2023-10-14T10:56:25.129 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-14T10:56:25.130 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425250 --name rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi -- /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425250/orig.config.yaml 2023-10-14T10:56:25.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T10:56:25.265 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425250 branch: rishabh-2023oct13 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} email: null first_in_suite: false job_id: '7425250' kernel: flavor: default kdb: true sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: rishabh-2023oct13 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023oct13 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6006 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 sleep_before_teardown: 0 subset: 402/512 suite: fs suite_branch: rishabh-2023oct13 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi026.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDPZroadSD0byLS/OQDU3rLFQxFrNb4uy/8dC1Q84XD54SKs2u9fZvALTgT2TlZqTou2kAJC3FXc4kmbpY/4Vrc= smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDaOgbq01oTcfIYZm6TGeOaOza33787dpNubwTK4SNRqD6Wz4P/rF8IfrmDKuzbcpBAWSWfoOcgzkXI7cr8x1EQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_pool_perm teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-13_18:04:14 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-14T10:56:25.266 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa; will attempt to use it 2023-10-14T10:56:25.267 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks 2023-10-14T10:56:25.267 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-14T10:56:25.269 INFO:teuthology.task.internal:Checking packages... 2023-10-14T10:56:25.293 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0' 2023-10-14T10:56:25.294 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-14T10:56:25.294 INFO:teuthology.packaging:ref: None 2023-10-14T10:56:25.295 INFO:teuthology.packaging:tag: None 2023-10-14T10:56:25.295 INFO:teuthology.packaging:branch: rishabh-2023oct13 2023-10-14T10:56:25.295 INFO:teuthology.packaging:sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T10:56:25.296 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=rishabh-2023oct13 2023-10-14T10:56:25.510 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6730-g4ba8a190-1jammy 2023-10-14T10:56:25.511 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-14T10:56:25.518 INFO:teuthology.task.internal:no buildpackages task found 2023-10-14T10:56:25.518 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-14T10:56:25.536 INFO:teuthology.task.internal:Saving configuration 2023-10-14T10:56:25.552 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-14T10:56:25.558 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T10:56:25.584 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425250', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 10:51:07.056865', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBO73NYNnM6xZIuiw6Gmi85LuRs2lBm/f0BBykQ6kjUe'} 2023-10-14T10:56:25.608 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425250', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 10:51:07.058604', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAhNNfK3eGeDKpmq6DMMnyY8GBtw+tHnP6KDBzYFDeZC'} 2023-10-14T10:56:25.609 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-14T10:56:25.615 INFO:teuthology.task.internal:roles: ubuntu@smithi026.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-14T10:56:25.615 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-14T10:56:25.616 INFO:teuthology.run_tasks:Running task console_log... 2023-10-14T10:56:25.685 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2db70deb80>, signals=[15]) 2023-10-14T10:56:25.686 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-14T10:56:25.691 INFO:teuthology.task.internal:Opening connections... 2023-10-14T10:56:25.692 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T10:56:25.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T10:56:25.769 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2023-10-14T10:56:25.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T10:56:25.844 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-14T10:56:25.851 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2023-10-14T10:56:25.857 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2023-10-14T10:56:25.858 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-10-14T10:56:25.908 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-14T10:56:25.908 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Ubuntu" 2023-10-14T10:56:25.909 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="22.04" 2023-10-14T10:56:25.909 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-14T10:56:25.909 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_CODENAME=jammy 2023-10-14T10:56:25.909 INFO:teuthology.orchestra.run.smithi026.stdout:ID=ubuntu 2023-10-14T10:56:25.909 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE=debian 2023-10-14T10:56:25.910 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-14T10:56:25.910 INFO:teuthology.orchestra.run.smithi026.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-14T10:56:25.910 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-14T10:56:25.910 INFO:teuthology.orchestra.run.smithi026.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-14T10:56:25.910 INFO:teuthology.orchestra.run.smithi026.stdout:UBUNTU_CODENAME=jammy 2023-10-14T10:56:25.911 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-10-14T10:56:25.931 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2023-10-14T10:56:25.936 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2023-10-14T10:56:25.936 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-10-14T10:56:25.981 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-14T10:56:25.981 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Ubuntu" 2023-10-14T10:56:25.982 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="22.04" 2023-10-14T10:56:25.982 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-14T10:56:25.982 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_CODENAME=jammy 2023-10-14T10:56:25.982 INFO:teuthology.orchestra.run.smithi110.stdout:ID=ubuntu 2023-10-14T10:56:25.982 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE=debian 2023-10-14T10:56:25.983 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-14T10:56:25.983 INFO:teuthology.orchestra.run.smithi110.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-14T10:56:25.983 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-14T10:56:25.983 INFO:teuthology.orchestra.run.smithi110.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-14T10:56:25.983 INFO:teuthology.orchestra.run.smithi110.stdout:UBUNTU_CODENAME=jammy 2023-10-14T10:56:25.984 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-10-14T10:56:26.006 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-14T10:56:26.016 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-14T10:56:26.022 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-14T10:56:26.022 DEBUG:teuthology.orchestra.run.smithi026:> test '!' -e /home/ubuntu/cephtest 2023-10-14T10:56:26.025 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2023-10-14T10:56:26.030 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-14T10:56:26.050 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-14T10:56:26.050 DEBUG:teuthology.orchestra.run.smithi026:> test -z $(ls -A /var/lib/ceph) 2023-10-14T10:56:26.074 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2023-10-14T10:56:26.096 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-14T10:56:26.151 INFO:teuthology.run_tasks:Running task kernel... 2023-10-14T10:56:26.166 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'} 2023-10-14T10:56:26.166 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, timeout 300 2023-10-14T10:56:26.167 DEBUG:teuthology.orchestra.run.smithi026:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T10:56:26.168 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T10:56:26.172 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T10:56:26.173 DEBUG:teuthology.task.kernel:sha1 for mon.a is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T10:56:26.173 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-14T10:56:26.174 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2023-10-14T10:56:26.174 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T10:56:26.175 DEBUG:teuthology.task.kernel:sha1 for mon.b is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T10:56:26.175 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-14T10:56:26.176 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2023-10-14T10:56:26.221 INFO:teuthology.orchestra.run.smithi026.stdout:5.15.0-56-generic 2023-10-14T10:56:26.221 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T10:56:26.222 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-14T10:56:26.222 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T10:56:26.227 INFO:teuthology.orchestra.run.smithi110.stdout:5.15.0-56-generic 2023-10-14T10:56:26.227 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T10:56:26.227 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-14T10:56:26.228 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T10:56:26.363 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-10-14T10:56:26.363 DEBUG:teuthology.orchestra.run.smithi026:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-10-14T10:56:26.379 INFO:teuthology.orchestra.run.smithi026.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-10-14T10:56:26.441 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2023-10-14T10:56:26.442 DEBUG:teuthology.orchestra.run.smithi110:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-10-14T10:56:26.455 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-10-14T10:56:26.515 INFO:teuthology.orchestra.run.smithi026.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-10-14T10:56:26.515 INFO:teuthology.orchestra.run.smithi026.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-10-14T10:56:26.515 INFO:teuthology.orchestra.run.smithi026.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-10-14T10:56:26.515 INFO:teuthology.orchestra.run.smithi026.stderr:hint: 2023-10-14T10:56:26.516 INFO:teuthology.orchestra.run.smithi026.stderr:hint: git config --global init.defaultBranch 2023-10-14T10:56:26.516 INFO:teuthology.orchestra.run.smithi026.stderr:hint: 2023-10-14T10:56:26.516 INFO:teuthology.orchestra.run.smithi026.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-10-14T10:56:26.516 INFO:teuthology.orchestra.run.smithi026.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-10-14T10:56:26.516 INFO:teuthology.orchestra.run.smithi026.stderr:hint: 2023-10-14T10:56:26.517 INFO:teuthology.orchestra.run.smithi026.stderr:hint: git branch -m 2023-10-14T10:56:26.517 INFO:teuthology.orchestra.run.smithi026.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-10-14T10:56:26.518 DEBUG:teuthology.orchestra.run.smithi026:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-10-14T10:56:26.572 INFO:teuthology.orchestra.run.smithi110.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-10-14T10:56:26.572 INFO:teuthology.orchestra.run.smithi110.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-10-14T10:56:26.573 INFO:teuthology.orchestra.run.smithi110.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-10-14T10:56:26.573 INFO:teuthology.orchestra.run.smithi110.stderr:hint: 2023-10-14T10:56:26.574 INFO:teuthology.orchestra.run.smithi110.stderr:hint: git config --global init.defaultBranch 2023-10-14T10:56:26.574 INFO:teuthology.orchestra.run.smithi110.stderr:hint: 2023-10-14T10:56:26.574 INFO:teuthology.orchestra.run.smithi110.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-10-14T10:56:26.575 INFO:teuthology.orchestra.run.smithi110.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-10-14T10:56:26.576 INFO:teuthology.orchestra.run.smithi110.stderr:hint: 2023-10-14T10:56:26.576 INFO:teuthology.orchestra.run.smithi110.stderr:hint: git branch -m 2023-10-14T10:56:26.577 INFO:teuthology.orchestra.run.smithi110.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-10-14T10:56:26.577 DEBUG:teuthology.orchestra.run.smithi110:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-10-14T10:56:26.586 DEBUG:teuthology.orchestra.run.smithi026:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-10-14T10:56:26.642 DEBUG:teuthology.orchestra.run.smithi026:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-10-14T10:56:26.655 DEBUG:teuthology.orchestra.run.smithi110:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-10-14T10:56:26.711 DEBUG:teuthology.orchestra.run.smithi110:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-10-14T10:57:23.763 INFO:teuthology.orchestra.run.smithi026.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-10-14T10:57:23.764 INFO:teuthology.orchestra.run.smithi026.stderr: * [new branch] main -> origin/main 2023-10-14T10:57:23.786 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20190312 -> 20190312 2023-10-14T10:57:23.787 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20190416 -> 20190416 2023-10-14T10:57:23.787 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20190514 -> 20190514 2023-10-14T10:57:23.787 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20190618 -> 20190618 2023-10-14T10:57:23.787 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20190717 -> 20190717 2023-10-14T10:57:23.788 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20190815 -> 20190815 2023-10-14T10:57:23.789 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20190923 -> 20190923 2023-10-14T10:57:23.789 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20191022 -> 20191022 2023-10-14T10:57:23.789 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20191215 -> 20191215 2023-10-14T10:57:23.789 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20200122 -> 20200122 2023-10-14T10:57:23.790 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20200316 -> 20200316 2023-10-14T10:57:23.790 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20200421 -> 20200421 2023-10-14T10:57:23.790 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20200519 -> 20200519 2023-10-14T10:57:23.790 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20200619 -> 20200619 2023-10-14T10:57:23.790 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20200721 -> 20200721 2023-10-14T10:57:23.793 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20200817 -> 20200817 2023-10-14T10:57:23.794 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20200918 -> 20200918 2023-10-14T10:57:23.794 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20201022 -> 20201022 2023-10-14T10:57:23.794 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20201118 -> 20201118 2023-10-14T10:57:23.794 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20201218 -> 20201218 2023-10-14T10:57:23.794 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20210208 -> 20210208 2023-10-14T10:57:23.795 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20210315 -> 20210315 2023-10-14T10:57:23.795 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20210511 -> 20210511 2023-10-14T10:57:23.795 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20210716 -> 20210716 2023-10-14T10:57:23.795 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20210818 -> 20210818 2023-10-14T10:57:23.796 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20210919 -> 20210919 2023-10-14T10:57:23.796 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20211027 -> 20211027 2023-10-14T10:57:23.796 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20211216 -> 20211216 2023-10-14T10:57:23.796 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20220209 -> 20220209 2023-10-14T10:57:23.796 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20220310 -> 20220310 2023-10-14T10:57:23.797 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20220411 -> 20220411 2023-10-14T10:57:23.797 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20220509 -> 20220509 2023-10-14T10:57:23.797 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20220610 -> 20220610 2023-10-14T10:57:23.797 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20220708 -> 20220708 2023-10-14T10:57:23.797 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20220815 -> 20220815 2023-10-14T10:57:23.797 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20220913 -> 20220913 2023-10-14T10:57:23.798 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20221012 -> 20221012 2023-10-14T10:57:23.798 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20221109 -> 20221109 2023-10-14T10:57:23.798 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20221214 -> 20221214 2023-10-14T10:57:23.798 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20230117 -> 20230117 2023-10-14T10:57:23.798 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20230210 -> 20230210 2023-10-14T10:57:23.799 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20230310 -> 20230310 2023-10-14T10:57:23.799 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20230404 -> 20230404 2023-10-14T10:57:23.799 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20230515 -> 20230515 2023-10-14T10:57:23.799 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20230625 -> 20230625 2023-10-14T10:57:23.799 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20230804 -> 20230804 2023-10-14T10:57:23.799 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20230919 -> 20230919 2023-10-14T10:57:26.759 INFO:teuthology.orchestra.run.smithi110.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-10-14T10:57:26.759 INFO:teuthology.orchestra.run.smithi110.stderr: * [new branch] main -> origin/main 2023-10-14T10:57:26.789 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20190312 -> 20190312 2023-10-14T10:57:26.789 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20190416 -> 20190416 2023-10-14T10:57:26.789 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20190514 -> 20190514 2023-10-14T10:57:26.789 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20190618 -> 20190618 2023-10-14T10:57:26.789 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20190717 -> 20190717 2023-10-14T10:57:26.790 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20190815 -> 20190815 2023-10-14T10:57:26.790 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20190923 -> 20190923 2023-10-14T10:57:26.793 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20191022 -> 20191022 2023-10-14T10:57:26.793 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20191215 -> 20191215 2023-10-14T10:57:26.793 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200122 -> 20200122 2023-10-14T10:57:26.794 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200316 -> 20200316 2023-10-14T10:57:26.794 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200421 -> 20200421 2023-10-14T10:57:26.794 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200519 -> 20200519 2023-10-14T10:57:26.794 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200619 -> 20200619 2023-10-14T10:57:26.794 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200721 -> 20200721 2023-10-14T10:57:26.795 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200817 -> 20200817 2023-10-14T10:57:26.795 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200918 -> 20200918 2023-10-14T10:57:26.795 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20201022 -> 20201022 2023-10-14T10:57:26.795 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20201118 -> 20201118 2023-10-14T10:57:26.795 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20201218 -> 20201218 2023-10-14T10:57:26.796 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20210208 -> 20210208 2023-10-14T10:57:26.796 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20210315 -> 20210315 2023-10-14T10:57:26.796 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20210511 -> 20210511 2023-10-14T10:57:26.796 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20210716 -> 20210716 2023-10-14T10:57:26.796 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20210818 -> 20210818 2023-10-14T10:57:26.796 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20210919 -> 20210919 2023-10-14T10:57:26.797 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20211027 -> 20211027 2023-10-14T10:57:26.797 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20211216 -> 20211216 2023-10-14T10:57:26.797 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220209 -> 20220209 2023-10-14T10:57:26.797 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220310 -> 20220310 2023-10-14T10:57:26.797 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220411 -> 20220411 2023-10-14T10:57:26.797 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220509 -> 20220509 2023-10-14T10:57:26.798 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220610 -> 20220610 2023-10-14T10:57:26.798 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220708 -> 20220708 2023-10-14T10:57:26.798 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220815 -> 20220815 2023-10-14T10:57:26.798 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220913 -> 20220913 2023-10-14T10:57:26.798 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20221012 -> 20221012 2023-10-14T10:57:26.799 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20221109 -> 20221109 2023-10-14T10:57:26.800 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20221214 -> 20221214 2023-10-14T10:57:26.800 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230117 -> 20230117 2023-10-14T10:57:26.800 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230210 -> 20230210 2023-10-14T10:57:26.800 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230310 -> 20230310 2023-10-14T10:57:26.800 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230404 -> 20230404 2023-10-14T10:57:26.801 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230515 -> 20230515 2023-10-14T10:57:26.801 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230625 -> 20230625 2023-10-14T10:57:26.801 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230804 -> 20230804 2023-10-14T10:57:26.801 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230919 -> 20230919 2023-10-14T10:57:27.683 INFO:teuthology.orchestra.run.smithi026.stderr:Updating files: 49% (1548/3159) Updating files: 50% (1580/3159) Updating files: 51% (1612/3159) Updating files: 52% (1643/3159) Updating files: 53% (1675/3159) Updating files: 54% (1706/3159) Updating files: 55% (1738/3159) Updating files: 56% (1770/3159) Updating files: 57% (1801/3159) Updating files: 58% (1833/3159) Updating files: 59% (1864/3159) Updating files: 60% (1896/3159) Updating files: 61% (1927/3159) Updating files: 62% (1959/3159) Updating files: 63% (1991/3159) Updating files: 64% (2022/3159) Updating files: 64% (2029/3159) Updating files: 65% (2054/3159) Updating files: 66% (2085/3159) Updating files: 67% (2117/3159) Updating files: 68% (2149/3159) Updating files: 69% (2180/3159) Updating files: 70% (2212/3159) Updating files: 71% (2243/3159) Updating files: 72% (2275/3159) Updating files: 73% (2307/3159) Updating files: 74% (2338/3159) Updating files: 75% (2370/3159) Updating files: 76% (2401/3159) Updating files: 77% (2433/3159) Updating files: 78% (2465/3159) Updating files: 79% (2496/3159) Updating files: 80% (2528/3159) Updating files: 81% (2559/3159) Updating files: 81% (2573/3159) Updating files: 82% (2591/3159) Updating files: 83% (2622/3159) Updating files: 84% (2654/3159) Updating files: 85% (2686/3159) Updating files: 86% (2717/3159) Updating files: 87% (2749/3159) Updating files: 88% (2780/3159) Updating files: 89% (2812/3159) Updating files: 90% (2844/3159) Updating files: 91% (2875/3159) Updating files: 92% (2907/3159) Updating files: 93% (2938/3159) Updating files: 94% (2970/3159) Updating files: 95% (3002/3159) Updating files: 96% (3033/3159) Updating files: 97% (3065/3159) Updating files: 98% (3096/3159) Updating files: 99% (3128/3159) Updating files: 100% (3159/3159) Updating files: 100% (3159/3159), done. 2023-10-14T10:57:27.688 INFO:teuthology.orchestra.run.smithi026.stdout:HEAD is now at 1be48f85 Merge branch 'pr-24-1697222431' into 'main' 2023-10-14T10:57:27.709 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.a... 2023-10-14T10:57:27.709 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T10:57:27.854 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/ 2023-10-14T10:57:27.855 DEBUG:teuthology.orchestra.run.smithi026:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-rc5-g47672119149b_6.6.0-rc5-g47672119149b-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/ --input-file=- 2023-10-14T10:57:27.857 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi026.front.sepia.ceph.com to complete... 2023-10-14T10:57:30.474 INFO:teuthology.orchestra.run.smithi110.stderr:Updating files: 51% (1629/3159) Updating files: 52% (1643/3159) Updating files: 53% (1675/3159) Updating files: 54% (1706/3159) Updating files: 55% (1738/3159) Updating files: 56% (1770/3159) Updating files: 57% (1801/3159) Updating files: 58% (1833/3159) Updating files: 59% (1864/3159) Updating files: 60% (1896/3159) Updating files: 61% (1927/3159) Updating files: 62% (1959/3159) Updating files: 63% (1991/3159) Updating files: 64% (2022/3159) Updating files: 65% (2054/3159) Updating files: 66% (2085/3159) Updating files: 66% (2104/3159) Updating files: 67% (2117/3159) Updating files: 68% (2149/3159) Updating files: 69% (2180/3159) Updating files: 70% (2212/3159) Updating files: 71% (2243/3159) Updating files: 72% (2275/3159) Updating files: 73% (2307/3159) Updating files: 74% (2338/3159) Updating files: 75% (2370/3159) Updating files: 76% (2401/3159) Updating files: 77% (2433/3159) Updating files: 78% (2465/3159) Updating files: 79% (2496/3159) Updating files: 80% (2528/3159) Updating files: 81% (2559/3159) Updating files: 81% (2587/3159) Updating files: 82% (2591/3159) Updating files: 83% (2622/3159) Updating files: 84% (2654/3159) Updating files: 85% (2686/3159) Updating files: 86% (2717/3159) Updating files: 87% (2749/3159) Updating files: 88% (2780/3159) Updating files: 89% (2812/3159) Updating files: 90% (2844/3159) Updating files: 91% (2875/3159) Updating files: 92% (2907/3159) Updating files: 93% (2938/3159) Updating files: 94% (2970/3159) Updating files: 95% (3002/3159) Updating files: 96% (3033/3159) Updating files: 97% (3065/3159) Updating files: 98% (3096/3159) Updating files: 99% (3128/3159) Updating files: 100% (3159/3159) Updating files: 100% (3159/3159), done. 2023-10-14T10:57:30.478 INFO:teuthology.orchestra.run.smithi110.stdout:HEAD is now at 1be48f85 Merge branch 'pr-24-1697222431' into 'main' 2023-10-14T10:57:30.497 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.b... 2023-10-14T10:57:30.498 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T10:57:30.730 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/ 2023-10-14T10:57:30.731 DEBUG:teuthology.orchestra.run.smithi110:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-rc5-g47672119149b_6.6.0-rc5-g47672119149b-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/ --input-file=- 2023-10-14T10:57:30.733 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi110.front.sepia.ceph.com to complete... 2023-10-14T10:57:33.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14 10:57:33 URL:https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/linux-image-6.6.0-rc5-g47672119149b_6.6.0-rc5-g47672119149b-1_amd64.deb [38909314/38909314] -> "/tmp/linux-image.deb" [1] 2023-10-14T10:57:33.691 INFO:teuthology.orchestra.run.smithi026.stderr:FINISHED --2023-10-14 10:57:33-- 2023-10-14T10:57:33.691 INFO:teuthology.orchestra.run.smithi026.stderr:Total wall clock time: 5.8s 2023-10-14T10:57:33.692 INFO:teuthology.orchestra.run.smithi026.stderr:Downloaded: 1 files, 37M in 5.4s (6.82 MB/s) 2023-10-14T10:57:33.694 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.a... 2023-10-14T10:57:33.694 DEBUG:teuthology.orchestra.run.smithi026:> sudo dpkg -i /tmp/linux-image.deb 2023-10-14T10:57:33.951 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package linux-image-6.6.0-rc5-g47672119149b. 2023-10-14T10:57:34.649 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14 10:57:34 URL:https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/linux-image-6.6.0-rc5-g47672119149b_6.6.0-rc5-g47672119149b-1_amd64.deb [38909314/38909314] -> "/tmp/linux-image.deb" [1] 2023-10-14T10:57:34.650 INFO:teuthology.orchestra.run.smithi110.stderr:FINISHED --2023-10-14 10:57:34-- 2023-10-14T10:57:34.650 INFO:teuthology.orchestra.run.smithi110.stderr:Total wall clock time: 3.8s 2023-10-14T10:57:34.650 INFO:teuthology.orchestra.run.smithi110.stderr:Downloaded: 1 files, 37M in 3.5s (10.6 MB/s) 2023-10-14T10:57:34.651 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.b... 2023-10-14T10:57:34.651 DEBUG:teuthology.orchestra.run.smithi110:> sudo dpkg -i /tmp/linux-image.deb 2023-10-14T10:57:34.929 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-image-6.6.0-rc5-g47672119149b. 2023-10-14T10:57:35.882 INFO:teuthology.orchestra.run.smithi026.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-10-14T10:57:35.887 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-10-14T10:57:35.988 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking linux-image-6.6.0-rc5-g47672119149b (6.6.0-rc5-g47672119149b-1) ... 2023-10-14T10:57:36.897 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-10-14T10:57:36.901 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-10-14T10:57:37.076 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-image-6.6.0-rc5-g47672119149b (6.6.0-rc5-g47672119149b-1) ... 2023-10-14T10:57:39.260 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up linux-image-6.6.0-rc5-g47672119149b (6.6.0-rc5-g47672119149b-1) ... 2023-10-14T10:57:39.357 INFO:teuthology.orchestra.run.smithi026.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-14T10:57:40.141 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-image-6.6.0-rc5-g47672119149b (6.6.0-rc5-g47672119149b-1) ... 2023-10-14T10:57:40.254 INFO:teuthology.orchestra.run.smithi110.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-14T10:57:58.388 INFO:teuthology.orchestra.run.smithi026.stderr:Sourcing file `/etc/default/grub' 2023-10-14T10:57:58.401 INFO:teuthology.orchestra.run.smithi026.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-14T10:57:58.467 INFO:teuthology.orchestra.run.smithi026.stderr:Generating grub configuration file ... 2023-10-14T10:57:58.818 INFO:teuthology.orchestra.run.smithi026.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-14T10:57:58.835 INFO:teuthology.orchestra.run.smithi026.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-14T10:57:59.029 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub' 2023-10-14T10:57:59.037 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-14T10:57:59.059 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2023-10-14T10:57:59.207 INFO:teuthology.orchestra.run.smithi026.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-14T10:57:59.219 INFO:teuthology.orchestra.run.smithi026.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-14T10:57:59.285 INFO:teuthology.orchestra.run.smithi026.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-14T10:57:59.292 INFO:teuthology.orchestra.run.smithi026.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-14T10:57:59.344 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-14T10:57:59.361 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-14T10:57:59.431 INFO:teuthology.orchestra.run.smithi026.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-14T10:57:59.432 INFO:teuthology.orchestra.run.smithi026.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-10-14T10:57:59.432 INFO:teuthology.orchestra.run.smithi026.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-14T10:57:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:done 2023-10-14T10:57:59.630 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-14T10:57:59.637 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-14T10:57:59.665 DEBUG:teuthology.orchestra.run.smithi026:> dpkg-deb -c /tmp/linux-image.deb 2023-10-14T10:57:59.673 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./ 2023-10-14T10:57:59.673 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./boot/ 2023-10-14T10:57:59.674 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 4415097 2023-10-10 19:56 ./boot/System.map-6.6.0-rc5-g47672119149b 2023-10-14T10:57:59.683 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 169298 2023-10-10 19:56 ./boot/config-6.6.0-rc5-g47672119149b 2023-10-14T10:57:59.684 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11352928 2023-10-10 19:56 ./boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-14T10:57:59.702 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/ 2023-10-14T10:57:59.702 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/kernel/ 2023-10-14T10:57:59.702 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/kernel/postinst.d/ 2023-10-14T10:57:59.703 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/kernel/postrm.d/ 2023-10-14T10:57:59.703 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/kernel/preinst.d/ 2023-10-14T10:57:59.703 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/kernel/prerm.d/ 2023-10-14T10:57:59.703 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/ 2023-10-14T10:57:59.704 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/ 2023-10-14T10:57:59.704 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/ 2023-10-14T10:57:59.704 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/ 2023-10-14T10:57:59.704 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/ 2023-10-14T10:57:59.704 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/ 2023-10-14T10:57:59.704 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ 2023-10-14T10:57:59.705 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 490233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/aesni-intel.ko 2023-10-14T10:57:59.705 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-14T10:57:59.708 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-14T10:57:59.708 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-14T10:57:59.708 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-14T10:57:59.708 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 93113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-14T10:57:59.709 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 106729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-14T10:57:59.709 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 152241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-14T10:57:59.709 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-14T10:57:59.709 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-14T10:57:59.709 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 83889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-14T10:57:59.709 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-14T10:57:59.710 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-14T10:57:59.710 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-14T10:57:59.710 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-14T10:57:59.710 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-14T10:57:59.710 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-14T10:57:59.711 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 58585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-14T10:57:59.711 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-14T10:57:59.711 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-14T10:57:59.711 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-14T10:57:59.711 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/ 2023-10-14T10:57:59.712 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/ 2023-10-14T10:57:59.712 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/ 2023-10-14T10:57:59.712 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-14T10:57:59.712 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpuid.ko 2023-10-14T10:57:59.712 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/msr.ko 2023-10-14T10:57:59.713 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/ 2023-10-14T10:57:59.713 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 353761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-14T10:57:59.713 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 881713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-14T10:57:59.713 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 2276817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-14T10:57:59.714 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-14T10:57:59.770 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ 2023-10-14T10:57:59.770 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 53761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/af_alg.ko 2023-10-14T10:57:59.770 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/algif_hash.ko 2023-10-14T10:57:59.771 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/algif_skcipher.ko 2023-10-14T10:57:59.771 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-14T10:57:59.771 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-14T10:57:59.771 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-14T10:57:59.771 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/asymmetric_keys/ 2023-10-14T10:57:59.772 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-10-14T10:57:59.772 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/ 2023-10-14T10:57:59.772 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-14T10:57:59.772 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-14T10:57:59.772 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-14T10:57:59.773 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-14T10:57:59.773 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-14T10:57:59.773 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-14T10:57:59.773 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-14T10:57:59.773 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-14T10:57:59.774 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-14T10:57:59.774 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-14T10:57:59.774 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-14T10:57:59.774 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-14T10:57:59.774 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-14T10:57:59.775 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-14T10:57:59.775 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-14T10:57:59.775 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-14T10:57:59.775 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-14T10:57:59.776 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-14T10:57:59.776 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cryptd.ko 2023-10-14T10:57:59.776 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-14T10:57:59.776 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_simd.ko 2023-10-14T10:57:59.776 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-14T10:57:59.776 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-14T10:57:59.777 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-14T10:57:59.777 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-14T10:57:59.777 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-14T10:57:59.777 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-14T10:57:59.777 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-14T10:57:59.778 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-14T10:57:59.778 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lrw.ko 2023-10-14T10:57:59.778 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-14T10:57:59.778 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-14T10:57:59.778 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-14T10:57:59.779 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-14T10:57:59.779 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-14T10:57:59.779 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-14T10:57:59.779 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-14T10:57:59.779 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-14T10:57:59.780 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-14T10:57:59.780 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 149193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-14T10:57:59.780 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-14T10:57:59.780 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-14T10:57:59.780 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-14T10:57:59.781 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-14T10:57:59.781 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-14T10:57:59.781 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-14T10:57:59.781 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-14T10:57:59.781 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xts.ko 2023-10-14T10:57:59.782 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-14T10:57:59.782 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ 2023-10-14T10:57:59.782 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ 2023-10-14T10:57:59.782 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_extlog.ko 2023-10-14T10:57:59.782 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-14T10:57:59.782 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-14T10:57:59.783 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/apei/ 2023-10-14T10:57:59.783 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/apei/einj.ko 2023-10-14T10:57:59.783 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-14T10:57:59.783 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-14T10:57:59.783 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-14T10:57:59.784 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-14T10:57:59.784 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 103025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-14T10:57:59.784 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ 2023-10-14T10:57:59.784 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-14T10:57:59.784 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 88865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci.ko 2023-10-14T10:57:59.785 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-14T10:57:59.785 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 88289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci.ko 2023-10-14T10:57:59.785 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-14T10:57:59.785 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-14T10:57:59.785 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-14T10:57:59.786 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-14T10:57:59.786 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-14T10:57:59.786 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-14T10:57:59.786 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-14T10:57:59.786 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-14T10:57:59.787 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-14T10:57:59.787 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-14T10:57:59.787 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-14T10:57:59.787 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-14T10:57:59.787 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-14T10:57:59.788 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-14T10:57:59.788 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-14T10:57:59.788 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-14T10:57:59.788 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-14T10:57:59.788 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-14T10:57:59.789 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_legacy.ko 2023-10-14T10:57:59.789 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-14T10:57:59.789 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-14T10:57:59.789 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-14T10:57:59.789 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-14T10:57:59.789 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-14T10:57:59.790 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-14T10:57:59.790 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-14T10:57:59.790 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-14T10:57:59.790 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-14T10:57:59.790 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-14T10:57:59.791 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-14T10:57:59.791 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-14T10:57:59.791 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-14T10:57:59.791 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_radisys.ko 2023-10-14T10:57:59.791 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-14T10:57:59.792 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rz1000.ko 2023-10-14T10:57:59.792 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-14T10:57:59.792 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-14T10:57:59.792 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-14T10:57:59.792 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-14T10:57:59.793 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-14T10:57:59.793 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-14T10:57:59.793 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-14T10:57:59.793 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-14T10:57:59.793 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 83345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-14T10:57:59.794 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 70393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-14T10:57:59.794 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-14T10:57:59.794 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-14T10:57:59.794 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-14T10:57:59.794 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-14T10:57:59.795 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-14T10:57:59.795 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-14T10:57:59.795 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-14T10:57:59.795 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-14T10:57:59.795 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-14T10:57:59.796 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-14T10:57:59.796 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ 2023-10-14T10:57:59.796 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-14T10:57:59.796 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/ 2023-10-14T10:57:59.796 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 124473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-14T10:57:59.796 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/ 2023-10-14T10:57:59.797 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/ 2023-10-14T10:57:59.797 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 113665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-14T10:57:59.797 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/ 2023-10-14T10:57:59.797 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 965585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-14T10:57:59.797 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 173225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-14T10:57:59.798 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/ 2023-10-14T10:57:59.798 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 94297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-14T10:57:59.798 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 115793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-14T10:57:59.798 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/ 2023-10-14T10:57:59.798 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 110449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-14T10:57:59.799 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 98193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-14T10:57:59.799 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 263769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-14T10:57:59.799 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/ 2023-10-14T10:57:59.799 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 98145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-14T10:57:59.799 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/ 2023-10-14T10:57:59.800 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 60217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-14T10:57:59.800 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ 2023-10-14T10:57:59.800 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/applicom.ko 2023-10-14T10:57:59.800 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-14T10:57:59.800 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/ 2023-10-14T10:57:59.801 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-14T10:57:59.801 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-14T10:57:59.801 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-14T10:57:59.801 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-14T10:57:59.801 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-14T10:57:59.802 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ 2023-10-14T10:57:59.802 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-14T10:57:59.802 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 148601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-14T10:57:59.802 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-14T10:57:59.803 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 139313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-14T10:57:59.803 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 70921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-14T10:57:59.803 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 53513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-14T10:57:59.803 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-14T10:57:59.803 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/ 2023-10-14T10:57:59.804 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 84097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-14T10:57:59.804 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/nvram.ko 2023-10-14T10:57:59.804 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-14T10:57:59.804 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-14T10:57:59.804 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/ 2023-10-14T10:57:59.805 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-14T10:57:59.805 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-10-14T10:57:59.805 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-10-14T10:57:59.805 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-10-14T10:57:59.805 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-14T10:57:59.806 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-14T10:57:59.806 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-10-14T10:57:59.806 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/ 2023-10-14T10:57:59.806 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_class.ko 2023-10-14T10:57:59.806 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_core.ko 2023-10-14T10:57:59.807 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-10-14T10:57:59.807 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/ 2023-10-14T10:57:59.807 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-palmas.ko 2023-10-14T10:57:59.807 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-si5351.ko 2023-10-14T10:57:59.807 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-twl6040.ko 2023-10-14T10:57:59.807 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-wm831x.ko 2023-10-14T10:57:59.808 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/ 2023-10-14T10:57:59.808 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-14T10:57:59.808 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-14T10:57:59.808 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-14T10:57:59.808 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ 2023-10-14T10:57:59.809 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ 2023-10-14T10:57:59.809 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 70801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-14T10:57:59.809 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 243025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-14T10:57:59.809 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/ 2023-10-14T10:57:59.809 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/ 2023-10-14T10:57:59.810 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/ 2023-10-14T10:57:59.810 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 438761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-14T10:57:59.810 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-10-14T10:57:59.810 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-14T10:57:59.810 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-14T10:57:59.811 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-14T10:57:59.811 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/ 2023-10-14T10:57:59.811 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 68857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-14T10:57:59.811 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/ 2023-10-14T10:57:59.811 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-14T10:57:59.812 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ 2023-10-14T10:57:59.812 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/ 2023-10-14T10:57:59.812 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-14T10:57:59.812 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ 2023-10-14T10:57:59.812 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 122569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-14T10:57:59.812 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ 2023-10-14T10:57:59.813 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 79953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-14T10:57:59.813 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-14T10:57:59.813 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 63617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-14T10:57:59.813 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-14T10:57:59.813 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-14T10:57:59.814 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-14T10:57:59.814 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-14T10:57:59.814 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-14T10:57:59.814 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 52041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-14T10:57:59.814 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-14T10:57:59.815 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-14T10:57:59.815 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 56825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-14T10:57:59.815 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-14T10:57:59.815 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/ 2023-10-14T10:57:59.815 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-gpio.ko 2023-10-14T10:57:59.815 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max14577.ko 2023-10-14T10:57:59.816 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max77693.ko 2023-10-14T10:57:59.816 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max8997.ko 2023-10-14T10:57:59.816 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-palmas.ko 2023-10-14T10:57:59.816 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-rt8973a.ko 2023-10-14T10:57:59.816 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-sm5502.ko 2023-10-14T10:57:59.817 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/ 2023-10-14T10:57:59.817 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/dmi-sysfs.ko 2023-10-14T10:57:59.817 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/efi/ 2023-10-14T10:57:59.817 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/efi/efi-pstore.ko 2023-10-14T10:57:59.817 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-14T10:57:59.818 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/ 2023-10-14T10:57:59.818 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-adp5520.ko 2023-10-14T10:57:59.818 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-amd8111.ko 2023-10-14T10:57:59.818 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-arizona.ko 2023-10-14T10:57:59.818 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-da9052.ko 2023-10-14T10:57:59.819 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-da9055.ko 2023-10-14T10:57:59.819 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-dln2.ko 2023-10-14T10:57:59.819 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 77849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-f7188x.ko 2023-10-14T10:57:59.819 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-generic.ko 2023-10-14T10:57:59.819 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-14T10:57:59.820 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-10-14T10:57:59.820 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-kempld.ko 2023-10-14T10:57:59.820 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-lp3943.ko 2023-10-14T10:57:59.820 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max7300.ko 2023-10-14T10:57:59.820 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max730x.ko 2023-10-14T10:57:59.820 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max732x.ko 2023-10-14T10:57:59.821 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-10-14T10:57:59.821 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-pca953x.ko 2023-10-14T10:57:59.821 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-pcf857x.ko 2023-10-14T10:57:59.821 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-rdc321x.ko 2023-10-14T10:57:59.821 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-sch.ko 2023-10-14T10:57:59.822 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-sch311x.ko 2023-10-14T10:57:59.822 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-tps65912.ko 2023-10-14T10:57:59.822 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-twl4030.ko 2023-10-14T10:57:59.822 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-twl6040.ko 2023-10-14T10:57:59.822 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-14T10:57:59.823 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-vx855.ko 2023-10-14T10:57:59.823 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm831x.ko 2023-10-14T10:57:59.823 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm8350.ko 2023-10-14T10:57:59.823 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm8994.ko 2023-10-14T10:57:59.823 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/ 2023-10-14T10:57:59.823 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-a4tech.ko 2023-10-14T10:57:59.824 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-apple.ko 2023-10-14T10:57:59.824 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-14T10:57:59.824 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-14T10:57:59.824 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-14T10:57:59.824 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-belkin.ko 2023-10-14T10:57:59.825 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cherry.ko 2023-10-14T10:57:59.825 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-chicony.ko 2023-10-14T10:57:59.825 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 60649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cp2112.ko 2023-10-14T10:57:59.825 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cypress.ko 2023-10-14T10:57:59.825 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-14T10:57:59.826 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-14T10:57:59.826 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-14T10:57:59.826 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-14T10:57:59.826 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ezkey.ko 2023-10-14T10:57:59.826 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-14T10:57:59.826 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-generic.ko 2023-10-14T10:57:59.827 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-14T10:57:59.827 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-14T10:57:59.827 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-14T10:57:59.827 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-14T10:57:59.827 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-14T10:57:59.828 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-14T10:57:59.828 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-14T10:57:59.828 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kensington.ko 2023-10-14T10:57:59.828 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-14T10:57:59.828 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-14T10:57:59.828 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-14T10:57:59.829 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-14T10:57:59.829 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-14T10:57:59.829 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lg-g15.ko 2023-10-14T10:57:59.829 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 58185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-14T10:57:59.829 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 101369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-14T10:57:59.830 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 80993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech.ko 2023-10-14T10:57:59.830 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-magicmouse.ko 2023-10-14T10:57:59.830 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-microsoft.ko 2023-10-14T10:57:59.830 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-monterey.ko 2023-10-14T10:57:59.830 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-14T10:57:59.831 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ntrig.ko 2023-10-14T10:57:59.831 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-14T10:57:59.831 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-14T10:57:59.831 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-14T10:57:59.831 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 72937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-14T10:57:59.832 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-14T10:57:59.834 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-14T10:57:59.834 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-14T10:57:59.834 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-14T10:57:59.834 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-14T10:57:59.834 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-14T10:57:59.835 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-14T10:57:59.835 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-14T10:57:59.835 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-14T10:57:59.835 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-14T10:57:59.835 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-14T10:57:59.836 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-14T10:57:59.836 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-14T10:57:59.836 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-14T10:57:59.836 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-14T10:57:59.836 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-14T10:57:59.837 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-14T10:57:59.837 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-14T10:57:59.837 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-14T10:57:59.837 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-14T10:57:59.837 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-14T10:57:59.837 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-14T10:57:59.838 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-14T10:57:59.838 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-14T10:57:59.838 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-14T10:57:59.838 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-14T10:57:59.838 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-14T10:57:59.839 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-14T10:57:59.839 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-14T10:57:59.839 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 71073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-14T10:57:59.839 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-14T10:57:59.839 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 143473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-14T10:57:59.840 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-14T10:57:59.840 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-14T10:57:59.840 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-14T10:57:59.840 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 267825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid.ko 2023-10-14T10:57:59.840 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-14T10:57:59.841 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/ 2023-10-14T10:57:59.841 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 125721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbhid.ko 2023-10-14T10:57:59.841 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbkbd.ko 2023-10-14T10:57:59.841 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbmouse.ko 2023-10-14T10:57:59.841 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 217873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-14T10:57:59.842 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/ 2023-10-14T10:57:59.842 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 64201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-14T10:57:59.842 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 89625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-14T10:57:59.842 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 305465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-14T10:57:59.842 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ 2023-10-14T10:57:59.843 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 66521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-14T10:57:59.843 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 61393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-14T10:57:59.843 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-14T10:57:59.843 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-14T10:57:59.843 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-14T10:57:59.844 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-14T10:57:59.844 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-14T10:57:59.844 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 97977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-14T10:57:59.844 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-14T10:57:59.844 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 45553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-14T10:57:59.845 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-14T10:57:59.845 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-14T10:57:59.845 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-14T10:57:59.845 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-14T10:57:59.845 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 74433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-14T10:57:59.846 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-14T10:57:59.846 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 67929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-14T10:57:59.846 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-14T10:57:59.846 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-14T10:57:59.846 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 55265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-14T10:57:59.847 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-14T10:57:59.847 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 58617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-14T10:57:59.847 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-14T10:57:59.847 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-14T10:57:59.847 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-14T10:57:59.848 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/da9052-hwmon.ko 2023-10-14T10:57:59.848 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/da9055-hwmon.ko 2023-10-14T10:57:59.848 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-14T10:57:59.848 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 99601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-14T10:57:59.848 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-14T10:57:59.848 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-14T10:57:59.849 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-14T10:57:59.849 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc2103.ko 2023-10-14T10:57:59.849 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-14T10:57:59.849 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 66985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-14T10:57:59.849 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 94457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-14T10:57:59.850 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-14T10:57:59.850 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-14T10:57:59.850 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 55449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-14T10:57:59.850 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-14T10:57:59.850 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-14T10:57:59.851 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 46801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-14T10:57:59.851 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 45529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-14T10:57:59.851 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hih6130.ko 2023-10-14T10:57:59.851 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-14T10:57:59.851 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-14T10:57:59.852 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-14T10:57:59.852 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-14T10:57:59.852 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-14T10:57:59.852 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-14T10:57:59.852 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-14T10:57:59.853 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 130449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-14T10:57:59.853 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/jc42.ko 2023-10-14T10:57:59.853 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-14T10:57:59.853 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-14T10:57:59.853 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-14T10:57:59.854 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 48601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-14T10:57:59.854 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-14T10:57:59.854 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-14T10:57:59.854 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-14T10:57:59.854 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-14T10:57:59.854 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-14T10:57:59.855 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-14T10:57:59.855 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 72833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-14T10:57:59.855 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 46153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-14T10:57:59.855 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-14T10:57:59.855 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-14T10:57:59.856 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 108841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-14T10:57:59.856 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-14T10:57:59.856 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-14T10:57:59.856 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-14T10:57:59.856 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-14T10:57:59.857 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-14T10:57:59.857 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-14T10:57:59.857 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-14T10:57:59.857 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-14T10:57:59.857 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-14T10:57:59.857 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-14T10:57:59.858 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-14T10:57:59.858 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-14T10:57:59.858 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-14T10:57:59.858 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-14T10:57:59.858 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-14T10:57:59.859 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-14T10:57:59.859 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-14T10:57:59.859 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mc13783-adc.ko 2023-10-14T10:57:59.859 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-14T10:57:59.859 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-10-14T10:57:59.860 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-14T10:57:59.860 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 119817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-14T10:57:59.860 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 60705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-14T10:57:59.860 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 59737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-14T10:57:59.860 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 82337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-14T10:57:59.860 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 54433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-14T10:57:59.861 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-14T10:57:59.861 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ 2023-10-14T10:57:59.861 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-14T10:57:59.861 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-14T10:57:59.861 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-14T10:57:59.862 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-14T10:57:59.862 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-14T10:57:59.862 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-14T10:57:59.862 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-14T10:57:59.862 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 82577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-14T10:57:59.863 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-14T10:57:59.863 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-14T10:57:59.863 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-14T10:57:59.863 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-14T10:57:59.863 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-14T10:57:59.864 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-14T10:57:59.864 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-14T10:57:59.864 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-14T10:57:59.864 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-14T10:57:59.864 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-14T10:57:59.864 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-14T10:57:59.865 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-14T10:57:59.865 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-14T10:57:59.865 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-14T10:57:59.865 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-14T10:57:59.865 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-14T10:57:59.866 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-14T10:57:59.866 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-14T10:57:59.866 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-14T10:57:59.866 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-14T10:57:59.866 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-14T10:57:59.867 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-14T10:57:59.867 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 52457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-14T10:57:59.867 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-14T10:57:59.867 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 57513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-14T10:57:59.867 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 78873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-14T10:57:59.868 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 71345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-14T10:57:59.868 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 63289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-14T10:57:59.868 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 71321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-14T10:57:59.868 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 101473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-14T10:57:59.868 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 119505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-14T10:57:59.869 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-14T10:57:59.869 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-14T10:57:59.869 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-10-14T10:57:59.869 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-10-14T10:57:59.869 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/ 2023-10-14T10:57:59.870 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/ 2023-10-14T10:57:59.870 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-14T10:57:59.870 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-14T10:57:59.870 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/ 2023-10-14T10:57:59.870 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-10-14T10:57:59.871 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-10-14T10:57:59.871 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-10-14T10:57:59.871 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-14T10:57:59.871 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-14T10:57:59.871 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-14T10:57:59.872 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-10-14T10:57:59.872 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 6929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-14T10:57:59.872 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-10-14T10:57:59.872 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-14T10:57:59.872 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-14T10:57:59.872 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-14T10:57:59.873 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-14T10:57:59.873 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-10-14T10:57:59.873 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-10-14T10:57:59.873 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 62817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-14T10:57:59.873 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-14T10:57:59.874 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-14T10:57:59.874 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-10-14T10:57:59.874 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-14T10:57:59.874 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-14T10:57:59.874 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-10-14T10:57:59.875 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-14T10:57:59.875 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-14T10:57:59.875 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-14T10:57:59.875 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-10-14T10:57:59.875 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-14T10:57:59.876 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-14T10:57:59.876 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-10-14T10:57:59.876 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-10-14T10:57:59.876 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-14T10:57:59.876 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-10-14T10:57:59.876 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-14T10:57:59.877 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-14T10:57:59.877 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-14T10:57:59.877 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-14T10:57:59.877 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-10-14T10:57:59.877 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-14T10:57:59.878 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-14T10:57:59.878 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-14T10:57:59.878 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/ 2023-10-14T10:57:59.878 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-10-14T10:57:59.878 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-10-14T10:57:59.879 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-10-14T10:57:59.879 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ 2023-10-14T10:57:59.879 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ 2023-10-14T10:57:59.879 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 273609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-14T10:57:59.879 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 879969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-14T10:57:59.880 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 69337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-14T10:57:59.880 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 324217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-14T10:57:59.880 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 97985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-14T10:57:59.880 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 282273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-14T10:57:59.880 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 66201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-14T10:57:59.880 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ 2023-10-14T10:57:59.881 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/ 2023-10-14T10:57:59.881 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 493073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-14T10:57:59.881 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/ 2023-10-14T10:57:59.881 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 419737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-14T10:57:59.881 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/ 2023-10-14T10:57:59.882 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 739025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-14T10:57:59.882 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ 2023-10-14T10:57:59.882 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 296625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-14T10:57:59.882 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ocrdma/ 2023-10-14T10:57:59.882 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 153697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-10-14T10:57:59.883 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/usnic/ 2023-10-14T10:57:59.883 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 168969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-10-14T10:57:59.883 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ 2023-10-14T10:57:59.883 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ 2023-10-14T10:57:59.883 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 263081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-14T10:57:59.884 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ 2023-10-14T10:57:59.884 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 100241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-14T10:57:59.884 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ 2023-10-14T10:57:59.884 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 111425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-14T10:57:59.884 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ 2023-10-14T10:57:59.885 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 128753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-14T10:57:59.885 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ 2023-10-14T10:57:59.885 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 129529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-14T10:57:59.885 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/ 2023-10-14T10:57:59.885 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/evbug.ko 2023-10-14T10:57:59.885 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/ff-memless.ko 2023-10-14T10:57:59.886 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/ 2023-10-14T10:57:59.886 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-14T10:57:59.886 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-14T10:57:59.886 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-14T10:57:59.887 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-14T10:57:59.887 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/ 2023-10-14T10:57:59.887 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-10-14T10:57:59.887 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-10-14T10:57:59.887 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-10-14T10:57:59.887 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-10-14T10:57:59.888 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-14T10:57:59.888 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-10-14T10:57:59.888 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lkkbd.ko 2023-10-14T10:57:59.888 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lm8323.ko 2023-10-14T10:57:59.888 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lm8333.ko 2023-10-14T10:57:59.889 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-10-14T10:57:59.889 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-10-14T10:57:59.889 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-10-14T10:57:59.889 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-10-14T10:57:59.889 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/newtonkbd.ko 2023-10-14T10:57:59.890 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-10-14T10:57:59.890 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/qt1070.ko 2023-10-14T10:57:59.890 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/qt2160.ko 2023-10-14T10:57:59.890 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-10-14T10:57:59.890 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/stowaway.ko 2023-10-14T10:57:59.891 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/sunkbd.ko 2023-10-14T10:57:59.891 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-10-14T10:57:59.891 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-10-14T10:57:59.891 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-10-14T10:57:59.891 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/xtkbd.ko 2023-10-14T10:57:59.892 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/matrix-keymap.ko 2023-10-14T10:57:59.892 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/ 2023-10-14T10:57:59.892 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-14T10:57:59.892 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-14T10:57:59.892 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 123681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-14T10:57:59.893 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 89449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-14T10:57:59.893 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/gpio_mouse.ko 2023-10-14T10:57:59.893 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 335977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/psmouse.ko 2023-10-14T10:57:59.893 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-14T10:57:59.893 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-14T10:57:59.893 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-14T10:57:59.894 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-14T10:57:59.894 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/ 2023-10-14T10:57:59.894 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 109873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-14T10:57:59.894 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ 2023-10-14T10:57:59.894 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-14T10:57:59.895 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-14T10:57:59.895 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ct82c710.ko 2023-10-14T10:57:59.895 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-14T10:57:59.895 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/parkbd.ko 2023-10-14T10:57:59.895 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/pcips2.ko 2023-10-14T10:57:59.896 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ps2mult.ko 2023-10-14T10:57:59.896 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-14T10:57:59.896 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serport.ko 2023-10-14T10:57:59.896 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-14T10:57:59.896 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/ 2023-10-14T10:57:59.896 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/ 2023-10-14T10:57:59.897 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-14T10:57:59.897 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/ 2023-10-14T10:57:59.897 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-88pm860x.ko 2023-10-14T10:57:59.897 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-adp5520.ko 2023-10-14T10:57:59.897 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 59753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-bd2802.ko 2023-10-14T10:57:59.898 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-14T10:57:59.898 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-da903x.ko 2023-10-14T10:57:59.898 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-da9052.ko 2023-10-14T10:57:59.898 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-gpio.ko 2023-10-14T10:57:59.898 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-14T10:57:59.899 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3533.ko 2023-10-14T10:57:59.899 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm355x.ko 2023-10-14T10:57:59.899 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3642.ko 2023-10-14T10:57:59.899 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-14T10:57:59.899 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp8788.ko 2023-10-14T10:57:59.899 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-max8997.ko 2023-10-14T10:57:59.900 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-mc13783.ko 2023-10-14T10:57:59.900 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-menf21bmc.ko 2023-10-14T10:57:59.900 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca9532.ko 2023-10-14T10:57:59.900 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca955x.ko 2023-10-14T10:57:59.900 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca963x.ko 2023-10-14T10:57:59.901 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-14T10:57:59.901 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-tca6507.ko 2023-10-14T10:57:59.901 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-wm831x-status.ko 2023-10-14T10:57:59.901 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-wm8350.ko 2023-10-14T10:57:59.901 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ 2023-10-14T10:57:59.902 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-14T10:57:59.902 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-14T10:57:59.902 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-14T10:57:59.902 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-14T10:57:59.902 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-14T10:57:59.903 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-14T10:57:59.903 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-14T10:57:59.903 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-14T10:57:59.903 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/ 2023-10-14T10:57:59.903 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/ 2023-10-14T10:57:59.904 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 654969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-14T10:57:59.904 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-14T10:57:59.904 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 89601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bufio.ko 2023-10-14T10:57:59.904 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-14T10:57:59.904 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 156009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-14T10:57:59.905 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 106897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-14T10:57:59.905 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-14T10:57:59.905 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 53857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-era.ko 2023-10-14T10:57:59.905 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-14T10:57:59.905 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-14T10:57:59.906 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log.ko 2023-10-14T10:57:59.906 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-mirror.ko 2023-10-14T10:57:59.906 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 78033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-14T10:57:59.906 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-14T10:57:59.906 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 70825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-14T10:57:59.906 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-region-hash.ko 2023-10-14T10:57:59.907 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-14T10:57:59.907 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-14T10:57:59.907 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 109593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-snapshot.ko 2023-10-14T10:57:59.907 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-14T10:57:59.907 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 181865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-14T10:57:59.908 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-14T10:57:59.908 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-zero.ko 2023-10-14T10:57:59.908 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-14T10:57:59.908 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-14T10:57:59.908 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-14T10:57:59.908 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/ 2023-10-14T10:57:59.909 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 199937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-14T10:57:59.909 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-14T10:57:59.909 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 113073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-14T10:57:59.909 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 158681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-14T10:57:59.909 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 395721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-14T10:57:59.910 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/ 2023-10-14T10:57:59.910 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/ 2023-10-14T10:57:59.910 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 178137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-14T10:57:59.910 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 63385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-14T10:57:59.910 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-14T10:57:59.911 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-14T10:57:59.911 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 123321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-14T10:57:59.911 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 79041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-14T10:57:59.911 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 53081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-14T10:57:59.911 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/ 2023-10-14T10:57:59.912 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm800.ko 2023-10-14T10:57:59.912 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm805.ko 2023-10-14T10:57:59.912 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm80x.ko 2023-10-14T10:57:59.912 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/arizona-i2c.ko 2023-10-14T10:57:59.912 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 123721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/arizona.ko 2023-10-14T10:57:59.912 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/bcm590xx.ko 2023-10-14T10:57:59.913 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/cros_ec_dev.ko 2023-10-14T10:57:59.913 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/dln2.ko 2023-10-14T10:57:59.913 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/janz-cmodio.ko 2023-10-14T10:57:59.913 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 53585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/kempld-core.ko 2023-10-14T10:57:59.913 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lm3533-core.ko 2023-10-14T10:57:59.914 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-10-14T10:57:59.914 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lp3943.ko 2023-10-14T10:57:59.914 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 54569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-14T10:57:59.914 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-14T10:57:59.914 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/max8907.ko 2023-10-14T10:57:59.915 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mc13xxx-core.ko 2023-10-14T10:57:59.915 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-10-14T10:57:59.915 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/menf21bmc.ko 2023-10-14T10:57:59.915 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633-adc.ko 2023-10-14T10:57:59.915 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633-gpio.ko 2023-10-14T10:57:59.915 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633.ko 2023-10-14T10:57:59.916 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-10-14T10:57:59.916 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/retu-mfd.ko 2023-10-14T10:57:59.916 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 80425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/si476x-core.ko 2023-10-14T10:57:59.916 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 48457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-14T10:57:59.916 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-10-14T10:57:59.917 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/tps65010.ko 2023-10-14T10:57:59.917 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/tps6507x.ko 2023-10-14T10:57:59.917 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-14T10:57:59.917 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-14T10:57:59.917 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-14T10:57:59.918 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wm8994.ko 2023-10-14T10:57:59.918 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ 2023-10-14T10:57:59.918 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-10-14T10:57:59.918 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 48489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ad525x_dpot.ko 2023-10-14T10:57:59.918 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/ 2023-10-14T10:57:59.918 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 46585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-14T10:57:59.919 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-14T10:57:59.919 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-14T10:57:59.919 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 45593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-14T10:57:59.919 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/ 2023-10-14T10:57:59.919 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-10-14T10:57:59.920 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/core.ko 2023-10-14T10:57:59.920 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/ 2023-10-14T10:57:59.920 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-14T10:57:59.920 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ds1682.ko 2023-10-14T10:57:59.920 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/dummy-irq.ko 2023-10-14T10:57:59.920 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/echo/ 2023-10-14T10:57:59.921 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/echo/echo.ko 2023-10-14T10:57:59.921 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/ 2023-10-14T10:57:59.921 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-14T10:57:59.921 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-14T10:57:59.921 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-14T10:57:59.922 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-14T10:57:59.922 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-14T10:57:59.922 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/genwqe/ 2023-10-14T10:57:59.922 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 152201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-10-14T10:57:59.922 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hmc6352.ko 2023-10-14T10:57:59.923 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-14T10:57:59.923 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ibmasm/ 2023-10-14T10:57:59.923 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 72129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-10-14T10:57:59.923 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ics932s401.ko 2023-10-14T10:57:59.923 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-14T10:57:59.923 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-14T10:57:59.924 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/ 2023-10-14T10:57:59.924 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-14T10:57:59.924 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-14T10:57:59.924 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/ 2023-10-14T10:57:59.924 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 125209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-14T10:57:59.925 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 56521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-14T10:57:59.925 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 310113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-14T10:57:59.925 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/phantom.ko 2023-10-14T10:57:59.925 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ti-st/ 2023-10-14T10:57:59.925 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 74265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ti-st/st_drv.ko 2023-10-14T10:57:59.926 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-14T10:57:59.926 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-14T10:57:59.926 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-14T10:57:59.926 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 48697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-14T10:57:59.926 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/ 2023-10-14T10:57:59.927 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 183609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-14T10:57:59.927 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ 2023-10-14T10:57:59.927 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/ 2023-10-14T10:57:59.927 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 490129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-14T10:57:59.927 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/ 2023-10-14T10:57:59.927 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/ 2023-10-14T10:57:59.928 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 106033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-14T10:57:59.928 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-14T10:57:59.928 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-14T10:57:59.928 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/ 2023-10-14T10:57:59.928 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 453737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-14T10:57:59.929 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-14T10:57:59.929 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-14T10:57:59.929 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ 2023-10-14T10:57:59.929 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/ 2023-10-14T10:57:59.929 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 45785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-14T10:57:59.930 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-14T10:57:59.930 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 130553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-14T10:57:59.930 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 68849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-14T10:57:59.930 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ 2023-10-14T10:57:59.930 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-14T10:57:59.930 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 59689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-14T10:57:59.931 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-14T10:57:59.931 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 99113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-14T10:57:59.931 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/ 2023-10-14T10:57:59.931 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 54521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-14T10:57:59.931 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/ 2023-10-14T10:57:59.932 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 69201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-14T10:57:59.932 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/ 2023-10-14T10:57:59.932 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 59585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-14T10:57:59.932 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/ 2023-10-14T10:57:59.932 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-14T10:57:59.933 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/ 2023-10-14T10:57:59.933 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 54609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-14T10:57:59.933 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-14T10:57:59.933 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 87297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-14T10:57:59.933 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/ 2023-10-14T10:57:59.933 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/ 2023-10-14T10:57:59.934 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 97337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-14T10:57:59.934 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-10-14T10:57:59.934 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 104673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-14T10:57:59.934 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-10-14T10:57:59.934 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 90257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-14T10:57:59.935 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/ 2023-10-14T10:57:59.935 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 81569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-14T10:57:59.935 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 69729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-14T10:57:59.935 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/ 2023-10-14T10:57:59.935 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 78401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-14T10:57:59.936 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 176761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-14T10:57:59.937 INFO:teuthology.orchestra.run.smithi110.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-14T10:57:59.937 INFO:teuthology.orchestra.run.smithi110.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-10-14T10:57:59.937 INFO:teuthology.orchestra.run.smithi110.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-14T10:57:59.937 INFO:teuthology.orchestra.run.smithi110.stderr:done 2023-10-14T10:58:00.044 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-10-14T10:58:00.044 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1421497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-14T10:58:00.044 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 128569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-14T10:58:00.044 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/ 2023-10-14T10:58:00.045 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 132089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-14T10:58:00.045 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 312081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-14T10:58:00.045 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/ 2023-10-14T10:58:00.045 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/ 2023-10-14T10:58:00.045 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 323513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-14T10:58:00.046 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/ 2023-10-14T10:58:00.046 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-10-14T10:58:00.046 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 193497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-14T10:58:00.046 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-10-14T10:58:00.046 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 347417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-14T10:58:00.046 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-10-14T10:58:00.047 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1044433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-14T10:58:00.047 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-10-14T10:58:00.047 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 166193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-14T10:58:00.047 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-10-14T10:58:00.047 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-14T10:58:00.047 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/ 2023-10-14T10:58:00.048 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/ 2023-10-14T10:58:00.048 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 204345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-14T10:58:00.048 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/ 2023-10-14T10:58:00.048 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/ 2023-10-14T10:58:00.048 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 69449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-14T10:58:00.048 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 61489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-14T10:58:00.049 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 141225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-14T10:58:00.049 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-14T10:58:00.049 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 62817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-14T10:58:00.049 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-14T10:58:00.049 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/ 2023-10-14T10:58:00.050 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 60873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-14T10:58:00.050 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 62833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-14T10:58:00.050 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 45721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-14T10:58:00.050 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ec_bhf.ko 2023-10-14T10:58:00.050 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/ 2023-10-14T10:58:00.051 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/ 2023-10-14T10:58:00.051 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 281137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-14T10:58:00.051 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-14T10:58:00.051 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-14T10:58:00.051 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fujitsu/ 2023-10-14T10:58:00.051 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 45345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-10-14T10:58:00.052 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ 2023-10-14T10:58:00.052 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 90465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-14T10:58:00.052 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/ 2023-10-14T10:58:00.052 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 295577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-14T10:58:00.052 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/ 2023-10-14T10:58:00.053 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 584497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-14T10:58:00.053 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/ 2023-10-14T10:58:00.053 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 246209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-14T10:58:00.053 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/ 2023-10-14T10:58:00.053 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 925697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-14T10:58:00.054 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/ 2023-10-14T10:58:00.054 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 302849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-14T10:58:00.054 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/ 2023-10-14T10:58:00.054 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 514681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-14T10:58:00.054 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/ 2023-10-14T10:58:00.055 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 93593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-14T10:58:00.055 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-10-14T10:58:00.055 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 734305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-14T10:58:00.055 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-10-14T10:58:00.055 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 151769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-14T10:58:00.056 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 86921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-14T10:58:00.056 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/ 2023-10-14T10:58:00.056 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-14T10:58:00.056 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 102289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-14T10:58:00.056 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 122649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-14T10:58:00.057 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/ 2023-10-14T10:58:00.057 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-10-14T10:58:00.057 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 727601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-14T10:58:00.057 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 278937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-14T10:58:00.057 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-10-14T10:58:00.057 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-10-14T10:58:00.058 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1113993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-14T10:58:00.058 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ 2023-10-14T10:58:00.058 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 53105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-10-14T10:58:00.058 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-10-14T10:58:00.058 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-10-14T10:58:00.059 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 95665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-14T10:58:00.059 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/ 2023-10-14T10:58:00.059 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-10-14T10:58:00.059 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 108649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-14T10:58:00.059 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ 2023-10-14T10:58:00.059 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 73441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-14T10:58:00.060 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-14T10:58:00.060 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/ 2023-10-14T10:58:00.060 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 150905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-14T10:58:00.060 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/ 2023-10-14T10:58:00.060 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 136721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-14T10:58:00.060 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/ 2023-10-14T10:58:00.061 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-14T10:58:00.061 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 43145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-14T10:58:00.061 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/ 2023-10-14T10:58:00.061 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-10-14T10:58:00.061 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 227897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-14T10:58:00.062 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 87081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-14T10:58:00.062 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-10-14T10:58:00.062 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 672049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-14T10:58:00.062 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/ 2023-10-14T10:58:00.062 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 43017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-14T10:58:00.063 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/ 2023-10-14T10:58:00.063 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 67385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-14T10:58:00.063 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 83985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-14T10:58:00.063 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-14T10:58:00.063 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 189801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-14T10:58:00.063 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/ 2023-10-14T10:58:00.064 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-10-14T10:58:00.064 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 104241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-10-14T10:58:00.064 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/ 2023-10-14T10:58:00.064 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1053921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-14T10:58:00.064 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/ 2023-10-14T10:58:00.065 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-14T10:58:00.065 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/ 2023-10-14T10:58:00.065 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 54817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-14T10:58:00.065 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 63337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-14T10:58:00.065 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/ 2023-10-14T10:58:00.066 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 61601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-14T10:58:00.066 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 67193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-14T10:58:00.066 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 73409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-14T10:58:00.066 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 68177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-14T10:58:00.066 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/ 2023-10-14T10:58:00.066 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-10-14T10:58:00.067 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-10-14T10:58:00.067 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-14T10:58:00.067 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-10-14T10:58:00.067 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 486961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-14T10:58:00.067 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/ 2023-10-14T10:58:00.068 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 103337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-14T10:58:00.068 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 166161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-14T10:58:00.068 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 66329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-14T10:58:00.068 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 78801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-14T10:58:00.068 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/ 2023-10-14T10:58:00.069 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-14T10:58:00.069 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/ 2023-10-14T10:58:00.069 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 86529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-14T10:58:00.069 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/ 2023-10-14T10:58:00.069 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 80273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-14T10:58:00.069 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 83633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-14T10:58:00.070 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/ 2023-10-14T10:58:00.070 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 46241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-14T10:58:00.070 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-14T10:58:00.070 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/ 2023-10-14T10:58:00.070 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 60057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-14T10:58:00.071 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/ 2023-10-14T10:58:00.071 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/defxx.ko 2023-10-14T10:58:00.071 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/skfp/ 2023-10-14T10:58:00.071 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 216985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/skfp/skfp.ko 2023-10-14T10:58:00.071 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 77345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-14T10:58:00.072 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/ 2023-10-14T10:58:00.072 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 235521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-14T10:58:00.072 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/ 2023-10-14T10:58:00.072 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-14T10:58:00.072 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-14T10:58:00.072 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ 2023-10-14T10:58:00.073 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 83769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-14T10:58:00.073 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 62209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-14T10:58:00.073 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-14T10:58:00.073 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/ 2023-10-14T10:58:00.073 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-14T10:58:00.074 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-14T10:58:00.074 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-gpio.ko 2023-10-14T10:58:00.074 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-14T10:58:00.074 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-14T10:58:00.074 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-14T10:58:00.075 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 43953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-14T10:58:00.075 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-14T10:58:00.075 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/ 2023-10-14T10:58:00.075 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-14T10:58:00.075 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-14T10:58:00.075 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ 2023-10-14T10:58:00.076 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-14T10:58:00.076 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-14T10:58:00.076 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-14T10:58:00.076 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-14T10:58:00.076 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-14T10:58:00.077 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-14T10:58:00.077 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-14T10:58:00.077 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-14T10:58:00.077 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-14T10:58:00.077 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-14T10:58:00.077 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 82049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-14T10:58:00.078 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 76177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-14T10:58:00.078 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-14T10:58:00.078 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 97857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-14T10:58:00.078 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-14T10:58:00.078 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-14T10:58:00.079 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-14T10:58:00.079 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-14T10:58:00.079 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-14T10:58:00.079 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/plip/ 2023-10-14T10:58:00.079 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 43569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/plip/plip.ko 2023-10-14T10:58:00.079 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ 2023-10-14T10:58:00.080 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-14T10:58:00.080 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-14T10:58:00.080 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-14T10:58:00.080 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-14T10:58:00.080 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-14T10:58:00.081 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-14T10:58:00.081 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-14T10:58:00.081 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-14T10:58:00.081 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sb1000.ko 2023-10-14T10:58:00.081 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/ 2023-10-14T10:58:00.081 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-14T10:58:00.082 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-14T10:58:00.082 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 64385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-14T10:58:00.082 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/ 2023-10-14T10:58:00.082 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 106169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-14T10:58:00.082 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-14T10:58:00.083 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-14T10:58:00.083 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-14T10:58:00.083 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-14T10:58:00.083 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-14T10:58:00.083 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 87017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-14T10:58:00.083 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/ 2023-10-14T10:58:00.084 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 144297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-14T10:58:00.084 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/ 2023-10-14T10:58:00.084 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 297329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-14T10:58:00.084 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/ 2023-10-14T10:58:00.085 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 144649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-14T10:58:00.085 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ 2023-10-14T10:58:00.085 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-14T10:58:00.085 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/ 2023-10-14T10:58:00.085 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/ 2023-10-14T10:58:00.085 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 264937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-14T10:58:00.086 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 102209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-14T10:58:00.086 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/ 2023-10-14T10:58:00.086 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 133841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-14T10:58:00.086 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-14T10:58:00.087 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 84465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-14T10:58:00.087 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-14T10:58:00.087 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/ 2023-10-14T10:58:00.087 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/ 2023-10-14T10:58:00.087 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-14T10:58:00.087 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-10-14T10:58:00.088 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-10-14T10:58:00.088 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pci-stub.ko 2023-10-14T10:58:00.088 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 46529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-14T10:58:00.088 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/ 2023-10-14T10:58:00.088 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-14T10:58:00.089 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 145809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia.ko 2023-10-14T10:58:00.089 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 62137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia_core.ko 2023-10-14T10:58:00.089 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-10-14T10:58:00.089 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-14T10:58:00.089 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 112889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-14T10:58:00.089 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/ 2023-10-14T10:58:00.090 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/broadcom/ 2023-10-14T10:58:00.090 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-10-14T10:58:00.090 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/samsung/ 2023-10-14T10:58:00.090 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-10-14T10:58:00.090 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/ 2023-10-14T10:58:00.091 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/ 2023-10-14T10:58:00.091 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 70153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-14T10:58:00.091 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/ 2023-10-14T10:58:00.091 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/ 2023-10-14T10:58:00.091 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-10-14T10:58:00.092 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec.ko 2023-10-14T10:58:00.092 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-10-14T10:58:00.092 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-10-14T10:58:00.092 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-10-14T10:58:00.092 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-10-14T10:58:00.093 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-10-14T10:58:00.093 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/ 2023-10-14T10:58:00.093 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 67097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-14T10:58:00.093 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-14T10:58:00.093 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-14T10:58:00.094 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 59665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-14T10:58:00.094 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-14T10:58:00.094 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 127569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-14T10:58:00.094 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-14T10:58:00.094 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-14T10:58:00.095 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-14T10:58:00.095 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-14T10:58:00.095 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-14T10:58:00.095 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-14T10:58:00.095 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/ibm_rtl.ko 2023-10-14T10:58:00.096 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/ 2023-10-14T10:58:00.096 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-14T10:58:00.096 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-10-14T10:58:00.096 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 43497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-14T10:58:00.096 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-14T10:58:00.097 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-14T10:58:00.097 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-14T10:58:00.097 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-14T10:58:00.097 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-14T10:58:00.097 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-14T10:58:00.097 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-14T10:58:00.098 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-14T10:58:00.098 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-14T10:58:00.098 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 57569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-14T10:58:00.098 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/ 2023-10-14T10:58:00.098 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ 2023-10-14T10:58:00.099 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/88pm860x_battery.ko 2023-10-14T10:58:00.099 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/88pm860x_charger.ko 2023-10-14T10:58:00.099 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 55057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq2415x_charger.ko 2023-10-14T10:58:00.099 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 54081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq24190_charger.ko 2023-10-14T10:58:00.099 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq24735-charger.ko 2023-10-14T10:58:00.099 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-10-14T10:58:00.100 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/da9030_battery.ko 2023-10-14T10:58:00.100 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/da9052-battery.ko 2023-10-14T10:58:00.100 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2760_battery.ko 2023-10-14T10:58:00.100 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2780_battery.ko 2023-10-14T10:58:00.100 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2781_battery.ko 2023-10-14T10:58:00.100 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2782_battery.ko 2023-10-14T10:58:00.101 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/gpio-charger.ko 2023-10-14T10:58:00.101 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/isp1704_charger.ko 2023-10-14T10:58:00.101 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/lp8727_charger.ko 2023-10-14T10:58:00.101 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max14577_charger.ko 2023-10-14T10:58:00.101 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max17040_battery.ko 2023-10-14T10:58:00.101 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max17042_battery.ko 2023-10-14T10:58:00.102 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max8903_charger.ko 2023-10-14T10:58:00.102 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max8925_power.ko 2023-10-14T10:58:00.102 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/pcf50633-charger.ko 2023-10-14T10:58:00.102 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/sbs-battery.ko 2023-10-14T10:58:00.102 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/test_power.ko 2023-10-14T10:58:00.103 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/tps65090-charger.ko 2023-10-14T10:58:00.103 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm831x_backup.ko 2023-10-14T10:58:00.103 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm831x_power.ko 2023-10-14T10:58:00.103 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm8350_power.ko 2023-10-14T10:58:00.103 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/ 2023-10-14T10:58:00.103 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 57729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-14T10:58:00.104 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-14T10:58:00.104 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/ 2023-10-14T10:58:00.104 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/ 2023-10-14T10:58:00.104 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-14T10:58:00.104 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-14T10:58:00.105 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-14T10:58:00.105 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-14T10:58:00.105 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ 2023-10-14T10:58:00.105 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 66385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-14T10:58:00.105 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-14T10:58:00.106 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/ 2023-10-14T10:58:00.106 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-88pm80x.ko 2023-10-14T10:58:00.106 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-88pm860x.ko 2023-10-14T10:58:00.106 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-14T10:58:00.106 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9052.ko 2023-10-14T10:58:00.107 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9055.ko 2023-10-14T10:58:00.107 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9063.ko 2023-10-14T10:58:00.107 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-14T10:58:00.107 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 68577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-14T10:58:00.107 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-14T10:58:00.107 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-14T10:58:00.108 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-14T10:58:00.108 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-14T10:58:00.108 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-14T10:58:00.108 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-14T10:58:00.108 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-14T10:58:00.109 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-14T10:58:00.109 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-14T10:58:00.109 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-14T10:58:00.109 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-14T10:58:00.109 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-lp8788.ko 2023-10-14T10:58:00.109 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-14T10:58:00.110 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-14T10:58:00.110 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-14T10:58:00.110 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t86.ko 2023-10-14T10:58:00.110 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-14T10:58:00.110 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8907.ko 2023-10-14T10:58:00.110 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8925.ko 2023-10-14T10:58:00.111 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8997.ko 2023-10-14T10:58:00.111 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8998.ko 2023-10-14T10:58:00.111 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-10-14T10:58:00.111 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-14T10:58:00.111 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-palmas.ko 2023-10-14T10:58:00.112 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 46633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-14T10:58:00.112 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf50633.ko 2023-10-14T10:58:00.112 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-14T10:58:00.112 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-14T10:58:00.112 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-14T10:58:00.112 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-14T10:58:00.113 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rc5t583.ko 2023-10-14T10:58:00.113 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-14T10:58:00.113 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-14T10:58:00.113 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-14T10:58:00.113 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-14T10:58:00.113 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-14T10:58:00.113 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-s35390a.ko 2023-10-14T10:58:00.114 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-14T10:58:00.114 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-tps6586x.ko 2023-10-14T10:58:00.114 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-tps65910.ko 2023-10-14T10:58:00.114 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-wm831x.ko 2023-10-14T10:58:00.114 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-wm8350.ko 2023-10-14T10:58:00.115 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-14T10:58:00.115 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ 2023-10-14T10:58:00.115 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 77617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-14T10:58:00.115 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 57665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-14T10:58:00.115 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 55169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-14T10:58:00.115 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 135185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-14T10:58:00.116 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-14T10:58:00.116 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/ 2023-10-14T10:58:00.116 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 272305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-14T10:58:00.116 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 100617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-14T10:58:00.116 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/ 2023-10-14T10:58:00.116 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 356265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-14T10:58:00.117 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 295801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-14T10:58:00.117 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic94xx/ 2023-10-14T10:58:00.117 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 189185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-10-14T10:58:00.117 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-14T10:58:00.117 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/ 2023-10-14T10:58:00.117 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 106881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-14T10:58:00.118 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-14T10:58:00.118 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/ 2023-10-14T10:58:00.118 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 246985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-14T10:58:00.118 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/ 2023-10-14T10:58:00.118 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1171945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-14T10:58:00.119 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/ 2023-10-14T10:58:00.119 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 237273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-14T10:58:00.119 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/ 2023-10-14T10:58:00.119 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 115369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-14T10:58:00.119 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-14T10:58:00.119 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/ 2023-10-14T10:58:00.120 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 308921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-14T10:58:00.120 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/ 2023-10-14T10:58:00.120 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-10-14T10:58:00.120 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 76145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-14T10:58:00.120 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-10-14T10:58:00.120 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 101449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-14T10:58:00.121 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 146689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-14T10:58:00.121 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 75553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-14T10:58:00.121 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-14T10:58:00.121 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/ 2023-10-14T10:58:00.121 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 212425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-14T10:58:00.122 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 60505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-14T10:58:00.122 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/ 2023-10-14T10:58:00.122 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 78209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-14T10:58:00.122 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 158505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-14T10:58:00.122 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fdomain.ko 2023-10-14T10:58:00.123 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/ 2023-10-14T10:58:00.123 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 263489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-14T10:58:00.123 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 201817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-14T10:58:00.123 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-14T10:58:00.123 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-14T10:58:00.123 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/imm.ko 2023-10-14T10:58:00.124 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-14T10:58:00.124 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 266537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-14T10:58:00.124 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 101881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-14T10:58:00.124 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/ 2023-10-14T10:58:00.124 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 317153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-14T10:58:00.124 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-14T10:58:00.125 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 52961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-14T10:58:00.125 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/ 2023-10-14T10:58:00.125 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 314865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-14T10:58:00.125 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 145585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-14T10:58:00.125 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 53521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-14T10:58:00.125 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/ 2023-10-14T10:58:00.126 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 216665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-14T10:58:00.126 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/ 2023-10-14T10:58:00.126 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 2197249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-14T10:58:00.126 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/ 2023-10-14T10:58:00.126 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 73569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-14T10:58:00.127 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-14T10:58:00.127 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 310617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-14T10:58:00.127 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 84721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-14T10:58:00.127 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/ 2023-10-14T10:58:00.127 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 659777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-14T10:58:00.128 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/ 2023-10-14T10:58:00.128 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 119561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-14T10:58:00.128 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 78129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-14T10:58:00.128 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/ 2023-10-14T10:58:00.128 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 81625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-10-14T10:58:00.128 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-10-14T10:58:00.129 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-10-14T10:58:00.129 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-10-14T10:58:00.129 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/ 2023-10-14T10:58:00.129 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 364105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-14T10:58:00.129 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 123617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-14T10:58:00.129 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ppa.ko 2023-10-14T10:58:00.130 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 55361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-14T10:58:00.130 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/ 2023-10-14T10:58:00.130 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1876625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-14T10:58:00.130 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 85289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-14T10:58:00.130 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/ 2023-10-14T10:58:00.131 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 559033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-14T10:58:00.131 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qlogicfas408.ko 2023-10-14T10:58:00.131 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-14T10:58:00.131 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 238825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-14T10:58:00.131 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 173937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-14T10:58:00.132 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 279313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-14T10:58:00.132 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 97729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-14T10:58:00.132 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 73881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-14T10:58:00.132 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-14T10:58:00.132 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-14T10:58:00.132 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 115889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-14T10:58:00.133 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 46825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-14T10:58:00.133 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/ 2023-10-14T10:58:00.133 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 162121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-14T10:58:00.133 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-14T10:58:00.133 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-14T10:58:00.134 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-14T10:58:00.134 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/xen-scsifront.ko 2023-10-14T10:58:00.134 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ 2023-10-14T10:58:00.134 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 129441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-14T10:58:00.134 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/ 2023-10-14T10:58:00.134 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/ 2023-10-14T10:58:00.135 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 736601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-14T10:58:00.135 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/ 2023-10-14T10:58:00.135 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-14T10:58:00.135 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-14T10:58:00.135 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 43025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-14T10:58:00.136 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 930321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-14T10:58:00.136 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-14T10:58:00.136 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 122521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-14T10:58:00.136 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/ 2023-10-14T10:58:00.136 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 75593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-14T10:58:00.136 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/ 2023-10-14T10:58:00.137 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/ 2023-10-14T10:58:00.137 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/ 2023-10-14T10:58:00.137 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-14T10:58:00.137 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-14T10:58:00.137 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-14T10:58:00.138 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-14T10:58:00.138 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-14T10:58:00.138 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-14T10:58:00.138 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-14T10:58:00.138 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-14T10:58:00.138 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-14T10:58:00.139 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-14T10:58:00.139 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-14T10:58:00.139 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-14T10:58:00.139 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-10-14T10:58:00.139 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-14T10:58:00.140 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-14T10:58:00.140 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-14T10:58:00.140 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ 2023-10-14T10:58:00.140 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ 2023-10-14T10:58:00.140 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 78425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-14T10:58:00.140 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 57865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/moxa.ko 2023-10-14T10:58:00.141 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/mxser.ko 2023-10-14T10:58:00.141 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 108601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-14T10:58:00.141 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-14T10:58:00.141 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 67929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-14T10:58:00.141 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/ 2023-10-14T10:58:00.142 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/ 2023-10-14T10:58:00.142 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-10-14T10:58:00.142 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 59497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-14T10:58:00.142 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-10-14T10:58:00.142 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/altera_uart.ko 2023-10-14T10:58:00.143 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-14T10:58:00.143 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 72425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-10-14T10:58:00.143 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/ 2023-10-14T10:58:00.143 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 103073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-14T10:58:00.143 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/rp2.ko 2023-10-14T10:58:00.143 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 52817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/sc16is7xx.ko 2023-10-14T10:58:00.144 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/ 2023-10-14T10:58:00.144 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ 2023-10-14T10:58:00.144 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 531265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-14T10:58:00.144 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ 2023-10-14T10:58:00.144 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-14T10:58:00.145 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-10-14T10:58:00.145 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/ 2023-10-14T10:58:00.145 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-14T10:58:00.145 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-14T10:58:00.145 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-14T10:58:00.145 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_dmem_genirq.ko 2023-10-14T10:58:00.146 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_mf624.ko 2023-10-14T10:58:00.146 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_netx.ko 2023-10-14T10:58:00.146 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-14T10:58:00.146 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-10-14T10:58:00.146 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-14T10:58:00.147 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/ 2023-10-14T10:58:00.147 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/c67x00/ 2023-10-14T10:58:00.147 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 73297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/c67x00/c67x00.ko 2023-10-14T10:58:00.147 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ 2023-10-14T10:58:00.147 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 144377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-10-14T10:58:00.148 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-10-14T10:58:00.148 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-10-14T10:58:00.148 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-10-14T10:58:00.148 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/ 2023-10-14T10:58:00.148 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 87089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-14T10:58:00.148 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-14T10:58:00.149 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-14T10:58:00.149 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 89857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-14T10:58:00.149 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/common/ 2023-10-14T10:58:00.149 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/common/ulpi.ko 2023-10-14T10:58:00.149 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc2/ 2023-10-14T10:58:00.150 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-10-14T10:58:00.150 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/ 2023-10-14T10:58:00.150 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-10-14T10:58:00.150 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-10-14T10:58:00.150 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 444553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3.ko 2023-10-14T10:58:00.151 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/ 2023-10-14T10:58:00.151 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/ 2023-10-14T10:58:00.151 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 60177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/u_ether.ko 2023-10-14T10:58:00.151 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/u_serial.ko 2023-10-14T10:58:00.151 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-10-14T10:58:00.152 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-10-14T10:58:00.152 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-10-14T10:58:00.152 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-10-14T10:58:00.152 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 92489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-10-14T10:58:00.152 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-10-14T10:58:00.152 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 122081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-10-14T10:58:00.153 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 57617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-10-14T10:58:00.153 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-10-14T10:58:00.153 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-10-14T10:58:00.153 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 57729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-10-14T10:58:00.153 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 85609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-10-14T10:58:00.154 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-10-14T10:58:00.154 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 58113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-10-14T10:58:00.154 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 67337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-10-14T10:58:00.154 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/ 2023-10-14T10:58:00.154 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-10-14T10:58:00.155 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-10-14T10:58:00.155 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-10-14T10:58:00.155 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-10-14T10:58:00.155 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-10-14T10:58:00.155 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-10-14T10:58:00.155 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-10-14T10:58:00.156 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-10-14T10:58:00.156 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-10-14T10:58:00.156 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-10-14T10:58:00.156 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-10-14T10:58:00.156 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-10-14T10:58:00.157 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 62185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-10-14T10:58:00.157 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-10-14T10:58:00.157 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 161225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/libcomposite.ko 2023-10-14T10:58:00.157 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/ 2023-10-14T10:58:00.157 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-10-14T10:58:00.158 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/bdc/ 2023-10-14T10:58:00.158 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 157681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-10-14T10:58:00.158 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-10-14T10:58:00.158 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 52721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-10-14T10:58:00.158 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 69705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-10-14T10:58:00.159 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 56033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-10-14T10:58:00.159 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 76057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/net2272.ko 2023-10-14T10:58:00.159 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 75073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/net2280.ko 2023-10-14T10:58:00.159 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 73169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-10-14T10:58:00.159 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 65809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-10-14T10:58:00.159 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 66097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-10-14T10:58:00.160 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 81505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-10-14T10:58:00.160 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 156073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-10-14T10:58:00.160 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/ 2023-10-14T10:58:00.160 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/bcma-hcd.ko 2023-10-14T10:58:00.160 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 80113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/isp116x-hcd.ko 2023-10-14T10:58:00.161 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 87353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-10-14T10:58:00.161 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 78873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-10-14T10:58:00.161 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-14T10:58:00.161 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811_cs.ko 2023-10-14T10:58:00.161 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/ssb-hcd.ko 2023-10-14T10:58:00.161 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-10-14T10:58:00.162 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/ 2023-10-14T10:58:00.162 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-14T10:58:00.162 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-14T10:58:00.162 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ 2023-10-14T10:58:00.162 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-14T10:58:00.163 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-14T10:58:00.163 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-10-14T10:58:00.163 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/cytherm.ko 2023-10-14T10:58:00.163 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ehset.ko 2023-10-14T10:58:00.163 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-14T10:58:00.164 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-14T10:58:00.164 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-14T10:58:00.164 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-14T10:58:00.164 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-14T10:58:00.164 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-14T10:58:00.164 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-14T10:58:00.165 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-14T10:58:00.165 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/lvstest.ko 2023-10-14T10:58:00.165 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/ 2023-10-14T10:58:00.165 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 64841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-14T10:58:00.165 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-14T10:58:00.166 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-14T10:58:00.166 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-14T10:58:00.166 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-14T10:58:00.166 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 70873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbtest.ko 2023-10-14T10:58:00.166 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-14T10:58:00.167 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-14T10:58:00.167 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/mon/ 2023-10-14T10:58:00.167 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 72953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/mon/usbmon.ko 2023-10-14T10:58:00.167 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/musb/ 2023-10-14T10:58:00.167 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 301545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/musb/musb_hdrc.ko 2023-10-14T10:58:00.167 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/ 2023-10-14T10:58:00.168 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-14T10:58:00.168 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-10-14T10:58:00.168 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-isp1301.ko 2023-10-14T10:58:00.168 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-tahvo.ko 2023-10-14T10:58:00.168 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ 2023-10-14T10:58:00.169 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-14T10:58:00.169 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-14T10:58:00.169 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-14T10:58:00.169 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-14T10:58:00.169 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 70257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-14T10:58:00.169 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-14T10:58:00.170 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 58217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-14T10:58:00.170 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-14T10:58:00.170 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-14T10:58:00.170 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/f81232.ko 2023-10-14T10:58:00.170 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 175137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-14T10:58:00.171 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 53113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-14T10:58:00.171 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 137081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-14T10:58:00.171 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 124833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-14T10:58:00.171 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 67769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-14T10:58:00.171 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-14T10:58:00.172 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-14T10:58:00.172 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 58233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-14T10:58:00.172 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 107521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-14T10:58:00.172 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-14T10:58:00.172 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-14T10:58:00.173 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-14T10:58:00.173 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-14T10:58:00.173 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/metro-usb.ko 2023-10-14T10:58:00.173 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 66449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-14T10:58:00.173 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 78217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-14T10:58:00.173 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 56337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mxuport.ko 2023-10-14T10:58:00.174 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-14T10:58:00.174 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-14T10:58:00.174 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-14T10:58:00.174 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 190633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-14T10:58:00.174 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-14T10:58:00.175 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 54353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-14T10:58:00.175 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-14T10:58:00.175 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-14T10:58:00.175 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-14T10:58:00.175 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-14T10:58:00.176 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-14T10:58:00.176 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-14T10:58:00.176 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-14T10:58:00.176 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-14T10:58:00.176 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 61489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-14T10:58:00.176 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-14T10:58:00.177 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-14T10:58:00.177 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-14T10:58:00.177 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 125609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usbserial.ko 2023-10-14T10:58:00.177 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-14T10:58:00.177 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-14T10:58:00.178 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/wishbone-serial.ko 2023-10-14T10:58:00.178 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-14T10:58:00.178 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ 2023-10-14T10:58:00.178 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 52913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-14T10:58:00.178 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-14T10:58:00.179 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-14T10:58:00.179 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-14T10:58:00.179 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-14T10:58:00.179 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-14T10:58:00.179 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-14T10:58:00.179 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-14T10:58:00.180 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-14T10:58:00.180 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-14T10:58:00.180 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-14T10:58:00.180 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-14T10:58:00.180 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-14T10:58:00.180 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-14T10:58:00.181 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 179969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-14T10:58:00.181 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/ 2023-10-14T10:58:00.181 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 67481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-14T10:58:00.181 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 72177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-14T10:58:00.181 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 107001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-14T10:58:00.182 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/ 2023-10-14T10:58:00.182 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/ 2023-10-14T10:58:00.182 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 154297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-14T10:58:00.182 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-14T10:58:00.182 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 108737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-14T10:58:00.183 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 77609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-14T10:58:00.183 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/ 2023-10-14T10:58:00.183 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 113873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-14T10:58:00.183 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-14T10:58:00.183 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 58089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-14T10:58:00.184 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 89249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-14T10:58:00.184 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/ 2023-10-14T10:58:00.184 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/ 2023-10-14T10:58:00.184 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-10-14T10:58:00.184 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/aat2870_bl.ko 2023-10-14T10:58:00.185 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp5520_bl.ko 2023-10-14T10:58:00.185 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp8860_bl.ko 2023-10-14T10:58:00.185 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp8870_bl.ko 2023-10-14T10:58:00.185 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-14T10:58:00.185 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/as3711_bl.ko 2023-10-14T10:58:00.185 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/bd6107.ko 2023-10-14T10:58:00.186 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/da903x_bl.ko 2023-10-14T10:58:00.186 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/da9052_bl.ko 2023-10-14T10:58:00.186 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/gpio_backlight.ko 2023-10-14T10:58:00.186 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/kb3886_bl.ko 2023-10-14T10:58:00.186 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-14T10:58:00.187 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lm3533_bl.ko 2023-10-14T10:58:00.187 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lm3639_bl.ko 2023-10-14T10:58:00.187 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lv5207lp.ko 2023-10-14T10:58:00.187 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/max8925_bl.ko 2023-10-14T10:58:00.187 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/pandora_bl.ko 2023-10-14T10:58:00.188 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-10-14T10:58:00.188 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-14T10:58:00.188 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/wm831x_bl.ko 2023-10-14T10:58:00.188 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/ 2023-10-14T10:58:00.188 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ 2023-10-14T10:58:00.189 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-14T10:58:00.189 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-14T10:58:00.189 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/matrox_w1.ko 2023-10-14T10:58:00.189 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/w1-gpio.ko 2023-10-14T10:58:00.189 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/ 2023-10-14T10:58:00.189 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-14T10:58:00.190 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-14T10:58:00.190 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-14T10:58:00.190 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-14T10:58:00.190 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-14T10:58:00.191 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-14T10:58:00.191 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-14T10:58:00.191 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-14T10:58:00.191 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-14T10:58:00.191 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-14T10:58:00.191 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 56425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-14T10:58:00.192 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 102673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-14T10:58:00.192 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ 2023-10-14T10:58:00.192 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/acquirewdt.ko 2023-10-14T10:58:00.192 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/advantechwdt.ko 2023-10-14T10:58:00.192 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-14T10:58:00.193 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-14T10:58:00.193 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/cpu5wdt.ko 2023-10-14T10:58:00.193 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9052_wdt.ko 2023-10-14T10:58:00.193 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9055_wdt.ko 2023-10-14T10:58:00.193 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9063_wdt.ko 2023-10-14T10:58:00.193 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/dw_wdt.ko 2023-10-14T10:58:00.194 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/eurotechwdt.ko 2023-10-14T10:58:00.194 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-14T10:58:00.194 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-14T10:58:00.194 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-14T10:58:00.194 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-14T10:58:00.195 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-14T10:58:00.195 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-14T10:58:00.195 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-14T10:58:00.195 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-14T10:58:00.195 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-14T10:58:00.195 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-14T10:58:00.196 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/kempld_wdt.ko 2023-10-14T10:58:00.196 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-14T10:58:00.196 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/mena21_wdt.ko 2023-10-14T10:58:00.196 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-10-14T10:58:00.196 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-14T10:58:00.197 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-10-14T10:58:00.197 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pc87413_wdt.ko 2023-10-14T10:58:00.197 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-14T10:58:00.197 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-14T10:58:00.197 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/retu_wdt.ko 2023-10-14T10:58:00.198 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-10-14T10:58:00.198 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-10-14T10:58:00.198 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-14T10:58:00.198 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sc1200wdt.ko 2023-10-14T10:58:00.198 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-14T10:58:00.199 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-10-14T10:58:00.199 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-14T10:58:00.199 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-14T10:58:00.199 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/twl4030_wdt.ko 2023-10-14T10:58:00.199 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-14T10:58:00.199 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-14T10:58:00.200 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-14T10:58:00.200 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-14T10:58:00.200 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wafer5823wdt.ko 2023-10-14T10:58:00.200 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-14T10:58:00.200 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wm831x_wdt.ko 2023-10-14T10:58:00.200 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wm8350_wdt.ko 2023-10-14T10:58:00.201 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-14T10:58:00.201 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/ 2023-10-14T10:58:00.201 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-14T10:58:00.201 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-14T10:58:00.201 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-14T10:58:00.202 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/ 2023-10-14T10:58:00.202 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 176441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-14T10:58:00.202 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-14T10:58:00.202 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 71249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-scsiback.ko 2023-10-14T10:58:00.202 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/ 2023-10-14T10:58:00.203 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-14T10:58:00.203 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ 2023-10-14T10:58:00.203 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/ 2023-10-14T10:58:00.203 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 166425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-14T10:58:00.203 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/adfs/ 2023-10-14T10:58:00.204 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 61073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/adfs/adfs.ko 2023-10-14T10:58:00.204 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/ 2023-10-14T10:58:00.204 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 163593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-14T10:58:00.204 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/afs/ 2023-10-14T10:58:00.204 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 932817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/afs/kafs.ko 2023-10-14T10:58:00.204 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/autofs/ 2023-10-14T10:58:00.205 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 101057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/autofs/autofs4.ko 2023-10-14T10:58:00.205 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/ 2023-10-14T10:58:00.205 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 64545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-14T10:58:00.205 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/bfs/ 2023-10-14T10:58:00.205 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/bfs/bfs.ko 2023-10-14T10:58:00.206 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-14T10:58:00.206 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/ 2023-10-14T10:58:00.206 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 3402585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-14T10:58:00.206 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/ 2023-10-14T10:58:00.206 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 306073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-14T10:58:00.207 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ 2023-10-14T10:58:00.207 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1323873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-14T10:58:00.207 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/ 2023-10-14T10:58:00.207 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 100801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-14T10:58:00.207 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/configfs/ 2023-10-14T10:58:00.208 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 108393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/configfs/configfs.ko 2023-10-14T10:58:00.208 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/ 2023-10-14T10:58:00.208 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-14T10:58:00.208 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/ 2023-10-14T10:58:00.208 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 642577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-14T10:58:00.208 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/efs/ 2023-10-14T10:58:00.209 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/efs/efs.ko 2023-10-14T10:58:00.209 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/ 2023-10-14T10:58:00.209 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1505025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-14T10:58:00.209 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/ 2023-10-14T10:58:00.209 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-14T10:58:00.209 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/freevxfs/ 2023-10-14T10:58:00.210 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/freevxfs/freevxfs.ko 2023-10-14T10:58:00.210 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/ 2023-10-14T10:58:00.210 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 226481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-14T10:58:00.210 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/ 2023-10-14T10:58:00.210 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-14T10:58:00.210 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/ 2023-10-14T10:58:00.211 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1231529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-14T10:58:00.211 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/ 2023-10-14T10:58:00.211 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 141209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-14T10:58:00.211 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/ 2023-10-14T10:58:00.211 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 222817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-14T10:58:00.211 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hpfs/ 2023-10-14T10:58:00.212 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 192329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hpfs/hpfs.ko 2023-10-14T10:58:00.212 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/ 2023-10-14T10:58:00.212 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 74065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-14T10:58:00.212 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/ 2023-10-14T10:58:00.212 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 419497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-14T10:58:00.212 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/ 2023-10-14T10:58:00.213 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 280313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-14T10:58:00.213 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/ 2023-10-14T10:58:00.213 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 89193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-14T10:58:00.213 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/ 2023-10-14T10:58:00.213 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 124649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-14T10:58:00.214 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/ 2023-10-14T10:58:00.214 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/ 2023-10-14T10:58:00.214 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 81449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-14T10:58:00.214 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/ 2023-10-14T10:58:00.214 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 59449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-14T10:58:00.214 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/ 2023-10-14T10:58:00.215 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 117513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-14T10:58:00.215 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1055649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-14T10:58:00.215 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 66441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv2.ko 2023-10-14T10:58:00.215 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 120177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-14T10:58:00.215 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 2041689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-14T10:58:00.216 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/ 2023-10-14T10:58:00.216 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-14T10:58:00.216 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-14T10:58:00.216 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/ 2023-10-14T10:58:00.216 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1516809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-14T10:58:00.217 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/ 2023-10-14T10:58:00.217 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 592833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-14T10:58:00.217 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/ 2023-10-14T10:58:00.217 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-14T10:58:00.217 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-14T10:58:00.217 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-14T10:58:00.218 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-14T10:58:00.218 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-14T10:58:00.218 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-14T10:58:00.218 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-14T10:58:00.218 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-14T10:58:00.219 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-14T10:58:00.219 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-14T10:58:00.219 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-14T10:58:00.219 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ascii.ko 2023-10-14T10:58:00.219 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-14T10:58:00.220 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-14T10:58:00.220 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-14T10:58:00.220 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-14T10:58:00.220 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-14T10:58:00.220 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-14T10:58:00.221 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-14T10:58:00.221 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-14T10:58:00.221 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-14T10:58:00.221 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-14T10:58:00.221 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-14T10:58:00.222 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-14T10:58:00.222 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-14T10:58:00.222 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-14T10:58:00.222 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-14T10:58:00.222 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-14T10:58:00.223 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-14T10:58:00.223 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-14T10:58:00.223 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 94137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-14T10:58:00.223 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 142673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-14T10:58:00.223 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 165745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-14T10:58:00.224 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 118121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-14T10:58:00.224 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-14T10:58:00.224 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-14T10:58:00.224 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-14T10:58:00.224 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-14T10:58:00.224 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-14T10:58:00.225 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-14T10:58:00.225 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-14T10:58:00.225 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-14T10:58:00.225 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-14T10:58:00.225 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-14T10:58:00.225 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-14T10:58:00.226 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-14T10:58:00.226 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-14T10:58:00.226 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-14T10:58:00.226 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-14T10:58:00.226 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-14T10:58:00.227 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-14T10:58:00.227 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ntfs/ 2023-10-14T10:58:00.227 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 219417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ntfs/ntfs.ko 2023-10-14T10:58:00.227 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ 2023-10-14T10:58:00.227 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ 2023-10-14T10:58:00.228 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 244409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-14T10:58:00.228 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ 2023-10-14T10:58:00.228 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 440737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-14T10:58:00.228 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ 2023-10-14T10:58:00.228 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 54049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-14T10:58:00.228 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 2592433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-14T10:58:00.229 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-14T10:58:00.229 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-14T10:58:00.229 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-14T10:58:00.229 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/omfs/ 2023-10-14T10:58:00.229 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 53433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/omfs/omfs.ko 2023-10-14T10:58:00.229 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/ 2023-10-14T10:58:00.230 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 352153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-14T10:58:00.230 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ 2023-10-14T10:58:00.230 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 54809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-14T10:58:00.230 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx4/ 2023-10-14T10:58:00.230 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx4/qnx4.ko 2023-10-14T10:58:00.231 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx6/ 2023-10-14T10:58:00.231 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 46689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx6/qnx6.ko 2023-10-14T10:58:00.231 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/ 2023-10-14T10:58:00.231 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_tree.ko 2023-10-14T10:58:00.231 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_v1.ko 2023-10-14T10:58:00.231 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_v2.ko 2023-10-14T10:58:00.232 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/ 2023-10-14T10:58:00.232 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 532673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-14T10:58:00.232 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/ 2023-10-14T10:58:00.232 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-14T10:58:00.232 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/ 2023-10-14T10:58:00.233 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/ 2023-10-14T10:58:00.233 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 2668121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-14T10:58:00.233 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/ 2023-10-14T10:58:00.233 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-14T10:58:00.233 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-14T10:58:00.234 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/ 2023-10-14T10:58:00.234 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 134641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-14T10:58:00.234 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/ 2023-10-14T10:58:00.234 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 90721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-14T10:58:00.234 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/ 2023-10-14T10:58:00.235 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 247737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-14T10:58:00.235 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ 2023-10-14T10:58:00.235 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 162497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-14T10:58:00.235 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/ 2023-10-14T10:58:00.235 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 4010729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-14T10:58:00.236 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/ 2023-10-14T10:58:00.236 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/locking/ 2023-10-14T10:58:00.236 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 75489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/locking/locktorture.ko 2023-10-14T10:58:00.236 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/time/ 2023-10-14T10:58:00.236 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/time/test_udelay.ko 2023-10-14T10:58:00.237 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 60553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-14T10:58:00.237 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ 2023-10-14T10:58:00.237 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 6833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-14T10:58:00.237 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 6529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc7.ko 2023-10-14T10:58:00.237 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-14T10:58:00.238 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/ 2023-10-14T10:58:00.238 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-14T10:58:00.238 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-14T10:58:00.238 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/interval_tree_test.ko 2023-10-14T10:58:00.238 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-14T10:58:00.238 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-14T10:58:00.241 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/ 2023-10-14T10:58:00.241 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-14T10:58:00.241 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-14T10:58:00.242 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/ 2023-10-14T10:58:00.242 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 6617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-14T10:58:00.242 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/memory-notifier-error-inject.ko 2023-10-14T10:58:00.242 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/notifier-error-inject.ko 2023-10-14T10:58:00.242 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/percpu_test.ko 2023-10-14T10:58:00.243 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/pm-notifier-error-inject.ko 2023-10-14T10:58:00.243 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/ 2023-10-14T10:58:00.243 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 143433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-14T10:58:00.243 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/rbtree_test.ko 2023-10-14T10:58:00.243 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/ 2023-10-14T10:58:00.244 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-14T10:58:00.244 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test-kstrtox.ko 2023-10-14T10:58:00.244 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test-string_helpers.ko 2023-10-14T10:58:00.244 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 4760425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_bpf.ko 2023-10-14T10:58:00.244 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_firmware.ko 2023-10-14T10:58:00.245 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 6369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_module.ko 2023-10-14T10:58:00.245 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_user_copy.ko 2023-10-14T10:58:00.245 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-14T10:58:00.245 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-14T10:58:00.245 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-14T10:58:00.245 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/xz/ 2023-10-14T10:58:00.246 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/xz/xz_dec_test.ko 2023-10-14T10:58:00.246 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/ 2023-10-14T10:58:00.246 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-14T10:58:00.246 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ 2023-10-14T10:58:00.246 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/ 2023-10-14T10:58:00.247 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 55737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-14T10:58:00.247 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-14T10:58:00.247 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-14T10:58:00.247 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-14T10:58:00.247 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 6985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-14T10:58:00.248 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-14T10:58:00.248 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-14T10:58:00.248 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-14T10:58:00.248 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/ 2023-10-14T10:58:00.248 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-14T10:58:00.248 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-14T10:58:00.249 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-14T10:58:00.249 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-14T10:58:00.249 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-14T10:58:00.249 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/ 2023-10-14T10:58:00.249 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 81737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-14T10:58:00.250 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/ 2023-10-14T10:58:00.250 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 198337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-14T10:58:00.250 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-14T10:58:00.250 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-14T10:58:00.250 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-14T10:58:00.250 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/ 2023-10-14T10:58:00.251 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 649297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-14T10:58:00.251 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/ 2023-10-14T10:58:00.251 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 63809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-14T10:58:00.251 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 777689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-14T10:58:00.251 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ 2023-10-14T10:58:00.252 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-14T10:58:00.252 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-14T10:58:00.252 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-14T10:58:00.252 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-14T10:58:00.252 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-14T10:58:00.252 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-14T10:58:00.253 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-14T10:58:00.253 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-14T10:58:00.253 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-14T10:58:00.253 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-14T10:58:00.253 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-14T10:58:00.254 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-14T10:58:00.254 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-14T10:58:00.254 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-14T10:58:00.254 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-14T10:58:00.254 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-14T10:58:00.255 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-14T10:58:00.255 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-14T10:58:00.255 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-14T10:58:00.255 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-14T10:58:00.255 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 55929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-14T10:58:00.255 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-14T10:58:00.256 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-14T10:58:00.256 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/ 2023-10-14T10:58:00.256 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1047017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-14T10:58:00.256 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/ 2023-10-14T10:58:00.256 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 125697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-14T10:58:00.256 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/ 2023-10-14T10:58:00.257 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 194209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-14T10:58:00.257 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-14T10:58:00.257 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 57881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-14T10:58:00.257 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 60337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-14T10:58:00.257 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/ 2023-10-14T10:58:00.258 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 390473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-14T10:58:00.258 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-14T10:58:00.258 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-14T10:58:00.258 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-14T10:58:00.258 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-14T10:58:00.259 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/hsr/ 2023-10-14T10:58:00.259 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 99729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/hsr/hsr.ko 2023-10-14T10:58:00.259 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ 2023-10-14T10:58:00.259 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ 2023-10-14T10:58:00.259 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 45233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-14T10:58:00.260 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 254625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-14T10:58:00.260 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-14T10:58:00.260 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ 2023-10-14T10:58:00.260 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-14T10:58:00.260 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-14T10:58:00.261 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 48401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-14T10:58:00.261 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-14T10:58:00.261 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 48657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-14T10:58:00.261 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 60633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-14T10:58:00.261 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 61225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-14T10:58:00.262 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-14T10:58:00.262 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-14T10:58:00.262 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-14T10:58:00.262 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ 2023-10-14T10:58:00.262 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-14T10:58:00.262 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-14T10:58:00.263 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-14T10:58:00.263 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ip_tables.ko 2023-10-14T10:58:00.263 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-14T10:58:00.263 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-10-14T10:58:00.263 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-14T10:58:00.264 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-14T10:58:00.264 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-14T10:58:00.264 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-10-14T10:58:00.264 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-14T10:58:00.264 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-14T10:58:00.265 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-14T10:58:00.265 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-14T10:58:00.265 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-14T10:58:00.265 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-14T10:58:00.265 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-14T10:58:00.265 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-14T10:58:00.266 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-14T10:58:00.266 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-10-14T10:58:00.266 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-14T10:58:00.266 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-14T10:58:00.266 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-14T10:58:00.267 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-14T10:58:00.267 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-14T10:58:00.267 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-14T10:58:00.267 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-14T10:58:00.267 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-14T10:58:00.268 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-14T10:58:00.268 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-14T10:58:00.268 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-14T10:58:00.268 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-14T10:58:00.268 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-14T10:58:00.268 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-14T10:58:00.269 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-14T10:58:00.269 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-14T10:58:00.269 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-14T10:58:00.269 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-14T10:58:00.269 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-14T10:58:00.269 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-14T10:58:00.270 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-14T10:58:00.270 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-14T10:58:00.270 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ 2023-10-14T10:58:00.270 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-14T10:58:00.270 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-14T10:58:00.271 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-14T10:58:00.271 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 80897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_gre.ko 2023-10-14T10:58:00.271 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 93577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-14T10:58:00.271 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-14T10:58:00.271 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 53273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-14T10:58:00.272 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-14T10:58:00.272 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/mip6.ko 2023-10-14T10:58:00.272 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ 2023-10-14T10:58:00.272 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-14T10:58:00.272 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-10-14T10:58:00.272 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-14T10:58:00.273 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-14T10:58:00.273 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-14T10:58:00.273 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-14T10:58:00.273 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-14T10:58:00.273 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-14T10:58:00.274 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-14T10:58:00.274 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-14T10:58:00.274 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-14T10:58:00.274 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-14T10:58:00.274 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-14T10:58:00.275 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-14T10:58:00.275 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-14T10:58:00.275 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-14T10:58:00.275 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-14T10:58:00.275 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-14T10:58:00.276 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-14T10:58:00.276 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-14T10:58:00.276 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-14T10:58:00.276 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-14T10:58:00.276 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-14T10:58:00.276 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-14T10:58:00.277 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-14T10:58:00.277 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 74073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-14T10:58:00.277 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-14T10:58:00.277 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-14T10:58:00.277 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/ 2023-10-14T10:58:00.278 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 82833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-14T10:58:00.278 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/ 2023-10-14T10:58:00.278 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 125281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-14T10:58:00.278 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-14T10:58:00.278 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-14T10:58:00.278 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-14T10:58:00.279 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-14T10:58:00.279 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-14T10:58:00.279 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 53241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-14T10:58:00.279 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/lapb/ 2023-10-14T10:58:00.279 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/lapb/lapb.ko 2023-10-14T10:58:00.280 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/ 2023-10-14T10:58:00.280 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-14T10:58:00.280 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 267777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc2.ko 2023-10-14T10:58:00.280 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/ 2023-10-14T10:58:00.280 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 290417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-14T10:58:00.280 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/ 2023-10-14T10:58:00.281 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-14T10:58:00.281 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ 2023-10-14T10:58:00.281 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ 2023-10-14T10:58:00.281 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 119585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-14T10:58:00.281 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-14T10:58:00.282 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-14T10:58:00.282 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-14T10:58:00.282 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 100297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-14T10:58:00.282 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 101441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-14T10:58:00.282 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 102817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-14T10:58:00.282 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 103481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-14T10:58:00.283 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 112849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-14T10:58:00.283 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 60329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-14T10:58:00.283 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 109593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-14T10:58:00.283 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 113129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-14T10:58:00.283 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 112585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-14T10:58:00.284 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 111585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-14T10:58:00.284 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 114465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-14T10:58:00.284 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-14T10:58:00.284 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ 2023-10-14T10:58:00.284 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 411729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-14T10:58:00.284 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-14T10:58:00.285 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-14T10:58:00.285 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-14T10:58:00.285 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-14T10:58:00.285 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-14T10:58:00.285 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-14T10:58:00.286 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-14T10:58:00.286 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-14T10:58:00.286 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-14T10:58:00.286 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-14T10:58:00.286 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-14T10:58:00.287 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-14T10:58:00.287 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-14T10:58:00.287 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-14T10:58:00.287 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 408257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-14T10:58:00.287 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-14T10:58:00.287 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-14T10:58:00.288 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-14T10:58:00.288 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 118145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-14T10:58:00.288 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-14T10:58:00.288 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-14T10:58:00.288 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 107297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-14T10:58:00.289 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-14T10:58:00.289 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-14T10:58:00.289 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 66641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-14T10:58:00.289 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-14T10:58:00.289 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-14T10:58:00.289 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-14T10:58:00.290 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 89473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-14T10:58:00.290 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-14T10:58:00.290 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-14T10:58:00.290 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 95417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-14T10:58:00.290 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-14T10:58:00.291 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-14T10:58:00.291 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-14T10:58:00.291 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-14T10:58:00.291 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-14T10:58:00.291 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-14T10:58:00.292 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 615313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-14T10:58:00.292 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-14T10:58:00.292 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-14T10:58:00.292 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-10-14T10:58:00.292 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-14T10:58:00.292 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-14T10:58:00.293 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-14T10:58:00.293 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-14T10:58:00.293 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-14T10:58:00.293 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-14T10:58:00.293 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-14T10:58:00.294 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-14T10:58:00.294 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-14T10:58:00.294 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-14T10:58:00.294 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-14T10:58:00.294 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-14T10:58:00.294 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-14T10:58:00.295 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-14T10:58:00.295 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-14T10:58:00.295 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_osf.ko 2023-10-14T10:58:00.295 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-14T10:58:00.295 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-14T10:58:00.296 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-14T10:58:00.296 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-14T10:58:00.296 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-14T10:58:00.296 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_synproxy.ko 2023-10-14T10:58:00.296 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tproxy.ko 2023-10-14T10:58:00.296 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 89313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/x_tables.ko 2023-10-14T10:58:00.297 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-14T10:58:00.297 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-14T10:58:00.297 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-14T10:58:00.297 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-14T10:58:00.297 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-14T10:58:00.298 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-14T10:58:00.298 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-14T10:58:00.298 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-14T10:58:00.298 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-14T10:58:00.298 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-14T10:58:00.299 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-14T10:58:00.299 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-14T10:58:00.299 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-14T10:58:00.299 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-14T10:58:00.299 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-14T10:58:00.299 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-14T10:58:00.300 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-14T10:58:00.300 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-14T10:58:00.300 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-14T10:58:00.300 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-14T10:58:00.300 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-14T10:58:00.301 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-14T10:58:00.301 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-14T10:58:00.301 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-14T10:58:00.301 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-14T10:58:00.301 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-14T10:58:00.301 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-14T10:58:00.302 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-14T10:58:00.302 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-14T10:58:00.302 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-14T10:58:00.302 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-14T10:58:00.302 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-14T10:58:00.303 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-14T10:58:00.303 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-14T10:58:00.303 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-14T10:58:00.303 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-14T10:58:00.303 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-14T10:58:00.304 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-14T10:58:00.304 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-14T10:58:00.304 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 43289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-14T10:58:00.304 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-14T10:58:00.304 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-14T10:58:00.304 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-14T10:58:00.305 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-14T10:58:00.305 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-14T10:58:00.305 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-14T10:58:00.305 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-14T10:58:00.305 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-14T10:58:00.306 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-14T10:58:00.306 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-14T10:58:00.306 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-14T10:58:00.306 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-14T10:58:00.306 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-14T10:58:00.306 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-14T10:58:00.307 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-14T10:58:00.307 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-14T10:58:00.307 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-14T10:58:00.307 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-14T10:58:00.307 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-14T10:58:00.308 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-14T10:58:00.308 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-14T10:58:00.308 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-14T10:58:00.308 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-14T10:58:00.308 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-14T10:58:00.309 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-14T10:58:00.309 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-14T10:58:00.309 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-14T10:58:00.309 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-14T10:58:00.309 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-14T10:58:00.309 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpudp.ko 2023-10-14T10:58:00.310 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-14T10:58:00.310 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-14T10:58:00.310 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/ 2023-10-14T10:58:00.310 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-14T10:58:00.310 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/ 2023-10-14T10:58:00.311 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-14T10:58:00.311 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/ 2023-10-14T10:58:00.311 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 380033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-14T10:58:00.311 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-14T10:58:00.311 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-14T10:58:00.311 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-14T10:58:00.312 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/ 2023-10-14T10:58:00.312 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-14T10:58:00.312 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/ 2023-10-14T10:58:00.312 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 110201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/phonet.ko 2023-10-14T10:58:00.312 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 54697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/pn_pep.ko 2023-10-14T10:58:00.313 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/ 2023-10-14T10:58:00.313 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 251481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-14T10:58:00.313 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 164937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-14T10:58:00.313 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 67377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-14T10:58:00.313 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rxrpc/ 2023-10-14T10:58:00.314 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 819657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rxrpc/rxrpc.ko 2023-10-14T10:58:00.314 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/ 2023-10-14T10:58:00.314 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-14T10:58:00.314 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-14T10:58:00.314 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-14T10:58:00.314 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-14T10:58:00.315 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-14T10:58:00.315 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 43449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-14T10:58:00.315 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-14T10:58:00.315 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-14T10:58:00.315 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-14T10:58:00.316 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-14T10:58:00.316 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-14T10:58:00.316 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-14T10:58:00.316 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_cgroup.ko 2023-10-14T10:58:00.316 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-14T10:58:00.317 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-14T10:58:00.317 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-14T10:58:00.317 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 61409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-14T10:58:00.317 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-14T10:58:00.317 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-14T10:58:00.318 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-14T10:58:00.318 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-14T10:58:00.318 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-14T10:58:00.318 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-14T10:58:00.318 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-14T10:58:00.319 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-14T10:58:00.319 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-14T10:58:00.319 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-14T10:58:00.319 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq_codel.ko 2023-10-14T10:58:00.319 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-14T10:58:00.320 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-14T10:58:00.320 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-14T10:58:00.320 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 66393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-14T10:58:00.320 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-14T10:58:00.320 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-14T10:58:00.321 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-14T10:58:00.321 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-14T10:58:00.321 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-14T10:58:00.321 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-14T10:58:00.321 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-14T10:58:00.322 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-14T10:58:00.322 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 48793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-14T10:58:00.322 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-14T10:58:00.322 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-14T10:58:00.322 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-14T10:58:00.323 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-14T10:58:00.323 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-14T10:58:00.323 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/ 2023-10-14T10:58:00.323 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 929745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-14T10:58:00.323 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-14T10:58:00.323 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/ 2023-10-14T10:58:00.324 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/ 2023-10-14T10:58:00.324 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 336529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-14T10:58:00.324 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 54737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-14T10:58:00.324 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1520161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-14T10:58:00.324 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/ 2023-10-14T10:58:00.325 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 707721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-14T10:58:00.325 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/ 2023-10-14T10:58:00.325 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-14T10:58:00.325 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 862641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-14T10:58:00.325 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/ 2023-10-14T10:58:00.326 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-14T10:58:00.326 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/ 2023-10-14T10:58:00.326 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 85337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-14T10:58:00.326 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 68049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-14T10:58:00.326 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 96193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-14T10:58:00.327 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-14T10:58:00.327 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-14T10:58:00.327 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/x25/ 2023-10-14T10:58:00.327 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 125177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/x25/x25.ko 2023-10-14T10:58:00.327 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/ 2023-10-14T10:58:00.327 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_algo.ko 2023-10-14T10:58:00.328 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-14T10:58:00.328 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 102257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_user.ko 2023-10-14T10:58:00.328 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/ 2023-10-14T10:58:00.328 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/ 2023-10-14T10:58:00.328 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-14T10:58:00.329 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 639863 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-14T10:58:00.329 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 623919 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-14T10:58:00.329 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7663 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-14T10:58:00.329 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23428 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-14T10:58:00.329 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9821 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-14T10:58:00.330 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 70004 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-14T10:58:00.330 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 146313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-14T10:58:00.330 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 232548 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-14T10:58:00.330 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 210 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-14T10:58:00.330 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 72606 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-14T10:58:00.331 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 879 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-14T10:58:00.331 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 254438 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-14T10:58:00.331 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 309363 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-14T10:58:00.331 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./usr/ 2023-10-14T10:58:00.331 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./usr/share/ 2023-10-14T10:58:00.332 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./usr/share/doc/ 2023-10-14T10:58:00.332 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/ 2023-10-14T10:58:00.332 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 175 2023-10-10 19:56 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/changelog.Debian.gz 2023-10-14T10:58:00.332 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 691 2023-10-10 19:56 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/copyright 2023-10-14T10:58:00.333 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-14T10:58:00.333 INFO:teuthology.task.kernel:searching for kernel 6.6.0-rc5-g47672119149b 2023-10-14T10:58:00.334 DEBUG:teuthology.orchestra.run.smithi026:> egrep '(submenu|menuentry.*6.6.0-rc5-g47672119149b).*{' /boot/grub/grub.cfg 2023-10-14T10:58:00.335 DEBUG:teuthology.orchestra.run.smithi110:> dpkg-deb -c /tmp/linux-image.deb 2023-10-14T10:58:00.342 INFO:teuthology.orchestra.run.smithi026.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-10-14T10:58:00.342 INFO:teuthology.orchestra.run.smithi026.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g47672119149b' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g47672119149b-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-10-14T10:58:00.342 INFO:teuthology.orchestra.run.smithi026.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g47672119149b (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g47672119149b-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-10-14T10:58:00.343 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-10-14T10:58:00.343 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-rc5-g47672119149b 2023-10-14T10:58:00.344 DEBUG:teuthology.orchestra.run.smithi026:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-10-14T10:58:00.344 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./ 2023-10-14T10:58:00.344 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./boot/ 2023-10-14T10:58:00.345 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 4415097 2023-10-10 19:56 ./boot/System.map-6.6.0-rc5-g47672119149b 2023-10-14T10:58:00.352 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 169298 2023-10-10 19:56 ./boot/config-6.6.0-rc5-g47672119149b 2023-10-14T10:58:00.352 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11352928 2023-10-10 19:56 ./boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-14T10:58:00.371 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/ 2023-10-14T10:58:00.372 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/kernel/ 2023-10-14T10:58:00.372 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/kernel/postinst.d/ 2023-10-14T10:58:00.372 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/kernel/postrm.d/ 2023-10-14T10:58:00.372 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/kernel/preinst.d/ 2023-10-14T10:58:00.372 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/kernel/prerm.d/ 2023-10-14T10:58:00.373 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/ 2023-10-14T10:58:00.373 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/ 2023-10-14T10:58:00.373 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/ 2023-10-14T10:58:00.373 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/ 2023-10-14T10:58:00.373 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/ 2023-10-14T10:58:00.374 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/ 2023-10-14T10:58:00.374 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ 2023-10-14T10:58:00.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 490233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/aesni-intel.ko 2023-10-14T10:58:00.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-14T10:58:00.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-14T10:58:00.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-14T10:58:00.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 93113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-14T10:58:00.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 106729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-14T10:58:00.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 152241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-14T10:58:00.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-14T10:58:00.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-14T10:58:00.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 83889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-14T10:58:00.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-14T10:58:00.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-14T10:58:00.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-14T10:58:00.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-14T10:58:00.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-14T10:58:00.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-14T10:58:00.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 58585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-14T10:58:00.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-14T10:58:00.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-14T10:58:00.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-14T10:58:00.378 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/ 2023-10-14T10:58:00.378 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/ 2023-10-14T10:58:00.378 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/ 2023-10-14T10:58:00.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-14T10:58:00.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpuid.ko 2023-10-14T10:58:00.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/msr.ko 2023-10-14T10:58:00.379 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/ 2023-10-14T10:58:00.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 353761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-14T10:58:00.393 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi026.front.sepia.ceph.com to complete... 2023-10-14T10:58:00.437 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 881713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-14T10:58:00.437 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 2276817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-14T10:58:00.437 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ 2023-10-14T10:58:00.438 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/af_alg.ko 2023-10-14T10:58:00.438 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/algif_hash.ko 2023-10-14T10:58:00.438 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/algif_skcipher.ko 2023-10-14T10:58:00.438 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-14T10:58:00.438 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-14T10:58:00.439 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-14T10:58:00.439 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/asymmetric_keys/ 2023-10-14T10:58:00.439 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-10-14T10:58:00.439 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/ 2023-10-14T10:58:00.439 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-14T10:58:00.440 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-14T10:58:00.440 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-14T10:58:00.440 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-14T10:58:00.440 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-14T10:58:00.440 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-14T10:58:00.441 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-14T10:58:00.441 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-14T10:58:00.441 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-14T10:58:00.441 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-14T10:58:00.441 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-14T10:58:00.442 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-14T10:58:00.442 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-14T10:58:00.442 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-14T10:58:00.442 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-14T10:58:00.442 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-14T10:58:00.443 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-14T10:58:00.443 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-14T10:58:00.443 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cryptd.ko 2023-10-14T10:58:00.443 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-14T10:58:00.443 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_simd.ko 2023-10-14T10:58:00.443 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-14T10:58:00.444 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-14T10:58:00.444 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-14T10:58:00.444 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-14T10:58:00.444 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-14T10:58:00.445 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-14T10:58:00.445 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-14T10:58:00.445 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-14T10:58:00.445 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lrw.ko 2023-10-14T10:58:00.445 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-14T10:58:00.446 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-14T10:58:00.446 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-14T10:58:00.446 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-14T10:58:00.446 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-14T10:58:00.446 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-14T10:58:00.447 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-14T10:58:00.447 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-14T10:58:00.447 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-14T10:58:00.447 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 149193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-14T10:58:00.447 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-14T10:58:00.448 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-14T10:58:00.448 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-14T10:58:00.448 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-14T10:58:00.448 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-14T10:58:00.448 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-14T10:58:00.448 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-14T10:58:00.449 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xts.ko 2023-10-14T10:58:00.449 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-14T10:58:00.449 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ 2023-10-14T10:58:00.449 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ 2023-10-14T10:58:00.449 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_extlog.ko 2023-10-14T10:58:00.450 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-14T10:58:00.450 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-14T10:58:00.450 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/apei/ 2023-10-14T10:58:00.450 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/apei/einj.ko 2023-10-14T10:58:00.450 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-14T10:58:00.451 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-14T10:58:00.451 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-14T10:58:00.451 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-14T10:58:00.451 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 103025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-14T10:58:00.451 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ 2023-10-14T10:58:00.452 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-14T10:58:00.452 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 88865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci.ko 2023-10-14T10:58:00.452 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-14T10:58:00.452 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 88289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci.ko 2023-10-14T10:58:00.452 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-14T10:58:00.453 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-14T10:58:00.453 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-14T10:58:00.453 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-14T10:58:00.453 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-14T10:58:00.453 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-14T10:58:00.453 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-14T10:58:00.454 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-14T10:58:00.454 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-14T10:58:00.454 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-14T10:58:00.454 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-14T10:58:00.454 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-14T10:58:00.455 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-14T10:58:00.455 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-14T10:58:00.455 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-14T10:58:00.455 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-14T10:58:00.455 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-14T10:58:00.456 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-14T10:58:00.456 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_legacy.ko 2023-10-14T10:58:00.456 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-14T10:58:00.456 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-14T10:58:00.456 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-14T10:58:00.457 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-14T10:58:00.457 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-14T10:58:00.457 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-14T10:58:00.457 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-14T10:58:00.457 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-14T10:58:00.458 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-14T10:58:00.458 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-14T10:58:00.458 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-14T10:58:00.458 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-14T10:58:00.458 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-14T10:58:00.458 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_radisys.ko 2023-10-14T10:58:00.459 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-14T10:58:00.459 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rz1000.ko 2023-10-14T10:58:00.459 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-14T10:58:00.459 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-14T10:58:00.460 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-14T10:58:00.460 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-14T10:58:00.460 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-14T10:58:00.460 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-14T10:58:00.460 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-14T10:58:00.461 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-14T10:58:00.461 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 83345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-14T10:58:00.461 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 70393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-14T10:58:00.461 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-14T10:58:00.461 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-14T10:58:00.461 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-14T10:58:00.462 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-14T10:58:00.462 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-14T10:58:00.462 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-14T10:58:00.462 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-14T10:58:00.462 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-14T10:58:00.463 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-14T10:58:00.463 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-14T10:58:00.463 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ 2023-10-14T10:58:00.463 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-14T10:58:00.463 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/ 2023-10-14T10:58:00.464 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 124473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-14T10:58:00.464 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/ 2023-10-14T10:58:00.464 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/ 2023-10-14T10:58:00.464 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 113665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-14T10:58:00.464 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/ 2023-10-14T10:58:00.465 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 965585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-14T10:58:00.465 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 173225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-14T10:58:00.465 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/ 2023-10-14T10:58:00.465 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 94297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-14T10:58:00.465 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 115793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-14T10:58:00.466 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/ 2023-10-14T10:58:00.466 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 110449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-14T10:58:00.466 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 98193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-14T10:58:00.466 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 263769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-14T10:58:00.466 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/ 2023-10-14T10:58:00.467 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 98145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-14T10:58:00.467 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/ 2023-10-14T10:58:00.467 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-14T10:58:00.467 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ 2023-10-14T10:58:00.468 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/applicom.ko 2023-10-14T10:58:00.468 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-14T10:58:00.468 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/ 2023-10-14T10:58:00.468 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-14T10:58:00.468 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-14T10:58:00.468 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-14T10:58:00.469 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-14T10:58:00.469 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-14T10:58:00.469 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ 2023-10-14T10:58:00.469 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-14T10:58:00.470 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 148601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-14T10:58:00.470 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-14T10:58:00.470 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 139313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-14T10:58:00.470 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 70921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-14T10:58:00.470 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-14T10:58:00.471 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-14T10:58:00.471 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/ 2023-10-14T10:58:00.471 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 84097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-14T10:58:00.471 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/nvram.ko 2023-10-14T10:58:00.471 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-14T10:58:00.471 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-14T10:58:00.472 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/ 2023-10-14T10:58:00.472 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-14T10:58:00.472 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-10-14T10:58:00.472 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-10-14T10:58:00.472 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-10-14T10:58:00.473 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-14T10:58:00.473 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-14T10:58:00.473 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-10-14T10:58:00.473 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/ 2023-10-14T10:58:00.473 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_class.ko 2023-10-14T10:58:00.474 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_core.ko 2023-10-14T10:58:00.474 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-10-14T10:58:00.474 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/ 2023-10-14T10:58:00.474 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-palmas.ko 2023-10-14T10:58:00.474 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-si5351.ko 2023-10-14T10:58:00.475 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-twl6040.ko 2023-10-14T10:58:00.475 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-wm831x.ko 2023-10-14T10:58:00.475 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/ 2023-10-14T10:58:00.475 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-14T10:58:00.475 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-14T10:58:00.475 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-14T10:58:00.476 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ 2023-10-14T10:58:00.476 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ 2023-10-14T10:58:00.476 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 70801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-14T10:58:00.476 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 243025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-14T10:58:00.476 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/ 2023-10-14T10:58:00.477 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/ 2023-10-14T10:58:00.477 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/ 2023-10-14T10:58:00.477 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 438761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-14T10:58:00.477 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-10-14T10:58:00.477 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-14T10:58:00.478 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-14T10:58:00.478 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-14T10:58:00.478 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/ 2023-10-14T10:58:00.478 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 68857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-14T10:58:00.478 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/ 2023-10-14T10:58:00.479 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-14T10:58:00.479 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ 2023-10-14T10:58:00.479 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/ 2023-10-14T10:58:00.479 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-14T10:58:00.480 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ 2023-10-14T10:58:00.480 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 122569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-14T10:58:00.480 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ 2023-10-14T10:58:00.480 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 79953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-14T10:58:00.480 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-14T10:58:00.480 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 63617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-14T10:58:00.481 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-14T10:58:00.481 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-14T10:58:00.481 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-14T10:58:00.481 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-14T10:58:00.481 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-14T10:58:00.482 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 52041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-14T10:58:00.482 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-14T10:58:00.482 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-14T10:58:00.482 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 56825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-14T10:58:00.482 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-14T10:58:00.483 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/ 2023-10-14T10:58:00.483 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-gpio.ko 2023-10-14T10:58:00.483 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max14577.ko 2023-10-14T10:58:00.483 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max77693.ko 2023-10-14T10:58:00.483 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max8997.ko 2023-10-14T10:58:00.483 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-palmas.ko 2023-10-14T10:58:00.484 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-rt8973a.ko 2023-10-14T10:58:00.484 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-sm5502.ko 2023-10-14T10:58:00.484 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/ 2023-10-14T10:58:00.484 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/dmi-sysfs.ko 2023-10-14T10:58:00.484 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/efi/ 2023-10-14T10:58:00.485 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/efi/efi-pstore.ko 2023-10-14T10:58:00.485 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-14T10:58:00.485 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/ 2023-10-14T10:58:00.485 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-adp5520.ko 2023-10-14T10:58:00.485 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-amd8111.ko 2023-10-14T10:58:00.485 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-arizona.ko 2023-10-14T10:58:00.486 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-da9052.ko 2023-10-14T10:58:00.486 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-da9055.ko 2023-10-14T10:58:00.486 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-dln2.ko 2023-10-14T10:58:00.486 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 77849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-f7188x.ko 2023-10-14T10:58:00.486 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-generic.ko 2023-10-14T10:58:00.487 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-14T10:58:00.487 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-10-14T10:58:00.487 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-kempld.ko 2023-10-14T10:58:00.487 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-lp3943.ko 2023-10-14T10:58:00.487 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max7300.ko 2023-10-14T10:58:00.488 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max730x.ko 2023-10-14T10:58:00.488 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max732x.ko 2023-10-14T10:58:00.488 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-10-14T10:58:00.488 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-pca953x.ko 2023-10-14T10:58:00.488 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-pcf857x.ko 2023-10-14T10:58:00.489 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-rdc321x.ko 2023-10-14T10:58:00.489 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-sch.ko 2023-10-14T10:58:00.489 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-sch311x.ko 2023-10-14T10:58:00.489 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-tps65912.ko 2023-10-14T10:58:00.489 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-twl4030.ko 2023-10-14T10:58:00.489 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-twl6040.ko 2023-10-14T10:58:00.490 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-14T10:58:00.490 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-vx855.ko 2023-10-14T10:58:00.490 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm831x.ko 2023-10-14T10:58:00.490 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm8350.ko 2023-10-14T10:58:00.490 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm8994.ko 2023-10-14T10:58:00.491 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/ 2023-10-14T10:58:00.491 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-a4tech.ko 2023-10-14T10:58:00.491 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-apple.ko 2023-10-14T10:58:00.491 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-14T10:58:00.491 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-14T10:58:00.492 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-14T10:58:00.492 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-belkin.ko 2023-10-14T10:58:00.492 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cherry.ko 2023-10-14T10:58:00.492 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-chicony.ko 2023-10-14T10:58:00.492 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cp2112.ko 2023-10-14T10:58:00.493 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cypress.ko 2023-10-14T10:58:00.493 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-14T10:58:00.493 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-14T10:58:00.493 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-14T10:58:00.493 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-14T10:58:00.493 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ezkey.ko 2023-10-14T10:58:00.494 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-14T10:58:00.494 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-generic.ko 2023-10-14T10:58:00.494 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-14T10:58:00.494 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-14T10:58:00.495 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-14T10:58:00.495 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-14T10:58:00.495 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-14T10:58:00.495 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-14T10:58:00.495 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-14T10:58:00.496 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kensington.ko 2023-10-14T10:58:00.496 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-14T10:58:00.496 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-14T10:58:00.496 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-14T10:58:00.496 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-14T10:58:00.497 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-14T10:58:00.497 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lg-g15.ko 2023-10-14T10:58:00.497 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 58185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-14T10:58:00.497 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 101369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-14T10:58:00.497 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 80993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech.ko 2023-10-14T10:58:00.498 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-magicmouse.ko 2023-10-14T10:58:00.498 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-microsoft.ko 2023-10-14T10:58:00.498 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-monterey.ko 2023-10-14T10:58:00.498 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-14T10:58:00.499 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ntrig.ko 2023-10-14T10:58:00.499 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-14T10:58:00.499 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-14T10:58:00.499 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-14T10:58:00.499 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 72937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-14T10:58:00.499 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-14T10:58:00.500 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-14T10:58:00.500 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-14T10:58:00.500 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-14T10:58:00.500 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-14T10:58:00.501 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-14T10:58:00.501 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-14T10:58:00.501 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-14T10:58:00.501 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-14T10:58:00.501 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-14T10:58:00.502 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-14T10:58:00.502 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-14T10:58:00.502 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-14T10:58:00.502 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-14T10:58:00.502 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-14T10:58:00.503 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-14T10:58:00.503 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-14T10:58:00.503 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-14T10:58:00.503 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-14T10:58:00.503 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-14T10:58:00.503 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-14T10:58:00.504 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-14T10:58:00.504 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-14T10:58:00.504 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-14T10:58:00.504 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-14T10:58:00.504 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-14T10:58:00.505 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-14T10:58:00.505 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-14T10:58:00.505 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-14T10:58:00.505 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 71073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-14T10:58:00.505 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-14T10:58:00.506 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 143473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-14T10:58:00.506 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-14T10:58:00.506 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-14T10:58:00.506 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-14T10:58:00.506 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 267825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid.ko 2023-10-14T10:58:00.507 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-14T10:58:00.507 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/ 2023-10-14T10:58:00.507 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 125721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbhid.ko 2023-10-14T10:58:00.507 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbkbd.ko 2023-10-14T10:58:00.508 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbmouse.ko 2023-10-14T10:58:00.508 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 217873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-14T10:58:00.508 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/ 2023-10-14T10:58:00.508 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 64201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-14T10:58:00.508 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 89625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-14T10:58:00.508 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 305465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-14T10:58:00.509 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ 2023-10-14T10:58:00.509 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-14T10:58:00.509 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-14T10:58:00.509 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-14T10:58:00.510 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-14T10:58:00.510 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-14T10:58:00.510 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-14T10:58:00.510 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-14T10:58:00.510 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 97977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-14T10:58:00.511 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-14T10:58:00.511 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-14T10:58:00.511 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-14T10:58:00.511 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-14T10:58:00.511 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-14T10:58:00.511 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-14T10:58:00.512 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 74433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-14T10:58:00.512 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-14T10:58:00.512 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-14T10:58:00.512 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-14T10:58:00.512 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-14T10:58:00.513 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 55265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-14T10:58:00.513 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-14T10:58:00.513 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 58617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-14T10:58:00.513 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-14T10:58:00.513 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-14T10:58:00.514 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-14T10:58:00.514 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/da9052-hwmon.ko 2023-10-14T10:58:00.514 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/da9055-hwmon.ko 2023-10-14T10:58:00.514 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-14T10:58:00.514 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 99601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-14T10:58:00.514 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-14T10:58:00.515 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-14T10:58:00.515 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-14T10:58:00.515 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc2103.ko 2023-10-14T10:58:00.515 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-14T10:58:00.515 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-14T10:58:00.516 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 94457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-14T10:58:00.516 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-14T10:58:00.516 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-14T10:58:00.516 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 55449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-14T10:58:00.516 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-14T10:58:00.517 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-14T10:58:00.517 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-14T10:58:00.517 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-14T10:58:00.517 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hih6130.ko 2023-10-14T10:58:00.517 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-14T10:58:00.517 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-14T10:58:00.518 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-14T10:58:00.518 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-14T10:58:00.518 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-14T10:58:00.518 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-14T10:58:00.519 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-14T10:58:00.519 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 130449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-14T10:58:00.519 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/jc42.ko 2023-10-14T10:58:00.519 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-14T10:58:00.519 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-14T10:58:00.520 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-14T10:58:00.520 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-14T10:58:00.520 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-14T10:58:00.520 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-14T10:58:00.520 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-14T10:58:00.520 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-14T10:58:00.521 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-14T10:58:00.521 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-14T10:58:00.521 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 72833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-14T10:58:00.521 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-14T10:58:00.521 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-14T10:58:00.522 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-14T10:58:00.522 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 108841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-14T10:58:00.522 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-14T10:58:00.522 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-14T10:58:00.522 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-14T10:58:00.523 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-14T10:58:00.523 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-14T10:58:00.523 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-14T10:58:00.523 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-14T10:58:00.523 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-14T10:58:00.524 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-14T10:58:00.524 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-14T10:58:00.524 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-14T10:58:00.524 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-14T10:58:00.524 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-14T10:58:00.524 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-14T10:58:00.525 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-14T10:58:00.525 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-14T10:58:00.525 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-14T10:58:00.525 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mc13783-adc.ko 2023-10-14T10:58:00.525 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-14T10:58:00.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-10-14T10:58:00.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-14T10:58:00.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 119817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-14T10:58:00.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-14T10:58:00.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-14T10:58:00.527 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 82337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-14T10:58:00.527 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-14T10:58:00.527 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-14T10:58:00.527 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ 2023-10-14T10:58:00.527 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-14T10:58:00.528 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-14T10:58:00.528 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-14T10:58:00.528 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-14T10:58:00.528 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-14T10:58:00.528 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-14T10:58:00.529 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-14T10:58:00.529 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 82577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-14T10:58:00.529 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-14T10:58:00.529 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-14T10:58:00.529 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-14T10:58:00.530 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-14T10:58:00.530 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-14T10:58:00.530 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-14T10:58:00.530 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-14T10:58:00.530 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-14T10:58:00.531 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-14T10:58:00.531 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-14T10:58:00.531 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-14T10:58:00.531 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-14T10:58:00.531 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-14T10:58:00.532 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-14T10:58:00.532 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-14T10:58:00.532 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-14T10:58:00.532 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-14T10:58:00.532 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-14T10:58:00.533 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-14T10:58:00.533 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-14T10:58:00.533 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-14T10:58:00.533 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-14T10:58:00.533 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 52457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-14T10:58:00.534 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-14T10:58:00.534 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-14T10:58:00.534 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-14T10:58:00.534 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 71345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-14T10:58:00.534 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 63289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-14T10:58:00.535 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 71321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-14T10:58:00.535 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 101473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-14T10:58:00.535 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 119505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-14T10:58:00.535 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-14T10:58:00.535 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-14T10:58:00.535 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-10-14T10:58:00.536 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-10-14T10:58:00.536 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/ 2023-10-14T10:58:00.536 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/ 2023-10-14T10:58:00.536 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-14T10:58:00.536 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-14T10:58:00.537 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/ 2023-10-14T10:58:00.537 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-10-14T10:58:00.537 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-10-14T10:58:00.537 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-10-14T10:58:00.537 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-14T10:58:00.538 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-14T10:58:00.538 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-14T10:58:00.538 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-10-14T10:58:00.538 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 6929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-14T10:58:00.538 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-10-14T10:58:00.539 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-14T10:58:00.539 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-14T10:58:00.539 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-14T10:58:00.539 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-14T10:58:00.539 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-10-14T10:58:00.539 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-10-14T10:58:00.540 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 62817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-14T10:58:00.540 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-14T10:58:00.540 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-14T10:58:00.540 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-10-14T10:58:00.540 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-14T10:58:00.541 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-14T10:58:00.541 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-10-14T10:58:00.541 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-14T10:58:00.541 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-14T10:58:00.541 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-14T10:58:00.542 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-10-14T10:58:00.542 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-14T10:58:00.542 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-14T10:58:00.542 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-10-14T10:58:00.542 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-10-14T10:58:00.543 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-14T10:58:00.543 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-10-14T10:58:00.543 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-14T10:58:00.543 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-14T10:58:00.543 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-14T10:58:00.544 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-14T10:58:00.544 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-10-14T10:58:00.544 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-14T10:58:00.544 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-14T10:58:00.544 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-14T10:58:00.545 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/ 2023-10-14T10:58:00.545 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-10-14T10:58:00.545 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-10-14T10:58:00.545 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-10-14T10:58:00.545 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ 2023-10-14T10:58:00.545 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ 2023-10-14T10:58:00.546 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 273609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-14T10:58:00.546 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 879969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-14T10:58:00.546 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 69337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-14T10:58:00.546 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 324217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-14T10:58:00.546 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 97985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-14T10:58:00.547 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 282273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-14T10:58:00.547 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-14T10:58:00.547 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ 2023-10-14T10:58:00.547 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/ 2023-10-14T10:58:00.547 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 493073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-14T10:58:00.548 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/ 2023-10-14T10:58:00.548 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 419737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-14T10:58:00.548 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/ 2023-10-14T10:58:00.548 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 739025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-14T10:58:00.548 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ 2023-10-14T10:58:00.549 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 296625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-14T10:58:00.549 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ocrdma/ 2023-10-14T10:58:00.549 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 153697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-10-14T10:58:00.549 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/usnic/ 2023-10-14T10:58:00.549 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 168969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-10-14T10:58:00.549 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ 2023-10-14T10:58:00.550 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ 2023-10-14T10:58:00.550 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 263081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-14T10:58:00.550 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ 2023-10-14T10:58:00.550 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 100241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-14T10:58:00.550 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ 2023-10-14T10:58:00.551 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 111425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-14T10:58:00.551 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ 2023-10-14T10:58:00.551 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 128753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-14T10:58:00.551 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ 2023-10-14T10:58:00.551 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 129529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-14T10:58:00.552 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/ 2023-10-14T10:58:00.552 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/evbug.ko 2023-10-14T10:58:00.552 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/ff-memless.ko 2023-10-14T10:58:00.552 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/ 2023-10-14T10:58:00.552 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-14T10:58:00.552 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-14T10:58:00.553 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-14T10:58:00.553 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-14T10:58:00.553 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/ 2023-10-14T10:58:00.553 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-10-14T10:58:00.553 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-10-14T10:58:00.554 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-10-14T10:58:00.554 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-10-14T10:58:00.554 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-14T10:58:00.554 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-10-14T10:58:00.554 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lkkbd.ko 2023-10-14T10:58:00.555 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lm8323.ko 2023-10-14T10:58:00.555 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lm8333.ko 2023-10-14T10:58:00.555 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-10-14T10:58:00.555 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-10-14T10:58:00.555 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-10-14T10:58:00.555 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-10-14T10:58:00.556 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/newtonkbd.ko 2023-10-14T10:58:00.556 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-10-14T10:58:00.556 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/qt1070.ko 2023-10-14T10:58:00.556 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/qt2160.ko 2023-10-14T10:58:00.556 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-10-14T10:58:00.557 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/stowaway.ko 2023-10-14T10:58:00.557 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/sunkbd.ko 2023-10-14T10:58:00.557 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-10-14T10:58:00.557 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-10-14T10:58:00.558 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-10-14T10:58:00.558 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/xtkbd.ko 2023-10-14T10:58:00.558 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/matrix-keymap.ko 2023-10-14T10:58:00.558 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/ 2023-10-14T10:58:00.559 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-14T10:58:00.559 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-14T10:58:00.559 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 123681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-14T10:58:00.559 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 89449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-14T10:58:00.559 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/gpio_mouse.ko 2023-10-14T10:58:00.559 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 335977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/psmouse.ko 2023-10-14T10:58:00.560 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-14T10:58:00.560 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-14T10:58:00.560 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-14T10:58:00.560 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-14T10:58:00.560 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/ 2023-10-14T10:58:00.561 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 109873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-14T10:58:00.561 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ 2023-10-14T10:58:00.561 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-14T10:58:00.561 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-14T10:58:00.561 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ct82c710.ko 2023-10-14T10:58:00.562 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-14T10:58:00.562 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/parkbd.ko 2023-10-14T10:58:00.562 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/pcips2.ko 2023-10-14T10:58:00.562 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ps2mult.ko 2023-10-14T10:58:00.562 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-14T10:58:00.563 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serport.ko 2023-10-14T10:58:00.563 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-14T10:58:00.563 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/ 2023-10-14T10:58:00.563 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/ 2023-10-14T10:58:00.563 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-14T10:58:00.564 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/ 2023-10-14T10:58:00.564 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-88pm860x.ko 2023-10-14T10:58:00.564 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-adp5520.ko 2023-10-14T10:58:00.564 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-bd2802.ko 2023-10-14T10:58:00.564 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-14T10:58:00.565 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-da903x.ko 2023-10-14T10:58:00.565 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-da9052.ko 2023-10-14T10:58:00.565 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-gpio.ko 2023-10-14T10:58:00.565 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-14T10:58:00.565 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3533.ko 2023-10-14T10:58:00.566 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm355x.ko 2023-10-14T10:58:00.566 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3642.ko 2023-10-14T10:58:00.566 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-14T10:58:00.566 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp8788.ko 2023-10-14T10:58:00.566 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-max8997.ko 2023-10-14T10:58:00.567 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-mc13783.ko 2023-10-14T10:58:00.567 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-menf21bmc.ko 2023-10-14T10:58:00.567 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca9532.ko 2023-10-14T10:58:00.567 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca955x.ko 2023-10-14T10:58:00.567 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca963x.ko 2023-10-14T10:58:00.568 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-14T10:58:00.568 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-tca6507.ko 2023-10-14T10:58:00.568 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-wm831x-status.ko 2023-10-14T10:58:00.568 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-wm8350.ko 2023-10-14T10:58:00.568 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ 2023-10-14T10:58:00.569 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-14T10:58:00.569 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-14T10:58:00.569 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-14T10:58:00.569 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-14T10:58:00.569 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-14T10:58:00.569 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-14T10:58:00.570 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-14T10:58:00.570 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-14T10:58:00.570 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/ 2023-10-14T10:58:00.570 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/ 2023-10-14T10:58:00.570 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 654969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-14T10:58:00.571 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-14T10:58:00.571 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 89601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bufio.ko 2023-10-14T10:58:00.571 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-14T10:58:00.571 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 156009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-14T10:58:00.571 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 106897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-14T10:58:00.572 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-14T10:58:00.572 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-era.ko 2023-10-14T10:58:00.572 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-14T10:58:00.572 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-14T10:58:00.572 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log.ko 2023-10-14T10:58:00.573 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-mirror.ko 2023-10-14T10:58:00.573 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-14T10:58:00.573 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-14T10:58:00.573 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 70825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-14T10:58:00.573 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-region-hash.ko 2023-10-14T10:58:00.573 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-14T10:58:00.574 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-14T10:58:00.574 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 109593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-snapshot.ko 2023-10-14T10:58:00.574 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-14T10:58:00.574 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 181865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-14T10:58:00.574 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-14T10:58:00.574 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-zero.ko 2023-10-14T10:58:00.575 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-14T10:58:00.575 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-14T10:58:00.575 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-14T10:58:00.575 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/ 2023-10-14T10:58:00.576 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 199937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-14T10:58:00.576 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-14T10:58:00.576 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 113073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-14T10:58:00.576 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 158681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-14T10:58:00.576 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 395721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-14T10:58:00.577 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/ 2023-10-14T10:58:00.577 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/ 2023-10-14T10:58:00.577 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 178137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-14T10:58:00.577 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 63385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-14T10:58:00.577 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-14T10:58:00.578 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-14T10:58:00.578 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 123321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-14T10:58:00.578 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 79041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-14T10:58:00.578 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-14T10:58:00.578 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/ 2023-10-14T10:58:00.579 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm800.ko 2023-10-14T10:58:00.579 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm805.ko 2023-10-14T10:58:00.579 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm80x.ko 2023-10-14T10:58:00.579 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/arizona-i2c.ko 2023-10-14T10:58:00.579 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 123721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/arizona.ko 2023-10-14T10:58:00.580 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/bcm590xx.ko 2023-10-14T10:58:00.580 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/cros_ec_dev.ko 2023-10-14T10:58:00.580 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/dln2.ko 2023-10-14T10:58:00.580 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/janz-cmodio.ko 2023-10-14T10:58:00.580 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/kempld-core.ko 2023-10-14T10:58:00.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lm3533-core.ko 2023-10-14T10:58:00.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-10-14T10:58:00.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lp3943.ko 2023-10-14T10:58:00.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-14T10:58:00.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-14T10:58:00.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/max8907.ko 2023-10-14T10:58:00.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mc13xxx-core.ko 2023-10-14T10:58:00.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-10-14T10:58:00.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/menf21bmc.ko 2023-10-14T10:58:00.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633-adc.ko 2023-10-14T10:58:00.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633-gpio.ko 2023-10-14T10:58:00.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633.ko 2023-10-14T10:58:00.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-10-14T10:58:00.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/retu-mfd.ko 2023-10-14T10:58:00.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 80425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/si476x-core.ko 2023-10-14T10:58:00.584 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-14T10:58:00.584 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-10-14T10:58:00.584 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/tps65010.ko 2023-10-14T10:58:00.584 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/tps6507x.ko 2023-10-14T10:58:00.584 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-14T10:58:00.585 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-14T10:58:00.585 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-14T10:58:00.585 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wm8994.ko 2023-10-14T10:58:00.585 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ 2023-10-14T10:58:00.586 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-10-14T10:58:00.586 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ad525x_dpot.ko 2023-10-14T10:58:00.586 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/ 2023-10-14T10:58:00.586 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-14T10:58:00.586 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-14T10:58:00.587 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-14T10:58:00.587 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-14T10:58:00.587 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/ 2023-10-14T10:58:00.587 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-10-14T10:58:00.587 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/core.ko 2023-10-14T10:58:00.588 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/ 2023-10-14T10:58:00.588 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-14T10:58:00.588 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ds1682.ko 2023-10-14T10:58:00.588 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/dummy-irq.ko 2023-10-14T10:58:00.589 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/echo/ 2023-10-14T10:58:00.589 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/echo/echo.ko 2023-10-14T10:58:00.589 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/ 2023-10-14T10:58:00.589 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-14T10:58:00.589 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-14T10:58:00.590 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-14T10:58:00.590 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-14T10:58:00.590 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-14T10:58:00.590 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/genwqe/ 2023-10-14T10:58:00.590 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 152201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-10-14T10:58:00.590 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hmc6352.ko 2023-10-14T10:58:00.591 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-14T10:58:00.591 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ibmasm/ 2023-10-14T10:58:00.591 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 72129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-10-14T10:58:00.591 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ics932s401.ko 2023-10-14T10:58:00.591 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-14T10:58:00.592 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-14T10:58:00.592 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/ 2023-10-14T10:58:00.592 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-14T10:58:00.592 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-14T10:58:00.592 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/ 2023-10-14T10:58:00.593 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 125209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-14T10:58:00.593 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 56521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-14T10:58:00.593 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 310113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-14T10:58:00.593 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/phantom.ko 2023-10-14T10:58:00.593 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ti-st/ 2023-10-14T10:58:00.594 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 74265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ti-st/st_drv.ko 2023-10-14T10:58:00.594 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-14T10:58:00.594 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-14T10:58:00.594 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-14T10:58:00.594 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-14T10:58:00.594 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/ 2023-10-14T10:58:00.595 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 183609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-14T10:58:00.595 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ 2023-10-14T10:58:00.595 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/ 2023-10-14T10:58:00.595 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 490129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-14T10:58:00.595 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/ 2023-10-14T10:58:00.596 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/ 2023-10-14T10:58:00.596 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 106033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-14T10:58:00.596 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-14T10:58:00.596 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-14T10:58:00.596 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/ 2023-10-14T10:58:00.597 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 453737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-14T10:58:00.597 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-14T10:58:00.597 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-14T10:58:00.597 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ 2023-10-14T10:58:00.597 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/ 2023-10-14T10:58:00.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-14T10:58:00.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-14T10:58:00.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 130553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-14T10:58:00.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 68849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-14T10:58:00.598 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ 2023-10-14T10:58:00.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-14T10:58:00.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-14T10:58:00.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-14T10:58:00.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 99113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-14T10:58:00.599 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/ 2023-10-14T10:58:00.600 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-14T10:58:00.600 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/ 2023-10-14T10:58:00.600 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 69201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-14T10:58:00.600 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/ 2023-10-14T10:58:00.601 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-14T10:58:00.601 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/ 2023-10-14T10:58:00.601 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-14T10:58:00.601 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/ 2023-10-14T10:58:00.601 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-14T10:58:00.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-14T10:58:00.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 87297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-14T10:58:00.602 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/ 2023-10-14T10:58:00.602 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/ 2023-10-14T10:58:00.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 97337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-14T10:58:00.603 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-10-14T10:58:00.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 104673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-14T10:58:00.603 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-10-14T10:58:00.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 90257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-14T10:58:00.603 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/ 2023-10-14T10:58:00.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 81569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-14T10:58:00.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 69729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-14T10:58:00.604 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/ 2023-10-14T10:58:00.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-14T10:58:00.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 176761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-14T10:58:00.717 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-10-14T10:58:00.717 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1421497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-14T10:58:00.717 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 128569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-14T10:58:00.717 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/ 2023-10-14T10:58:00.718 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 132089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-14T10:58:00.718 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 312081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-14T10:58:00.718 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/ 2023-10-14T10:58:00.718 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/ 2023-10-14T10:58:00.718 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 323513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-14T10:58:00.719 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/ 2023-10-14T10:58:00.719 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-10-14T10:58:00.719 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 193497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-14T10:58:00.719 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-10-14T10:58:00.719 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 347417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-14T10:58:00.719 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-10-14T10:58:00.720 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1044433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-14T10:58:00.720 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-10-14T10:58:00.720 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 166193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-14T10:58:00.720 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-10-14T10:58:00.721 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-14T10:58:00.721 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/ 2023-10-14T10:58:00.721 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/ 2023-10-14T10:58:00.721 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 204345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-14T10:58:00.721 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/ 2023-10-14T10:58:00.721 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/ 2023-10-14T10:58:00.722 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 69449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-14T10:58:00.722 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-14T10:58:00.722 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 141225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-14T10:58:00.722 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-14T10:58:00.722 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 62817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-14T10:58:00.723 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-14T10:58:00.723 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/ 2023-10-14T10:58:00.723 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-14T10:58:00.723 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 62833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-14T10:58:00.723 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-14T10:58:00.724 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ec_bhf.ko 2023-10-14T10:58:00.724 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/ 2023-10-14T10:58:00.724 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/ 2023-10-14T10:58:00.724 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 281137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-14T10:58:00.724 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-14T10:58:00.724 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-14T10:58:00.725 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fujitsu/ 2023-10-14T10:58:00.725 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-10-14T10:58:00.725 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ 2023-10-14T10:58:00.725 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 90465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-14T10:58:00.725 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/ 2023-10-14T10:58:00.726 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 295577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-14T10:58:00.726 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/ 2023-10-14T10:58:00.726 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 584497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-14T10:58:00.726 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/ 2023-10-14T10:58:00.726 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 246209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-14T10:58:00.727 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/ 2023-10-14T10:58:00.727 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 925697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-14T10:58:00.727 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/ 2023-10-14T10:58:00.727 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 302849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-14T10:58:00.727 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/ 2023-10-14T10:58:00.727 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 514681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-14T10:58:00.728 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/ 2023-10-14T10:58:00.728 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 93593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-14T10:58:00.728 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-10-14T10:58:00.728 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 734305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-14T10:58:00.728 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-10-14T10:58:00.729 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 151769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-14T10:58:00.729 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 86921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-14T10:58:00.729 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/ 2023-10-14T10:58:00.729 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-14T10:58:00.729 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 102289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-14T10:58:00.729 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 122649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-14T10:58:00.730 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/ 2023-10-14T10:58:00.730 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-10-14T10:58:00.730 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 727601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-14T10:58:00.730 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 278937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-14T10:58:00.731 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-10-14T10:58:00.731 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-10-14T10:58:00.731 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1113993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-14T10:58:00.731 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ 2023-10-14T10:58:00.731 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-10-14T10:58:00.732 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-10-14T10:58:00.732 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-10-14T10:58:00.732 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 95665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-14T10:58:00.732 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/ 2023-10-14T10:58:00.732 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-10-14T10:58:00.733 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 108649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-14T10:58:00.733 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ 2023-10-14T10:58:00.733 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 73441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-14T10:58:00.733 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-14T10:58:00.733 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/ 2023-10-14T10:58:00.734 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 150905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-14T10:58:00.734 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/ 2023-10-14T10:58:00.734 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 136721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-14T10:58:00.734 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/ 2023-10-14T10:58:00.734 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-14T10:58:00.735 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-14T10:58:00.735 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/ 2023-10-14T10:58:00.735 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-10-14T10:58:00.735 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 227897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-14T10:58:00.735 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 87081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-14T10:58:00.736 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-10-14T10:58:00.736 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 672049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-14T10:58:00.736 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/ 2023-10-14T10:58:00.736 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-14T10:58:00.736 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/ 2023-10-14T10:58:00.737 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-14T10:58:00.737 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 83985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-14T10:58:00.737 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-14T10:58:00.737 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 189801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-14T10:58:00.737 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/ 2023-10-14T10:58:00.738 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-10-14T10:58:00.738 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 104241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-10-14T10:58:00.738 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/ 2023-10-14T10:58:00.738 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1053921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-14T10:58:00.738 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/ 2023-10-14T10:58:00.739 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-14T10:58:00.739 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/ 2023-10-14T10:58:00.739 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-14T10:58:00.739 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 63337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-14T10:58:00.739 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/ 2023-10-14T10:58:00.740 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-14T10:58:00.740 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-14T10:58:00.740 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 73409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-14T10:58:00.740 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 68177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-14T10:58:00.740 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/ 2023-10-14T10:58:00.741 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-10-14T10:58:00.741 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-10-14T10:58:00.741 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-14T10:58:00.741 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-10-14T10:58:00.741 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 486961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-14T10:58:00.742 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/ 2023-10-14T10:58:00.742 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 103337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-14T10:58:00.742 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 166161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-14T10:58:00.742 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-14T10:58:00.742 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-14T10:58:00.743 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/ 2023-10-14T10:58:00.743 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-14T10:58:00.743 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/ 2023-10-14T10:58:00.743 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 86529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-14T10:58:00.743 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/ 2023-10-14T10:58:00.744 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 80273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-14T10:58:00.744 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 83633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-14T10:58:00.744 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/ 2023-10-14T10:58:00.744 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-14T10:58:00.744 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-14T10:58:00.745 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/ 2023-10-14T10:58:00.745 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-14T10:58:00.745 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/ 2023-10-14T10:58:00.745 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/defxx.ko 2023-10-14T10:58:00.745 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/skfp/ 2023-10-14T10:58:00.746 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 216985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/skfp/skfp.ko 2023-10-14T10:58:00.746 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 77345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-14T10:58:00.746 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/ 2023-10-14T10:58:00.746 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 235521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-14T10:58:00.746 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/ 2023-10-14T10:58:00.747 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-14T10:58:00.747 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-14T10:58:00.747 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ 2023-10-14T10:58:00.747 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 83769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-14T10:58:00.747 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 62209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-14T10:58:00.747 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-14T10:58:00.748 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/ 2023-10-14T10:58:00.748 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-14T10:58:00.748 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-14T10:58:00.748 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-gpio.ko 2023-10-14T10:58:00.748 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-14T10:58:00.749 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-14T10:58:00.749 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-14T10:58:00.749 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-14T10:58:00.749 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-14T10:58:00.749 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/ 2023-10-14T10:58:00.750 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-14T10:58:00.750 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-14T10:58:00.750 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ 2023-10-14T10:58:00.750 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-14T10:58:00.750 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-14T10:58:00.751 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-14T10:58:00.751 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-14T10:58:00.751 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-14T10:58:00.751 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-14T10:58:00.751 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-14T10:58:00.751 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-14T10:58:00.752 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-14T10:58:00.752 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-14T10:58:00.752 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 82049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-14T10:58:00.752 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 76177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-14T10:58:00.752 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-14T10:58:00.753 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 97857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-14T10:58:00.753 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-14T10:58:00.753 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-14T10:58:00.753 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-14T10:58:00.753 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-14T10:58:00.754 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-14T10:58:00.754 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/plip/ 2023-10-14T10:58:00.754 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/plip/plip.ko 2023-10-14T10:58:00.754 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ 2023-10-14T10:58:00.754 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-14T10:58:00.755 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-14T10:58:00.755 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-14T10:58:00.755 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-14T10:58:00.755 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-14T10:58:00.755 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-14T10:58:00.756 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-14T10:58:00.756 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-14T10:58:00.756 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sb1000.ko 2023-10-14T10:58:00.756 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/ 2023-10-14T10:58:00.756 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-14T10:58:00.757 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-14T10:58:00.757 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 64385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-14T10:58:00.757 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/ 2023-10-14T10:58:00.757 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 106169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-14T10:58:00.757 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-14T10:58:00.758 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-14T10:58:00.758 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-14T10:58:00.758 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-14T10:58:00.758 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-14T10:58:00.758 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 87017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-14T10:58:00.759 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/ 2023-10-14T10:58:00.759 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 144297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-14T10:58:00.759 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/ 2023-10-14T10:58:00.759 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 297329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-14T10:58:00.759 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/ 2023-10-14T10:58:00.759 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 144649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-14T10:58:00.760 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ 2023-10-14T10:58:00.760 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-14T10:58:00.760 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/ 2023-10-14T10:58:00.760 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/ 2023-10-14T10:58:00.760 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 264937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-14T10:58:00.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 102209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-14T10:58:00.761 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/ 2023-10-14T10:58:00.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 133841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-14T10:58:00.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-14T10:58:00.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 84465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-14T10:58:00.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-14T10:58:00.762 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/ 2023-10-14T10:58:00.762 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/ 2023-10-14T10:58:00.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-14T10:58:00.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-10-14T10:58:00.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-10-14T10:58:00.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pci-stub.ko 2023-10-14T10:58:00.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-14T10:58:00.763 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/ 2023-10-14T10:58:00.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-14T10:58:00.764 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 145809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia.ko 2023-10-14T10:58:00.764 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 62137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia_core.ko 2023-10-14T10:58:00.764 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-10-14T10:58:00.764 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-14T10:58:00.764 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 112889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-14T10:58:00.764 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/ 2023-10-14T10:58:00.765 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/broadcom/ 2023-10-14T10:58:00.765 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-10-14T10:58:00.765 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/samsung/ 2023-10-14T10:58:00.765 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-10-14T10:58:00.765 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/ 2023-10-14T10:58:00.765 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/ 2023-10-14T10:58:00.766 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 70153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-14T10:58:00.766 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/ 2023-10-14T10:58:00.766 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/ 2023-10-14T10:58:00.766 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-10-14T10:58:00.766 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec.ko 2023-10-14T10:58:00.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-10-14T10:58:00.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-10-14T10:58:00.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-10-14T10:58:00.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-10-14T10:58:00.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-10-14T10:58:00.768 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/ 2023-10-14T10:58:00.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-14T10:58:00.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-14T10:58:00.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-14T10:58:00.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-14T10:58:00.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-14T10:58:00.769 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 127569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-14T10:58:00.769 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-14T10:58:00.769 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-14T10:58:00.769 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-14T10:58:00.769 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-14T10:58:00.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-14T10:58:00.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-14T10:58:00.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/ibm_rtl.ko 2023-10-14T10:58:00.770 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/ 2023-10-14T10:58:00.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-14T10:58:00.771 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-10-14T10:58:00.771 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-14T10:58:00.771 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-14T10:58:00.771 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-14T10:58:00.771 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-14T10:58:00.772 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-14T10:58:00.772 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-14T10:58:00.772 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-14T10:58:00.772 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-14T10:58:00.772 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-14T10:58:00.772 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-14T10:58:00.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-14T10:58:00.773 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/ 2023-10-14T10:58:00.773 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ 2023-10-14T10:58:00.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/88pm860x_battery.ko 2023-10-14T10:58:00.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/88pm860x_charger.ko 2023-10-14T10:58:00.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 55057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq2415x_charger.ko 2023-10-14T10:58:00.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq24190_charger.ko 2023-10-14T10:58:00.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq24735-charger.ko 2023-10-14T10:58:00.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-10-14T10:58:00.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/da9030_battery.ko 2023-10-14T10:58:00.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/da9052-battery.ko 2023-10-14T10:58:00.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2760_battery.ko 2023-10-14T10:58:00.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2780_battery.ko 2023-10-14T10:58:00.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2781_battery.ko 2023-10-14T10:58:00.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2782_battery.ko 2023-10-14T10:58:00.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/gpio-charger.ko 2023-10-14T10:58:00.776 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/isp1704_charger.ko 2023-10-14T10:58:00.776 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/lp8727_charger.ko 2023-10-14T10:58:00.776 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max14577_charger.ko 2023-10-14T10:58:00.776 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max17040_battery.ko 2023-10-14T10:58:00.776 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max17042_battery.ko 2023-10-14T10:58:00.777 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max8903_charger.ko 2023-10-14T10:58:00.777 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max8925_power.ko 2023-10-14T10:58:00.777 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/pcf50633-charger.ko 2023-10-14T10:58:00.777 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/sbs-battery.ko 2023-10-14T10:58:00.777 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/test_power.ko 2023-10-14T10:58:00.778 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/tps65090-charger.ko 2023-10-14T10:58:00.778 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm831x_backup.ko 2023-10-14T10:58:00.778 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm831x_power.ko 2023-10-14T10:58:00.778 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm8350_power.ko 2023-10-14T10:58:00.778 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/ 2023-10-14T10:58:00.779 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-14T10:58:00.779 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-14T10:58:00.779 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/ 2023-10-14T10:58:00.779 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/ 2023-10-14T10:58:00.779 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-14T10:58:00.780 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-14T10:58:00.780 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-14T10:58:00.780 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-14T10:58:00.780 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ 2023-10-14T10:58:00.780 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-14T10:58:00.781 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-14T10:58:00.781 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/ 2023-10-14T10:58:00.781 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-88pm80x.ko 2023-10-14T10:58:00.781 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-88pm860x.ko 2023-10-14T10:58:00.781 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-14T10:58:00.782 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9052.ko 2023-10-14T10:58:00.782 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9055.ko 2023-10-14T10:58:00.782 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9063.ko 2023-10-14T10:58:00.782 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-14T10:58:00.782 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 68577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-14T10:58:00.783 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-14T10:58:00.783 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-14T10:58:00.783 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-14T10:58:00.783 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-14T10:58:00.783 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-14T10:58:00.783 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-14T10:58:00.784 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-14T10:58:00.784 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-14T10:58:00.784 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-14T10:58:00.784 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-14T10:58:00.784 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-14T10:58:00.785 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-lp8788.ko 2023-10-14T10:58:00.785 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-14T10:58:00.785 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-14T10:58:00.785 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-14T10:58:00.785 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t86.ko 2023-10-14T10:58:00.785 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-14T10:58:00.786 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8907.ko 2023-10-14T10:58:00.786 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8925.ko 2023-10-14T10:58:00.786 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8997.ko 2023-10-14T10:58:00.786 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8998.ko 2023-10-14T10:58:00.787 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-10-14T10:58:00.787 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-14T10:58:00.787 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-palmas.ko 2023-10-14T10:58:00.787 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-14T10:58:00.787 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf50633.ko 2023-10-14T10:58:00.787 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-14T10:58:00.788 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-14T10:58:00.788 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-14T10:58:00.788 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-14T10:58:00.788 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rc5t583.ko 2023-10-14T10:58:00.788 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-14T10:58:00.789 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-14T10:58:00.789 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-14T10:58:00.789 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-14T10:58:00.789 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-14T10:58:00.789 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-s35390a.ko 2023-10-14T10:58:00.790 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-14T10:58:00.790 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-tps6586x.ko 2023-10-14T10:58:00.790 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-tps65910.ko 2023-10-14T10:58:00.790 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-wm831x.ko 2023-10-14T10:58:00.790 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-wm8350.ko 2023-10-14T10:58:00.791 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-14T10:58:00.791 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ 2023-10-14T10:58:00.791 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 77617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-14T10:58:00.791 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-14T10:58:00.791 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 55169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-14T10:58:00.792 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 135185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-14T10:58:00.792 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-14T10:58:00.792 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/ 2023-10-14T10:58:00.792 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 272305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-14T10:58:00.793 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 100617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-14T10:58:00.793 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/ 2023-10-14T10:58:00.793 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 356265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-14T10:58:00.793 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 295801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-14T10:58:00.793 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic94xx/ 2023-10-14T10:58:00.794 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 189185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-10-14T10:58:00.794 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-14T10:58:00.794 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/ 2023-10-14T10:58:00.794 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 106881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-14T10:58:00.795 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-14T10:58:00.795 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/ 2023-10-14T10:58:00.795 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 246985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-14T10:58:00.795 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/ 2023-10-14T10:58:00.795 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1171945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-14T10:58:00.796 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/ 2023-10-14T10:58:00.796 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 237273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-14T10:58:00.796 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/ 2023-10-14T10:58:00.796 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 115369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-14T10:58:00.796 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-14T10:58:00.797 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/ 2023-10-14T10:58:00.797 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 308921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-14T10:58:00.797 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/ 2023-10-14T10:58:00.797 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-10-14T10:58:00.797 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 76145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-14T10:58:00.798 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-10-14T10:58:00.798 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 101449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-14T10:58:00.798 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 146689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-14T10:58:00.798 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 75553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-14T10:58:00.799 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-14T10:58:00.799 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/ 2023-10-14T10:58:00.799 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 212425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-14T10:58:00.799 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-14T10:58:00.799 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/ 2023-10-14T10:58:00.800 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-14T10:58:00.800 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 158505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-14T10:58:00.800 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fdomain.ko 2023-10-14T10:58:00.800 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/ 2023-10-14T10:58:00.800 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 263489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-14T10:58:00.801 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 201817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-14T10:58:00.801 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-14T10:58:00.801 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-14T10:58:00.801 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/imm.ko 2023-10-14T10:58:00.801 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-14T10:58:00.802 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 266537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-14T10:58:00.802 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 101881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-14T10:58:00.802 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/ 2023-10-14T10:58:00.802 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 317153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-14T10:58:00.803 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-14T10:58:00.803 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 52961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-14T10:58:00.803 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/ 2023-10-14T10:58:00.803 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 314865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-14T10:58:00.803 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 145585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-14T10:58:00.804 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-14T10:58:00.804 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/ 2023-10-14T10:58:00.804 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 216665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-14T10:58:00.804 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/ 2023-10-14T10:58:00.804 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 2197249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-14T10:58:00.805 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/ 2023-10-14T10:58:00.805 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 73569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-14T10:58:00.805 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-14T10:58:00.805 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 310617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-14T10:58:00.805 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 84721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-14T10:58:00.806 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/ 2023-10-14T10:58:00.806 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 659777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-14T10:58:00.806 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/ 2023-10-14T10:58:00.806 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 119561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-14T10:58:00.806 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-14T10:58:00.807 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/ 2023-10-14T10:58:00.807 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 81625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-10-14T10:58:00.807 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-10-14T10:58:00.807 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-10-14T10:58:00.807 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-10-14T10:58:00.807 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/ 2023-10-14T10:58:00.808 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 364105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-14T10:58:00.808 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 123617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-14T10:58:00.808 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ppa.ko 2023-10-14T10:58:00.808 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 55361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-14T10:58:00.808 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/ 2023-10-14T10:58:00.809 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1876625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-14T10:58:00.809 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 85289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-14T10:58:00.809 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/ 2023-10-14T10:58:00.809 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 559033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-14T10:58:00.809 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qlogicfas408.ko 2023-10-14T10:58:00.810 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-14T10:58:00.810 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 238825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-14T10:58:00.810 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 173937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-14T10:58:00.810 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 279313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-14T10:58:00.810 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 97729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-14T10:58:00.811 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 73881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-14T10:58:00.811 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-14T10:58:00.811 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-14T10:58:00.811 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 115889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-14T10:58:00.811 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-14T10:58:00.811 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/ 2023-10-14T10:58:00.812 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 162121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-14T10:58:00.812 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-14T10:58:00.812 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-14T10:58:00.812 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-14T10:58:00.813 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/xen-scsifront.ko 2023-10-14T10:58:00.813 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ 2023-10-14T10:58:00.813 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 129441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-14T10:58:00.813 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/ 2023-10-14T10:58:00.813 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/ 2023-10-14T10:58:00.813 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 736601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-14T10:58:00.814 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/ 2023-10-14T10:58:00.814 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-14T10:58:00.814 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-14T10:58:00.814 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-14T10:58:00.814 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 930321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-14T10:58:00.815 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-14T10:58:00.815 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 122521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-14T10:58:00.815 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/ 2023-10-14T10:58:00.815 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 75593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-14T10:58:00.815 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/ 2023-10-14T10:58:00.816 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/ 2023-10-14T10:58:00.816 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/ 2023-10-14T10:58:00.816 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-14T10:58:00.816 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-14T10:58:00.816 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-14T10:58:00.817 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-14T10:58:00.817 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-14T10:58:00.817 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-14T10:58:00.817 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-14T10:58:00.817 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-14T10:58:00.817 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-14T10:58:00.818 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-14T10:58:00.818 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-14T10:58:00.818 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-14T10:58:00.818 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-10-14T10:58:00.819 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-14T10:58:00.819 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-14T10:58:00.819 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-14T10:58:00.819 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ 2023-10-14T10:58:00.819 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ 2023-10-14T10:58:00.820 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-14T10:58:00.820 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/moxa.ko 2023-10-14T10:58:00.820 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/mxser.ko 2023-10-14T10:58:00.820 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 108601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-14T10:58:00.821 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-14T10:58:00.821 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-14T10:58:00.821 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/ 2023-10-14T10:58:00.821 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/ 2023-10-14T10:58:00.821 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-10-14T10:58:00.821 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-14T10:58:00.822 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-10-14T10:58:00.822 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/altera_uart.ko 2023-10-14T10:58:00.822 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-14T10:58:00.822 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 72425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-10-14T10:58:00.823 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/ 2023-10-14T10:58:00.823 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 103073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-14T10:58:00.823 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/rp2.ko 2023-10-14T10:58:00.823 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 52817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/sc16is7xx.ko 2023-10-14T10:58:00.823 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/ 2023-10-14T10:58:00.824 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ 2023-10-14T10:58:00.824 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 531265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-14T10:58:00.824 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ 2023-10-14T10:58:00.824 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-14T10:58:00.824 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-10-14T10:58:00.824 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/ 2023-10-14T10:58:00.825 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-14T10:58:00.825 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-14T10:58:00.825 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-14T10:58:00.825 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_dmem_genirq.ko 2023-10-14T10:58:00.825 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_mf624.ko 2023-10-14T10:58:00.826 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_netx.ko 2023-10-14T10:58:00.826 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-14T10:58:00.826 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-10-14T10:58:00.826 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-14T10:58:00.826 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/ 2023-10-14T10:58:00.827 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/c67x00/ 2023-10-14T10:58:00.827 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 73297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/c67x00/c67x00.ko 2023-10-14T10:58:00.827 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ 2023-10-14T10:58:00.827 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 144377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-10-14T10:58:00.827 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-10-14T10:58:00.828 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-10-14T10:58:00.828 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-10-14T10:58:00.828 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/ 2023-10-14T10:58:00.828 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 87089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-14T10:58:00.829 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-14T10:58:00.829 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-14T10:58:00.829 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 89857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-14T10:58:00.829 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/common/ 2023-10-14T10:58:00.829 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/common/ulpi.ko 2023-10-14T10:58:00.829 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc2/ 2023-10-14T10:58:00.830 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-10-14T10:58:00.830 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/ 2023-10-14T10:58:00.830 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-10-14T10:58:00.830 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-10-14T10:58:00.830 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 444553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3.ko 2023-10-14T10:58:00.831 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/ 2023-10-14T10:58:00.831 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/ 2023-10-14T10:58:00.831 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/u_ether.ko 2023-10-14T10:58:00.831 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/u_serial.ko 2023-10-14T10:58:00.831 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-10-14T10:58:00.831 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-10-14T10:58:00.832 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-10-14T10:58:00.832 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-10-14T10:58:00.832 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 92489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-10-14T10:58:00.832 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-10-14T10:58:00.832 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 122081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-10-14T10:58:00.833 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-10-14T10:58:00.833 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-10-14T10:58:00.833 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-10-14T10:58:00.833 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-10-14T10:58:00.833 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 85609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-10-14T10:58:00.834 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-10-14T10:58:00.834 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 58113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-10-14T10:58:00.834 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-10-14T10:58:00.834 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/ 2023-10-14T10:58:00.834 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-10-14T10:58:00.835 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-10-14T10:58:00.835 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-10-14T10:58:00.835 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-10-14T10:58:00.835 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-10-14T10:58:00.835 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-10-14T10:58:00.835 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-10-14T10:58:00.836 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-10-14T10:58:00.836 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-10-14T10:58:00.836 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-10-14T10:58:00.836 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-10-14T10:58:00.836 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-10-14T10:58:00.837 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 62185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-10-14T10:58:00.837 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-10-14T10:58:00.837 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 161225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/libcomposite.ko 2023-10-14T10:58:00.837 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/ 2023-10-14T10:58:00.837 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-10-14T10:58:00.837 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/bdc/ 2023-10-14T10:58:00.838 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 157681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-10-14T10:58:00.838 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-10-14T10:58:00.838 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 52721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-10-14T10:58:00.838 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 69705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-10-14T10:58:00.838 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 56033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-10-14T10:58:00.839 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 76057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/net2272.ko 2023-10-14T10:58:00.839 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 75073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/net2280.ko 2023-10-14T10:58:00.839 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 73169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-10-14T10:58:00.839 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 65809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-10-14T10:58:00.839 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-10-14T10:58:00.840 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 81505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-10-14T10:58:00.840 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 156073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-10-14T10:58:00.840 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/ 2023-10-14T10:58:00.840 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/bcma-hcd.ko 2023-10-14T10:58:00.840 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 80113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/isp116x-hcd.ko 2023-10-14T10:58:00.840 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 87353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-10-14T10:58:00.841 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-10-14T10:58:00.841 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-14T10:58:00.841 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811_cs.ko 2023-10-14T10:58:00.841 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/ssb-hcd.ko 2023-10-14T10:58:00.841 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-10-14T10:58:00.842 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/ 2023-10-14T10:58:00.842 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-14T10:58:00.842 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-14T10:58:00.842 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ 2023-10-14T10:58:00.842 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-14T10:58:00.843 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-14T10:58:00.843 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-10-14T10:58:00.843 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/cytherm.ko 2023-10-14T10:58:00.843 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ehset.ko 2023-10-14T10:58:00.844 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-14T10:58:00.844 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-14T10:58:00.844 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-14T10:58:00.844 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-14T10:58:00.844 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-14T10:58:00.845 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-14T10:58:00.845 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-14T10:58:00.845 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-14T10:58:00.845 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/lvstest.ko 2023-10-14T10:58:00.845 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/ 2023-10-14T10:58:00.846 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 64841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-14T10:58:00.846 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-14T10:58:00.846 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-14T10:58:00.846 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-14T10:58:00.846 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-14T10:58:00.847 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 70873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbtest.ko 2023-10-14T10:58:00.847 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-14T10:58:00.847 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-14T10:58:00.847 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/mon/ 2023-10-14T10:58:00.847 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 72953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/mon/usbmon.ko 2023-10-14T10:58:00.848 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/musb/ 2023-10-14T10:58:00.848 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 301545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/musb/musb_hdrc.ko 2023-10-14T10:58:00.848 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/ 2023-10-14T10:58:00.848 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-14T10:58:00.848 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-10-14T10:58:00.849 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-isp1301.ko 2023-10-14T10:58:00.849 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-tahvo.ko 2023-10-14T10:58:00.849 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ 2023-10-14T10:58:00.849 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-14T10:58:00.849 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-14T10:58:00.850 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-14T10:58:00.850 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-14T10:58:00.850 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 70257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-14T10:58:00.850 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-14T10:58:00.850 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 58217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-14T10:58:00.851 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-14T10:58:00.851 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-14T10:58:00.851 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/f81232.ko 2023-10-14T10:58:00.851 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 175137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-14T10:58:00.851 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-14T10:58:00.852 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 137081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-14T10:58:00.852 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 124833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-14T10:58:00.852 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-14T10:58:00.852 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-14T10:58:00.852 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-14T10:58:00.852 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 58233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-14T10:58:00.853 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 107521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-14T10:58:00.853 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-14T10:58:00.853 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-14T10:58:00.853 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-14T10:58:00.853 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-14T10:58:00.854 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/metro-usb.ko 2023-10-14T10:58:00.854 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-14T10:58:00.854 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-14T10:58:00.854 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 56337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mxuport.ko 2023-10-14T10:58:00.854 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-14T10:58:00.855 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-14T10:58:00.855 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-14T10:58:00.855 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 190633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-14T10:58:00.855 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-14T10:58:00.855 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-14T10:58:00.856 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-14T10:58:00.856 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-14T10:58:00.856 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-14T10:58:00.856 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-14T10:58:00.856 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-14T10:58:00.857 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-14T10:58:00.857 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-14T10:58:00.857 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-14T10:58:00.857 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-14T10:58:00.857 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-14T10:58:00.858 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-14T10:58:00.858 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-14T10:58:00.858 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 125609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usbserial.ko 2023-10-14T10:58:00.858 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-14T10:58:00.858 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-14T10:58:00.859 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/wishbone-serial.ko 2023-10-14T10:58:00.859 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-14T10:58:00.859 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ 2023-10-14T10:58:00.859 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 52913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-14T10:58:00.859 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-14T10:58:00.860 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-14T10:58:00.860 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-14T10:58:00.860 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-14T10:58:00.860 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-14T10:58:00.860 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-14T10:58:00.861 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-14T10:58:00.861 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-14T10:58:00.861 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-14T10:58:00.861 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-14T10:58:00.861 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-14T10:58:00.862 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-14T10:58:00.862 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-14T10:58:00.862 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 179969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-14T10:58:00.862 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/ 2023-10-14T10:58:00.862 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-14T10:58:00.863 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 72177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-14T10:58:00.863 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 107001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-14T10:58:00.863 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/ 2023-10-14T10:58:00.863 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/ 2023-10-14T10:58:00.863 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 154297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-14T10:58:00.864 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-14T10:58:00.864 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 108737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-14T10:58:00.864 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 77609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-14T10:58:00.864 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/ 2023-10-14T10:58:00.864 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 113873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-14T10:58:00.865 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-14T10:58:00.865 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 58089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-14T10:58:00.865 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 89249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-14T10:58:00.865 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/ 2023-10-14T10:58:00.865 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/ 2023-10-14T10:58:00.865 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-10-14T10:58:00.866 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/aat2870_bl.ko 2023-10-14T10:58:00.866 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp5520_bl.ko 2023-10-14T10:58:00.866 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp8860_bl.ko 2023-10-14T10:58:00.866 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp8870_bl.ko 2023-10-14T10:58:00.866 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-14T10:58:00.867 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/as3711_bl.ko 2023-10-14T10:58:00.867 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/bd6107.ko 2023-10-14T10:58:00.867 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/da903x_bl.ko 2023-10-14T10:58:00.867 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/da9052_bl.ko 2023-10-14T10:58:00.867 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/gpio_backlight.ko 2023-10-14T10:58:00.868 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/kb3886_bl.ko 2023-10-14T10:58:00.868 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-14T10:58:00.868 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lm3533_bl.ko 2023-10-14T10:58:00.868 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lm3639_bl.ko 2023-10-14T10:58:00.868 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lv5207lp.ko 2023-10-14T10:58:00.869 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/max8925_bl.ko 2023-10-14T10:58:00.869 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/pandora_bl.ko 2023-10-14T10:58:00.869 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-10-14T10:58:00.869 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-14T10:58:00.869 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/wm831x_bl.ko 2023-10-14T10:58:00.870 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/ 2023-10-14T10:58:00.870 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ 2023-10-14T10:58:00.870 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-14T10:58:00.870 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-14T10:58:00.870 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/matrox_w1.ko 2023-10-14T10:58:00.871 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/w1-gpio.ko 2023-10-14T10:58:00.871 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/ 2023-10-14T10:58:00.871 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-14T10:58:00.871 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-14T10:58:00.871 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-14T10:58:00.872 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-14T10:58:00.872 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-14T10:58:00.872 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-14T10:58:00.872 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-14T10:58:00.872 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-14T10:58:00.873 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-14T10:58:00.873 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-14T10:58:00.873 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 56425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-14T10:58:00.873 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 102673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-14T10:58:00.873 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ 2023-10-14T10:58:00.873 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/acquirewdt.ko 2023-10-14T10:58:00.874 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/advantechwdt.ko 2023-10-14T10:58:00.874 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-14T10:58:00.874 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-14T10:58:00.874 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/cpu5wdt.ko 2023-10-14T10:58:00.874 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9052_wdt.ko 2023-10-14T10:58:00.875 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9055_wdt.ko 2023-10-14T10:58:00.875 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9063_wdt.ko 2023-10-14T10:58:00.875 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/dw_wdt.ko 2023-10-14T10:58:00.875 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/eurotechwdt.ko 2023-10-14T10:58:00.875 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-14T10:58:00.876 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-14T10:58:00.876 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-14T10:58:00.876 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-14T10:58:00.876 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-14T10:58:00.876 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-14T10:58:00.877 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-14T10:58:00.877 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-14T10:58:00.877 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-14T10:58:00.877 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-14T10:58:00.877 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/kempld_wdt.ko 2023-10-14T10:58:00.877 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-14T10:58:00.878 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/mena21_wdt.ko 2023-10-14T10:58:00.878 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-10-14T10:58:00.878 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-14T10:58:00.878 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-10-14T10:58:00.878 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pc87413_wdt.ko 2023-10-14T10:58:00.879 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-14T10:58:00.879 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-14T10:58:00.879 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/retu_wdt.ko 2023-10-14T10:58:00.879 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-10-14T10:58:00.879 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-10-14T10:58:00.880 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-14T10:58:00.880 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sc1200wdt.ko 2023-10-14T10:58:00.880 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-14T10:58:00.880 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-10-14T10:58:00.880 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-14T10:58:00.880 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-14T10:58:00.881 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/twl4030_wdt.ko 2023-10-14T10:58:00.881 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-14T10:58:00.881 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-14T10:58:00.881 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-14T10:58:00.881 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-14T10:58:00.882 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wafer5823wdt.ko 2023-10-14T10:58:00.882 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-14T10:58:00.882 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wm831x_wdt.ko 2023-10-14T10:58:00.882 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wm8350_wdt.ko 2023-10-14T10:58:00.882 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-14T10:58:00.883 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/ 2023-10-14T10:58:00.883 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-14T10:58:00.883 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-14T10:58:00.883 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-14T10:58:00.883 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/ 2023-10-14T10:58:00.884 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 176441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-14T10:58:00.884 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-14T10:58:00.884 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 71249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-scsiback.ko 2023-10-14T10:58:00.884 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/ 2023-10-14T10:58:00.884 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-14T10:58:00.885 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ 2023-10-14T10:58:00.885 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/ 2023-10-14T10:58:00.885 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 166425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-14T10:58:00.885 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/adfs/ 2023-10-14T10:58:00.885 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/adfs/adfs.ko 2023-10-14T10:58:00.886 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/ 2023-10-14T10:58:00.886 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 163593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-14T10:58:00.886 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/afs/ 2023-10-14T10:58:00.886 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 932817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/afs/kafs.ko 2023-10-14T10:58:00.886 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/autofs/ 2023-10-14T10:58:00.887 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 101057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/autofs/autofs4.ko 2023-10-14T10:58:00.887 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/ 2023-10-14T10:58:00.887 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 64545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-14T10:58:00.887 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/bfs/ 2023-10-14T10:58:00.887 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/bfs/bfs.ko 2023-10-14T10:58:00.888 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-14T10:58:00.888 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/ 2023-10-14T10:58:00.888 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 3402585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-14T10:58:00.888 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/ 2023-10-14T10:58:00.888 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 306073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-14T10:58:00.889 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ 2023-10-14T10:58:00.889 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1323873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-14T10:58:00.889 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/ 2023-10-14T10:58:00.889 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 100801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-14T10:58:00.889 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/configfs/ 2023-10-14T10:58:00.889 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 108393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/configfs/configfs.ko 2023-10-14T10:58:00.890 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/ 2023-10-14T10:58:00.890 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-14T10:58:00.890 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/ 2023-10-14T10:58:00.890 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 642577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-14T10:58:00.890 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/efs/ 2023-10-14T10:58:00.891 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/efs/efs.ko 2023-10-14T10:58:00.891 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/ 2023-10-14T10:58:00.891 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1505025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-14T10:58:00.891 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/ 2023-10-14T10:58:00.891 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-14T10:58:00.892 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/freevxfs/ 2023-10-14T10:58:00.892 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/freevxfs/freevxfs.ko 2023-10-14T10:58:00.892 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/ 2023-10-14T10:58:00.892 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 226481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-14T10:58:00.892 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/ 2023-10-14T10:58:00.893 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-14T10:58:00.893 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/ 2023-10-14T10:58:00.893 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1231529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-14T10:58:00.893 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/ 2023-10-14T10:58:00.893 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 141209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-14T10:58:00.893 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/ 2023-10-14T10:58:00.894 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 222817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-14T10:58:00.894 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hpfs/ 2023-10-14T10:58:00.894 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 192329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hpfs/hpfs.ko 2023-10-14T10:58:00.894 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/ 2023-10-14T10:58:00.894 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 74065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-14T10:58:00.895 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/ 2023-10-14T10:58:00.895 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 419497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-14T10:58:00.895 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/ 2023-10-14T10:58:00.895 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 280313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-14T10:58:00.895 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/ 2023-10-14T10:58:00.896 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 89193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-14T10:58:00.896 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/ 2023-10-14T10:58:00.896 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 124649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-14T10:58:00.896 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/ 2023-10-14T10:58:00.896 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/ 2023-10-14T10:58:00.897 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 81449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-14T10:58:00.897 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/ 2023-10-14T10:58:00.897 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-14T10:58:00.897 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/ 2023-10-14T10:58:00.897 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 117513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-14T10:58:00.897 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1055649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-14T10:58:00.898 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv2.ko 2023-10-14T10:58:00.898 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 120177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-14T10:58:00.898 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 2041689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-14T10:58:00.898 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/ 2023-10-14T10:58:00.898 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-14T10:58:00.899 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-14T10:58:00.899 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/ 2023-10-14T10:58:00.899 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1516809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-14T10:58:00.899 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/ 2023-10-14T10:58:00.899 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 592833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-14T10:58:00.900 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/ 2023-10-14T10:58:00.900 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-14T10:58:00.900 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-14T10:58:00.900 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-14T10:58:00.900 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-14T10:58:00.901 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-14T10:58:00.901 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-14T10:58:00.901 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-14T10:58:00.901 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-14T10:58:00.901 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-14T10:58:00.901 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-14T10:58:00.902 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-14T10:58:00.902 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ascii.ko 2023-10-14T10:58:00.902 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-14T10:58:00.902 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-14T10:58:00.902 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-14T10:58:00.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-14T10:58:00.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-14T10:58:00.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-14T10:58:00.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-14T10:58:00.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-14T10:58:00.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-14T10:58:00.904 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-14T10:58:00.904 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-14T10:58:00.904 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-14T10:58:00.904 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-14T10:58:00.904 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-14T10:58:00.905 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-14T10:58:00.905 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-14T10:58:00.905 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-14T10:58:00.905 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-14T10:58:00.905 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 94137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-14T10:58:00.906 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 142673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-14T10:58:00.906 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 165745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-14T10:58:00.906 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 118121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-14T10:58:00.906 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-14T10:58:00.906 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-14T10:58:00.907 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-14T10:58:00.907 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-14T10:58:00.907 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-14T10:58:00.907 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-14T10:58:00.907 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-14T10:58:00.908 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-14T10:58:00.908 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-14T10:58:00.908 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-14T10:58:00.908 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-14T10:58:00.908 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-14T10:58:00.909 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-14T10:58:00.909 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-14T10:58:00.909 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-14T10:58:00.909 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-14T10:58:00.909 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-14T10:58:00.910 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ntfs/ 2023-10-14T10:58:00.910 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 219417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ntfs/ntfs.ko 2023-10-14T10:58:00.910 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ 2023-10-14T10:58:00.910 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ 2023-10-14T10:58:00.910 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 244409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-14T10:58:00.910 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ 2023-10-14T10:58:00.911 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 440737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-14T10:58:00.911 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ 2023-10-14T10:58:00.911 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-14T10:58:00.911 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 2592433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-14T10:58:00.911 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-14T10:58:00.912 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-14T10:58:00.912 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-14T10:58:00.912 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/omfs/ 2023-10-14T10:58:00.912 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/omfs/omfs.ko 2023-10-14T10:58:00.912 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/ 2023-10-14T10:58:00.913 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 352153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-14T10:58:00.913 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ 2023-10-14T10:58:00.913 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-14T10:58:00.913 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx4/ 2023-10-14T10:58:00.913 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx4/qnx4.ko 2023-10-14T10:58:00.913 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx6/ 2023-10-14T10:58:00.914 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx6/qnx6.ko 2023-10-14T10:58:00.914 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/ 2023-10-14T10:58:00.914 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_tree.ko 2023-10-14T10:58:00.914 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_v1.ko 2023-10-14T10:58:00.914 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_v2.ko 2023-10-14T10:58:00.915 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/ 2023-10-14T10:58:00.915 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 532673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-14T10:58:00.915 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/ 2023-10-14T10:58:00.915 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-14T10:58:00.915 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/ 2023-10-14T10:58:00.916 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/ 2023-10-14T10:58:00.916 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 2668121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-14T10:58:00.916 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/ 2023-10-14T10:58:00.916 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-14T10:58:00.916 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-14T10:58:00.916 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/ 2023-10-14T10:58:00.917 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 134641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-14T10:58:00.917 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/ 2023-10-14T10:58:00.917 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 90721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-14T10:58:00.917 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/ 2023-10-14T10:58:00.917 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 247737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-14T10:58:00.917 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ 2023-10-14T10:58:00.918 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 162497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-14T10:58:00.918 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/ 2023-10-14T10:58:00.918 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 4010729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-14T10:58:00.918 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/ 2023-10-14T10:58:00.918 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/locking/ 2023-10-14T10:58:00.919 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 75489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/locking/locktorture.ko 2023-10-14T10:58:00.919 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/time/ 2023-10-14T10:58:00.919 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/time/test_udelay.ko 2023-10-14T10:58:00.919 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-14T10:58:00.919 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ 2023-10-14T10:58:00.919 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 6833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-14T10:58:00.920 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 6529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc7.ko 2023-10-14T10:58:00.920 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-14T10:58:00.920 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/ 2023-10-14T10:58:00.920 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-14T10:58:00.920 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-14T10:58:00.921 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/interval_tree_test.ko 2023-10-14T10:58:00.921 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-14T10:58:00.921 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-14T10:58:00.921 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/ 2023-10-14T10:58:00.921 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-14T10:58:00.922 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-14T10:58:00.922 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/ 2023-10-14T10:58:00.922 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 6617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-14T10:58:00.922 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/memory-notifier-error-inject.ko 2023-10-14T10:58:00.923 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/notifier-error-inject.ko 2023-10-14T10:58:00.923 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/percpu_test.ko 2023-10-14T10:58:00.923 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/pm-notifier-error-inject.ko 2023-10-14T10:58:00.923 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/ 2023-10-14T10:58:00.924 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 143433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-14T10:58:00.924 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/rbtree_test.ko 2023-10-14T10:58:00.924 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/ 2023-10-14T10:58:00.924 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-14T10:58:00.924 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test-kstrtox.ko 2023-10-14T10:58:00.925 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test-string_helpers.ko 2023-10-14T10:58:00.925 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 4760425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_bpf.ko 2023-10-14T10:58:00.925 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_firmware.ko 2023-10-14T10:58:00.925 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 6369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_module.ko 2023-10-14T10:58:00.925 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_user_copy.ko 2023-10-14T10:58:00.926 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-14T10:58:00.926 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-14T10:58:00.926 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-14T10:58:00.926 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/xz/ 2023-10-14T10:58:00.926 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/xz/xz_dec_test.ko 2023-10-14T10:58:00.926 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/ 2023-10-14T10:58:00.927 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-14T10:58:00.927 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ 2023-10-14T10:58:00.927 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/ 2023-10-14T10:58:00.927 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 55737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-14T10:58:00.927 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-14T10:58:00.928 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-14T10:58:00.928 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-14T10:58:00.928 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 6985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-14T10:58:00.928 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-14T10:58:00.928 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-14T10:58:00.929 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-14T10:58:00.929 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/ 2023-10-14T10:58:00.929 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-14T10:58:00.929 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-14T10:58:00.929 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-14T10:58:00.929 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-14T10:58:00.930 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-14T10:58:00.930 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/ 2023-10-14T10:58:00.930 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 81737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-14T10:58:00.930 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/ 2023-10-14T10:58:00.930 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 198337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-14T10:58:00.931 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-14T10:58:00.931 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-14T10:58:00.931 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-14T10:58:00.931 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/ 2023-10-14T10:58:00.931 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 649297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-14T10:58:00.932 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/ 2023-10-14T10:58:00.932 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 63809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-14T10:58:00.932 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 777689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-14T10:58:00.932 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ 2023-10-14T10:58:00.932 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-14T10:58:00.933 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-14T10:58:00.933 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-14T10:58:00.933 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-14T10:58:00.933 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-14T10:58:00.933 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-14T10:58:00.934 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-14T10:58:00.934 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-14T10:58:00.934 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-14T10:58:00.934 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-14T10:58:00.934 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-14T10:58:00.935 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-14T10:58:00.935 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-14T10:58:00.935 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-14T10:58:00.935 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-14T10:58:00.935 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-14T10:58:00.935 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-14T10:58:00.936 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-14T10:58:00.936 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-14T10:58:00.936 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-14T10:58:00.936 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 55929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-14T10:58:00.936 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-14T10:58:00.937 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-14T10:58:00.937 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/ 2023-10-14T10:58:00.937 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1047017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-14T10:58:00.937 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/ 2023-10-14T10:58:00.937 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 125697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-14T10:58:00.938 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/ 2023-10-14T10:58:00.938 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 194209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-14T10:58:00.938 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-14T10:58:00.938 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-14T10:58:00.938 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-14T10:58:00.939 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/ 2023-10-14T10:58:00.939 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 390473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-14T10:58:00.939 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-14T10:58:00.939 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-14T10:58:00.939 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-14T10:58:00.940 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-14T10:58:00.940 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/hsr/ 2023-10-14T10:58:00.940 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 99729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/hsr/hsr.ko 2023-10-14T10:58:00.940 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ 2023-10-14T10:58:00.940 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ 2023-10-14T10:58:00.940 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-14T10:58:00.941 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 254625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-14T10:58:00.941 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-14T10:58:00.941 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ 2023-10-14T10:58:00.941 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-14T10:58:00.941 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-14T10:58:00.942 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-14T10:58:00.942 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-14T10:58:00.942 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-14T10:58:00.942 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-14T10:58:00.942 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-14T10:58:00.943 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-14T10:58:00.943 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-14T10:58:00.943 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-14T10:58:00.943 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ 2023-10-14T10:58:00.943 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-14T10:58:00.943 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-14T10:58:00.944 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-14T10:58:00.944 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ip_tables.ko 2023-10-14T10:58:00.944 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-14T10:58:00.944 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-10-14T10:58:00.944 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-14T10:58:00.945 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-14T10:58:00.945 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-14T10:58:00.945 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-10-14T10:58:00.945 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-14T10:58:00.945 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-14T10:58:00.946 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-14T10:58:00.946 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-14T10:58:00.946 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-14T10:58:00.946 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-14T10:58:00.946 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-14T10:58:00.947 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-14T10:58:00.947 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-14T10:58:00.947 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-10-14T10:58:00.947 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-14T10:58:00.947 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-14T10:58:00.948 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-14T10:58:00.948 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-14T10:58:00.948 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-14T10:58:00.948 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-14T10:58:00.948 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-14T10:58:00.949 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-14T10:58:00.949 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-14T10:58:00.949 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-14T10:58:00.949 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-14T10:58:00.949 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-14T10:58:00.950 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-14T10:58:00.950 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-14T10:58:00.950 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-14T10:58:00.950 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-14T10:58:00.950 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-14T10:58:00.951 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-14T10:58:00.951 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-14T10:58:00.951 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-14T10:58:00.951 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-14T10:58:00.951 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-14T10:58:00.952 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ 2023-10-14T10:58:00.952 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-14T10:58:00.952 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-14T10:58:00.952 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-14T10:58:00.952 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 80897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_gre.ko 2023-10-14T10:58:00.952 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 93577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-14T10:58:00.953 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-14T10:58:00.953 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-14T10:58:00.953 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-14T10:58:00.953 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/mip6.ko 2023-10-14T10:58:00.953 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ 2023-10-14T10:58:00.954 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-14T10:58:00.954 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-10-14T10:58:00.954 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-14T10:58:00.954 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-14T10:58:00.955 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-14T10:58:00.955 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-14T10:58:00.955 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-14T10:58:00.955 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-14T10:58:00.956 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-14T10:58:00.956 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-14T10:58:00.956 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-14T10:58:00.956 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-14T10:58:00.956 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-14T10:58:00.957 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-14T10:58:00.957 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-14T10:58:00.957 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-14T10:58:00.957 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-14T10:58:00.958 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-14T10:58:00.958 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-14T10:58:00.958 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-14T10:58:00.958 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-14T10:58:00.958 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-14T10:58:00.959 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-14T10:58:00.959 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-14T10:58:00.959 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-14T10:58:00.959 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 74073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-14T10:58:00.959 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-14T10:58:00.960 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-14T10:58:00.960 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/ 2023-10-14T10:58:00.960 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 82833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-14T10:58:00.960 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/ 2023-10-14T10:58:00.960 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 125281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-14T10:58:00.961 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-14T10:58:00.961 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-14T10:58:00.961 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-14T10:58:00.961 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-14T10:58:00.961 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-14T10:58:00.962 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-14T10:58:00.962 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/lapb/ 2023-10-14T10:58:00.962 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/lapb/lapb.ko 2023-10-14T10:58:00.962 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/ 2023-10-14T10:58:00.962 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-14T10:58:00.963 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 267777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc2.ko 2023-10-14T10:58:00.963 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/ 2023-10-14T10:58:00.963 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 290417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-14T10:58:00.963 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/ 2023-10-14T10:58:00.963 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-14T10:58:00.964 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ 2023-10-14T10:58:00.964 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ 2023-10-14T10:58:00.964 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 119585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-14T10:58:00.964 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-14T10:58:00.964 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-14T10:58:00.965 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-14T10:58:00.965 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 100297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-14T10:58:00.965 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 101441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-14T10:58:00.965 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 102817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-14T10:58:00.965 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 103481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-14T10:58:00.966 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 112849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-14T10:58:00.966 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-14T10:58:00.966 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 109593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-14T10:58:00.966 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 113129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-14T10:58:00.966 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 112585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-14T10:58:00.966 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 111585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-14T10:58:00.967 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 114465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-14T10:58:00.967 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-14T10:58:00.967 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ 2023-10-14T10:58:00.967 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 411729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-14T10:58:00.967 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-14T10:58:00.968 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-14T10:58:00.968 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-14T10:58:00.968 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-14T10:58:00.968 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-14T10:58:00.968 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-14T10:58:00.968 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-14T10:58:00.969 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-14T10:58:00.969 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-14T10:58:00.969 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-14T10:58:00.969 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-14T10:58:00.969 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-14T10:58:00.970 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-14T10:58:00.970 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-14T10:58:00.970 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 408257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-14T10:58:00.970 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-14T10:58:00.970 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-14T10:58:00.971 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-14T10:58:00.971 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 118145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-14T10:58:00.971 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-14T10:58:00.971 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-14T10:58:00.971 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 107297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-14T10:58:00.972 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-14T10:58:00.972 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-14T10:58:00.972 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-14T10:58:00.972 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-14T10:58:00.972 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-14T10:58:00.973 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-14T10:58:00.973 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 89473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-14T10:58:00.973 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-14T10:58:00.973 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-14T10:58:00.973 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 95417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-14T10:58:00.973 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-14T10:58:00.974 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-14T10:58:00.974 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-14T10:58:00.974 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-14T10:58:00.974 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-14T10:58:00.974 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-14T10:58:00.975 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 615313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-14T10:58:00.975 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-14T10:58:00.975 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-14T10:58:00.975 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-10-14T10:58:00.975 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-14T10:58:00.975 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-14T10:58:00.976 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-14T10:58:00.976 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-14T10:58:00.976 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-14T10:58:00.976 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-14T10:58:00.976 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-14T10:58:00.976 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-14T10:58:00.977 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-14T10:58:00.977 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-14T10:58:00.977 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-14T10:58:00.977 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-14T10:58:00.977 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-14T10:58:00.977 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-14T10:58:00.978 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-14T10:58:00.978 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_osf.ko 2023-10-14T10:58:00.978 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-14T10:58:00.978 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-14T10:58:00.978 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-14T10:58:00.979 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-14T10:58:00.979 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-14T10:58:00.979 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_synproxy.ko 2023-10-14T10:58:00.979 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tproxy.ko 2023-10-14T10:58:00.979 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 89313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/x_tables.ko 2023-10-14T10:58:00.980 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-14T10:58:00.980 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-14T10:58:00.980 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-14T10:58:00.980 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-14T10:58:00.980 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-14T10:58:00.981 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-14T10:58:00.981 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-14T10:58:00.981 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-14T10:58:00.981 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-14T10:58:00.981 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-14T10:58:00.982 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-14T10:58:00.982 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-14T10:58:00.982 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-14T10:58:00.982 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-14T10:58:00.983 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-14T10:58:00.983 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-14T10:58:00.983 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-14T10:58:00.983 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-14T10:58:00.983 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-14T10:58:00.984 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-14T10:58:00.984 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-14T10:58:00.984 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-14T10:58:00.984 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-14T10:58:00.984 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-14T10:58:00.985 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-14T10:58:00.985 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-14T10:58:00.985 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-14T10:58:00.985 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-14T10:58:00.985 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-14T10:58:00.986 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-14T10:58:00.986 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-14T10:58:00.986 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-14T10:58:00.986 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-14T10:58:00.986 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-14T10:58:00.987 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-14T10:58:00.987 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-14T10:58:00.987 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-14T10:58:00.987 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-14T10:58:00.987 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-14T10:58:00.988 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-14T10:58:00.988 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-14T10:58:00.988 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-14T10:58:00.988 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-14T10:58:00.988 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-14T10:58:00.988 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-14T10:58:00.989 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-14T10:58:00.989 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-14T10:58:00.989 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-14T10:58:00.989 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-14T10:58:00.989 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-14T10:58:00.990 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-14T10:58:00.990 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-14T10:58:00.990 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-14T10:58:00.990 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-14T10:58:00.990 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-14T10:58:00.991 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-14T10:58:00.991 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-14T10:58:00.991 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-14T10:58:00.991 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-14T10:58:00.991 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-14T10:58:00.991 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-14T10:58:00.992 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-14T10:58:00.992 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-14T10:58:00.992 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-14T10:58:00.992 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-14T10:58:00.992 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-14T10:58:00.993 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-14T10:58:00.993 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-14T10:58:00.993 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-14T10:58:00.993 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpudp.ko 2023-10-14T10:58:00.993 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-14T10:58:00.994 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-14T10:58:00.994 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/ 2023-10-14T10:58:00.994 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-14T10:58:00.994 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/ 2023-10-14T10:58:00.994 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-14T10:58:00.995 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/ 2023-10-14T10:58:00.995 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 380033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-14T10:58:00.995 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-14T10:58:00.995 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-14T10:58:00.995 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-14T10:58:00.995 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/ 2023-10-14T10:58:00.996 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-14T10:58:00.996 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/ 2023-10-14T10:58:00.996 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 110201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/phonet.ko 2023-10-14T10:58:00.996 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/pn_pep.ko 2023-10-14T10:58:00.996 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/ 2023-10-14T10:58:00.997 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 251481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-14T10:58:00.997 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 164937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-14T10:58:00.997 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-14T10:58:00.997 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rxrpc/ 2023-10-14T10:58:00.997 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 819657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rxrpc/rxrpc.ko 2023-10-14T10:58:00.997 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/ 2023-10-14T10:58:00.998 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-14T10:58:00.998 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-14T10:58:00.998 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-14T10:58:00.998 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-14T10:58:00.998 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-14T10:58:00.999 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-14T10:58:00.999 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-14T10:58:00.999 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-14T10:58:00.999 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-14T10:58:00.999 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-14T10:58:01.000 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-14T10:58:01.000 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-14T10:58:01.000 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_cgroup.ko 2023-10-14T10:58:01.000 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-14T10:58:01.000 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-14T10:58:01.001 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-14T10:58:01.001 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-14T10:58:01.001 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-14T10:58:01.001 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-14T10:58:01.002 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-14T10:58:01.002 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-14T10:58:01.002 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-14T10:58:01.002 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-14T10:58:01.002 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-14T10:58:01.003 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-14T10:58:01.003 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-14T10:58:01.003 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-14T10:58:01.003 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq_codel.ko 2023-10-14T10:58:01.003 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-14T10:58:01.004 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-14T10:58:01.004 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-14T10:58:01.004 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-14T10:58:01.004 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-14T10:58:01.004 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-14T10:58:01.004 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-14T10:58:01.005 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-14T10:58:01.005 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-14T10:58:01.005 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-14T10:58:01.005 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-14T10:58:01.005 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-14T10:58:01.006 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-14T10:58:01.006 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-14T10:58:01.006 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-14T10:58:01.006 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-14T10:58:01.006 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-14T10:58:01.006 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-14T10:58:01.007 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/ 2023-10-14T10:58:01.007 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 929745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-14T10:58:01.007 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-14T10:58:01.007 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/ 2023-10-14T10:58:01.007 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/ 2023-10-14T10:58:01.008 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 336529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-14T10:58:01.008 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-14T10:58:01.008 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1520161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-14T10:58:01.008 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/ 2023-10-14T10:58:01.008 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 707721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-14T10:58:01.009 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/ 2023-10-14T10:58:01.009 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-14T10:58:01.009 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 862641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-14T10:58:01.009 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/ 2023-10-14T10:58:01.009 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-14T10:58:01.010 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/ 2023-10-14T10:58:01.010 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 85337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-14T10:58:01.010 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 68049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-14T10:58:01.010 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 96193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-14T10:58:01.010 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-14T10:58:01.011 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-14T10:58:01.011 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/x25/ 2023-10-14T10:58:01.011 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 125177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/x25/x25.ko 2023-10-14T10:58:01.011 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/ 2023-10-14T10:58:01.011 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_algo.ko 2023-10-14T10:58:01.012 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-14T10:58:01.012 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 102257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_user.ko 2023-10-14T10:58:01.012 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/ 2023-10-14T10:58:01.012 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/ 2023-10-14T10:58:01.012 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-14T10:58:01.013 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 639863 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-14T10:58:01.013 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 623919 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-14T10:58:01.013 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7663 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-14T10:58:01.013 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23428 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-14T10:58:01.013 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9821 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-14T10:58:01.014 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 70004 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-14T10:58:01.014 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 146313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-14T10:58:01.014 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 232548 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-14T10:58:01.014 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 210 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-14T10:58:01.014 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 72606 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-14T10:58:01.015 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 879 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-14T10:58:01.015 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 254438 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-14T10:58:01.015 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 309363 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-14T10:58:01.015 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./usr/ 2023-10-14T10:58:01.015 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./usr/share/ 2023-10-14T10:58:01.016 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./usr/share/doc/ 2023-10-14T10:58:01.016 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/ 2023-10-14T10:58:01.016 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 175 2023-10-10 19:56 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/changelog.Debian.gz 2023-10-14T10:58:01.016 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 691 2023-10-10 19:56 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/copyright 2023-10-14T10:58:01.017 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-14T10:58:01.017 INFO:teuthology.task.kernel:searching for kernel 6.6.0-rc5-g47672119149b 2023-10-14T10:58:01.018 DEBUG:teuthology.orchestra.run.smithi110:> egrep '(submenu|menuentry.*6.6.0-rc5-g47672119149b).*{' /boot/grub/grub.cfg 2023-10-14T10:58:01.019 INFO:teuthology.orchestra.run.smithi026.stderr:Sourcing file `/etc/default/grub' 2023-10-14T10:58:01.019 INFO:teuthology.orchestra.run.smithi026.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-14T10:58:01.019 INFO:teuthology.orchestra.run.smithi026.stderr:Generating grub configuration file ... 2023-10-14T10:58:01.026 INFO:teuthology.orchestra.run.smithi110.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-10-14T10:58:01.026 INFO:teuthology.orchestra.run.smithi110.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g47672119149b' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g47672119149b-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-10-14T10:58:01.026 INFO:teuthology.orchestra.run.smithi110.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g47672119149b (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g47672119149b-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-10-14T10:58:01.027 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-10-14T10:58:01.027 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-rc5-g47672119149b 2023-10-14T10:58:01.027 DEBUG:teuthology.orchestra.run.smithi110:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-10-14T10:58:01.071 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi110.front.sepia.ceph.com to complete... 2023-10-14T10:58:01.094 INFO:teuthology.orchestra.run.smithi026.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-14T10:58:01.100 INFO:teuthology.orchestra.run.smithi026.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-14T10:58:01.395 INFO:teuthology.orchestra.run.smithi026.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-14T10:58:01.401 INFO:teuthology.orchestra.run.smithi026.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-14T10:58:01.443 INFO:teuthology.orchestra.run.smithi026.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-14T10:58:01.449 INFO:teuthology.orchestra.run.smithi026.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-14T10:58:01.458 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub' 2023-10-14T10:58:01.459 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-14T10:58:01.494 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2023-10-14T10:58:01.586 INFO:teuthology.orchestra.run.smithi026.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-14T10:58:01.586 INFO:teuthology.orchestra.run.smithi026.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-10-14T10:58:01.587 INFO:teuthology.orchestra.run.smithi026.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-14T10:58:01.603 INFO:teuthology.orchestra.run.smithi026.stderr:done 2023-10-14T10:58:01.684 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-14T10:58:01.690 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-14T10:58:01.923 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-14T10:58:01.928 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-14T10:58:01.967 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-14T10:58:01.972 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-14T10:58:02.101 INFO:teuthology.orchestra.run.smithi110.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-14T10:58:02.102 INFO:teuthology.orchestra.run.smithi110.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-10-14T10:58:02.102 INFO:teuthology.orchestra.run.smithi110.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-14T10:58:02.118 INFO:teuthology.orchestra.run.smithi110.stderr:done 2023-10-14T10:58:32.737 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-14T10:58:32.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-10-14T10:58:32.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T10:58:33.252 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-14T10:58:33.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-10-14T10:58:33.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T10:58:51.130 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-10-14T10:58:51.642 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-10-14T10:59:00.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-10-14T10:59:00.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T10:59:00.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-10-14T10:59:00.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T10:59:03.706 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-10-14T10:59:15.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-10-14T10:59:15.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T10:59:18.526 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-10-14T10:59:30.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-10-14T10:59:30.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T10:59:33.595 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-10-14T10:59:47.535 DEBUG:teuthology.orchestra.run.smithi110:> true 2023-10-14T10:59:48.179 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-10-14T10:59:48.179 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-rc5-g47672119149b"... 2023-10-14T10:59:48.180 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2023-10-14T10:59:48.230 INFO:teuthology.orchestra.run.smithi110.stdout:6.6.0-rc5-g47672119149b 2023-10-14T10:59:48.230 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-14T10:59:48.231 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-14T10:59:48.231 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-14T10:59:48.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-10-14T10:59:48.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T10:59:48.868 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-10-14T10:59:49.232 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-14T10:59:49.232 DEBUG:teuthology.orchestra.run.smithi110:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-14T10:59:49.339 INFO:teuthology.orchestra.run.smithi110.stdout:ttyS1 2023-10-14T10:59:49.385 DEBUG:teuthology.parallel:result is None 2023-10-14T10:59:49.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-10-14T10:59:49.489 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-rc5-g47672119149b"... 2023-10-14T10:59:49.490 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2023-10-14T10:59:49.539 INFO:teuthology.orchestra.run.smithi026.stdout:6.6.0-rc5-g47672119149b 2023-10-14T10:59:49.539 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-14T10:59:49.540 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-14T10:59:49.540 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-14T10:59:50.541 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-14T10:59:50.542 DEBUG:teuthology.orchestra.run.smithi026:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-14T10:59:50.633 INFO:teuthology.orchestra.run.smithi026.stdout:ttyS1 2023-10-14T10:59:50.689 DEBUG:teuthology.parallel:result is None 2023-10-14T10:59:50.690 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-14T10:59:50.698 INFO:teuthology.task.internal:Creating test directory... 2023-10-14T10:59:50.698 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T10:59:50.702 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T10:59:50.712 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-14T10:59:50.718 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-14T10:59:50.729 INFO:teuthology.task.internal:Creating archive directory... 2023-10-14T10:59:50.730 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T10:59:50.760 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T10:59:50.876 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-14T10:59:50.891 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-14T10:59:50.891 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T10:59:50.895 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T10:59:50.925 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T10:59:50.927 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T10:59:50.940 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T10:59:50.942 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T10:59:50.944 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-14T10:59:50.951 INFO:teuthology.task.internal:Configuring sudo... 2023-10-14T10:59:50.952 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T10:59:50.994 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T10:59:51.017 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-14T10:59:51.029 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-14T10:59:51.030 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T10:59:51.061 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T10:59:51.071 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T10:59:51.123 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T10:59:51.175 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T10:59:51.176 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T10:59:51.251 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T10:59:51.261 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T10:59:51.315 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T10:59:51.315 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T10:59:51.394 DEBUG:teuthology.orchestra.run.smithi026:> sudo service rsyslog restart 2023-10-14T10:59:51.398 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2023-10-14T10:59:51.508 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-14T10:59:51.515 INFO:teuthology.task.internal:Starting timer... 2023-10-14T10:59:51.516 INFO:teuthology.run_tasks:Running task pcp... 2023-10-14T10:59:51.529 INFO:teuthology.run_tasks:Running task selinux... 2023-10-14T10:59:51.540 DEBUG:teuthology.task.selinux:Excluding smithi026: OS 'ubuntu' does not support SELinux 2023-10-14T10:59:51.541 DEBUG:teuthology.task.selinux:Excluding smithi110: OS 'ubuntu' does not support SELinux 2023-10-14T10:59:51.541 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-14T10:59:51.542 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-10-14T10:59:51.542 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-14T10:59:51.543 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-14T10:59:51.552 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-14T10:59:51.553 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-14T10:59:51.571 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-14T10:59:51.572 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi026.front.sepia.ceph.com,smithi110.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-14T11:08:35.081 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi026.front.sepia.ceph.com'), Remote(name='ubuntu@smithi110.front.sepia.ceph.com')] 2023-10-14T11:08:35.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-10-14T11:08:35.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:08:35.165 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-10-14T11:08:35.313 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-10-14T11:08:35.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-10-14T11:08:35.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:08:35.391 DEBUG:teuthology.orchestra.run.smithi110:> true 2023-10-14T11:08:35.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-10-14T11:08:35.513 INFO:teuthology.run_tasks:Running task clock... 2023-10-14T11:08:35.523 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-14T11:08:35.524 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T11:08:35.524 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T11:08:35.528 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T11:08:35.528 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T11:08:35.565 INFO:teuthology.orchestra.run.smithi026.stdout:14 Oct 11:08:35 ntpd[27876]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-10-14T11:08:35.566 INFO:teuthology.orchestra.run.smithi026.stdout:14 Oct 11:08:35 ntpd[27876]: Command line: ntpd -gq 2023-10-14T11:08:35.566 INFO:teuthology.orchestra.run.smithi026.stdout:14 Oct 11:08:35 ntpd[27876]: ---------------------------------------------------- 2023-10-14T11:08:35.566 INFO:teuthology.orchestra.run.smithi026.stdout:14 Oct 11:08:35 ntpd[27876]: ntp-4 is maintained by Network Time Foundation, 2023-10-14T11:08:35.566 INFO:teuthology.orchestra.run.smithi026.stdout:14 Oct 11:08:35 ntpd[27876]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-10-14T11:08:35.567 INFO:teuthology.orchestra.run.smithi026.stdout:14 Oct 11:08:35 ntpd[27876]: corporation. Support and training for ntp-4 are 2023-10-14T11:08:35.567 INFO:teuthology.orchestra.run.smithi026.stdout:14 Oct 11:08:35 ntpd[27876]: available at https://www.nwtime.org/support 2023-10-14T11:08:35.567 INFO:teuthology.orchestra.run.smithi026.stdout:14 Oct 11:08:35 ntpd[27876]: ---------------------------------------------------- 2023-10-14T11:08:35.568 INFO:teuthology.orchestra.run.smithi026.stdout:14 Oct 11:08:35 ntpd[27876]: proto: precision = 0.043 usec (-24) 2023-10-14T11:08:35.568 INFO:teuthology.orchestra.run.smithi026.stdout:14 Oct 11:08:35 ntpd[27876]: basedate set to 2022-02-04 2023-10-14T11:08:35.568 INFO:teuthology.orchestra.run.smithi026.stdout:14 Oct 11:08:35 ntpd[27876]: gps base set to 2022-02-06 (week 2196) 2023-10-14T11:08:35.569 INFO:teuthology.orchestra.run.smithi026.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-14T11:08:35.569 INFO:teuthology.orchestra.run.smithi026.stdout:14 Oct 11:08:35 ntpd[27876]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-14T11:08:35.569 INFO:teuthology.orchestra.run.smithi026.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-14T11:08:35.570 INFO:teuthology.orchestra.run.smithi026.stdout:14 Oct 11:08:35 ntpd[27876]: restrict ::: KOD does nothing without LIMITED. 2023-10-14T11:08:35.571 INFO:teuthology.orchestra.run.smithi026.stdout:14 Oct 11:08:35 ntpd[27876]: Listen and drop on 0 v6wildcard [::]:123 2023-10-14T11:08:35.571 INFO:teuthology.orchestra.run.smithi026.stdout:14 Oct 11:08:35 ntpd[27876]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-14T11:08:35.571 INFO:teuthology.orchestra.run.smithi026.stdout:14 Oct 11:08:35 ntpd[27876]: Listen normally on 2 lo 127.0.0.1:123 2023-10-14T11:08:35.571 INFO:teuthology.orchestra.run.smithi026.stdout:14 Oct 11:08:35 ntpd[27876]: Listen normally on 3 ens1f0 172.21.15.26:123 2023-10-14T11:08:35.571 INFO:teuthology.orchestra.run.smithi026.stdout:14 Oct 11:08:35 ntpd[27876]: Listen normally on 4 lo [::1]:123 2023-10-14T11:08:35.572 INFO:teuthology.orchestra.run.smithi026.stdout:14 Oct 11:08:35 ntpd[27876]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fea5:cac0%3]:123 2023-10-14T11:08:35.572 INFO:teuthology.orchestra.run.smithi026.stdout:14 Oct 11:08:35 ntpd[27876]: Listening on routing socket on fd #22 for interface updates 2023-10-14T11:08:35.595 INFO:teuthology.orchestra.run.smithi110.stdout:14 Oct 11:08:35 ntpd[28075]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-10-14T11:08:35.595 INFO:teuthology.orchestra.run.smithi110.stdout:14 Oct 11:08:35 ntpd[28075]: Command line: ntpd -gq 2023-10-14T11:08:35.595 INFO:teuthology.orchestra.run.smithi110.stdout:14 Oct 11:08:35 ntpd[28075]: ---------------------------------------------------- 2023-10-14T11:08:35.596 INFO:teuthology.orchestra.run.smithi110.stdout:14 Oct 11:08:35 ntpd[28075]: ntp-4 is maintained by Network Time Foundation, 2023-10-14T11:08:35.596 INFO:teuthology.orchestra.run.smithi110.stdout:14 Oct 11:08:35 ntpd[28075]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-10-14T11:08:35.596 INFO:teuthology.orchestra.run.smithi110.stdout:14 Oct 11:08:35 ntpd[28075]: corporation. Support and training for ntp-4 are 2023-10-14T11:08:35.596 INFO:teuthology.orchestra.run.smithi110.stdout:14 Oct 11:08:35 ntpd[28075]: available at https://www.nwtime.org/support 2023-10-14T11:08:35.596 INFO:teuthology.orchestra.run.smithi110.stdout:14 Oct 11:08:35 ntpd[28075]: ---------------------------------------------------- 2023-10-14T11:08:35.597 INFO:teuthology.orchestra.run.smithi110.stdout:14 Oct 11:08:35 ntpd[28075]: proto: precision = 0.042 usec (-24) 2023-10-14T11:08:35.598 INFO:teuthology.orchestra.run.smithi110.stdout:14 Oct 11:08:35 ntpd[28075]: basedate set to 2022-02-04 2023-10-14T11:08:35.598 INFO:teuthology.orchestra.run.smithi110.stdout:14 Oct 11:08:35 ntpd[28075]: gps base set to 2022-02-06 (week 2196) 2023-10-14T11:08:35.598 INFO:teuthology.orchestra.run.smithi110.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-14T11:08:35.599 INFO:teuthology.orchestra.run.smithi110.stdout:14 Oct 11:08:35 ntpd[28075]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-14T11:08:35.599 INFO:teuthology.orchestra.run.smithi110.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-14T11:08:35.601 INFO:teuthology.orchestra.run.smithi110.stdout:14 Oct 11:08:35 ntpd[28075]: restrict ::: KOD does nothing without LIMITED. 2023-10-14T11:08:35.601 INFO:teuthology.orchestra.run.smithi110.stdout:14 Oct 11:08:35 ntpd[28075]: Listen and drop on 0 v6wildcard [::]:123 2023-10-14T11:08:35.601 INFO:teuthology.orchestra.run.smithi110.stdout:14 Oct 11:08:35 ntpd[28075]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-14T11:08:35.601 INFO:teuthology.orchestra.run.smithi110.stdout:14 Oct 11:08:35 ntpd[28075]: Listen normally on 2 lo 127.0.0.1:123 2023-10-14T11:08:35.602 INFO:teuthology.orchestra.run.smithi110.stdout:14 Oct 11:08:35 ntpd[28075]: Listen normally on 3 enp3s0f1 172.21.15.110:123 2023-10-14T11:08:35.602 INFO:teuthology.orchestra.run.smithi110.stdout:14 Oct 11:08:35 ntpd[28075]: Listen normally on 4 lo [::1]:123 2023-10-14T11:08:35.602 INFO:teuthology.orchestra.run.smithi110.stdout:14 Oct 11:08:35 ntpd[28075]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc35%5]:123 2023-10-14T11:08:35.603 INFO:teuthology.orchestra.run.smithi110.stdout:14 Oct 11:08:35 ntpd[28075]: Listening on routing socket on fd #22 for interface updates 2023-10-14T11:08:36.566 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:36 ntpd[27876]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:36.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:36 ntpd[27876]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:36.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:36 ntpd[27876]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:36.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:36 ntpd[27876]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:36.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:36 ntpd[27876]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T11:08:36.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:36 ntpd[27876]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T11:08:36.595 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:36 ntpd[28075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:36.596 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:36 ntpd[28075]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:36.596 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:36 ntpd[28075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:36.597 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:36 ntpd[28075]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:36.597 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:36 ntpd[28075]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T11:08:36.597 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:36 ntpd[28075]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T11:08:37.566 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:37 ntpd[27876]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:37 ntpd[27876]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:37 ntpd[27876]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:37 ntpd[27876]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:37 ntpd[27876]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T11:08:37.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:37 ntpd[27876]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T11:08:37.595 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:37 ntpd[28075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:37.596 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:37 ntpd[28075]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:38.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:38 ntpd[27876]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:38.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:38 ntpd[27876]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:38.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:38 ntpd[27876]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:38.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:38 ntpd[27876]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:38.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:38 ntpd[27876]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:38.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:38 ntpd[27876]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:38.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:38 ntpd[27876]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T11:08:38.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:38 ntpd[27876]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T11:08:38.569 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:38 ntpd[27876]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:38.569 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:38 ntpd[27876]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:38.569 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:38 ntpd[27876]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T11:08:38.569 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:38 ntpd[27876]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T11:08:38.596 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:38 ntpd[28075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:38.596 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:38 ntpd[28075]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:38.596 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:38 ntpd[28075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:38.596 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:38 ntpd[28075]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:38.597 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:38 ntpd[28075]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T11:08:38.597 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:38 ntpd[28075]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T11:08:39.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:39 ntpd[27876]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:39.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:39 ntpd[27876]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:39.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:39 ntpd[27876]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:39.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:39 ntpd[27876]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:39.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:39 ntpd[27876]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:39.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:39 ntpd[27876]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:39.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:39 ntpd[27876]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T11:08:39.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:39 ntpd[27876]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T11:08:40.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:40 ntpd[27876]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:40.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:40 ntpd[27876]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:40.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:40 ntpd[27876]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:40.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:40 ntpd[27876]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:40.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:40 ntpd[27876]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:40.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:40 ntpd[27876]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:40.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:40 ntpd[27876]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T11:08:40.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:40 ntpd[27876]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T11:08:40.569 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:40 ntpd[27876]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:40.569 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:40 ntpd[27876]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:40.569 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:40 ntpd[27876]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T11:08:40.569 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:40 ntpd[27876]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T11:08:40.596 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:40 ntpd[28075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:40.596 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:40 ntpd[28075]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:40.597 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:40 ntpd[28075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:40.597 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:40 ntpd[28075]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:40.597 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:40 ntpd[28075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:40.597 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:40 ntpd[28075]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:40.598 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:40 ntpd[28075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:40.598 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:40 ntpd[28075]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:40.598 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:40 ntpd[28075]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T11:08:40.598 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:40 ntpd[28075]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T11:08:40.599 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:40 ntpd[28075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:40.599 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:40 ntpd[28075]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:40.599 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:40 ntpd[28075]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T11:08:40.599 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:40 ntpd[28075]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T11:08:40.599 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:40 ntpd[28075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:40.599 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:40 ntpd[28075]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:40.600 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:40 ntpd[28075]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T11:08:40.600 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:40 ntpd[28075]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T11:08:41.566 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:41 ntpd[27876]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:41.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:41 ntpd[27876]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:41.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:41 ntpd[27876]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:41.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:41 ntpd[27876]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:41.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:41 ntpd[27876]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T11:08:41.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:41 ntpd[27876]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T11:08:42.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:42 ntpd[27876]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:42.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:42 ntpd[27876]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:42.567 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:42 ntpd[27876]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:42.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:42 ntpd[27876]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:42.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:42 ntpd[27876]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:42.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:42 ntpd[27876]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:42.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:42 ntpd[27876]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T11:08:42.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:42 ntpd[27876]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T11:08:42.568 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:42 ntpd[27876]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:42.569 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:42 ntpd[27876]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:42.569 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:42 ntpd[27876]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T11:08:42.569 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:42 ntpd[27876]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T11:08:42.569 INFO:teuthology.orchestra.run.smithi026.stdout:14 Oct 11:08:42 ntpd[27876]: ntpd: time slew +0.002722 s 2023-10-14T11:08:42.570 INFO:teuthology.orchestra.run.smithi026.stdout:ntpd: time slew +0.002722s 2023-10-14T11:08:42.570 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:42 ntpd[27876]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-14T11:08:42.570 INFO:teuthology.orchestra.run.smithi026.stderr:14 Oct 11:08:42 ntpd[27876]: can't open /var/log/ntpstats/loopstats.20231014: Permission denied 2023-10-14T11:08:42.596 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:42 ntpd[28075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:42.596 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:42 ntpd[28075]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:42.596 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:42 ntpd[28075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:42.597 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:42 ntpd[28075]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:42.597 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:42 ntpd[28075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:42.597 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:42 ntpd[28075]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:42.597 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:42 ntpd[28075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:42.597 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:42 ntpd[28075]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:42.598 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:42 ntpd[28075]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T11:08:42.598 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:42 ntpd[28075]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T11:08:42.598 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:42 ntpd[28075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T11:08:42.598 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:42 ntpd[28075]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T11:08:42.598 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:42 ntpd[28075]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T11:08:42.598 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:42 ntpd[28075]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T11:08:42.599 INFO:teuthology.orchestra.run.smithi110.stdout:14 Oct 11:08:42 ntpd[28075]: ntpd: time slew +0.004037 s 2023-10-14T11:08:42.599 INFO:teuthology.orchestra.run.smithi110.stdout:ntpd: time slew +0.004037s 2023-10-14T11:08:42.600 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:42 ntpd[28075]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-14T11:08:42.600 INFO:teuthology.orchestra.run.smithi110.stderr:14 Oct 11:08:42 ntpd[28075]: can't open /var/log/ntpstats/loopstats.20231014: Permission denied 2023-10-14T11:08:42.683 INFO:teuthology.orchestra.run.smithi026.stdout: remote refid st t when poll reach delay offset jitter 2023-10-14T11:08:42.683 INFO:teuthology.orchestra.run.smithi026.stdout:============================================================================== 2023-10-14T11:08:42.683 INFO:teuthology.orchestra.run.smithi026.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-14T11:08:42.684 INFO:teuthology.orchestra.run.smithi026.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-14T11:08:42.684 INFO:teuthology.orchestra.run.smithi026.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-14T11:08:42.684 INFO:teuthology.orchestra.run.smithi026.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-14T11:08:42.694 INFO:teuthology.orchestra.run.smithi110.stdout: remote refid st t when poll reach delay offset jitter 2023-10-14T11:08:42.694 INFO:teuthology.orchestra.run.smithi110.stdout:============================================================================== 2023-10-14T11:08:42.694 INFO:teuthology.orchestra.run.smithi110.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-14T11:08:42.695 INFO:teuthology.orchestra.run.smithi110.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-14T11:08:42.695 INFO:teuthology.orchestra.run.smithi110.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-14T11:08:42.695 INFO:teuthology.orchestra.run.smithi110.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-14T11:08:42.696 INFO:teuthology.run_tasks:Running task install... 2023-10-14T11:08:42.705 DEBUG:teuthology.task.install:project ceph 2023-10-14T11:08:42.705 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}} 2023-10-14T11:08:42.706 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'} 2023-10-14T11:08:42.706 INFO:teuthology.task.install:Using flavor: default 2023-10-14T11:08:42.712 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-14T11:08:42.712 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-14T11:08:42.713 DEBUG:teuthology.orchestra.run.smithi026:> sudo apt-key list | grep Ceph 2023-10-14T11:08:42.713 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-key list | grep Ceph 2023-10-14T11:08:42.842 INFO:teuthology.orchestra.run.smithi026.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-10-14T11:08:42.845 INFO:teuthology.orchestra.run.smithi110.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-10-14T11:08:42.899 INFO:teuthology.orchestra.run.smithi110.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-14T11:08:42.899 INFO:teuthology.orchestra.run.smithi110.stdout:uid [ unknown] Ceph.com (release key) 2023-10-14T11:08:42.900 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-14T11:08:42.901 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-14T11:08:42.901 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T11:08:42.935 INFO:teuthology.orchestra.run.smithi026.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-14T11:08:42.935 INFO:teuthology.orchestra.run.smithi026.stdout:uid [ unknown] Ceph.com (release key) 2023-10-14T11:08:42.936 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-14T11:08:42.937 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-14T11:08:42.937 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T11:08:43.071 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default/ 2023-10-14T11:08:43.071 INFO:teuthology.task.install.deb:Package version is 18.0.0-6730-g4ba8a190-1jammy 2023-10-14T11:08:43.187 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:08:43.187 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-14T11:08:43.191 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default/ 2023-10-14T11:08:43.191 INFO:teuthology.task.install.deb:Package version is 18.0.0-6730-g4ba8a190-1jammy 2023-10-14T11:08:43.238 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get update 2023-10-14T11:08:43.298 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:08:43.299 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-14T11:08:43.321 DEBUG:teuthology.orchestra.run.smithi026:> sudo apt-get update 2023-10-14T11:08:43.420 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-14T11:08:43.426 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-14T11:08:43.442 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-14T11:08:43.523 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-14T11:08:43.523 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-14T11:08:43.533 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-14T11:08:43.552 INFO:teuthology.orchestra.run.smithi110.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy InRelease 2023-10-14T11:08:43.555 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-14T11:08:43.591 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-10-14T11:08:43.631 INFO:teuthology.orchestra.run.smithi110.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy Release.gpg 2023-10-14T11:08:43.634 INFO:teuthology.orchestra.run.smithi026.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy InRelease 2023-10-14T11:08:43.672 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,407 B] 2023-10-14T11:08:43.674 INFO:teuthology.orchestra.run.smithi026.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-10-14T11:08:43.714 INFO:teuthology.orchestra.run.smithi026.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy Release.gpg 2023-10-14T11:08:43.724 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-10-14T11:08:43.753 INFO:teuthology.orchestra.run.smithi026.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-10-14T11:08:43.845 INFO:teuthology.orchestra.run.smithi026.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,407 B] 2023-10-14T11:08:44.150 INFO:teuthology.orchestra.run.smithi026.stdout:Fetched 28.6 kB in 1s (47.6 kB/s) 2023-10-14T11:08:44.293 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:9 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-14T11:08:44.520 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 28.6 kB in 1s (26.8 kB/s) 2023-10-14T11:08:45.089 INFO:teuthology.orchestra.run.smithi026.stdout:Reading package lists... 2023-10-14T11:08:45.106 DEBUG:teuthology.orchestra.run.smithi026:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6730-g4ba8a190-1jammy cephadm=18.0.0-6730-g4ba8a190-1jammy ceph-mds=18.0.0-6730-g4ba8a190-1jammy ceph-mgr=18.0.0-6730-g4ba8a190-1jammy ceph-common=18.0.0-6730-g4ba8a190-1jammy ceph-fuse=18.0.0-6730-g4ba8a190-1jammy ceph-test=18.0.0-6730-g4ba8a190-1jammy ceph-volume=18.0.0-6730-g4ba8a190-1jammy radosgw=18.0.0-6730-g4ba8a190-1jammy python3-rados=18.0.0-6730-g4ba8a190-1jammy python3-rgw=18.0.0-6730-g4ba8a190-1jammy python3-cephfs=18.0.0-6730-g4ba8a190-1jammy python3-rbd=18.0.0-6730-g4ba8a190-1jammy libcephfs2=18.0.0-6730-g4ba8a190-1jammy libcephfs-dev=18.0.0-6730-g4ba8a190-1jammy librados2=18.0.0-6730-g4ba8a190-1jammy librbd1=18.0.0-6730-g4ba8a190-1jammy rbd-fuse=18.0.0-6730-g4ba8a190-1jammy python3-cephfs=18.0.0-6730-g4ba8a190-1jammy cephfs-shell=18.0.0-6730-g4ba8a190-1jammy cephfs-top=18.0.0-6730-g4ba8a190-1jammy cephfs-mirror=18.0.0-6730-g4ba8a190-1jammy 2023-10-14T11:08:45.183 INFO:teuthology.orchestra.run.smithi026.stdout:Reading package lists... 2023-10-14T11:08:45.351 INFO:teuthology.orchestra.run.smithi026.stdout:Building dependency tree... 2023-10-14T11:08:45.352 INFO:teuthology.orchestra.run.smithi026.stdout:Reading state information... 2023-10-14T11:08:45.418 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2023-10-14T11:08:45.436 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6730-g4ba8a190-1jammy cephadm=18.0.0-6730-g4ba8a190-1jammy ceph-mds=18.0.0-6730-g4ba8a190-1jammy ceph-mgr=18.0.0-6730-g4ba8a190-1jammy ceph-common=18.0.0-6730-g4ba8a190-1jammy ceph-fuse=18.0.0-6730-g4ba8a190-1jammy ceph-test=18.0.0-6730-g4ba8a190-1jammy ceph-volume=18.0.0-6730-g4ba8a190-1jammy radosgw=18.0.0-6730-g4ba8a190-1jammy python3-rados=18.0.0-6730-g4ba8a190-1jammy python3-rgw=18.0.0-6730-g4ba8a190-1jammy python3-cephfs=18.0.0-6730-g4ba8a190-1jammy python3-rbd=18.0.0-6730-g4ba8a190-1jammy libcephfs2=18.0.0-6730-g4ba8a190-1jammy libcephfs-dev=18.0.0-6730-g4ba8a190-1jammy librados2=18.0.0-6730-g4ba8a190-1jammy librbd1=18.0.0-6730-g4ba8a190-1jammy rbd-fuse=18.0.0-6730-g4ba8a190-1jammy python3-cephfs=18.0.0-6730-g4ba8a190-1jammy cephfs-shell=18.0.0-6730-g4ba8a190-1jammy cephfs-top=18.0.0-6730-g4ba8a190-1jammy cephfs-mirror=18.0.0-6730-g4ba8a190-1jammy 2023-10-14T11:08:45.507 INFO:teuthology.orchestra.run.smithi026.stdout:The following packages were automatically installed and are no longer required: 2023-10-14T11:08:45.507 INFO:teuthology.orchestra.run.smithi026.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-14T11:08:45.507 INFO:teuthology.orchestra.run.smithi026.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-14T11:08:45.508 INFO:teuthology.orchestra.run.smithi026.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-14T11:08:45.508 INFO:teuthology.orchestra.run.smithi026.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-14T11:08:45.510 INFO:teuthology.orchestra.run.smithi026.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-14T11:08:45.510 INFO:teuthology.orchestra.run.smithi026.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-14T11:08:45.510 INFO:teuthology.orchestra.run.smithi026.stdout:The following additional packages will be installed: 2023-10-14T11:08:45.511 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-14T11:08:45.511 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-10-14T11:08:45.511 INFO:teuthology.orchestra.run.smithi026.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-14T11:08:45.512 INFO:teuthology.orchestra.run.smithi026.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-10-14T11:08:45.512 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-10-14T11:08:45.512 INFO:teuthology.orchestra.run.smithi026.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-10-14T11:08:45.512 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-10-14T11:08:45.513 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-10-14T11:08:45.513 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-10-14T11:08:45.513 INFO:teuthology.orchestra.run.smithi026.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-10-14T11:08:45.513 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-10-14T11:08:45.514 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-10-14T11:08:45.514 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-10-14T11:08:45.514 INFO:teuthology.orchestra.run.smithi026.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-14T11:08:45.514 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-10-14T11:08:45.515 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-10-14T11:08:45.515 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-10-14T11:08:45.515 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-10-14T11:08:45.515 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-10-14T11:08:45.516 INFO:teuthology.orchestra.run.smithi026.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-10-14T11:08:45.519 INFO:teuthology.orchestra.run.smithi026.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-10-14T11:08:45.520 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-10-14T11:08:45.520 INFO:teuthology.orchestra.run.smithi026.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-14T11:08:45.520 INFO:teuthology.orchestra.run.smithi026.stdout:Suggested packages: 2023-10-14T11:08:45.520 INFO:teuthology.orchestra.run.smithi026.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-10-14T11:08:45.521 INFO:teuthology.orchestra.run.smithi026.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-10-14T11:08:45.521 INFO:teuthology.orchestra.run.smithi026.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-10-14T11:08:45.521 INFO:teuthology.orchestra.run.smithi026.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-10-14T11:08:45.521 INFO:teuthology.orchestra.run.smithi026.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-10-14T11:08:45.522 INFO:teuthology.orchestra.run.smithi026.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-10-14T11:08:45.522 INFO:teuthology.orchestra.run.smithi026.stdout: python3-watchdog 2023-10-14T11:08:45.522 INFO:teuthology.orchestra.run.smithi026.stdout:Recommended packages: 2023-10-14T11:08:45.522 INFO:teuthology.orchestra.run.smithi026.stdout: btrfs-tools 2023-10-14T11:08:45.523 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2023-10-14T11:08:45.657 INFO:teuthology.orchestra.run.smithi026.stdout:The following NEW packages will be installed: 2023-10-14T11:08:45.657 INFO:teuthology.orchestra.run.smithi026.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-14T11:08:45.657 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-14T11:08:45.658 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-14T11:08:45.658 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-10-14T11:08:45.658 INFO:teuthology.orchestra.run.smithi026.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-14T11:08:45.658 INFO:teuthology.orchestra.run.smithi026.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-10-14T11:08:45.659 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-10-14T11:08:45.660 INFO:teuthology.orchestra.run.smithi026.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-10-14T11:08:45.660 INFO:teuthology.orchestra.run.smithi026.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-10-14T11:08:45.660 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-10-14T11:08:45.660 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-10-14T11:08:45.660 INFO:teuthology.orchestra.run.smithi026.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-10-14T11:08:45.660 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-10-14T11:08:45.661 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-10-14T11:08:45.661 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-10-14T11:08:45.661 INFO:teuthology.orchestra.run.smithi026.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-10-14T11:08:45.661 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-10-14T11:08:45.661 INFO:teuthology.orchestra.run.smithi026.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-10-14T11:08:45.662 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-10-14T11:08:45.662 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-10-14T11:08:45.662 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-14T11:08:45.662 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-10-14T11:08:45.662 INFO:teuthology.orchestra.run.smithi026.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-10-14T11:08:45.662 INFO:teuthology.orchestra.run.smithi026.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-10-14T11:08:45.663 INFO:teuthology.orchestra.run.smithi026.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-10-14T11:08:45.663 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-10-14T11:08:45.663 INFO:teuthology.orchestra.run.smithi026.stdout: socat xmlstarlet 2023-10-14T11:08:45.677 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2023-10-14T11:08:45.678 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2023-10-14T11:08:45.829 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2023-10-14T11:08:45.830 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-14T11:08:45.830 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-14T11:08:45.830 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-14T11:08:45.830 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-14T11:08:45.832 INFO:teuthology.orchestra.run.smithi110.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-14T11:08:45.832 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-14T11:08:45.833 INFO:teuthology.orchestra.run.smithi110.stdout:The following additional packages will be installed: 2023-10-14T11:08:45.833 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-14T11:08:45.833 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-10-14T11:08:45.833 INFO:teuthology.orchestra.run.smithi110.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-14T11:08:45.833 INFO:teuthology.orchestra.run.smithi110.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-10-14T11:08:45.834 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-10-14T11:08:45.834 INFO:teuthology.orchestra.run.smithi110.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-10-14T11:08:45.834 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-10-14T11:08:45.834 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-10-14T11:08:45.835 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-10-14T11:08:45.835 INFO:teuthology.orchestra.run.smithi110.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-10-14T11:08:45.835 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-10-14T11:08:45.835 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-10-14T11:08:45.835 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-10-14T11:08:45.835 INFO:teuthology.orchestra.run.smithi110.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-14T11:08:45.836 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-10-14T11:08:45.836 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-10-14T11:08:45.836 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-10-14T11:08:45.836 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-10-14T11:08:45.836 INFO:teuthology.orchestra.run.smithi110.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-10-14T11:08:45.836 INFO:teuthology.orchestra.run.smithi110.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-10-14T11:08:45.837 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-10-14T11:08:45.837 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-10-14T11:08:45.837 INFO:teuthology.orchestra.run.smithi110.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-14T11:08:45.837 INFO:teuthology.orchestra.run.smithi110.stdout:Suggested packages: 2023-10-14T11:08:45.838 INFO:teuthology.orchestra.run.smithi110.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-10-14T11:08:45.838 INFO:teuthology.orchestra.run.smithi110.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-10-14T11:08:45.838 INFO:teuthology.orchestra.run.smithi110.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-10-14T11:08:45.838 INFO:teuthology.orchestra.run.smithi110.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-10-14T11:08:45.838 INFO:teuthology.orchestra.run.smithi110.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-10-14T11:08:45.839 INFO:teuthology.orchestra.run.smithi110.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-10-14T11:08:45.839 INFO:teuthology.orchestra.run.smithi110.stdout: python3-watchdog 2023-10-14T11:08:45.839 INFO:teuthology.orchestra.run.smithi110.stdout:Recommended packages: 2023-10-14T11:08:45.839 INFO:teuthology.orchestra.run.smithi110.stdout: btrfs-tools 2023-10-14T11:08:45.856 INFO:teuthology.orchestra.run.smithi026.stdout:0 upgraded, 115 newly installed, 0 to remove and 259 not upgraded. 2023-10-14T11:08:45.856 INFO:teuthology.orchestra.run.smithi026.stdout:Need to get 184 MB of archives. 2023-10-14T11:08:45.856 INFO:teuthology.orchestra.run.smithi026.stdout:After this operation, 826 MB of additional disk space will be used. 2023-10-14T11:08:45.856 INFO:teuthology.orchestra.run.smithi026.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-10-14T11:08:45.939 INFO:teuthology.orchestra.run.smithi026.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-10-14T11:08:45.968 INFO:teuthology.orchestra.run.smithi026.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-6730-g4ba8a190-1jammy [3,449 kB] 2023-10-14T11:08:45.974 INFO:teuthology.orchestra.run.smithi110.stdout:The following NEW packages will be installed: 2023-10-14T11:08:45.974 INFO:teuthology.orchestra.run.smithi110.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-14T11:08:45.974 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-14T11:08:45.974 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-14T11:08:45.975 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-10-14T11:08:45.976 INFO:teuthology.orchestra.run.smithi110.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-14T11:08:45.976 INFO:teuthology.orchestra.run.smithi110.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-10-14T11:08:45.977 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-10-14T11:08:45.977 INFO:teuthology.orchestra.run.smithi110.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-10-14T11:08:45.977 INFO:teuthology.orchestra.run.smithi110.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-10-14T11:08:45.977 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-10-14T11:08:45.978 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-10-14T11:08:45.978 INFO:teuthology.orchestra.run.smithi110.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-10-14T11:08:45.978 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-10-14T11:08:45.978 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-10-14T11:08:45.978 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-10-14T11:08:45.979 INFO:teuthology.orchestra.run.smithi110.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-10-14T11:08:45.979 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-10-14T11:08:45.979 INFO:teuthology.orchestra.run.smithi110.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-10-14T11:08:45.979 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-10-14T11:08:45.979 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-10-14T11:08:45.979 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-14T11:08:45.980 INFO:teuthology.orchestra.run.smithi110.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-10-14T11:08:45.980 INFO:teuthology.orchestra.run.smithi110.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-10-14T11:08:45.980 INFO:teuthology.orchestra.run.smithi110.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-10-14T11:08:45.980 INFO:teuthology.orchestra.run.smithi110.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-10-14T11:08:45.980 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-10-14T11:08:45.981 INFO:teuthology.orchestra.run.smithi110.stdout: socat xmlstarlet 2023-10-14T11:08:45.984 INFO:teuthology.orchestra.run.smithi026.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-10-14T11:08:46.171 INFO:teuthology.orchestra.run.smithi110.stdout:0 upgraded, 115 newly installed, 0 to remove and 259 not upgraded. 2023-10-14T11:08:46.172 INFO:teuthology.orchestra.run.smithi110.stdout:Need to get 184 MB of archives. 2023-10-14T11:08:46.172 INFO:teuthology.orchestra.run.smithi110.stdout:After this operation, 826 MB of additional disk space will be used. 2023-10-14T11:08:46.172 INFO:teuthology.orchestra.run.smithi110.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-10-14T11:08:46.190 INFO:teuthology.orchestra.run.smithi026.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-10-14T11:08:46.234 INFO:teuthology.orchestra.run.smithi026.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-10-14T11:08:46.254 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-10-14T11:08:46.264 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-6730-g4ba8a190-1jammy [3,449 kB] 2023-10-14T11:08:46.299 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-10-14T11:08:46.310 INFO:teuthology.orchestra.run.smithi026.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-10-14T11:08:46.321 INFO:teuthology.orchestra.run.smithi026.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-10-14T11:08:46.368 INFO:teuthology.orchestra.run.smithi026.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-10-14T11:08:46.506 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-10-14T11:08:46.533 INFO:teuthology.orchestra.run.smithi026.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-10-14T11:08:46.542 INFO:teuthology.orchestra.run.smithi026.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-10-14T11:08:46.550 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-10-14T11:08:46.569 INFO:teuthology.orchestra.run.smithi026.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-10-14T11:08:46.626 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-10-14T11:08:46.637 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-10-14T11:08:46.684 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-10-14T11:08:46.742 INFO:teuthology.orchestra.run.smithi026.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-10-14T11:08:46.825 INFO:teuthology.orchestra.run.smithi026.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-6730-g4ba8a190-1jammy [3,130 kB] 2023-10-14T11:08:46.849 INFO:teuthology.orchestra.run.smithi110.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-10-14T11:08:46.858 INFO:teuthology.orchestra.run.smithi110.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-10-14T11:08:46.885 INFO:teuthology.orchestra.run.smithi110.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-10-14T11:08:46.934 INFO:teuthology.orchestra.run.smithi026.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-10-14T11:08:47.057 INFO:teuthology.orchestra.run.smithi110.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-10-14T11:08:47.079 INFO:teuthology.orchestra.run.smithi110.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-6730-g4ba8a190-1jammy [3,130 kB] 2023-10-14T11:08:47.131 INFO:teuthology.orchestra.run.smithi026.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-6730-g4ba8a190-1jammy [688 kB] 2023-10-14T11:08:47.177 INFO:teuthology.orchestra.run.smithi026.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-6730-g4ba8a190-1jammy [356 kB] 2023-10-14T11:08:47.215 INFO:teuthology.orchestra.run.smithi026.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-6730-g4ba8a190-1jammy [32.8 kB] 2023-10-14T11:08:47.216 INFO:teuthology.orchestra.run.smithi026.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-6730-g4ba8a190-1jammy [180 kB] 2023-10-14T11:08:47.224 INFO:teuthology.orchestra.run.smithi026.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-6730-g4ba8a190-1jammy [62.4 kB] 2023-10-14T11:08:47.227 INFO:teuthology.orchestra.run.smithi026.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-6730-g4ba8a190-1jammy [329 kB] 2023-10-14T11:08:47.249 INFO:teuthology.orchestra.run.smithi110.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-10-14T11:08:47.256 INFO:teuthology.orchestra.run.smithi026.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-6730-g4ba8a190-1jammy [6,222 kB] 2023-10-14T11:08:47.358 INFO:teuthology.orchestra.run.smithi026.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-10-14T11:08:47.365 INFO:teuthology.orchestra.run.smithi026.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-10-14T11:08:47.365 INFO:teuthology.orchestra.run.smithi026.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-10-14T11:08:47.377 INFO:teuthology.orchestra.run.smithi026.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-10-14T11:08:47.378 INFO:teuthology.orchestra.run.smithi026.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-10-14T11:08:47.380 INFO:teuthology.orchestra.run.smithi026.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-10-14T11:08:47.382 INFO:teuthology.orchestra.run.smithi026.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-10-14T11:08:47.383 INFO:teuthology.orchestra.run.smithi026.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-10-14T11:08:47.385 INFO:teuthology.orchestra.run.smithi026.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-10-14T11:08:47.397 INFO:teuthology.orchestra.run.smithi110.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-6730-g4ba8a190-1jammy [688 kB] 2023-10-14T11:08:47.476 INFO:teuthology.orchestra.run.smithi110.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-6730-g4ba8a190-1jammy [356 kB] 2023-10-14T11:08:47.489 INFO:teuthology.orchestra.run.smithi110.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-6730-g4ba8a190-1jammy [32.8 kB] 2023-10-14T11:08:47.513 INFO:teuthology.orchestra.run.smithi110.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-6730-g4ba8a190-1jammy [180 kB] 2023-10-14T11:08:47.520 INFO:teuthology.orchestra.run.smithi110.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-6730-g4ba8a190-1jammy [62.4 kB] 2023-10-14T11:08:47.522 INFO:teuthology.orchestra.run.smithi110.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-6730-g4ba8a190-1jammy [329 kB] 2023-10-14T11:08:47.549 INFO:teuthology.orchestra.run.smithi026.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-10-14T11:08:47.556 INFO:teuthology.orchestra.run.smithi110.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-6730-g4ba8a190-1jammy [6,222 kB] 2023-10-14T11:08:47.634 INFO:teuthology.orchestra.run.smithi026.stdout:Get:33 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-6730-g4ba8a190-1jammy [112 kB] 2023-10-14T11:08:47.636 INFO:teuthology.orchestra.run.smithi026.stdout:Get:34 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-6730-g4ba8a190-1jammy [439 kB] 2023-10-14T11:08:47.671 INFO:teuthology.orchestra.run.smithi026.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-6730-g4ba8a190-1jammy [22.6 MB] 2023-10-14T11:08:47.674 INFO:teuthology.orchestra.run.smithi110.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-10-14T11:08:47.681 INFO:teuthology.orchestra.run.smithi110.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-10-14T11:08:47.682 INFO:teuthology.orchestra.run.smithi110.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-10-14T11:08:47.693 INFO:teuthology.orchestra.run.smithi110.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-10-14T11:08:47.694 INFO:teuthology.orchestra.run.smithi110.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-10-14T11:08:47.695 INFO:teuthology.orchestra.run.smithi110.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-10-14T11:08:47.697 INFO:teuthology.orchestra.run.smithi110.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-10-14T11:08:47.699 INFO:teuthology.orchestra.run.smithi110.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-10-14T11:08:47.701 INFO:teuthology.orchestra.run.smithi110.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-10-14T11:08:47.866 INFO:teuthology.orchestra.run.smithi110.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-10-14T11:08:47.995 INFO:teuthology.orchestra.run.smithi026.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-10-14T11:08:48.005 INFO:teuthology.orchestra.run.smithi026.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-10-14T11:08:48.011 INFO:teuthology.orchestra.run.smithi026.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-10-14T11:08:48.015 INFO:teuthology.orchestra.run.smithi026.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-10-14T11:08:48.034 INFO:teuthology.orchestra.run.smithi026.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-14T11:08:48.038 INFO:teuthology.orchestra.run.smithi026.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-10-14T11:08:48.040 INFO:teuthology.orchestra.run.smithi026.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-10-14T11:08:48.068 INFO:teuthology.orchestra.run.smithi110.stdout:Get:33 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-6730-g4ba8a190-1jammy [112 kB] 2023-10-14T11:08:48.069 INFO:teuthology.orchestra.run.smithi110.stdout:Get:34 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-6730-g4ba8a190-1jammy [439 kB] 2023-10-14T11:08:48.080 INFO:teuthology.orchestra.run.smithi026.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-10-14T11:08:48.094 INFO:teuthology.orchestra.run.smithi026.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-10-14T11:08:48.099 INFO:teuthology.orchestra.run.smithi026.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-10-14T11:08:48.125 INFO:teuthology.orchestra.run.smithi110.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-6730-g4ba8a190-1jammy [22.6 MB] 2023-10-14T11:08:48.312 INFO:teuthology.orchestra.run.smithi110.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-10-14T11:08:48.323 INFO:teuthology.orchestra.run.smithi110.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-10-14T11:08:48.329 INFO:teuthology.orchestra.run.smithi110.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-10-14T11:08:48.333 INFO:teuthology.orchestra.run.smithi110.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-10-14T11:08:48.351 INFO:teuthology.orchestra.run.smithi110.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-14T11:08:48.354 INFO:teuthology.orchestra.run.smithi026.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-10-14T11:08:48.355 INFO:teuthology.orchestra.run.smithi110.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-10-14T11:08:48.357 INFO:teuthology.orchestra.run.smithi110.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-10-14T11:08:48.397 INFO:teuthology.orchestra.run.smithi110.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-10-14T11:08:48.412 INFO:teuthology.orchestra.run.smithi110.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-10-14T11:08:48.416 INFO:teuthology.orchestra.run.smithi110.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-10-14T11:08:48.437 INFO:teuthology.orchestra.run.smithi026.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-10-14T11:08:48.528 INFO:teuthology.orchestra.run.smithi026.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-10-14T11:08:48.606 INFO:teuthology.orchestra.run.smithi026.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-10-14T11:08:48.670 INFO:teuthology.orchestra.run.smithi110.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-10-14T11:08:48.709 INFO:teuthology.orchestra.run.smithi026.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-10-14T11:08:48.753 INFO:teuthology.orchestra.run.smithi110.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-10-14T11:08:48.796 INFO:teuthology.orchestra.run.smithi026.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-10-14T11:08:48.815 INFO:teuthology.orchestra.run.smithi026.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-10-14T11:08:48.844 INFO:teuthology.orchestra.run.smithi026.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-10-14T11:08:48.845 INFO:teuthology.orchestra.run.smithi110.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-10-14T11:08:48.858 INFO:teuthology.orchestra.run.smithi026.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-10-14T11:08:48.895 INFO:teuthology.orchestra.run.smithi026.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-10-14T11:08:48.903 INFO:teuthology.orchestra.run.smithi026.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-10-14T11:08:48.912 INFO:teuthology.orchestra.run.smithi026.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-6730-g4ba8a190-1jammy [6,851 kB] 2023-10-14T11:08:48.922 INFO:teuthology.orchestra.run.smithi110.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-10-14T11:08:49.028 INFO:teuthology.orchestra.run.smithi110.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-10-14T11:08:49.094 INFO:teuthology.orchestra.run.smithi026.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-10-14T11:08:49.118 INFO:teuthology.orchestra.run.smithi110.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-10-14T11:08:49.137 INFO:teuthology.orchestra.run.smithi110.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-10-14T11:08:49.167 INFO:teuthology.orchestra.run.smithi110.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-10-14T11:08:49.180 INFO:teuthology.orchestra.run.smithi110.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-10-14T11:08:49.218 INFO:teuthology.orchestra.run.smithi110.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-10-14T11:08:49.226 INFO:teuthology.orchestra.run.smithi110.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-10-14T11:08:49.282 INFO:teuthology.orchestra.run.smithi026.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-6730-g4ba8a190-1jammy [238 kB] 2023-10-14T11:08:49.285 INFO:teuthology.orchestra.run.smithi026.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6730-g4ba8a190-1jammy [128 kB] 2023-10-14T11:08:49.289 INFO:teuthology.orchestra.run.smithi026.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-6730-g4ba8a190-1jammy [1,496 kB] 2023-10-14T11:08:49.391 INFO:teuthology.orchestra.run.smithi026.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-6730-g4ba8a190-1jammy [9,861 kB] 2023-10-14T11:08:49.417 INFO:teuthology.orchestra.run.smithi110.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-10-14T11:08:49.914 INFO:teuthology.orchestra.run.smithi026.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-6730-g4ba8a190-1jammy [31.7 MB] 2023-10-14T11:08:49.922 INFO:teuthology.orchestra.run.smithi026.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-10-14T11:08:49.924 INFO:teuthology.orchestra.run.smithi026.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-10-14T11:08:49.925 INFO:teuthology.orchestra.run.smithi026.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-10-14T11:08:49.926 INFO:teuthology.orchestra.run.smithi026.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-14T11:08:49.926 INFO:teuthology.orchestra.run.smithi026.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-10-14T11:08:49.927 INFO:teuthology.orchestra.run.smithi026.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-10-14T11:08:49.951 INFO:teuthology.orchestra.run.smithi026.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-10-14T11:08:49.953 INFO:teuthology.orchestra.run.smithi026.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-10-14T11:08:49.954 INFO:teuthology.orchestra.run.smithi026.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-10-14T11:08:49.974 INFO:teuthology.orchestra.run.smithi110.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-6730-g4ba8a190-1jammy [6,851 kB] 2023-10-14T11:08:50.024 INFO:teuthology.orchestra.run.smithi026.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-10-14T11:08:50.187 INFO:teuthology.orchestra.run.smithi026.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-10-14T11:08:50.318 INFO:teuthology.orchestra.run.smithi110.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-10-14T11:08:50.319 INFO:teuthology.orchestra.run.smithi110.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-10-14T11:08:50.321 INFO:teuthology.orchestra.run.smithi110.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-10-14T11:08:50.321 INFO:teuthology.orchestra.run.smithi110.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-14T11:08:50.321 INFO:teuthology.orchestra.run.smithi110.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-10-14T11:08:50.323 INFO:teuthology.orchestra.run.smithi110.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-10-14T11:08:50.346 INFO:teuthology.orchestra.run.smithi110.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-10-14T11:08:50.348 INFO:teuthology.orchestra.run.smithi110.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-10-14T11:08:50.349 INFO:teuthology.orchestra.run.smithi110.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-10-14T11:08:50.419 INFO:teuthology.orchestra.run.smithi110.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-10-14T11:08:50.450 INFO:teuthology.orchestra.run.smithi026.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-10-14T11:08:50.483 INFO:teuthology.orchestra.run.smithi026.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-10-14T11:08:50.516 INFO:teuthology.orchestra.run.smithi110.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-6730-g4ba8a190-1jammy [238 kB] 2023-10-14T11:08:50.526 INFO:teuthology.orchestra.run.smithi110.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6730-g4ba8a190-1jammy [128 kB] 2023-10-14T11:08:50.552 INFO:teuthology.orchestra.run.smithi026.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-10-14T11:08:50.566 INFO:teuthology.orchestra.run.smithi110.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-6730-g4ba8a190-1jammy [1,496 kB] 2023-10-14T11:08:50.583 INFO:teuthology.orchestra.run.smithi110.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-10-14T11:08:50.588 INFO:teuthology.orchestra.run.smithi026.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-10-14T11:08:50.608 INFO:teuthology.orchestra.run.smithi026.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-10-14T11:08:50.634 INFO:teuthology.orchestra.run.smithi026.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-10-14T11:08:50.664 INFO:teuthology.orchestra.run.smithi110.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-6730-g4ba8a190-1jammy [9,861 kB] 2023-10-14T11:08:50.773 INFO:teuthology.orchestra.run.smithi026.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-10-14T11:08:50.808 INFO:teuthology.orchestra.run.smithi026.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-10-14T11:08:50.828 INFO:teuthology.orchestra.run.smithi026.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-10-14T11:08:50.835 INFO:teuthology.orchestra.run.smithi026.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-10-14T11:08:50.840 INFO:teuthology.orchestra.run.smithi110.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-10-14T11:08:50.873 INFO:teuthology.orchestra.run.smithi110.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-10-14T11:08:50.935 INFO:teuthology.orchestra.run.smithi110.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-10-14T11:08:50.970 INFO:teuthology.orchestra.run.smithi110.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-10-14T11:08:50.988 INFO:teuthology.orchestra.run.smithi110.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-10-14T11:08:51.015 INFO:teuthology.orchestra.run.smithi110.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-10-14T11:08:51.038 INFO:teuthology.orchestra.run.smithi026.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-10-14T11:08:51.150 INFO:teuthology.orchestra.run.smithi110.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-10-14T11:08:51.184 INFO:teuthology.orchestra.run.smithi110.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-10-14T11:08:51.204 INFO:teuthology.orchestra.run.smithi110.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-10-14T11:08:51.212 INFO:teuthology.orchestra.run.smithi110.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-10-14T11:08:51.415 INFO:teuthology.orchestra.run.smithi110.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-10-14T11:08:51.484 INFO:teuthology.orchestra.run.smithi110.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-6730-g4ba8a190-1jammy [31.7 MB] 2023-10-14T11:08:51.521 INFO:teuthology.orchestra.run.smithi026.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-10-14T11:08:51.527 INFO:teuthology.orchestra.run.smithi026.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-10-14T11:08:51.658 INFO:teuthology.orchestra.run.smithi026.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-10-14T11:08:51.689 INFO:teuthology.orchestra.run.smithi026.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-6730-g4ba8a190-1jammy [14.0 kB] 2023-10-14T11:08:51.689 INFO:teuthology.orchestra.run.smithi026.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-6730-g4ba8a190-1jammy [839 kB] 2023-10-14T11:08:51.703 INFO:teuthology.orchestra.run.smithi026.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-10-14T11:08:51.704 INFO:teuthology.orchestra.run.smithi026.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-14T11:08:51.709 INFO:teuthology.orchestra.run.smithi026.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-6730-g4ba8a190-1jammy [2,146 kB] 2023-10-14T11:08:51.709 INFO:teuthology.orchestra.run.smithi026.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-10-14T11:08:51.711 INFO:teuthology.orchestra.run.smithi026.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-10-14T11:08:51.727 INFO:teuthology.orchestra.run.smithi026.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-10-14T11:08:51.735 INFO:teuthology.orchestra.run.smithi026.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-10-14T11:08:51.796 INFO:teuthology.orchestra.run.smithi026.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-10-14T11:08:51.855 INFO:teuthology.orchestra.run.smithi026.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-6730-g4ba8a190-1jammy [283 kB] 2023-10-14T11:08:51.865 INFO:teuthology.orchestra.run.smithi026.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-6730-g4ba8a190-1jammy [138 kB] 2023-10-14T11:08:51.867 INFO:teuthology.orchestra.run.smithi026.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-6730-g4ba8a190-1jammy [1,906 kB] 2023-10-14T11:08:51.895 INFO:teuthology.orchestra.run.smithi110.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-10-14T11:08:51.901 INFO:teuthology.orchestra.run.smithi110.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-10-14T11:08:51.961 INFO:teuthology.orchestra.run.smithi026.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6730-g4ba8a190-1jammy [8,625 kB] 2023-10-14T11:08:51.961 INFO:teuthology.orchestra.run.smithi026.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-10-14T11:08:52.030 INFO:teuthology.orchestra.run.smithi110.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-10-14T11:08:52.077 INFO:teuthology.orchestra.run.smithi110.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-10-14T11:08:52.077 INFO:teuthology.orchestra.run.smithi110.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-14T11:08:52.082 INFO:teuthology.orchestra.run.smithi110.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-10-14T11:08:52.084 INFO:teuthology.orchestra.run.smithi110.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-10-14T11:08:52.101 INFO:teuthology.orchestra.run.smithi110.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-10-14T11:08:52.108 INFO:teuthology.orchestra.run.smithi110.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-10-14T11:08:52.127 INFO:teuthology.orchestra.run.smithi026.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-10-14T11:08:52.168 INFO:teuthology.orchestra.run.smithi110.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-10-14T11:08:52.333 INFO:teuthology.orchestra.run.smithi110.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-10-14T11:08:52.416 INFO:teuthology.orchestra.run.smithi026.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-10-14T11:08:52.442 INFO:teuthology.orchestra.run.smithi026.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-10-14T11:08:52.442 INFO:teuthology.orchestra.run.smithi026.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-6730-g4ba8a190-1jammy [14.2 kB] 2023-10-14T11:08:52.442 INFO:teuthology.orchestra.run.smithi026.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-6730-g4ba8a190-1jammy [47.8 MB] 2023-10-14T11:08:52.499 INFO:teuthology.orchestra.run.smithi110.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-10-14T11:08:52.792 INFO:teuthology.orchestra.run.smithi110.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-10-14T11:08:52.818 INFO:teuthology.orchestra.run.smithi110.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-10-14T11:08:54.052 INFO:teuthology.orchestra.run.smithi110.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-6730-g4ba8a190-1jammy [14.0 kB] 2023-10-14T11:08:54.053 INFO:teuthology.orchestra.run.smithi110.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-6730-g4ba8a190-1jammy [839 kB] 2023-10-14T11:08:54.095 INFO:teuthology.orchestra.run.smithi110.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-6730-g4ba8a190-1jammy [2,146 kB] 2023-10-14T11:08:54.273 INFO:teuthology.orchestra.run.smithi110.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-6730-g4ba8a190-1jammy [283 kB] 2023-10-14T11:08:54.326 INFO:teuthology.orchestra.run.smithi110.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-6730-g4ba8a190-1jammy [138 kB] 2023-10-14T11:08:54.332 INFO:teuthology.orchestra.run.smithi110.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-6730-g4ba8a190-1jammy [1,906 kB] 2023-10-14T11:08:54.487 INFO:teuthology.orchestra.run.smithi110.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6730-g4ba8a190-1jammy [8,625 kB] 2023-10-14T11:08:55.079 INFO:teuthology.orchestra.run.smithi026.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-6730-g4ba8a190-1jammy [120 kB] 2023-10-14T11:08:55.080 INFO:teuthology.orchestra.run.smithi026.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-6730-g4ba8a190-1jammy [227 kB] 2023-10-14T11:08:55.082 INFO:teuthology.orchestra.run.smithi026.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-6730-g4ba8a190-1jammy [33.9 kB] 2023-10-14T11:08:55.083 INFO:teuthology.orchestra.run.smithi026.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-6730-g4ba8a190-1jammy [23.4 kB] 2023-10-14T11:08:55.083 INFO:teuthology.orchestra.run.smithi026.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-6730-g4ba8a190-1jammy [38.3 kB] 2023-10-14T11:08:55.084 INFO:teuthology.orchestra.run.smithi026.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-6730-g4ba8a190-1jammy [12.3 MB] 2023-10-14T11:08:55.199 INFO:teuthology.orchestra.run.smithi110.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-6730-g4ba8a190-1jammy [14.2 kB] 2023-10-14T11:08:55.200 INFO:teuthology.orchestra.run.smithi110.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-6730-g4ba8a190-1jammy [47.8 MB] 2023-10-14T11:08:55.772 INFO:teuthology.orchestra.run.smithi026.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-6730-g4ba8a190-1jammy [91.6 kB] 2023-10-14T11:08:56.364 INFO:teuthology.orchestra.run.smithi026.stdout:Fetched 184 MB in 10s (18.2 MB/s) 2023-10-14T11:08:56.519 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-14T11:08:56.590 INFO:teuthology.orchestra.run.smithi026.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132932 files and directories currently installed.) 2023-10-14T11:08:56.593 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-10-14T11:08:56.635 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-10-14T11:08:56.937 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-14T11:08:56.952 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-10-14T11:08:56.996 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-14T11:08:57.307 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-cmd2. 2023-10-14T11:08:57.316 INFO:teuthology.orchestra.run.smithi110.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-6730-g4ba8a190-1jammy [120 kB] 2023-10-14T11:08:57.318 INFO:teuthology.orchestra.run.smithi110.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-6730-g4ba8a190-1jammy [227 kB] 2023-10-14T11:08:57.320 INFO:teuthology.orchestra.run.smithi110.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-6730-g4ba8a190-1jammy [33.9 kB] 2023-10-14T11:08:57.320 INFO:teuthology.orchestra.run.smithi110.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-6730-g4ba8a190-1jammy [23.4 kB] 2023-10-14T11:08:57.320 INFO:teuthology.orchestra.run.smithi110.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-6730-g4ba8a190-1jammy [38.3 kB] 2023-10-14T11:08:57.321 INFO:teuthology.orchestra.run.smithi110.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-6730-g4ba8a190-1jammy [12.3 MB] 2023-10-14T11:08:57.321 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-10-14T11:08:57.382 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-10-14T11:08:57.702 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libfmt8:amd64. 2023-10-14T11:08:57.717 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-10-14T11:08:57.776 INFO:teuthology.orchestra.run.smithi110.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-6730-g4ba8a190-1jammy [91.6 kB] 2023-10-14T11:08:57.796 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-14T11:08:58.148 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-10-14T11:08:58.163 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-10-14T11:08:58.213 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-14T11:08:58.341 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 184 MB in 12s (15.6 MB/s) 2023-10-14T11:08:58.488 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-14T11:08:58.556 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132932 files and directories currently installed.) 2023-10-14T11:08:58.559 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-10-14T11:08:58.612 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-10-14T11:08:58.918 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-14T11:08:58.934 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-10-14T11:08:58.939 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-14T11:08:58.953 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-10-14T11:08:58.976 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-14T11:08:58.998 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-14T11:08:59.301 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cmd2. 2023-10-14T11:08:59.315 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-10-14T11:08:59.321 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-14T11:08:59.337 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-10-14T11:08:59.367 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-10-14T11:08:59.380 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-14T11:08:59.670 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libfmt8:amd64. 2023-10-14T11:08:59.684 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-10-14T11:08:59.770 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-14T11:08:59.808 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-14T11:08:59.824 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-14T11:08:59.875 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T11:09:00.132 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-10-14T11:09:00.146 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-10-14T11:09:00.190 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-14T11:09:00.286 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-14T11:09:00.301 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-14T11:09:00.345 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T11:09:00.552 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-14T11:09:00.566 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-10-14T11:09:00.611 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-14T11:09:00.698 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-14T11:09:00.713 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-14T11:09:00.756 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T11:09:00.913 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-14T11:09:00.927 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-10-14T11:09:00.972 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-14T11:09:01.076 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-10-14T11:09:01.093 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-10-14T11:09:01.134 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-14T11:09:01.442 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-14T11:09:01.457 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-14T11:09:01.462 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package librados2. 2023-10-14T11:09:01.477 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../011-librados2_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:01.509 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T11:09:01.529 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking librados2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:01.929 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-14T11:09:01.943 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-14T11:09:01.956 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package librbd1. 2023-10-14T11:09:01.972 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../012-librbd1_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:01.987 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T11:09:02.015 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking librbd1 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:02.315 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-14T11:09:02.330 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-14T11:09:02.373 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T11:09:02.417 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libcephfs2. 2023-10-14T11:09:02.433 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:02.475 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libcephfs2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:02.726 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-10-14T11:09:02.741 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-10-14T11:09:02.778 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-rados. 2023-10-14T11:09:02.793 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../014-python3-rados_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:02.810 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-14T11:09:02.828 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-rados (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:03.114 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-14T11:09:03.129 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librados2. 2023-10-14T11:09:03.130 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T11:09:03.144 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../011-librados2_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:03.173 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-ceph-argparse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:03.187 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librados2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:03.450 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-cephfs. 2023-10-14T11:09:03.466 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:03.508 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-cephfs (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:03.841 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librbd1. 2023-10-14T11:09:03.845 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-14T11:09:03.855 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../012-librbd1_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:03.860 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T11:09:03.899 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librbd1 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:03.903 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-ceph-common (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:04.216 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-prettytable. 2023-10-14T11:09:04.230 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-10-14T11:09:04.273 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-10-14T11:09:04.311 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libcephfs2. 2023-10-14T11:09:04.326 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:04.370 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libcephfs2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:04.503 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-rbd. 2023-10-14T11:09:04.515 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:04.550 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-rbd (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:04.646 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rados. 2023-10-14T11:09:04.662 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../014-python3-rados_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:04.696 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rados (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:04.919 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-14T11:09:04.935 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-10-14T11:09:04.978 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-14T11:09:04.982 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-14T11:09:04.997 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T11:09:05.040 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-ceph-argparse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:05.314 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package librgw2. 2023-10-14T11:09:05.326 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cephfs. 2023-10-14T11:09:05.329 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../021-librgw2_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:05.341 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:05.372 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking librgw2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:05.384 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cephfs (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:05.712 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-14T11:09:05.727 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T11:09:05.770 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-ceph-common (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:05.858 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-rgw. 2023-10-14T11:09:05.873 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:05.916 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-rgw (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:06.082 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-prettytable. 2023-10-14T11:09:06.097 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-10-14T11:09:06.131 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-10-14T11:09:06.227 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package liboath0:amd64. 2023-10-14T11:09:06.242 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-10-14T11:09:06.285 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-10-14T11:09:06.418 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rbd. 2023-10-14T11:09:06.433 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:06.476 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rbd (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:06.613 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libradosstriper1. 2023-10-14T11:09:06.629 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:06.688 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libradosstriper1 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:06.854 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-14T11:09:06.869 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-10-14T11:09:06.912 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-14T11:09:07.125 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-common. 2023-10-14T11:09:07.140 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../025-ceph-common_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:07.183 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-common (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:07.240 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librgw2. 2023-10-14T11:09:07.255 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../021-librgw2_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:07.298 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librgw2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:07.751 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rgw. 2023-10-14T11:09:07.765 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:07.801 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rgw (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:08.162 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liboath0:amd64. 2023-10-14T11:09:08.177 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-10-14T11:09:08.220 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-10-14T11:09:08.297 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-base. 2023-10-14T11:09:08.313 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../026-ceph-base_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:08.365 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-base (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:08.554 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libradosstriper1. 2023-10-14T11:09:08.569 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:08.615 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libradosstriper1 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:08.985 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-common. 2023-10-14T11:09:09.000 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../025-ceph-common_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:09.035 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-common (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:09.051 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-10-14T11:09:09.066 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-10-14T11:09:09.101 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-10-14T11:09:09.396 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-cheroot. 2023-10-14T11:09:09.411 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-10-14T11:09:09.454 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-14T11:09:09.782 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-10-14T11:09:09.798 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-10-14T11:09:09.857 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-10-14T11:09:10.157 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-base. 2023-10-14T11:09:10.160 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-jaraco.text. 2023-10-14T11:09:10.172 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../026-ceph-base_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:10.178 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-10-14T11:09:10.218 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-10-14T11:09:10.225 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-base (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:10.521 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-10-14T11:09:10.537 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-10-14T11:09:10.571 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-10-14T11:09:10.882 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-tempora. 2023-10-14T11:09:10.898 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-10-14T11:09:10.937 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-10-14T11:09:10.940 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-10-14T11:09:10.951 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-10-14T11:09:10.986 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-10-14T11:09:11.226 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-portend. 2023-10-14T11:09:11.242 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-10-14T11:09:11.273 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cheroot. 2023-10-14T11:09:11.285 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-10-14T11:09:11.287 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-10-14T11:09:11.331 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-14T11:09:11.571 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-10-14T11:09:11.587 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-10-14T11:09:11.637 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-10-14T11:09:11.684 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-10-14T11:09:11.699 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-10-14T11:09:11.742 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-10-14T11:09:11.941 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-14T11:09:11.956 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-10-14T11:09:11.999 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-10-14T11:09:12.070 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.text. 2023-10-14T11:09:12.085 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-10-14T11:09:12.129 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-10-14T11:09:12.319 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-natsort. 2023-10-14T11:09:12.334 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-10-14T11:09:12.377 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-10-14T11:09:12.398 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-10-14T11:09:12.413 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-10-14T11:09:12.448 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-10-14T11:09:12.697 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-logutils. 2023-10-14T11:09:12.712 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-10-14T11:09:12.756 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-10-14T11:09:12.776 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-tempora. 2023-10-14T11:09:12.791 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-10-14T11:09:12.834 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-10-14T11:09:13.074 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-14T11:09:13.090 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-10-14T11:09:13.124 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-10-14T11:09:13.162 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-portend. 2023-10-14T11:09:13.177 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-10-14T11:09:13.220 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-10-14T11:09:13.394 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-mako. 2023-10-14T11:09:13.409 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-10-14T11:09:13.452 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-14T11:09:13.532 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-10-14T11:09:13.547 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-10-14T11:09:13.590 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-10-14T11:09:13.901 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-14T11:09:13.916 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-10-14T11:09:13.959 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-10-14T11:09:13.998 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-14T11:09:14.013 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-14T11:09:14.055 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-14T11:09:14.321 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-natsort. 2023-10-14T11:09:14.336 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-10-14T11:09:14.350 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-14T11:09:14.365 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-10-14T11:09:14.371 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-10-14T11:09:14.408 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-10-14T11:09:14.632 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-logutils. 2023-10-14T11:09:14.647 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-10-14T11:09:14.682 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-10-14T11:09:14.702 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-webob. 2023-10-14T11:09:14.718 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-10-14T11:09:14.761 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-10-14T11:09:15.002 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-14T11:09:15.017 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-10-14T11:09:15.060 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-10-14T11:09:15.130 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-waitress. 2023-10-14T11:09:15.146 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-10-14T11:09:15.192 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-14T11:09:15.363 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-mako. 2023-10-14T11:09:15.378 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-10-14T11:09:15.421 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-14T11:09:15.500 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-tempita. 2023-10-14T11:09:15.515 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-10-14T11:09:15.558 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-10-14T11:09:15.750 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-14T11:09:15.765 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-14T11:09:15.808 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-14T11:09:15.886 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-paste. 2023-10-14T11:09:15.902 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-10-14T11:09:15.944 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-10-14T11:09:16.119 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-14T11:09:16.134 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-10-14T11:09:16.169 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-10-14T11:09:16.265 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-14T11:09:16.280 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-10-14T11:09:16.322 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-10-14T11:09:16.455 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-webob. 2023-10-14T11:09:16.471 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-10-14T11:09:16.513 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-10-14T11:09:16.642 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-14T11:09:16.657 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-10-14T11:09:16.708 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-10-14T11:09:16.900 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-waitress. 2023-10-14T11:09:16.915 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-10-14T11:09:16.961 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-14T11:09:17.012 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-webtest. 2023-10-14T11:09:17.027 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-10-14T11:09:17.070 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-10-14T11:09:17.295 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-tempita. 2023-10-14T11:09:17.309 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-10-14T11:09:17.353 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-10-14T11:09:17.389 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pecan. 2023-10-14T11:09:17.405 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-10-14T11:09:17.448 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-10-14T11:09:17.656 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-paste. 2023-10-14T11:09:17.671 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-10-14T11:09:17.714 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-10-14T11:09:17.794 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-certifi. 2023-10-14T11:09:17.809 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-10-14T11:09:17.885 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-10-14T11:09:18.067 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-14T11:09:18.081 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-10-14T11:09:18.117 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-10-14T11:09:18.214 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-idna. 2023-10-14T11:09:18.229 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-10-14T11:09:18.272 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-idna (3.3-1) ... 2023-10-14T11:09:18.453 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-14T11:09:18.469 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-10-14T11:09:18.511 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-10-14T11:09:19.342 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-urllib3. 2023-10-14T11:09:19.358 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-10-14T11:09:19.391 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-10-14T11:09:19.581 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-webtest. 2023-10-14T11:09:19.596 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-10-14T11:09:19.639 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-10-14T11:09:19.644 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-requests. 2023-10-14T11:09:19.660 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-10-14T11:09:19.694 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-14T11:09:19.989 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-14T11:09:19.992 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pecan. 2023-10-14T11:09:20.005 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-10-14T11:09:20.007 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-10-14T11:09:20.047 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-14T11:09:20.051 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-10-14T11:09:20.350 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-14T11:09:20.366 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T11:09:20.409 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:20.439 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-certifi. 2023-10-14T11:09:20.453 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-10-14T11:09:20.489 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-10-14T11:09:20.792 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-idna. 2023-10-14T11:09:20.805 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-14T11:09:20.806 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-10-14T11:09:20.820 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:20.850 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-idna (3.3-1) ... 2023-10-14T11:09:20.863 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:21.174 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-openssl. 2023-10-14T11:09:21.178 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-urllib3. 2023-10-14T11:09:21.190 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-10-14T11:09:21.193 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-10-14T11:09:21.236 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-10-14T11:09:21.266 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-10-14T11:09:21.573 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-requests. 2023-10-14T11:09:21.587 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-10-14T11:09:21.602 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr. 2023-10-14T11:09:21.618 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:21.631 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-14T11:09:21.660 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:21.942 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-14T11:09:21.956 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-10-14T11:09:22.000 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-14T11:09:22.056 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mon. 2023-10-14T11:09:22.071 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:22.114 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mon (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:22.312 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-14T11:09:22.326 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T11:09:22.370 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:22.750 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-14T11:09:22.764 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:22.808 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:22.851 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-osd. 2023-10-14T11:09:22.866 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:22.900 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-osd (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:23.102 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-openssl. 2023-10-14T11:09:23.116 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-10-14T11:09:23.161 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-10-14T11:09:23.522 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr. 2023-10-14T11:09:23.536 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:23.580 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:23.975 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mon. 2023-10-14T11:09:23.989 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:24.025 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mon (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:24.195 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph. 2023-10-14T11:09:24.211 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../061-ceph_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:24.253 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:24.573 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-fuse. 2023-10-14T11:09:24.589 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:24.631 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-fuse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:24.846 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-osd. 2023-10-14T11:09:24.860 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:24.905 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-osd (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:24.985 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mds. 2023-10-14T11:09:25.000 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:25.043 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mds (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:25.413 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package cephadm. 2023-10-14T11:09:25.428 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../064-cephadm_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:25.471 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking cephadm (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:25.791 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-14T11:09:25.806 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-10-14T11:09:25.849 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-10-14T11:09:26.160 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python-babel-localedata. 2023-10-14T11:09:26.165 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph. 2023-10-14T11:09:26.175 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-10-14T11:09:26.180 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../061-ceph_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:26.215 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:26.218 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-14T11:09:26.552 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-fuse. 2023-10-14T11:09:26.566 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:26.610 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-fuse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:26.988 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mds. 2023-10-14T11:09:27.002 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:27.046 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mds (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:27.231 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-babel. 2023-10-14T11:09:27.246 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-10-14T11:09:27.289 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-10-14T11:09:27.416 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephadm. 2023-10-14T11:09:27.430 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../064-cephadm_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:27.491 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephadm (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:27.626 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-jinja2. 2023-10-14T11:09:27.640 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-10-14T11:09:27.684 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-10-14T11:09:27.779 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-14T11:09:27.794 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-10-14T11:09:27.837 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-10-14T11:09:28.054 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-14T11:09:28.070 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T11:09:28.112 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:28.174 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python-babel-localedata. 2023-10-14T11:09:28.188 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-10-14T11:09:28.231 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-14T11:09:28.449 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-14T11:09:28.465 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-10-14T11:09:28.508 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-10-14T11:09:28.769 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-14T11:09:28.784 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-10-14T11:09:28.819 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-14T11:09:29.130 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-routes. 2023-10-14T11:09:29.146 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-10-14T11:09:29.197 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-10-14T11:09:29.220 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-babel. 2023-10-14T11:09:29.234 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-10-14T11:09:29.278 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-10-14T11:09:29.533 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-14T11:09:29.549 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T11:09:29.590 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jinja2. 2023-10-14T11:09:29.591 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:29.603 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-10-14T11:09:29.652 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-10-14T11:09:30.010 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-14T11:09:30.020 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-10-14T11:09:30.024 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T11:09:30.035 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-10-14T11:09:30.068 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:30.078 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-14T11:09:30.422 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-14T11:09:30.435 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-10-14T11:09:30.480 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-10-14T11:09:30.573 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-joblib. 2023-10-14T11:09:30.589 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-10-14T11:09:30.631 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-10-14T11:09:30.782 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-14T11:09:30.796 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-10-14T11:09:30.841 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-14T11:09:31.010 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-10-14T11:09:31.026 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-10-14T11:09:31.068 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-10-14T11:09:31.160 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-routes. 2023-10-14T11:09:31.174 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-10-14T11:09:31.210 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-10-14T11:09:31.354 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-sklearn. 2023-10-14T11:09:31.370 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-10-14T11:09:31.413 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-14T11:09:31.530 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-14T11:09:31.544 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T11:09:31.589 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:31.967 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-10-14T11:09:31.980 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-10-14T11:09:32.025 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-14T11:09:32.079 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-14T11:09:32.094 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T11:09:32.129 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:32.521 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-joblib. 2023-10-14T11:09:32.534 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-10-14T11:09:32.571 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-10-14T11:09:32.958 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-10-14T11:09:32.971 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-10-14T11:09:33.016 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-10-14T11:09:33.058 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-cachetools. 2023-10-14T11:09:33.074 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-10-14T11:09:33.116 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-10-14T11:09:33.318 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-sklearn. 2023-10-14T11:09:33.332 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-10-14T11:09:33.377 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-14T11:09:33.402 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-14T11:09:33.418 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-10-14T11:09:33.460 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-10-14T11:09:33.788 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-14T11:09:33.805 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-10-14T11:09:33.872 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-10-14T11:09:34.019 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-14T11:09:34.033 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T11:09:34.077 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:34.166 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-rsa. 2023-10-14T11:09:34.182 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-10-14T11:09:34.224 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-rsa (4.8-1) ... 2023-10-14T11:09:34.872 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-google-auth. 2023-10-14T11:09:34.888 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-10-14T11:09:34.939 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-10-14T11:09:35.234 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-14T11:09:35.248 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cachetools. 2023-10-14T11:09:35.249 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-10-14T11:09:35.263 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-10-14T11:09:35.292 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-14T11:09:35.306 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-10-14T11:09:35.586 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-websocket. 2023-10-14T11:09:35.602 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-10-14T11:09:35.609 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-14T11:09:35.624 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-10-14T11:09:35.644 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-10-14T11:09:35.659 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-10-14T11:09:35.953 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-14T11:09:35.967 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-14T11:09:35.968 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-10-14T11:09:35.983 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-10-14T11:09:36.012 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-10-14T11:09:36.025 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-14T11:09:36.465 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rsa. 2023-10-14T11:09:36.479 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-10-14T11:09:36.523 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rsa (4.8-1) ... 2023-10-14T11:09:36.664 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-14T11:09:36.678 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T11:09:36.722 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:36.953 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-google-auth. 2023-10-14T11:09:36.968 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-10-14T11:09:37.011 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-10-14T11:09:37.100 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-14T11:09:37.114 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-10-14T11:09:37.149 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-14T11:09:37.357 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-14T11:09:37.372 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-10-14T11:09:37.415 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-14T11:09:37.552 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-14T11:09:37.568 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-10-14T11:09:37.611 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-14T11:09:37.726 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-websocket. 2023-10-14T11:09:37.741 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-10-14T11:09:37.784 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-10-14T11:09:37.897 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package jq. 2023-10-14T11:09:37.912 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-10-14T11:09:37.955 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-10-14T11:09:38.121 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-14T11:09:38.137 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-10-14T11:09:38.187 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-14T11:09:38.207 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package socat. 2023-10-14T11:09:38.223 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-10-14T11:09:38.274 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-10-14T11:09:38.561 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package xmlstarlet. 2023-10-14T11:09:38.577 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-10-14T11:09:38.610 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-10-14T11:09:38.876 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-14T11:09:38.890 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T11:09:38.934 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:38.965 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-test. 2023-10-14T11:09:38.980 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../093-ceph-test_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:39.023 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-test (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:39.287 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-14T11:09:39.301 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-10-14T11:09:39.354 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-14T11:09:39.732 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-14T11:09:39.746 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-10-14T11:09:39.790 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-14T11:09:40.051 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package jq. 2023-10-14T11:09:40.065 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-10-14T11:09:40.135 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-10-14T11:09:40.362 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package socat. 2023-10-14T11:09:40.376 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-10-14T11:09:40.420 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-10-14T11:09:40.741 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package xmlstarlet. 2023-10-14T11:09:40.755 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-10-14T11:09:40.799 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-10-14T11:09:40.969 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-volume. 2023-10-14T11:09:40.985 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T11:09:41.018 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-volume (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:41.119 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-test. 2023-10-14T11:09:41.133 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../093-ceph-test_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:41.178 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-test (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:41.381 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-14T11:09:41.397 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:41.431 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking cephfs-mirror (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:41.734 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-colorama. 2023-10-14T11:09:41.750 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-10-14T11:09:41.800 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-10-14T11:09:42.086 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package cephfs-shell. 2023-10-14T11:09:42.102 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T11:09:42.145 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking cephfs-shell (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:42.406 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package cephfs-top. 2023-10-14T11:09:42.422 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T11:09:42.464 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking cephfs-top (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:42.708 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-14T11:09:42.724 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:42.767 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libcephfs-dev (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:43.049 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-volume. 2023-10-14T11:09:43.064 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T11:09:43.107 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-volume (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:43.162 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package nvme-cli. 2023-10-14T11:09:43.177 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-10-14T11:09:43.219 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-10-14T11:09:43.511 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-14T11:09:43.526 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:43.558 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-14T11:09:43.569 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephfs-mirror (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:43.574 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-10-14T11:09:43.624 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-10-14T11:09:43.923 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-colorama. 2023-10-14T11:09:43.938 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-10-14T11:09:43.981 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-10-14T11:09:44.069 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-iniconfig. 2023-10-14T11:09:44.085 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-10-14T11:09:44.119 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-10-14T11:09:44.242 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephfs-shell. 2023-10-14T11:09:44.257 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T11:09:44.300 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephfs-shell (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:44.405 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pastescript. 2023-10-14T11:09:44.421 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-10-14T11:09:44.463 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-14T11:09:44.544 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephfs-top. 2023-10-14T11:09:44.560 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T11:09:44.603 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephfs-top (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:44.775 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pluggy. 2023-10-14T11:09:44.791 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-10-14T11:09:44.833 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-10-14T11:09:44.881 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-14T11:09:44.897 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:44.939 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libcephfs-dev (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:45.170 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-psutil. 2023-10-14T11:09:45.185 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-10-14T11:09:45.232 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-10-14T11:09:45.351 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package nvme-cli. 2023-10-14T11:09:45.365 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-10-14T11:09:45.409 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-10-14T11:09:45.572 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-py. 2023-10-14T11:09:45.589 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-10-14T11:09:45.630 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-py (1.10.0-1) ... 2023-10-14T11:09:45.772 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-14T11:09:45.786 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-10-14T11:09:45.822 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-10-14T11:09:45.967 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pygments. 2023-10-14T11:09:45.983 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-10-14T11:09:46.025 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-10-14T11:09:46.350 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-iniconfig. 2023-10-14T11:09:46.364 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-10-14T11:09:46.400 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-10-14T11:09:46.479 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-14T11:09:46.495 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-10-14T11:09:46.562 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-10-14T11:09:46.669 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pastescript. 2023-10-14T11:09:46.683 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-10-14T11:09:46.727 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-14T11:09:46.840 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-toml. 2023-10-14T11:09:46.856 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-10-14T11:09:46.923 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-10-14T11:09:47.072 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pluggy. 2023-10-14T11:09:47.087 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-10-14T11:09:47.130 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-10-14T11:09:47.218 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pytest. 2023-10-14T11:09:47.234 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-10-14T11:09:47.276 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-10-14T11:09:47.459 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-psutil. 2023-10-14T11:09:47.473 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-10-14T11:09:47.517 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-10-14T11:09:47.571 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-simplejson. 2023-10-14T11:09:47.587 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-10-14T11:09:47.621 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-10-14T11:09:47.836 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-py. 2023-10-14T11:09:47.851 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-10-14T11:09:47.894 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-py (1.10.0-1) ... 2023-10-14T11:09:47.918 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-14T11:09:47.934 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-10-14T11:09:47.973 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-10-14T11:09:48.248 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pygments. 2023-10-14T11:09:48.262 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-10-14T11:09:48.306 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-10-14T11:09:48.669 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package radosgw. 2023-10-14T11:09:48.684 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../113-radosgw_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:48.727 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking radosgw (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:48.785 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-14T11:09:48.800 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-10-14T11:09:48.844 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-10-14T11:09:49.163 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-toml. 2023-10-14T11:09:49.177 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-10-14T11:09:49.213 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-10-14T11:09:49.305 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package rbd-fuse. 2023-10-14T11:09:49.320 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:49.363 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking rbd-fuse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:49.491 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pytest. 2023-10-14T11:09:49.505 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-10-14T11:09:49.549 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-10-14T11:09:49.639 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-10-14T11:09:49.911 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-simplejson. 2023-10-14T11:09:49.925 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-10-14T11:09:49.969 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-10-14T11:09:50.193 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-14T11:09:50.271 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-14T11:09:50.286 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-10-14T11:09:50.319 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-10-14T11:09:50.322 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-10-14T11:09:50.588 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-10-14T11:09:50.995 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-10-14T11:09:51.017 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package radosgw. 2023-10-14T11:09:51.031 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../113-radosgw_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:51.067 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking radosgw (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:51.606 INFO:teuthology.orchestra.run.smithi026.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-10-14T11:09:51.687 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package rbd-fuse. 2023-10-14T11:09:51.687 INFO:teuthology.orchestra.run.smithi026.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-10-14T11:09:51.701 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T11:09:51.729 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up cephadm (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:51.745 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking rbd-fuse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:52.072 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-10-14T11:09:52.291 INFO:teuthology.orchestra.run.smithi026.stdout:Adding system user cephadm....done 2023-10-14T11:09:52.342 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-14T11:09:52.451 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-10-14T11:09:52.452 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-14T11:09:52.731 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-10-14T11:09:52.737 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-10-14T11:09:53.096 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-10-14T11:09:53.124 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-10-14T11:09:53.205 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-10-14T11:09:53.481 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-14T11:09:53.728 INFO:teuthology.orchestra.run.smithi110.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-10-14T11:09:53.749 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-10-14T11:09:53.773 INFO:teuthology.orchestra.run.smithi110.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-10-14T11:09:53.820 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephadm (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:53.876 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-py (1.10.0-1) ... 2023-10-14T11:09:54.228 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-10-14T11:09:54.365 INFO:teuthology.orchestra.run.smithi110.stdout:Adding system user cephadm....done 2023-10-14T11:09:54.517 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-14T11:09:54.604 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-10-14T11:09:54.793 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-10-14T11:09:54.972 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-10-14T11:09:55.078 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-10-14T11:09:55.204 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-10-14T11:09:55.240 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-10-14T11:09:55.497 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-14T11:09:55.508 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-10-14T11:09:55.765 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-10-14T11:09:55.784 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-10-14T11:09:55.891 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-py (1.10.0-1) ... 2023-10-14T11:09:56.177 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-10-14T11:09:56.201 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-10-14T11:09:56.444 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-ceph-argparse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:56.578 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-10-14T11:09:56.704 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-14T11:09:56.830 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-10-14T11:09:56.871 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-10-14T11:09:57.097 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-10-14T11:09:57.139 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-10-14T11:09:57.365 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-14T11:09:57.440 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-10-14T11:09:57.499 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-10-14T11:09:57.699 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-10-14T11:09:57.884 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-14T11:09:58.043 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-10-14T11:09:58.076 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-10-14T11:09:58.318 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-ceph-argparse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:09:58.328 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-10-14T11:09:58.587 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-10-14T11:09:58.611 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-14T11:09:58.737 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-10-14T11:09:58.896 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-10-14T11:09:59.005 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-10-14T11:09:59.273 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-14T11:09:59.406 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-10-14T11:09:59.640 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-10-14T11:09:59.767 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-14T11:09:59.884 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-10-14T11:09:59.942 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-10-14T11:10:00.068 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-10-14T11:10:00.153 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-10-14T11:10:00.194 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-14T11:10:00.421 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-10-14T11:10:00.519 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-10-14T11:10:00.746 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-10-14T11:10:00.946 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-10-14T11:10:01.205 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-10-14T11:10:01.449 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-10-14T11:10:01.590 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-14T11:10:01.716 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-10-14T11:10:01.875 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-10-14T11:10:01.941 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-10-14T11:10:01.976 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-14T11:10:02.267 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-14T11:10:02.277 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-10-14T11:10:02.627 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-10-14T11:10:02.679 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-10-14T11:10:02.916 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-10-14T11:10:02.938 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-10-14T11:10:03.020 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-ceph-common (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:03.313 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-idna (3.3-1) ... 2023-10-14T11:10:03.365 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-14T11:10:03.656 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-14T11:10:03.666 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-10-14T11:10:03.975 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-14T11:10:04.310 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-10-14T11:10:04.578 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-10-14T11:10:04.737 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-ceph-common (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:04.937 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T11:10:05.038 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-idna (3.3-1) ... 2023-10-14T11:10:05.046 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-toml (0.10.2-1) ... 2023-10-14T11:10:05.340 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-14T11:10:05.448 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-10-14T11:10:05.556 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-14T11:10:05.582 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-10-14T11:10:05.917 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-10-14T11:10:06.235 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-10-14T11:10:06.503 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T11:10:06.629 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-14T11:10:06.755 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-10-14T11:10:06.778 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T11:10:06.913 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-toml (0.10.2-1) ... 2023-10-14T11:10:07.073 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-10-14T11:10:07.189 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-14T11:10:07.315 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-10-14T11:10:07.332 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-10-14T11:10:07.441 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-10-14T11:10:07.617 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-10-14T11:10:07.726 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-10-14T11:10:07.901 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-14T11:10:07.994 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-10-14T11:10:08.177 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-10-14T11:10:08.286 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T11:10:08.412 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-14T11:10:08.454 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-14T11:10:08.547 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-10-14T11:10:08.579 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-10-14T11:10:08.873 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-10-14T11:10:08.913 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-14T11:10:09.014 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-14T11:10:09.150 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-10-14T11:10:09.308 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-10-14T11:10:09.434 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-10-14T11:10:09.625 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-10-14T11:10:09.693 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-14T11:10:09.924 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-10-14T11:10:09.953 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-10-14T11:10:10.254 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-14T11:10:10.354 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-10-14T11:10:10.397 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-10-14T11:10:10.690 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-14T11:10:10.737 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-14T11:10:10.815 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-14T11:10:10.863 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-10-14T11:10:11.134 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-10-14T11:10:11.315 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-10-14T11:10:11.426 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-10-14T11:10:11.591 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-portend (3.0.0-1) ... 2023-10-14T11:10:11.719 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-10-14T11:10:11.859 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T11:10:12.010 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-10-14T11:10:12.145 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-10-14T11:10:12.344 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-10-14T11:10:12.389 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-14T11:10:12.514 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-10-14T11:10:12.662 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-14T11:10:12.916 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-10-14T11:10:12.972 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-10-14T11:10:13.073 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-rsa (4.8-1) ... 2023-10-14T11:10:13.176 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-portend (3.0.0-1) ... 2023-10-14T11:10:13.349 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-10-14T11:10:13.460 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T11:10:13.586 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-10-14T11:10:13.633 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-14T11:10:13.909 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-10-14T11:10:13.912 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-10-14T11:10:14.266 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-14T11:10:14.327 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-14T11:10:14.542 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-10-14T11:10:14.620 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-10-14T11:10:14.675 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rsa (4.8-1) ... 2023-10-14T11:10:14.944 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-10-14T11:10:15.006 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-14T11:10:15.123 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up librados2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:15.228 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-14T11:10:15.249 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up librgw2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:15.461 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:15.496 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-10-14T11:10:15.587 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libcephfs2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:15.713 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libradosstriper1 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:15.831 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-10-14T11:10:15.880 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-14T11:10:16.133 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up librbd1 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:16.182 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-10-14T11:10:16.258 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr-modules-core (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:16.384 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-fuse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:16.534 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-14T11:10:16.596 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-14T11:10:16.596 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-14T11:10:16.643 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librados2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:16.769 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librgw2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:16.988 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:17.114 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libcephfs2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:17.219 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libcephfs-dev (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:17.241 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libradosstriper1 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:17.320 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-rados (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:17.367 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-10-14T11:10:17.429 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up cephfs-top (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:17.555 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-14T11:10:17.635 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librbd1 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:17.761 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-modules-core (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:17.887 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-fuse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:18.095 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-14T11:10:18.096 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-14T11:10:18.713 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libcephfs-dev (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:18.839 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rados (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:18.902 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-rbd (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:18.965 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephfs-top (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:19.053 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up rbd-fuse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:19.091 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-14T11:10:19.154 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-rgw (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:19.280 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-cephfs (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:19.406 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up cephfs-shell (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:19.532 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-common (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:20.086 INFO:teuthology.orchestra.run.smithi026.stdout:Adding group ceph....done 2023-10-14T11:10:20.388 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rbd (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:20.453 INFO:teuthology.orchestra.run.smithi026.stdout:Adding system user ceph....done 2023-10-14T11:10:20.513 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up rbd-fuse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:20.623 INFO:teuthology.orchestra.run.smithi026.stdout:Setting system user ceph properties....done 2023-10-14T11:10:20.639 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rgw (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:20.641 INFO:teuthology.orchestra.run.smithi026.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-14T11:10:20.765 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cephfs (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:20.792 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-14T11:10:20.883 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephfs-shell (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:21.017 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-common (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:21.209 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-14T11:10:21.588 INFO:teuthology.orchestra.run.smithi110.stdout:Adding group ceph....done 2023-10-14T11:10:21.875 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up cephfs-mirror (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:21.971 INFO:teuthology.orchestra.run.smithi110.stdout:Adding system user ceph....done 2023-10-14T11:10:22.115 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-14T11:10:22.116 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-14T11:10:22.182 INFO:teuthology.orchestra.run.smithi110.stdout:Setting system user ceph properties....done 2023-10-14T11:10:22.197 INFO:teuthology.orchestra.run.smithi110.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-14T11:10:22.337 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-14T11:10:22.709 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-test (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:22.719 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-14T11:10:22.836 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up radosgw (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:23.385 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephfs-mirror (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:23.407 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-14T11:10:23.407 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-14T11:10:23.592 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-14T11:10:23.593 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-14T11:10:24.037 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-base (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:24.261 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-test (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:24.410 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-14T11:10:24.412 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up radosgw (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:24.981 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-14T11:10:24.982 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-14T11:10:25.089 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mds (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:25.328 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-14T11:10:25.329 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-14T11:10:25.956 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-base (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:26.001 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:26.282 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-14T11:10:26.283 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-14T11:10:26.546 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-14T11:10:26.935 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-osd (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:27.194 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mds (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:27.336 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-14T11:10:27.337 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-14T11:10:27.458 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-14T11:10:27.459 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-14T11:10:27.987 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:28.095 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:28.096 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:28.222 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mon (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:28.307 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-14T11:10:28.308 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-14T11:10:28.438 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-14T11:10:28.438 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-14T11:10:28.938 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-osd (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:29.059 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr-cephadm (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:29.201 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:29.271 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-14T11:10:29.271 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-14T11:10:29.327 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr-dashboard (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:29.470 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-volume (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:29.831 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-14T11:10:29.907 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:30.041 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:30.184 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mon (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:30.392 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-14T11:10:30.392 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-14T11:10:30.553 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-14T11:10:31.019 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-cephadm (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:31.062 INFO:teuthology.orchestra.run.smithi026.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-14T11:10:31.067 DEBUG:teuthology.orchestra.run.smithi026:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-14T11:10:31.155 INFO:teuthology.orchestra.run.smithi026.stdout:Reading package lists... 2023-10-14T11:10:31.321 INFO:teuthology.orchestra.run.smithi026.stdout:Building dependency tree... 2023-10-14T11:10:31.321 INFO:teuthology.orchestra.run.smithi026.stdout:Reading state information... 2023-10-14T11:10:31.432 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:31.472 INFO:teuthology.orchestra.run.smithi026.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-10-14T11:10:31.473 INFO:teuthology.orchestra.run.smithi026.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-10-14T11:10:31.473 INFO:teuthology.orchestra.run.smithi026.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-10-14T11:10:31.473 INFO:teuthology.orchestra.run.smithi026.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-10-14T11:10:31.473 INFO:teuthology.orchestra.run.smithi026.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-10-14T11:10:31.473 INFO:teuthology.orchestra.run.smithi026.stdout:The following packages were automatically installed and are no longer required: 2023-10-14T11:10:31.474 INFO:teuthology.orchestra.run.smithi026.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-14T11:10:31.474 INFO:teuthology.orchestra.run.smithi026.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-14T11:10:31.474 INFO:teuthology.orchestra.run.smithi026.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-14T11:10:31.475 INFO:teuthology.orchestra.run.smithi026.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-14T11:10:31.476 INFO:teuthology.orchestra.run.smithi026.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-14T11:10:31.476 INFO:teuthology.orchestra.run.smithi026.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-14T11:10:31.476 INFO:teuthology.orchestra.run.smithi026.stdout:The following additional packages will be installed: 2023-10-14T11:10:31.476 INFO:teuthology.orchestra.run.smithi026.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-10-14T11:10:31.477 INFO:teuthology.orchestra.run.smithi026.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-10-14T11:10:31.477 INFO:teuthology.orchestra.run.smithi026.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-10-14T11:10:31.477 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-10-14T11:10:31.477 INFO:teuthology.orchestra.run.smithi026.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-14T11:10:31.477 INFO:teuthology.orchestra.run.smithi026.stdout:Suggested packages: 2023-10-14T11:10:31.478 INFO:teuthology.orchestra.run.smithi026.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-10-14T11:10:31.478 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-10-14T11:10:31.478 INFO:teuthology.orchestra.run.smithi026.stdout: libengine-pkcs11-openssl 2023-10-14T11:10:31.527 INFO:teuthology.orchestra.run.smithi026.stdout:The following NEW packages will be installed: 2023-10-14T11:10:31.527 INFO:teuthology.orchestra.run.smithi026.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-10-14T11:10:31.528 INFO:teuthology.orchestra.run.smithi026.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-10-14T11:10:31.529 INFO:teuthology.orchestra.run.smithi026.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-10-14T11:10:31.529 INFO:teuthology.orchestra.run.smithi026.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-10-14T11:10:31.529 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-10-14T11:10:31.529 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-10-14T11:10:31.529 INFO:teuthology.orchestra.run.smithi026.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-14T11:10:31.530 INFO:teuthology.orchestra.run.smithi026.stdout:The following packages will be upgraded: 2023-10-14T11:10:31.530 INFO:teuthology.orchestra.run.smithi026.stdout: libssl3 2023-10-14T11:10:31.558 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-dashboard (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:31.587 INFO:teuthology.orchestra.run.smithi026.stdout:1 upgraded, 39 newly installed, 0 to remove and 258 not upgraded. 2023-10-14T11:10:31.587 INFO:teuthology.orchestra.run.smithi026.stdout:Need to get 54.6 MB of archives. 2023-10-14T11:10:31.587 INFO:teuthology.orchestra.run.smithi026.stdout:After this operation, 202 MB of additional disk space will be used. 2023-10-14T11:10:31.588 INFO:teuthology.orchestra.run.smithi026.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-10-14T11:10:31.687 INFO:teuthology.orchestra.run.smithi026.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-10-14T11:10:31.692 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-volume (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T11:10:31.743 INFO:teuthology.orchestra.run.smithi026.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-10-14T11:10:31.749 INFO:teuthology.orchestra.run.smithi026.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-10-14T11:10:31.749 INFO:teuthology.orchestra.run.smithi026.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-10-14T11:10:31.750 INFO:teuthology.orchestra.run.smithi026.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-10-14T11:10:31.752 INFO:teuthology.orchestra.run.smithi026.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-10-14T11:10:31.752 INFO:teuthology.orchestra.run.smithi026.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-10-14T11:10:31.753 INFO:teuthology.orchestra.run.smithi026.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-10-14T11:10:31.755 INFO:teuthology.orchestra.run.smithi026.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-10-14T11:10:31.755 INFO:teuthology.orchestra.run.smithi026.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-10-14T11:10:31.760 INFO:teuthology.orchestra.run.smithi026.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-10-14T11:10:31.772 INFO:teuthology.orchestra.run.smithi026.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-10-14T11:10:31.990 INFO:teuthology.orchestra.run.smithi026.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-10-14T11:10:31.992 INFO:teuthology.orchestra.run.smithi026.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-10-14T11:10:31.993 INFO:teuthology.orchestra.run.smithi026.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-10-14T11:10:31.996 INFO:teuthology.orchestra.run.smithi026.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-10-14T11:10:31.996 INFO:teuthology.orchestra.run.smithi026.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-10-14T11:10:32.000 INFO:teuthology.orchestra.run.smithi026.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-10-14T11:10:32.002 INFO:teuthology.orchestra.run.smithi026.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-10-14T11:10:32.009 INFO:teuthology.orchestra.run.smithi026.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-10-14T11:10:32.010 INFO:teuthology.orchestra.run.smithi026.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-10-14T11:10:32.031 INFO:teuthology.orchestra.run.smithi026.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-10-14T11:10:32.032 INFO:teuthology.orchestra.run.smithi026.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-10-14T11:10:32.036 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-14T11:10:32.042 INFO:teuthology.orchestra.run.smithi026.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-10-14T11:10:32.063 INFO:teuthology.orchestra.run.smithi026.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-10-14T11:10:32.066 INFO:teuthology.orchestra.run.smithi026.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-10-14T11:10:32.066 INFO:teuthology.orchestra.run.smithi026.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-10-14T11:10:32.067 INFO:teuthology.orchestra.run.smithi026.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-10-14T11:10:32.067 INFO:teuthology.orchestra.run.smithi026.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-10-14T11:10:32.079 INFO:teuthology.orchestra.run.smithi026.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-10-14T11:10:32.081 INFO:teuthology.orchestra.run.smithi026.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-10-14T11:10:32.232 INFO:teuthology.orchestra.run.smithi026.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-10-14T11:10:32.232 INFO:teuthology.orchestra.run.smithi026.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-10-14T11:10:32.233 INFO:teuthology.orchestra.run.smithi026.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-10-14T11:10:32.233 INFO:teuthology.orchestra.run.smithi026.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-10-14T11:10:32.233 INFO:teuthology.orchestra.run.smithi026.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-10-14T11:10:32.234 INFO:teuthology.orchestra.run.smithi026.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-10-14T11:10:32.243 INFO:teuthology.orchestra.run.smithi026.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-10-14T11:10:32.244 INFO:teuthology.orchestra.run.smithi026.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-10-14T11:10:32.639 INFO:teuthology.orchestra.run.smithi026.stdout:Preconfiguring packages ... 2023-10-14T11:10:32.792 INFO:teuthology.orchestra.run.smithi026.stdout:Fetched 54.6 MB in 1s (77.2 MB/s) 2023-10-14T11:10:32.827 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-14T11:10:32.955 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package flex. 2023-10-14T11:10:33.029 INFO:teuthology.orchestra.run.smithi026.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139851 files and directories currently installed.) 2023-10-14T11:10:33.033 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-10-14T11:10:33.071 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking flex (2.6.4-8build2) ... 2023-10-14T11:10:33.311 INFO:teuthology.orchestra.run.smithi110.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-14T11:10:33.315 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-14T11:10:33.391 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2023-10-14T11:10:33.562 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2023-10-14T11:10:33.563 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2023-10-14T11:10:33.590 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-14T11:10:33.712 INFO:teuthology.orchestra.run.smithi110.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-10-14T11:10:33.713 INFO:teuthology.orchestra.run.smithi110.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-10-14T11:10:33.713 INFO:teuthology.orchestra.run.smithi110.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-10-14T11:10:33.713 INFO:teuthology.orchestra.run.smithi110.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-10-14T11:10:33.713 INFO:teuthology.orchestra.run.smithi110.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-10-14T11:10:33.713 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2023-10-14T11:10:33.714 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-14T11:10:33.714 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-14T11:10:33.714 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-14T11:10:33.714 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-14T11:10:33.716 INFO:teuthology.orchestra.run.smithi110.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-14T11:10:33.716 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-14T11:10:33.716 INFO:teuthology.orchestra.run.smithi110.stdout:The following additional packages will be installed: 2023-10-14T11:10:33.716 INFO:teuthology.orchestra.run.smithi110.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-10-14T11:10:33.716 INFO:teuthology.orchestra.run.smithi110.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-10-14T11:10:33.717 INFO:teuthology.orchestra.run.smithi110.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-10-14T11:10:33.717 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-10-14T11:10:33.717 INFO:teuthology.orchestra.run.smithi110.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-14T11:10:33.717 INFO:teuthology.orchestra.run.smithi110.stdout:Suggested packages: 2023-10-14T11:10:33.717 INFO:teuthology.orchestra.run.smithi110.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-10-14T11:10:33.717 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-10-14T11:10:33.718 INFO:teuthology.orchestra.run.smithi110.stdout: libengine-pkcs11-openssl 2023-10-14T11:10:33.759 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-10-14T11:10:33.764 INFO:teuthology.orchestra.run.smithi110.stdout:The following NEW packages will be installed: 2023-10-14T11:10:33.764 INFO:teuthology.orchestra.run.smithi110.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-10-14T11:10:33.765 INFO:teuthology.orchestra.run.smithi110.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-10-14T11:10:33.765 INFO:teuthology.orchestra.run.smithi110.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-10-14T11:10:33.766 INFO:teuthology.orchestra.run.smithi110.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-10-14T11:10:33.766 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-10-14T11:10:33.766 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-10-14T11:10:33.766 INFO:teuthology.orchestra.run.smithi110.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-14T11:10:33.767 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages will be upgraded: 2023-10-14T11:10:33.767 INFO:teuthology.orchestra.run.smithi110.stdout: libssl3 2023-10-14T11:10:33.825 INFO:teuthology.orchestra.run.smithi110.stdout:1 upgraded, 39 newly installed, 0 to remove and 258 not upgraded. 2023-10-14T11:10:33.825 INFO:teuthology.orchestra.run.smithi110.stdout:Need to get 54.6 MB of archives. 2023-10-14T11:10:33.825 INFO:teuthology.orchestra.run.smithi110.stdout:After this operation, 202 MB of additional disk space will be used. 2023-10-14T11:10:33.826 INFO:teuthology.orchestra.run.smithi110.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-10-14T11:10:33.948 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-10-14T11:10:34.017 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-10-14T11:10:34.029 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-10-14T11:10:34.030 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-10-14T11:10:34.031 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-10-14T11:10:34.033 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-10-14T11:10:34.033 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-10-14T11:10:34.035 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-10-14T11:10:34.035 INFO:teuthology.orchestra.run.smithi110.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-10-14T11:10:34.036 INFO:teuthology.orchestra.run.smithi110.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-10-14T11:10:34.040 INFO:teuthology.orchestra.run.smithi110.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-10-14T11:10:34.056 INFO:teuthology.orchestra.run.smithi110.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-10-14T11:10:34.167 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-14T11:10:34.378 INFO:teuthology.orchestra.run.smithi110.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-10-14T11:10:34.379 INFO:teuthology.orchestra.run.smithi110.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-10-14T11:10:34.380 INFO:teuthology.orchestra.run.smithi110.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-10-14T11:10:34.382 INFO:teuthology.orchestra.run.smithi110.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-10-14T11:10:34.383 INFO:teuthology.orchestra.run.smithi110.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-10-14T11:10:34.387 INFO:teuthology.orchestra.run.smithi110.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-10-14T11:10:34.389 INFO:teuthology.orchestra.run.smithi110.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-10-14T11:10:34.396 INFO:teuthology.orchestra.run.smithi110.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-10-14T11:10:34.396 INFO:teuthology.orchestra.run.smithi110.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-10-14T11:10:34.427 INFO:teuthology.orchestra.run.smithi110.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-10-14T11:10:34.429 INFO:teuthology.orchestra.run.smithi110.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-10-14T11:10:34.440 INFO:teuthology.orchestra.run.smithi110.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-10-14T11:10:34.467 INFO:teuthology.orchestra.run.smithi110.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-10-14T11:10:34.471 INFO:teuthology.orchestra.run.smithi110.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-10-14T11:10:34.471 INFO:teuthology.orchestra.run.smithi110.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-10-14T11:10:34.472 INFO:teuthology.orchestra.run.smithi110.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-10-14T11:10:34.472 INFO:teuthology.orchestra.run.smithi110.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-10-14T11:10:34.487 INFO:teuthology.orchestra.run.smithi110.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-10-14T11:10:34.497 INFO:teuthology.orchestra.run.smithi110.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-10-14T11:10:34.699 INFO:teuthology.orchestra.run.smithi110.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-10-14T11:10:34.699 INFO:teuthology.orchestra.run.smithi110.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-10-14T11:10:34.699 INFO:teuthology.orchestra.run.smithi110.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-10-14T11:10:34.699 INFO:teuthology.orchestra.run.smithi110.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-10-14T11:10:34.700 INFO:teuthology.orchestra.run.smithi110.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-10-14T11:10:34.700 INFO:teuthology.orchestra.run.smithi110.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-10-14T11:10:34.716 INFO:teuthology.orchestra.run.smithi110.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-10-14T11:10:34.716 INFO:teuthology.orchestra.run.smithi110.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-10-14T11:10:34.718 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package bison. 2023-10-14T11:10:34.792 INFO:teuthology.orchestra.run.smithi026.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139924 files and directories currently installed.) 2023-10-14T11:10:34.795 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-10-14T11:10:34.846 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-10-14T11:10:35.097 INFO:teuthology.orchestra.run.smithi110.stdout:Preconfiguring packages ... 2023-10-14T11:10:35.250 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 54.6 MB in 1s (58.0 MB/s) 2023-10-14T11:10:35.288 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-14T11:10:35.303 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-10-14T11:10:35.346 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-10-14T11:10:35.416 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package flex. 2023-10-14T11:10:35.488 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139851 files and directories currently installed.) 2023-10-14T11:10:35.492 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-10-14T11:10:35.540 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking flex (2.6.4-8build2) ... 2023-10-14T11:10:35.683 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package dump. 2023-10-14T11:10:35.698 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-10-14T11:10:35.741 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking dump (0.4b47-3) ... 2023-10-14T11:10:36.101 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-14T11:10:36.113 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package indent. 2023-10-14T11:10:36.129 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-10-14T11:10:36.162 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-14T11:10:36.254 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-10-14T11:10:36.399 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-14T11:10:36.414 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-10-14T11:10:36.457 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-14T11:10:36.676 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-14T11:10:36.794 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-14T11:10:36.810 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-10-14T11:10:36.852 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-14T11:10:37.105 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-14T11:10:37.121 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-10-14T11:10:37.155 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-10-14T11:10:37.229 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package bison. 2023-10-14T11:10:37.301 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139924 files and directories currently installed.) 2023-10-14T11:10:37.304 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-10-14T11:10:37.348 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-10-14T11:10:37.542 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libfl2:amd64. 2023-10-14T11:10:37.558 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-10-14T11:10:37.600 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-10-14T11:10:37.790 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-14T11:10:37.804 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-10-14T11:10:37.835 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-10-14T11:10:37.852 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-10-14T11:10:37.857 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-10-14T11:10:37.894 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-14T11:10:38.171 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libjson-perl. 2023-10-14T11:10:38.187 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-10-14T11:10:38.202 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package dump. 2023-10-14T11:10:38.216 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-10-14T11:10:38.230 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-10-14T11:10:38.285 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking dump (0.4b47-3) ... 2023-10-14T11:10:38.499 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libllvm14:amd64. 2023-10-14T11:10:38.515 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-10-14T11:10:38.549 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-14T11:10:38.572 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package indent. 2023-10-14T11:10:38.586 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-10-14T11:10:38.630 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-14T11:10:38.899 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-14T11:10:38.913 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-10-14T11:10:38.949 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-14T11:10:39.286 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-14T11:10:39.300 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-10-14T11:10:39.344 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-14T11:10:39.630 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-14T11:10:39.644 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-10-14T11:10:39.688 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-10-14T11:10:39.969 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-14T11:10:39.985 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-14T11:10:40.027 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-14T11:10:40.050 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libfl2:amd64. 2023-10-14T11:10:40.065 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-10-14T11:10:40.100 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-10-14T11:10:40.271 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-14T11:10:40.287 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-14T11:10:40.330 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-14T11:10:40.335 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-10-14T11:10:40.349 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-10-14T11:10:40.394 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-14T11:10:40.616 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-14T11:10:40.632 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-14T11:10:40.666 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-14T11:10:40.679 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libjson-perl. 2023-10-14T11:10:40.693 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-10-14T11:10:40.737 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-10-14T11:10:41.065 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libllvm14:amd64. 2023-10-14T11:10:41.079 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-10-14T11:10:41.124 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-14T11:10:41.361 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-14T11:10:41.377 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-10-14T11:10:41.419 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-14T11:10:41.747 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-14T11:10:41.763 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-10-14T11:10:41.805 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-14T11:10:42.158 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-14T11:10:42.174 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-14T11:10:42.216 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T11:10:42.468 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-14T11:10:42.484 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-14T11:10:42.518 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-14T11:10:42.536 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-14T11:10:42.553 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-14T11:10:42.594 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-14T11:10:42.787 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-14T11:10:42.803 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-14T11:10:42.845 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-14T11:10:42.863 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-14T11:10:42.879 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-14T11:10:42.921 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-14T11:10:43.165 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-14T11:10:43.180 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-14T11:10:43.199 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-14T11:10:43.215 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-14T11:10:43.223 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-14T11:10:43.257 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-14T11:10:43.593 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-14T11:10:43.608 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-10-14T11:10:43.651 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-14T11:10:43.736 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-14T11:10:43.752 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-10-14T11:10:43.785 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-10-14T11:10:43.986 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-14T11:10:44.002 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-10-14T11:10:44.045 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-14T11:10:44.138 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package modemmanager. 2023-10-14T11:10:44.155 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-14T11:10:44.197 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-14T11:10:44.339 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-14T11:10:44.354 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-14T11:10:44.397 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T11:10:44.775 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-14T11:10:44.791 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-14T11:10:44.819 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package network-manager. 2023-10-14T11:10:44.834 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-14T11:10:44.836 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-10-14T11:10:44.886 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-10-14T11:10:45.152 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-14T11:10:45.168 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-14T11:10:45.210 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-14T11:10:45.454 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-14T11:10:45.470 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-14T11:10:45.510 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ppp. 2023-10-14T11:10:45.513 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-14T11:10:45.526 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-10-14T11:10:45.853 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-10-14T11:10:46.024 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-14T11:10:46.039 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-10-14T11:10:46.082 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-10-14T11:10:46.214 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package pptp-linux. 2023-10-14T11:10:46.229 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-10-14T11:10:46.340 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-10-14T11:10:46.486 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package modemmanager. 2023-10-14T11:10:46.501 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-14T11:10:46.543 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-14T11:10:46.584 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-14T11:10:46.599 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-10-14T11:10:46.642 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-10-14T11:10:46.954 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-14T11:10:46.970 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-10-14T11:10:47.012 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-client-common (238) ... 2023-10-14T11:10:47.191 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package network-manager. 2023-10-14T11:10:47.206 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-10-14T11:10:47.257 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-10-14T11:10:47.333 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-client-14. 2023-10-14T11:10:47.349 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-14T11:10:47.391 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T11:10:47.906 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ppp. 2023-10-14T11:10:47.921 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-10-14T11:10:47.987 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-common. 2023-10-14T11:10:48.004 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-10-14T11:10:48.065 INFO:teuthology.orchestra.run.smithi026.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-14T11:10:48.095 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-common (238) ... 2023-10-14T11:10:48.257 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-10-14T11:10:48.553 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-14. 2023-10-14T11:10:48.570 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-14T11:10:48.602 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package pptp-linux. 2023-10-14T11:10:48.606 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T11:10:48.616 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-10-14T11:10:48.661 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-10-14T11:10:48.896 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-14T11:10:48.910 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-10-14T11:10:48.955 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-10-14T11:10:49.274 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-14T11:10:49.288 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-10-14T11:10:49.324 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-client-common (238) ... 2023-10-14T11:10:49.602 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-client-14. 2023-10-14T11:10:49.617 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-14T11:10:49.652 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T11:10:49.847 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql. 2023-10-14T11:10:49.863 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-10-14T11:10:49.906 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql (14+238) ... 2023-10-14T11:10:50.133 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-client. 2023-10-14T11:10:50.148 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-10-14T11:10:50.183 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-client (14+238) ... 2023-10-14T11:10:50.240 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-common. 2023-10-14T11:10:50.255 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-10-14T11:10:50.341 INFO:teuthology.orchestra.run.smithi110.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-14T11:10:50.372 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-common (238) ... 2023-10-14T11:10:50.418 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-14T11:10:50.433 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-10-14T11:10:50.485 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-contrib (14+238) ... 2023-10-14T11:10:50.804 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package tcl8.6. 2023-10-14T11:10:50.814 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-14. 2023-10-14T11:10:50.819 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-10-14T11:10:50.828 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-14T11:10:50.862 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-14T11:10:50.908 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T11:10:51.148 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package tcl. 2023-10-14T11:10:51.164 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-10-14T11:10:51.211 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-10-14T11:10:51.695 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package wpasupplicant. 2023-10-14T11:10:51.713 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-10-14T11:10:51.753 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-14T11:10:52.083 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql. 2023-10-14T11:10:52.098 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-10-14T11:10:52.099 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-14T11:10:52.117 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-10-14T11:10:52.157 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-10-14T11:10:52.164 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql (14+238) ... 2023-10-14T11:10:52.427 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-client. 2023-10-14T11:10:52.442 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-10-14T11:10:52.485 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-client (14+238) ... 2023-10-14T11:10:52.577 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-14T11:10:52.593 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-10-14T11:10:52.644 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-14T11:10:52.754 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-14T11:10:52.769 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-10-14T11:10:52.812 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-contrib (14+238) ... 2023-10-14T11:10:52.929 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-client-common (238) ... 2023-10-14T11:10:53.082 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package tcl8.6. 2023-10-14T11:10:53.097 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-10-14T11:10:53.131 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-14T11:10:53.141 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up flex (2.6.4-8build2) ... 2023-10-14T11:10:53.267 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-14T11:10:53.409 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T11:10:53.443 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package tcl. 2023-10-14T11:10:53.458 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-10-14T11:10:53.505 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-10-14T11:10:53.544 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-10-14T11:10:53.653 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-14T11:10:53.763 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T11:10:53.854 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package wpasupplicant. 2023-10-14T11:10:53.870 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-10-14T11:10:53.937 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-14T11:10:54.257 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-14T11:10:54.273 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-10-14T11:10:54.307 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-10-14T11:10:54.719 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-14T11:10:54.735 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-10-14T11:10:54.785 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-14T11:10:54.786 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-14T11:10:54.885 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-14T11:10:55.102 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-client-common (238) ... 2023-10-14T11:10:55.271 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-14T11:10:55.272 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-14T11:10:55.299 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up flex (2.6.4-8build2) ... 2023-10-14T11:10:55.417 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-14T11:10:55.551 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T11:10:55.702 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-10-14T11:10:55.829 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-14T11:10:55.946 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-10-14T11:10:55.963 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T11:10:56.064 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-14T11:10:56.182 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-10-14T11:10:56.358 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-10-14T11:10:56.509 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-10-14T11:10:56.634 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-14T11:10:56.761 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-10-14T11:10:56.971 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-14T11:10:57.130 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-14T11:10:57.466 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-14T11:10:57.504 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-14T11:10:57.504 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-14T11:10:57.592 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up dump (0.4b47-3) ... 2023-10-14T11:10:57.688 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-14T11:10:57.761 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-14T11:10:57.887 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-14T11:10:58.012 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up tcl (8.6.11+1build2) ... 2023-10-14T11:10:58.138 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libjson-perl (4.04000-1) ... 2023-10-14T11:10:58.188 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-10-14T11:10:58.264 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-10-14T11:10:58.314 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-14T11:10:58.371 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-10-14T11:10:58.440 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-10-14T11:10:58.441 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-14T11:10:58.567 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-14T11:10:58.582 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-10-14T11:10:58.700 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-10-14T11:10:58.745 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-14T11:10:58.801 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-14T11:10:58.869 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-14T11:10:58.927 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-10-14T11:10:58.995 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-10-14T11:10:59.163 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-client (14+238) ... 2023-10-14T11:10:59.289 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-10-14T11:10:59.741 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-14T11:10:59.858 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up dump (0.4b47-3) ... 2023-10-14T11:10:59.892 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:10:59.893 INFO:teuthology.orchestra.run.smithi026.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-14T11:10:59.893 INFO:teuthology.orchestra.run.smithi026.stdout:which means they are currently configured by ifupdown: 2023-10-14T11:10:59.893 INFO:teuthology.orchestra.run.smithi026.stdout:- ens1f0 2023-10-14T11:10:59.893 INFO:teuthology.orchestra.run.smithi026.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-14T11:10:59.893 INFO:teuthology.orchestra.run.smithi026.stdout:remove their configuration from /etc/network/interfaces. 2023-10-14T11:10:59.894 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:10:59.953 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-14T11:11:00.020 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-14T11:11:00.032 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-14T11:11:00.146 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-14T11:11:00.306 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up tcl (8.6.11+1build2) ... 2023-10-14T11:11:00.432 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libjson-perl (4.04000-1) ... 2023-10-14T11:11:00.442 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-14T11:11:00.558 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-10-14T11:11:00.648 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-10-14T11:11:00.718 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-14T11:11:00.855 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-14T11:11:00.878 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-14T11:11:01.062 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-14T11:11:01.188 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-14T11:11:01.314 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-10-14T11:11:01.507 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-client (14+238) ... 2023-10-14T11:11:01.558 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-14T11:11:01.633 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-10-14T11:11:02.035 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-14T11:11:02.162 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-10-14T11:11:02.213 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:02.213 INFO:teuthology.orchestra.run.smithi110.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-14T11:11:02.214 INFO:teuthology.orchestra.run.smithi110.stdout:which means they are currently configured by ifupdown: 2023-10-14T11:11:02.214 INFO:teuthology.orchestra.run.smithi110.stdout:- enp3s0f1 2023-10-14T11:11:02.214 INFO:teuthology.orchestra.run.smithi110.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-14T11:11:02.214 INFO:teuthology.orchestra.run.smithi110.stdout:remove their configuration from /etc/network/interfaces. 2023-10-14T11:11:02.215 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:02.287 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-common (238) ... 2023-10-14T11:11:02.345 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-14T11:11:02.739 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-14T11:11:03.145 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-14T11:11:03.244 INFO:teuthology.orchestra.run.smithi026.stdout:Adding user postgres to group ssl-cert 2023-10-14T11:11:03.537 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:03.537 INFO:teuthology.orchestra.run.smithi026.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-14T11:11:03.813 INFO:teuthology.orchestra.run.smithi026.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-14T11:11:03.814 INFO:teuthology.orchestra.run.smithi026.stdout:Removing obsolete dictionary files: 2023-10-14T11:11:03.844 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-14T11:11:03.987 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-14T11:11:04.114 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-10-14T11:11:04.239 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-common (238) ... 2023-10-14T11:11:04.536 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-14T11:11:05.030 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T11:11:05.210 INFO:teuthology.orchestra.run.smithi110.stdout:Adding user postgres to group ssl-cert 2023-10-14T11:11:05.378 INFO:teuthology.orchestra.run.smithi026.stdout:Creating new PostgreSQL cluster 14/main ... 2023-10-14T11:11:05.397 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-10-14T11:11:05.453 INFO:teuthology.orchestra.run.smithi026.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-14T11:11:05.453 INFO:teuthology.orchestra.run.smithi026.stdout:This user must also own the server process. 2023-10-14T11:11:05.453 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:05.453 INFO:teuthology.orchestra.run.smithi026.stdout:The database cluster will be initialized with locale "en_US". 2023-10-14T11:11:05.454 INFO:teuthology.orchestra.run.smithi026.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-14T11:11:05.454 INFO:teuthology.orchestra.run.smithi026.stdout:The default text search configuration will be set to "english". 2023-10-14T11:11:05.454 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:05.454 INFO:teuthology.orchestra.run.smithi026.stdout:Data page checksums are disabled. 2023-10-14T11:11:05.454 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:05.454 INFO:teuthology.orchestra.run.smithi026.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-10-14T11:11:05.455 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:05.455 INFO:teuthology.orchestra.run.smithi110.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-14T11:11:05.456 INFO:teuthology.orchestra.run.smithi026.stdout:creating subdirectories ... ok 2023-10-14T11:11:05.456 INFO:teuthology.orchestra.run.smithi026.stdout:selecting dynamic shared memory implementation ... posix 2023-10-14T11:11:05.479 INFO:teuthology.orchestra.run.smithi026.stdout:selecting default max_connections ... 100 2023-10-14T11:11:05.516 INFO:teuthology.orchestra.run.smithi026.stdout:selecting default shared_buffers ... 128MB 2023-10-14T11:11:05.530 INFO:teuthology.orchestra.run.smithi026.stdout:selecting default time zone ... Etc/UTC 2023-10-14T11:11:05.531 INFO:teuthology.orchestra.run.smithi026.stdout:creating configuration files ... ok 2023-10-14T11:11:05.709 INFO:teuthology.orchestra.run.smithi026.stdout:running bootstrap script ... ok 2023-10-14T11:11:05.720 INFO:teuthology.orchestra.run.smithi110.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-14T11:11:05.721 INFO:teuthology.orchestra.run.smithi110.stdout:Removing obsolete dictionary files: 2023-10-14T11:11:06.426 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-14T11:11:06.441 INFO:teuthology.orchestra.run.smithi026.stdout:performing post-bootstrap initialization ... ok 2023-10-14T11:11:06.958 INFO:teuthology.orchestra.run.smithi026.stdout:syncing data to disk ... ok 2023-10-14T11:11:07.025 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T11:11:07.353 INFO:teuthology.orchestra.run.smithi110.stdout:Creating new PostgreSQL cluster 14/main ... 2023-10-14T11:11:07.370 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-10-14T11:11:07.437 INFO:teuthology.orchestra.run.smithi110.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-14T11:11:07.437 INFO:teuthology.orchestra.run.smithi110.stdout:This user must also own the server process. 2023-10-14T11:11:07.438 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:07.438 INFO:teuthology.orchestra.run.smithi110.stdout:The database cluster will be initialized with locale "en_US". 2023-10-14T11:11:07.438 INFO:teuthology.orchestra.run.smithi110.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-14T11:11:07.438 INFO:teuthology.orchestra.run.smithi110.stdout:The default text search configuration will be set to "english". 2023-10-14T11:11:07.438 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:07.439 INFO:teuthology.orchestra.run.smithi110.stdout:Data page checksums are disabled. 2023-10-14T11:11:07.439 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:07.439 INFO:teuthology.orchestra.run.smithi110.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-10-14T11:11:07.440 INFO:teuthology.orchestra.run.smithi110.stdout:creating subdirectories ... ok 2023-10-14T11:11:07.440 INFO:teuthology.orchestra.run.smithi110.stdout:selecting dynamic shared memory implementation ... posix 2023-10-14T11:11:07.462 INFO:teuthology.orchestra.run.smithi110.stdout:selecting default max_connections ... 100 2023-10-14T11:11:07.499 INFO:teuthology.orchestra.run.smithi110.stdout:selecting default shared_buffers ... 128MB 2023-10-14T11:11:07.511 INFO:teuthology.orchestra.run.smithi110.stdout:selecting default time zone ... Etc/UTC 2023-10-14T11:11:07.513 INFO:teuthology.orchestra.run.smithi110.stdout:creating configuration files ... ok 2023-10-14T11:11:07.515 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-14T11:11:07.681 INFO:teuthology.orchestra.run.smithi110.stdout:running bootstrap script ... ok 2023-10-14T11:11:08.312 INFO:teuthology.orchestra.run.smithi110.stdout:performing post-bootstrap initialization ... ok 2023-10-14T11:11:08.846 INFO:teuthology.orchestra.run.smithi110.stdout:syncing data to disk ... ok 2023-10-14T11:11:09.380 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-14T11:11:10.595 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-14T11:11:10.721 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-contrib (14+238) ... 2023-10-14T11:11:10.839 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql (14+238) ... 2023-10-14T11:11:10.940 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-14T11:11:11.066 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-14T11:11:11.334 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-14T11:11:11.335 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-14T11:11:12.110 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-14T11:11:12.437 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-14T11:11:12.588 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-14T11:11:12.766 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-14T11:11:12.892 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-contrib (14+238) ... 2023-10-14T11:11:13.035 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql (14+238) ... 2023-10-14T11:11:13.161 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-14T11:11:13.304 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-14T11:11:13.556 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-14T11:11:13.556 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-14T11:11:14.282 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-10-14T11:11:14.323 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-14T11:11:14.383 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-10-14T11:11:14.658 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-14T11:11:14.809 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-14T11:11:15.085 INFO:teuthology.orchestra.run.smithi026.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-14T11:11:15.091 DEBUG:teuthology.parallel:result is None 2023-10-14T11:11:16.222 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-10-14T11:11:16.322 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-10-14T11:11:17.024 INFO:teuthology.orchestra.run.smithi110.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-14T11:11:17.028 DEBUG:teuthology.parallel:result is None 2023-10-14T11:11:17.029 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T11:11:17.277 DEBUG:teuthology.orchestra.run.smithi026:> dpkg-query -W -f '${Version}' ceph 2023-10-14T11:11:17.302 INFO:teuthology.orchestra.run.smithi026.stdout:18.0.0-6730-g4ba8a190-1jammy 2023-10-14T11:11:17.303 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730-g4ba8a190-1jammy 2023-10-14T11:11:17.303 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730-g4ba8a190-1jammy is installed. 2023-10-14T11:11:17.304 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T11:11:17.448 DEBUG:teuthology.orchestra.run.smithi110:> dpkg-query -W -f '${Version}' ceph 2023-10-14T11:11:17.471 INFO:teuthology.orchestra.run.smithi110.stdout:18.0.0-6730-g4ba8a190-1jammy 2023-10-14T11:11:17.471 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730-g4ba8a190-1jammy 2023-10-14T11:11:17.472 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730-g4ba8a190-1jammy is installed. 2023-10-14T11:11:17.472 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-14T11:11:17.473 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:17.473 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T11:11:17.497 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:11:17.497 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T11:11:17.535 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-14T11:11:17.535 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:17.536 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T11:11:17.562 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T11:11:17.626 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:11:17.627 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T11:11:17.647 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T11:11:17.714 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-14T11:11:17.715 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:17.715 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T11:11:17.738 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T11:11:17.806 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:11:17.807 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T11:11:17.827 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T11:11:17.894 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-14T11:11:17.895 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:17.895 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T11:11:17.918 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T11:11:17.983 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:11:17.983 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T11:11:18.004 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T11:11:18.066 INFO:teuthology.run_tasks:Running task ceph... 2023-10-14T11:11:18.134 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-14T11:11:18.135 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 777 /var/log/ceph 2023-10-14T11:11:18.141 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /var/log/ceph 2023-10-14T11:11:18.162 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-14T11:11:18.162 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T11:11:18.208 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T11:11:18.228 INFO:tasks.ceph:Creating extra log directories... 2023-10-14T11:11:18.228 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T11:11:18.271 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T11:11:18.298 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-14T11:11:18.298 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-14T11:11:18.298 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-14T11:11:18.299 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:18.299 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T11:11:18.345 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T11:11:18.440 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:11:18.440 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T11:11:18.449 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T11:11:18.544 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-14T11:11:18.544 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-14T11:11:18.544 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425250', 'branch': 'rishabh-2023oct13', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm}', 'email': None, 'first_in_suite': False, 'job_id': '7425250', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'rishabh-2023oct13'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-2023oct13', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6006, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'sleep_before_teardown': 0, 'subset': '402/512', 'suite': 'fs', 'suite_branch': 'rishabh-2023oct13', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi026.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDPZroadSD0byLS/OQDU3rLFQxFrNb4uy/8dC1Q84XD54SKs2u9fZvALTgT2TlZqTou2kAJC3FXc4kmbpY/4Vrc=', 'smithi110.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDaOgbq01oTcfIYZm6TGeOaOza33787dpNubwTK4SNRqD6Wz4P/rF8IfrmDKuzbcpBAWSWfoOcgzkXI7cr8x1EQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_pool_perm']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-13_18:04:14', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-14T11:11:18.545 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T11:11:18.550 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T11:11:18.560 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T11:11:18.604 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T11:11:18.626 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:18.626 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T11:11:18.673 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T11:11:18.674 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_1 2023-10-14T11:11:18.725 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T11:11:18.726 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T11:11:18.726 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 902 Links: 1 2023-10-14T11:11:18.726 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T11:11:18.726 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-10-14 11:05:02.370951345 +0000 2023-10-14T11:11:18.727 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-10-14 11:05:01.974954884 +0000 2023-10-14T11:11:18.727 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-10-14 11:05:01.974954884 +0000 2023-10-14T11:11:18.727 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2023-10-14 11:05:01.974954884 +0000 2023-10-14T11:11:18.727 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T11:11:18.792 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-10-14T11:11:18.792 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-10-14T11:11:18.792 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000260911 s, 2.0 MB/s 2023-10-14T11:11:18.794 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T11:11:18.847 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_2 2023-10-14T11:11:18.897 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T11:11:18.898 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T11:11:18.898 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 921 Links: 1 2023-10-14T11:11:18.898 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T11:11:18.898 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-10-14 11:05:03.038945380 +0000 2023-10-14T11:11:18.898 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-10-14 11:05:02.634948988 +0000 2023-10-14T11:11:18.899 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-10-14 11:05:02.634948988 +0000 2023-10-14T11:11:18.899 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2023-10-14 11:05:02.634948988 +0000 2023-10-14T11:11:18.899 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T11:11:18.960 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-10-14T11:11:18.960 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-10-14T11:11:18.961 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000259855 s, 2.0 MB/s 2023-10-14T11:11:18.962 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T11:11:19.015 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_3 2023-10-14T11:11:19.066 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T11:11:19.066 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T11:11:19.066 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 936 Links: 1 2023-10-14T11:11:19.066 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T11:11:19.066 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-10-14 11:05:03.678939662 +0000 2023-10-14T11:11:19.067 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-10-14 11:05:03.274943271 +0000 2023-10-14T11:11:19.067 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-10-14 11:05:03.274943271 +0000 2023-10-14T11:11:19.067 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2023-10-14 11:05:03.274943271 +0000 2023-10-14T11:11:19.067 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T11:11:19.129 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-10-14T11:11:19.129 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-10-14T11:11:19.129 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000249409 s, 2.1 MB/s 2023-10-14T11:11:19.131 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T11:11:19.183 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_4 2023-10-14T11:11:19.238 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T11:11:19.238 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T11:11:19.238 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 952 Links: 1 2023-10-14T11:11:19.238 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T11:11:19.239 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-10-14 11:05:04.350933660 +0000 2023-10-14T11:11:19.239 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-10-14 11:05:03.958937162 +0000 2023-10-14T11:11:19.239 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-10-14 11:05:03.958937162 +0000 2023-10-14T11:11:19.239 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2023-10-14 11:05:03.958937162 +0000 2023-10-14T11:11:19.239 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T11:11:19.300 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-10-14T11:11:19.301 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-10-14T11:11:19.301 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000261883 s, 2.0 MB/s 2023-10-14T11:11:19.302 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T11:11:19.359 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T11:11:19.360 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:11:19.360 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T11:11:19.370 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T11:11:19.371 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2023-10-14T11:11:19.420 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T11:11:19.420 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T11:11:19.420 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 889 Links: 1 2023-10-14T11:11:19.421 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T11:11:19.421 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2023-10-14 11:04:57.818991372 +0000 2023-10-14T11:11:19.421 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2023-10-14 11:04:57.434994801 +0000 2023-10-14T11:11:19.421 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2023-10-14 11:04:57.434994801 +0000 2023-10-14T11:11:19.421 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2023-10-14 11:04:57.434994801 +0000 2023-10-14T11:11:19.422 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T11:11:19.482 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2023-10-14T11:11:19.483 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2023-10-14T11:11:19.483 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000275752 s, 1.9 MB/s 2023-10-14T11:11:19.484 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T11:11:19.538 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2023-10-14T11:11:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T11:11:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T11:11:19.588 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 906 Links: 1 2023-10-14T11:11:19.589 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T11:11:19.589 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2023-10-14 11:04:58.418986013 +0000 2023-10-14T11:11:19.589 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2023-10-14 11:04:58.054989263 +0000 2023-10-14T11:11:19.589 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2023-10-14 11:04:58.054989263 +0000 2023-10-14T11:11:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2023-10-14 11:04:58.054989263 +0000 2023-10-14T11:11:19.590 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T11:11:19.650 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2023-10-14T11:11:19.651 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2023-10-14T11:11:19.651 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000272814 s, 1.9 MB/s 2023-10-14T11:11:19.653 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T11:11:19.706 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2023-10-14T11:11:19.756 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T11:11:19.756 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T11:11:19.756 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 924 Links: 1 2023-10-14T11:11:19.757 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T11:11:19.757 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2023-10-14 11:04:59.042980439 +0000 2023-10-14T11:11:19.757 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2023-10-14 11:04:58.654983905 +0000 2023-10-14T11:11:19.757 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2023-10-14 11:04:58.654983905 +0000 2023-10-14T11:11:19.757 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2023-10-14 11:04:58.654983905 +0000 2023-10-14T11:11:19.758 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T11:11:19.818 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2023-10-14T11:11:19.819 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2023-10-14T11:11:19.819 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000277942 s, 1.8 MB/s 2023-10-14T11:11:19.820 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T11:11:19.874 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2023-10-14T11:11:19.924 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T11:11:19.924 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T11:11:19.924 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 943 Links: 1 2023-10-14T11:11:19.924 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T11:11:19.925 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2023-10-14 11:04:59.698974579 +0000 2023-10-14T11:11:19.925 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2023-10-14 11:04:59.306978081 +0000 2023-10-14T11:11:19.925 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2023-10-14 11:04:59.306978081 +0000 2023-10-14T11:11:19.925 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2023-10-14 11:04:59.306978081 +0000 2023-10-14T11:11:19.926 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T11:11:19.986 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2023-10-14T11:11:19.986 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2023-10-14T11:11:19.987 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000271247 s, 1.9 MB/s 2023-10-14T11:11:19.988 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T11:11:20.046 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T11:11:20.046 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-14T11:11:20.046 INFO:tasks.ceph:Generating config... 2023-10-14T11:11:20.048 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-14T11:11:20.048 INFO:tasks.ceph:[client] debug client = 20 2023-10-14T11:11:20.048 INFO:tasks.ceph:[client] debug ms = 1 2023-10-14T11:11:20.048 INFO:tasks.ceph:[client] pid file = 2023-10-14T11:11:20.049 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-14T11:11:20.049 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-14T11:11:20.049 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-14T11:11:20.049 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-14T11:11:20.050 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-14T11:11:20.050 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-14T11:11:20.051 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-14T11:11:20.051 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-14T11:11:20.051 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-14T11:11:20.052 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-14T11:11:20.052 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-14T11:11:20.052 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-14T11:11:20.053 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-14T11:11:20.053 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-14T11:11:20.053 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-14T11:11:20.053 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-14T11:11:20.054 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-14T11:11:20.054 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-14T11:11:20.055 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-14T11:11:20.055 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-14T11:11:20.055 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-14T11:11:20.056 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-14T11:11:20.056 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-14T11:11:20.056 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-14T11:11:20.056 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-14T11:11:20.057 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-14T11:11:20.057 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-14T11:11:20.057 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-14T11:11:20.057 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-14T11:11:20.057 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-14T11:11:20.058 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-14T11:11:20.058 INFO:tasks.ceph:Setting up mon.a... 2023-10-14T11:11:20.058 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-14T11:11:20.112 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.keyring 2023-10-14T11:11:20.180 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-14T11:11:20.231 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T11:11:20.252 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.26'), ('mon.b', '172.21.15.110'), ('mon.c', '[v2:172.21.15.110:3301,v1:172.21.15.110:6790]')] 2023-10-14T11:11:20.253 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.26,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-14T11:11:20.254 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:20.254 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T11:11:20.305 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.26 --add b 172.21.15.110 --addv c '[v2:172.21.15.110:3301,v1:172.21.15.110:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:11:20.396 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:11:20.396 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: generated fsid 9730719c-9713-4147-aaa1-ca8aabbbe5ad 2023-10-14T11:11:20.396 INFO:teuthology.orchestra.run.smithi026.stdout:setting min_mon_release = pacific 2023-10-14T11:11:20.397 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 0 2023-10-14T11:11:20.397 INFO:teuthology.orchestra.run.smithi026.stdout:fsid 9730719c-9713-4147-aaa1-ca8aabbbe5ad 2023-10-14T11:11:20.397 INFO:teuthology.orchestra.run.smithi026.stdout:last_changed 2023-10-14T11:11:20.397311+0000 2023-10-14T11:11:20.397 INFO:teuthology.orchestra.run.smithi026.stdout:created 2023-10-14T11:11:20.397311+0000 2023-10-14T11:11:20.397 INFO:teuthology.orchestra.run.smithi026.stdout:min_mon_release 16 (pacific) 2023-10-14T11:11:20.398 INFO:teuthology.orchestra.run.smithi026.stdout:election_strategy: 1 2023-10-14T11:11:20.398 INFO:teuthology.orchestra.run.smithi026.stdout:0: [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon.a 2023-10-14T11:11:20.398 INFO:teuthology.orchestra.run.smithi026.stdout:1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2023-10-14T11:11:20.398 INFO:teuthology.orchestra.run.smithi026.stdout:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2023-10-14T11:11:20.398 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-14T11:11:20.400 DEBUG:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T11:11:20.408 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9730719c-9713-4147-aaa1-ca8aabbbe5ad... 2023-10-14T11:11:20.409 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T11:11:20.452 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T11:11:20.495 INFO:teuthology.orchestra.run.smithi026.stdout:[global] 2023-10-14T11:11:20.495 INFO:teuthology.orchestra.run.smithi026.stdout: chdir = "" 2023-10-14T11:11:20.495 INFO:teuthology.orchestra.run.smithi026.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T11:11:20.495 INFO:teuthology.orchestra.run.smithi026.stdout: auth supported = cephx 2023-10-14T11:11:20.496 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.496 INFO:teuthology.orchestra.run.smithi026.stdout: filestore xattr use omap = true 2023-10-14T11:11:20.496 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.496 INFO:teuthology.orchestra.run.smithi026.stdout: mon clock drift allowed = 1.000 2023-10-14T11:11:20.496 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.497 INFO:teuthology.orchestra.run.smithi026.stdout: osd crush chooseleaf type = 0 2023-10-14T11:11:20.497 INFO:teuthology.orchestra.run.smithi026.stdout: auth debug = true 2023-10-14T11:11:20.497 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.497 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on old message = true 2023-10-14T11:11:20.497 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on bug = true 2023-10-14T11:11:20.498 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.498 INFO:teuthology.orchestra.run.smithi026.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T11:11:20.498 INFO:teuthology.orchestra.run.smithi026.stdout: mon pg warn max object skew = 0 2023-10-14T11:11:20.498 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.498 INFO:teuthology.orchestra.run.smithi026.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T11:11:20.499 INFO:teuthology.orchestra.run.smithi026.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T11:11:20.499 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.499 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default size = 2 2023-10-14T11:11:20.499 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.499 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow primary affinity = true 2023-10-14T11:11:20.500 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow pg remap = true 2023-10-14T11:11:20.500 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on legacy crush tunables = false 2023-10-14T11:11:20.500 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on crush straw calc version zero = false 2023-10-14T11:11:20.500 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on no sortbitwise = false 2023-10-14T11:11:20.500 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on osd down out interval zero = false 2023-10-14T11:11:20.501 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on too few osds = false 2023-10-14T11:11:20.501 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T11:11:20.501 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T11:11:20.501 INFO:teuthology.orchestra.run.smithi026.stdout: mon_allow_pool_size_one = true 2023-10-14T11:11:20.501 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.501 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T11:11:20.502 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.502 INFO:teuthology.orchestra.run.smithi026.stdout: osd default data pool replay window = 5 2023-10-14T11:11:20.502 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.502 INFO:teuthology.orchestra.run.smithi026.stdout: mon allow pool delete = true 2023-10-14T11:11:20.502 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.503 INFO:teuthology.orchestra.run.smithi026.stdout: mon cluster log file level = debug 2023-10-14T11:11:20.503 INFO:teuthology.orchestra.run.smithi026.stdout: debug asserts on shutdown = true 2023-10-14T11:11:20.503 INFO:teuthology.orchestra.run.smithi026.stdout: mon health detail to clog = false 2023-10-14T11:11:20.503 INFO:teuthology.orchestra.run.smithi026.stdout: mon host = "172.21.15.26,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2023-10-14T11:11:20.503 INFO:teuthology.orchestra.run.smithi026.stdout: fsid = 9730719c-9713-4147-aaa1-ca8aabbbe5ad 2023-10-14T11:11:20.504 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.504 INFO:teuthology.orchestra.run.smithi026.stdout:[osd] 2023-10-14T11:11:20.504 INFO:teuthology.orchestra.run.smithi026.stdout: osd journal size = 100 2023-10-14T11:11:20.504 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.504 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub load threshold = 5.0 2023-10-14T11:11:20.504 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub max interval = 600 2023-10-14T11:11:20.505 INFO:teuthology.orchestra.run.smithi026.stdout: osd mclock profile = high_recovery_ops 2023-10-14T11:11:20.505 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.505 INFO:teuthology.orchestra.run.smithi026.stdout: osd recover clone overlap = true 2023-10-14T11:11:20.505 INFO:teuthology.orchestra.run.smithi026.stdout: osd recovery max chunk = 1048576 2023-10-14T11:11:20.505 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.506 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug shutdown = true 2023-10-14T11:11:20.506 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug op order = true 2023-10-14T11:11:20.506 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug verify stray on activate = true 2023-10-14T11:11:20.506 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.506 INFO:teuthology.orchestra.run.smithi026.stdout: osd open classes on start = true 2023-10-14T11:11:20.507 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug pg log writeout = true 2023-10-14T11:11:20.507 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.507 INFO:teuthology.orchestra.run.smithi026.stdout: osd deep scrub update digest min age = 30 2023-10-14T11:11:20.507 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.507 INFO:teuthology.orchestra.run.smithi026.stdout: osd map max advance = 10 2023-10-14T11:11:20.508 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.508 INFO:teuthology.orchestra.run.smithi026.stdout: journal zero on create = true 2023-10-14T11:11:20.508 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.508 INFO:teuthology.orchestra.run.smithi026.stdout: filestore ondisk finisher threads = 3 2023-10-14T11:11:20.508 INFO:teuthology.orchestra.run.smithi026.stdout: filestore apply finisher threads = 3 2023-10-14T11:11:20.509 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.509 INFO:teuthology.orchestra.run.smithi026.stdout: bdev debug aio = true 2023-10-14T11:11:20.509 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug misdirected ops = true 2023-10-14T11:11:20.509 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore block size = 96636764160 2023-10-14T11:11:20.509 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore fsck on mount = True 2023-10-14T11:11:20.510 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluefs = 20 2023-10-14T11:11:20.510 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluestore = 20 2023-10-14T11:11:20.510 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-10-14T11:11:20.510 INFO:teuthology.orchestra.run.smithi026.stdout: debug osd = 20 2023-10-14T11:11:20.510 INFO:teuthology.orchestra.run.smithi026.stdout: debug rocksdb = 10 2023-10-14T11:11:20.511 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T11:11:20.511 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd full ratio = 0.9 2023-10-14T11:11:20.511 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd nearfull ratio = 0.8 2023-10-14T11:11:20.511 INFO:teuthology.orchestra.run.smithi026.stdout: osd failsafe full ratio = 0.95 2023-10-14T11:11:20.511 INFO:teuthology.orchestra.run.smithi026.stdout: osd objectstore = bluestore 2023-10-14T11:11:20.512 INFO:teuthology.orchestra.run.smithi026.stdout: osd op complaint time = 180 2023-10-14T11:11:20.512 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.512 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr] 2023-10-14T11:11:20.512 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-10-14T11:11:20.512 INFO:teuthology.orchestra.run.smithi026.stdout: debug mgr = 20 2023-10-14T11:11:20.512 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2023-10-14T11:11:20.513 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2023-10-14T11:11:20.513 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2023-10-14T11:11:20.513 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2023-10-14T11:11:20.513 INFO:teuthology.orchestra.run.smithi026.stdout: mgr/telemetry/nag = false 2023-10-14T11:11:20.513 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.514 INFO:teuthology.orchestra.run.smithi026.stdout:[mon] 2023-10-14T11:11:20.514 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-10-14T11:11:20.514 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2023-10-14T11:11:20.514 INFO:teuthology.orchestra.run.smithi026.stdout: debug paxos = 20 2023-10-14T11:11:20.514 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2023-10-14T11:11:20.515 INFO:teuthology.orchestra.run.smithi026.stdout: mon data avail warn = 5 2023-10-14T11:11:20.515 INFO:teuthology.orchestra.run.smithi026.stdout: mon mgr mkfs grace = 240 2023-10-14T11:11:20.515 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2023-10-14T11:11:20.515 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd reporter subtree level = osd 2023-10-14T11:11:20.515 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd prime pg temp = true 2023-10-14T11:11:20.515 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2023-10-14T11:11:20.516 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.516 INFO:teuthology.orchestra.run.smithi026.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T11:11:20.516 INFO:teuthology.orchestra.run.smithi026.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T11:11:20.516 INFO:teuthology.orchestra.run.smithi026.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T11:11:20.516 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.517 INFO:teuthology.orchestra.run.smithi026.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T11:11:20.517 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T11:11:20.517 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T11:11:20.517 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.517 INFO:teuthology.orchestra.run.smithi026.stdout: # 1m isn't quite enough 2023-10-14T11:11:20.518 INFO:teuthology.orchestra.run.smithi026.stdout: mon_down_mkfs_grace = 2m 2023-10-14T11:11:20.518 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.518 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_filestore_osds = false 2023-10-14T11:11:20.518 INFO:teuthology.orchestra.run.smithi026.stdout: mon op complaint time = 120 2023-10-14T11:11:20.518 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:20.519 INFO:teuthology.orchestra.run.smithi026.stdout:[client] 2023-10-14T11:11:20.519 INFO:teuthology.orchestra.run.smithi026.stdout: rgw cache enabled = true 2023-10-14T11:11:20.519 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable ops log = true 2023-10-14T11:11:20.519 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable usage log = true 2023-10-14T11:11:20.519 INFO:teuthology.orchestra.run.smithi026.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T11:11:20.519 INFO:teuthology.orchestra.run.smithi026.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T11:11:20.520 INFO:teuthology.orchestra.run.smithi026.stdout: client mount timeout = 600 2023-10-14T11:11:20.520 INFO:teuthology.orchestra.run.smithi026.stdout: debug client = 20 2023-10-14T11:11:20.520 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-10-14T11:11:20.520 INFO:teuthology.orchestra.run.smithi026.stdout: pid file = "" 2023-10-14T11:11:20.520 INFO:teuthology.orchestra.run.smithi026.stdout: rados mon op timeout = 900 2023-10-14T11:11:20.521 INFO:teuthology.orchestra.run.smithi026.stdout: rados osd op timeout = 900 2023-10-14T11:11:20.521 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.a] 2023-10-14T11:11:20.521 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.b] 2023-10-14T11:11:20.521 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.c] 2023-10-14T11:11:20.521 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a] 2023-10-14T11:11:20.521 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.c] 2023-10-14T11:11:20.522 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.b] 2023-10-14T11:11:20.522 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.d] 2023-10-14T11:11:20.522 INFO:teuthology.orchestra.run.smithi026.stdout:[mds] 2023-10-14T11:11:20.522 INFO:teuthology.orchestra.run.smithi026.stdout: debug mds = 20 2023-10-14T11:11:20.522 INFO:teuthology.orchestra.run.smithi026.stdout: debug mds balancer = 20 2023-10-14T11:11:20.523 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-10-14T11:11:20.523 INFO:teuthology.orchestra.run.smithi026.stdout: mds debug frag = True 2023-10-14T11:11:20.523 INFO:teuthology.orchestra.run.smithi026.stdout: mds debug scatterstat = True 2023-10-14T11:11:20.523 INFO:teuthology.orchestra.run.smithi026.stdout: mds op complaint time = 180 2023-10-14T11:11:20.523 INFO:teuthology.orchestra.run.smithi026.stdout: mds verify scatter = True 2023-10-14T11:11:20.523 INFO:teuthology.orchestra.run.smithi026.stdout: osd op complaint time = 180 2023-10-14T11:11:20.524 INFO:teuthology.orchestra.run.smithi026.stdout: rados mon op timeout = 900 2023-10-14T11:11:20.524 INFO:teuthology.orchestra.run.smithi026.stdout: rados osd op timeout = 900 2023-10-14T11:11:20.525 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2023-10-14T11:11:20.526 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2023-10-14T11:11:20.526 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T11:11:20.526 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2023-10-14T11:11:20.526 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.527 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2023-10-14T11:11:20.527 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.527 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2023-10-14T11:11:20.527 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.527 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2023-10-14T11:11:20.527 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2023-10-14T11:11:20.528 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.528 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2023-10-14T11:11:20.528 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2023-10-14T11:11:20.528 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.528 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T11:11:20.529 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2023-10-14T11:11:20.529 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.529 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T11:11:20.529 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T11:11:20.529 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.530 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2023-10-14T11:11:20.530 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.530 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2023-10-14T11:11:20.530 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2023-10-14T11:11:20.530 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2023-10-14T11:11:20.530 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2023-10-14T11:11:20.531 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2023-10-14T11:11:20.531 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2023-10-14T11:11:20.531 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2023-10-14T11:11:20.531 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T11:11:20.531 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T11:11:20.532 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2023-10-14T11:11:20.532 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.532 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T11:11:20.532 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.532 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2023-10-14T11:11:20.532 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.533 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2023-10-14T11:11:20.533 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.533 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2023-10-14T11:11:20.533 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2023-10-14T11:11:20.533 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2023-10-14T11:11:20.534 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = "172.21.15.26,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2023-10-14T11:11:20.534 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = 9730719c-9713-4147-aaa1-ca8aabbbe5ad 2023-10-14T11:11:20.534 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.534 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2023-10-14T11:11:20.534 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2023-10-14T11:11:20.534 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.535 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2023-10-14T11:11:20.535 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 600 2023-10-14T11:11:20.535 INFO:teuthology.orchestra.run.smithi110.stdout: osd mclock profile = high_recovery_ops 2023-10-14T11:11:20.535 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.535 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2023-10-14T11:11:20.536 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2023-10-14T11:11:20.536 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.536 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2023-10-14T11:11:20.536 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2023-10-14T11:11:20.536 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2023-10-14T11:11:20.536 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.537 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2023-10-14T11:11:20.537 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2023-10-14T11:11:20.537 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.537 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2023-10-14T11:11:20.537 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.538 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2023-10-14T11:11:20.538 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.538 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2023-10-14T11:11:20.538 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.538 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2023-10-14T11:11:20.539 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2023-10-14T11:11:20.539 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.539 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2023-10-14T11:11:20.539 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2023-10-14T11:11:20.539 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore block size = 96636764160 2023-10-14T11:11:20.540 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore fsck on mount = True 2023-10-14T11:11:20.540 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluefs = 20 2023-10-14T11:11:20.540 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluestore = 20 2023-10-14T11:11:20.540 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2023-10-14T11:11:20.540 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 20 2023-10-14T11:11:20.540 INFO:teuthology.orchestra.run.smithi110.stdout: debug rocksdb = 10 2023-10-14T11:11:20.541 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T11:11:20.541 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd full ratio = 0.9 2023-10-14T11:11:20.541 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd nearfull ratio = 0.8 2023-10-14T11:11:20.541 INFO:teuthology.orchestra.run.smithi110.stdout: osd failsafe full ratio = 0.95 2023-10-14T11:11:20.541 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = bluestore 2023-10-14T11:11:20.542 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2023-10-14T11:11:20.542 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.542 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2023-10-14T11:11:20.542 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2023-10-14T11:11:20.542 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2023-10-14T11:11:20.542 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2023-10-14T11:11:20.543 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2023-10-14T11:11:20.543 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2023-10-14T11:11:20.543 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2023-10-14T11:11:20.543 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2023-10-14T11:11:20.543 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.544 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2023-10-14T11:11:20.544 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2023-10-14T11:11:20.544 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2023-10-14T11:11:20.544 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2023-10-14T11:11:20.544 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2023-10-14T11:11:20.544 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2023-10-14T11:11:20.545 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2023-10-14T11:11:20.545 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2023-10-14T11:11:20.545 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2023-10-14T11:11:20.545 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2023-10-14T11:11:20.546 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2023-10-14T11:11:20.546 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.546 INFO:teuthology.orchestra.run.smithi110.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T11:11:20.546 INFO:teuthology.orchestra.run.smithi110.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T11:11:20.547 INFO:teuthology.orchestra.run.smithi110.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T11:11:20.547 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.547 INFO:teuthology.orchestra.run.smithi110.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T11:11:20.547 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T11:11:20.548 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T11:11:20.548 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.548 INFO:teuthology.orchestra.run.smithi110.stdout: # 1m isn't quite enough 2023-10-14T11:11:20.548 INFO:teuthology.orchestra.run.smithi110.stdout: mon_down_mkfs_grace = 2m 2023-10-14T11:11:20.548 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.549 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_filestore_osds = false 2023-10-14T11:11:20.549 INFO:teuthology.orchestra.run.smithi110.stdout: mon op complaint time = 120 2023-10-14T11:11:20.549 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-14T11:11:20.550 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2023-10-14T11:11:20.550 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2023-10-14T11:11:20.550 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = true 2023-10-14T11:11:20.550 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2023-10-14T11:11:20.550 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T11:11:20.551 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T11:11:20.551 INFO:teuthology.orchestra.run.smithi110.stdout: client mount timeout = 600 2023-10-14T11:11:20.551 INFO:teuthology.orchestra.run.smithi110.stdout: debug client = 20 2023-10-14T11:11:20.551 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2023-10-14T11:11:20.552 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = "" 2023-10-14T11:11:20.552 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2023-10-14T11:11:20.552 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2023-10-14T11:11:20.552 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2023-10-14T11:11:20.552 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.b] 2023-10-14T11:11:20.552 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.c] 2023-10-14T11:11:20.553 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2023-10-14T11:11:20.553 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2023-10-14T11:11:20.553 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2023-10-14T11:11:20.553 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2023-10-14T11:11:20.553 INFO:teuthology.orchestra.run.smithi110.stdout:[mds] 2023-10-14T11:11:20.554 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds = 20 2023-10-14T11:11:20.554 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds balancer = 20 2023-10-14T11:11:20.554 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2023-10-14T11:11:20.554 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug frag = True 2023-10-14T11:11:20.554 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug scatterstat = True 2023-10-14T11:11:20.554 INFO:teuthology.orchestra.run.smithi110.stdout: mds op complaint time = 180 2023-10-14T11:11:20.555 INFO:teuthology.orchestra.run.smithi110.stdout: mds verify scatter = True 2023-10-14T11:11:20.555 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2023-10-14T11:11:20.555 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2023-10-14T11:11:20.555 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2023-10-14T11:11:20.556 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-14T11:11:20.556 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-14T11:11:20.627 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-14T11:11:20.627 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:20.628 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-14T11:11:20.637 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:20.638 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-14T11:11:20.692 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T11:11:20.693 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:20.693 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T11:11:20.694 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T11:11:20.774 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:20.774 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:11:20.825 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi110.front.sepia.ceph.com 2023-10-14T11:11:20.825 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:11:20.825 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T11:11:20.826 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T11:11:20.862 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:11:20.863 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:11:20.911 INFO:tasks.ceph:Setting up mon nodes... 2023-10-14T11:11:20.912 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-14T11:11:20.912 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-14T11:11:20.970 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-14T11:11:20.975 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T11:11:21.034 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T11:11:21.054 INFO:tasks.ceph:Setting up mds nodes... 2023-10-14T11:11:21.055 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-14T11:11:21.114 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-14T11:11:21.119 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-14T11:11:21.140 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-14T11:11:21.241 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-14T11:11:21.245 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-14T11:11:21.266 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-14T11:11:21.326 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-14T11:11:21.331 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-14T11:11:21.352 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-14T11:11:21.455 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-14T11:11:21.459 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-14T11:11:21.480 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-14T11:11:21.480 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-14T11:11:21.526 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-14T11:11:21.544 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-14T11:11:21.632 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-14T11:11:21.650 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-14T11:11:21.693 INFO:teuthology.orchestra.run.smithi110.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-14T11:11:21.710 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-14T11:11:21.793 INFO:teuthology.orchestra.run.smithi110.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-14T11:11:21.811 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-14T11:11:21.811 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-14T11:11:21.811 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-14T11:11:21.833 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T11:11:21.833 INFO:tasks.ceph:role: osd.0 2023-10-14T11:11:21.834 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T11:11:21.834 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T11:11:21.897 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T11:11:21.897 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T11:11:21.898 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T11:11:21.898 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T11:11:21.898 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T11:11:21.898 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-10-14T11:11:21.899 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T11:11:21.899 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T11:11:21.899 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T11:11:21.899 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T11:11:21.922 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-10-14T11:11:21.968 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-10-14T11:11:21.968 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-14T11:11:22.034 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-14T11:11:22.097 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: /sbin/restorecon: command not found 2023-10-14T11:11:22.098 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:11:22.099 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-14T11:11:22.160 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T11:11:22.161 INFO:tasks.ceph:role: osd.1 2023-10-14T11:11:22.161 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T11:11:22.161 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T11:11:22.224 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T11:11:22.224 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T11:11:22.224 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T11:11:22.225 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T11:11:22.225 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T11:11:22.225 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-10-14T11:11:22.225 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T11:11:22.225 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T11:11:22.226 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T11:11:22.226 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T11:11:22.249 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-10-14T11:11:22.251 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-10-14T11:11:22.252 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-14T11:11:22.322 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-14T11:11:22.381 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: /sbin/restorecon: command not found 2023-10-14T11:11:22.382 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:11:22.382 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-14T11:11:22.448 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T11:11:22.448 INFO:tasks.ceph:role: osd.2 2023-10-14T11:11:22.449 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T11:11:22.449 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-14T11:11:22.513 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T11:11:22.513 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T11:11:22.514 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T11:11:22.514 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T11:11:22.514 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T11:11:22.514 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-10-14T11:11:22.514 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T11:11:22.515 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T11:11:22.515 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T11:11:22.515 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T11:11:22.538 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-10-14T11:11:22.540 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-10-14T11:11:22.541 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-14T11:11:22.615 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-14T11:11:22.673 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: /sbin/restorecon: command not found 2023-10-14T11:11:22.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:11:22.675 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-14T11:11:22.737 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T11:11:22.737 INFO:tasks.ceph:role: osd.3 2023-10-14T11:11:22.737 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T11:11:22.738 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-14T11:11:22.800 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T11:11:22.800 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T11:11:22.801 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T11:11:22.801 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T11:11:22.801 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T11:11:22.801 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-10-14T11:11:22.801 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T11:11:22.802 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T11:11:22.802 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T11:11:22.802 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T11:11:22.824 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-10-14T11:11:22.827 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-10-14T11:11:22.828 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-14T11:11:22.894 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-14T11:11:22.953 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: /sbin/restorecon: command not found 2023-10-14T11:11:22.953 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:11:22.954 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:11:23.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:23.085+0000 7f540be4a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-14T11:11:23.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:23.089+0000 7f540be4a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-14T11:11:23.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:23.089+0000 7f540be4a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T11:11:23.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:23.089+0000 7f540be4a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T11:11:23.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:23.089+0000 7f540be4a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T11:11:23.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:23.089+0000 7f540be4a640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-14T11:11:26.068 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-14T11:11:26.090 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:11:26.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:26.189+0000 7faae8131640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-14T11:11:26.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:26.189+0000 7faae8131640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-14T11:11:26.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:26.189+0000 7faae8131640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T11:11:26.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:26.189+0000 7faae8131640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T11:11:26.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:26.189+0000 7faae8131640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T11:11:26.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:26.189+0000 7faae8131640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-14T11:11:29.176 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-14T11:11:29.202 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:11:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:29.301+0000 7fbeb2f67640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-14T11:11:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:29.301+0000 7fbeb2f67640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-14T11:11:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:29.301+0000 7fbeb2f67640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T11:11:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:29.301+0000 7fbeb2f67640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T11:11:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:29.301+0000 7fbeb2f67640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T11:11:29.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:29.301+0000 7fbeb2f67640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-14T11:11:32.315 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-14T11:11:32.337 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:11:32.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:32.437+0000 7fced1d3c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-14T11:11:32.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:32.437+0000 7fced1d3c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-14T11:11:32.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:32.437+0000 7fced1d3c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T11:11:32.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:32.437+0000 7fced1d3c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T11:11:32.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:32.437+0000 7fced1d3c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T11:11:32.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:32.441+0000 7fced1d3c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-14T11:11:35.426 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-14T11:11:35.448 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-14T11:11:35.471 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T11:11:35.472 INFO:tasks.ceph:role: osd.4 2023-10-14T11:11:35.472 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com 2023-10-14T11:11:35.473 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T11:11:35.536 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T11:11:35.537 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T11:11:35.537 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T11:11:35.537 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T11:11:35.537 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T11:11:35.538 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2023-10-14T11:11:35.538 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T11:11:35.538 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T11:11:35.538 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T11:11:35.538 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T11:11:35.561 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2023-10-14T11:11:35.563 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2023-10-14T11:11:35.564 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-14T11:11:35.637 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-14T11:11:35.695 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2023-10-14T11:11:35.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:11:35.696 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-14T11:11:35.762 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T11:11:35.763 INFO:tasks.ceph:role: osd.5 2023-10-14T11:11:35.763 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com 2023-10-14T11:11:35.763 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T11:11:35.822 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T11:11:35.822 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T11:11:35.823 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T11:11:35.823 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T11:11:35.823 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T11:11:35.823 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2023-10-14T11:11:35.823 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T11:11:35.824 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T11:11:35.824 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T11:11:35.824 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T11:11:35.846 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2023-10-14T11:11:35.848 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2023-10-14T11:11:35.849 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-14T11:11:35.919 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-14T11:11:35.979 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2023-10-14T11:11:35.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:11:35.980 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-14T11:11:36.046 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T11:11:36.046 INFO:tasks.ceph:role: osd.6 2023-10-14T11:11:36.047 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com 2023-10-14T11:11:36.047 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-14T11:11:36.106 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T11:11:36.106 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T11:11:36.106 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T11:11:36.107 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T11:11:36.107 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T11:11:36.107 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2023-10-14T11:11:36.107 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T11:11:36.107 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T11:11:36.108 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T11:11:36.108 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T11:11:36.130 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2023-10-14T11:11:36.132 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2023-10-14T11:11:36.133 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-14T11:11:36.199 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-14T11:11:36.262 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2023-10-14T11:11:36.263 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:11:36.264 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-14T11:11:36.326 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T11:11:36.326 INFO:tasks.ceph:role: osd.7 2023-10-14T11:11:36.327 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com 2023-10-14T11:11:36.327 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-14T11:11:36.390 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T11:11:36.391 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T11:11:36.391 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T11:11:36.391 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T11:11:36.391 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T11:11:36.391 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2023-10-14T11:11:36.392 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T11:11:36.392 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T11:11:36.392 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T11:11:36.392 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T11:11:36.415 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2023-10-14T11:11:36.417 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2023-10-14T11:11:36.418 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-14T11:11:36.483 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-14T11:11:36.542 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2023-10-14T11:11:36.543 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:11:36.544 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:11:36.666 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:36.661+0000 7f9efb3d3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-14T11:11:36.667 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:36.661+0000 7f9efb3d3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-14T11:11:36.668 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:36.661+0000 7f9efb3d3640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T11:11:36.668 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:36.665+0000 7f9efb3d3640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T11:11:36.668 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:36.665+0000 7f9efb3d3640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T11:11:36.668 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:36.665+0000 7f9efb3d3640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-14T11:11:39.642 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-14T11:11:39.664 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:11:39.764 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:39.761+0000 7f15d4b20640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-14T11:11:39.765 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:39.761+0000 7f15d4b20640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-14T11:11:39.765 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:39.761+0000 7f15d4b20640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T11:11:39.766 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:39.761+0000 7f15d4b20640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T11:11:39.766 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:39.761+0000 7f15d4b20640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T11:11:39.766 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:39.761+0000 7f15d4b20640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-14T11:11:42.758 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-14T11:11:42.780 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:11:42.876 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:42.873+0000 7ff3e8dbf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-14T11:11:42.877 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:42.873+0000 7ff3e8dbf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-14T11:11:42.878 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:42.873+0000 7ff3e8dbf640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T11:11:42.878 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:42.873+0000 7ff3e8dbf640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T11:11:42.878 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:42.873+0000 7ff3e8dbf640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T11:11:42.878 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:42.873+0000 7ff3e8dbf640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-14T11:11:45.857 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-14T11:11:45.879 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:11:45.982 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:45.977+0000 7f3e8502d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-14T11:11:45.983 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:45.977+0000 7f3e8502d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-14T11:11:45.983 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:45.977+0000 7f3e8502d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T11:11:45.983 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:45.977+0000 7f3e8502d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T11:11:45.983 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:45.977+0000 7f3e8502d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T11:11:45.984 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:45.981+0000 7f3e8502d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-14T11:11:48.547 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:11:48.551 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:11:48.965 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-14T11:11:48.986 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-14T11:11:48.986 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:48.987 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-14T11:11:49.010 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:49.011 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-14T11:11:49.078 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:49.079 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-14T11:11:49.142 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:49.142 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-14T11:11:49.206 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:49.206 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-14T11:11:49.270 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:49.271 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-14T11:11:49.334 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:49.335 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-14T11:11:49.398 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:11:49.399 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-14T11:11:49.420 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:11:49.421 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-14T11:11:49.483 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:11:49.483 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-14T11:11:49.550 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:11:49.551 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-14T11:11:49.614 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:11:49.615 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-14T11:11:49.678 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:11:49.678 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-14T11:11:49.742 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:11:49.743 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-14T11:11:49.806 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:49.807 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-14T11:11:49.817 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:49.817 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-14T11:11:49.869 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:11:49.870 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-14T11:11:49.881 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:11:49.882 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-14T11:11:49.935 INFO:tasks.ceph:Adding keys to all mons... 2023-10-14T11:11:49.936 DEBUG:teuthology.orchestra.run.smithi026:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T11:11:49.940 DEBUG:teuthology.orchestra.run.smithi110:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T11:11:49.987 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.y] 2023-10-14T11:11:49.987 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBYdyplAXfkORAAVGkkCTmYSKxUhZbWw9wJYg== 2023-10-14T11:11:49.987 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a] 2023-10-14T11:11:49.988 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBZdyplRm7mBhAA9TLX9jvw13hKZFBzlqLVWA== 2023-10-14T11:11:49.988 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.c] 2023-10-14T11:11:49.988 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBZdyplCHJwDhAAfunTAdo2FVxukOSj7Hztsg== 2023-10-14T11:11:49.988 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.0] 2023-10-14T11:11:49.988 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBbdyplyABdBRAALhGtz0Y51kT1x8n8Vj21Cw== 2023-10-14T11:11:49.989 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.1] 2023-10-14T11:11:49.989 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBedyplCaVcCxAAFVOhDkVThePN3Y/gjD3wNA== 2023-10-14T11:11:49.989 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.2] 2023-10-14T11:11:49.989 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBhdypljagWEhAAFVSbpqTlV5d/o/ydvm53tQ== 2023-10-14T11:11:49.989 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.3] 2023-10-14T11:11:49.990 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBkdyplvzxDGhAAn9TglOxt8PgopVubKj+J/Q== 2023-10-14T11:11:49.990 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.x] 2023-10-14T11:11:49.990 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBZdyplKBIpAhAAcL6wVN4Q7x9dIscL9JZjPw== 2023-10-14T11:11:49.990 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.b] 2023-10-14T11:11:49.990 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBZdyplCziNExAADrUZ/ARa7JGEmPPFlzyiOg== 2023-10-14T11:11:49.991 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.d] 2023-10-14T11:11:49.991 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBZdyplzgA5GxAAK5Ah/o0nnDMVIZprhphkxw== 2023-10-14T11:11:49.991 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.4] 2023-10-14T11:11:49.991 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBodyploWvTJxAAFxIauZ1IG+Taz4096ajC2Q== 2023-10-14T11:11:49.992 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.5] 2023-10-14T11:11:49.992 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBrdyplw++tLRAALzDk+Aw1H/IDM+5WsjSPvA== 2023-10-14T11:11:49.992 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.6] 2023-10-14T11:11:49.992 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBudyplwJJdNBAARKiA3WwEH8t1/y7UNy92eg== 2023-10-14T11:11:49.992 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.7] 2023-10-14T11:11:49.993 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBxdyplgBijOhAAy21yvN9VKAds3X/rGbCUgQ== 2023-10-14T11:11:49.993 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2023-10-14T11:11:49.993 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBZdyplGXdwHxAA3yn7fC60cZX9BQGuvdlfYw== 2023-10-14T11:11:49.993 INFO:teuthology.orchestra.run.smithi026.stdout:[client.2] 2023-10-14T11:11:49.993 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBZdyplH9PCJRAArxibYqSOXNQRw3K/6HcKTQ== 2023-10-14T11:11:49.994 INFO:teuthology.orchestra.run.smithi026.stdout:[client.1] 2023-10-14T11:11:49.994 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBZdypl5UdxKRAAeFk3cdLM7WTuHwdsE3PZIA== 2023-10-14T11:11:49.994 INFO:teuthology.orchestra.run.smithi026.stdout:[client.3] 2023-10-14T11:11:49.994 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBZdyplVCFoLxAAqT8U/Z+hM68mTywgrINGzg== 2023-10-14T11:11:50.001 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.y] 2023-10-14T11:11:50.001 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBYdyplAXfkORAAVGkkCTmYSKxUhZbWw9wJYg== 2023-10-14T11:11:50.001 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2023-10-14T11:11:50.001 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBZdyplRm7mBhAA9TLX9jvw13hKZFBzlqLVWA== 2023-10-14T11:11:50.002 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2023-10-14T11:11:50.002 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBZdyplCHJwDhAAfunTAdo2FVxukOSj7Hztsg== 2023-10-14T11:11:50.002 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.0] 2023-10-14T11:11:50.002 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBbdyplyABdBRAALhGtz0Y51kT1x8n8Vj21Cw== 2023-10-14T11:11:50.002 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.1] 2023-10-14T11:11:50.003 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBedyplCaVcCxAAFVOhDkVThePN3Y/gjD3wNA== 2023-10-14T11:11:50.003 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.2] 2023-10-14T11:11:50.003 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBhdypljagWEhAAFVSbpqTlV5d/o/ydvm53tQ== 2023-10-14T11:11:50.003 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.3] 2023-10-14T11:11:50.003 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBkdyplvzxDGhAAn9TglOxt8PgopVubKj+J/Q== 2023-10-14T11:11:50.004 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.x] 2023-10-14T11:11:50.004 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBZdyplKBIpAhAAcL6wVN4Q7x9dIscL9JZjPw== 2023-10-14T11:11:50.004 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2023-10-14T11:11:50.004 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBZdyplCziNExAADrUZ/ARa7JGEmPPFlzyiOg== 2023-10-14T11:11:50.005 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2023-10-14T11:11:50.005 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBZdyplzgA5GxAAK5Ah/o0nnDMVIZprhphkxw== 2023-10-14T11:11:50.005 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.4] 2023-10-14T11:11:50.005 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBodyploWvTJxAAFxIauZ1IG+Taz4096ajC2Q== 2023-10-14T11:11:50.006 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.5] 2023-10-14T11:11:50.006 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBrdyplw++tLRAALzDk+Aw1H/IDM+5WsjSPvA== 2023-10-14T11:11:50.006 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.6] 2023-10-14T11:11:50.006 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBudyplwJJdNBAARKiA3WwEH8t1/y7UNy92eg== 2023-10-14T11:11:50.007 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.7] 2023-10-14T11:11:50.007 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBxdyplgBijOhAAy21yvN9VKAds3X/rGbCUgQ== 2023-10-14T11:11:50.007 INFO:teuthology.orchestra.run.smithi110.stdout:[client.0] 2023-10-14T11:11:50.007 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBZdyplGXdwHxAA3yn7fC60cZX9BQGuvdlfYw== 2023-10-14T11:11:50.008 INFO:teuthology.orchestra.run.smithi110.stdout:[client.2] 2023-10-14T11:11:50.008 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBZdyplH9PCJRAArxibYqSOXNQRw3K/6HcKTQ== 2023-10-14T11:11:50.008 INFO:teuthology.orchestra.run.smithi110.stdout:[client.1] 2023-10-14T11:11:50.008 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBZdypl5UdxKRAAeFk3cdLM7WTuHwdsE3PZIA== 2023-10-14T11:11:50.008 INFO:teuthology.orchestra.run.smithi110.stdout:[client.3] 2023-10-14T11:11:50.009 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBZdyplVCFoLxAAqT8U/Z+hM68mTywgrINGzg== 2023-10-14T11:11:50.010 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T11:11:50.039 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T11:11:50.110 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T11:11:50.114 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T11:11:50.172 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T11:11:50.176 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T11:11:50.234 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:11:50.238 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:11:50.293 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:11:50.297 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:11:50.352 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:11:50.356 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:11:50.410 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:11:50.414 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:11:50.467 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T11:11:50.472 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T11:11:50.527 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T11:11:50.531 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T11:11:50.588 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T11:11:50.592 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T11:11:50.648 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:11:50.652 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:11:50.706 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:11:50.710 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:11:50.764 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:11:50.768 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:11:50.822 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:11:50.826 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:11:50.880 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T11:11:50.885 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T11:11:50.942 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T11:11:50.946 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T11:11:51.003 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T11:11:51.007 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T11:11:51.064 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T11:11:51.068 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T11:11:51.126 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-14T11:11:51.127 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-14T11:11:51.148 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T11:11:51.262 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-14T11:11:51.283 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-14T11:11:51.305 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T11:11:51.421 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-14T11:11:51.441 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-14T11:11:51.503 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T11:11:51.617 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-14T11:11:51.638 DEBUG:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:11:51.642 DEBUG:teuthology.orchestra.run.smithi110:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:11:51.686 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-14T11:11:51.687 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-14T11:11:51.687 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-14T11:11:51.695 INFO:tasks.ceph.mon.a:Started 2023-10-14T11:11:51.695 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-14T11:11:51.696 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-14T11:11:51.730 INFO:tasks.ceph.mon.b:Started 2023-10-14T11:11:51.731 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-14T11:11:51.731 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-14T11:11:51.735 INFO:tasks.ceph.mon.c:Started 2023-10-14T11:11:51.735 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-14T11:11:51.736 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-14T11:11:51.736 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-14T11:11:51.740 INFO:tasks.ceph.mgr.y:Started 2023-10-14T11:11:51.740 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-14T11:11:51.741 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-14T11:11:51.746 INFO:tasks.ceph.mgr.x:Started 2023-10-14T11:11:51.747 INFO:tasks.ceph:Setting crush tunables to default 2023-10-14T11:11:51.747 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd crush tunables default 2023-10-14T11:11:51.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:51.889+0000 7f8b60c9a640 1 Processor -- start 2023-10-14T11:11:51.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:51.889+0000 7f8b60c9a640 1 -- start start 2023-10-14T11:11:51.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:51.889+0000 7f8b60c9a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b5c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:51.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:51.889+0000 7f8b60c9a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 0x7f8b5c0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:51.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:51.889+0000 7f8b60c9a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5c0d1670 con 0x7f8b5c0d0040 2023-10-14T11:11:51.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:51.889+0000 7f8b60c9a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5c0d1460 con 0x7f8b5c0b84e0 2023-10-14T11:11:51.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:51.889+0000 7f8b60c9a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c0d04b0 con 0x7f8b5c15cba0 2023-10-14T11:11:51.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:51.889+0000 7f8b53fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 0x7f8b5c0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:51.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:51.889+0000 7f8b53fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 0x7f8b5c0cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44316/0 (socket says 172.21.15.26:44316) 2023-10-14T11:11:51.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:51.889+0000 7f8b53fff640 1 -- 172.21.15.26:0/1772024661 learned_addr learned my addr 172.21.15.26:0/1772024661 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:11:51.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:51.889+0000 7f8b5a59c640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b5c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:51.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:51.889+0000 7f8b53fff640 1 -- 172.21.15.26:0/1772024661 >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 msgr2=0x7f8b5c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T11:11:51.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:51.889+0000 7f8b53fff640 1 -- 172.21.15.26:0/1772024661 >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 msgr2=0x7f8b5c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T11:11:51.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:51.889+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 0x7f8b5c0cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T11:11:51.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:51.889+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 0x7f8b5c0cfb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T11:11:51.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:51.889+0000 7f8b5a59c640 1 -- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 msgr2=0x7f8b5c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T11:11:51.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:51.889+0000 7f8b5a59c640 1 -- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 msgr2=0x7f8b5c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T11:11:51.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:51.889+0000 7f8b5a59c640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b5c0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T11:11:51.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:51.889+0000 7f8b5a59c640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b5c0d0f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T11:11:52.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:52.093+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 0x7f8b5c0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:52.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:52.093+0000 7f8b53fff640 1 -- 172.21.15.26:0/1772024661 >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 msgr2=0x7f8b5c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T11:11:52.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:52.093+0000 7f8b53fff640 1 -- 172.21.15.26:0/1772024661 >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 msgr2=0x7f8b5c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T11:11:52.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:52.093+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 0x7f8b5c0cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T11:11:52.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:52.093+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 0x7f8b5c0cfb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-14T11:11:52.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:52.093+0000 7f8b5a59c640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b5c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:52.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:52.093+0000 7f8b5a59c640 1 -- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 msgr2=0x7f8b5c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T11:11:52.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:52.093+0000 7f8b5a59c640 1 -- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 msgr2=0x7f8b5c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T11:11:52.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:52.093+0000 7f8b5a59c640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b5c0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T11:11:52.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:52.093+0000 7f8b5a59c640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b5c0d0f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-14T11:11:52.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:52.497+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 0x7f8b5c0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:52.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:52.497+0000 7f8b53fff640 1 -- 172.21.15.26:0/1772024661 >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 msgr2=0x7f8b5c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T11:11:52.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:52.497+0000 7f8b53fff640 1 -- 172.21.15.26:0/1772024661 >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 msgr2=0x7f8b5c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T11:11:52.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:52.497+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 0x7f8b5c0cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T11:11:52.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:52.497+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 0x7f8b5c0cfb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-14T11:11:52.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:52.497+0000 7f8b5a59c640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b5c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:52.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:52.497+0000 7f8b5a59c640 1 -- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 msgr2=0x7f8b5c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T11:11:52.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:52.497+0000 7f8b5a59c640 1 -- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 msgr2=0x7f8b5c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T11:11:52.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:52.497+0000 7f8b5a59c640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b5c0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T11:11:52.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:52.497+0000 7f8b5a59c640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b5c0d0f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-14T11:11:53.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:53.301+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 0x7f8b5c0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:53.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:53.301+0000 7f8b53fff640 1 -- 172.21.15.26:0/1772024661 >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 msgr2=0x7f8b5c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T11:11:53.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:53.301+0000 7f8b53fff640 1 -- 172.21.15.26:0/1772024661 >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 msgr2=0x7f8b5c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T11:11:53.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:53.301+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 0x7f8b5c0cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T11:11:53.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:53.301+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 0x7f8b5c0cfb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-14T11:11:53.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:53.301+0000 7f8b5a59c640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b5c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:53.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:53.301+0000 7f8b5a59c640 1 -- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 msgr2=0x7f8b5c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T11:11:53.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:53.301+0000 7f8b5a59c640 1 -- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 msgr2=0x7f8b5c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T11:11:53.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:53.301+0000 7f8b5a59c640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b5c0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T11:11:53.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:53.301+0000 7f8b5a59c640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b5c0d0f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-14T11:11:54.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:54.889+0000 7f8b58d99640 1 -- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 msgr2=0x7f8b5c0d0f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T11:11:54.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:54.889+0000 7f8b58d99640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b5c0d0f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:54.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:54.889+0000 7f8b58d99640 1 -- 172.21.15.26:0/1772024661 >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 msgr2=0x7f8b5c0cfb00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T11:11:54.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:54.889+0000 7f8b58d99640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.26:3300/0 conn(0x7f8b5c0b84e0 0x7f8b5c0cfb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:54.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:54.889+0000 7f8b58d99640 1 -- 172.21.15.26:0/1772024661 >> v1:172.21.15.110:6789/0 conn(0x7f8b5c0d0040 legacy=0x7f8b5c0d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:54.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:54.889+0000 7f8b58d99640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 0x7f8b3c009820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:54.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:54.889+0000 7f8b58d99640 1 -- 172.21.15.26:0/1772024661 --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5c0d1950 con 0x7f8b3c0036f0 2023-10-14T11:11:54.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:54.889+0000 7f8b58d99640 1 -- 172.21.15.26:0/1772024661 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5c0d1460 con 0x7f8b3c007360 2023-10-14T11:11:54.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:54.889+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 0x7f8b3c009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:54.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:54.889+0000 7f8b53fff640 1 -- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 msgr2=0x7f8b3c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T11:11:54.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:54.889+0000 7f8b53fff640 1 -- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 msgr2=0x7f8b3c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T11:11:54.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:54.889+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 0x7f8b3c009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T11:11:54.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:54.889+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 0x7f8b3c009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T11:11:55.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:55.093+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 0x7f8b3c009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:55.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:55.093+0000 7f8b53fff640 1 -- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 msgr2=0x7f8b3c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T11:11:55.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:55.093+0000 7f8b53fff640 1 -- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 msgr2=0x7f8b3c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T11:11:55.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:55.093+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 0x7f8b3c009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T11:11:55.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:55.093+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 0x7f8b3c009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-14T11:11:55.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:55.497+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 0x7f8b3c009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:55.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:55.497+0000 7f8b53fff640 1 -- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 msgr2=0x7f8b3c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T11:11:55.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:55.497+0000 7f8b53fff640 1 -- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 msgr2=0x7f8b3c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T11:11:55.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:55.497+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 0x7f8b3c009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T11:11:55.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:55.497+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 0x7f8b3c009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-14T11:11:56.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:56.301+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 0x7f8b3c009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:56.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:56.301+0000 7f8b53fff640 1 -- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 msgr2=0x7f8b3c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T11:11:56.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:56.301+0000 7f8b53fff640 1 -- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 msgr2=0x7f8b3c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T11:11:56.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:56.301+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 0x7f8b3c009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T11:11:56.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:56.301+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 0x7f8b3c009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-14T11:11:57.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.045+0000 7f8b59d9b640 1 -- 172.21.15.26:0/1772024661 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1712230401 0 0) 0x7f8b5c0d1950 con 0x7f8b3c0036f0 2023-10-14T11:11:57.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.045+0000 7f8b59d9b640 1 -- 172.21.15.26:0/1772024661 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b48003530 con 0x7f8b3c0036f0 2023-10-14T11:11:57.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.049+0000 7f8b59d9b640 1 -- 172.21.15.26:0/1772024661 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2301603736 0 0) 0x7f8b48003530 con 0x7f8b3c0036f0 2023-10-14T11:11:57.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.049+0000 7f8b59d9b640 1 -- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 msgr2=0x7f8b3c009820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T11:11:57.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.049+0000 7f8b59d9b640 1 --2- 172.21.15.26:0/1772024661 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c007360 0x7f8b3c009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:57.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.049+0000 7f8b59d9b640 1 -- 172.21.15.26:0/1772024661 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c00af20 con 0x7f8b3c0036f0 2023-10-14T11:11:57.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.049+0000 7f8b59d9b640 1 -- 172.21.15.26:0/1772024661 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f8b4c00e510 con 0x7f8b3c0036f0 2023-10-14T11:11:57.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.049+0000 7f8b59d9b640 1 -- 172.21.15.26:0/1772024661 >> v1:172.21.15.26:6789/0 conn(0x7f8b3c0036f0 legacy=0x7f8b3c005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:57.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.049+0000 7f8b59d9b640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b480039d0 0x7f8b48003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:57.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.049+0000 7f8b59d9b640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b480047d0 0x7f8b48004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:57.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.049+0000 7f8b59d9b640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b4800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:57.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.049+0000 7f8b5ad9d640 1 -- 172.21.15.26:0/1772024661 reap_dead start 2023-10-14T11:11:57.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.049+0000 7f8b59d9b640 1 -- 172.21.15.26:0/1772024661 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c0d1460 con 0x7f8b480047d0 2023-10-14T11:11:57.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.049+0000 7f8b59d9b640 1 -- 172.21.15.26:0/1772024661 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480055d0 con 0x7f8b480039d0 2023-10-14T11:11:57.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.049+0000 7f8b59d9b640 1 -- 172.21.15.26:0/1772024661 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4800bed0 con 0x7f8b5c15cba0 2023-10-14T11:11:57.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.049+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b480047d0 0x7f8b48004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:57.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.049+0000 7f8b5ad9d640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b4800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:57.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.049+0000 7f8b5a59c640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b480039d0 0x7f8b48003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:57.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.049+0000 7f8b5ad9d640 1 -- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b480039d0 msgr2=0x7f8b48003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:11:57.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.049+0000 7f8b5ad9d640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b480039d0 0x7f8b48003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:57.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.049+0000 7f8b5ad9d640 1 -- 172.21.15.26:0/1772024661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b480047d0 msgr2=0x7f8b48004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:11:57.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.049+0000 7f8b5ad9d640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b480047d0 0x7f8b48004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:57.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.049+0000 7f8b5ad9d640 1 -- 172.21.15.26:0/1772024661 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b48003530 con 0x7f8b5c15cba0 2023-10-14T11:11:57.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.049+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b480047d0 0x7f8b48004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:11:57.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.053+0000 7f8b5ad9d640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b4800b990 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c0ced60 tx=0x7f8b5401c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5907f088cc96d19 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:11:57.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.053+0000 7f8b59d9b640 1 -- 172.21.15.26:0/1772024661 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b54005d50 con 0x7f8b5c15cba0 2023-10-14T11:11:57.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.053+0000 7f8b59d9b640 1 -- 172.21.15.26:0/1772024661 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b54003980 con 0x7f8b5c15cba0 2023-10-14T11:11:57.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.053+0000 7f8b59d9b640 1 -- 172.21.15.26:0/1772024661 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b54003d10 con 0x7f8b5c15cba0 2023-10-14T11:11:57.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.057+0000 7f8b60c9a640 1 -- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 msgr2=0x7f8b4800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:57.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.057+0000 7f8b60c9a640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b4800b990 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c0ced60 tx=0x7f8b5401c420 comp rx=0 tx=0).stop 2023-10-14T11:11:57.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.057+0000 7f8b60c9a640 1 -- 172.21.15.26:0/1772024661 shutdown_connections 2023-10-14T11:11:57.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.057+0000 7f8b60c9a640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b4800b990 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:57.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.057+0000 7f8b60c9a640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b480047d0 0x7f8b48004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:57.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.057+0000 7f8b60c9a640 1 --2- 172.21.15.26:0/1772024661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b480039d0 0x7f8b48003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:57.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.057+0000 7f8b60c9a640 1 -- 172.21.15.26:0/1772024661 >> 172.21.15.26:0/1772024661 conn(0x7f8b5c0719c0 msgr2=0x7f8b5c071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:11:57.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.057+0000 7f8b60c9a640 1 -- 172.21.15.26:0/1772024661 shutdown_connections 2023-10-14T11:11:57.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.057+0000 7f8b60c9a640 1 -- 172.21.15.26:0/1772024661 wait complete. 2023-10-14T11:11:57.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.057+0000 7f8b60c9a640 1 Processor -- start 2023-10-14T11:11:57.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.057+0000 7f8b60c9a640 1 -- start start 2023-10-14T11:11:57.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b60c9a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b480039d0 0x7f8b5c149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:57.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b60c9a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b480047d0 0x7f8b5c1f2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:57.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b60c9a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b5c15e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:57.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b60c9a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c15f6b0 con 0x7f8b480047d0 2023-10-14T11:11:57.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b60c9a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c14a250 con 0x7f8b480039d0 2023-10-14T11:11:57.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b60c9a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c15d020 con 0x7f8b5c15cba0 2023-10-14T11:11:57.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b53fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b480047d0 0x7f8b5c1f2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:57.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b53fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b480047d0 0x7f8b5c1f2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51276/0 (socket says 172.21.15.26:51276) 2023-10-14T11:11:57.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b53fff640 1 -- 172.21.15.26:0/1290188832 learned_addr learned my addr 172.21.15.26:0/1290188832 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:11:57.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b5a59c640 1 --2- 172.21.15.26:0/1290188832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b480039d0 0x7f8b5c149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:57.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b5ad9d640 1 --2- 172.21.15.26:0/1290188832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b5c15e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:57.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b53fff640 1 -- 172.21.15.26:0/1290188832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 msgr2=0x7f8b5c15e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:57.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1290188832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b5c15e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:57.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b53fff640 1 -- 172.21.15.26:0/1290188832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b480039d0 msgr2=0x7f8b5c149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:57.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1290188832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b480039d0 0x7f8b5c149d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:57.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b53fff640 1 -- 172.21.15.26:0/1290188832 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5c15d300 con 0x7f8b480047d0 2023-10-14T11:11:57.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b5a59c640 1 --2- 172.21.15.26:0/1290188832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b480039d0 0x7f8b5c149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:11:57.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b53fff640 1 --2- 172.21.15.26:0/1290188832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b480047d0 0x7f8b5c1f2a30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8b440169f0 tx=0x7f8b44016eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:11:57.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b52ffd640 1 -- 172.21.15.26:0/1290188832 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4401e050 con 0x7f8b480047d0 2023-10-14T11:11:57.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b52ffd640 1 -- 172.21.15.26:0/1290188832 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4401f040 con 0x7f8b480047d0 2023-10-14T11:11:57.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b52ffd640 1 -- 172.21.15.26:0/1290188832 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44023400 con 0x7f8b480047d0 2023-10-14T11:11:57.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b60c9a640 1 -- 172.21.15.26:0/1290188832 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b5c15d5e0 con 0x7f8b480047d0 2023-10-14T11:11:57.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b60c9a640 1 -- 172.21.15.26:0/1290188832 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b5c15dba0 con 0x7f8b480047d0 2023-10-14T11:11:57.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b52ffd640 1 -- 172.21.15.26:0/1290188832 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8b44005ca0 con 0x7f8b480047d0 2023-10-14T11:11:57.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b52ffd640 1 -- 172.21.15.26:0/1290188832 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8b44023560 con 0x7f8b480047d0 2023-10-14T11:11:57.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.061+0000 7f8b60c9a640 1 -- 172.21.15.26:0/1290188832 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b5c04e170 con 0x7f8b480047d0 2023-10-14T11:11:57.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.077+0000 7f8b52ffd640 1 -- 172.21.15.26:0/1290188832 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f8b44027020 con 0x7f8b480047d0 2023-10-14T11:11:57.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.141+0000 7f8b60c9a640 1 -- 172.21.15.26:0/1290188832 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f8b5c0d1240 con 0x7f8b480047d0 2023-10-14T11:11:57.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.145+0000 7f8b52ffd640 1 -- 172.21.15.26:0/1290188832 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8b44006000 con 0x7f8b480047d0 2023-10-14T11:11:57.146 INFO:teuthology.orchestra.run.smithi026.stderr:adjusted tunables profile to default 2023-10-14T11:11:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.145+0000 7f8b60c9a640 1 -- 172.21.15.26:0/1290188832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b480047d0 msgr2=0x7f8b5c1f2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.145+0000 7f8b60c9a640 1 --2- 172.21.15.26:0/1290188832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b480047d0 0x7f8b5c1f2a30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8b440169f0 tx=0x7f8b44016eb0 comp rx=0 tx=0).stop 2023-10-14T11:11:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.145+0000 7f8b60c9a640 1 -- 172.21.15.26:0/1290188832 shutdown_connections 2023-10-14T11:11:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.145+0000 7f8b60c9a640 1 --2- 172.21.15.26:0/1290188832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b5c15cba0 0x7f8b5c15e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.145+0000 7f8b60c9a640 1 --2- 172.21.15.26:0/1290188832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b480047d0 0x7f8b5c1f2a30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.145+0000 7f8b60c9a640 1 --2- 172.21.15.26:0/1290188832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b480039d0 0x7f8b5c149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.145+0000 7f8b60c9a640 1 -- 172.21.15.26:0/1290188832 >> 172.21.15.26:0/1290188832 conn(0x7f8b5c0719c0 msgr2=0x7f8b5c0d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:11:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.145+0000 7f8b60c9a640 1 -- 172.21.15.26:0/1290188832 shutdown_connections 2023-10-14T11:11:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:57.145+0000 7f8b60c9a640 1 -- 172.21.15.26:0/1290188832 wait complete. 2023-10-14T11:11:57.168 INFO:tasks.ceph:check_enable_crimson: False 2023-10-14T11:11:57.168 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-14T11:11:57.168 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:57.169 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-14T11:11:57.190 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:57.190 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-14T11:11:57.252 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:57.253 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-14T11:11:57.280 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:11:57.277+0000 7fe4cf10b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T11:11:57.302 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:11:57.302 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-14T11:11:57.365 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:11:57.366 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-14T11:11:57.390 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:11:57.391 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-14T11:11:57.452 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:11:57.452 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-14T11:11:57.520 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:11:57.520 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-14T11:11:57.584 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 25998260-202e-4090-9e28-3098039db5b8 0 2023-10-14T11:11:57.768 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.768+0000 7f1dc451d640 1 Processor -- start 2023-10-14T11:11:57.768 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.768+0000 7f1dc451d640 1 -- start start 2023-10-14T11:11:57.769 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.768+0000 7f1dc451d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dbc0b84e0 0x7f1dbc0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:57.770 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.768+0000 7f1dc451d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dbc0d1670 con 0x7f1dbc15cba0 2023-10-14T11:11:57.770 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.768+0000 7f1dc451d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dbc0d1950 con 0x7f1dbc0d0210 2023-10-14T11:11:57.770 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.768+0000 7f1dc451d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc0d1460 con 0x7f1dbc0b84e0 2023-10-14T11:11:57.770 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.768+0000 7f1dc1ab8640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f1dbc0d0210 0x7f1dbc0b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44476/0 (socket says 172.21.15.110:44476) 2023-10-14T11:11:57.770 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.768+0000 7f1dc1ab8640 1 -- 172.21.15.110:0/3791769093 learned_addr learned my addr 172.21.15.110:0/3791769093 (peer_addr_for_me v1:172.21.15.110:0/0) 2023-10-14T11:11:57.770 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.768+0000 7f1dc2aba640 1 --2- 172.21.15.110:0/3791769093 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dbc0b84e0 0x7f1dbc0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:57.771 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.768+0000 7f1dc12b7640 1 -- 172.21.15.110:0/3791769093 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475874600 0 0) 0x7f1dbc0d1950 con 0x7f1dbc0d0210 2023-10-14T11:11:57.772 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.768+0000 7f1dc12b7640 1 -- 172.21.15.110:0/3791769093 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1da8003530 con 0x7f1dbc0d0210 2023-10-14T11:11:57.772 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.768+0000 7f1dc2aba640 1 -- 172.21.15.110:0/3791769093 >> v1:172.21.15.110:6789/0 conn(0x7f1dbc0d0210 legacy=0x7f1dbc0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:57.773 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.768+0000 7f1dc2aba640 1 -- 172.21.15.110:0/3791769093 >> v1:172.21.15.26:6789/0 conn(0x7f1dbc15cba0 legacy=0x7f1dbc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:57.773 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.768+0000 7f1dc2aba640 1 -- 172.21.15.110:0/3791769093 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dbc0d1c30 con 0x7f1dbc0b84e0 2023-10-14T11:11:57.774 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.772+0000 7f1dc2aba640 1 --2- 172.21.15.110:0/3791769093 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dbc0b84e0 0x7f1dbc0d0f20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009dc0 tx=0x7f1db401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfa0e452395b091a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:11:57.775 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.772+0000 7f1dc12b7640 1 -- 172.21.15.110:0/3791769093 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db40a5a30 con 0x7f1dbc0b84e0 2023-10-14T11:11:57.775 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.772+0000 7f1dc12b7640 1 -- 172.21.15.110:0/3791769093 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db40a5b90 con 0x7f1dbc0b84e0 2023-10-14T11:11:57.775 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.772+0000 7f1dc12b7640 1 -- 172.21.15.110:0/3791769093 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db40ad440 con 0x7f1dbc0b84e0 2023-10-14T11:11:57.775 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.772+0000 7f1dc451d640 1 -- 172.21.15.110:0/3791769093 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dbc0b84e0 msgr2=0x7f1dbc0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:57.775 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.772+0000 7f1dc451d640 1 --2- 172.21.15.110:0/3791769093 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dbc0b84e0 0x7f1dbc0d0f20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009dc0 tx=0x7f1db401c970 comp rx=0 tx=0).stop 2023-10-14T11:11:57.775 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.772+0000 7f1dc451d640 1 -- 172.21.15.110:0/3791769093 shutdown_connections 2023-10-14T11:11:57.776 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.772+0000 7f1dc451d640 1 --2- 172.21.15.110:0/3791769093 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dbc0b84e0 0x7f1dbc0d0f20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:57.776 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.772+0000 7f1dc451d640 1 -- 172.21.15.110:0/3791769093 >> 172.21.15.110:0/3791769093 conn(0x7f1dbc0719c0 msgr2=0x7f1dbc071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:11:57.776 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.772+0000 7f1dc451d640 1 -- 172.21.15.110:0/3791769093 shutdown_connections 2023-10-14T11:11:57.776 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.772+0000 7f1dc451d640 1 -- 172.21.15.110:0/3791769093 wait complete. 2023-10-14T11:11:57.779 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc451d640 1 Processor -- start 2023-10-14T11:11:57.779 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc451d640 1 -- start start 2023-10-14T11:11:57.779 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc451d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dbc0b84e0 0x7f1dbc14f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:57.779 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc451d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dbc0d0210 0x7f1dbc14c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:57.780 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc451d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dbc15cba0 0x7f1dbc14d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:57.780 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc451d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc14eb60 con 0x7f1dbc15cba0 2023-10-14T11:11:57.780 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc451d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc14faf0 con 0x7f1dbc0d0210 2023-10-14T11:11:57.780 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc451d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc14cd70 con 0x7f1dbc0b84e0 2023-10-14T11:11:57.780 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc1ab8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dbc0d0210 0x7f1dbc14c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:57.781 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc22b9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dbc0b84e0 0x7f1dbc14f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:57.781 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc1ab8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dbc0d0210 0x7f1dbc14c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48972/0 (socket says 172.21.15.110:48972) 2023-10-14T11:11:57.781 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc1ab8640 1 -- 172.21.15.110:0/2015666692 learned_addr learned my addr 172.21.15.110:0/2015666692 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-14T11:11:57.781 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc2aba640 1 --2- 172.21.15.110:0/2015666692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dbc15cba0 0x7f1dbc14d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:57.781 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc22b9640 1 -- 172.21.15.110:0/2015666692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dbc0d0210 msgr2=0x7f1dbc14c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:57.782 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc22b9640 1 --2- 172.21.15.110:0/2015666692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dbc0d0210 0x7f1dbc14c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:57.782 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc22b9640 1 -- 172.21.15.110:0/2015666692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dbc15cba0 msgr2=0x7f1dbc14d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:57.782 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc22b9640 1 --2- 172.21.15.110:0/2015666692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dbc15cba0 0x7f1dbc14d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:57.782 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc22b9640 1 -- 172.21.15.110:0/2015666692 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db4009a70 con 0x7f1dbc0b84e0 2023-10-14T11:11:57.782 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc1ab8640 1 --2- 172.21.15.110:0/2015666692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dbc0d0210 0x7f1dbc14c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:11:57.783 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc22b9640 1 --2- 172.21.15.110:0/2015666692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dbc0b84e0 0x7f1dbc14f5b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1db8000f70 tx=0x7f1db800c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:11:57.783 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1db2ffd640 1 -- 172.21.15.110:0/2015666692 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db80052d0 con 0x7f1dbc0b84e0 2023-10-14T11:11:57.783 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1db2ffd640 1 -- 172.21.15.110:0/2015666692 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db8005430 con 0x7f1dbc0b84e0 2023-10-14T11:11:57.783 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1db2ffd640 1 -- 172.21.15.110:0/2015666692 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db8003840 con 0x7f1dbc0b84e0 2023-10-14T11:11:57.783 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc451d640 1 -- 172.21.15.110:0/2015666692 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dbc14e2b0 con 0x7f1dbc0b84e0 2023-10-14T11:11:57.784 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc451d640 1 -- 172.21.15.110:0/2015666692 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dbc14edb0 con 0x7f1dbc0b84e0 2023-10-14T11:11:57.784 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1db2ffd640 1 -- 172.21.15.110:0/2015666692 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1db8003ca0 con 0x7f1dbc0b84e0 2023-10-14T11:11:57.784 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1db2ffd640 1 -- 172.21.15.110:0/2015666692 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1db801c7d0 con 0x7f1dbc0b84e0 2023-10-14T11:11:57.784 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.776+0000 7f1dc451d640 1 -- 172.21.15.110:0/2015666692 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dbc04e170 con 0x7f1dbc0b84e0 2023-10-14T11:11:57.785 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.780+0000 7f1db2ffd640 1 -- 172.21.15.110:0/2015666692 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f1db8017070 con 0x7f1dbc0b84e0 2023-10-14T11:11:57.832 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:11:57.829+0000 7fe4cf10b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T11:11:57.846 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.844+0000 7f1dc451d640 1 -- 172.21.15.110:0/2015666692 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "25998260-202e-4090-9e28-3098039db5b8", "id": 0} v 0) v1 -- 0x7f1dbc0cedd0 con 0x7f1dbc0b84e0 2023-10-14T11:11:57.851 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.852+0000 7f1db2ffd640 1 -- 172.21.15.110:0/2015666692 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "25998260-202e-4090-9e28-3098039db5b8", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1db801c990 con 0x7f1dbc0b84e0 2023-10-14T11:11:57.851 INFO:teuthology.orchestra.run.smithi110.stdout:0 2023-10-14T11:11:57.852 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.852+0000 7f1dc451d640 1 -- 172.21.15.110:0/2015666692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dbc0b84e0 msgr2=0x7f1dbc14f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:57.852 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.852+0000 7f1dc451d640 1 --2- 172.21.15.110:0/2015666692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dbc0b84e0 0x7f1dbc14f5b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1db8000f70 tx=0x7f1db800c820 comp rx=0 tx=0).stop 2023-10-14T11:11:57.852 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.852+0000 7f1dc451d640 1 -- 172.21.15.110:0/2015666692 shutdown_connections 2023-10-14T11:11:57.853 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.852+0000 7f1dc451d640 1 --2- 172.21.15.110:0/2015666692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dbc15cba0 0x7f1dbc14d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:57.853 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.852+0000 7f1dc451d640 1 --2- 172.21.15.110:0/2015666692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dbc0d0210 0x7f1dbc14c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:57.853 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.852+0000 7f1dc451d640 1 --2- 172.21.15.110:0/2015666692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dbc0b84e0 0x7f1dbc14f5b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:57.853 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.852+0000 7f1dc451d640 1 -- 172.21.15.110:0/2015666692 >> 172.21.15.110:0/2015666692 conn(0x7f1dbc0719c0 msgr2=0x7f1dbc0d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:11:57.853 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.852+0000 7f1dc451d640 1 -- 172.21.15.110:0/2015666692 shutdown_connections 2023-10-14T11:11:57.854 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:57.852+0000 7f1dc451d640 1 -- 172.21.15.110:0/2015666692 wait complete. 2023-10-14T11:11:57.871 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 561dc692-04c6-4a51-85aa-a1490fbb8da7 1 2023-10-14T11:11:58.007 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.008+0000 7f335dc09640 1 Processor -- start 2023-10-14T11:11:58.008 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.008+0000 7f335dc09640 1 -- start start 2023-10-14T11:11:58.009 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.008+0000 7f335dc09640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f335815cc30 0x7f33580b8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.009 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.008+0000 7f335dc09640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f33580cd840 0x7f33580cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.009 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.008+0000 7f335dc09640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f335815d010 con 0x7f33580d0f90 2023-10-14T11:11:58.010 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.008+0000 7f335dc09640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33580b74d0 con 0x7f335815cc30 2023-10-14T11:11:58.010 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.008+0000 7f335dc09640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33580b77b0 con 0x7f33580cd840 2023-10-14T11:11:58.010 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.008+0000 7f3356ffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f33580cd840 0x7f33580cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.010 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.008+0000 7f3356ffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f33580cd840 0x7f33580cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49002/0 (socket says 172.21.15.110:49002) 2023-10-14T11:11:58.010 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.008+0000 7f3356ffd640 1 -- 172.21.15.110:0/1270543317 learned_addr learned my addr 172.21.15.110:0/1270543317 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-14T11:11:58.011 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.008+0000 7f33577fe640 1 --2- 172.21.15.110:0/1270543317 >> v2:172.21.15.26:3300/0 conn(0x7f335815cc30 0x7f33580b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.011 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.008+0000 7f3356ffd640 1 -- 172.21.15.110:0/1270543317 >> v2:172.21.15.26:3300/0 conn(0x7f335815cc30 msgr2=0x7f33580b8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:11:58.011 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.008+0000 7f3356ffd640 1 --2- 172.21.15.110:0/1270543317 >> v2:172.21.15.26:3300/0 conn(0x7f335815cc30 0x7f33580b8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.011 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.008+0000 7f3356ffd640 1 -- 172.21.15.110:0/1270543317 >> v1:172.21.15.26:6789/0 conn(0x7f33580d0f90 legacy=0x7f33580d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:11:58.011 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.008+0000 7f3356ffd640 1 -- 172.21.15.110:0/1270543317 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33580b7a90 con 0x7f33580cd840 2023-10-14T11:11:58.012 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.012+0000 7f3356ffd640 1 --2- 172.21.15.110:0/1270543317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33580cd840 0x7f33580cdc80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f33580cf430 tx=0x7f334c01ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2862cc1dbb02c5c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:11:58.012 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.012+0000 7f33567fc640 1 -- 172.21.15.110:0/1270543317 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c0a89b0 con 0x7f33580cd840 2023-10-14T11:11:58.013 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.012+0000 7f33567fc640 1 -- 172.21.15.110:0/1270543317 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c0a8b10 con 0x7f33580cd840 2023-10-14T11:11:58.013 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.012+0000 7f33567fc640 1 -- 172.21.15.110:0/1270543317 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c0a8ea0 con 0x7f33580cd840 2023-10-14T11:11:58.014 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.012+0000 7f335dc09640 1 -- 172.21.15.110:0/1270543317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33580cd840 msgr2=0x7f33580cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.014 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.012+0000 7f335dc09640 1 --2- 172.21.15.110:0/1270543317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33580cd840 0x7f33580cdc80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f33580cf430 tx=0x7f334c01ecb0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.014 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.012+0000 7f335dc09640 1 -- 172.21.15.110:0/1270543317 shutdown_connections 2023-10-14T11:11:58.014 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.012+0000 7f335dc09640 1 --2- 172.21.15.110:0/1270543317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33580cd840 0x7f33580cdc80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.015 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.012+0000 7f335dc09640 1 --2- 172.21.15.110:0/1270543317 >> v2:172.21.15.26:3300/0 conn(0x7f335815cc30 0x7f33580b8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.015 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.012+0000 7f335dc09640 1 -- 172.21.15.110:0/1270543317 >> 172.21.15.110:0/1270543317 conn(0x7f335806b750 msgr2=0x7f335806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:11:58.015 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.012+0000 7f335dc09640 1 -- 172.21.15.110:0/1270543317 shutdown_connections 2023-10-14T11:11:58.015 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.012+0000 7f335dc09640 1 -- 172.21.15.110:0/1270543317 wait complete. 2023-10-14T11:11:58.016 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f335dc09640 1 Processor -- start 2023-10-14T11:11:58.016 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f335dc09640 1 -- start start 2023-10-14T11:11:58.016 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f335dc09640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33580cd840 0x7f33581e7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.017 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f335dc09640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33580d0f90 0x7f33580c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.017 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f335dc09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f335815cc30 0x7f335814ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.017 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f335dc09640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33580ccaa0 con 0x7f335815cc30 2023-10-14T11:11:58.017 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f335dc09640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33580ca2b0 con 0x7f33580cd840 2023-10-14T11:11:58.017 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f335dc09640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33580ca590 con 0x7f33580d0f90 2023-10-14T11:11:58.019 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f3356ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33580d0f90 0x7f33580c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.019 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f33577fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33580cd840 0x7f33581e7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.019 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f3356ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33580d0f90 0x7f33580c9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:38146/0 (socket says 172.21.15.110:38146) 2023-10-14T11:11:58.020 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f3356ffd640 1 -- 172.21.15.110:0/247591946 learned_addr learned my addr 172.21.15.110:0/247591946 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-14T11:11:58.020 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f3357fff640 1 --2- 172.21.15.110:0/247591946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f335815cc30 0x7f335814ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.020 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f3356ffd640 1 -- 172.21.15.110:0/247591946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33580cd840 msgr2=0x7f33581e7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.020 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f3356ffd640 1 --2- 172.21.15.110:0/247591946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33580cd840 0x7f33581e7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.020 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f3356ffd640 1 -- 172.21.15.110:0/247591946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f335815cc30 msgr2=0x7f335814ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.021 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f3356ffd640 1 --2- 172.21.15.110:0/247591946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f335815cc30 0x7f335814ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.021 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f3356ffd640 1 -- 172.21.15.110:0/247591946 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334c0094d0 con 0x7f33580d0f90 2023-10-14T11:11:58.021 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f33577fe640 1 --2- 172.21.15.110:0/247591946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33580cd840 0x7f33581e7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:11:58.021 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f3356ffd640 1 --2- 172.21.15.110:0/247591946 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33580d0f90 0x7f33580c9c40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f334c0b3040 tx=0x7f334c01ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:11:58.021 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f333ffff640 1 -- 172.21.15.110:0/247591946 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c0b0e00 con 0x7f33580d0f90 2023-10-14T11:11:58.021 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f333ffff640 1 -- 172.21.15.110:0/247591946 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c0bb470 con 0x7f33580d0f90 2023-10-14T11:11:58.022 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f333ffff640 1 -- 172.21.15.110:0/247591946 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c0bb820 con 0x7f33580d0f90 2023-10-14T11:11:58.022 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f335dc09640 1 -- 172.21.15.110:0/247591946 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33580ca870 con 0x7f33580d0f90 2023-10-14T11:11:58.022 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f335dc09640 1 -- 172.21.15.110:0/247591946 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33580cae30 con 0x7f33580d0f90 2023-10-14T11:11:58.022 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f333ffff640 1 -- 172.21.15.110:0/247591946 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f334c0b7070 con 0x7f33580d0f90 2023-10-14T11:11:58.022 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.016+0000 7f333ffff640 1 -- 172.21.15.110:0/247591946 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f334c0c5950 con 0x7f33580d0f90 2023-10-14T11:11:58.023 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.020+0000 7f335dc09640 1 -- 172.21.15.110:0/247591946 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33580cb020 con 0x7f33580d0f90 2023-10-14T11:11:58.023 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.024+0000 7f333ffff640 1 -- 172.21.15.110:0/247591946 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f334c0b5070 con 0x7f33580d0f90 2023-10-14T11:11:58.045 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:11:58.045+0000 7fe4cf10b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T11:11:58.078 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:11:58.076+0000 7fd4a4d99180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T11:11:58.091 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.088+0000 7f335dc09640 1 -- 172.21.15.110:0/247591946 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "561dc692-04c6-4a51-85aa-a1490fbb8da7", "id": 1} v 0) v1 -- 0x7f33580cb020 con 0x7f33580d0f90 2023-10-14T11:11:58.095 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.096+0000 7f333ffff640 1 -- 172.21.15.110:0/247591946 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "561dc692-04c6-4a51-85aa-a1490fbb8da7", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f334c0c5460 con 0x7f33580d0f90 2023-10-14T11:11:58.095 INFO:teuthology.orchestra.run.smithi110.stdout:1 2023-10-14T11:11:58.096 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.096+0000 7f335dc09640 1 -- 172.21.15.110:0/247591946 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33580d0f90 msgr2=0x7f33580c9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.097 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.096+0000 7f335dc09640 1 --2- 172.21.15.110:0/247591946 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33580d0f90 0x7f33580c9c40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f334c0b3040 tx=0x7f334c01ba50 comp rx=0 tx=0).stop 2023-10-14T11:11:58.097 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.096+0000 7f335dc09640 1 -- 172.21.15.110:0/247591946 shutdown_connections 2023-10-14T11:11:58.097 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.096+0000 7f335dc09640 1 --2- 172.21.15.110:0/247591946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f335815cc30 0x7f335814ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.097 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.096+0000 7f335dc09640 1 --2- 172.21.15.110:0/247591946 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33580d0f90 0x7f33580c9c40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.097 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.096+0000 7f335dc09640 1 --2- 172.21.15.110:0/247591946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33580cd840 0x7f33581e7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.098 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.096+0000 7f335dc09640 1 -- 172.21.15.110:0/247591946 >> 172.21.15.110:0/247591946 conn(0x7f335806b750 msgr2=0x7f33581e77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:11:58.098 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.096+0000 7f335dc09640 1 -- 172.21.15.110:0/247591946 shutdown_connections 2023-10-14T11:11:58.098 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.096+0000 7f335dc09640 1 -- 172.21.15.110:0/247591946 wait complete. 2023-10-14T11:11:58.115 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 0e76b99e-ec38-4aec-a55d-c4c13944e199 2 2023-10-14T11:11:58.251 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.248+0000 7efea9794640 1 Processor -- start 2023-10-14T11:11:58.251 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.248+0000 7efea9794640 1 -- start start 2023-10-14T11:11:58.252 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.252+0000 7efea9794640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efea415cba0 0x7efea40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.252 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.252+0000 7efea9794640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efea40d0210 0x7efea40b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.253 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.252+0000 7efea9794640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea40d1670 con 0x7efea40b84e0 2023-10-14T11:11:58.253 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.252+0000 7efea9794640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea40d1460 con 0x7efea415cba0 2023-10-14T11:11:58.253 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.252+0000 7efea9794640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea40d1950 con 0x7efea40d0210 2023-10-14T11:11:58.253 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.252+0000 7efea37fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efea40d0210 0x7efea40b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.253 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.252+0000 7efea37fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efea40d0210 0x7efea40b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49018/0 (socket says 172.21.15.110:49018) 2023-10-14T11:11:58.254 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.252+0000 7efea37fe640 1 -- 172.21.15.110:0/3078835699 learned_addr learned my addr 172.21.15.110:0/3078835699 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-14T11:11:58.254 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.252+0000 7efea2ffd640 1 --2- 172.21.15.110:0/3078835699 >> v2:172.21.15.26:3300/0 conn(0x7efea415cba0 0x7efea40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.255 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.252+0000 7efea37fe640 1 -- 172.21.15.110:0/3078835699 >> v2:172.21.15.26:3300/0 conn(0x7efea415cba0 msgr2=0x7efea40d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:11:58.255 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.252+0000 7efea37fe640 1 --2- 172.21.15.110:0/3078835699 >> v2:172.21.15.26:3300/0 conn(0x7efea415cba0 0x7efea40d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.255 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.252+0000 7efea37fe640 1 -- 172.21.15.110:0/3078835699 >> v1:172.21.15.26:6789/0 conn(0x7efea40b84e0 legacy=0x7efea40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.255 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.252+0000 7efea37fe640 1 -- 172.21.15.110:0/3078835699 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea40d1c30 con 0x7efea40d0210 2023-10-14T11:11:58.257 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.256+0000 7efea37fe640 1 --2- 172.21.15.110:0/3078835699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efea40d0210 0x7efea40b5cf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efea40ce450 tx=0x7efe9c01c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b38ed31afd529c2d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:11:58.258 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.256+0000 7efea1ffb640 1 -- 172.21.15.110:0/3078835699 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c0a5800 con 0x7efea40d0210 2023-10-14T11:11:58.258 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.256+0000 7efea1ffb640 1 -- 172.21.15.110:0/3078835699 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9c0a5960 con 0x7efea40d0210 2023-10-14T11:11:58.258 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.256+0000 7efea1ffb640 1 -- 172.21.15.110:0/3078835699 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c0a5cf0 con 0x7efea40d0210 2023-10-14T11:11:58.259 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.256+0000 7efea9794640 1 -- 172.21.15.110:0/3078835699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efea40d0210 msgr2=0x7efea40b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.259 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.256+0000 7efea9794640 1 --2- 172.21.15.110:0/3078835699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efea40d0210 0x7efea40b5cf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efea40ce450 tx=0x7efe9c01c940 comp rx=0 tx=0).stop 2023-10-14T11:11:58.260 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.256+0000 7efea9794640 1 -- 172.21.15.110:0/3078835699 shutdown_connections 2023-10-14T11:11:58.260 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.256+0000 7efea9794640 1 --2- 172.21.15.110:0/3078835699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efea40d0210 0x7efea40b5cf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.260 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.256+0000 7efea9794640 1 --2- 172.21.15.110:0/3078835699 >> v2:172.21.15.26:3300/0 conn(0x7efea415cba0 0x7efea40d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.260 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.256+0000 7efea9794640 1 -- 172.21.15.110:0/3078835699 >> 172.21.15.110:0/3078835699 conn(0x7efea40719c0 msgr2=0x7efea4071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:11:58.260 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.256+0000 7efea9794640 1 -- 172.21.15.110:0/3078835699 shutdown_connections 2023-10-14T11:11:58.261 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.256+0000 7efea9794640 1 -- 172.21.15.110:0/3078835699 wait complete. 2023-10-14T11:11:58.262 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.260+0000 7efea9794640 1 Processor -- start 2023-10-14T11:11:58.262 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.260+0000 7efea9794640 1 -- start start 2023-10-14T11:11:58.262 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.260+0000 7efea9794640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efea40b84e0 0x7efea41500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.262 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.260+0000 7efea9794640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efea40d0210 0x7efea414aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.263 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.260+0000 7efea9794640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efea415cba0 0x7efea40c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.263 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.260+0000 7efea9794640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea4150630 con 0x7efea40b84e0 2023-10-14T11:11:58.263 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.260+0000 7efea9794640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea414f090 con 0x7efea40d0210 2023-10-14T11:11:58.263 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.260+0000 7efea9794640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea414f330 con 0x7efea415cba0 2023-10-14T11:11:58.263 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.260+0000 7efea27fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efea40d0210 0x7efea414aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.264 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.260+0000 7efea2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efea40b84e0 0x7efea41500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.264 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.260+0000 7efea37fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efea415cba0 0x7efea40c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.264 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.260+0000 7efea27fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efea40d0210 0x7efea414aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49022/0 (socket says 172.21.15.110:49022) 2023-10-14T11:11:58.264 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.260+0000 7efea27fc640 1 -- 172.21.15.110:0/3902524746 learned_addr learned my addr 172.21.15.110:0/3902524746 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-14T11:11:58.265 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.260+0000 7efea27fc640 1 -- 172.21.15.110:0/3902524746 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efea415cba0 msgr2=0x7efea40c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.266 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.260+0000 7efea27fc640 1 --2- 172.21.15.110:0/3902524746 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efea415cba0 0x7efea40c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.266 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.260+0000 7efea27fc640 1 -- 172.21.15.110:0/3902524746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efea40b84e0 msgr2=0x7efea41500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.266 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.260+0000 7efea27fc640 1 --2- 172.21.15.110:0/3902524746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efea40b84e0 0x7efea41500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.267 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.260+0000 7efea27fc640 1 -- 172.21.15.110:0/3902524746 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c009b30 con 0x7efea40d0210 2023-10-14T11:11:58.268 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.260+0000 7efea27fc640 1 --2- 172.21.15.110:0/3902524746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efea40d0210 0x7efea414aa50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efe9800c500 tx=0x7efe9800c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:11:58.268 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.264+0000 7efe8b7fe640 1 -- 172.21.15.110:0/3902524746 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe98005220 con 0x7efea40d0210 2023-10-14T11:11:58.268 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.264+0000 7efe8b7fe640 1 -- 172.21.15.110:0/3902524746 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe98005380 con 0x7efea40d0210 2023-10-14T11:11:58.268 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.264+0000 7efe8b7fe640 1 -- 172.21.15.110:0/3902524746 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe98007270 con 0x7efea40d0210 2023-10-14T11:11:58.268 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.264+0000 7efea9794640 1 -- 172.21.15.110:0/3902524746 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea414f610 con 0x7efea40d0210 2023-10-14T11:11:58.269 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.264+0000 7efea9794640 1 -- 172.21.15.110:0/3902524746 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea414fbd0 con 0x7efea40d0210 2023-10-14T11:11:58.269 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.264+0000 7efe8b7fe640 1 -- 172.21.15.110:0/3902524746 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efe980067e0 con 0x7efea40d0210 2023-10-14T11:11:58.269 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.264+0000 7efe8b7fe640 1 -- 172.21.15.110:0/3902524746 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7efe98012630 con 0x7efea40d0210 2023-10-14T11:11:58.269 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.264+0000 7efea9794640 1 -- 172.21.15.110:0/3902524746 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea414fdf0 con 0x7efea40d0210 2023-10-14T11:11:58.279 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.280+0000 7efe8b7fe640 1 -- 172.21.15.110:0/3902524746 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7efe98016020 con 0x7efea40d0210 2023-10-14T11:11:58.344 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.344+0000 7efea9794640 1 -- 172.21.15.110:0/3902524746 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0e76b99e-ec38-4aec-a55d-c4c13944e199", "id": 2} v 0) v1 -- 0x7efea40d1290 con 0x7efea40d0210 2023-10-14T11:11:58.348 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.348+0000 7efe8b7fe640 1 -- 172.21.15.110:0/3902524746 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0e76b99e-ec38-4aec-a55d-c4c13944e199", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7efe9802a0b0 con 0x7efea40d0210 2023-10-14T11:11:58.348 INFO:teuthology.orchestra.run.smithi110.stdout:2 2023-10-14T11:11:58.349 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.348+0000 7efea9794640 1 -- 172.21.15.110:0/3902524746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efea40d0210 msgr2=0x7efea414aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.349 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.348+0000 7efea9794640 1 --2- 172.21.15.110:0/3902524746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efea40d0210 0x7efea414aa50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efe9800c500 tx=0x7efe9800c9c0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.350 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.348+0000 7efea9794640 1 -- 172.21.15.110:0/3902524746 shutdown_connections 2023-10-14T11:11:58.350 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.348+0000 7efea9794640 1 --2- 172.21.15.110:0/3902524746 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efea415cba0 0x7efea40c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.350 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.348+0000 7efea9794640 1 --2- 172.21.15.110:0/3902524746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efea40d0210 0x7efea414aa50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.350 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.348+0000 7efea9794640 1 --2- 172.21.15.110:0/3902524746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efea40b84e0 0x7efea41500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.350 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.348+0000 7efea9794640 1 -- 172.21.15.110:0/3902524746 >> 172.21.15.110:0/3902524746 conn(0x7efea40719c0 msgr2=0x7efea40b70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:11:58.351 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.348+0000 7efea9794640 1 -- 172.21.15.110:0/3902524746 shutdown_connections 2023-10-14T11:11:58.351 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.348+0000 7efea9794640 1 -- 172.21.15.110:0/3902524746 wait complete. 2023-10-14T11:11:58.367 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32 3 2023-10-14T11:11:58.502 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.500+0000 7fded9362640 1 Processor -- start 2023-10-14T11:11:58.502 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.500+0000 7fded9362640 1 -- start start 2023-10-14T11:11:58.504 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.500+0000 7fded9362640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fded40cd910 0x7fded40d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.504 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.500+0000 7fded9362640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fded40d2b80 0x7fded406ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.504 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.500+0000 7fded9362640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded415ce60 con 0x7fded415ca80 2023-10-14T11:11:58.505 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.500+0000 7fded9362640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded406b310 con 0x7fded40cd910 2023-10-14T11:11:58.505 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.500+0000 7fded9362640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded406b5f0 con 0x7fded40d2b80 2023-10-14T11:11:58.505 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.504+0000 7fded8b61640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fded40d2b80 0x7fded406ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.505 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.504+0000 7fded3fff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fded415ca80 0x7fded40cd200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44478/0 (socket says 172.21.15.110:44478) 2023-10-14T11:11:58.506 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.504+0000 7fded3fff640 1 -- 172.21.15.110:0/1616407401 learned_addr learned my addr 172.21.15.110:0/1616407401 (peer_addr_for_me v1:172.21.15.110:0/0) 2023-10-14T11:11:58.506 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.504+0000 7fded37fe640 1 --2- 172.21.15.110:0/1616407401 >> v2:172.21.15.26:3300/0 conn(0x7fded40cd910 0x7fded40d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.506 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.504+0000 7fded8b61640 1 -- 172.21.15.110:0/1616407401 >> v2:172.21.15.26:3300/0 conn(0x7fded40cd910 msgr2=0x7fded40d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:11:58.506 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.504+0000 7fded8b61640 1 --2- 172.21.15.110:0/1616407401 >> v2:172.21.15.26:3300/0 conn(0x7fded40cd910 0x7fded40d2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.507 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.504+0000 7fded8b61640 1 -- 172.21.15.110:0/1616407401 >> v1:172.21.15.110:6789/0 conn(0x7fded415ca80 legacy=0x7fded40cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.507 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.504+0000 7fded8b61640 1 -- 172.21.15.110:0/1616407401 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded40cf160 con 0x7fded40d2b80 2023-10-14T11:11:58.508 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.504+0000 7fded8b61640 1 --2- 172.21.15.110:0/1616407401 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fded40d2b80 0x7fded406ba80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdecc009d90 tx=0x7fdecc01c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cbcbba7e2969c49 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:11:58.508 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.504+0000 7fded2ffd640 1 -- 172.21.15.110:0/1616407401 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc0a5980 con 0x7fded40d2b80 2023-10-14T11:11:58.509 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.504+0000 7fded2ffd640 1 -- 172.21.15.110:0/1616407401 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdecc0a5ae0 con 0x7fded40d2b80 2023-10-14T11:11:58.509 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.504+0000 7fded2ffd640 1 -- 172.21.15.110:0/1616407401 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc0a5e70 con 0x7fded40d2b80 2023-10-14T11:11:58.509 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.508+0000 7fded9362640 1 -- 172.21.15.110:0/1616407401 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fded40d2b80 msgr2=0x7fded406ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.509 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.508+0000 7fded9362640 1 --2- 172.21.15.110:0/1616407401 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fded40d2b80 0x7fded406ba80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdecc009d90 tx=0x7fdecc01c8c0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.509 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.508+0000 7fded9362640 1 -- 172.21.15.110:0/1616407401 shutdown_connections 2023-10-14T11:11:58.510 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.508+0000 7fded9362640 1 --2- 172.21.15.110:0/1616407401 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fded40d2b80 0x7fded406ba80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.510 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.508+0000 7fded9362640 1 --2- 172.21.15.110:0/1616407401 >> v2:172.21.15.26:3300/0 conn(0x7fded40cd910 0x7fded40d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.510 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.508+0000 7fded9362640 1 -- 172.21.15.110:0/1616407401 >> 172.21.15.110:0/1616407401 conn(0x7fded408c230 msgr2=0x7fded409bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:11:58.510 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.508+0000 7fded9362640 1 -- 172.21.15.110:0/1616407401 shutdown_connections 2023-10-14T11:11:58.511 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.508+0000 7fded9362640 1 -- 172.21.15.110:0/1616407401 wait complete. 2023-10-14T11:11:58.513 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.508+0000 7fded9362640 1 Processor -- start 2023-10-14T11:11:58.513 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.508+0000 7fded9362640 1 -- start start 2023-10-14T11:11:58.514 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.508+0000 7fded9362640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fded40cd910 0x7fded41556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.514 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.508+0000 7fded9362640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fded40d2b80 0x7fded4152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.514 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.508+0000 7fded9362640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fded415ca80 0x7fded40afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.515 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.508+0000 7fded9362640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded4153350 con 0x7fded40cd910 2023-10-14T11:11:58.515 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.508+0000 7fded9362640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded40c9410 con 0x7fded415ca80 2023-10-14T11:11:58.515 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.508+0000 7fded9362640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded4156250 con 0x7fded40d2b80 2023-10-14T11:11:58.515 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.508+0000 7fded37fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fded40d2b80 0x7fded4152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.516 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.508+0000 7fded8b61640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fded415ca80 0x7fded40afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.516 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.508+0000 7fded3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fded40cd910 0x7fded41556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.516 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.508+0000 7fded8b61640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fded415ca80 0x7fded40afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49032/0 (socket says 172.21.15.110:49032) 2023-10-14T11:11:58.517 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.508+0000 7fded8b61640 1 -- 172.21.15.110:0/1116327777 learned_addr learned my addr 172.21.15.110:0/1116327777 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-14T11:11:58.517 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.512+0000 7fded8b61640 1 -- 172.21.15.110:0/1116327777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fded40d2b80 msgr2=0x7fded4152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.517 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.512+0000 7fded8b61640 1 --2- 172.21.15.110:0/1116327777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fded40d2b80 0x7fded4152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.517 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.512+0000 7fded8b61640 1 -- 172.21.15.110:0/1116327777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fded40cd910 msgr2=0x7fded41556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.517 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.512+0000 7fded8b61640 1 --2- 172.21.15.110:0/1116327777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fded40cd910 0x7fded41556f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.518 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.512+0000 7fded8b61640 1 -- 172.21.15.110:0/1116327777 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc009a70 con 0x7fded415ca80 2023-10-14T11:11:58.518 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.512+0000 7fded3fff640 1 --2- 172.21.15.110:0/1116327777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fded40cd910 0x7fded41556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:11:58.518 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.512+0000 7fded8b61640 1 --2- 172.21.15.110:0/1116327777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fded415ca80 0x7fded40afa80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdecc01af70 tx=0x7fdecc019660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:11:58.518 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.512+0000 7fded0ff9640 1 -- 172.21.15.110:0/1116327777 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc0b9860 con 0x7fded415ca80 2023-10-14T11:11:58.519 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.512+0000 7fded0ff9640 1 -- 172.21.15.110:0/1116327777 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdecc0b99c0 con 0x7fded415ca80 2023-10-14T11:11:58.519 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.512+0000 7fded0ff9640 1 -- 172.21.15.110:0/1116327777 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc0b9d30 con 0x7fded415ca80 2023-10-14T11:11:58.519 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.512+0000 7fded9362640 1 -- 172.21.15.110:0/1116327777 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded4156530 con 0x7fded415ca80 2023-10-14T11:11:58.519 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.512+0000 7fded9362640 1 -- 172.21.15.110:0/1116327777 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded40c90a0 con 0x7fded415ca80 2023-10-14T11:11:58.519 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.512+0000 7fded0ff9640 1 -- 172.21.15.110:0/1116327777 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdecc0ad740 con 0x7fded415ca80 2023-10-14T11:11:58.519 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.512+0000 7fded0ff9640 1 -- 172.21.15.110:0/1116327777 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fdecc0c2b10 con 0x7fded415ca80 2023-10-14T11:11:58.520 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.512+0000 7fded9362640 1 -- 172.21.15.110:0/1116327777 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded41560b0 con 0x7fded415ca80 2023-10-14T11:11:58.520 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.516+0000 7fded0ff9640 1 -- 172.21.15.110:0/1116327777 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fdecc0e0b40 con 0x7fded415ca80 2023-10-14T11:11:58.581 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.580+0000 7fded9362640 1 -- 172.21.15.110:0/1116327777 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32", "id": 3} v 0) v1 -- 0x7fded41534d0 con 0x7fded415ca80 2023-10-14T11:11:58.585 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.584+0000 7fded0ff9640 1 -- 172.21.15.110:0/1116327777 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fded41534d0 con 0x7fded415ca80 2023-10-14T11:11:58.586 INFO:teuthology.orchestra.run.smithi110.stdout:3 2023-10-14T11:11:58.587 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.584+0000 7fded9362640 1 -- 172.21.15.110:0/1116327777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fded415ca80 msgr2=0x7fded40afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.588 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.584+0000 7fded9362640 1 --2- 172.21.15.110:0/1116327777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fded415ca80 0x7fded40afa80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdecc01af70 tx=0x7fdecc019660 comp rx=0 tx=0).stop 2023-10-14T11:11:58.588 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.584+0000 7fded9362640 1 -- 172.21.15.110:0/1116327777 shutdown_connections 2023-10-14T11:11:58.588 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.584+0000 7fded9362640 1 --2- 172.21.15.110:0/1116327777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fded415ca80 0x7fded40afa80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.589 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.584+0000 7fded9362640 1 --2- 172.21.15.110:0/1116327777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fded40d2b80 0x7fded4152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.589 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.584+0000 7fded9362640 1 --2- 172.21.15.110:0/1116327777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fded40cd910 0x7fded41556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.589 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.584+0000 7fded9362640 1 -- 172.21.15.110:0/1116327777 >> 172.21.15.110:0/1116327777 conn(0x7fded408c230 msgr2=0x7fded40d2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:11:58.590 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.584+0000 7fded9362640 1 -- 172.21.15.110:0/1116327777 shutdown_connections 2023-10-14T11:11:58.590 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.584+0000 7fded9362640 1 -- 172.21.15.110:0/1116327777 wait complete. 2023-10-14T11:11:58.605 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 155ec5fc-cdfd-468c-9b87-48b7d568181b 4 2023-10-14T11:11:58.657 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:11:58.656+0000 7fd4a4d99180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T11:11:58.715 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:11:58.713+0000 7fe4cf10b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T11:11:58.742 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.740+0000 7f3ef1a46640 1 Processor -- start 2023-10-14T11:11:58.742 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.740+0000 7f3ef1a46640 1 -- start start 2023-10-14T11:11:58.743 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.740+0000 7f3ef1a46640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3eec15cba0 0x7f3eec0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.743 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.744+0000 7f3ef1a46640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eec0d1670 con 0x7f3eec0d0210 2023-10-14T11:11:58.744 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.744+0000 7f3ef1a46640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eec0d1950 con 0x7f3eec0b84e0 2023-10-14T11:11:58.744 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.744+0000 7f3ef1a46640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eec0d1460 con 0x7f3eec15cba0 2023-10-14T11:11:58.744 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.744+0000 7f3ee27fc640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f3eec0b84e0 0x7f3eec0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44480/0 (socket says 172.21.15.110:44480) 2023-10-14T11:11:58.744 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.744+0000 7f3ee27fc640 1 -- 172.21.15.110:0/3410519701 learned_addr learned my addr 172.21.15.110:0/3410519701 (peer_addr_for_me v1:172.21.15.110:0/0) 2023-10-14T11:11:58.744 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.744+0000 7f3eeaffd640 1 --2- 172.21.15.110:0/3410519701 >> v2:172.21.15.26:3300/0 conn(0x7f3eec15cba0 0x7f3eec0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.745 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.744+0000 7f3eea7fc640 1 -- 172.21.15.110:0/3410519701 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782947069 0 0) 0x7f3eec0d1950 con 0x7f3eec0b84e0 2023-10-14T11:11:58.745 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.744+0000 7f3eea7fc640 1 -- 172.21.15.110:0/3410519701 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ed8003530 con 0x7f3eec0b84e0 2023-10-14T11:11:58.745 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.744+0000 7f3eeaffd640 1 -- 172.21.15.110:0/3410519701 >> v1:172.21.15.110:6789/0 conn(0x7f3eec0b84e0 legacy=0x7f3eec0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.746 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.744+0000 7f3eeaffd640 1 -- 172.21.15.110:0/3410519701 >> v1:172.21.15.26:6789/0 conn(0x7f3eec0d0210 legacy=0x7f3eec0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.746 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.744+0000 7f3eeaffd640 1 -- 172.21.15.110:0/3410519701 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec0d1c30 con 0x7f3eec15cba0 2023-10-14T11:11:58.747 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.748+0000 7f3eeaffd640 1 --2- 172.21.15.110:0/3410519701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eec15cba0 0x7f3eec0d0f20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0097c0 tx=0x7f3edc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7897d48f0daa6247 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:11:58.747 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.748+0000 7f3eea7fc640 1 -- 172.21.15.110:0/3410519701 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc0ab5f0 con 0x7f3eec15cba0 2023-10-14T11:11:58.747 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.748+0000 7f3eea7fc640 1 -- 172.21.15.110:0/3410519701 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc0ab750 con 0x7f3eec15cba0 2023-10-14T11:11:58.748 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.748+0000 7f3eea7fc640 1 -- 172.21.15.110:0/3410519701 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc0abae0 con 0x7f3eec15cba0 2023-10-14T11:11:58.749 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.748+0000 7f3ef1a46640 1 -- 172.21.15.110:0/3410519701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eec15cba0 msgr2=0x7f3eec0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.749 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.748+0000 7f3ef1a46640 1 --2- 172.21.15.110:0/3410519701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eec15cba0 0x7f3eec0d0f20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0097c0 tx=0x7f3edc01c3f0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.749 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.748+0000 7f3ef1a46640 1 -- 172.21.15.110:0/3410519701 shutdown_connections 2023-10-14T11:11:58.749 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.748+0000 7f3ef1a46640 1 --2- 172.21.15.110:0/3410519701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eec15cba0 0x7f3eec0d0f20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.749 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.748+0000 7f3ef1a46640 1 -- 172.21.15.110:0/3410519701 >> 172.21.15.110:0/3410519701 conn(0x7f3eec0719c0 msgr2=0x7f3eec071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:11:58.750 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.748+0000 7f3ef1a46640 1 -- 172.21.15.110:0/3410519701 shutdown_connections 2023-10-14T11:11:58.750 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.748+0000 7f3ef1a46640 1 -- 172.21.15.110:0/3410519701 wait complete. 2023-10-14T11:11:58.751 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.748+0000 7f3ef1a46640 1 Processor -- start 2023-10-14T11:11:58.752 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.748+0000 7f3ef1a46640 1 -- start start 2023-10-14T11:11:58.752 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3ef1a46640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eec0b84e0 0x7f3eec0c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.752 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3ef1a46640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3eec0d0210 0x7f3eec14e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.753 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3ef1a46640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3eec15cba0 0x7f3eec152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.753 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3ef1a46640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0c8620 con 0x7f3eec0b84e0 2023-10-14T11:11:58.753 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3ef1a46640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0cb630 con 0x7f3eec15cba0 2023-10-14T11:11:58.753 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3ef1a46640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0c9450 con 0x7f3eec0d0210 2023-10-14T11:11:58.753 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3ee27fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3eec0d0210 0x7f3eec14e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.754 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3eeb7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3eec15cba0 0x7f3eec152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.754 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3eeaffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eec0b84e0 0x7f3eec0c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.754 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3ee27fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3eec0d0210 0x7f3eec14e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:38192/0 (socket says 172.21.15.110:38192) 2023-10-14T11:11:58.754 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3ee27fc640 1 -- 172.21.15.110:0/461612016 learned_addr learned my addr 172.21.15.110:0/461612016 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-14T11:11:58.755 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3eeaffd640 1 -- 172.21.15.110:0/461612016 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3eec0d0210 msgr2=0x7f3eec14e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.755 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3eeaffd640 1 --2- 172.21.15.110:0/461612016 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3eec0d0210 0x7f3eec14e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.755 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3eeaffd640 1 -- 172.21.15.110:0/461612016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3eec15cba0 msgr2=0x7f3eec152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.755 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3eeaffd640 1 --2- 172.21.15.110:0/461612016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3eec15cba0 0x7f3eec152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.756 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3eeaffd640 1 -- 172.21.15.110:0/461612016 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc009420 con 0x7f3eec0b84e0 2023-10-14T11:11:58.757 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3eeaffd640 1 --2- 172.21.15.110:0/461612016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eec0b84e0 0x7f3eec0c74d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0ac000 tx=0x7f3edc01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:11:58.757 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3ee8ff9640 1 -- 172.21.15.110:0/461612016 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc0bf610 con 0x7f3eec0b84e0 2023-10-14T11:11:58.757 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3ee8ff9640 1 -- 172.21.15.110:0/461612016 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc0bf790 con 0x7f3eec0b84e0 2023-10-14T11:11:58.757 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3ee8ff9640 1 -- 172.21.15.110:0/461612016 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc0bfb40 con 0x7f3eec0b84e0 2023-10-14T11:11:58.758 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3ef1a46640 1 -- 172.21.15.110:0/461612016 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eec0cad00 con 0x7f3eec0b84e0 2023-10-14T11:11:58.758 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3ef1a46640 1 -- 172.21.15.110:0/461612016 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eec0cb2c0 con 0x7f3eec0b84e0 2023-10-14T11:11:58.758 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3ee8ff9640 1 -- 172.21.15.110:0/461612016 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3edc0b5400 con 0x7f3eec0b84e0 2023-10-14T11:11:58.758 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3ee8ff9640 1 -- 172.21.15.110:0/461612016 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f3edc0a8050 con 0x7f3eec0b84e0 2023-10-14T11:11:58.758 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.752+0000 7f3ef1a46640 1 -- 172.21.15.110:0/461612016 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eec04e170 con 0x7f3eec0b84e0 2023-10-14T11:11:58.759 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.756+0000 7f3ee8ff9640 1 -- 172.21.15.110:0/461612016 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f3edc0b5750 con 0x7f3eec0b84e0 2023-10-14T11:11:58.781 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:11:58.781+0000 7fe4cf10b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T11:11:58.825 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.824+0000 7f3ef1a46640 1 -- 172.21.15.110:0/461612016 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd new", "uuid": "155ec5fc-cdfd-468c-9b87-48b7d568181b", "id": 4} v 0) v1 -- 0x7f3eec155690 con 0x7f3eec0b84e0 2023-10-14T11:11:58.827 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.828+0000 7f3ee8ff9640 1 -- 172.21.15.110:0/461612016 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "155ec5fc-cdfd-468c-9b87-48b7d568181b", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3edc0b59c0 con 0x7f3eec0b84e0 2023-10-14T11:11:58.827 INFO:teuthology.orchestra.run.smithi110.stdout:4 2023-10-14T11:11:58.829 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.828+0000 7f3ef1a46640 1 -- 172.21.15.110:0/461612016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eec0b84e0 msgr2=0x7f3eec0c74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.829 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.828+0000 7f3ef1a46640 1 --2- 172.21.15.110:0/461612016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eec0b84e0 0x7f3eec0c74d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0ac000 tx=0x7f3edc01ac30 comp rx=0 tx=0).stop 2023-10-14T11:11:58.829 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.828+0000 7f3ef1a46640 1 -- 172.21.15.110:0/461612016 shutdown_connections 2023-10-14T11:11:58.830 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.828+0000 7f3ef1a46640 1 --2- 172.21.15.110:0/461612016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3eec15cba0 0x7f3eec152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.830 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.828+0000 7f3ef1a46640 1 --2- 172.21.15.110:0/461612016 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3eec0d0210 0x7f3eec14e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.830 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.828+0000 7f3ef1a46640 1 --2- 172.21.15.110:0/461612016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eec0b84e0 0x7f3eec0c74d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.830 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.828+0000 7f3ef1a46640 1 -- 172.21.15.110:0/461612016 >> 172.21.15.110:0/461612016 conn(0x7f3eec0719c0 msgr2=0x7f3eec155bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:11:58.830 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.828+0000 7f3ef1a46640 1 -- 172.21.15.110:0/461612016 shutdown_connections 2023-10-14T11:11:58.831 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.828+0000 7f3ef1a46640 1 -- 172.21.15.110:0/461612016 wait complete. 2023-10-14T11:11:58.845 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:11:58.845+0000 7fe4cf10b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T11:11:58.848 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 040ef3ea-4707-4229-b251-0d951b8112a8 5 2023-10-14T11:11:58.868 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:11:58.868+0000 7fd4a4d99180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T11:11:58.939 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:11:58.937+0000 7fe4cf10b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T11:11:58.984 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.984+0000 7f668633e640 1 Processor -- start 2023-10-14T11:11:58.984 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.984+0000 7f668633e640 1 -- start start 2023-10-14T11:11:58.985 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.984+0000 7f668633e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f66800b84e0 0x7f66800d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.986 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.984+0000 7f668633e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66800d1670 con 0x7f66800d0210 2023-10-14T11:11:58.986 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.984+0000 7f668633e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66800d1950 con 0x7f668015cba0 2023-10-14T11:11:58.986 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.984+0000 7f668633e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66800d1460 con 0x7f66800b84e0 2023-10-14T11:11:58.986 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.984+0000 7f66848db640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f66800b84e0 0x7f66800d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.987 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.984+0000 7f667ffff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f668015cba0 0x7f66800cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44494/0 (socket says 172.21.15.110:44494) 2023-10-14T11:11:58.987 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.984+0000 7f667ffff640 1 -- 172.21.15.110:0/967846138 learned_addr learned my addr 172.21.15.110:0/967846138 (peer_addr_for_me v1:172.21.15.110:0/0) 2023-10-14T11:11:58.987 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.984+0000 7f66848db640 1 -- 172.21.15.110:0/967846138 >> v1:172.21.15.110:6789/0 conn(0x7f668015cba0 legacy=0x7f66800cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.987 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.984+0000 7f667effd640 1 -- 172.21.15.110:0/967846138 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1391699503 0 0) 0x7f66800d1950 con 0x7f668015cba0 2023-10-14T11:11:58.987 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.984+0000 7f66848db640 1 -- 172.21.15.110:0/967846138 >> v1:172.21.15.26:6789/0 conn(0x7f66800d0210 legacy=0x7f66800b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.988 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.984+0000 7f66848db640 1 -- 172.21.15.110:0/967846138 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66800d1c30 con 0x7f66800b84e0 2023-10-14T11:11:58.988 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.988+0000 7f66848db640 1 --2- 172.21.15.110:0/967846138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66800b84e0 0x7f66800d0f20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6678009d90 tx=0x7f667801c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85a60c671a5a9f68 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:11:58.990 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.988+0000 7f667effd640 1 -- 172.21.15.110:0/967846138 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66780a57b0 con 0x7f66800b84e0 2023-10-14T11:11:58.990 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.988+0000 7f667effd640 1 -- 172.21.15.110:0/967846138 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66780a5910 con 0x7f66800b84e0 2023-10-14T11:11:58.990 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.988+0000 7f667effd640 1 -- 172.21.15.110:0/967846138 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66780a5ca0 con 0x7f66800b84e0 2023-10-14T11:11:58.990 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.988+0000 7f668633e640 1 -- 172.21.15.110:0/967846138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66800b84e0 msgr2=0x7f66800d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.990 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.988+0000 7f668633e640 1 --2- 172.21.15.110:0/967846138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66800b84e0 0x7f66800d0f20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6678009d90 tx=0x7f667801c750 comp rx=0 tx=0).stop 2023-10-14T11:11:58.991 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.988+0000 7f668633e640 1 -- 172.21.15.110:0/967846138 shutdown_connections 2023-10-14T11:11:58.991 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.988+0000 7f668633e640 1 --2- 172.21.15.110:0/967846138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66800b84e0 0x7f66800d0f20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.991 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.988+0000 7f668633e640 1 -- 172.21.15.110:0/967846138 >> 172.21.15.110:0/967846138 conn(0x7f66800719c0 msgr2=0x7f6680071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:11:58.991 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.988+0000 7f668633e640 1 -- 172.21.15.110:0/967846138 shutdown_connections 2023-10-14T11:11:58.992 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.988+0000 7f668633e640 1 -- 172.21.15.110:0/967846138 wait complete. 2023-10-14T11:11:58.994 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f668633e640 1 Processor -- start 2023-10-14T11:11:58.994 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f668633e640 1 -- start start 2023-10-14T11:11:58.995 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f668633e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66800b84e0 0x7f66800c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.995 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f668633e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66800d0210 0x7f66801552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.995 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f668633e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f668015cba0 0x7f66800d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:58.995 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f668633e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66801557f0 con 0x7f668015cba0 2023-10-14T11:11:58.995 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f668633e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6680155ce0 con 0x7f66800d0210 2023-10-14T11:11:58.996 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f668633e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66800c61e0 con 0x7f66800b84e0 2023-10-14T11:11:58.996 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f667f7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66800d0210 0x7f66801552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.996 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f667ffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66800b84e0 0x7f66800c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.997 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f667f7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66800d0210 0x7f66801552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49070/0 (socket says 172.21.15.110:49070) 2023-10-14T11:11:58.997 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f667f7fe640 1 -- 172.21.15.110:0/918044857 learned_addr learned my addr 172.21.15.110:0/918044857 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-14T11:11:58.998 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f66848db640 1 --2- 172.21.15.110:0/918044857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f668015cba0 0x7f66800d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:58.998 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f667f7fe640 1 -- 172.21.15.110:0/918044857 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66800b84e0 msgr2=0x7f66800c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.998 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f667f7fe640 1 --2- 172.21.15.110:0/918044857 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66800b84e0 0x7f66800c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.999 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f667f7fe640 1 -- 172.21.15.110:0/918044857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f668015cba0 msgr2=0x7f66800d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:58.999 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f667f7fe640 1 --2- 172.21.15.110:0/918044857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f668015cba0 0x7f66800d2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:58.999 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f667f7fe640 1 -- 172.21.15.110:0/918044857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6678009a70 con 0x7f66800d0210 2023-10-14T11:11:59.000 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f667ffff640 1 --2- 172.21.15.110:0/918044857 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66800b84e0 0x7f66800c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:11:59.000 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f667f7fe640 1 --2- 172.21.15.110:0/918044857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66800d0210 0x7f66801552b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6674009ec0 tx=0x7f667400c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:11:59.000 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f667cff9640 1 -- 172.21.15.110:0/918044857 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667400ce10 con 0x7f66800d0210 2023-10-14T11:11:59.000 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f667cff9640 1 -- 172.21.15.110:0/918044857 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6674004020 con 0x7f66800d0210 2023-10-14T11:11:59.001 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f667cff9640 1 -- 172.21.15.110:0/918044857 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6674004410 con 0x7f66800d0210 2023-10-14T11:11:59.001 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f668633e640 1 -- 172.21.15.110:0/918044857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66800c64c0 con 0x7f66800d0210 2023-10-14T11:11:59.001 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f668633e640 1 -- 172.21.15.110:0/918044857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66800c6a80 con 0x7f66800d0210 2023-10-14T11:11:59.001 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f667cff9640 1 -- 172.21.15.110:0/918044857 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6674003900 con 0x7f66800d0210 2023-10-14T11:11:59.002 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f667cff9640 1 -- 172.21.15.110:0/918044857 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f6674014420 con 0x7f66800d0210 2023-10-14T11:11:59.002 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.992+0000 7f668633e640 1 -- 172.21.15.110:0/918044857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f668004e170 con 0x7f66800d0210 2023-10-14T11:11:59.003 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:58.996+0000 7f667cff9640 1 -- 172.21.15.110:0/918044857 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f6674018030 con 0x7f66800d0210 2023-10-14T11:11:59.003 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:11:59.001+0000 7fe4cf10b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T11:11:59.066 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.064+0000 7f668633e640 1 -- 172.21.15.110:0/918044857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "040ef3ea-4707-4229-b251-0d951b8112a8", "id": 5} v 0) v1 -- 0x7f66800b6440 con 0x7f66800d0210 2023-10-14T11:11:59.070 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.068+0000 7f667cff9640 1 -- 172.21.15.110:0/918044857 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "040ef3ea-4707-4229-b251-0d951b8112a8", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f66740145e0 con 0x7f66800d0210 2023-10-14T11:11:59.071 INFO:teuthology.orchestra.run.smithi110.stdout:5 2023-10-14T11:11:59.072 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.072+0000 7f668633e640 1 -- 172.21.15.110:0/918044857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66800d0210 msgr2=0x7f66801552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:59.072 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.072+0000 7f668633e640 1 --2- 172.21.15.110:0/918044857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66800d0210 0x7f66801552b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6674009ec0 tx=0x7f667400c430 comp rx=0 tx=0).stop 2023-10-14T11:11:59.072 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.072+0000 7f668633e640 1 -- 172.21.15.110:0/918044857 shutdown_connections 2023-10-14T11:11:59.072 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.072+0000 7f668633e640 1 --2- 172.21.15.110:0/918044857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f668015cba0 0x7f66800d2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.073 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.072+0000 7f668633e640 1 --2- 172.21.15.110:0/918044857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66800d0210 0x7f66801552b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.073 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.072+0000 7f668633e640 1 --2- 172.21.15.110:0/918044857 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66800b84e0 0x7f66800c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.073 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.072+0000 7f668633e640 1 -- 172.21.15.110:0/918044857 >> 172.21.15.110:0/918044857 conn(0x7f66800719c0 msgr2=0x7f66800b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:11:59.073 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.072+0000 7f668633e640 1 -- 172.21.15.110:0/918044857 shutdown_connections 2023-10-14T11:11:59.073 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.072+0000 7f668633e640 1 -- 172.21.15.110:0/918044857 wait complete. 2023-10-14T11:11:59.090 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 9a55b2d2-8cdf-41a4-94cb-969d4a7dc297 6 2023-10-14T11:11:59.096 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:11:59.097+0000 7fe4cf10b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T11:11:59.159 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:11:59.157+0000 7fe4cf10b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T11:11:59.270 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.268+0000 7fa0166c9640 1 Processor -- start 2023-10-14T11:11:59.271 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.268+0000 7fa0166c9640 1 -- start start 2023-10-14T11:11:59.272 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.272+0000 7fa0166c9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa01015cba0 0x7fa0100d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:59.272 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.272+0000 7fa0166c9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa0100b84e0 0x7fa0100cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:59.272 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.272+0000 7fa0166c9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0100d1670 con 0x7fa0100d0040 2023-10-14T11:11:59.273 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.272+0000 7fa0166c9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0100d1460 con 0x7fa01015cba0 2023-10-14T11:11:59.273 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.272+0000 7fa0166c9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0100d04b0 con 0x7fa0100b84e0 2023-10-14T11:11:59.273 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.272+0000 7fa00f7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa0100b84e0 0x7fa0100cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:59.273 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.272+0000 7fa00f7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa0100b84e0 0x7fa0100cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49086/0 (socket says 172.21.15.110:49086) 2023-10-14T11:11:59.273 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.272+0000 7fa00f7fe640 1 -- 172.21.15.110:0/2523556618 learned_addr learned my addr 172.21.15.110:0/2523556618 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-14T11:11:59.274 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.272+0000 7fa00ffff640 1 --2- 172.21.15.110:0/2523556618 >> v2:172.21.15.26:3300/0 conn(0x7fa01015cba0 0x7fa0100d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:59.274 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.272+0000 7fa00f7fe640 1 -- 172.21.15.110:0/2523556618 >> v2:172.21.15.26:3300/0 conn(0x7fa01015cba0 msgr2=0x7fa0100d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:11:59.274 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.272+0000 7fa00f7fe640 1 --2- 172.21.15.110:0/2523556618 >> v2:172.21.15.26:3300/0 conn(0x7fa01015cba0 0x7fa0100d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.274 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.272+0000 7fa00f7fe640 1 -- 172.21.15.110:0/2523556618 >> v1:172.21.15.26:6789/0 conn(0x7fa0100d0040 legacy=0x7fa0100d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:11:59.274 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.272+0000 7fa00f7fe640 1 -- 172.21.15.110:0/2523556618 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0100d1950 con 0x7fa0100b84e0 2023-10-14T11:11:59.275 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.272+0000 7fa00ffff640 1 --2- 172.21.15.110:0/2523556618 >> v2:172.21.15.26:3300/0 conn(0x7fa01015cba0 0x7fa0100d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:11:59.276 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.272+0000 7fa00f7fe640 1 --2- 172.21.15.110:0/2523556618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0100b84e0 0x7fa0100cfb00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa0100cf2f0 tx=0x7fa00401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d5e089dfb99b439 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:11:59.276 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.272+0000 7fa00effd640 1 -- 172.21.15.110:0/2523556618 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0040a8050 con 0x7fa0100b84e0 2023-10-14T11:11:59.276 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.276+0000 7fa00effd640 1 -- 172.21.15.110:0/2523556618 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0040ac5f0 con 0x7fa0100b84e0 2023-10-14T11:11:59.277 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.276+0000 7fa00effd640 1 -- 172.21.15.110:0/2523556618 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0040ac980 con 0x7fa0100b84e0 2023-10-14T11:11:59.277 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.276+0000 7fa0166c9640 1 -- 172.21.15.110:0/2523556618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0100b84e0 msgr2=0x7fa0100cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:59.277 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.276+0000 7fa0166c9640 1 --2- 172.21.15.110:0/2523556618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0100b84e0 0x7fa0100cfb00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa0100cf2f0 tx=0x7fa00401c470 comp rx=0 tx=0).stop 2023-10-14T11:11:59.277 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.276+0000 7fa0166c9640 1 -- 172.21.15.110:0/2523556618 shutdown_connections 2023-10-14T11:11:59.277 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.276+0000 7fa0166c9640 1 --2- 172.21.15.110:0/2523556618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0100b84e0 0x7fa0100cfb00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.278 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.276+0000 7fa0166c9640 1 --2- 172.21.15.110:0/2523556618 >> v2:172.21.15.26:3300/0 conn(0x7fa01015cba0 0x7fa0100d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.278 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.276+0000 7fa0166c9640 1 -- 172.21.15.110:0/2523556618 >> 172.21.15.110:0/2523556618 conn(0x7fa0100719c0 msgr2=0x7fa010071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:11:59.278 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.276+0000 7fa0166c9640 1 -- 172.21.15.110:0/2523556618 shutdown_connections 2023-10-14T11:11:59.278 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.276+0000 7fa0166c9640 1 -- 172.21.15.110:0/2523556618 wait complete. 2023-10-14T11:11:59.280 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.276+0000 7fa0166c9640 1 Processor -- start 2023-10-14T11:11:59.281 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.276+0000 7fa0166c9640 1 -- start start 2023-10-14T11:11:59.281 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.276+0000 7fa0166c9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0100b84e0 0x7fa0100c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:59.281 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.276+0000 7fa0166c9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0100d0040 0x7fa010147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:59.281 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.276+0000 7fa0166c9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa01015cba0 0x7fa01014ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:59.282 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.276+0000 7fa0166c9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0100cc6e0 con 0x7fa01015cba0 2023-10-14T11:11:59.282 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.276+0000 7fa0166c9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0100ccb00 con 0x7fa0100b84e0 2023-10-14T11:11:59.282 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.276+0000 7fa0166c9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01014a560 con 0x7fa0100d0040 2023-10-14T11:11:59.282 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.280+0000 7fa00ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0100b84e0 0x7fa0100c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:59.282 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.280+0000 7fa00f7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0100d0040 0x7fa010147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:59.283 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.280+0000 7fa00ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0100b84e0 0x7fa0100c56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49102/0 (socket says 172.21.15.110:49102) 2023-10-14T11:11:59.283 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.280+0000 7fa00ffff640 1 -- 172.21.15.110:0/2431082780 learned_addr learned my addr 172.21.15.110:0/2431082780 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-14T11:11:59.283 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.280+0000 7fa014c66640 1 --2- 172.21.15.110:0/2431082780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa01015cba0 0x7fa01014ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:59.283 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.280+0000 7fa00ffff640 1 -- 172.21.15.110:0/2431082780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0100d0040 msgr2=0x7fa010147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:59.283 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.280+0000 7fa00ffff640 1 --2- 172.21.15.110:0/2431082780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0100d0040 0x7fa010147af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.284 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.280+0000 7fa00ffff640 1 -- 172.21.15.110:0/2431082780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa01015cba0 msgr2=0x7fa01014ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:59.284 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.280+0000 7fa00ffff640 1 --2- 172.21.15.110:0/2431082780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa01015cba0 0x7fa01014ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.284 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.280+0000 7fa00ffff640 1 -- 172.21.15.110:0/2431082780 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0040094d0 con 0x7fa0100b84e0 2023-10-14T11:11:59.284 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.280+0000 7fa00ffff640 1 --2- 172.21.15.110:0/2431082780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0100b84e0 0x7fa0100c56e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa00000d800 tx=0x7fa00000dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:11:59.284 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.280+0000 7fa00cff9640 1 -- 172.21.15.110:0/2431082780 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0000096c0 con 0x7fa0100b84e0 2023-10-14T11:11:59.284 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.280+0000 7fa00cff9640 1 -- 172.21.15.110:0/2431082780 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa000009820 con 0x7fa0100b84e0 2023-10-14T11:11:59.285 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.280+0000 7fa0166c9640 1 -- 172.21.15.110:0/2431082780 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01014a840 con 0x7fa0100b84e0 2023-10-14T11:11:59.285 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.280+0000 7fa00cff9640 1 -- 172.21.15.110:0/2431082780 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa000009bd0 con 0x7fa0100b84e0 2023-10-14T11:11:59.285 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.280+0000 7fa0166c9640 1 -- 172.21.15.110:0/2431082780 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0100cc300 con 0x7fa0100b84e0 2023-10-14T11:11:59.285 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.280+0000 7fa00cff9640 1 -- 172.21.15.110:0/2431082780 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa000014710 con 0x7fa0100b84e0 2023-10-14T11:11:59.285 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.280+0000 7fa00cff9640 1 -- 172.21.15.110:0/2431082780 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fa00001d4f0 con 0x7fa0100b84e0 2023-10-14T11:11:59.286 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.280+0000 7fa0166c9640 1 -- 172.21.15.110:0/2431082780 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa01004e170 con 0x7fa0100b84e0 2023-10-14T11:11:59.286 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.284+0000 7fa00cff9640 1 -- 172.21.15.110:0/2431082780 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fa00003cb40 con 0x7fa0100b84e0 2023-10-14T11:11:59.324 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:11:59.321+0000 7fe4cf10b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T11:11:59.349 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.348+0000 7fa0166c9640 1 -- 172.21.15.110:0/2431082780 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9a55b2d2-8cdf-41a4-94cb-969d4a7dc297", "id": 6} v 0) v1 -- 0x7fa010072120 con 0x7fa0100b84e0 2023-10-14T11:11:59.353 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.352+0000 7fa00cff9640 1 -- 172.21.15.110:0/2431082780 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9a55b2d2-8cdf-41a4-94cb-969d4a7dc297", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa00002b070 con 0x7fa0100b84e0 2023-10-14T11:11:59.354 INFO:teuthology.orchestra.run.smithi110.stdout:6 2023-10-14T11:11:59.355 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.352+0000 7fa0166c9640 1 -- 172.21.15.110:0/2431082780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0100b84e0 msgr2=0x7fa0100c56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:59.355 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.352+0000 7fa0166c9640 1 --2- 172.21.15.110:0/2431082780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0100b84e0 0x7fa0100c56e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa00000d800 tx=0x7fa00000dcc0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.355 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.352+0000 7fa0166c9640 1 -- 172.21.15.110:0/2431082780 shutdown_connections 2023-10-14T11:11:59.355 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.352+0000 7fa0166c9640 1 --2- 172.21.15.110:0/2431082780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa01015cba0 0x7fa01014ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.356 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.352+0000 7fa0166c9640 1 --2- 172.21.15.110:0/2431082780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0100d0040 0x7fa010147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.356 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.352+0000 7fa0166c9640 1 --2- 172.21.15.110:0/2431082780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0100b84e0 0x7fa0100c56e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.356 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.352+0000 7fa0166c9640 1 -- 172.21.15.110:0/2431082780 >> 172.21.15.110:0/2431082780 conn(0x7fa0100719c0 msgr2=0x7fa010072940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:11:59.356 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.352+0000 7fa0166c9640 1 -- 172.21.15.110:0/2431082780 shutdown_connections 2023-10-14T11:11:59.356 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.352+0000 7fa0166c9640 1 -- 172.21.15.110:0/2431082780 wait complete. 2023-10-14T11:11:59.373 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 9d237756-386f-48dd-bd9b-0796937e557f 7 2023-10-14T11:11:59.395 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:11:59.393+0000 7fe4cf10b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T11:11:59.510 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.508+0000 7fbad3765640 1 Processor -- start 2023-10-14T11:11:59.510 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.508+0000 7fbad3765640 1 -- start start 2023-10-14T11:11:59.511 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.512+0000 7fbad3765640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbacc15cba0 0x7fbacc0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:59.511 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.512+0000 7fbad3765640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbacc0d1670 con 0x7fbacc0b84e0 2023-10-14T11:11:59.511 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.512+0000 7fbad3765640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbacc0d1950 con 0x7fbacc0d0210 2023-10-14T11:11:59.512 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.512+0000 7fbad3765640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc0d1460 con 0x7fbacc15cba0 2023-10-14T11:11:59.512 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.512+0000 7fbad1501640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbacc15cba0 0x7fbacc0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:59.512 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.512+0000 7fbad1d02640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fbacc0d0210 0x7fbacc0b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44500/0 (socket says 172.21.15.110:44500) 2023-10-14T11:11:59.512 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.512+0000 7fbad1d02640 1 -- 172.21.15.110:0/1249936059 learned_addr learned my addr 172.21.15.110:0/1249936059 (peer_addr_for_me v1:172.21.15.110:0/0) 2023-10-14T11:11:59.513 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.512+0000 7fbad1501640 1 -- 172.21.15.110:0/1249936059 >> v1:172.21.15.110:6789/0 conn(0x7fbacc0d0210 legacy=0x7fbacc0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:59.513 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.512+0000 7fbad1501640 1 -- 172.21.15.110:0/1249936059 >> v1:172.21.15.26:6789/0 conn(0x7fbacc0b84e0 legacy=0x7fbacc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:59.513 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.512+0000 7fbad1501640 1 -- 172.21.15.110:0/1249936059 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc0d1c30 con 0x7fbacc15cba0 2023-10-14T11:11:59.513 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.512+0000 7fbac3fff640 1 -- 172.21.15.110:0/1249936059 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892699676 0 0) 0x7fbacc0d1950 con 0x7fbacc0d0210 2023-10-14T11:11:59.514 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.512+0000 7fbad1501640 1 --2- 172.21.15.110:0/1249936059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbacc15cba0 0x7fbacc0d0f20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbac80097f0 tx=0x7fbac801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc8efdb32d2afefe server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:11:59.515 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.512+0000 7fbac3fff640 1 -- 172.21.15.110:0/1249936059 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac80aa620 con 0x7fbacc15cba0 2023-10-14T11:11:59.517 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.512+0000 7fbac3fff640 1 -- 172.21.15.110:0/1249936059 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac80aa780 con 0x7fbacc15cba0 2023-10-14T11:11:59.518 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.512+0000 7fbac3fff640 1 -- 172.21.15.110:0/1249936059 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac80aab10 con 0x7fbacc15cba0 2023-10-14T11:11:59.521 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.516+0000 7fbad3765640 1 -- 172.21.15.110:0/1249936059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbacc15cba0 msgr2=0x7fbacc0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:59.521 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.516+0000 7fbad3765640 1 --2- 172.21.15.110:0/1249936059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbacc15cba0 0x7fbacc0d0f20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbac80097f0 tx=0x7fbac801c4c0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.521 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.516+0000 7fbad3765640 1 -- 172.21.15.110:0/1249936059 shutdown_connections 2023-10-14T11:11:59.521 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.516+0000 7fbad3765640 1 --2- 172.21.15.110:0/1249936059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbacc15cba0 0x7fbacc0d0f20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.522 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.516+0000 7fbad3765640 1 -- 172.21.15.110:0/1249936059 >> 172.21.15.110:0/1249936059 conn(0x7fbacc0719c0 msgr2=0x7fbacc071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:11:59.522 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.516+0000 7fbad3765640 1 -- 172.21.15.110:0/1249936059 shutdown_connections 2023-10-14T11:11:59.522 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.516+0000 7fbad3765640 1 -- 172.21.15.110:0/1249936059 wait complete. 2023-10-14T11:11:59.522 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.516+0000 7fbad3765640 1 Processor -- start 2023-10-14T11:11:59.522 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.516+0000 7fbad3765640 1 -- start start 2023-10-14T11:11:59.522 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.516+0000 7fbad3765640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbacc0b84e0 0x7fbacc154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:59.523 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.516+0000 7fbad3765640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbacc0d0210 0x7fbacc15ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:59.523 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.516+0000 7fbad3765640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbacc15cba0 0x7fbacc1f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:59.523 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.516+0000 7fbad3765640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc153de0 con 0x7fbacc0b84e0 2023-10-14T11:11:59.523 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.516+0000 7fbad3765640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc1531d0 con 0x7fbacc0d0210 2023-10-14T11:11:59.523 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.516+0000 7fbad3765640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc1534b0 con 0x7fbacc15cba0 2023-10-14T11:11:59.524 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.516+0000 7fbad1d02640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbacc15cba0 0x7fbacc1f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:59.524 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.516+0000 7fbad0d00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbacc0d0210 0x7fbacc15ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:59.524 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.516+0000 7fbad0d00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbacc0d0210 0x7fbacc15ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49104/0 (socket says 172.21.15.110:49104) 2023-10-14T11:11:59.524 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.516+0000 7fbad1d02640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbacc15cba0 0x7fbacc1f8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:38224/0 (socket says 172.21.15.110:38224) 2023-10-14T11:11:59.524 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.516+0000 7fbad0d00640 1 -- 172.21.15.110:0/3795917407 learned_addr learned my addr 172.21.15.110:0/3795917407 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-14T11:11:59.525 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.516+0000 7fbad1501640 1 --2- 172.21.15.110:0/3795917407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbacc0b84e0 0x7fbacc154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:59.525 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.520+0000 7fbad0d00640 1 -- 172.21.15.110:0/3795917407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbacc15cba0 msgr2=0x7fbacc1f8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:59.525 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.520+0000 7fbad0d00640 1 --2- 172.21.15.110:0/3795917407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbacc15cba0 0x7fbacc1f8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.525 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.520+0000 7fbad0d00640 1 -- 172.21.15.110:0/3795917407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbacc0b84e0 msgr2=0x7fbacc154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:59.525 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.520+0000 7fbad0d00640 1 --2- 172.21.15.110:0/3795917407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbacc0b84e0 0x7fbacc154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.526 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.520+0000 7fbad0d00640 1 -- 172.21.15.110:0/3795917407 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac8009420 con 0x7fbacc0d0210 2023-10-14T11:11:59.526 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.520+0000 7fbad1d02640 1 --2- 172.21.15.110:0/3795917407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbacc15cba0 0x7fbacc1f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:11:59.526 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.520+0000 7fbad0d00640 1 --2- 172.21.15.110:0/3795917407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbacc0d0210 0x7fbacc15ac50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbabc00c3c0 tx=0x7fbabc00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:11:59.526 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.520+0000 7fbac1ffb640 1 -- 172.21.15.110:0/3795917407 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc0052d0 con 0x7fbacc0d0210 2023-10-14T11:11:59.526 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.520+0000 7fbac1ffb640 1 -- 172.21.15.110:0/3795917407 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbabc005430 con 0x7fbacc0d0210 2023-10-14T11:11:59.527 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.520+0000 7fbad3765640 1 -- 172.21.15.110:0/3795917407 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbacc153790 con 0x7fbacc0d0210 2023-10-14T11:11:59.527 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.520+0000 7fbac1ffb640 1 -- 172.21.15.110:0/3795917407 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc003840 con 0x7fbacc0d0210 2023-10-14T11:11:59.527 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.520+0000 7fbac1ffb640 1 -- 172.21.15.110:0/3795917407 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbabc003ca0 con 0x7fbacc0d0210 2023-10-14T11:11:59.527 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.520+0000 7fbad3765640 1 -- 172.21.15.110:0/3795917407 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbacc155150 con 0x7fbacc0d0210 2023-10-14T11:11:59.527 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.520+0000 7fbac1ffb640 1 -- 172.21.15.110:0/3795917407 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fbabc012420 con 0x7fbacc0d0210 2023-10-14T11:11:59.527 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.520+0000 7fbad3765640 1 -- 172.21.15.110:0/3795917407 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbacc153f90 con 0x7fbacc0d0210 2023-10-14T11:11:59.528 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:11:59.520+0000 7fd4a4d99180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T11:11:59.528 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.524+0000 7fbac1ffb640 1 -- 172.21.15.110:0/3795917407 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fbacc153f90 con 0x7fbacc0d0210 2023-10-14T11:11:59.584 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:11:59.584+0000 7fd4a4d99180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T11:11:59.588 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.588+0000 7fbad3765640 1 -- 172.21.15.110:0/3795917407 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9d237756-386f-48dd-bd9b-0796937e557f", "id": 7} v 0) v1 -- 0x7fbacc04e170 con 0x7fbacc0d0210 2023-10-14T11:11:59.593 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.592+0000 7fbac1ffb640 1 -- 172.21.15.110:0/3795917407 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9d237756-386f-48dd-bd9b-0796937e557f", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbabc017070 con 0x7fbacc0d0210 2023-10-14T11:11:59.593 INFO:teuthology.orchestra.run.smithi110.stdout:7 2023-10-14T11:11:59.594 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.592+0000 7fbad3765640 1 -- 172.21.15.110:0/3795917407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbacc0d0210 msgr2=0x7fbacc15ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:59.594 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.592+0000 7fbad3765640 1 --2- 172.21.15.110:0/3795917407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbacc0d0210 0x7fbacc15ac50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbabc00c3c0 tx=0x7fbabc00c880 comp rx=0 tx=0).stop 2023-10-14T11:11:59.595 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.592+0000 7fbad3765640 1 -- 172.21.15.110:0/3795917407 shutdown_connections 2023-10-14T11:11:59.595 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.592+0000 7fbad3765640 1 --2- 172.21.15.110:0/3795917407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbacc15cba0 0x7fbacc1f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.595 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.592+0000 7fbad3765640 1 --2- 172.21.15.110:0/3795917407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbacc0d0210 0x7fbacc15ac50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.595 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.592+0000 7fbad3765640 1 --2- 172.21.15.110:0/3795917407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbacc0b84e0 0x7fbacc154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.595 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.592+0000 7fbad3765640 1 -- 172.21.15.110:0/3795917407 >> 172.21.15.110:0/3795917407 conn(0x7fbacc0719c0 msgr2=0x7fbacc0b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:11:59.595 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.592+0000 7fbad3765640 1 -- 172.21.15.110:0/3795917407 shutdown_connections 2023-10-14T11:11:59.596 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:11:59.592+0000 7fbad3765640 1 -- 172.21.15.110:0/3795917407 wait complete. 2023-10-14T11:11:59.613 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-14T11:11:59.613 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-14T11:11:59.618 INFO:tasks.ceph.osd.0:Started 2023-10-14T11:11:59.618 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-14T11:11:59.619 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-14T11:11:59.623 INFO:tasks.ceph.osd.1:Started 2023-10-14T11:11:59.623 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-14T11:11:59.624 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-14T11:11:59.628 INFO:tasks.ceph.osd.2:Started 2023-10-14T11:11:59.628 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-14T11:11:59.629 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-14T11:11:59.633 INFO:tasks.ceph.osd.3:Started 2023-10-14T11:11:59.634 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-14T11:11:59.634 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-14T11:11:59.638 INFO:tasks.ceph.osd.4:Started 2023-10-14T11:11:59.638 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-14T11:11:59.639 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-14T11:11:59.643 INFO:tasks.ceph.osd.5:Started 2023-10-14T11:11:59.643 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-14T11:11:59.644 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-14T11:11:59.648 INFO:tasks.ceph.osd.6:Started 2023-10-14T11:11:59.648 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-14T11:11:59.649 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-14T11:11:59.650 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:11:59.648+0000 7fd4a4d99180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T11:11:59.654 INFO:tasks.ceph.osd.7:Started 2023-10-14T11:11:59.655 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:11:59.762 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:11:59.760+0000 7fd4a4d99180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T11:11:59.829 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:11:59.828+0000 7fd4a4d99180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T11:11:59.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.861+0000 7f9fe852a640 1 Processor -- start 2023-10-14T11:11:59.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.861+0000 7f9fe852a640 1 -- start start 2023-10-14T11:11:59.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.861+0000 7f9fe852a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9fe0070c40 0x7f9fe015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:59.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.861+0000 7f9fe852a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe015be60 con 0x7f9fe00b07f0 2023-10-14T11:11:59.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.861+0000 7f9fe852a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe015c1f0 con 0x7f9fe00b4020 2023-10-14T11:11:59.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.861+0000 7f9fe852a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe015b3b0 con 0x7f9fe0070c40 2023-10-14T11:11:59.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.865+0000 7f9fe6ac7640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9fe00b07f0 0x7f9fe0164490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47012/0 (socket says 172.21.15.26:47012) 2023-10-14T11:11:59.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.865+0000 7f9fe6ac7640 1 -- 172.21.15.26:0/1253633141 learned_addr learned my addr 172.21.15.26:0/1253633141 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:11:59.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.865+0000 7f9fe62c6640 1 --2- 172.21.15.26:0/1253633141 >> v2:172.21.15.110:3300/0 conn(0x7f9fe0070c40 0x7f9fe015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:59.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.865+0000 7f9fe52c4640 1 -- 172.21.15.26:0/1253633141 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242678072 0 0) 0x7f9fe015be60 con 0x7f9fe00b07f0 2023-10-14T11:11:59.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.865+0000 7f9fe52c4640 1 -- 172.21.15.26:0/1253633141 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fcc003530 con 0x7f9fe00b07f0 2023-10-14T11:11:59.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.865+0000 7f9fe52c4640 1 -- 172.21.15.26:0/1253633141 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165340422 0 0) 0x7f9fe015c1f0 con 0x7f9fe00b4020 2023-10-14T11:11:59.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.865+0000 7f9fe52c4640 1 -- 172.21.15.26:0/1253633141 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fe015be60 con 0x7f9fe00b4020 2023-10-14T11:11:59.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.865+0000 7f9fe62c6640 1 -- 172.21.15.26:0/1253633141 >> v1:172.21.15.110:6789/0 conn(0x7f9fe00b4020 legacy=0x7f9fe00b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:59.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.865+0000 7f9fe62c6640 1 -- 172.21.15.26:0/1253633141 >> v1:172.21.15.26:6789/0 conn(0x7f9fe00b07f0 legacy=0x7f9fe0164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:59.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.865+0000 7f9fe62c6640 1 -- 172.21.15.26:0/1253633141 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe0071020 con 0x7f9fe0070c40 2023-10-14T11:11:59.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.865+0000 7f9fe62c6640 1 --2- 172.21.15.26:0/1253633141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fe0070c40 0x7f9fe015ae70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0097c0 tx=0x7f9fdc01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ee825ef5a863fbd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:11:59.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.865+0000 7f9fe52c4640 1 -- 172.21.15.26:0/1253633141 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc0ab5f0 con 0x7f9fe0070c40 2023-10-14T11:11:59.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.865+0000 7f9fe52c4640 1 -- 172.21.15.26:0/1253633141 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc0ab750 con 0x7f9fe0070c40 2023-10-14T11:11:59.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.865+0000 7f9fe52c4640 1 -- 172.21.15.26:0/1253633141 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc0abae0 con 0x7f9fe0070c40 2023-10-14T11:11:59.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.869+0000 7f9fe852a640 1 -- 172.21.15.26:0/1253633141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fe0070c40 msgr2=0x7f9fe015ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:59.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.869+0000 7f9fe852a640 1 --2- 172.21.15.26:0/1253633141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fe0070c40 0x7f9fe015ae70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0097c0 tx=0x7f9fdc01c3f0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.869+0000 7f9fe852a640 1 -- 172.21.15.26:0/1253633141 shutdown_connections 2023-10-14T11:11:59.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.869+0000 7f9fe852a640 1 --2- 172.21.15.26:0/1253633141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fe0070c40 0x7f9fe015ae70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.869+0000 7f9fe852a640 1 -- 172.21.15.26:0/1253633141 >> 172.21.15.26:0/1253633141 conn(0x7f9fe006c190 msgr2=0x7f9fe006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:11:59.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.869+0000 7f9fe852a640 1 -- 172.21.15.26:0/1253633141 shutdown_connections 2023-10-14T11:11:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.869+0000 7f9fe852a640 1 -- 172.21.15.26:0/1253633141 wait complete. 2023-10-14T11:11:59.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.869+0000 7f9fe852a640 1 Processor -- start 2023-10-14T11:11:59.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.869+0000 7f9fe852a640 1 -- start start 2023-10-14T11:11:59.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.869+0000 7f9fe852a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe0070c40 0x7f9fe01565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:59.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.869+0000 7f9fe852a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fe00b07f0 0x7f9fe0154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:59.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.869+0000 7f9fe852a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fe00b4020 0x7f9fe0151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:11:59.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.869+0000 7f9fe852a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe0151440 con 0x7f9fe0070c40 2023-10-14T11:11:59.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.869+0000 7f9fe852a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe0151a00 con 0x7f9fe00b07f0 2023-10-14T11:11:59.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.869+0000 7f9fe852a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe0154740 con 0x7f9fe00b4020 2023-10-14T11:11:59.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.869+0000 7f9fe62c6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe0070c40 0x7f9fe01565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:59.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.869+0000 7f9fe62c6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe0070c40 0x7f9fe01565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51286/0 (socket says 172.21.15.26:51286) 2023-10-14T11:11:59.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.869+0000 7f9fe62c6640 1 -- 172.21.15.26:0/1377932698 learned_addr learned my addr 172.21.15.26:0/1377932698 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:11:59.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.869+0000 7f9fe6ac7640 1 --2- 172.21.15.26:0/1377932698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fe00b4020 0x7f9fe0151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:59.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.869+0000 7f9fe5ac5640 1 --2- 172.21.15.26:0/1377932698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fe00b07f0 0x7f9fe0154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:11:59.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.873+0000 7f9fe62c6640 1 -- 172.21.15.26:0/1377932698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fe00b4020 msgr2=0x7f9fe0151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:59.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.873+0000 7f9fe62c6640 1 --2- 172.21.15.26:0/1377932698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fe00b4020 0x7f9fe0151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.873+0000 7f9fe62c6640 1 -- 172.21.15.26:0/1377932698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fe00b07f0 msgr2=0x7f9fe0154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:59.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.873+0000 7f9fe62c6640 1 --2- 172.21.15.26:0/1377932698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fe00b07f0 0x7f9fe0154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.873+0000 7f9fe62c6640 1 -- 172.21.15.26:0/1377932698 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fdc009420 con 0x7f9fe0070c40 2023-10-14T11:11:59.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.873+0000 7f9fe62c6640 1 --2- 172.21.15.26:0/1377932698 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe0070c40 0x7f9fe01565b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc019000 tx=0x7f9fdc01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:11:59.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.873+0000 7f9fd6ffd640 1 -- 172.21.15.26:0/1377932698 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc0bf610 con 0x7f9fe0070c40 2023-10-14T11:11:59.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.873+0000 7f9fd6ffd640 1 -- 172.21.15.26:0/1377932698 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc0bf770 con 0x7f9fe0070c40 2023-10-14T11:11:59.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.873+0000 7f9fd6ffd640 1 -- 172.21.15.26:0/1377932698 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc0bfb20 con 0x7f9fe0070c40 2023-10-14T11:11:59.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.873+0000 7f9fe852a640 1 -- 172.21.15.26:0/1377932698 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe01523d0 con 0x7f9fe0070c40 2023-10-14T11:11:59.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.873+0000 7f9fe852a640 1 -- 172.21.15.26:0/1377932698 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe0156f30 con 0x7f9fe0070c40 2023-10-14T11:11:59.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.873+0000 7f9fd6ffd640 1 -- 172.21.15.26:0/1377932698 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9fdc0b5400 con 0x7f9fe0070c40 2023-10-14T11:11:59.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.873+0000 7f9fd6ffd640 1 -- 172.21.15.26:0/1377932698 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9fdc0a8050 con 0x7f9fe0070c40 2023-10-14T11:11:59.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.873+0000 7f9fe852a640 1 -- 172.21.15.26:0/1377932698 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe0074010 con 0x7f9fe0070c40 2023-10-14T11:11:59.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.877+0000 7f9fd6ffd640 1 -- 172.21.15.26:0/1377932698 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f9fdc0c4020 con 0x7f9fe0070c40 2023-10-14T11:11:59.918 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:11:59.916+0000 7fd4a4d99180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T11:11:59.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.933+0000 7f9fe852a640 1 -- 172.21.15.26:0/1377932698 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fe015c130 con 0x7f9fe0070c40 2023-10-14T11:11:59.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.933+0000 7f9fd6ffd640 1 -- 172.21.15.26:0/1377932698 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9fdc0b56b0 con 0x7f9fe0070c40 2023-10-14T11:11:59.935 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:11:59.936 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":10,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:11:59.590779+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:11:59.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.933+0000 7f9fe852a640 1 -- 172.21.15.26:0/1377932698 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe0070c40 msgr2=0x7f9fe01565b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:11:59.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.933+0000 7f9fe852a640 1 --2- 172.21.15.26:0/1377932698 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe0070c40 0x7f9fe01565b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc019000 tx=0x7f9fdc01ac30 comp rx=0 tx=0).stop 2023-10-14T11:11:59.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.933+0000 7f9fe852a640 1 -- 172.21.15.26:0/1377932698 shutdown_connections 2023-10-14T11:11:59.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.933+0000 7f9fe852a640 1 --2- 172.21.15.26:0/1377932698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fe00b4020 0x7f9fe0151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.933+0000 7f9fe852a640 1 --2- 172.21.15.26:0/1377932698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fe00b07f0 0x7f9fe0154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.933+0000 7f9fe852a640 1 --2- 172.21.15.26:0/1377932698 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe0070c40 0x7f9fe01565b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:11:59.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.933+0000 7f9fe852a640 1 -- 172.21.15.26:0/1377932698 >> 172.21.15.26:0/1377932698 conn(0x7f9fe006c190 msgr2=0x7f9fe00c41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:11:59.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.933+0000 7f9fe852a640 1 -- 172.21.15.26:0/1377932698 shutdown_connections 2023-10-14T11:11:59.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:11:59.933+0000 7f9fe852a640 1 -- 172.21.15.26:0/1377932698 wait complete. 2023-10-14T11:11:59.955 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-14T11:11:59.955 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-14T11:11:59.977 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:11:59.976+0000 7fd4a4d99180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T11:12:00.014 INFO:tasks.ceph.mgr.y.smithi026.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-10-14T11:12:00.014 INFO:tasks.ceph.mgr.y.smithi026.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-10-14T11:12:00.014 INFO:tasks.ceph.mgr.y.smithi026.stderr: from numpy import show_config as show_numpy_config 2023-10-14T11:12:00.059 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:12:00.057+0000 7fe4cf10b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T11:12:00.135 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:12:00.136+0000 7fd4a4d99180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T11:12:00.201 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:12:00.201+0000 7fe4cf10b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T11:12:00.203 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:12:00.204+0000 7fd4a4d99180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T11:12:00.272 INFO:tasks.ceph.osd.4.smithi110.stderr:2023-10-14T11:12:00.272+0000 7f83a1319640 -1 Falling back to public interface 2023-10-14T11:12:00.300 INFO:tasks.ceph.osd.5.smithi110.stderr:2023-10-14T11:12:00.300+0000 7feabfd20640 -1 Falling back to public interface 2023-10-14T11:12:00.318 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-10-14T11:12:00.317+0000 7fa0d882b640 -1 Falling back to public interface 2023-10-14T11:12:00.318 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-10-14T11:12:00.317+0000 7f9c1219b640 -1 Falling back to public interface 2023-10-14T11:12:00.319 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-10-14T11:12:00.317+0000 7f9c1115c640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6803/0: (98) Address already in use 2023-10-14T11:12:00.333 INFO:tasks.ceph.osd.7.smithi110.stderr:2023-10-14T11:12:00.332+0000 7f13d85cc640 -1 Falling back to public interface 2023-10-14T11:12:00.334 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-10-14T11:12:00.333+0000 7f4ddeecf640 -1 Falling back to public interface 2023-10-14T11:12:00.354 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-10-14T11:12:00.353+0000 7ff28d42f640 -1 Falling back to public interface 2023-10-14T11:12:00.364 INFO:tasks.ceph.osd.6.smithi110.stderr:2023-10-14T11:12:00.364+0000 7f3e2945b640 -1 Falling back to public interface 2023-10-14T11:12:00.388 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:12:00.389+0000 7fe4cf10b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T11:12:00.465 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:12:00.465+0000 7fe4cf10b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T11:12:00.609 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:12:00.609+0000 7fe4cf10b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T11:12:00.761 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T11:12:00.877 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-10-14T11:12:00.877 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-10-14T11:12:00.877 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-10-14T11:12:00.895 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.893+0000 7ff9a946b640 1 Processor -- start 2023-10-14T11:12:00.895 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.893+0000 7ff9a946b640 1 -- start start 2023-10-14T11:12:00.896 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.893+0000 7ff9a946b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff9a415ce40 0x7ff9a40ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:00.897 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.893+0000 7ff9a946b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff9a40ce540 0x7ff9a40d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:00.897 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.893+0000 7ff9a946b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a40cfd50 con 0x7ff9a415ca60 2023-10-14T11:12:00.897 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.893+0000 7ff9a946b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a40d0030 con 0x7ff9a40ce540 2023-10-14T11:12:00.897 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.893+0000 7ff9a946b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a40cd520 con 0x7ff9a415ce40 2023-10-14T11:12:00.898 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.893+0000 7ff9a37fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff9a40ce540 0x7ff9a40d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:00.898 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.893+0000 7ff9a37fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff9a40ce540 0x7ff9a40d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51300/0 (socket says 172.21.15.26:51300) 2023-10-14T11:12:00.898 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.893+0000 7ff9a37fe640 1 -- 172.21.15.26:0/2832865854 learned_addr learned my addr 172.21.15.26:0/2832865854 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:00.898 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.893+0000 7ff99bfff640 1 --2- 172.21.15.26:0/2832865854 >> v2:172.21.15.110:3300/0 conn(0x7ff9a415ce40 0x7ff9a40ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:00.899 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.893+0000 7ff9a37fe640 1 -- 172.21.15.26:0/2832865854 >> v2:172.21.15.110:3300/0 conn(0x7ff9a415ce40 msgr2=0x7ff9a40ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:00.899 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.893+0000 7ff9a37fe640 1 --2- 172.21.15.26:0/2832865854 >> v2:172.21.15.110:3300/0 conn(0x7ff9a415ce40 0x7ff9a40ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:00.899 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.897+0000 7ff9a37fe640 1 -- 172.21.15.26:0/2832865854 >> v1:172.21.15.110:6789/0 conn(0x7ff9a415ca60 legacy=0x7ff9a406b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:00.899 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.897+0000 7ff9a37fe640 1 -- 172.21.15.26:0/2832865854 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a40cd800 con 0x7ff9a40ce540 2023-10-14T11:12:00.902 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.897+0000 7ff9a37fe640 1 --2- 172.21.15.26:0/2832865854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9a40ce540 0x7ff9a40d0f60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff9a408bda0 tx=0x7ff99c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0bae2cab8336f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:00.903 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.897+0000 7ff9a27fc640 1 -- 172.21.15.26:0/2832865854 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c0a57a0 con 0x7ff9a40ce540 2023-10-14T11:12:00.904 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.897+0000 7ff9a27fc640 1 -- 172.21.15.26:0/2832865854 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99c0a5900 con 0x7ff9a40ce540 2023-10-14T11:12:00.904 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.897+0000 7ff9a27fc640 1 -- 172.21.15.26:0/2832865854 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c0a5c90 con 0x7ff9a40ce540 2023-10-14T11:12:00.904 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.897+0000 7ff9a946b640 1 -- 172.21.15.26:0/2832865854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9a40ce540 msgr2=0x7ff9a40d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:00.905 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.897+0000 7ff9a946b640 1 --2- 172.21.15.26:0/2832865854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9a40ce540 0x7ff9a40d0f60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff9a408bda0 tx=0x7ff99c01c9d0 comp rx=0 tx=0).stop 2023-10-14T11:12:00.905 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.897+0000 7ff9a946b640 1 -- 172.21.15.26:0/2832865854 shutdown_connections 2023-10-14T11:12:00.905 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.897+0000 7ff9a946b640 1 --2- 172.21.15.26:0/2832865854 >> v2:172.21.15.110:3300/0 conn(0x7ff9a415ce40 0x7ff9a40ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:00.905 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.897+0000 7ff9a946b640 1 --2- 172.21.15.26:0/2832865854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9a40ce540 0x7ff9a40d0f60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:00.905 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.897+0000 7ff9a946b640 1 -- 172.21.15.26:0/2832865854 >> 172.21.15.26:0/2832865854 conn(0x7ff9a408c350 msgr2=0x7ff9a409bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:00.906 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.897+0000 7ff9a946b640 1 -- 172.21.15.26:0/2832865854 shutdown_connections 2023-10-14T11:12:00.906 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.897+0000 7ff9a946b640 1 -- 172.21.15.26:0/2832865854 wait complete. 2023-10-14T11:12:00.909 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.901+0000 7ff9a946b640 1 Processor -- start 2023-10-14T11:12:00.909 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.901+0000 7ff9a946b640 1 -- start start 2023-10-14T11:12:00.909 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.901+0000 7ff9a946b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a40ce540 0x7ff9a40b75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:00.910 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.901+0000 7ff9a946b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9a415ca60 0x7ff9a40cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:00.910 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.901+0000 7ff9a946b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9a415ce40 0x7ff9a40c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:00.910 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.901+0000 7ff9a946b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a40b7c90 con 0x7ff9a415ca60 2023-10-14T11:12:00.910 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.901+0000 7ff9a946b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a40b7f70 con 0x7ff9a40ce540 2023-10-14T11:12:00.910 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.901+0000 7ff9a946b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a40b44f0 con 0x7ff9a415ce40 2023-10-14T11:12:00.911 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.901+0000 7ff99bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9a415ca60 0x7ff9a40cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:00.911 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.901+0000 7ff9a2ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a40ce540 0x7ff9a40b75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:00.911 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.901+0000 7ff99bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9a415ca60 0x7ff9a40cbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51310/0 (socket says 172.21.15.26:51310) 2023-10-14T11:12:00.911 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.901+0000 7ff99bfff640 1 -- 172.21.15.26:0/123997215 learned_addr learned my addr 172.21.15.26:0/123997215 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:00.912 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.901+0000 7ff9a37fe640 1 --2- 172.21.15.26:0/123997215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9a415ce40 0x7ff9a40c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:00.912 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.901+0000 7ff99bfff640 1 -- 172.21.15.26:0/123997215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9a415ce40 msgr2=0x7ff9a40c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:00.912 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.901+0000 7ff99bfff640 1 --2- 172.21.15.26:0/123997215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9a415ce40 0x7ff9a40c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:00.912 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.901+0000 7ff99bfff640 1 -- 172.21.15.26:0/123997215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a40ce540 msgr2=0x7ff9a40b75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:00.913 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.901+0000 7ff99bfff640 1 --2- 172.21.15.26:0/123997215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a40ce540 0x7ff9a40b75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:00.913 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.901+0000 7ff99bfff640 1 -- 172.21.15.26:0/123997215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99c009b30 con 0x7ff9a415ca60 2023-10-14T11:12:00.913 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.901+0000 7ff9a2ffd640 1 --2- 172.21.15.26:0/123997215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a40ce540 0x7ff9a40b75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:12:00.913 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.901+0000 7ff99bfff640 1 --2- 172.21.15.26:0/123997215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9a415ca60 0x7ff9a40cbc60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00e870 tx=0x7ff98c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:00.913 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.905+0000 7ff99b7fe640 1 -- 172.21.15.26:0/123997215 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c009510 con 0x7ff9a415ca60 2023-10-14T11:12:00.914 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.905+0000 7ff99b7fe640 1 -- 172.21.15.26:0/123997215 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c00eec0 con 0x7ff9a415ca60 2023-10-14T11:12:00.914 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.905+0000 7ff9a946b640 1 -- 172.21.15.26:0/123997215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a40b47d0 con 0x7ff9a415ca60 2023-10-14T11:12:00.914 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.905+0000 7ff99b7fe640 1 -- 172.21.15.26:0/123997215 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c00cb40 con 0x7ff9a415ca60 2023-10-14T11:12:00.914 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.905+0000 7ff9a946b640 1 -- 172.21.15.26:0/123997215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a40b8250 con 0x7ff9a415ca60 2023-10-14T11:12:00.914 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.905+0000 7ff99b7fe640 1 -- 172.21.15.26:0/123997215 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff98c0059a0 con 0x7ff9a415ca60 2023-10-14T11:12:00.915 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.905+0000 7ff99b7fe640 1 -- 172.21.15.26:0/123997215 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ff98c0067f0 con 0x7ff9a415ca60 2023-10-14T11:12:00.915 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.905+0000 7ff9a946b640 1 -- 172.21.15.26:0/123997215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a40b4960 con 0x7ff9a415ca60 2023-10-14T11:12:00.915 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.905+0000 7ff99b7fe640 1 -- 172.21.15.26:0/123997215 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7ff98c021060 con 0x7ff9a415ca60 2023-10-14T11:12:00.931 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:12:00.928+0000 7fd4a4d99180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T11:12:00.966 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.965+0000 7ff9a946b640 1 -- 172.21.15.26:0/123997215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9a404e170 con 0x7ff9a415ca60 2023-10-14T11:12:00.967 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.965+0000 7ff99b7fe640 1 -- 172.21.15.26:0/123997215 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff98c017070 con 0x7ff9a415ca60 2023-10-14T11:12:00.967 INFO:teuthology.misc.health.smithi026.stdout: 2023-10-14T11:12:00.967 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":10,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:11:59.590779+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:12:00.968 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.965+0000 7ff9a946b640 1 -- 172.21.15.26:0/123997215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9a415ca60 msgr2=0x7ff9a40cbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:00.968 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.965+0000 7ff9a946b640 1 --2- 172.21.15.26:0/123997215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9a415ca60 0x7ff9a40cbc60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00e870 tx=0x7ff98c00ec70 comp rx=0 tx=0).stop 2023-10-14T11:12:00.971 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.965+0000 7ff9a946b640 1 -- 172.21.15.26:0/123997215 shutdown_connections 2023-10-14T11:12:00.971 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.965+0000 7ff9a946b640 1 --2- 172.21.15.26:0/123997215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9a415ce40 0x7ff9a40c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:00.971 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.965+0000 7ff9a946b640 1 --2- 172.21.15.26:0/123997215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9a415ca60 0x7ff9a40cbc60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:00.971 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.965+0000 7ff9a946b640 1 --2- 172.21.15.26:0/123997215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a40ce540 0x7ff9a40b75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:00.972 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.965+0000 7ff9a946b640 1 -- 172.21.15.26:0/123997215 >> 172.21.15.26:0/123997215 conn(0x7ff9a408c350 msgr2=0x7ff9a40b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:00.972 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.965+0000 7ff9a946b640 1 -- 172.21.15.26:0/123997215 shutdown_connections 2023-10-14T11:12:00.972 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:00.965+0000 7ff9a946b640 1 -- 172.21.15.26:0/123997215 wait complete. 2023-10-14T11:12:00.985 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-14T11:12:01.067 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:12:01.068+0000 7fd4a4d99180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T11:12:01.236 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:12:01.236+0000 7fd4a4d99180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T11:12:01.309 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:12:01.308+0000 7fd4a4d99180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T11:12:01.347 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:12:01.345+0000 7fe4cf10b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T11:12:01.438 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:12:01.437+0000 7fe4cf10b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T11:12:01.445 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:12:01.444+0000 7fd4a4d99180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T11:12:01.638 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:12:01.637+0000 7fe4cf10b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T11:12:01.727 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:12:01.725+0000 7fe4cf10b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T11:12:02.072 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:12:02.069+0000 7fe4cf10b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T11:12:02.115 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:12:02.112+0000 7fd4a4d99180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T11:12:02.143 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:12:02.141+0000 7fe4cf10b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T11:12:02.208 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:12:02.208+0000 7fd4a4d99180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T11:12:02.398 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:12:02.396+0000 7fd4a4d99180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T11:12:02.482 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:12:02.480+0000 7fd4a4d99180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T11:12:02.807 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:12:02.808+0000 7fd4a4d99180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T11:12:02.876 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-14T11:12:02.876+0000 7fd4a4d99180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T11:12:03.167 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:12:03.165+0000 7fe47677d640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-14T11:12:03.167 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-14T11:12:03.165+0000 7fe47677d640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-14T11:12:04.150 INFO:tasks.ceph.osd.4.smithi110.stderr:2023-10-14T11:12:04.148+0000 7f83a1319640 -1 osd.4 0 log_to_monitors true 2023-10-14T11:12:04.193 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-10-14T11:12:04.193+0000 7f9c1219b640 -1 osd.2 0 log_to_monitors true 2023-10-14T11:12:04.285 INFO:tasks.ceph.osd.7.smithi110.stderr:2023-10-14T11:12:04.284+0000 7f13d85cc640 -1 osd.7 0 log_to_monitors true 2023-10-14T11:12:04.286 INFO:tasks.ceph.osd.6.smithi110.stderr:2023-10-14T11:12:04.284+0000 7f3e2945b640 -1 osd.6 0 log_to_monitors true 2023-10-14T11:12:04.325 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-10-14T11:12:04.325+0000 7f4ddeecf640 -1 osd.1 0 log_to_monitors true 2023-10-14T11:12:04.339 INFO:tasks.ceph.osd.5.smithi110.stderr:2023-10-14T11:12:04.336+0000 7feabfd20640 -1 osd.5 0 log_to_monitors true 2023-10-14T11:12:04.341 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-10-14T11:12:04.341+0000 7fa0d882b640 -1 osd.3 0 log_to_monitors true 2023-10-14T11:12:04.346 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-10-14T11:12:04.345+0000 7ff28d42f640 -1 osd.0 0 log_to_monitors true 2023-10-14T11:12:07.601 INFO:tasks.ceph.osd.6.smithi110.stderr:2023-10-14T11:12:07.599+0000 7f3e25403640 -1 osd.6 0 waiting for initial osdmap 2023-10-14T11:12:07.619 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-10-14T11:12:07.616+0000 7ff2893d9640 -1 osd.0 0 waiting for initial osdmap 2023-10-14T11:12:07.628 INFO:tasks.ceph.osd.5.smithi110.stderr:2023-10-14T11:12:07.627+0000 7feabbcc8640 -1 osd.5 0 waiting for initial osdmap 2023-10-14T11:12:07.636 INFO:tasks.ceph.osd.7.smithi110.stderr:2023-10-14T11:12:07.635+0000 7f13d4574640 -1 osd.7 0 waiting for initial osdmap 2023-10-14T11:12:07.643 INFO:tasks.ceph.osd.6.smithi110.stderr:2023-10-14T11:12:07.639+0000 7f3e1d238640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T11:12:07.645 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-10-14T11:12:07.644+0000 7f9c0e143640 -1 osd.2 0 waiting for initial osdmap 2023-10-14T11:12:07.669 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-10-14T11:12:07.668+0000 7ff28120e640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T11:12:07.676 INFO:tasks.ceph.osd.7.smithi110.stderr:2023-10-14T11:12:07.675+0000 7f13cc3a9640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T11:12:07.677 INFO:tasks.ceph.osd.5.smithi110.stderr:2023-10-14T11:12:07.675+0000 7feab3afd640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T11:12:07.679 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-10-14T11:12:07.676+0000 7fa0d3deb640 -1 osd.3 0 waiting for initial osdmap 2023-10-14T11:12:07.685 INFO:tasks.ceph.osd.4.smithi110.stderr:2023-10-14T11:12:07.683+0000 7f839dad5640 -1 osd.4 0 waiting for initial osdmap 2023-10-14T11:12:07.693 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-10-14T11:12:07.692+0000 7f9c05f78640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T11:12:07.711 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-10-14T11:12:07.708+0000 7f4ddb68b640 -1 osd.1 0 waiting for initial osdmap 2023-10-14T11:12:07.712 INFO:tasks.ceph.osd.4.smithi110.stderr:2023-10-14T11:12:07.711+0000 7f83950f6640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T11:12:07.717 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-10-14T11:12:07.716+0000 7fa0cbc20640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T11:12:07.745 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-10-14T11:12:07.744+0000 7f4dd2cac640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T11:12:07.791 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T11:12:07.928 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.924+0000 7fba29e46640 1 Processor -- start 2023-10-14T11:12:07.928 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.924+0000 7fba29e46640 1 -- start start 2023-10-14T11:12:07.929 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.928+0000 7fba29e46640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba2415ca60 0x7fba2406b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:07.930 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.928+0000 7fba29e46640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fba240ce710 0x7fba240d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:07.930 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.928+0000 7fba29e46640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba240cfd50 con 0x7fba2406b980 2023-10-14T11:12:07.930 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.928+0000 7fba29e46640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba240d0030 con 0x7fba240ce710 2023-10-14T11:12:07.930 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.928+0000 7fba29e46640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba240cd520 con 0x7fba2415ca60 2023-10-14T11:12:07.930 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.928+0000 7fba237fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba2415ca60 0x7fba2406b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:07.931 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.928+0000 7fba23fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fba240ce710 0x7fba240d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:07.931 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.928+0000 7fba237fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba2415ca60 0x7fba2406b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:52836/0 (socket says 172.21.15.26:52836) 2023-10-14T11:12:07.931 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.928+0000 7fba237fe640 1 -- 172.21.15.26:0/2672276447 learned_addr learned my addr 172.21.15.26:0/2672276447 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:07.932 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.928+0000 7fba237fe640 1 -- 172.21.15.26:0/2672276447 >> v2:172.21.15.110:3300/0 conn(0x7fba240ce710 msgr2=0x7fba240d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:07.932 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.928+0000 7fba237fe640 1 --2- 172.21.15.26:0/2672276447 >> v2:172.21.15.110:3300/0 conn(0x7fba240ce710 0x7fba240d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:07.932 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.928+0000 7fba237fe640 1 -- 172.21.15.26:0/2672276447 >> v1:172.21.15.110:6789/0 conn(0x7fba2406b980 legacy=0x7fba240ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:07.932 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.928+0000 7fba237fe640 1 -- 172.21.15.26:0/2672276447 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba240cd800 con 0x7fba2415ca60 2023-10-14T11:12:07.933 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.932+0000 7fba237fe640 1 --2- 172.21.15.26:0/2672276447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba2415ca60 0x7fba2406b440 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fba14009870 tx=0x7fba1401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fe6dca5fba67503 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:07.933 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.932+0000 7fba227fc640 1 -- 172.21.15.26:0/2672276447 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba140a95f0 con 0x7fba2415ca60 2023-10-14T11:12:07.934 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.932+0000 7fba227fc640 1 -- 172.21.15.26:0/2672276447 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba140a9750 con 0x7fba2415ca60 2023-10-14T11:12:07.934 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.932+0000 7fba227fc640 1 -- 172.21.15.26:0/2672276447 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba140a9ae0 con 0x7fba2415ca60 2023-10-14T11:12:07.935 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.932+0000 7fba29e46640 1 -- 172.21.15.26:0/2672276447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba2415ca60 msgr2=0x7fba2406b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:07.935 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.932+0000 7fba29e46640 1 --2- 172.21.15.26:0/2672276447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba2415ca60 0x7fba2406b440 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fba14009870 tx=0x7fba1401c510 comp rx=0 tx=0).stop 2023-10-14T11:12:07.935 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.932+0000 7fba29e46640 1 -- 172.21.15.26:0/2672276447 shutdown_connections 2023-10-14T11:12:07.935 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.932+0000 7fba29e46640 1 --2- 172.21.15.26:0/2672276447 >> v2:172.21.15.110:3300/0 conn(0x7fba240ce710 0x7fba240d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:07.935 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.932+0000 7fba29e46640 1 --2- 172.21.15.26:0/2672276447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba2415ca60 0x7fba2406b440 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:07.936 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.932+0000 7fba29e46640 1 -- 172.21.15.26:0/2672276447 >> 172.21.15.26:0/2672276447 conn(0x7fba2408c350 msgr2=0x7fba2409bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:07.936 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.932+0000 7fba29e46640 1 -- 172.21.15.26:0/2672276447 shutdown_connections 2023-10-14T11:12:07.936 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.932+0000 7fba29e46640 1 -- 172.21.15.26:0/2672276447 wait complete. 2023-10-14T11:12:07.938 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.932+0000 7fba29e46640 1 Processor -- start 2023-10-14T11:12:07.938 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.932+0000 7fba29e46640 1 -- start start 2023-10-14T11:12:07.938 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba29e46640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba2406b980 0x7fba2415ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:07.939 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba29e46640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba240ce710 0x7fba24152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:07.939 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba29e46640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba2415ca60 0x7fba2415b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:07.939 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba29e46640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2415d960 con 0x7fba240ce710 2023-10-14T11:12:07.939 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba29e46640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2415d350 con 0x7fba2415ca60 2023-10-14T11:12:07.939 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba29e46640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2415c0b0 con 0x7fba2406b980 2023-10-14T11:12:07.940 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba237fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba2406b980 0x7fba2415ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:07.940 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba237fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba2406b980 0x7fba2415ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:52844/0 (socket says 172.21.15.26:52844) 2023-10-14T11:12:07.940 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba237fe640 1 -- 172.21.15.26:0/3045078328 learned_addr learned my addr 172.21.15.26:0/3045078328 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:07.940 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba22ffd640 1 --2- 172.21.15.26:0/3045078328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba240ce710 0x7fba24152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:07.940 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba23fff640 1 --2- 172.21.15.26:0/3045078328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba2415ca60 0x7fba2415b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:07.941 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba237fe640 1 -- 172.21.15.26:0/3045078328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba2415ca60 msgr2=0x7fba2415b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:07.941 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba237fe640 1 --2- 172.21.15.26:0/3045078328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba2415ca60 0x7fba2415b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:07.941 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba237fe640 1 -- 172.21.15.26:0/3045078328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba240ce710 msgr2=0x7fba24152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:07.941 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba237fe640 1 --2- 172.21.15.26:0/3045078328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba240ce710 0x7fba24152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:07.941 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba237fe640 1 -- 172.21.15.26:0/3045078328 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba140094d0 con 0x7fba2406b980 2023-10-14T11:12:07.941 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba237fe640 1 --2- 172.21.15.26:0/3045078328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba2406b980 0x7fba2415ddf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fba1401a140 tx=0x7fba140192b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:07.942 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba0bfff640 1 -- 172.21.15.26:0/3045078328 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba140ba410 con 0x7fba2406b980 2023-10-14T11:12:07.942 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba0bfff640 1 -- 172.21.15.26:0/3045078328 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba140ba570 con 0x7fba2406b980 2023-10-14T11:12:07.942 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba0bfff640 1 -- 172.21.15.26:0/3045078328 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba140ba920 con 0x7fba2406b980 2023-10-14T11:12:07.942 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba29e46640 1 -- 172.21.15.26:0/3045078328 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba2415d5f0 con 0x7fba2406b980 2023-10-14T11:12:07.942 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba29e46640 1 -- 172.21.15.26:0/3045078328 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba241533e0 con 0x7fba2406b980 2023-10-14T11:12:07.943 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba29e46640 1 -- 172.21.15.26:0/3045078328 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba2404e170 con 0x7fba2406b980 2023-10-14T11:12:07.943 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.936+0000 7fba0bfff640 1 -- 172.21.15.26:0/3045078328 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 85794+0+0 (secure 0 0 0) 0x7fba140b13f0 con 0x7fba2406b980 2023-10-14T11:12:07.944 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.940+0000 7fba0bfff640 1 --2- 172.21.15.26:0/3045078328 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fba10066460 0x7fba10068920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:07.944 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.940+0000 7fba0bfff640 1 -- 172.21.15.26:0/3045078328 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fba1411d4d0 con 0x7fba2406b980 2023-10-14T11:12:07.944 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.940+0000 7fba22ffd640 1 --2- 172.21.15.26:0/3045078328 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fba10066460 0x7fba10068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:07.944 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.940+0000 7fba22ffd640 1 --2- 172.21.15.26:0/3045078328 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fba10066460 0x7fba10068920 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fba2415b430 tx=0x7fba18009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:07.946 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:07.944+0000 7fba0bfff640 1 -- 172.21.15.26:0/3045078328 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fba140eb860 con 0x7fba2406b980 2023-10-14T11:12:08.105 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:08.104+0000 7fba29e46640 1 -- 172.21.15.26:0/3045078328 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba2406b220 con 0x7fba2406b980 2023-10-14T11:12:08.106 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:08.104+0000 7fba0bfff640 1 -- 172.21.15.26:0/3045078328 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fba140eee80 con 0x7fba2406b980 2023-10-14T11:12:08.106 INFO:teuthology.misc.health.smithi026.stdout: 2023-10-14T11:12:08.107 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":12,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:12:05.817764+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:12:08.108 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:08.104+0000 7fba29e46640 1 -- 172.21.15.26:0/3045078328 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fba10066460 msgr2=0x7fba10068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:08.109 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:08.104+0000 7fba29e46640 1 --2- 172.21.15.26:0/3045078328 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fba10066460 0x7fba10068920 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fba2415b430 tx=0x7fba18009040 comp rx=0 tx=0).stop 2023-10-14T11:12:08.109 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:08.104+0000 7fba29e46640 1 -- 172.21.15.26:0/3045078328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba2406b980 msgr2=0x7fba2415ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:08.109 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:08.104+0000 7fba29e46640 1 --2- 172.21.15.26:0/3045078328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba2406b980 0x7fba2415ddf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fba1401a140 tx=0x7fba140192b0 comp rx=0 tx=0).stop 2023-10-14T11:12:08.109 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:08.104+0000 7fba29e46640 1 -- 172.21.15.26:0/3045078328 shutdown_connections 2023-10-14T11:12:08.110 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:08.104+0000 7fba29e46640 1 --2- 172.21.15.26:0/3045078328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba2415ca60 0x7fba2415b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:08.110 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:08.104+0000 7fba29e46640 1 --2- 172.21.15.26:0/3045078328 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fba10066460 0x7fba10068920 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:08.110 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:08.104+0000 7fba29e46640 1 --2- 172.21.15.26:0/3045078328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba240ce710 0x7fba24152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:08.110 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:08.104+0000 7fba29e46640 1 --2- 172.21.15.26:0/3045078328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba2406b980 0x7fba2415ddf0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:08.110 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:08.104+0000 7fba29e46640 1 -- 172.21.15.26:0/3045078328 >> 172.21.15.26:0/3045078328 conn(0x7fba2408c350 msgr2=0x7fba240b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:08.110 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:08.104+0000 7fba29e46640 1 -- 172.21.15.26:0/3045078328 shutdown_connections 2023-10-14T11:12:08.111 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:08.104+0000 7fba29e46640 1 -- 172.21.15.26:0/3045078328 wait complete. 2023-10-14T11:12:08.126 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-14T11:12:14.935 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T11:12:15.072 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.068+0000 7f9e34279640 1 Processor -- start 2023-10-14T11:12:15.073 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.068+0000 7f9e34279640 1 -- start start 2023-10-14T11:12:15.074 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.072+0000 7f9e34279640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e2c0cbf50 0x7f9e2c0cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:15.074 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.072+0000 7f9e34279640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e2c0b1810 0x7f9e2c06afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:15.074 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.072+0000 7f9e34279640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e2c0cdce0 con 0x7f9e2c1601b0 2023-10-14T11:12:15.074 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.072+0000 7f9e34279640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2c0cfcf0 con 0x7f9e2c0b1810 2023-10-14T11:12:15.075 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.072+0000 7f9e34279640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c0cf440 con 0x7f9e2c0cbf50 2023-10-14T11:12:15.076 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.072+0000 7f9e32015640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9e2c1601b0 0x7f9e2c0cd090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55362/0 (socket says 172.21.15.26:55362) 2023-10-14T11:12:15.076 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.072+0000 7f9e32015640 1 -- 172.21.15.26:0/570112604 learned_addr learned my addr 172.21.15.26:0/570112604 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:15.076 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.072+0000 7f9e32816640 1 --2- 172.21.15.26:0/570112604 >> v2:172.21.15.26:3300/0 conn(0x7f9e2c0b1810 0x7f9e2c06afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:15.076 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.072+0000 7f9e31814640 1 --2- 172.21.15.26:0/570112604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e2c0cbf50 0x7f9e2c0cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:15.076 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.072+0000 7f9e31013640 1 -- 172.21.15.26:0/570112604 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295750483 0 0) 0x7f9e2c0cdce0 con 0x7f9e2c1601b0 2023-10-14T11:12:15.077 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.072+0000 7f9e31013640 1 -- 172.21.15.26:0/570112604 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e18003530 con 0x7f9e2c1601b0 2023-10-14T11:12:15.077 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.072+0000 7f9e32816640 1 -- 172.21.15.26:0/570112604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e2c0cbf50 msgr2=0x7f9e2c0cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:15.077 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.072+0000 7f9e32816640 1 --2- 172.21.15.26:0/570112604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e2c0cbf50 0x7f9e2c0cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.077 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.072+0000 7f9e32816640 1 -- 172.21.15.26:0/570112604 >> v1:172.21.15.26:6789/0 conn(0x7f9e2c1601b0 legacy=0x7f9e2c0cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:15.077 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.072+0000 7f9e32816640 1 -- 172.21.15.26:0/570112604 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2c0cdf10 con 0x7f9e2c0b1810 2023-10-14T11:12:15.078 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.076+0000 7f9e32816640 1 --2- 172.21.15.26:0/570112604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e2c0b1810 0x7f9e2c06afa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9e24009d90 tx=0x7f9e2401c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c52a0cf502cc788d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:15.079 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.076+0000 7f9e31013640 1 -- 172.21.15.26:0/570112604 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e240a57c0 con 0x7f9e2c0b1810 2023-10-14T11:12:15.079 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.076+0000 7f9e31013640 1 -- 172.21.15.26:0/570112604 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e240a5920 con 0x7f9e2c0b1810 2023-10-14T11:12:15.079 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.076+0000 7f9e31013640 1 -- 172.21.15.26:0/570112604 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e240a5cb0 con 0x7f9e2c0b1810 2023-10-14T11:12:15.079 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.076+0000 7f9e34279640 1 -- 172.21.15.26:0/570112604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e2c0b1810 msgr2=0x7f9e2c06afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:15.079 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.076+0000 7f9e34279640 1 --2- 172.21.15.26:0/570112604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e2c0b1810 0x7f9e2c06afa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9e24009d90 tx=0x7f9e2401c810 comp rx=0 tx=0).stop 2023-10-14T11:12:15.080 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.076+0000 7f9e34279640 1 -- 172.21.15.26:0/570112604 shutdown_connections 2023-10-14T11:12:15.080 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.076+0000 7f9e34279640 1 --2- 172.21.15.26:0/570112604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e2c0b1810 0x7f9e2c06afa0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.080 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.076+0000 7f9e34279640 1 --2- 172.21.15.26:0/570112604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e2c0cbf50 0x7f9e2c0cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.080 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.076+0000 7f9e34279640 1 -- 172.21.15.26:0/570112604 >> 172.21.15.26:0/570112604 conn(0x7f9e2c0d0810 msgr2=0x7f9e2c0d0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:15.080 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.076+0000 7f9e34279640 1 -- 172.21.15.26:0/570112604 shutdown_connections 2023-10-14T11:12:15.081 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.076+0000 7f9e34279640 1 -- 172.21.15.26:0/570112604 wait complete. 2023-10-14T11:12:15.083 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.076+0000 7f9e34279640 1 Processor -- start 2023-10-14T11:12:15.083 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.076+0000 7f9e34279640 1 -- start start 2023-10-14T11:12:15.083 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.080+0000 7f9e34279640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e2c0b1810 0x7f9e2c1533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:15.083 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.080+0000 7f9e34279640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e2c0cbf50 0x7f9e2c158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:15.083 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.080+0000 7f9e34279640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e2c1601b0 0x7f9e2c1592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:15.084 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.080+0000 7f9e34279640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c152110 con 0x7f9e2c0cbf50 2023-10-14T11:12:15.084 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.080+0000 7f9e34279640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c1523f0 con 0x7f9e2c0b1810 2023-10-14T11:12:15.084 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.080+0000 7f9e34279640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c1526d0 con 0x7f9e2c1601b0 2023-10-14T11:12:15.084 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.080+0000 7f9e31814640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e2c0cbf50 0x7f9e2c158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:15.084 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.080+0000 7f9e31814640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e2c0cbf50 0x7f9e2c158d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59872/0 (socket says 172.21.15.26:59872) 2023-10-14T11:12:15.085 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.080+0000 7f9e31814640 1 -- 172.21.15.26:0/594458202 learned_addr learned my addr 172.21.15.26:0/594458202 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:15.085 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.080+0000 7f9e31814640 1 -- 172.21.15.26:0/594458202 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e2c1601b0 msgr2=0x7f9e2c1592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:15.085 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.080+0000 7f9e31814640 1 --2- 172.21.15.26:0/594458202 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e2c1601b0 0x7f9e2c1592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.085 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.080+0000 7f9e31814640 1 -- 172.21.15.26:0/594458202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e2c0b1810 msgr2=0x7f9e2c1533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:15.085 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.080+0000 7f9e31814640 1 --2- 172.21.15.26:0/594458202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e2c0b1810 0x7f9e2c1533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.086 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.080+0000 7f9e31814640 1 -- 172.21.15.26:0/594458202 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e24009a70 con 0x7f9e2c0cbf50 2023-10-14T11:12:15.086 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.080+0000 7f9e31814640 1 --2- 172.21.15.26:0/594458202 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e2c0cbf50 0x7f9e2c158d80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00d800 tx=0x7f9e1c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:15.086 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.080+0000 7f9e22ffd640 1 -- 172.21.15.26:0/594458202 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c00b6c0 con 0x7f9e2c0cbf50 2023-10-14T11:12:15.086 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.080+0000 7f9e22ffd640 1 -- 172.21.15.26:0/594458202 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1c00b820 con 0x7f9e2c0cbf50 2023-10-14T11:12:15.086 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.080+0000 7f9e34279640 1 -- 172.21.15.26:0/594458202 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e2c1529b0 con 0x7f9e2c0cbf50 2023-10-14T11:12:15.087 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.080+0000 7f9e22ffd640 1 -- 172.21.15.26:0/594458202 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c00bb90 con 0x7f9e2c0cbf50 2023-10-14T11:12:15.087 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.080+0000 7f9e34279640 1 -- 172.21.15.26:0/594458202 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e2c0c5860 con 0x7f9e2c0cbf50 2023-10-14T11:12:15.088 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.080+0000 7f9e34279640 1 -- 172.21.15.26:0/594458202 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e2c04e170 con 0x7f9e2c0cbf50 2023-10-14T11:12:15.088 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.080+0000 7f9e22ffd640 1 -- 172.21.15.26:0/594458202 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9e1c00bcf0 con 0x7f9e2c0cbf50 2023-10-14T11:12:15.088 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.084+0000 7f9e22ffd640 1 --2- 172.21.15.26:0/594458202 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9e100664a0 0x7f9e10068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:15.088 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.084+0000 7f9e22ffd640 1 -- 172.21.15.26:0/594458202 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9e1c0840c0 con 0x7f9e2c0cbf50 2023-10-14T11:12:15.089 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.084+0000 7f9e32015640 1 --2- 172.21.15.26:0/594458202 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9e100664a0 0x7f9e10068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:15.089 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.084+0000 7f9e32015640 1 --2- 172.21.15.26:0/594458202 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9e100664a0 0x7f9e10068960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9e28007fd0 tx=0x7f9e28007940 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:15.091 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.088+0000 7f9e22ffd640 1 -- 172.21.15.26:0/594458202 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9e1c051890 con 0x7f9e2c0cbf50 2023-10-14T11:12:15.252 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.248+0000 7f9e34279640 1 -- 172.21.15.26:0/594458202 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e2c152ed0 con 0x7f9e2c0cbf50 2023-10-14T11:12:15.253 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.252+0000 7f9e22ffd640 1 -- 172.21.15.26:0/594458202 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f9e2c152ed0 con 0x7f9e2c0cbf50 2023-10-14T11:12:15.254 INFO:teuthology.misc.health.smithi026.stdout: 2023-10-14T11:12:15.254 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":17,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:12:12.866723+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:12:15.255 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.252+0000 7f9e34279640 1 -- 172.21.15.26:0/594458202 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9e100664a0 msgr2=0x7f9e10068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:15.255 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.252+0000 7f9e34279640 1 --2- 172.21.15.26:0/594458202 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9e100664a0 0x7f9e10068960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9e28007fd0 tx=0x7f9e28007940 comp rx=0 tx=0).stop 2023-10-14T11:12:15.256 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.252+0000 7f9e34279640 1 -- 172.21.15.26:0/594458202 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e2c0cbf50 msgr2=0x7f9e2c158d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:15.256 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.252+0000 7f9e34279640 1 --2- 172.21.15.26:0/594458202 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e2c0cbf50 0x7f9e2c158d80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00d800 tx=0x7f9e1c00dcc0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.256 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.252+0000 7f9e34279640 1 -- 172.21.15.26:0/594458202 shutdown_connections 2023-10-14T11:12:15.256 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.252+0000 7f9e34279640 1 --2- 172.21.15.26:0/594458202 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e2c1601b0 0x7f9e2c1592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.256 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.252+0000 7f9e34279640 1 --2- 172.21.15.26:0/594458202 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9e100664a0 0x7f9e10068960 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.257 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.252+0000 7f9e34279640 1 --2- 172.21.15.26:0/594458202 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e2c0cbf50 0x7f9e2c158d80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.257 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.252+0000 7f9e34279640 1 --2- 172.21.15.26:0/594458202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e2c0b1810 0x7f9e2c1533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.257 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.252+0000 7f9e34279640 1 -- 172.21.15.26:0/594458202 >> 172.21.15.26:0/594458202 conn(0x7f9e2c0d0810 msgr2=0x7f9e2c15f010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:15.257 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.252+0000 7f9e34279640 1 -- 172.21.15.26:0/594458202 shutdown_connections 2023-10-14T11:12:15.257 INFO:teuthology.misc.health.smithi026.stderr:2023-10-14T11:12:15.252+0000 7f9e34279640 1 -- 172.21.15.26:0/594458202 wait complete. 2023-10-14T11:12:15.273 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-14T11:12:15.273 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-14T11:12:15.273 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T11:12:15.274 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T11:12:15.278 INFO:tasks.ceph.mds.a:Started 2023-10-14T11:12:15.278 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T11:12:15.279 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T11:12:15.282 INFO:tasks.ceph.mds.c:Started 2023-10-14T11:12:15.282 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T11:12:15.283 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T11:12:15.286 INFO:tasks.ceph.mds.b:Started 2023-10-14T11:12:15.287 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T11:12:15.287 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T11:12:15.290 INFO:tasks.ceph.mds.d:Started 2023-10-14T11:12:15.291 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-14T11:12:15.291 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:12:15.377 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-10-14T11:12:15.378 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-14T11:12:15.397 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2023-10-14T11:12:15.397 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2023-10-14T11:12:15.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.440+0000 7fa0fd10f640 1 Processor -- start 2023-10-14T11:12:15.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.440+0000 7fa0fd10f640 1 -- start start 2023-10-14T11:12:15.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.440+0000 7fa0fd10f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa0f80d15d0 0x7fa0f80cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:15.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.440+0000 7fa0fd10f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f80ce770 con 0x7fa0f815cb90 2023-10-14T11:12:15.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.440+0000 7fa0fd10f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f80d0600 con 0x7fa0f80d3010 2023-10-14T11:12:15.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.440+0000 7fa0fd10f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f80c6450 con 0x7fa0f80d15d0 2023-10-14T11:12:15.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.440+0000 7fa0f6d9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa0f815cb90 0x7fa0f80d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55388/0 (socket says 172.21.15.26:55388) 2023-10-14T11:12:15.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.440+0000 7fa0f6d9d640 1 -- 172.21.15.26:0/3881998913 learned_addr learned my addr 172.21.15.26:0/3881998913 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:15.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.440+0000 7fa0f659c640 1 --2- 172.21.15.26:0/3881998913 >> v2:172.21.15.26:3300/0 conn(0x7fa0f80d15d0 0x7fa0f80cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.440+0000 7fa0f5d9b640 1 -- 172.21.15.26:0/3881998913 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4081405826 0 0) 0x7fa0f80ce770 con 0x7fa0f815cb90 2023-10-14T11:12:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.440+0000 7fa0f5d9b640 1 -- 172.21.15.26:0/3881998913 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0e0003530 con 0x7fa0f815cb90 2023-10-14T11:12:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.440+0000 7fa0f659c640 1 -- 172.21.15.26:0/3881998913 >> v1:172.21.15.110:6789/0 conn(0x7fa0f80d3010 legacy=0x7fa0f80c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.440+0000 7fa0f659c640 1 -- 172.21.15.26:0/3881998913 >> v1:172.21.15.26:6789/0 conn(0x7fa0f815cb90 legacy=0x7fa0f80d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.440+0000 7fa0f659c640 1 -- 172.21.15.26:0/3881998913 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f80d08a0 con 0x7fa0f80d15d0 2023-10-14T11:12:15.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.444+0000 7fa0f659c640 1 --2- 172.21.15.26:0/3881998913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0f80d15d0 0x7fa0f80cfb10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0097c0 tx=0x7fa0ec01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2602212a15295b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:15.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.444+0000 7fa0f5d9b640 1 -- 172.21.15.26:0/3881998913 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec0ac620 con 0x7fa0f80d15d0 2023-10-14T11:12:15.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.444+0000 7fa0f5d9b640 1 -- 172.21.15.26:0/3881998913 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ec0ac780 con 0x7fa0f80d15d0 2023-10-14T11:12:15.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.444+0000 7fa0f5d9b640 1 -- 172.21.15.26:0/3881998913 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec0acb10 con 0x7fa0f80d15d0 2023-10-14T11:12:15.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.444+0000 7fa0fd10f640 1 -- 172.21.15.26:0/3881998913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0f80d15d0 msgr2=0x7fa0f80cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:15.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.444+0000 7fa0fd10f640 1 --2- 172.21.15.26:0/3881998913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0f80d15d0 0x7fa0f80cfb10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0097c0 tx=0x7fa0ec01c3c0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.444+0000 7fa0fd10f640 1 -- 172.21.15.26:0/3881998913 shutdown_connections 2023-10-14T11:12:15.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.444+0000 7fa0fd10f640 1 --2- 172.21.15.26:0/3881998913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0f80d15d0 0x7fa0f80cfb10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.444+0000 7fa0fd10f640 1 -- 172.21.15.26:0/3881998913 >> 172.21.15.26:0/3881998913 conn(0x7fa0f809bc50 msgr2=0x7fa0f80d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:15.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.444+0000 7fa0fd10f640 1 -- 172.21.15.26:0/3881998913 shutdown_connections 2023-10-14T11:12:15.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.444+0000 7fa0fd10f640 1 -- 172.21.15.26:0/3881998913 wait complete. 2023-10-14T11:12:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.444+0000 7fa0fd10f640 1 Processor -- start 2023-10-14T11:12:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0fd10f640 1 -- start start 2023-10-14T11:12:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0fd10f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0f80d15d0 0x7fa0f80cab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:15.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0fd10f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0f80d3010 0x7fa0f806b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:15.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0fd10f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0f815cb90 0x7fa0f806be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:15.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0fd10f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f815ac60 con 0x7fa0f80d15d0 2023-10-14T11:12:15.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0fd10f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f809cf40 con 0x7fa0f80d3010 2023-10-14T11:12:15.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0fd10f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80cb4c0 con 0x7fa0f815cb90 2023-10-14T11:12:15.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0f6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0f80d15d0 0x7fa0f80cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:15.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0f6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0f80d15d0 0x7fa0f80cab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59944/0 (socket says 172.21.15.26:59944) 2023-10-14T11:12:15.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0f6d9d640 1 -- 172.21.15.26:0/3998787520 learned_addr learned my addr 172.21.15.26:0/3998787520 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:15.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0f659c640 1 --2- 172.21.15.26:0/3998787520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0f80d3010 0x7fa0f806b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:15.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0f759e640 1 --2- 172.21.15.26:0/3998787520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0f815cb90 0x7fa0f806be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:15.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0f6d9d640 1 -- 172.21.15.26:0/3998787520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0f815cb90 msgr2=0x7fa0f806be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:15.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0f6d9d640 1 --2- 172.21.15.26:0/3998787520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0f815cb90 0x7fa0f806be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0f6d9d640 1 -- 172.21.15.26:0/3998787520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0f80d3010 msgr2=0x7fa0f806b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:15.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0f6d9d640 1 --2- 172.21.15.26:0/3998787520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0f80d3010 0x7fa0f806b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0f6d9d640 1 -- 172.21.15.26:0/3998787520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ec009420 con 0x7fa0f80d15d0 2023-10-14T11:12:15.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0f6d9d640 1 --2- 172.21.15.26:0/3998787520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0f80d15d0 0x7fa0f80cab50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8001270 tx=0x7fa0e800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:15.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0df7fe640 1 -- 172.21.15.26:0/3998787520 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e80074e0 con 0x7fa0f80d15d0 2023-10-14T11:12:15.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0df7fe640 1 -- 172.21.15.26:0/3998787520 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e8007640 con 0x7fa0f80d15d0 2023-10-14T11:12:15.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0df7fe640 1 -- 172.21.15.26:0/3998787520 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e80059b0 con 0x7fa0f80d15d0 2023-10-14T11:12:15.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0fd10f640 1 -- 172.21.15.26:0/3998787520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f80cb7a0 con 0x7fa0f80d15d0 2023-10-14T11:12:15.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0fd10f640 1 -- 172.21.15.26:0/3998787520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f80cbd60 con 0x7fa0f80d15d0 2023-10-14T11:12:15.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.448+0000 7fa0fd10f640 1 -- 172.21.15.26:0/3998787520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f8074010 con 0x7fa0f80d15d0 2023-10-14T11:12:15.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.452+0000 7fa0df7fe640 1 -- 172.21.15.26:0/3998787520 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa0e8005b10 con 0x7fa0f80d15d0 2023-10-14T11:12:15.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.452+0000 7fa0df7fe640 1 --2- 172.21.15.26:0/3998787520 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa0e40664a0 0x7fa0e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:15.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.452+0000 7fa0df7fe640 1 -- 172.21.15.26:0/3998787520 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa0e8082fe0 con 0x7fa0f80d15d0 2023-10-14T11:12:15.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.452+0000 7fa0f659c640 1 --2- 172.21.15.26:0/3998787520 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa0e40664a0 0x7fa0e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:15.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.452+0000 7fa0f659c640 1 --2- 172.21.15.26:0/3998787520 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa0e40664a0 0x7fa0e4068960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0ae000 tx=0x7fa0ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:15.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.456+0000 7fa0df7fe640 1 -- 172.21.15.26:0/3998787520 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa0e80508f0 con 0x7fa0f80d15d0 2023-10-14T11:12:15.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.612+0000 7fa0fd10f640 1 -- 172.21.15.26:0/3998787520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0f80d3590 con 0x7fa0f80d15d0 2023-10-14T11:12:15.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.616+0000 7fa0df7fe640 1 -- 172.21.15.26:0/3998787520 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12850 (secure 0 0 0) 0x7fa0e8017020 con 0x7fa0f80d15d0 2023-10-14T11:12:15.618 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:15.618 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":17,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:12:12.866723+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:12:15.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.616+0000 7fa0fd10f640 1 -- 172.21.15.26:0/3998787520 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa0e40664a0 msgr2=0x7fa0e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:15.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.616+0000 7fa0fd10f640 1 --2- 172.21.15.26:0/3998787520 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa0e40664a0 0x7fa0e4068960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0ae000 tx=0x7fa0ec008040 comp rx=0 tx=0).stop 2023-10-14T11:12:15.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.616+0000 7fa0fd10f640 1 -- 172.21.15.26:0/3998787520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0f80d15d0 msgr2=0x7fa0f80cab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:15.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.616+0000 7fa0fd10f640 1 --2- 172.21.15.26:0/3998787520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0f80d15d0 0x7fa0f80cab50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8001270 tx=0x7fa0e800c8e0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.616+0000 7fa0fd10f640 1 -- 172.21.15.26:0/3998787520 shutdown_connections 2023-10-14T11:12:15.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.616+0000 7fa0fd10f640 1 --2- 172.21.15.26:0/3998787520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0f815cb90 0x7fa0f806be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.616+0000 7fa0fd10f640 1 --2- 172.21.15.26:0/3998787520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0f80d3010 0x7fa0f806b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.616+0000 7fa0fd10f640 1 --2- 172.21.15.26:0/3998787520 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa0e40664a0 0x7fa0e4068960 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.616+0000 7fa0fd10f640 1 --2- 172.21.15.26:0/3998787520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0f80d15d0 0x7fa0f80cab50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.616+0000 7fa0fd10f640 1 -- 172.21.15.26:0/3998787520 >> 172.21.15.26:0/3998787520 conn(0x7fa0f809bc50 msgr2=0x7fa0f80d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:15.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.616+0000 7fa0fd10f640 1 -- 172.21.15.26:0/3998787520 shutdown_connections 2023-10-14T11:12:15.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.616+0000 7fa0fd10f640 1 -- 172.21.15.26:0/3998787520 wait complete. 2023-10-14T11:12:15.640 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:12:15.640 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:12:15.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.784+0000 7fd061ed6640 1 Processor -- start 2023-10-14T11:12:15.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.784+0000 7fd061ed6640 1 -- start start 2023-10-14T11:12:15.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.784+0000 7fd061ed6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd05c0d0210 0x7fd05c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:15.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.784+0000 7fd061ed6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd05c0d1670 con 0x7fd05c0b84e0 2023-10-14T11:12:15.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.784+0000 7fd061ed6640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd05c0d1950 con 0x7fd05c15cba0 2023-10-14T11:12:15.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.784+0000 7fd061ed6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c0d1460 con 0x7fd05c0d0210 2023-10-14T11:12:15.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.784+0000 7fd05bfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd05c0b84e0 0x7fd05c0b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55396/0 (socket says 172.21.15.26:55396) 2023-10-14T11:12:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.784+0000 7fd05bfff640 1 -- 172.21.15.26:0/2084364110 learned_addr learned my addr 172.21.15.26:0/2084364110 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.784+0000 7fd05affd640 1 --2- 172.21.15.26:0/2084364110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd05c0d0210 0x7fd05c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.784+0000 7fd05a7fc640 1 -- 172.21.15.26:0/2084364110 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031235624 0 0) 0x7fd05c0d1670 con 0x7fd05c0b84e0 2023-10-14T11:12:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.784+0000 7fd05a7fc640 1 -- 172.21.15.26:0/2084364110 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd044003530 con 0x7fd05c0b84e0 2023-10-14T11:12:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.784+0000 7fd05a7fc640 1 -- 172.21.15.26:0/2084364110 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565070101 0 0) 0x7fd05c0d1950 con 0x7fd05c15cba0 2023-10-14T11:12:15.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.784+0000 7fd05a7fc640 1 -- 172.21.15.26:0/2084364110 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd05c0d1670 con 0x7fd05c15cba0 2023-10-14T11:12:15.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.784+0000 7fd05affd640 1 -- 172.21.15.26:0/2084364110 >> v1:172.21.15.110:6789/0 conn(0x7fd05c15cba0 legacy=0x7fd05c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:15.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.784+0000 7fd05affd640 1 -- 172.21.15.26:0/2084364110 >> v1:172.21.15.26:6789/0 conn(0x7fd05c0b84e0 legacy=0x7fd05c0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:15.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.784+0000 7fd05affd640 1 -- 172.21.15.26:0/2084364110 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05c0d1c30 con 0x7fd05c0d0210 2023-10-14T11:12:15.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.788+0000 7fd05affd640 1 --2- 172.21.15.26:0/2084364110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd05c0d0210 0x7fd05c0d0f20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd0500097f0 tx=0x7fd05001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7dd2166ae08a6b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:15.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.788+0000 7fd05a7fc640 1 -- 172.21.15.26:0/2084364110 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0500aa620 con 0x7fd05c0d0210 2023-10-14T11:12:15.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.788+0000 7fd05a7fc640 1 -- 172.21.15.26:0/2084364110 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0500aa780 con 0x7fd05c0d0210 2023-10-14T11:12:15.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.788+0000 7fd05a7fc640 1 -- 172.21.15.26:0/2084364110 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0500aab10 con 0x7fd05c0d0210 2023-10-14T11:12:15.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.788+0000 7fd061ed6640 1 -- 172.21.15.26:0/2084364110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd05c0d0210 msgr2=0x7fd05c0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:15.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.788+0000 7fd061ed6640 1 --2- 172.21.15.26:0/2084364110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd05c0d0210 0x7fd05c0d0f20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd0500097f0 tx=0x7fd05001c4c0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.788+0000 7fd061ed6640 1 -- 172.21.15.26:0/2084364110 shutdown_connections 2023-10-14T11:12:15.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.788+0000 7fd061ed6640 1 --2- 172.21.15.26:0/2084364110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd05c0d0210 0x7fd05c0d0f20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.788+0000 7fd061ed6640 1 -- 172.21.15.26:0/2084364110 >> 172.21.15.26:0/2084364110 conn(0x7fd05c0719c0 msgr2=0x7fd05c071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:15.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.788+0000 7fd061ed6640 1 -- 172.21.15.26:0/2084364110 shutdown_connections 2023-10-14T11:12:15.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.788+0000 7fd061ed6640 1 -- 172.21.15.26:0/2084364110 wait complete. 2023-10-14T11:12:15.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.792+0000 7fd061ed6640 1 Processor -- start 2023-10-14T11:12:15.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.792+0000 7fd061ed6640 1 -- start start 2023-10-14T11:12:15.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.792+0000 7fd061ed6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd05c0b84e0 0x7fd05c14e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:15.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.792+0000 7fd061ed6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd05c0d0210 0x7fd05c14c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:15.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.792+0000 7fd061ed6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd05c15cba0 0x7fd05c15dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:15.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.792+0000 7fd061ed6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c14f760 con 0x7fd05c15cba0 2023-10-14T11:12:15.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.792+0000 7fd061ed6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c14f1a0 con 0x7fd05c0d0210 2023-10-14T11:12:15.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.792+0000 7fd061ed6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c14f480 con 0x7fd05c0b84e0 2023-10-14T11:12:15.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.792+0000 7fd05bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd05c15cba0 0x7fd05c15dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:15.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.792+0000 7fd05b7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd05c0b84e0 0x7fd05c14e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:15.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.792+0000 7fd05bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd05c15cba0 0x7fd05c15dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59948/0 (socket says 172.21.15.26:59948) 2023-10-14T11:12:15.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.792+0000 7fd05affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd05c0d0210 0x7fd05c14c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:15.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.792+0000 7fd05bfff640 1 -- 172.21.15.26:0/3380641456 learned_addr learned my addr 172.21.15.26:0/3380641456 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:15.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.792+0000 7fd05affd640 1 -- 172.21.15.26:0/3380641456 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd05c0b84e0 msgr2=0x7fd05c14e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:15.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.792+0000 7fd05affd640 1 --2- 172.21.15.26:0/3380641456 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd05c0b84e0 0x7fd05c14e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.792+0000 7fd05affd640 1 -- 172.21.15.26:0/3380641456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd05c15cba0 msgr2=0x7fd05c15dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:15.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.792+0000 7fd05affd640 1 --2- 172.21.15.26:0/3380641456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd05c15cba0 0x7fd05c15dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.792+0000 7fd05affd640 1 -- 172.21.15.26:0/3380641456 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd050009420 con 0x7fd05c0d0210 2023-10-14T11:12:15.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.792+0000 7fd05bfff640 1 --2- 172.21.15.26:0/3380641456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd05c15cba0 0x7fd05c15dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:12:15.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.796+0000 7fd05affd640 1 --2- 172.21.15.26:0/3380641456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd05c0d0210 0x7fd05c14c270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd0500ab000 tx=0x7fd05001ad00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:15.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.796+0000 7fd043fff640 1 -- 172.21.15.26:0/3380641456 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0500aadc0 con 0x7fd05c0d0210 2023-10-14T11:12:15.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.796+0000 7fd043fff640 1 -- 172.21.15.26:0/3380641456 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0500be410 con 0x7fd05c0d0210 2023-10-14T11:12:15.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.796+0000 7fd043fff640 1 -- 172.21.15.26:0/3380641456 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0500be7c0 con 0x7fd05c0d0210 2023-10-14T11:12:15.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.796+0000 7fd061ed6640 1 -- 172.21.15.26:0/3380641456 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd05c0c79d0 con 0x7fd05c0d0210 2023-10-14T11:12:15.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.796+0000 7fd061ed6640 1 -- 172.21.15.26:0/3380641456 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd05c14ee90 con 0x7fd05c0d0210 2023-10-14T11:12:15.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.796+0000 7fd061ed6640 1 -- 172.21.15.26:0/3380641456 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd05c04e170 con 0x7fd05c0d0210 2023-10-14T11:12:15.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.796+0000 7fd043fff640 1 -- 172.21.15.26:0/3380641456 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd0500059a0 con 0x7fd05c0d0210 2023-10-14T11:12:15.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.796+0000 7fd043fff640 1 --2- 172.21.15.26:0/3380641456 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd0480664a0 0x7fd048068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:15.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.796+0000 7fd043fff640 1 -- 172.21.15.26:0/3380641456 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd05011e260 con 0x7fd05c0d0210 2023-10-14T11:12:15.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.796+0000 7fd05b7fe640 1 --2- 172.21.15.26:0/3380641456 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd0480664a0 0x7fd048068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:15.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.800+0000 7fd05b7fe640 1 --2- 172.21.15.26:0/3380641456 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd0480664a0 0x7fd048068960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0011f0 tx=0x7fd04c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:15.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.800+0000 7fd043fff640 1 -- 172.21.15.26:0/3380641456 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd0500ebb50 con 0x7fd05c0d0210 2023-10-14T11:12:15.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.960+0000 7fd061ed6640 1 -- 172.21.15.26:0/3380641456 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd05c14f5c0 con 0x7fd05c0d0210 2023-10-14T11:12:15.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.960+0000 7fd043fff640 1 -- 172.21.15.26:0/3380641456 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd05c14f5c0 con 0x7fd05c0d0210 2023-10-14T11:12:15.964 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:12:15.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.964+0000 7fd061ed6640 1 -- 172.21.15.26:0/3380641456 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd0480664a0 msgr2=0x7fd048068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:15.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.964+0000 7fd061ed6640 1 --2- 172.21.15.26:0/3380641456 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd0480664a0 0x7fd048068960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0011f0 tx=0x7fd04c009040 comp rx=0 tx=0).stop 2023-10-14T11:12:15.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.964+0000 7fd061ed6640 1 -- 172.21.15.26:0/3380641456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd05c0d0210 msgr2=0x7fd05c14c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:15.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.964+0000 7fd061ed6640 1 --2- 172.21.15.26:0/3380641456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd05c0d0210 0x7fd05c14c270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd0500ab000 tx=0x7fd05001ad00 comp rx=0 tx=0).stop 2023-10-14T11:12:15.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.964+0000 7fd061ed6640 1 -- 172.21.15.26:0/3380641456 shutdown_connections 2023-10-14T11:12:15.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.964+0000 7fd061ed6640 1 --2- 172.21.15.26:0/3380641456 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd0480664a0 0x7fd048068960 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.964+0000 7fd061ed6640 1 --2- 172.21.15.26:0/3380641456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd05c15cba0 0x7fd05c15dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.964+0000 7fd061ed6640 1 --2- 172.21.15.26:0/3380641456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd05c0d0210 0x7fd05c14c270 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.964+0000 7fd061ed6640 1 --2- 172.21.15.26:0/3380641456 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd05c0b84e0 0x7fd05c14e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:15.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.964+0000 7fd061ed6640 1 -- 172.21.15.26:0/3380641456 >> 172.21.15.26:0/3380641456 conn(0x7fd05c0719c0 msgr2=0x7fd05c0b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:15.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.964+0000 7fd061ed6640 1 -- 172.21.15.26:0/3380641456 shutdown_connections 2023-10-14T11:12:15.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:15.964+0000 7fd061ed6640 1 -- 172.21.15.26:0/3380641456 wait complete. 2023-10-14T11:12:15.985 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:12:16.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.124+0000 7f2e96101640 1 Processor -- start 2023-10-14T11:12:16.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.124+0000 7f2e96101640 1 -- start start 2023-10-14T11:12:16.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.124+0000 7f2e96101640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e90070c40 0x7f2e9015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:16.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.124+0000 7f2e96101640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2e900b4020 0x7f2e900b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:16.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.124+0000 7f2e96101640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2e900b0620 0x7f2e9015c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:16.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.124+0000 7f2e96101640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9015b3b0 con 0x7f2e900b4020 2023-10-14T11:12:16.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.124+0000 7f2e96101640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e900b0a90 con 0x7f2e900b0620 2023-10-14T11:12:16.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.124+0000 7f2e96101640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9015be60 con 0x7f2e90070c40 2023-10-14T11:12:16.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.128+0000 7f2e8effd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2e900b4020 0x7f2e900b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:16.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.128+0000 7f2e8effd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2e900b4020 0x7f2e900b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59950/0 (socket says 172.21.15.26:59950) 2023-10-14T11:12:16.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.128+0000 7f2e8effd640 1 -- 172.21.15.26:0/710928710 learned_addr learned my addr 172.21.15.26:0/710928710 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:16.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.128+0000 7f2e8f7fe640 1 --2- 172.21.15.26:0/710928710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e90070c40 0x7f2e9015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:16.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.128+0000 7f2e8ffff640 1 --2- 172.21.15.26:0/710928710 >> v2:172.21.15.110:3300/0 conn(0x7f2e900b0620 0x7f2e9015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:16.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.128+0000 7f2e8effd640 1 -- 172.21.15.26:0/710928710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e90070c40 msgr2=0x7f2e9015ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:16.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.128+0000 7f2e8effd640 1 --2- 172.21.15.26:0/710928710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e90070c40 0x7f2e9015ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:16.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.128+0000 7f2e8effd640 1 -- 172.21.15.26:0/710928710 >> v2:172.21.15.110:3300/0 conn(0x7f2e900b0620 msgr2=0x7f2e9015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:16.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.128+0000 7f2e8effd640 1 --2- 172.21.15.26:0/710928710 >> v2:172.21.15.110:3300/0 conn(0x7f2e900b0620 0x7f2e9015c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:16.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.128+0000 7f2e8effd640 1 -- 172.21.15.26:0/710928710 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9015c1f0 con 0x7f2e900b4020 2023-10-14T11:12:16.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.128+0000 7f2e8effd640 1 --2- 172.21.15.26:0/710928710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e900b4020 0x7f2e900b00e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2e900b0e30 tx=0x7f2e8401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59df235fa99bbc89 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:16.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.128+0000 7f2e8e7fc640 1 -- 172.21.15.26:0/710928710 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e840a7070 con 0x7f2e900b4020 2023-10-14T11:12:16.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.128+0000 7f2e8e7fc640 1 -- 172.21.15.26:0/710928710 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e840ab430 con 0x7f2e900b4020 2023-10-14T11:12:16.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.128+0000 7f2e8e7fc640 1 -- 172.21.15.26:0/710928710 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e840ab7c0 con 0x7f2e900b4020 2023-10-14T11:12:16.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e96101640 1 -- 172.21.15.26:0/710928710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e900b4020 msgr2=0x7f2e900b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:16.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e96101640 1 --2- 172.21.15.26:0/710928710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e900b4020 0x7f2e900b00e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2e900b0e30 tx=0x7f2e8401c470 comp rx=0 tx=0).stop 2023-10-14T11:12:16.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e96101640 1 -- 172.21.15.26:0/710928710 shutdown_connections 2023-10-14T11:12:16.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e96101640 1 --2- 172.21.15.26:0/710928710 >> v2:172.21.15.110:3300/0 conn(0x7f2e900b0620 0x7f2e9015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:16.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e96101640 1 --2- 172.21.15.26:0/710928710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e900b4020 0x7f2e900b00e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:16.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e96101640 1 --2- 172.21.15.26:0/710928710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e90070c40 0x7f2e9015ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:16.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e96101640 1 -- 172.21.15.26:0/710928710 >> 172.21.15.26:0/710928710 conn(0x7f2e9006c190 msgr2=0x7f2e9006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:16.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e96101640 1 -- 172.21.15.26:0/710928710 shutdown_connections 2023-10-14T11:12:16.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e96101640 1 -- 172.21.15.26:0/710928710 wait complete. 2023-10-14T11:12:16.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e96101640 1 Processor -- start 2023-10-14T11:12:16.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e96101640 1 -- start start 2023-10-14T11:12:16.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e96101640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e90070c40 0x7f2e90140580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:16.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e96101640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e900b0620 0x7f2e9014b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:16.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e96101640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e900b4020 0x7f2e900ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:16.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e96101640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9014bd20 con 0x7f2e900b0620 2023-10-14T11:12:16.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e96101640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9014c000 con 0x7f2e900b4020 2023-10-14T11:12:16.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e96101640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9014c2e0 con 0x7f2e90070c40 2023-10-14T11:12:16.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e8effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e900b0620 0x7f2e9014b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:16.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e8effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e900b0620 0x7f2e9014b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59952/0 (socket says 172.21.15.26:59952) 2023-10-14T11:12:16.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e8effd640 1 -- 172.21.15.26:0/2575311212 learned_addr learned my addr 172.21.15.26:0/2575311212 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:16.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e8ffff640 1 --2- 172.21.15.26:0/2575311212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e900b4020 0x7f2e900ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:16.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e8f7fe640 1 --2- 172.21.15.26:0/2575311212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e90070c40 0x7f2e90140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:16.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e8effd640 1 -- 172.21.15.26:0/2575311212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e90070c40 msgr2=0x7f2e90140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:16.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e8effd640 1 --2- 172.21.15.26:0/2575311212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e90070c40 0x7f2e90140580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:16.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e8effd640 1 -- 172.21.15.26:0/2575311212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e900b4020 msgr2=0x7f2e900ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:16.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e8effd640 1 --2- 172.21.15.26:0/2575311212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e900b4020 0x7f2e900ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:16.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.132+0000 7f2e8effd640 1 -- 172.21.15.26:0/2575311212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e840094d0 con 0x7f2e900b0620 2023-10-14T11:12:16.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.136+0000 7f2e8effd640 1 --2- 172.21.15.26:0/2575311212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e900b0620 0x7f2e9014b2d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2e840ad040 tx=0x7f2e84019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:16.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.136+0000 7f2e77fff640 1 -- 172.21.15.26:0/2575311212 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e840b4620 con 0x7f2e900b0620 2023-10-14T11:12:16.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.136+0000 7f2e77fff640 1 -- 172.21.15.26:0/2575311212 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e840b47a0 con 0x7f2e900b0620 2023-10-14T11:12:16.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.136+0000 7f2e96101640 1 -- 172.21.15.26:0/2575311212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9014c5c0 con 0x7f2e900b0620 2023-10-14T11:12:16.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.136+0000 7f2e77fff640 1 -- 172.21.15.26:0/2575311212 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e840b4b50 con 0x7f2e900b0620 2023-10-14T11:12:16.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.136+0000 7f2e96101640 1 -- 172.21.15.26:0/2575311212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e90140ac0 con 0x7f2e900b0620 2023-10-14T11:12:16.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.136+0000 7f2e96101640 1 -- 172.21.15.26:0/2575311212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e90074010 con 0x7f2e900b0620 2023-10-14T11:12:16.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.136+0000 7f2e77fff640 1 -- 172.21.15.26:0/2575311212 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2e840b4cb0 con 0x7f2e900b0620 2023-10-14T11:12:16.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.136+0000 7f2e77fff640 1 --2- 172.21.15.26:0/2575311212 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2e7c0664a0 0x7f2e7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:16.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.136+0000 7f2e77fff640 1 -- 172.21.15.26:0/2575311212 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2e8411de80 con 0x7f2e900b0620 2023-10-14T11:12:16.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.136+0000 7f2e8f7fe640 1 --2- 172.21.15.26:0/2575311212 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2e7c0664a0 0x7f2e7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:16.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.140+0000 7f2e8f7fe640 1 --2- 172.21.15.26:0/2575311212 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2e7c0664a0 0x7f2e7c068960 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2e80009af0 tx=0x7f2e80008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:16.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.140+0000 7f2e77fff640 1 -- 172.21.15.26:0/2575311212 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2e840eb760 con 0x7f2e900b0620 2023-10-14T11:12:16.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.328+0000 7f2e96101640 1 -- 172.21.15.26:0/2575311212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e9014d220 con 0x7f2e900b0620 2023-10-14T11:12:16.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.328+0000 7f2e77fff640 1 -- 172.21.15.26:0/2575311212 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f2e840c4090 con 0x7f2e900b0620 2023-10-14T11:12:16.333 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:16.333 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6836/4242453713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":4242453713},{"type":"v1","addr":"172.21.15.26:6836","nonce":4242453713}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-14T11:12:16.333 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 2 2023-10-14T11:12:16.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.332+0000 7f2e96101640 1 -- 172.21.15.26:0/2575311212 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2e7c0664a0 msgr2=0x7f2e7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:16.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.332+0000 7f2e96101640 1 --2- 172.21.15.26:0/2575311212 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2e7c0664a0 0x7f2e7c068960 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2e80009af0 tx=0x7f2e80008040 comp rx=0 tx=0).stop 2023-10-14T11:12:16.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.332+0000 7f2e96101640 1 -- 172.21.15.26:0/2575311212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e900b0620 msgr2=0x7f2e9014b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:16.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.332+0000 7f2e96101640 1 --2- 172.21.15.26:0/2575311212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e900b0620 0x7f2e9014b2d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2e840ad040 tx=0x7f2e84019210 comp rx=0 tx=0).stop 2023-10-14T11:12:16.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.332+0000 7f2e96101640 1 -- 172.21.15.26:0/2575311212 shutdown_connections 2023-10-14T11:12:16.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.332+0000 7f2e96101640 1 --2- 172.21.15.26:0/2575311212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e900b4020 0x7f2e900ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:16.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.332+0000 7f2e96101640 1 --2- 172.21.15.26:0/2575311212 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2e7c0664a0 0x7f2e7c068960 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.332+0000 7f2e96101640 1 --2- 172.21.15.26:0/2575311212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e900b0620 0x7f2e9014b2d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.332+0000 7f2e96101640 1 --2- 172.21.15.26:0/2575311212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e90070c40 0x7f2e90140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:16.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.332+0000 7f2e96101640 1 -- 172.21.15.26:0/2575311212 >> 172.21.15.26:0/2575311212 conn(0x7f2e9006c190 msgr2=0x7f2e90071300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:16.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.332+0000 7f2e96101640 1 -- 172.21.15.26:0/2575311212 shutdown_connections 2023-10-14T11:12:16.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:16.332+0000 7f2e96101640 1 -- 172.21.15.26:0/2575311212 wait complete. 2023-10-14T11:12:18.355 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:12:18.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.504+0000 7f7d5419d640 1 Processor -- start 2023-10-14T11:12:18.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.504+0000 7f7d5419d640 1 -- start start 2023-10-14T11:12:18.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.508+0000 7f7d5419d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d4c164520 0x7f7d4c0ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:18.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.508+0000 7f7d5419d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7d4c0b07f0 0x7f7d4c0cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:18.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.508+0000 7f7d5419d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4c0c96f0 con 0x7f7d4c0ad960 2023-10-14T11:12:18.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.508+0000 7f7d5419d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c164900 con 0x7f7d4c0b07f0 2023-10-14T11:12:18.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.508+0000 7f7d5419d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0cb950 con 0x7f7d4c164520 2023-10-14T11:12:18.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.508+0000 7f7d51f39640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d4c164520 0x7f7d4c0ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:18.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.508+0000 7f7d51f39640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d4c164520 0x7f7d4c0ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:51782/0 (socket says 172.21.15.26:51782) 2023-10-14T11:12:18.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.508+0000 7f7d51f39640 1 -- 172.21.15.26:0/4163263166 learned_addr learned my addr 172.21.15.26:0/4163263166 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:18.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.508+0000 7f7d5273a640 1 --2- 172.21.15.26:0/4163263166 >> v2:172.21.15.110:3300/0 conn(0x7f7d4c0b07f0 0x7f7d4c0cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:18.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.508+0000 7f7d51f39640 1 -- 172.21.15.26:0/4163263166 >> v2:172.21.15.110:3300/0 conn(0x7f7d4c0b07f0 msgr2=0x7f7d4c0cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:18.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.508+0000 7f7d51f39640 1 --2- 172.21.15.26:0/4163263166 >> v2:172.21.15.110:3300/0 conn(0x7f7d4c0b07f0 0x7f7d4c0cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:18.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.508+0000 7f7d51f39640 1 -- 172.21.15.26:0/4163263166 >> v1:172.21.15.110:6789/0 conn(0x7f7d4c0ad960 legacy=0x7f7d4c0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:18.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.508+0000 7f7d51f39640 1 -- 172.21.15.26:0/4163263166 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c0cbed0 con 0x7f7d4c164520 2023-10-14T11:12:18.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.512+0000 7f7d51f39640 1 --2- 172.21.15.26:0/4163263166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d4c164520 0x7f7d4c0ce010 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009870 tx=0x7f7d4801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61eee5190e4bb0ed server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:18.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.512+0000 7f7d50f37640 1 -- 172.21.15.26:0/4163263166 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d480a95f0 con 0x7f7d4c164520 2023-10-14T11:12:18.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.512+0000 7f7d50f37640 1 -- 172.21.15.26:0/4163263166 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d480a9750 con 0x7f7d4c164520 2023-10-14T11:12:18.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.512+0000 7f7d50f37640 1 -- 172.21.15.26:0/4163263166 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d480a9ae0 con 0x7f7d4c164520 2023-10-14T11:12:18.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.512+0000 7f7d5419d640 1 -- 172.21.15.26:0/4163263166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d4c164520 msgr2=0x7f7d4c0ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:18.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.512+0000 7f7d5419d640 1 --2- 172.21.15.26:0/4163263166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d4c164520 0x7f7d4c0ce010 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009870 tx=0x7f7d4801c510 comp rx=0 tx=0).stop 2023-10-14T11:12:18.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.512+0000 7f7d5419d640 1 -- 172.21.15.26:0/4163263166 shutdown_connections 2023-10-14T11:12:18.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.512+0000 7f7d5419d640 1 --2- 172.21.15.26:0/4163263166 >> v2:172.21.15.110:3300/0 conn(0x7f7d4c0b07f0 0x7f7d4c0cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:18.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.512+0000 7f7d5419d640 1 --2- 172.21.15.26:0/4163263166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d4c164520 0x7f7d4c0ce010 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:18.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.512+0000 7f7d5419d640 1 -- 172.21.15.26:0/4163263166 >> 172.21.15.26:0/4163263166 conn(0x7f7d4c06c190 msgr2=0x7f7d4c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:18.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.512+0000 7f7d5419d640 1 -- 172.21.15.26:0/4163263166 shutdown_connections 2023-10-14T11:12:18.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.512+0000 7f7d5419d640 1 -- 172.21.15.26:0/4163263166 wait complete. 2023-10-14T11:12:18.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.512+0000 7f7d5419d640 1 Processor -- start 2023-10-14T11:12:18.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d5419d640 1 -- start start 2023-10-14T11:12:18.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d5419d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d4c0ad960 0x7f7d4c0c2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:18.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d5419d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d4c0b07f0 0x7f7d4c0b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:18.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d5419d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d4c164520 0x7f7d4c14fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:18.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d5419d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c150870 con 0x7f7d4c164520 2023-10-14T11:12:18.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d5419d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c15b280 con 0x7f7d4c0b07f0 2023-10-14T11:12:18.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d5419d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0b3510 con 0x7f7d4c0ad960 2023-10-14T11:12:18.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d5273a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d4c164520 0x7f7d4c14fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:18.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d5273a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d4c164520 0x7f7d4c14fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59962/0 (socket says 172.21.15.26:59962) 2023-10-14T11:12:18.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d5273a640 1 -- 172.21.15.26:0/378933002 learned_addr learned my addr 172.21.15.26:0/378933002 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:18.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d51f39640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d4c0ad960 0x7f7d4c0c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:18.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d51738640 1 --2- 172.21.15.26:0/378933002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d4c0b07f0 0x7f7d4c0b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:18.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d5273a640 1 -- 172.21.15.26:0/378933002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d4c0ad960 msgr2=0x7f7d4c0c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:18.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d5273a640 1 --2- 172.21.15.26:0/378933002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d4c0ad960 0x7f7d4c0c2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:18.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d5273a640 1 -- 172.21.15.26:0/378933002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d4c0b07f0 msgr2=0x7f7d4c0b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:18.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d5273a640 1 --2- 172.21.15.26:0/378933002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d4c0b07f0 0x7f7d4c0b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:18.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d5273a640 1 -- 172.21.15.26:0/378933002 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d480094d0 con 0x7f7d4c164520 2023-10-14T11:12:18.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d5273a640 1 --2- 172.21.15.26:0/378933002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d4c164520 0x7f7d4c14fe00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400ec10 tx=0x7f7d4400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:18.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d427fc640 1 -- 172.21.15.26:0/378933002 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400cd20 con 0x7f7d4c164520 2023-10-14T11:12:18.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d427fc640 1 -- 172.21.15.26:0/378933002 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4400f040 con 0x7f7d4c164520 2023-10-14T11:12:18.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d427fc640 1 -- 172.21.15.26:0/378933002 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d440146c0 con 0x7f7d4c164520 2023-10-14T11:12:18.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d5419d640 1 -- 172.21.15.26:0/378933002 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4c0b37f0 con 0x7f7d4c164520 2023-10-14T11:12:18.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d5419d640 1 -- 172.21.15.26:0/378933002 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c0b3db0 con 0x7f7d4c164520 2023-10-14T11:12:18.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.516+0000 7f7d5419d640 1 -- 172.21.15.26:0/378933002 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4c1509e0 con 0x7f7d4c164520 2023-10-14T11:12:18.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.520+0000 7f7d427fc640 1 -- 172.21.15.26:0/378933002 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7d44014a30 con 0x7f7d4c164520 2023-10-14T11:12:18.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.520+0000 7f7d427fc640 1 --2- 172.21.15.26:0/378933002 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7d300664a0 0x7f7d30068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:18.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.520+0000 7f7d427fc640 1 -- 172.21.15.26:0/378933002 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7d44084690 con 0x7f7d4c164520 2023-10-14T11:12:18.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.520+0000 7f7d51f39640 1 --2- 172.21.15.26:0/378933002 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7d300664a0 0x7f7d30068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:18.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.520+0000 7f7d51f39640 1 --2- 172.21.15.26:0/378933002 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7d300664a0 0x7f7d30068960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7d480ae000 tx=0x7f7d480b4040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:18.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.524+0000 7f7d427fc640 1 -- 172.21.15.26:0/378933002 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7d44051f00 con 0x7f7d4c164520 2023-10-14T11:12:18.626 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:12:18.630 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:12:18.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.712+0000 7f7d5419d640 1 -- 172.21.15.26:0/378933002 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d4c074010 con 0x7f7d4c164520 2023-10-14T11:12:18.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.716+0000 7f7d427fc640 1 -- 172.21.15.26:0/378933002 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7f7d44018e90 con 0x7f7d4c164520 2023-10-14T11:12:18.717 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:18.718 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/2685368784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2685368784},{"type":"v1","addr":"172.21.15.110:6834","nonce":2685368784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6836/4242453713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":4242453713},{"type":"v1","addr":"172.21.15.26:6836","nonce":4242453713}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3507761146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":3507761146},{"type":"v1","addr":"172.21.15.26:6837","nonce":3507761146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3522025152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3522025152},{"type":"v1","addr":"172.21.15.110:6835","nonce":3522025152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-14T11:12:18.718 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 3 2023-10-14T11:12:18.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.716+0000 7f7d5419d640 1 -- 172.21.15.26:0/378933002 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7d300664a0 msgr2=0x7f7d30068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:18.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.716+0000 7f7d5419d640 1 --2- 172.21.15.26:0/378933002 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7d300664a0 0x7f7d30068960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7d480ae000 tx=0x7f7d480b4040 comp rx=0 tx=0).stop 2023-10-14T11:12:18.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.716+0000 7f7d5419d640 1 -- 172.21.15.26:0/378933002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d4c164520 msgr2=0x7f7d4c14fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:18.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.716+0000 7f7d5419d640 1 --2- 172.21.15.26:0/378933002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d4c164520 0x7f7d4c14fe00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400ec10 tx=0x7f7d4400c490 comp rx=0 tx=0).stop 2023-10-14T11:12:18.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.716+0000 7f7d5419d640 1 -- 172.21.15.26:0/378933002 shutdown_connections 2023-10-14T11:12:18.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.716+0000 7f7d5419d640 1 --2- 172.21.15.26:0/378933002 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7d300664a0 0x7f7d30068960 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:18.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.716+0000 7f7d5419d640 1 --2- 172.21.15.26:0/378933002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d4c164520 0x7f7d4c14fe00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:18.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.716+0000 7f7d5419d640 1 --2- 172.21.15.26:0/378933002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d4c0b07f0 0x7f7d4c0b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:18.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.716+0000 7f7d5419d640 1 --2- 172.21.15.26:0/378933002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d4c0ad960 0x7f7d4c0c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:18.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.716+0000 7f7d5419d640 1 -- 172.21.15.26:0/378933002 >> 172.21.15.26:0/378933002 conn(0x7f7d4c06c190 msgr2=0x7f7d4c0af860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:18.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.716+0000 7f7d5419d640 1 -- 172.21.15.26:0/378933002 shutdown_connections 2023-10-14T11:12:18.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.716+0000 7f7d5419d640 1 -- 172.21.15.26:0/378933002 wait complete. 2023-10-14T11:12:18.738 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:12:18.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.920+0000 7fb9c9017640 1 Processor -- start 2023-10-14T11:12:18.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.920+0000 7fb9c9017640 1 -- start start 2023-10-14T11:12:18.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.920+0000 7fb9c9017640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb9c40b07f0 0x7fb9c415ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:18.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.920+0000 7fb9c9017640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9c415d690 0x7fb9c4164490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:18.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.920+0000 7fb9c9017640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c415be60 con 0x7fb9c4070c40 2023-10-14T11:12:18.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.920+0000 7fb9c9017640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c415b3b0 con 0x7fb9c40b07f0 2023-10-14T11:12:18.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.920+0000 7fb9c9017640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c415c1f0 con 0x7fb9c415d690 2023-10-14T11:12:18.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.924+0000 7fb9bbfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb9c40b07f0 0x7fb9c415ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:18.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.924+0000 7fb9c359e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9c415d690 0x7fb9c4164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:18.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.924+0000 7fb9bbfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb9c40b07f0 0x7fb9c415ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:34640/0 (socket says 172.21.15.26:34640) 2023-10-14T11:12:18.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.924+0000 7fb9bbfff640 1 -- 172.21.15.26:0/341190298 learned_addr learned my addr 172.21.15.26:0/341190298 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:18.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.924+0000 7fb9c359e640 1 -- 172.21.15.26:0/341190298 >> v2:172.21.15.110:3300/0 conn(0x7fb9c40b07f0 msgr2=0x7fb9c415ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:18.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.924+0000 7fb9c359e640 1 --2- 172.21.15.26:0/341190298 >> v2:172.21.15.110:3300/0 conn(0x7fb9c40b07f0 0x7fb9c415ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:18.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.924+0000 7fb9c359e640 1 -- 172.21.15.26:0/341190298 >> v1:172.21.15.110:6789/0 conn(0x7fb9c4070c40 legacy=0x7fb9c40b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:18.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.924+0000 7fb9c359e640 1 -- 172.21.15.26:0/341190298 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c4071020 con 0x7fb9c415d690 2023-10-14T11:12:18.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.924+0000 7fb9bbfff640 1 --2- 172.21.15.26:0/341190298 >> v2:172.21.15.110:3300/0 conn(0x7fb9c40b07f0 0x7fb9c415ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:12:18.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.924+0000 7fb9c359e640 1 --2- 172.21.15.26:0/341190298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9c415d690 0x7fb9c4164490 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc009d90 tx=0x7fb9bc01c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e904788aa5236cb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:18.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.928+0000 7fb9c259c640 1 -- 172.21.15.26:0/341190298 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc0a58f0 con 0x7fb9c415d690 2023-10-14T11:12:18.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.928+0000 7fb9c259c640 1 -- 172.21.15.26:0/341190298 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9bc0a5a50 con 0x7fb9c415d690 2023-10-14T11:12:18.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.928+0000 7fb9c259c640 1 -- 172.21.15.26:0/341190298 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc0a5de0 con 0x7fb9c415d690 2023-10-14T11:12:18.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.928+0000 7fb9c9017640 1 -- 172.21.15.26:0/341190298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9c415d690 msgr2=0x7fb9c4164490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:18.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.928+0000 7fb9c9017640 1 --2- 172.21.15.26:0/341190298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9c415d690 0x7fb9c4164490 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc009d90 tx=0x7fb9bc01c830 comp rx=0 tx=0).stop 2023-10-14T11:12:18.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.928+0000 7fb9c9017640 1 -- 172.21.15.26:0/341190298 shutdown_connections 2023-10-14T11:12:18.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.928+0000 7fb9c9017640 1 --2- 172.21.15.26:0/341190298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9c415d690 0x7fb9c4164490 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:18.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.928+0000 7fb9c9017640 1 --2- 172.21.15.26:0/341190298 >> v2:172.21.15.110:3300/0 conn(0x7fb9c40b07f0 0x7fb9c415ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:18.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.928+0000 7fb9c9017640 1 -- 172.21.15.26:0/341190298 >> 172.21.15.26:0/341190298 conn(0x7fb9c406c190 msgr2=0x7fb9c406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:18.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.928+0000 7fb9c9017640 1 -- 172.21.15.26:0/341190298 shutdown_connections 2023-10-14T11:12:18.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.928+0000 7fb9c9017640 1 -- 172.21.15.26:0/341190298 wait complete. 2023-10-14T11:12:18.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.928+0000 7fb9c9017640 1 Processor -- start 2023-10-14T11:12:18.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.928+0000 7fb9c9017640 1 -- start start 2023-10-14T11:12:18.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9c9017640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9c4070c40 0x7fb9c40b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:18.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9c9017640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9c40b07f0 0x7fb9c4148900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:18.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9c9017640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9c415d690 0x7fb9c4148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:18.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9c9017640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c40c3700 con 0x7fb9c415d690 2023-10-14T11:12:18.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9c9017640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c414bcb0 con 0x7fb9c4070c40 2023-10-14T11:12:18.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9c9017640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c40c2da0 con 0x7fb9c40b07f0 2023-10-14T11:12:18.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9c359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9c415d690 0x7fb9c4148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:18.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9bbfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9c40b07f0 0x7fb9c4148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:18.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9c359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9c415d690 0x7fb9c4148e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59976/0 (socket says 172.21.15.26:59976) 2023-10-14T11:12:18.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9c359e640 1 -- 172.21.15.26:0/1633960500 learned_addr learned my addr 172.21.15.26:0/1633960500 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:18.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9c2d9d640 1 --2- 172.21.15.26:0/1633960500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9c4070c40 0x7fb9c40b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:18.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9c359e640 1 -- 172.21.15.26:0/1633960500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9c40b07f0 msgr2=0x7fb9c4148900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:18.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9c359e640 1 --2- 172.21.15.26:0/1633960500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9c40b07f0 0x7fb9c4148900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:18.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9c359e640 1 -- 172.21.15.26:0/1633960500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9c4070c40 msgr2=0x7fb9c40b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:18.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9c359e640 1 --2- 172.21.15.26:0/1633960500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9c4070c40 0x7fb9c40b22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:18.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9c359e640 1 -- 172.21.15.26:0/1633960500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac0094d0 con 0x7fb9c415d690 2023-10-14T11:12:18.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9c359e640 1 --2- 172.21.15.26:0/1633960500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9c415d690 0x7fb9c4148e40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc01aee0 tx=0x7fb9bc0195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:18.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9bb7fe640 1 -- 172.21.15.26:0/1633960500 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc0b9650 con 0x7fb9c415d690 2023-10-14T11:12:18.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9bb7fe640 1 -- 172.21.15.26:0/1633960500 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9bc0b97b0 con 0x7fb9c415d690 2023-10-14T11:12:18.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9bb7fe640 1 -- 172.21.15.26:0/1633960500 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc0b9b20 con 0x7fb9c415d690 2023-10-14T11:12:18.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9c9017640 1 -- 172.21.15.26:0/1633960500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9bc009a70 con 0x7fb9c415d690 2023-10-14T11:12:18.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9c9017640 1 -- 172.21.15.26:0/1633960500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c40c3040 con 0x7fb9c415d690 2023-10-14T11:12:18.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9c9017640 1 -- 172.21.15.26:0/1633960500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c40c3840 con 0x7fb9c415d690 2023-10-14T11:12:18.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.932+0000 7fb9bb7fe640 1 -- 172.21.15.26:0/1633960500 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb9bc0b9c80 con 0x7fb9c415d690 2023-10-14T11:12:18.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.936+0000 7fb9bb7fe640 1 --2- 172.21.15.26:0/1633960500 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb9a40664a0 0x7fb9a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:18.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.936+0000 7fb9bb7fe640 1 -- 172.21.15.26:0/1633960500 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb9bc11ec00 con 0x7fb9c415d690 2023-10-14T11:12:18.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.936+0000 7fb9c2d9d640 1 --2- 172.21.15.26:0/1633960500 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb9a40664a0 0x7fb9a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:18.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.936+0000 7fb9c2d9d640 1 --2- 172.21.15.26:0/1633960500 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb9a40664a0 0x7fb9a4068960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4007fd0 tx=0x7fb9b4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:18.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:18.940+0000 7fb9bb7fe640 1 -- 172.21.15.26:0/1633960500 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb9c40c3840 con 0x7fb9c415d690 2023-10-14T11:12:19.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.096+0000 7fb9c9017640 1 -- 172.21.15.26:0/1633960500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9c40c3840 con 0x7fb9c415d690 2023-10-14T11:12:19.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.100+0000 7fb9bb7fe640 1 -- 172.21.15.26:0/1633960500 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12850 (secure 0 0 0) 0x7fb9c40c3840 con 0x7fb9c415d690 2023-10-14T11:12:19.101 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:19.101 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":17,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:12:12.866723+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:12:19.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.100+0000 7fb9c9017640 1 -- 172.21.15.26:0/1633960500 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb9a40664a0 msgr2=0x7fb9a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:19.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.100+0000 7fb9c9017640 1 --2- 172.21.15.26:0/1633960500 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb9a40664a0 0x7fb9a4068960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4007fd0 tx=0x7fb9b4009040 comp rx=0 tx=0).stop 2023-10-14T11:12:19.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.100+0000 7fb9c9017640 1 -- 172.21.15.26:0/1633960500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9c415d690 msgr2=0x7fb9c4148e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:19.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.100+0000 7fb9c9017640 1 --2- 172.21.15.26:0/1633960500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9c415d690 0x7fb9c4148e40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc01aee0 tx=0x7fb9bc0195d0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.100+0000 7fb9c9017640 1 -- 172.21.15.26:0/1633960500 shutdown_connections 2023-10-14T11:12:19.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.100+0000 7fb9c9017640 1 --2- 172.21.15.26:0/1633960500 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb9a40664a0 0x7fb9a4068960 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.100+0000 7fb9c9017640 1 --2- 172.21.15.26:0/1633960500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9c415d690 0x7fb9c4148e40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.100+0000 7fb9c9017640 1 --2- 172.21.15.26:0/1633960500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9c40b07f0 0x7fb9c4148900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.100+0000 7fb9c9017640 1 --2- 172.21.15.26:0/1633960500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9c4070c40 0x7fb9c40b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.100+0000 7fb9c9017640 1 -- 172.21.15.26:0/1633960500 >> 172.21.15.26:0/1633960500 conn(0x7fb9c406c190 msgr2=0x7fb9c40afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:19.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.100+0000 7fb9c9017640 1 -- 172.21.15.26:0/1633960500 shutdown_connections 2023-10-14T11:12:19.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.100+0000 7fb9c9017640 1 -- 172.21.15.26:0/1633960500 wait complete. 2023-10-14T11:12:19.123 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:12:19.123 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:12:19.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.268+0000 7f4c96a17640 1 Processor -- start 2023-10-14T11:12:19.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.268+0000 7f4c96a17640 1 -- start start 2023-10-14T11:12:19.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.268+0000 7f4c96a17640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4c900d0210 0x7f4c900d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:19.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.268+0000 7f4c96a17640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c900d1670 con 0x7f4c9015cba0 2023-10-14T11:12:19.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.268+0000 7f4c96a17640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c900d1950 con 0x7f4c900b84e0 2023-10-14T11:12:19.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.268+0000 7f4c96a17640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c900d1460 con 0x7f4c900d0210 2023-10-14T11:12:19.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.268+0000 7f4c8f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4c900d0210 0x7f4c900d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:19.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.268+0000 7f4c8ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4c9015cba0 0x7f4c900cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55408/0 (socket says 172.21.15.26:55408) 2023-10-14T11:12:19.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.268+0000 7f4c8ffff640 1 -- 172.21.15.26:0/379929861 learned_addr learned my addr 172.21.15.26:0/379929861 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:19.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.268+0000 7f4c8effd640 1 -- 172.21.15.26:0/379929861 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2519805650 0 0) 0x7f4c900d1670 con 0x7f4c9015cba0 2023-10-14T11:12:19.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.268+0000 7f4c8effd640 1 -- 172.21.15.26:0/379929861 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c78003530 con 0x7f4c9015cba0 2023-10-14T11:12:19.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.268+0000 7f4c8f7fe640 1 -- 172.21.15.26:0/379929861 >> v1:172.21.15.110:6789/0 conn(0x7f4c900b84e0 legacy=0x7f4c900b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:19.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.268+0000 7f4c8f7fe640 1 -- 172.21.15.26:0/379929861 >> v1:172.21.15.26:6789/0 conn(0x7f4c9015cba0 legacy=0x7f4c900cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:19.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.268+0000 7f4c8f7fe640 1 -- 172.21.15.26:0/379929861 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c900d1c30 con 0x7f4c900d0210 2023-10-14T11:12:19.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.272+0000 7f4c8f7fe640 1 --2- 172.21.15.26:0/379929861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c900d0210 0x7f4c900d0f20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4c840097c0 tx=0x7f4c8401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c64527c8b48630 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:19.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.272+0000 7f4c8effd640 1 -- 172.21.15.26:0/379929861 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c840ab5f0 con 0x7f4c900d0210 2023-10-14T11:12:19.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.272+0000 7f4c8effd640 1 -- 172.21.15.26:0/379929861 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c840ab750 con 0x7f4c900d0210 2023-10-14T11:12:19.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.272+0000 7f4c8effd640 1 -- 172.21.15.26:0/379929861 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c840abac0 con 0x7f4c900d0210 2023-10-14T11:12:19.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.272+0000 7f4c96a17640 1 -- 172.21.15.26:0/379929861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c900d0210 msgr2=0x7f4c900d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:19.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.272+0000 7f4c96a17640 1 --2- 172.21.15.26:0/379929861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c900d0210 0x7f4c900d0f20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4c840097c0 tx=0x7f4c8401c3f0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.272+0000 7f4c96a17640 1 -- 172.21.15.26:0/379929861 shutdown_connections 2023-10-14T11:12:19.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.272+0000 7f4c96a17640 1 --2- 172.21.15.26:0/379929861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c900d0210 0x7f4c900d0f20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.272+0000 7f4c96a17640 1 -- 172.21.15.26:0/379929861 >> 172.21.15.26:0/379929861 conn(0x7f4c900719c0 msgr2=0x7f4c90071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:19.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.272+0000 7f4c96a17640 1 -- 172.21.15.26:0/379929861 shutdown_connections 2023-10-14T11:12:19.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.272+0000 7f4c96a17640 1 -- 172.21.15.26:0/379929861 wait complete. 2023-10-14T11:12:19.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c96a17640 1 Processor -- start 2023-10-14T11:12:19.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c96a17640 1 -- start start 2023-10-14T11:12:19.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c96a17640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c900b84e0 0x7f4c9014c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:19.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c96a17640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c900d0210 0x7f4c9015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:19.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c96a17640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c9015cba0 0x7f4c9015f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:19.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c96a17640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900c7dd0 con 0x7f4c900d0210 2023-10-14T11:12:19.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c96a17640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900c71c0 con 0x7f4c900b84e0 2023-10-14T11:12:19.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c96a17640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900c74a0 con 0x7f4c9015cba0 2023-10-14T11:12:19.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c8f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c900d0210 0x7f4c9015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:19.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c8f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c900d0210 0x7f4c9015f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60002/0 (socket says 172.21.15.26:60002) 2023-10-14T11:12:19.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c8f7fe640 1 -- 172.21.15.26:0/498154552 learned_addr learned my addr 172.21.15.26:0/498154552 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:19.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c8ffff640 1 --2- 172.21.15.26:0/498154552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c900b84e0 0x7f4c9014c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:19.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c94fb4640 1 --2- 172.21.15.26:0/498154552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c9015cba0 0x7f4c9015f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:19.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c8f7fe640 1 -- 172.21.15.26:0/498154552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c9015cba0 msgr2=0x7f4c9015f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:19.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c8f7fe640 1 --2- 172.21.15.26:0/498154552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c9015cba0 0x7f4c9015f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c8f7fe640 1 -- 172.21.15.26:0/498154552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c900b84e0 msgr2=0x7f4c9014c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:19.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c8f7fe640 1 --2- 172.21.15.26:0/498154552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c900b84e0 0x7f4c9014c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c8f7fe640 1 -- 172.21.15.26:0/498154552 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c84009420 con 0x7f4c900d0210 2023-10-14T11:12:19.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c8f7fe640 1 --2- 172.21.15.26:0/498154552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c900d0210 0x7f4c9015f1f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4c840097c0 tx=0x7f4c8401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:19.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c8cff9640 1 -- 172.21.15.26:0/498154552 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c84004220 con 0x7f4c900d0210 2023-10-14T11:12:19.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c8cff9640 1 -- 172.21.15.26:0/498154552 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c840b9070 con 0x7f4c900d0210 2023-10-14T11:12:19.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c8cff9640 1 -- 172.21.15.26:0/498154552 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c84003620 con 0x7f4c900d0210 2023-10-14T11:12:19.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c96a17640 1 -- 172.21.15.26:0/498154552 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c900c7780 con 0x7f4c900d0210 2023-10-14T11:12:19.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c96a17640 1 -- 172.21.15.26:0/498154552 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c900c8260 con 0x7f4c900d0210 2023-10-14T11:12:19.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.276+0000 7f4c96a17640 1 -- 172.21.15.26:0/498154552 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c900c75e0 con 0x7f4c900d0210 2023-10-14T11:12:19.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.280+0000 7f4c8cff9640 1 -- 172.21.15.26:0/498154552 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4c84003780 con 0x7f4c900d0210 2023-10-14T11:12:19.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.280+0000 7f4c8cff9640 1 --2- 172.21.15.26:0/498154552 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4c7c0664a0 0x7f4c7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:19.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.280+0000 7f4c8cff9640 1 -- 172.21.15.26:0/498154552 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4c840bb070 con 0x7f4c900d0210 2023-10-14T11:12:19.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.280+0000 7f4c8ffff640 1 --2- 172.21.15.26:0/498154552 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4c7c0664a0 0x7f4c7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:19.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.280+0000 7f4c8ffff640 1 --2- 172.21.15.26:0/498154552 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4c7c0664a0 0x7f4c7c068960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4c800011f0 tx=0x7f4c80007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:19.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.284+0000 7f4c8cff9640 1 -- 172.21.15.26:0/498154552 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4c8414f090 con 0x7f4c900d0210 2023-10-14T11:12:19.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.440+0000 7f4c96a17640 1 -- 172.21.15.26:0/498154552 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4c9004e170 con 0x7f4c900d0210 2023-10-14T11:12:19.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.440+0000 7f4c8cff9640 1 -- 172.21.15.26:0/498154552 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4c840c4020 con 0x7f4c900d0210 2023-10-14T11:12:19.444 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:12:19.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.444+0000 7f4c96a17640 1 -- 172.21.15.26:0/498154552 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4c7c0664a0 msgr2=0x7f4c7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.444+0000 7f4c96a17640 1 --2- 172.21.15.26:0/498154552 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4c7c0664a0 0x7f4c7c068960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4c800011f0 tx=0x7f4c80007d40 comp rx=0 tx=0).stop 2023-10-14T11:12:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.444+0000 7f4c96a17640 1 -- 172.21.15.26:0/498154552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c900d0210 msgr2=0x7f4c9015f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.444+0000 7f4c96a17640 1 --2- 172.21.15.26:0/498154552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c900d0210 0x7f4c9015f1f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4c840097c0 tx=0x7f4c8401ac30 comp rx=0 tx=0).stop 2023-10-14T11:12:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.444+0000 7f4c96a17640 1 -- 172.21.15.26:0/498154552 shutdown_connections 2023-10-14T11:12:19.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.444+0000 7f4c96a17640 1 --2- 172.21.15.26:0/498154552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c9015cba0 0x7f4c9015f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.444+0000 7f4c96a17640 1 --2- 172.21.15.26:0/498154552 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4c7c0664a0 0x7f4c7c068960 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.444+0000 7f4c96a17640 1 --2- 172.21.15.26:0/498154552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c900d0210 0x7f4c9015f1f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.444+0000 7f4c96a17640 1 --2- 172.21.15.26:0/498154552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c900b84e0 0x7f4c9014c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.444+0000 7f4c96a17640 1 -- 172.21.15.26:0/498154552 >> 172.21.15.26:0/498154552 conn(0x7f4c900719c0 msgr2=0x7f4c900cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.444+0000 7f4c96a17640 1 -- 172.21.15.26:0/498154552 shutdown_connections 2023-10-14T11:12:19.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.444+0000 7f4c96a17640 1 -- 172.21.15.26:0/498154552 wait complete. 2023-10-14T11:12:19.465 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T11:12:19.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.604+0000 7fc356e6b640 1 Processor -- start 2023-10-14T11:12:19.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.604+0000 7fc356e6b640 1 -- start start 2023-10-14T11:12:19.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.608+0000 7fc356e6b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc35015ca70 0x7fc3500d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:19.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.608+0000 7fc356e6b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc3500cf7a0 0x7fc3500c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:19.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.608+0000 7fc356e6b640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3500c65f0 con 0x7fc3500d3550 2023-10-14T11:12:19.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.608+0000 7fc356e6b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3500ce820 con 0x7fc35015ca70 2023-10-14T11:12:19.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.608+0000 7fc356e6b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3500cdf80 con 0x7fc3500cf7a0 2023-10-14T11:12:19.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.608+0000 7fc354c07640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc35015ca70 0x7fc3500d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:19.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.608+0000 7fc34ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc3500d3550 0x7fc3500cf090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55416/0 (socket says 172.21.15.26:55416) 2023-10-14T11:12:19.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.608+0000 7fc354c07640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc35015ca70 0x7fc3500d3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60016/0 (socket says 172.21.15.26:60016) 2023-10-14T11:12:19.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.608+0000 7fc34ffff640 1 -- 172.21.15.26:0/2805785489 learned_addr learned my addr 172.21.15.26:0/2805785489 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:19.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.608+0000 7fc355408640 1 --2- 172.21.15.26:0/2805785489 >> v2:172.21.15.110:3300/0 conn(0x7fc3500cf7a0 0x7fc3500c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:19.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.608+0000 7fc354c07640 1 -- 172.21.15.26:0/2805785489 >> v2:172.21.15.110:3300/0 conn(0x7fc3500cf7a0 msgr2=0x7fc3500c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:19.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.608+0000 7fc354c07640 1 --2- 172.21.15.26:0/2805785489 >> v2:172.21.15.110:3300/0 conn(0x7fc3500cf7a0 0x7fc3500c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.608+0000 7fc354c07640 1 -- 172.21.15.26:0/2805785489 >> v1:172.21.15.26:6789/0 conn(0x7fc3500d3550 legacy=0x7fc3500cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:19.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.608+0000 7fc354c07640 1 -- 172.21.15.26:0/2805785489 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3500ce260 con 0x7fc35015ca70 2023-10-14T11:12:19.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.608+0000 7fc34f7fe640 1 -- 172.21.15.26:0/2805785489 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1413690266 0 0) 0x7fc3500c65f0 con 0x7fc3500d3550 2023-10-14T11:12:19.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.612+0000 7fc354c07640 1 --2- 172.21.15.26:0/2805785489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc35015ca70 0x7fc3500d3010 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc3500b8950 tx=0x7fc34401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfdb531df1153a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:19.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.612+0000 7fc34f7fe640 1 -- 172.21.15.26:0/2805785489 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3440ab600 con 0x7fc35015ca70 2023-10-14T11:12:19.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.612+0000 7fc34f7fe640 1 -- 172.21.15.26:0/2805785489 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3440a7050 con 0x7fc35015ca70 2023-10-14T11:12:19.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.612+0000 7fc34f7fe640 1 -- 172.21.15.26:0/2805785489 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3440ab980 con 0x7fc35015ca70 2023-10-14T11:12:19.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.612+0000 7fc356e6b640 1 -- 172.21.15.26:0/2805785489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc35015ca70 msgr2=0x7fc3500d3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:19.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.612+0000 7fc356e6b640 1 --2- 172.21.15.26:0/2805785489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc35015ca70 0x7fc3500d3010 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc3500b8950 tx=0x7fc34401c410 comp rx=0 tx=0).stop 2023-10-14T11:12:19.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.612+0000 7fc356e6b640 1 -- 172.21.15.26:0/2805785489 shutdown_connections 2023-10-14T11:12:19.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.612+0000 7fc356e6b640 1 --2- 172.21.15.26:0/2805785489 >> v2:172.21.15.110:3300/0 conn(0x7fc3500cf7a0 0x7fc3500c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.612+0000 7fc356e6b640 1 --2- 172.21.15.26:0/2805785489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc35015ca70 0x7fc3500d3010 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.612+0000 7fc356e6b640 1 -- 172.21.15.26:0/2805785489 >> 172.21.15.26:0/2805785489 conn(0x7fc35009bc50 msgr2=0x7fc3500d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:19.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.612+0000 7fc356e6b640 1 -- 172.21.15.26:0/2805785489 shutdown_connections 2023-10-14T11:12:19.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.612+0000 7fc356e6b640 1 -- 172.21.15.26:0/2805785489 wait complete. 2023-10-14T11:12:19.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.612+0000 7fc356e6b640 1 Processor -- start 2023-10-14T11:12:19.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.612+0000 7fc356e6b640 1 -- start start 2023-10-14T11:12:19.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.612+0000 7fc356e6b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3500cf7a0 0x7fc350159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:19.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.612+0000 7fc356e6b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3500d3550 0x7fc35006c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:19.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc356e6b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc35015ca70 0x7fc3500b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:19.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc356e6b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3500cb100 con 0x7fc3500cf7a0 2023-10-14T11:12:19.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc356e6b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35015a170 con 0x7fc35015ca70 2023-10-14T11:12:19.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc356e6b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35015a450 con 0x7fc3500d3550 2023-10-14T11:12:19.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc354c07640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3500cf7a0 0x7fc350159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:19.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc354c07640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3500cf7a0 0x7fc350159870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60022/0 (socket says 172.21.15.26:60022) 2023-10-14T11:12:19.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc354c07640 1 -- 172.21.15.26:0/2182512654 learned_addr learned my addr 172.21.15.26:0/2182512654 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:19.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc355408640 1 --2- 172.21.15.26:0/2182512654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc35015ca70 0x7fc3500b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:19.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc34ffff640 1 --2- 172.21.15.26:0/2182512654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3500d3550 0x7fc35006c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:19.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc354c07640 1 -- 172.21.15.26:0/2182512654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3500d3550 msgr2=0x7fc35006c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:19.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc354c07640 1 --2- 172.21.15.26:0/2182512654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3500d3550 0x7fc35006c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc354c07640 1 -- 172.21.15.26:0/2182512654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc35015ca70 msgr2=0x7fc3500b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:19.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc354c07640 1 --2- 172.21.15.26:0/2182512654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc35015ca70 0x7fc3500b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc354c07640 1 -- 172.21.15.26:0/2182512654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3440093b0 con 0x7fc3500cf7a0 2023-10-14T11:12:19.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc354c07640 1 --2- 172.21.15.26:0/2182512654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3500cf7a0 0x7fc350159870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc344019020 tx=0x7fc3440191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:19.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc34d7fa640 1 -- 172.21.15.26:0/2182512654 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3440b4840 con 0x7fc3500cf7a0 2023-10-14T11:12:19.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc34d7fa640 1 -- 172.21.15.26:0/2182512654 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3440b49a0 con 0x7fc3500cf7a0 2023-10-14T11:12:19.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc34d7fa640 1 -- 172.21.15.26:0/2182512654 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3440b4d30 con 0x7fc3500cf7a0 2023-10-14T11:12:19.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc356e6b640 1 -- 172.21.15.26:0/2182512654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35015a730 con 0x7fc3500cf7a0 2023-10-14T11:12:19.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc356e6b640 1 -- 172.21.15.26:0/2182512654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc350159db0 con 0x7fc3500cf7a0 2023-10-14T11:12:19.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc356e6b640 1 -- 172.21.15.26:0/2182512654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc350159f40 con 0x7fc3500cf7a0 2023-10-14T11:12:19.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc34d7fa640 1 -- 172.21.15.26:0/2182512654 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc3440b2040 con 0x7fc3500cf7a0 2023-10-14T11:12:19.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.616+0000 7fc34d7fa640 1 --2- 172.21.15.26:0/2182512654 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc3340664a0 0x7fc334068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:19.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.620+0000 7fc34d7fa640 1 -- 172.21.15.26:0/2182512654 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc34411dd50 con 0x7fc3500cf7a0 2023-10-14T11:12:19.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.620+0000 7fc34ffff640 1 --2- 172.21.15.26:0/2182512654 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc3340664a0 0x7fc334068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:19.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.620+0000 7fc34ffff640 1 --2- 172.21.15.26:0/2182512654 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc3340664a0 0x7fc334068960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc33c007fd0 tx=0x7fc33c007d60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:19.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.620+0000 7fc34d7fa640 1 -- 172.21.15.26:0/2182512654 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc3440eb5c0 con 0x7fc3500cf7a0 2023-10-14T11:12:19.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.780+0000 7fc356e6b640 1 -- 172.21.15.26:0/2182512654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc3500c5f90 con 0x7fc3500cf7a0 2023-10-14T11:12:19.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.780+0000 7fc34d7fa640 1 -- 172.21.15.26:0/2182512654 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc3440b0090 con 0x7fc3500cf7a0 2023-10-14T11:12:19.785 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:19.786 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-14T11:12:19.786 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:12:19.786 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-10-14T11:12:19.786 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-10-14T11:12:19.786 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:12:19.787 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-14T11:12:19.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.784+0000 7fc356e6b640 1 -- 172.21.15.26:0/2182512654 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc3340664a0 msgr2=0x7fc334068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:19.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.784+0000 7fc356e6b640 1 --2- 172.21.15.26:0/2182512654 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc3340664a0 0x7fc334068960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc33c007fd0 tx=0x7fc33c007d60 comp rx=0 tx=0).stop 2023-10-14T11:12:19.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.784+0000 7fc356e6b640 1 -- 172.21.15.26:0/2182512654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3500cf7a0 msgr2=0x7fc350159870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:19.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.784+0000 7fc356e6b640 1 --2- 172.21.15.26:0/2182512654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3500cf7a0 0x7fc350159870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc344019020 tx=0x7fc3440191b0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.784+0000 7fc356e6b640 1 -- 172.21.15.26:0/2182512654 shutdown_connections 2023-10-14T11:12:19.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.784+0000 7fc356e6b640 1 --2- 172.21.15.26:0/2182512654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc35015ca70 0x7fc3500b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.784+0000 7fc356e6b640 1 --2- 172.21.15.26:0/2182512654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3500d3550 0x7fc35006c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.784+0000 7fc356e6b640 1 --2- 172.21.15.26:0/2182512654 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc3340664a0 0x7fc334068960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.784+0000 7fc356e6b640 1 --2- 172.21.15.26:0/2182512654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3500cf7a0 0x7fc350159870 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.784+0000 7fc356e6b640 1 -- 172.21.15.26:0/2182512654 >> 172.21.15.26:0/2182512654 conn(0x7fc35009bc50 msgr2=0x7fc3500c8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:19.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.784+0000 7fc356e6b640 1 -- 172.21.15.26:0/2182512654 shutdown_connections 2023-10-14T11:12:19.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.784+0000 7fc356e6b640 1 -- 172.21.15.26:0/2182512654 wait complete. 2023-10-14T11:12:19.806 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T11:12:19.806 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T11:12:19.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.952+0000 7f346289a640 1 Processor -- start 2023-10-14T11:12:19.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.952+0000 7f346289a640 1 -- start start 2023-10-14T11:12:19.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.956+0000 7f346289a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f345c1600e0 0x7f345c0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:19.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.956+0000 7f346289a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f345c0cd9c0 0x7f345c0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:19.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.956+0000 7f346289a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f345c0caf20 con 0x7f345c0cfd50 2023-10-14T11:12:19.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.956+0000 7f346289a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f345c0b3720 con 0x7f345c0cd9c0 2023-10-14T11:12:19.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.956+0000 7f346289a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f345c0d02a0 con 0x7f345c1600e0 2023-10-14T11:12:19.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.956+0000 7f3460e37640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f345c0cd9c0 0x7f345c0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:19.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.956+0000 7f3460e37640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f345c0cd9c0 0x7f345c0cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60036/0 (socket says 172.21.15.26:60036) 2023-10-14T11:12:19.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.956+0000 7f3460e37640 1 -- 172.21.15.26:0/4010688722 learned_addr learned my addr 172.21.15.26:0/4010688722 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:19.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.956+0000 7f345bfff640 1 --2- 172.21.15.26:0/4010688722 >> v2:172.21.15.110:3300/0 conn(0x7f345c1600e0 0x7f345c0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:19.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.956+0000 7f3460e37640 1 -- 172.21.15.26:0/4010688722 >> v2:172.21.15.110:3300/0 conn(0x7f345c1600e0 msgr2=0x7f345c0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:19.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.956+0000 7f3460e37640 1 --2- 172.21.15.26:0/4010688722 >> v2:172.21.15.110:3300/0 conn(0x7f345c1600e0 0x7f345c0cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.956+0000 7f3460e37640 1 -- 172.21.15.26:0/4010688722 >> v1:172.21.15.110:6789/0 conn(0x7f345c0cfd50 legacy=0x7f345c0cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:19.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.956+0000 7f3460e37640 1 -- 172.21.15.26:0/4010688722 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345c0cb170 con 0x7f345c0cd9c0 2023-10-14T11:12:19.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.960+0000 7f3460e37640 1 --2- 172.21.15.26:0/4010688722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f345c0cd9c0 0x7f345c0cbc50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f345c071b80 tx=0x7f345401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73ba67f1d747a90 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:19.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.960+0000 7f345affd640 1 -- 172.21.15.26:0/4010688722 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34540a5790 con 0x7f345c0cd9c0 2023-10-14T11:12:19.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.960+0000 7f345affd640 1 -- 172.21.15.26:0/4010688722 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34540a58f0 con 0x7f345c0cd9c0 2023-10-14T11:12:19.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.960+0000 7f345affd640 1 -- 172.21.15.26:0/4010688722 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34540a5c80 con 0x7f345c0cd9c0 2023-10-14T11:12:19.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.960+0000 7f346289a640 1 -- 172.21.15.26:0/4010688722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f345c0cd9c0 msgr2=0x7f345c0cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:19.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.960+0000 7f346289a640 1 --2- 172.21.15.26:0/4010688722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f345c0cd9c0 0x7f345c0cbc50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f345c071b80 tx=0x7f345401c8d0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.960+0000 7f346289a640 1 -- 172.21.15.26:0/4010688722 shutdown_connections 2023-10-14T11:12:19.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.960+0000 7f346289a640 1 --2- 172.21.15.26:0/4010688722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f345c0cd9c0 0x7f345c0cbc50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.960+0000 7f346289a640 1 --2- 172.21.15.26:0/4010688722 >> v2:172.21.15.110:3300/0 conn(0x7f345c1600e0 0x7f345c0cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.960+0000 7f346289a640 1 -- 172.21.15.26:0/4010688722 >> 172.21.15.26:0/4010688722 conn(0x7f345c0d08d0 msgr2=0x7f345c0d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:19.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.960+0000 7f346289a640 1 -- 172.21.15.26:0/4010688722 shutdown_connections 2023-10-14T11:12:19.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.960+0000 7f346289a640 1 -- 172.21.15.26:0/4010688722 wait complete. 2023-10-14T11:12:19.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.960+0000 7f346289a640 1 Processor -- start 2023-10-14T11:12:19.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.960+0000 7f346289a640 1 -- start start 2023-10-14T11:12:19.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.960+0000 7f346289a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f345c0cd9c0 0x7f345c14fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:19.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.960+0000 7f346289a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f345c0cfd50 0x7f345c0b3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:19.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.960+0000 7f346289a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f345c1600e0 0x7f345c0c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:19.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f346289a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c0c5db0 con 0x7f345c0cfd50 2023-10-14T11:12:19.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f346289a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c0c4b40 con 0x7f345c0cd9c0 2023-10-14T11:12:19.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f346289a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345c157210 con 0x7f345c1600e0 2023-10-14T11:12:19.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f345b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f345c0cfd50 0x7f345c0b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:19.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f345bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f345c0cd9c0 0x7f345c14fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:19.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f345bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f345c0cd9c0 0x7f345c14fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:34694/0 (socket says 172.21.15.26:34694) 2023-10-14T11:12:19.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f345bfff640 1 -- 172.21.15.26:0/1501386359 learned_addr learned my addr 172.21.15.26:0/1501386359 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:19.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f345b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f345c0cfd50 0x7f345c0b3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60040/0 (socket says 172.21.15.26:60040) 2023-10-14T11:12:19.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f3460e37640 1 --2- 172.21.15.26:0/1501386359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f345c1600e0 0x7f345c0c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:19.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f345b7fe640 1 -- 172.21.15.26:0/1501386359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f345c1600e0 msgr2=0x7f345c0c4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:19.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f345b7fe640 1 --2- 172.21.15.26:0/1501386359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f345c1600e0 0x7f345c0c4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f345b7fe640 1 -- 172.21.15.26:0/1501386359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f345c0cd9c0 msgr2=0x7f345c14fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:19.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f345b7fe640 1 --2- 172.21.15.26:0/1501386359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f345c0cd9c0 0x7f345c14fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:19.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f345b7fe640 1 -- 172.21.15.26:0/1501386359 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3454009b30 con 0x7f345c0cfd50 2023-10-14T11:12:19.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f345bfff640 1 --2- 172.21.15.26:0/1501386359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f345c0cd9c0 0x7f345c14fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:12:19.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f345b7fe640 1 --2- 172.21.15.26:0/1501386359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f345c0cfd50 0x7f345c0b3890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f345000c3e0 tx=0x7f345000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:19.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f3458ff9640 1 -- 172.21.15.26:0/1501386359 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3450011790 con 0x7f345c0cfd50 2023-10-14T11:12:19.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f3458ff9640 1 -- 172.21.15.26:0/1501386359 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34500118f0 con 0x7f345c0cfd50 2023-10-14T11:12:19.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f346289a640 1 -- 172.21.15.26:0/1501386359 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345c0b5180 con 0x7f345c0cfd50 2023-10-14T11:12:19.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f3458ff9640 1 -- 172.21.15.26:0/1501386359 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3450011ce0 con 0x7f345c0cfd50 2023-10-14T11:12:19.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f346289a640 1 -- 172.21.15.26:0/1501386359 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345c0c4580 con 0x7f345c0cfd50 2023-10-14T11:12:19.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f346289a640 1 -- 172.21.15.26:0/1501386359 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f345c0c43c0 con 0x7f345c0cfd50 2023-10-14T11:12:19.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.964+0000 7f3458ff9640 1 -- 172.21.15.26:0/1501386359 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f345001c460 con 0x7f345c0cfd50 2023-10-14T11:12:19.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.968+0000 7f3458ff9640 1 --2- 172.21.15.26:0/1501386359 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f34480664a0 0x7f3448068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:19.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.968+0000 7f3458ff9640 1 -- 172.21.15.26:0/1501386359 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f34500838e0 con 0x7f345c0cfd50 2023-10-14T11:12:19.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.968+0000 7f345bfff640 1 --2- 172.21.15.26:0/1501386359 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f34480664a0 0x7f3448068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:19.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.968+0000 7f345bfff640 1 --2- 172.21.15.26:0/1501386359 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f34480664a0 0x7f3448068960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f345c0c73e0 tx=0x7f344c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:19.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:19.968+0000 7f3458ff9640 1 -- 172.21.15.26:0/1501386359 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f34500510c0 con 0x7f345c0cfd50 2023-10-14T11:12:20.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:20.132+0000 7f346289a640 1 -- 172.21.15.26:0/1501386359 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f345c04e170 con 0x7f345c0cfd50 2023-10-14T11:12:20.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:20.936+0000 7f3458ff9640 1 -- 172.21.15.26:0/1501386359 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f34500546e0 con 0x7f345c0cfd50 2023-10-14T11:12:20.939 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-10-14T11:12:20.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:20.940+0000 7f346289a640 1 -- 172.21.15.26:0/1501386359 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f34480664a0 msgr2=0x7f3448068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:20.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:20.940+0000 7f346289a640 1 --2- 172.21.15.26:0/1501386359 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f34480664a0 0x7f3448068960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f345c0c73e0 tx=0x7f344c008040 comp rx=0 tx=0).stop 2023-10-14T11:12:20.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:20.940+0000 7f346289a640 1 -- 172.21.15.26:0/1501386359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f345c0cfd50 msgr2=0x7f345c0b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:20.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:20.940+0000 7f346289a640 1 --2- 172.21.15.26:0/1501386359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f345c0cfd50 0x7f345c0b3890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f345000c3e0 tx=0x7f345000c8a0 comp rx=0 tx=0).stop 2023-10-14T11:12:20.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:20.940+0000 7f346289a640 1 -- 172.21.15.26:0/1501386359 shutdown_connections 2023-10-14T11:12:20.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:20.940+0000 7f346289a640 1 --2- 172.21.15.26:0/1501386359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f345c1600e0 0x7f345c0c4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:20.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:20.940+0000 7f346289a640 1 --2- 172.21.15.26:0/1501386359 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f34480664a0 0x7f3448068960 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:20.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:20.940+0000 7f346289a640 1 --2- 172.21.15.26:0/1501386359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f345c0cfd50 0x7f345c0b3890 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:20.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:20.940+0000 7f346289a640 1 --2- 172.21.15.26:0/1501386359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f345c0cd9c0 0x7f345c14fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:20.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:20.940+0000 7f346289a640 1 -- 172.21.15.26:0/1501386359 >> 172.21.15.26:0/1501386359 conn(0x7f345c0d08d0 msgr2=0x7f345c15e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:20.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:20.940+0000 7f346289a640 1 -- 172.21.15.26:0/1501386359 shutdown_connections 2023-10-14T11:12:20.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:20.940+0000 7f346289a640 1 -- 172.21.15.26:0/1501386359 wait complete. 2023-10-14T11:12:20.973 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-14T11:12:21.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.124+0000 7ffaa1c32640 1 Processor -- start 2023-10-14T11:12:21.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.124+0000 7ffaa1c32640 1 -- start start 2023-10-14T11:12:21.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.124+0000 7ffaa1c32640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa9c0b89b0 0x7ffa9c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:21.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.124+0000 7ffaa1c32640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ffa9c0d0130 0x7ffa9c0d0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:21.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.124+0000 7ffaa1c32640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa9c161720 con 0x7ffa9c0b85d0 2023-10-14T11:12:21.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.124+0000 7ffaa1c32640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa9c0d05a0 con 0x7ffa9c0d0130 2023-10-14T11:12:21.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.124+0000 7ffaa1c32640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c160ba0 con 0x7ffa9c0b89b0 2023-10-14T11:12:21.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.124+0000 7ffa9b7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ffa9c0b85d0 0x7ffa9c15dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55420/0 (socket says 172.21.15.26:55420) 2023-10-14T11:12:21.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.124+0000 7ffa9b7fe640 1 -- 172.21.15.26:0/2886280080 learned_addr learned my addr 172.21.15.26:0/2886280080 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:21.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.124+0000 7ffa9bfff640 1 --2- 172.21.15.26:0/2886280080 >> v2:172.21.15.110:3300/0 conn(0x7ffa9c0d0130 0x7ffa9c0d0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:21.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.124+0000 7ffa9affd640 1 --2- 172.21.15.26:0/2886280080 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa9c0b89b0 0x7ffa9c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:21.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.124+0000 7ffa9a7fc640 1 -- 172.21.15.26:0/2886280080 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462324159 0 0) 0x7ffa9c161720 con 0x7ffa9c0b85d0 2023-10-14T11:12:21.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.124+0000 7ffa9a7fc640 1 -- 172.21.15.26:0/2886280080 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa84003530 con 0x7ffa9c0b85d0 2023-10-14T11:12:21.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.124+0000 7ffa9a7fc640 1 -- 172.21.15.26:0/2886280080 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2496648169 0 0) 0x7ffa84003530 con 0x7ffa9c0b85d0 2023-10-14T11:12:21.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.124+0000 7ffa9a7fc640 1 -- 172.21.15.26:0/2886280080 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa9c0b89b0 msgr2=0x7ffa9c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:21.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.124+0000 7ffa9a7fc640 1 --2- 172.21.15.26:0/2886280080 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa9c0b89b0 0x7ffa9c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:21.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.124+0000 7ffa9a7fc640 1 -- 172.21.15.26:0/2886280080 >> v2:172.21.15.110:3300/0 conn(0x7ffa9c0d0130 msgr2=0x7ffa9c0d0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:21.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.124+0000 7ffa9a7fc640 1 --2- 172.21.15.26:0/2886280080 >> v2:172.21.15.110:3300/0 conn(0x7ffa9c0d0130 0x7ffa9c0d0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:21.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.124+0000 7ffa9a7fc640 1 -- 172.21.15.26:0/2886280080 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c160e80 con 0x7ffa9c0b85d0 2023-10-14T11:12:21.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.124+0000 7ffa9a7fc640 1 -- 172.21.15.26:0/2886280080 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7ffa8c001680 con 0x7ffa9c0b85d0 2023-10-14T11:12:21.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.124+0000 7ffa9affd640 1 --2- 172.21.15.26:0/2886280080 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa9c0b89b0 0x7ffa9c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:12:21.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.124+0000 7ffa9a7fc640 1 -- 172.21.15.26:0/2886280080 >> v1:172.21.15.26:6789/0 conn(0x7ffa9c0b85d0 legacy=0x7ffa9c15dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:21.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.128+0000 7ffa9a7fc640 1 --2- 172.21.15.26:0/2886280080 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa9c0b89b0 0x7ffa84003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:21.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.128+0000 7ffa9a7fc640 1 --2- 172.21.15.26:0/2886280080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa84003ec0 0x7ffa840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:21.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.128+0000 7ffa9a7fc640 1 --2- 172.21.15.26:0/2886280080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa84004d10 0x7ffa84005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:21.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.128+0000 7ffa9a7fc640 1 -- 172.21.15.26:0/2886280080 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c0d05a0 con 0x7ffa84004d10 2023-10-14T11:12:21.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.128+0000 7ffa9a7fc640 1 -- 172.21.15.26:0/2886280080 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c160ba0 con 0x7ffa84003ec0 2023-10-14T11:12:21.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.128+0000 7ffa9a7fc640 1 -- 172.21.15.26:0/2886280080 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8400b990 con 0x7ffa9c0b89b0 2023-10-14T11:12:21.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.128+0000 7ffa9bfff640 1 --2- 172.21.15.26:0/2886280080 >> v2:172.21.15.110:3300/0 conn(0x7ffa9c0d0130 0x7ffa9c0d0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:12:21.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.128+0000 7ffa9b7fe640 1 --2- 172.21.15.26:0/2886280080 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa9c0b89b0 0x7ffa84003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:21.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.128+0000 7ffa9bfff640 1 --2- 172.21.15.26:0/2886280080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa84004d10 0x7ffa84005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:21.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.128+0000 7ffa9affd640 1 --2- 172.21.15.26:0/2886280080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa84003ec0 0x7ffa840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:21.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.128+0000 7ffa9b7fe640 1 -- 172.21.15.26:0/2886280080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa84003ec0 msgr2=0x7ffa840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:21.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.128+0000 7ffa9b7fe640 1 --2- 172.21.15.26:0/2886280080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa84003ec0 0x7ffa840047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:21.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.128+0000 7ffa9b7fe640 1 -- 172.21.15.26:0/2886280080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa84004d10 msgr2=0x7ffa84005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:21.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.128+0000 7ffa9b7fe640 1 --2- 172.21.15.26:0/2886280080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa84004d10 0x7ffa84005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:21.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.128+0000 7ffa9b7fe640 1 -- 172.21.15.26:0/2886280080 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa90009420 con 0x7ffa9c0b89b0 2023-10-14T11:12:21.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.128+0000 7ffa9b7fe640 1 --2- 172.21.15.26:0/2886280080 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa9c0b89b0 0x7ffa84003980 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00c240 tx=0x7ffa8c01cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb15c656b8cdadd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:21.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.132+0000 7ffa9a7fc640 1 -- 172.21.15.26:0/2886280080 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c0a5960 con 0x7ffa9c0b89b0 2023-10-14T11:12:21.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.132+0000 7ffa9a7fc640 1 -- 172.21.15.26:0/2886280080 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8c0a5ac0 con 0x7ffa9c0b89b0 2023-10-14T11:12:21.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.132+0000 7ffa9a7fc640 1 -- 172.21.15.26:0/2886280080 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c0058e0 con 0x7ffa9c0b89b0 2023-10-14T11:12:21.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.132+0000 7ffaa1c32640 1 -- 172.21.15.26:0/2886280080 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa9c0b89b0 msgr2=0x7ffa84003980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:21.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.132+0000 7ffaa1c32640 1 --2- 172.21.15.26:0/2886280080 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa9c0b89b0 0x7ffa84003980 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00c240 tx=0x7ffa8c01cc60 comp rx=0 tx=0).stop 2023-10-14T11:12:21.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.132+0000 7ffa9bfff640 1 -- 172.21.15.26:0/2886280080 reap_dead start 2023-10-14T11:12:21.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.132+0000 7ffaa1c32640 1 -- 172.21.15.26:0/2886280080 shutdown_connections 2023-10-14T11:12:21.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.132+0000 7ffaa1c32640 1 -- 172.21.15.26:0/2886280080 >> 172.21.15.26:0/2886280080 conn(0x7ffa9c06b750 msgr2=0x7ffa9c06bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:21.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.132+0000 7ffaa1c32640 1 -- 172.21.15.26:0/2886280080 shutdown_connections 2023-10-14T11:12:21.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.132+0000 7ffaa1c32640 1 -- 172.21.15.26:0/2886280080 wait complete. 2023-10-14T11:12:21.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.132+0000 7ffaa1c32640 1 Processor -- start 2023-10-14T11:12:21.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.132+0000 7ffaa1c32640 1 -- start start 2023-10-14T11:12:21.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.132+0000 7ffaa1c32640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa9c0b89b0 0x7ffa9c0b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:21.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.132+0000 7ffaa1c32640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa9c147510 0x7ffa9c146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:21.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.132+0000 7ffaa1c32640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa9c0cb550 0x7ffa9c0cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:21.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.132+0000 7ffaa1c32640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c0cbf10 con 0x7ffa9c0b89b0 2023-10-14T11:12:21.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.132+0000 7ffaa1c32640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c0c9020 con 0x7ffa9c0cb550 2023-10-14T11:12:21.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.132+0000 7ffaa1c32640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c147330 con 0x7ffa9c147510 2023-10-14T11:12:21.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.132+0000 7ffa9b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa9c0b89b0 0x7ffa9c0b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:21.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.132+0000 7ffa9b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa9c0b89b0 0x7ffa9c0b3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60060/0 (socket says 172.21.15.26:60060) 2023-10-14T11:12:21.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.136+0000 7ffa9b7fe640 1 -- 172.21.15.26:0/3230393140 learned_addr learned my addr 172.21.15.26:0/3230393140 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:21.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.136+0000 7ffa9affd640 1 --2- 172.21.15.26:0/3230393140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa9c147510 0x7ffa9c146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:21.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.136+0000 7ffa9bfff640 1 --2- 172.21.15.26:0/3230393140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa9c0cb550 0x7ffa9c0cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:21.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.136+0000 7ffa9b7fe640 1 -- 172.21.15.26:0/3230393140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa9c147510 msgr2=0x7ffa9c146df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:21.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.136+0000 7ffa9b7fe640 1 --2- 172.21.15.26:0/3230393140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa9c147510 0x7ffa9c146df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:21.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.136+0000 7ffa9b7fe640 1 -- 172.21.15.26:0/3230393140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa9c0cb550 msgr2=0x7ffa9c0cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:21.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.136+0000 7ffa9b7fe640 1 --2- 172.21.15.26:0/3230393140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa9c0cb550 0x7ffa9c0cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:21.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.136+0000 7ffa9b7fe640 1 -- 172.21.15.26:0/3230393140 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c0cd8e0 con 0x7ffa9c0b89b0 2023-10-14T11:12:21.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.136+0000 7ffa9b7fe640 1 --2- 172.21.15.26:0/3230393140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa9c0b89b0 0x7ffa9c0b3490 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c000f70 tx=0x7ffa84005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:21.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.136+0000 7ffa83fff640 1 -- 172.21.15.26:0/3230393140 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c0072d0 con 0x7ffa9c0b89b0 2023-10-14T11:12:21.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.136+0000 7ffa83fff640 1 -- 172.21.15.26:0/3230393140 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8c0b3070 con 0x7ffa9c0b89b0 2023-10-14T11:12:21.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.136+0000 7ffaa1c32640 1 -- 172.21.15.26:0/3230393140 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa9c0cdbc0 con 0x7ffa9c0b89b0 2023-10-14T11:12:21.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.136+0000 7ffa83fff640 1 -- 172.21.15.26:0/3230393140 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c007650 con 0x7ffa9c0b89b0 2023-10-14T11:12:21.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.136+0000 7ffaa1c32640 1 -- 172.21.15.26:0/3230393140 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9c0caac0 con 0x7ffa9c0b89b0 2023-10-14T11:12:21.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.136+0000 7ffaa1c32640 1 -- 172.21.15.26:0/3230393140 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa9c1563f0 con 0x7ffa9c0b89b0 2023-10-14T11:12:21.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.136+0000 7ffa83fff640 1 -- 172.21.15.26:0/3230393140 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffa8c0ae440 con 0x7ffa9c0b89b0 2023-10-14T11:12:21.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.140+0000 7ffa83fff640 1 --2- 172.21.15.26:0/3230393140 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ffa880664d0 0x7ffa88068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:21.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.140+0000 7ffa83fff640 1 -- 172.21.15.26:0/3230393140 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7ffa8c0b5070 con 0x7ffa9c0b89b0 2023-10-14T11:12:21.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.140+0000 7ffa9affd640 1 --2- 172.21.15.26:0/3230393140 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ffa880664d0 0x7ffa88068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:21.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.140+0000 7ffa9affd640 1 --2- 172.21.15.26:0/3230393140 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ffa880664d0 0x7ffa88068990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0d22d0 tx=0x7ffa90009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:21.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.140+0000 7ffa83fff640 1 -- 172.21.15.26:0/3230393140 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffa8c0ebf30 con 0x7ffa9c0b89b0 2023-10-14T11:12:21.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.296+0000 7ffaa1c32640 1 -- 172.21.15.26:0/3230393140 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7ffa9c161410 con 0x7ffa9c0b89b0 2023-10-14T11:12:21.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.944+0000 7ffa83fff640 1 -- 172.21.15.26:0/3230393140 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7ffa8c001c60 con 0x7ffa9c0b89b0 2023-10-14T11:12:21.947 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-10-14T11:12:21.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.944+0000 7ffaa1c32640 1 -- 172.21.15.26:0/3230393140 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ffa880664d0 msgr2=0x7ffa88068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:21.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.944+0000 7ffaa1c32640 1 --2- 172.21.15.26:0/3230393140 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ffa880664d0 0x7ffa88068990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0d22d0 tx=0x7ffa90009190 comp rx=0 tx=0).stop 2023-10-14T11:12:21.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.944+0000 7ffaa1c32640 1 -- 172.21.15.26:0/3230393140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa9c0b89b0 msgr2=0x7ffa9c0b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:21.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.944+0000 7ffaa1c32640 1 --2- 172.21.15.26:0/3230393140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa9c0b89b0 0x7ffa9c0b3490 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c000f70 tx=0x7ffa84005800 comp rx=0 tx=0).stop 2023-10-14T11:12:21.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.948+0000 7ffaa1c32640 1 -- 172.21.15.26:0/3230393140 shutdown_connections 2023-10-14T11:12:21.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.948+0000 7ffaa1c32640 1 --2- 172.21.15.26:0/3230393140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa9c0cb550 0x7ffa9c0cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:21.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.948+0000 7ffaa1c32640 1 --2- 172.21.15.26:0/3230393140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa9c147510 0x7ffa9c146df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:21.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.948+0000 7ffaa1c32640 1 --2- 172.21.15.26:0/3230393140 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ffa880664d0 0x7ffa88068990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:21.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.948+0000 7ffaa1c32640 1 --2- 172.21.15.26:0/3230393140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa9c0b89b0 0x7ffa9c0b3490 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:21.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.948+0000 7ffaa1c32640 1 -- 172.21.15.26:0/3230393140 >> 172.21.15.26:0/3230393140 conn(0x7ffa9c06b750 msgr2=0x7ffa9c0b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:21.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.948+0000 7ffaa1c32640 1 -- 172.21.15.26:0/3230393140 shutdown_connections 2023-10-14T11:12:21.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:21.948+0000 7ffaa1c32640 1 -- 172.21.15.26:0/3230393140 wait complete. 2023-10-14T11:12:21.997 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T11:12:22.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.140+0000 7f789cbc4640 1 Processor -- start 2023-10-14T11:12:22.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.140+0000 7f789cbc4640 1 -- start start 2023-10-14T11:12:22.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.144+0000 7f789cbc4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f78980b3f10 0x7f78980cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:22.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.144+0000 7f789cbc4640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78980ceb10 con 0x7f789815ac20 2023-10-14T11:12:22.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.144+0000 7f789cbc4640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f789815b000 con 0x7f78980cd2c0 2023-10-14T11:12:22.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.144+0000 7f789cbc4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78980cdcb0 con 0x7f78980b3f10 2023-10-14T11:12:22.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.144+0000 7f7896d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f78980b3f10 0x7f78980cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:22.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.144+0000 7f789659c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f789815ac20 0x7f78980cf890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55430/0 (socket says 172.21.15.26:55430) 2023-10-14T11:12:22.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.144+0000 7f789659c640 1 -- 172.21.15.26:0/3754290161 learned_addr learned my addr 172.21.15.26:0/3754290161 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:22.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.144+0000 7f7896d9d640 1 --2- 172.21.15.26:0/3754290161 >> v2:172.21.15.26:3300/0 conn(0x7f78980b3f10 0x7f78980cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60072/0 (socket says 172.21.15.26:60072) 2023-10-14T11:12:22.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.144+0000 7f7896d9d640 1 -- 172.21.15.26:0/3754290161 >> v1:172.21.15.110:6789/0 conn(0x7f78980cd2c0 legacy=0x7f78980b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:22.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.144+0000 7f7896d9d640 1 -- 172.21.15.26:0/3754290161 >> v1:172.21.15.26:6789/0 conn(0x7f789815ac20 legacy=0x7f78980cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:22.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.144+0000 7f7896d9d640 1 -- 172.21.15.26:0/3754290161 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78980cbd50 con 0x7f78980b3f10 2023-10-14T11:12:22.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.144+0000 7f7895d9b640 1 -- 172.21.15.26:0/3754290161 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566991917 0 0) 0x7f78980ceb10 con 0x7f789815ac20 2023-10-14T11:12:22.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.144+0000 7f7896d9d640 1 --2- 172.21.15.26:0/3754290161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78980b3f10 0x7f78980cd770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7890009d90 tx=0x7f789001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcaf63230a7103f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:22.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f7895d9b640 1 -- 172.21.15.26:0/3754290161 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78900a5900 con 0x7f78980b3f10 2023-10-14T11:12:22.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f7895d9b640 1 -- 172.21.15.26:0/3754290161 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78900a5a60 con 0x7f78980b3f10 2023-10-14T11:12:22.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f7895d9b640 1 -- 172.21.15.26:0/3754290161 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78900a5df0 con 0x7f78980b3f10 2023-10-14T11:12:22.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f789cbc4640 1 -- 172.21.15.26:0/3754290161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78980b3f10 msgr2=0x7f78980cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:22.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f789cbc4640 1 --2- 172.21.15.26:0/3754290161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78980b3f10 0x7f78980cd770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7890009d90 tx=0x7f789001c950 comp rx=0 tx=0).stop 2023-10-14T11:12:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f789cbc4640 1 -- 172.21.15.26:0/3754290161 shutdown_connections 2023-10-14T11:12:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f789cbc4640 1 --2- 172.21.15.26:0/3754290161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78980b3f10 0x7f78980cd770 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f789cbc4640 1 -- 172.21.15.26:0/3754290161 >> 172.21.15.26:0/3754290161 conn(0x7f789806e570 msgr2=0x7f789806e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f789cbc4640 1 -- 172.21.15.26:0/3754290161 shutdown_connections 2023-10-14T11:12:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f789cbc4640 1 -- 172.21.15.26:0/3754290161 wait complete. 2023-10-14T11:12:22.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f789cbc4640 1 Processor -- start 2023-10-14T11:12:22.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f789cbc4640 1 -- start start 2023-10-14T11:12:22.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f789cbc4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78980b3f10 0x7f789814dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:22.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f789cbc4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78980cd2c0 0x7f78980c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:22.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f789cbc4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f789815ac20 0x7f78980b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f789cbc4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78980c99f0 con 0x7f78980b3f10 2023-10-14T11:12:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f789cbc4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789814e2c0 con 0x7f78980cd2c0 2023-10-14T11:12:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f789cbc4640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78980c8b00 con 0x7f789815ac20 2023-10-14T11:12:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f789659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78980b3f10 0x7f789814dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:22.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f789659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78980b3f10 0x7f789814dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60076/0 (socket says 172.21.15.26:60076) 2023-10-14T11:12:22.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f789659c640 1 -- 172.21.15.26:0/1393253692 learned_addr learned my addr 172.21.15.26:0/1393253692 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:22.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f7896d9d640 1 --2- 172.21.15.26:0/1393253692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f789815ac20 0x7f78980b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:22.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.148+0000 7f788ffff640 1 --2- 172.21.15.26:0/1393253692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78980cd2c0 0x7f78980c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:22.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.152+0000 7f789659c640 1 -- 172.21.15.26:0/1393253692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f789815ac20 msgr2=0x7f78980b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:22.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.152+0000 7f789659c640 1 --2- 172.21.15.26:0/1393253692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f789815ac20 0x7f78980b0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:22.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.152+0000 7f789659c640 1 -- 172.21.15.26:0/1393253692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78980cd2c0 msgr2=0x7f78980c4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:22.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.152+0000 7f789659c640 1 --2- 172.21.15.26:0/1393253692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78980cd2c0 0x7f78980c4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:22.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.152+0000 7f789659c640 1 -- 172.21.15.26:0/1393253692 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7890009a70 con 0x7f78980b3f10 2023-10-14T11:12:22.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.152+0000 7f7896d9d640 1 --2- 172.21.15.26:0/1393253692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f789815ac20 0x7f78980b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:22.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.152+0000 7f789659c640 1 --2- 172.21.15.26:0/1393253692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78980b3f10 0x7f789814dd80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f788800c410 tx=0x7f788800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:22.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.152+0000 7f788effd640 1 -- 172.21.15.26:0/1393253692 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78880074e0 con 0x7f78980b3f10 2023-10-14T11:12:22.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.152+0000 7f788effd640 1 -- 172.21.15.26:0/1393253692 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7888007640 con 0x7f78980b3f10 2023-10-14T11:12:22.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.152+0000 7f788effd640 1 -- 172.21.15.26:0/1393253692 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7888004a30 con 0x7f78980b3f10 2023-10-14T11:12:22.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.152+0000 7f789cbc4640 1 -- 172.21.15.26:0/1393253692 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78980c8de0 con 0x7f78980b3f10 2023-10-14T11:12:22.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.152+0000 7f789cbc4640 1 -- 172.21.15.26:0/1393253692 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78980c93a0 con 0x7f78980b3f10 2023-10-14T11:12:22.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.152+0000 7f789cbc4640 1 -- 172.21.15.26:0/1393253692 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f789804e170 con 0x7f78980b3f10 2023-10-14T11:12:22.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.152+0000 7f788effd640 1 -- 172.21.15.26:0/1393253692 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7888004b90 con 0x7f78980b3f10 2023-10-14T11:12:22.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.152+0000 7f788effd640 1 --2- 172.21.15.26:0/1393253692 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f78780664a0 0x7f7878068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:22.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.156+0000 7f788effd640 1 -- 172.21.15.26:0/1393253692 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f7888083be0 con 0x7f78980b3f10 2023-10-14T11:12:22.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.156+0000 7f788ffff640 1 --2- 172.21.15.26:0/1393253692 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f78780664a0 0x7f7878068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:22.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.156+0000 7f788ffff640 1 --2- 172.21.15.26:0/1393253692 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f78780664a0 0x7f7878068960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f78981f5f80 tx=0x7f7880009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:22.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.160+0000 7f788effd640 1 -- 172.21.15.26:0/1393253692 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f78880510c0 con 0x7f78980b3f10 2023-10-14T11:12:22.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.352+0000 7f789cbc4640 1 -- 172.21.15.26:0/1393253692 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f78980cc8a0 con 0x7f78980b3f10 2023-10-14T11:12:22.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.956+0000 7f788effd640 1 -- 172.21.15.26:0/1393253692 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f78880546e0 con 0x7f78980b3f10 2023-10-14T11:12:22.965 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 2 and data pool 3 2023-10-14T11:12:22.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.976+0000 7f789cbc4640 1 -- 172.21.15.26:0/1393253692 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f78780664a0 msgr2=0x7f7878068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:22.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.976+0000 7f789cbc4640 1 --2- 172.21.15.26:0/1393253692 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f78780664a0 0x7f7878068960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f78981f5f80 tx=0x7f7880009040 comp rx=0 tx=0).stop 2023-10-14T11:12:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.976+0000 7f789cbc4640 1 -- 172.21.15.26:0/1393253692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78980b3f10 msgr2=0x7f789814dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.976+0000 7f789cbc4640 1 --2- 172.21.15.26:0/1393253692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78980b3f10 0x7f789814dd80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f788800c410 tx=0x7f788800c8d0 comp rx=0 tx=0).stop 2023-10-14T11:12:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.980+0000 7f789cbc4640 1 -- 172.21.15.26:0/1393253692 shutdown_connections 2023-10-14T11:12:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.980+0000 7f789cbc4640 1 --2- 172.21.15.26:0/1393253692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f789815ac20 0x7f78980b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.980+0000 7f789cbc4640 1 --2- 172.21.15.26:0/1393253692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78980cd2c0 0x7f78980c4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:22.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.980+0000 7f789cbc4640 1 --2- 172.21.15.26:0/1393253692 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f78780664a0 0x7f7878068960 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f78981f5f80 tx=0x7f7880009040 comp rx=0 tx=0).stop 2023-10-14T11:12:22.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.980+0000 7f789cbc4640 1 --2- 172.21.15.26:0/1393253692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78980b3f10 0x7f789814dd80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:22.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.980+0000 7f789cbc4640 1 -- 172.21.15.26:0/1393253692 >> 172.21.15.26:0/1393253692 conn(0x7f789806e570 msgr2=0x7f7898154ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:22.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.980+0000 7f789cbc4640 1 -- 172.21.15.26:0/1393253692 shutdown_connections 2023-10-14T11:12:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:22.980+0000 7f789cbc4640 1 -- 172.21.15.26:0/1393253692 wait complete. 2023-10-14T11:12:23.017 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-14T11:12:23.017 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-14T11:12:23.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.164+0000 7fe5f3701640 1 Processor -- start 2023-10-14T11:12:23.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.164+0000 7fe5f3701640 1 -- start start 2023-10-14T11:12:23.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.164+0000 7fe5f3701640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe5ec0cdc80 0x7fe5ec0cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:23.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.164+0000 7fe5f3701640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe5ec15dec0 0x7fe5ec0cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:23.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.164+0000 7fe5f3701640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ec0ce460 con 0x7fe5ec0d2570 2023-10-14T11:12:23.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.164+0000 7fe5f3701640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5ec0cd830 con 0x7fe5ec15dec0 2023-10-14T11:12:23.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.164+0000 7fe5f3701640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5ec15da30 con 0x7fe5ec0cdc80 2023-10-14T11:12:23.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.164+0000 7fe5f1c9e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe5ec15dec0 0x7fe5ec0cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:23.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.164+0000 7fe5f1c9e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe5ec15dec0 0x7fe5ec0cfb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52198/0 (socket says 172.21.15.26:52198) 2023-10-14T11:12:23.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.164+0000 7fe5f1c9e640 1 -- 172.21.15.26:0/1145029801 learned_addr learned my addr 172.21.15.26:0/1145029801 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:23.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.168+0000 7fe5f0c9c640 1 --2- 172.21.15.26:0/1145029801 >> v2:172.21.15.110:3300/0 conn(0x7fe5ec0cdc80 0x7fe5ec0cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:23.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.168+0000 7fe5f1c9e640 1 -- 172.21.15.26:0/1145029801 >> v2:172.21.15.110:3300/0 conn(0x7fe5ec0cdc80 msgr2=0x7fe5ec0cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:23.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.168+0000 7fe5f1c9e640 1 --2- 172.21.15.26:0/1145029801 >> v2:172.21.15.110:3300/0 conn(0x7fe5ec0cdc80 0x7fe5ec0cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:23.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.168+0000 7fe5f1c9e640 1 -- 172.21.15.26:0/1145029801 >> v1:172.21.15.110:6789/0 conn(0x7fe5ec0d2570 legacy=0x7fe5ec161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:23.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.168+0000 7fe5f1c9e640 1 -- 172.21.15.26:0/1145029801 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec0ce180 con 0x7fe5ec15dec0 2023-10-14T11:12:23.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.168+0000 7fe5f1c9e640 1 --2- 172.21.15.26:0/1145029801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5ec15dec0 0x7fe5ec0cfb50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0664e0 tx=0x7fe5e401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73adfbb9f81cb0ab server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:23.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.168+0000 7fe5e3fff640 1 -- 172.21.15.26:0/1145029801 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e40a5860 con 0x7fe5ec15dec0 2023-10-14T11:12:23.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.168+0000 7fe5e3fff640 1 -- 172.21.15.26:0/1145029801 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e40a59c0 con 0x7fe5ec15dec0 2023-10-14T11:12:23.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.168+0000 7fe5e3fff640 1 -- 172.21.15.26:0/1145029801 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e40a5d50 con 0x7fe5ec15dec0 2023-10-14T11:12:23.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f3701640 1 -- 172.21.15.26:0/1145029801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5ec15dec0 msgr2=0x7fe5ec0cfb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:23.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f3701640 1 --2- 172.21.15.26:0/1145029801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5ec15dec0 0x7fe5ec0cfb50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0664e0 tx=0x7fe5e401c9a0 comp rx=0 tx=0).stop 2023-10-14T11:12:23.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f3701640 1 -- 172.21.15.26:0/1145029801 shutdown_connections 2023-10-14T11:12:23.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f3701640 1 --2- 172.21.15.26:0/1145029801 >> v2:172.21.15.110:3300/0 conn(0x7fe5ec0cdc80 0x7fe5ec0cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:23.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f3701640 1 --2- 172.21.15.26:0/1145029801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5ec15dec0 0x7fe5ec0cfb50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:23.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f3701640 1 -- 172.21.15.26:0/1145029801 >> 172.21.15.26:0/1145029801 conn(0x7fe5ec0715c0 msgr2=0x7fe5ec0719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:23.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f3701640 1 -- 172.21.15.26:0/1145029801 shutdown_connections 2023-10-14T11:12:23.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f3701640 1 -- 172.21.15.26:0/1145029801 wait complete. 2023-10-14T11:12:23.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f3701640 1 Processor -- start 2023-10-14T11:12:23.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f3701640 1 -- start start 2023-10-14T11:12:23.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f3701640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5ec0cdc80 0x7fe5ec14d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:23.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f3701640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5ec0d2570 0x7fe5ec150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:23.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f3701640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5ec15dec0 0x7fe5ec158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:23.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f3701640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec14d820 con 0x7fe5ec15dec0 2023-10-14T11:12:23.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f3701640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec1519d0 con 0x7fe5ec0d2570 2023-10-14T11:12:23.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f3701640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec151cb0 con 0x7fe5ec0cdc80 2023-10-14T11:12:23.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f1c9e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5ec15dec0 0x7fe5ec158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:23.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f149d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5ec0cdc80 0x7fe5ec14d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:23.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f0c9c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5ec0d2570 0x7fe5ec150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:23.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f1c9e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5ec15dec0 0x7fe5ec158a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52202/0 (socket says 172.21.15.26:52202) 2023-10-14T11:12:23.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f1c9e640 1 -- 172.21.15.26:0/325271969 learned_addr learned my addr 172.21.15.26:0/325271969 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:23.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f1c9e640 1 -- 172.21.15.26:0/325271969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5ec0cdc80 msgr2=0x7fe5ec14d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:23.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f1c9e640 1 --2- 172.21.15.26:0/325271969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5ec0cdc80 0x7fe5ec14d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:23.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f1c9e640 1 -- 172.21.15.26:0/325271969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5ec0d2570 msgr2=0x7fe5ec150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:23.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.172+0000 7fe5f1c9e640 1 --2- 172.21.15.26:0/325271969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5ec0d2570 0x7fe5ec150f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:23.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.176+0000 7fe5f1c9e640 1 -- 172.21.15.26:0/325271969 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e4009b30 con 0x7fe5ec15dec0 2023-10-14T11:12:23.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.176+0000 7fe5f149d640 1 --2- 172.21.15.26:0/325271969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5ec0cdc80 0x7fe5ec14d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:12:23.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.176+0000 7fe5f0c9c640 1 --2- 172.21.15.26:0/325271969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5ec0d2570 0x7fe5ec150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:12:23.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.176+0000 7fe5f1c9e640 1 --2- 172.21.15.26:0/325271969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5ec15dec0 0x7fe5ec158a80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe5e40af040 tx=0x7fe5e4019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:23.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.176+0000 7fe5e1ffb640 1 -- 172.21.15.26:0/325271969 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e40b8670 con 0x7fe5ec15dec0 2023-10-14T11:12:23.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.176+0000 7fe5e1ffb640 1 -- 172.21.15.26:0/325271969 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e40b87d0 con 0x7fe5ec15dec0 2023-10-14T11:12:23.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.176+0000 7fe5e1ffb640 1 -- 172.21.15.26:0/325271969 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e40b8b60 con 0x7fe5ec15dec0 2023-10-14T11:12:23.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.176+0000 7fe5f3701640 1 -- 172.21.15.26:0/325271969 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5ec151f90 con 0x7fe5ec15dec0 2023-10-14T11:12:23.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.176+0000 7fe5f3701640 1 -- 172.21.15.26:0/325271969 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ec152550 con 0x7fe5ec15dec0 2023-10-14T11:12:23.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.176+0000 7fe5f3701640 1 -- 172.21.15.26:0/325271969 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5ec152740 con 0x7fe5ec15dec0 2023-10-14T11:12:23.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.176+0000 7fe5e1ffb640 1 -- 172.21.15.26:0/325271969 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe5e40b8cc0 con 0x7fe5ec15dec0 2023-10-14T11:12:23.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.176+0000 7fe5e1ffb640 1 --2- 172.21.15.26:0/325271969 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe5d00664a0 0x7fe5d0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:23.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.176+0000 7fe5e1ffb640 1 -- 172.21.15.26:0/325271969 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5e411f390 con 0x7fe5ec15dec0 2023-10-14T11:12:23.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.180+0000 7fe5f149d640 1 --2- 172.21.15.26:0/325271969 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe5d00664a0 0x7fe5d0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:23.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.180+0000 7fe5f149d640 1 --2- 172.21.15.26:0/325271969 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe5d00664a0 0x7fe5d0068960 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8007fd0 tx=0x7fe5e8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:23.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.180+0000 7fe5e1ffb640 1 -- 172.21.15.26:0/325271969 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe5e40ec970 con 0x7fe5ec15dec0 2023-10-14T11:12:23.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.348+0000 7fe5f3701640 1 -- 172.21.15.26:0/325271969 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fe5ec04e170 con 0x7fe5ec15dec0 2023-10-14T11:12:23.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.964+0000 7fe5e1ffb640 1 -- 172.21.15.26:0/325271969 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7fe5e40eff90 con 0x7fe5ec15dec0 2023-10-14T11:12:23.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.968+0000 7fe5f3701640 1 -- 172.21.15.26:0/325271969 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe5d00664a0 msgr2=0x7fe5d0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:23.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.968+0000 7fe5f3701640 1 --2- 172.21.15.26:0/325271969 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe5d00664a0 0x7fe5d0068960 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8007fd0 tx=0x7fe5e8009040 comp rx=0 tx=0).stop 2023-10-14T11:12:23.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.968+0000 7fe5f3701640 1 -- 172.21.15.26:0/325271969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5ec15dec0 msgr2=0x7fe5ec158a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:23.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.968+0000 7fe5f3701640 1 --2- 172.21.15.26:0/325271969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5ec15dec0 0x7fe5ec158a80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe5e40af040 tx=0x7fe5e4019740 comp rx=0 tx=0).stop 2023-10-14T11:12:23.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.968+0000 7fe5f3701640 1 -- 172.21.15.26:0/325271969 shutdown_connections 2023-10-14T11:12:23.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.968+0000 7fe5f3701640 1 --2- 172.21.15.26:0/325271969 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe5d00664a0 0x7fe5d0068960 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:23.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.968+0000 7fe5f3701640 1 --2- 172.21.15.26:0/325271969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5ec15dec0 0x7fe5ec158a80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:23.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.968+0000 7fe5f3701640 1 --2- 172.21.15.26:0/325271969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5ec0d2570 0x7fe5ec150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:23.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.968+0000 7fe5f3701640 1 --2- 172.21.15.26:0/325271969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5ec0cdc80 0x7fe5ec14d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:23.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.968+0000 7fe5f3701640 1 -- 172.21.15.26:0/325271969 >> 172.21.15.26:0/325271969 conn(0x7fe5ec0715c0 msgr2=0x7fe5ec0b8360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:23.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.968+0000 7fe5f3701640 1 -- 172.21.15.26:0/325271969 shutdown_connections 2023-10-14T11:12:23.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:23.968+0000 7fe5f3701640 1 -- 172.21.15.26:0/325271969 wait complete. 2023-10-14T11:12:23.994 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T11:12:24.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.144+0000 7f61618c9640 1 Processor -- start 2023-10-14T11:12:24.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.144+0000 7f61618c9640 1 -- start start 2023-10-14T11:12:24.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.148+0000 7f61618c9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f615c0b8640 0x7f615c0d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:24.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.148+0000 7f61618c9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c15cff0 con 0x7f615c0cd800 2023-10-14T11:12:24.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.148+0000 7f61618c9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c0b63f0 con 0x7f615c15cc10 2023-10-14T11:12:24.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.148+0000 7f61618c9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f615c0b66d0 con 0x7f615c0b8640 2023-10-14T11:12:24.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.148+0000 7f615b7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f615c0cd800 0x7f615c0cdc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42424/0 (socket says 172.21.15.26:42424) 2023-10-14T11:12:24.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.148+0000 7f615b7fe640 1 -- 172.21.15.26:0/14962953 learned_addr learned my addr 172.21.15.26:0/14962953 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:24.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.148+0000 7f6153fff640 1 --2- 172.21.15.26:0/14962953 >> v2:172.21.15.110:3300/0 conn(0x7f615c0b8640 0x7f615c0d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:24.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.148+0000 7f615a7fc640 1 -- 172.21.15.26:0/14962953 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430681450 0 0) 0x7f615c15cff0 con 0x7f615c0cd800 2023-10-14T11:12:24.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.148+0000 7f615a7fc640 1 -- 172.21.15.26:0/14962953 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6148003530 con 0x7f615c0cd800 2023-10-14T11:12:24.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.148+0000 7f6153fff640 1 -- 172.21.15.26:0/14962953 >> v1:172.21.15.110:6789/0 conn(0x7f615c15cc10 legacy=0x7f615c0b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:24.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.148+0000 7f6153fff640 1 -- 172.21.15.26:0/14962953 >> v1:172.21.15.26:6789/0 conn(0x7f615c0cd800 legacy=0x7f615c0cdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:24.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.148+0000 7f6153fff640 1 -- 172.21.15.26:0/14962953 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c0b69b0 con 0x7f615c0b8640 2023-10-14T11:12:24.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.152+0000 7f6153fff640 1 --2- 172.21.15.26:0/14962953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f615c0b8640 0x7f615c0d0b70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f61440097c0 tx=0x7f614401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e740cec4028dd000 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:24.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.152+0000 7f615a7fc640 1 -- 172.21.15.26:0/14962953 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61440a8970 con 0x7f615c0b8640 2023-10-14T11:12:24.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.152+0000 7f615a7fc640 1 -- 172.21.15.26:0/14962953 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61440a8ad0 con 0x7f615c0b8640 2023-10-14T11:12:24.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.152+0000 7f615a7fc640 1 -- 172.21.15.26:0/14962953 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61440a8e60 con 0x7f615c0b8640 2023-10-14T11:12:24.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.152+0000 7f61618c9640 1 -- 172.21.15.26:0/14962953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f615c0b8640 msgr2=0x7f615c0d0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:24.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.152+0000 7f61618c9640 1 --2- 172.21.15.26:0/14962953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f615c0b8640 0x7f615c0d0b70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f61440097c0 tx=0x7f614401ec70 comp rx=0 tx=0).stop 2023-10-14T11:12:24.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.152+0000 7f61618c9640 1 -- 172.21.15.26:0/14962953 shutdown_connections 2023-10-14T11:12:24.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.152+0000 7f61618c9640 1 --2- 172.21.15.26:0/14962953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f615c0b8640 0x7f615c0d0b70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:24.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.152+0000 7f61618c9640 1 -- 172.21.15.26:0/14962953 >> 172.21.15.26:0/14962953 conn(0x7f615c0719c0 msgr2=0x7f615c071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:24.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.152+0000 7f61618c9640 1 -- 172.21.15.26:0/14962953 shutdown_connections 2023-10-14T11:12:24.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.152+0000 7f61618c9640 1 -- 172.21.15.26:0/14962953 wait complete. 2023-10-14T11:12:24.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f61618c9640 1 Processor -- start 2023-10-14T11:12:24.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f61618c9640 1 -- start start 2023-10-14T11:12:24.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f61618c9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f615c0b8640 0x7f615c0c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:24.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f61618c9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f615c0cd800 0x7f615c0c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:24.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f61618c9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f615c15cc10 0x7f615c15e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:24.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f61618c9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c0d1540 con 0x7f615c0b8640 2023-10-14T11:12:24.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f61618c9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c1f3030 con 0x7f615c15cc10 2023-10-14T11:12:24.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f61618c9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615c1f3310 con 0x7f615c0cd800 2023-10-14T11:12:24.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f615affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f615c0b8640 0x7f615c0c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:24.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f615affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f615c0b8640 0x7f615c0c71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52212/0 (socket says 172.21.15.26:52212) 2023-10-14T11:12:24.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f615affd640 1 -- 172.21.15.26:0/310370517 learned_addr learned my addr 172.21.15.26:0/310370517 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:24.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f615b7fe640 1 --2- 172.21.15.26:0/310370517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f615c15cc10 0x7f615c15e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:24.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f6153fff640 1 --2- 172.21.15.26:0/310370517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f615c0cd800 0x7f615c0c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:24.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f615affd640 1 -- 172.21.15.26:0/310370517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f615c0cd800 msgr2=0x7f615c0c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:24.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f615affd640 1 --2- 172.21.15.26:0/310370517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f615c0cd800 0x7f615c0c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:24.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f615affd640 1 -- 172.21.15.26:0/310370517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f615c15cc10 msgr2=0x7f615c15e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:24.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f615affd640 1 --2- 172.21.15.26:0/310370517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f615c15cc10 0x7f615c15e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:24.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f615affd640 1 -- 172.21.15.26:0/310370517 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6144009420 con 0x7f615c0b8640 2023-10-14T11:12:24.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f615affd640 1 --2- 172.21.15.26:0/310370517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f615c0b8640 0x7f615c0c71e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f614c00c370 tx=0x7f614c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:24.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f6158ff9640 1 -- 172.21.15.26:0/310370517 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c0052d0 con 0x7f615c0b8640 2023-10-14T11:12:24.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f6158ff9640 1 -- 172.21.15.26:0/310370517 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c005430 con 0x7f615c0b8640 2023-10-14T11:12:24.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f6158ff9640 1 -- 172.21.15.26:0/310370517 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c007260 con 0x7f615c0b8640 2023-10-14T11:12:24.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f61618c9640 1 -- 172.21.15.26:0/310370517 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615c0c6700 con 0x7f615c0b8640 2023-10-14T11:12:24.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f61618c9640 1 -- 172.21.15.26:0/310370517 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615c0c6cc0 con 0x7f615c0b8640 2023-10-14T11:12:24.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.156+0000 7f61618c9640 1 -- 172.21.15.26:0/310370517 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615c15fe40 con 0x7f615c0b8640 2023-10-14T11:12:24.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.160+0000 7f6158ff9640 1 -- 172.21.15.26:0/310370517 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f614c0073c0 con 0x7f615c0b8640 2023-10-14T11:12:24.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.160+0000 7f6158ff9640 1 --2- 172.21.15.26:0/310370517 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f613c0664a0 0x7f613c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:24.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.160+0000 7f6158ff9640 1 -- 172.21.15.26:0/310370517 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f614c083300 con 0x7f615c0b8640 2023-10-14T11:12:24.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.160+0000 7f6153fff640 1 --2- 172.21.15.26:0/310370517 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f613c0664a0 0x7f613c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:24.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.160+0000 7f6153fff640 1 --2- 172.21.15.26:0/310370517 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f613c0664a0 0x7f613c068960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f61440b2000 tx=0x7f61440aa070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:24.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.164+0000 7f6158ff9640 1 -- 172.21.15.26:0/310370517 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f614c0506b0 con 0x7f615c0b8640 2023-10-14T11:12:24.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:24.320+0000 7f61618c9640 1 -- 172.21.15.26:0/310370517 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f615c0b1ff0 con 0x7f615c0b8640 2023-10-14T11:12:25.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:25.976+0000 7f6158ff9640 1 -- 172.21.15.26:0/310370517 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f614c053cd0 con 0x7f615c0b8640 2023-10-14T11:12:25.979 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data_ec' created 2023-10-14T11:12:25.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:25.980+0000 7f61618c9640 1 -- 172.21.15.26:0/310370517 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f613c0664a0 msgr2=0x7f613c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:25.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:25.980+0000 7f61618c9640 1 --2- 172.21.15.26:0/310370517 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f613c0664a0 0x7f613c068960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f61440b2000 tx=0x7f61440aa070 comp rx=0 tx=0).stop 2023-10-14T11:12:25.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:25.980+0000 7f61618c9640 1 -- 172.21.15.26:0/310370517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f615c0b8640 msgr2=0x7f615c0c71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:25.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:25.980+0000 7f61618c9640 1 --2- 172.21.15.26:0/310370517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f615c0b8640 0x7f615c0c71e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f614c00c370 tx=0x7f614c00c830 comp rx=0 tx=0).stop 2023-10-14T11:12:25.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:25.980+0000 7f61618c9640 1 -- 172.21.15.26:0/310370517 shutdown_connections 2023-10-14T11:12:25.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:25.980+0000 7f61618c9640 1 --2- 172.21.15.26:0/310370517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f615c15cc10 0x7f615c15e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:25.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:25.980+0000 7f61618c9640 1 --2- 172.21.15.26:0/310370517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f615c0cd800 0x7f615c0c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:25.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:25.980+0000 7f61618c9640 1 --2- 172.21.15.26:0/310370517 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f613c0664a0 0x7f613c068960 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:25.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:25.980+0000 7f61618c9640 1 --2- 172.21.15.26:0/310370517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f615c0b8640 0x7f615c0c71e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:25.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:25.980+0000 7f61618c9640 1 -- 172.21.15.26:0/310370517 >> 172.21.15.26:0/310370517 conn(0x7f615c0719c0 msgr2=0x7f615c15c210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:25.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:25.980+0000 7f61618c9640 1 -- 172.21.15.26:0/310370517 shutdown_connections 2023-10-14T11:12:25.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:25.980+0000 7f61618c9640 1 -- 172.21.15.26:0/310370517 wait complete. 2023-10-14T11:12:26.015 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-14T11:12:26.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.160+0000 7f40b7f65640 1 Processor -- start 2023-10-14T11:12:26.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.160+0000 7f40b7f65640 1 -- start start 2023-10-14T11:12:26.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.164+0000 7f40b7f65640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f40b00d2570 0x7f40b0161210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:26.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.164+0000 7f40b7f65640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40b00cfd20 0x7f40b00d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:26.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.164+0000 7f40b7f65640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b00ce460 con 0x7f40b00cdc80 2023-10-14T11:12:26.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.164+0000 7f40b7f65640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b00cd830 con 0x7f40b00d2570 2023-10-14T11:12:26.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.164+0000 7f40b7f65640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b015da30 con 0x7f40b00cfd20 2023-10-14T11:12:26.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.164+0000 7f40b5500640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f40b00cdc80 0x7f40b00cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42438/0 (socket says 172.21.15.26:42438) 2023-10-14T11:12:26.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.164+0000 7f40b5500640 1 -- 172.21.15.26:0/358340444 learned_addr learned my addr 172.21.15.26:0/358340444 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:26.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.164+0000 7f40b5d01640 1 --2- 172.21.15.26:0/358340444 >> v2:172.21.15.110:3300/0 conn(0x7f40b00d2570 0x7f40b0161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:26.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.164+0000 7f40b6502640 1 --2- 172.21.15.26:0/358340444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40b00cfd20 0x7f40b00d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:26.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.164+0000 7f40b4cff640 1 -- 172.21.15.26:0/358340444 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211173866 0 0) 0x7f40b00ce460 con 0x7f40b00cdc80 2023-10-14T11:12:26.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.164+0000 7f40b4cff640 1 -- 172.21.15.26:0/358340444 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f409c003530 con 0x7f40b00cdc80 2023-10-14T11:12:26.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.164+0000 7f40b4cff640 1 -- 172.21.15.26:0/358340444 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2769143132 0 0) 0x7f409c003530 con 0x7f40b00cdc80 2023-10-14T11:12:26.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.164+0000 7f40b5d01640 1 -- 172.21.15.26:0/358340444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40b00cfd20 msgr2=0x7f40b00d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:26.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.164+0000 7f40b5d01640 1 --2- 172.21.15.26:0/358340444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40b00cfd20 0x7f40b00d0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:26.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.164+0000 7f40b5d01640 1 -- 172.21.15.26:0/358340444 >> v1:172.21.15.26:6789/0 conn(0x7f40b00cdc80 legacy=0x7f40b00cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:26.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.164+0000 7f40b5d01640 1 -- 172.21.15.26:0/358340444 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b0161750 con 0x7f40b00d2570 2023-10-14T11:12:26.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.168+0000 7f40b5d01640 1 --2- 172.21.15.26:0/358340444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40b00d2570 0x7f40b0161210 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0097c0 tx=0x7f40ac01c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2dee9a446028250 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:26.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.168+0000 7f40b4cff640 1 -- 172.21.15.26:0/358340444 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a0001680 con 0x7f40b00d2570 2023-10-14T11:12:26.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.168+0000 7f40b4cff640 1 -- 172.21.15.26:0/358340444 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac0a7050 con 0x7f40b00d2570 2023-10-14T11:12:26.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.168+0000 7f40b4cff640 1 -- 172.21.15.26:0/358340444 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac0ab620 con 0x7f40b00d2570 2023-10-14T11:12:26.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.168+0000 7f40b7f65640 1 -- 172.21.15.26:0/358340444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40b00d2570 msgr2=0x7f40b0161210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:26.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.168+0000 7f40b7f65640 1 --2- 172.21.15.26:0/358340444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40b00d2570 0x7f40b0161210 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0097c0 tx=0x7f40ac01c370 comp rx=0 tx=0).stop 2023-10-14T11:12:26.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.168+0000 7f40b7f65640 1 -- 172.21.15.26:0/358340444 shutdown_connections 2023-10-14T11:12:26.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.168+0000 7f40b7f65640 1 --2- 172.21.15.26:0/358340444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40b00cfd20 0x7f40b00d0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:26.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.168+0000 7f40b7f65640 1 --2- 172.21.15.26:0/358340444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40b00d2570 0x7f40b0161210 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:26.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.168+0000 7f40b7f65640 1 -- 172.21.15.26:0/358340444 >> 172.21.15.26:0/358340444 conn(0x7f40b00715c0 msgr2=0x7f40b00719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:26.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.168+0000 7f40b7f65640 1 -- 172.21.15.26:0/358340444 shutdown_connections 2023-10-14T11:12:26.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.168+0000 7f40b7f65640 1 -- 172.21.15.26:0/358340444 wait complete. 2023-10-14T11:12:26.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.168+0000 7f40b7f65640 1 Processor -- start 2023-10-14T11:12:26.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40b7f65640 1 -- start start 2023-10-14T11:12:26.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40b7f65640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40b00cdc80 0x7f40b01567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:26.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40b7f65640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40b00cfd20 0x7f40b0159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:26.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40b7f65640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b00d2570 0x7f40b01596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:26.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40b7f65640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b0156ce0 con 0x7f40b00d2570 2023-10-14T11:12:26.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40b7f65640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b00c8eb0 con 0x7f40b00cfd20 2023-10-14T11:12:26.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40b7f65640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b015c750 con 0x7f40b00cdc80 2023-10-14T11:12:26.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40b6502640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b00d2570 0x7f40b01596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:26.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40b6502640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b00d2570 0x7f40b01596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52224/0 (socket says 172.21.15.26:52224) 2023-10-14T11:12:26.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40b6502640 1 -- 172.21.15.26:0/2813314033 learned_addr learned my addr 172.21.15.26:0/2813314033 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:26.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40b5d01640 1 --2- 172.21.15.26:0/2813314033 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40b00cdc80 0x7f40b01567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:26.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40b5500640 1 --2- 172.21.15.26:0/2813314033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40b00cfd20 0x7f40b0159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:26.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40b6502640 1 -- 172.21.15.26:0/2813314033 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40b00cdc80 msgr2=0x7f40b01567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:26.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40b6502640 1 --2- 172.21.15.26:0/2813314033 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40b00cdc80 0x7f40b01567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:26.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40b6502640 1 -- 172.21.15.26:0/2813314033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40b00cfd20 msgr2=0x7f40b0159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:26.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40b6502640 1 --2- 172.21.15.26:0/2813314033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40b00cfd20 0x7f40b0159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:26.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40b6502640 1 -- 172.21.15.26:0/2813314033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac009420 con 0x7f40b00d2570 2023-10-14T11:12:26.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40b6502640 1 --2- 172.21.15.26:0/2813314033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b00d2570 0x7f40b01596a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f40a800efc0 tx=0x7f40a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:26.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40a67fc640 1 -- 172.21.15.26:0/2813314033 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8014480 con 0x7f40b00d2570 2023-10-14T11:12:26.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40a67fc640 1 -- 172.21.15.26:0/2813314033 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a800f040 con 0x7f40b00d2570 2023-10-14T11:12:26.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40a67fc640 1 -- 172.21.15.26:0/2813314033 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8014820 con 0x7f40b00d2570 2023-10-14T11:12:26.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40b7f65640 1 -- 172.21.15.26:0/2813314033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b01540b0 con 0x7f40b00d2570 2023-10-14T11:12:26.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40b7f65640 1 -- 172.21.15.26:0/2813314033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b0155cc0 con 0x7f40b00d2570 2023-10-14T11:12:26.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.172+0000 7f40b7f65640 1 -- 172.21.15.26:0/2813314033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b004e170 con 0x7f40b00d2570 2023-10-14T11:12:26.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.176+0000 7f40a67fc640 1 -- 172.21.15.26:0/2813314033 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f40a8014980 con 0x7f40b00d2570 2023-10-14T11:12:26.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.176+0000 7f40a67fc640 1 --2- 172.21.15.26:0/2813314033 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f40940664a0 0x7f4094068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:26.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.176+0000 7f40a67fc640 1 -- 172.21.15.26:0/2813314033 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f40a8084ff0 con 0x7f40b00d2570 2023-10-14T11:12:26.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.176+0000 7f40b5d01640 1 --2- 172.21.15.26:0/2813314033 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f40940664a0 0x7f4094068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:26.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.176+0000 7f40b5d01640 1 --2- 172.21.15.26:0/2813314033 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f40940664a0 0x7f4094068960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0ad000 tx=0x7f40ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:26.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.180+0000 7f40a67fc640 1 -- 172.21.15.26:0/2813314033 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f40a80521f0 con 0x7f40b00d2570 2023-10-14T11:12:26.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.336+0000 7f40b7f65640 1 -- 172.21.15.26:0/2813314033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f40b00c7480 con 0x7f40b00d2570 2023-10-14T11:12:26.405 INFO:tasks.ceph.mds.b.smithi110.stderr:2023-10-14T11:12:26.402+0000 7fd3aebfa640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T11:12:26.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.980+0000 7f40a67fc640 1 -- 172.21.15.26:0/2813314033 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f40a8055810 con 0x7f40b00d2570 2023-10-14T11:12:26.985 INFO:teuthology.orchestra.run.smithi026.stderr:set pool 4 allow_ec_overwrites to true 2023-10-14T11:12:26.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.984+0000 7f40b7f65640 1 -- 172.21.15.26:0/2813314033 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f40940664a0 msgr2=0x7f4094068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:26.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.984+0000 7f40b7f65640 1 --2- 172.21.15.26:0/2813314033 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f40940664a0 0x7f4094068960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0ad000 tx=0x7f40ac008040 comp rx=0 tx=0).stop 2023-10-14T11:12:26.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.984+0000 7f40b7f65640 1 -- 172.21.15.26:0/2813314033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b00d2570 msgr2=0x7f40b01596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:26.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.984+0000 7f40b7f65640 1 --2- 172.21.15.26:0/2813314033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b00d2570 0x7f40b01596a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f40a800efc0 tx=0x7f40a800c490 comp rx=0 tx=0).stop 2023-10-14T11:12:26.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.984+0000 7f40b7f65640 1 -- 172.21.15.26:0/2813314033 shutdown_connections 2023-10-14T11:12:26.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.984+0000 7f40b7f65640 1 --2- 172.21.15.26:0/2813314033 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f40940664a0 0x7f4094068960 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:26.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.984+0000 7f40b7f65640 1 --2- 172.21.15.26:0/2813314033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b00d2570 0x7f40b01596a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:26.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.984+0000 7f40b7f65640 1 --2- 172.21.15.26:0/2813314033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40b00cfd20 0x7f40b0159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:26.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.984+0000 7f40b7f65640 1 --2- 172.21.15.26:0/2813314033 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40b00cdc80 0x7f40b01567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:26.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.984+0000 7f40b7f65640 1 -- 172.21.15.26:0/2813314033 >> 172.21.15.26:0/2813314033 conn(0x7f40b00715c0 msgr2=0x7f40b0156eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:26.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.984+0000 7f40b7f65640 1 -- 172.21.15.26:0/2813314033 shutdown_connections 2023-10-14T11:12:26.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:26.984+0000 7f40b7f65640 1 -- 172.21.15.26:0/2813314033 wait complete. 2023-10-14T11:12:27.037 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-14T11:12:27.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.180+0000 7fea61c9c640 1 Processor -- start 2023-10-14T11:12:27.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.180+0000 7fea61c9c640 1 -- start start 2023-10-14T11:12:27.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.184+0000 7fea61c9c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fea5c06a5a0 0x7fea5c06e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:27.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.184+0000 7fea61c9c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fea5c0b3f00 0x7fea5c0c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:27.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.184+0000 7fea61c9c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5c0b4370 con 0x7fea5c159900 2023-10-14T11:12:27.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.184+0000 7fea61c9c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea5c0cd740 con 0x7fea5c06a5a0 2023-10-14T11:12:27.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.184+0000 7fea61c9c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0b4600 con 0x7fea5c0b3f00 2023-10-14T11:12:27.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.184+0000 7fea5affd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fea5c06a5a0 0x7fea5c06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:27.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.184+0000 7fea5affd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fea5c06a5a0 0x7fea5c06e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52240/0 (socket says 172.21.15.26:52240) 2023-10-14T11:12:27.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.184+0000 7fea5affd640 1 -- 172.21.15.26:0/3350067316 learned_addr learned my addr 172.21.15.26:0/3350067316 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:27.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.184+0000 7fea5affd640 1 -- 172.21.15.26:0/3350067316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fea5c0b3f00 msgr2=0x7fea5c0c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:27.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.184+0000 7fea5affd640 1 --2- 172.21.15.26:0/3350067316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fea5c0b3f00 0x7fea5c0c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:27.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.184+0000 7fea5affd640 1 -- 172.21.15.26:0/3350067316 >> v1:172.21.15.26:6789/0 conn(0x7fea5c159900 legacy=0x7fea5c069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:27.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.184+0000 7fea5affd640 1 -- 172.21.15.26:0/3350067316 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c0c8dd0 con 0x7fea5c06a5a0 2023-10-14T11:12:27.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.184+0000 7fea5a7fc640 1 -- 172.21.15.26:0/3350067316 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227597287 0 0) 0x7fea5c0b4370 con 0x7fea5c159900 2023-10-14T11:12:27.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.188+0000 7fea5affd640 1 --2- 172.21.15.26:0/3350067316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5c06a5a0 0x7fea5c06e260 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fea50009870 tx=0x7fea5001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0e8d2ac473336e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:27.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.188+0000 7fea5a7fc640 1 -- 172.21.15.26:0/3350067316 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea500aa670 con 0x7fea5c06a5a0 2023-10-14T11:12:27.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.188+0000 7fea5a7fc640 1 -- 172.21.15.26:0/3350067316 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea500aa7d0 con 0x7fea5c06a5a0 2023-10-14T11:12:27.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.188+0000 7fea5a7fc640 1 -- 172.21.15.26:0/3350067316 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea500aab60 con 0x7fea5c06a5a0 2023-10-14T11:12:27.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.188+0000 7fea61c9c640 1 -- 172.21.15.26:0/3350067316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5c06a5a0 msgr2=0x7fea5c06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:27.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.188+0000 7fea61c9c640 1 --2- 172.21.15.26:0/3350067316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5c06a5a0 0x7fea5c06e260 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fea50009870 tx=0x7fea5001c510 comp rx=0 tx=0).stop 2023-10-14T11:12:27.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.188+0000 7fea61c9c640 1 -- 172.21.15.26:0/3350067316 shutdown_connections 2023-10-14T11:12:27.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.188+0000 7fea61c9c640 1 --2- 172.21.15.26:0/3350067316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fea5c0b3f00 0x7fea5c0c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:27.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.188+0000 7fea61c9c640 1 --2- 172.21.15.26:0/3350067316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5c06a5a0 0x7fea5c06e260 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:27.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.188+0000 7fea61c9c640 1 -- 172.21.15.26:0/3350067316 >> 172.21.15.26:0/3350067316 conn(0x7fea5c0b0da0 msgr2=0x7fea5c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:27.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.188+0000 7fea61c9c640 1 -- 172.21.15.26:0/3350067316 shutdown_connections 2023-10-14T11:12:27.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.188+0000 7fea61c9c640 1 -- 172.21.15.26:0/3350067316 wait complete. 2023-10-14T11:12:27.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.188+0000 7fea61c9c640 1 Processor -- start 2023-10-14T11:12:27.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.188+0000 7fea61c9c640 1 -- start start 2023-10-14T11:12:27.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.188+0000 7fea61c9c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5c06a5a0 0x7fea5c142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:27.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.188+0000 7fea61c9c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fea5c0b3f00 0x7fea5c15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:27.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.188+0000 7fea61c9c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea5c159900 0x7fea5c0ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:27.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.188+0000 7fea61c9c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c142a50 con 0x7fea5c06a5a0 2023-10-14T11:12:27.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.188+0000 7fea61c9c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0c8a00 con 0x7fea5c159900 2023-10-14T11:12:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.188+0000 7fea61c9c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0c7960 con 0x7fea5c0b3f00 2023-10-14T11:12:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.192+0000 7fea5b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5c06a5a0 0x7fea5c142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.192+0000 7fea5b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5c06a5a0 0x7fea5c142510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52242/0 (socket says 172.21.15.26:52242) 2023-10-14T11:12:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.192+0000 7fea5b7fe640 1 -- 172.21.15.26:0/220666146 learned_addr learned my addr 172.21.15.26:0/220666146 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.192+0000 7fea5affd640 1 --2- 172.21.15.26:0/220666146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fea5c0b3f00 0x7fea5c15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:27.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.192+0000 7fea5bfff640 1 --2- 172.21.15.26:0/220666146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea5c159900 0x7fea5c0ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:27.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.192+0000 7fea5b7fe640 1 -- 172.21.15.26:0/220666146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fea5c0b3f00 msgr2=0x7fea5c15c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:27.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.192+0000 7fea5b7fe640 1 --2- 172.21.15.26:0/220666146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fea5c0b3f00 0x7fea5c15c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:27.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.192+0000 7fea5b7fe640 1 -- 172.21.15.26:0/220666146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea5c159900 msgr2=0x7fea5c0ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:27.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.192+0000 7fea5b7fe640 1 --2- 172.21.15.26:0/220666146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea5c159900 0x7fea5c0ab870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:27.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.192+0000 7fea5b7fe640 1 -- 172.21.15.26:0/220666146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea500094d0 con 0x7fea5c06a5a0 2023-10-14T11:12:27.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.192+0000 7fea5bfff640 1 --2- 172.21.15.26:0/220666146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea5c159900 0x7fea5c0ab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:27.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.192+0000 7fea5b7fe640 1 --2- 172.21.15.26:0/220666146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5c06a5a0 0x7fea5c142510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fea4c001ec0 tx=0x7fea4c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:27.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.192+0000 7fea43fff640 1 -- 172.21.15.26:0/220666146 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c0054e0 con 0x7fea5c06a5a0 2023-10-14T11:12:27.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.192+0000 7fea43fff640 1 -- 172.21.15.26:0/220666146 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c003600 con 0x7fea5c06a5a0 2023-10-14T11:12:27.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.192+0000 7fea43fff640 1 -- 172.21.15.26:0/220666146 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c0039b0 con 0x7fea5c06a5a0 2023-10-14T11:12:27.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.192+0000 7fea61c9c640 1 -- 172.21.15.26:0/220666146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5c0c7c40 con 0x7fea5c06a5a0 2023-10-14T11:12:27.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.192+0000 7fea61c9c640 1 -- 172.21.15.26:0/220666146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5c0c8200 con 0x7fea5c06a5a0 2023-10-14T11:12:27.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.192+0000 7fea61c9c640 1 -- 172.21.15.26:0/220666146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5c04e170 con 0x7fea5c06a5a0 2023-10-14T11:12:27.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.192+0000 7fea43fff640 1 -- 172.21.15.26:0/220666146 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fea4c003b10 con 0x7fea5c06a5a0 2023-10-14T11:12:27.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.192+0000 7fea43fff640 1 --2- 172.21.15.26:0/220666146 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fea480664a0 0x7fea48068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:27.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.196+0000 7fea43fff640 1 -- 172.21.15.26:0/220666146 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fea4c0838b0 con 0x7fea5c06a5a0 2023-10-14T11:12:27.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.196+0000 7fea5affd640 1 --2- 172.21.15.26:0/220666146 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fea480664a0 0x7fea48068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:27.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.196+0000 7fea5affd640 1 --2- 172.21.15.26:0/220666146 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fea480664a0 0x7fea48068960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea500ae000 tx=0x7fea500a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:27.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.200+0000 7fea43fff640 1 -- 172.21.15.26:0/220666146 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fea4c050930 con 0x7fea5c06a5a0 2023-10-14T11:12:27.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.396+0000 7fea61c9c640 1 -- 172.21.15.26:0/220666146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fea5c06db90 con 0x7fea5c06a5a0 2023-10-14T11:12:27.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.984+0000 7fea43fff640 1 -- 172.21.15.26:0/220666146 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fea4c017070 con 0x7fea5c06a5a0 2023-10-14T11:12:27.988 INFO:teuthology.orchestra.run.smithi026.stderr:added data pool 4 to fsmap 2023-10-14T11:12:27.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.988+0000 7fea61c9c640 1 -- 172.21.15.26:0/220666146 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fea480664a0 msgr2=0x7fea48068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:27.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.988+0000 7fea61c9c640 1 --2- 172.21.15.26:0/220666146 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fea480664a0 0x7fea48068960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea500ae000 tx=0x7fea500a7000 comp rx=0 tx=0).stop 2023-10-14T11:12:27.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.988+0000 7fea61c9c640 1 -- 172.21.15.26:0/220666146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5c06a5a0 msgr2=0x7fea5c142510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:27.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.988+0000 7fea61c9c640 1 --2- 172.21.15.26:0/220666146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5c06a5a0 0x7fea5c142510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fea4c001ec0 tx=0x7fea4c00c8e0 comp rx=0 tx=0).stop 2023-10-14T11:12:27.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.988+0000 7fea61c9c640 1 -- 172.21.15.26:0/220666146 shutdown_connections 2023-10-14T11:12:27.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.988+0000 7fea61c9c640 1 --2- 172.21.15.26:0/220666146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea5c159900 0x7fea5c0ab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:27.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.988+0000 7fea61c9c640 1 --2- 172.21.15.26:0/220666146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fea5c0b3f00 0x7fea5c15c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:27.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.988+0000 7fea61c9c640 1 --2- 172.21.15.26:0/220666146 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fea480664a0 0x7fea48068960 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:27.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.988+0000 7fea61c9c640 1 --2- 172.21.15.26:0/220666146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5c06a5a0 0x7fea5c142510 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:27.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.988+0000 7fea61c9c640 1 -- 172.21.15.26:0/220666146 >> 172.21.15.26:0/220666146 conn(0x7fea5c0b0da0 msgr2=0x7fea5c070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:27.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.988+0000 7fea61c9c640 1 -- 172.21.15.26:0/220666146 shutdown_connections 2023-10-14T11:12:27.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:27.988+0000 7fea61c9c640 1 -- 172.21.15.26:0/220666146 wait complete. 2023-10-14T11:12:28.017 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:12:28.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.164+0000 7fbd1cd2a640 1 Processor -- start 2023-10-14T11:12:28.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.164+0000 7fbd1cd2a640 1 -- start start 2023-10-14T11:12:28.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.164+0000 7fbd1cd2a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd180c8cb0 0x7fbd180cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:28.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.164+0000 7fbd1cd2a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd180723d0 con 0x7fbd18159ba0 2023-10-14T11:12:28.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.164+0000 7fbd1cd2a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd180717c0 con 0x7fbd181597c0 2023-10-14T11:12:28.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.164+0000 7fbd1cd2a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd18071aa0 con 0x7fbd180c8cb0 2023-10-14T11:12:28.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.164+0000 7fbd15d9b640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbd18159ba0 0x7fbd180cae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42456/0 (socket says 172.21.15.26:42456) 2023-10-14T11:12:28.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.164+0000 7fbd15d9b640 1 -- 172.21.15.26:0/4280991958 learned_addr learned my addr 172.21.15.26:0/4280991958 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:28.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.164+0000 7fbd16d9d640 1 --2- 172.21.15.26:0/4280991958 >> v2:172.21.15.26:3300/0 conn(0x7fbd180c8cb0 0x7fbd180cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:28.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.164+0000 7fbd1559a640 1 -- 172.21.15.26:0/4280991958 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038409607 0 0) 0x7fbd180723d0 con 0x7fbd18159ba0 2023-10-14T11:12:28.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.164+0000 7fbd16d9d640 1 -- 172.21.15.26:0/4280991958 >> v1:172.21.15.110:6789/0 conn(0x7fbd181597c0 legacy=0x7fbd180ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:28.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.164+0000 7fbd16d9d640 1 -- 172.21.15.26:0/4280991958 >> v1:172.21.15.26:6789/0 conn(0x7fbd18159ba0 legacy=0x7fbd180cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:28.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.164+0000 7fbd16d9d640 1 -- 172.21.15.26:0/4280991958 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd18071d80 con 0x7fbd180c8cb0 2023-10-14T11:12:28.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.168+0000 7fbd16d9d640 1 --2- 172.21.15.26:0/4280991958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd180c8cb0 0x7fbd180cb520 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009d90 tx=0x7fbd1001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6802e47d0bc3b611 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:28.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.168+0000 7fbd1559a640 1 -- 172.21.15.26:0/4280991958 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd100a5970 con 0x7fbd180c8cb0 2023-10-14T11:12:28.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.168+0000 7fbd1559a640 1 -- 172.21.15.26:0/4280991958 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd100a5ad0 con 0x7fbd180c8cb0 2023-10-14T11:12:28.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.168+0000 7fbd1559a640 1 -- 172.21.15.26:0/4280991958 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd100a5e60 con 0x7fbd180c8cb0 2023-10-14T11:12:28.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.168+0000 7fbd1cd2a640 1 -- 172.21.15.26:0/4280991958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd180c8cb0 msgr2=0x7fbd180cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:28.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.168+0000 7fbd1cd2a640 1 --2- 172.21.15.26:0/4280991958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd180c8cb0 0x7fbd180cb520 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009d90 tx=0x7fbd1001c910 comp rx=0 tx=0).stop 2023-10-14T11:12:28.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.168+0000 7fbd1cd2a640 1 -- 172.21.15.26:0/4280991958 shutdown_connections 2023-10-14T11:12:28.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.168+0000 7fbd1cd2a640 1 --2- 172.21.15.26:0/4280991958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd180c8cb0 0x7fbd180cb520 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.168+0000 7fbd1cd2a640 1 -- 172.21.15.26:0/4280991958 >> 172.21.15.26:0/4280991958 conn(0x7fbd1806c190 msgr2=0x7fbd1806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.168+0000 7fbd1cd2a640 1 -- 172.21.15.26:0/4280991958 shutdown_connections 2023-10-14T11:12:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.168+0000 7fbd1cd2a640 1 -- 172.21.15.26:0/4280991958 wait complete. 2023-10-14T11:12:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd1cd2a640 1 Processor -- start 2023-10-14T11:12:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd1cd2a640 1 -- start start 2023-10-14T11:12:28.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd1cd2a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd180c8cb0 0x7fbd1814d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:28.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd1cd2a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd181597c0 0x7fbd1814a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:28.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd1cd2a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd18159ba0 0x7fbd18146330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:28.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd1cd2a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd18159fe0 con 0x7fbd180c8cb0 2023-10-14T11:12:28.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd1cd2a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1814ae10 con 0x7fbd18159ba0 2023-10-14T11:12:28.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd1cd2a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1814b0f0 con 0x7fbd181597c0 2023-10-14T11:12:28.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd1659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd180c8cb0 0x7fbd1814d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:28.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd1659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd180c8cb0 0x7fbd1814d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52260/0 (socket says 172.21.15.26:52260) 2023-10-14T11:12:28.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd1659c640 1 -- 172.21.15.26:0/3589888905 learned_addr learned my addr 172.21.15.26:0/3589888905 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:28.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd16d9d640 1 --2- 172.21.15.26:0/3589888905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd18159ba0 0x7fbd18146330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:28.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd15d9b640 1 --2- 172.21.15.26:0/3589888905 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd181597c0 0x7fbd1814a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:28.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd1659c640 1 -- 172.21.15.26:0/3589888905 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd181597c0 msgr2=0x7fbd1814a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:28.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd1659c640 1 --2- 172.21.15.26:0/3589888905 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd181597c0 0x7fbd1814a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd1659c640 1 -- 172.21.15.26:0/3589888905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd18159ba0 msgr2=0x7fbd18146330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:28.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd1659c640 1 --2- 172.21.15.26:0/3589888905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd18159ba0 0x7fbd18146330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd1659c640 1 -- 172.21.15.26:0/3589888905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd10009a70 con 0x7fbd180c8cb0 2023-10-14T11:12:28.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd16d9d640 1 --2- 172.21.15.26:0/3589888905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd18159ba0 0x7fbd18146330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:28.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd15d9b640 1 --2- 172.21.15.26:0/3589888905 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd181597c0 0x7fbd1814a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:28.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd1659c640 1 --2- 172.21.15.26:0/3589888905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd180c8cb0 0x7fbd1814d370 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbd0800c450 tx=0x7fbd0800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:28.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd06ffd640 1 -- 172.21.15.26:0/3589888905 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd08012830 con 0x7fbd180c8cb0 2023-10-14T11:12:28.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd06ffd640 1 -- 172.21.15.26:0/3589888905 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd080129b0 con 0x7fbd180c8cb0 2023-10-14T11:12:28.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd06ffd640 1 -- 172.21.15.26:0/3589888905 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd08012d60 con 0x7fbd180c8cb0 2023-10-14T11:12:28.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd1cd2a640 1 -- 172.21.15.26:0/3589888905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1814b3d0 con 0x7fbd180c8cb0 2023-10-14T11:12:28.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd1cd2a640 1 -- 172.21.15.26:0/3589888905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1814d8b0 con 0x7fbd180c8cb0 2023-10-14T11:12:28.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.172+0000 7fbd1cd2a640 1 -- 172.21.15.26:0/3589888905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd1815a150 con 0x7fbd180c8cb0 2023-10-14T11:12:28.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.176+0000 7fbd06ffd640 1 -- 172.21.15.26:0/3589888905 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbd0801c460 con 0x7fbd180c8cb0 2023-10-14T11:12:28.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.176+0000 7fbd06ffd640 1 --2- 172.21.15.26:0/3589888905 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbcf80664a0 0x7fbcf8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:28.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.176+0000 7fbd06ffd640 1 -- 172.21.15.26:0/3589888905 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbd08084080 con 0x7fbd180c8cb0 2023-10-14T11:12:28.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.176+0000 7fbd15d9b640 1 --2- 172.21.15.26:0/3589888905 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbcf80664a0 0x7fbcf8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:28.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.176+0000 7fbd15d9b640 1 --2- 172.21.15.26:0/3589888905 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbcf80664a0 0x7fbcf8068960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbd18156d70 tx=0x7fbd0c007c20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:28.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.180+0000 7fbd06ffd640 1 -- 172.21.15.26:0/3589888905 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbd080b5090 con 0x7fbd180c8cb0 2023-10-14T11:12:28.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.368+0000 7fbd1cd2a640 1 -- 172.21.15.26:0/3589888905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd18074010 con 0x7fbd180c8cb0 2023-10-14T11:12:28.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.368+0000 7fbd06ffd640 1 -- 172.21.15.26:0/3589888905 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4915 (secure 0 0 0) 0x7fbd08051170 con 0x7fbd180c8cb0 2023-10-14T11:12:28.371 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:28.371 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/2685368784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2685368784},{"type":"v1","addr":"172.21.15.110:6834","nonce":2685368784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6836/4242453713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":4242453713},{"type":"v1","addr":"172.21.15.26:6836","nonce":4242453713}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3507761146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":3507761146},{"type":"v1","addr":"172.21.15.26:6837","nonce":3507761146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:12:22.355867+0000","modified":"2023-10-14T11:12:27.399160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3522025152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3522025152},{"type":"v1","addr":"172.21.15.110:6835","nonce":3522025152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-14T11:12:28.371 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 7 2023-10-14T11:12:28.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.368+0000 7fbd1cd2a640 1 -- 172.21.15.26:0/3589888905 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbcf80664a0 msgr2=0x7fbcf8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:28.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.368+0000 7fbd1cd2a640 1 --2- 172.21.15.26:0/3589888905 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbcf80664a0 0x7fbcf8068960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbd18156d70 tx=0x7fbd0c007c20 comp rx=0 tx=0).stop 2023-10-14T11:12:28.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.368+0000 7fbd1cd2a640 1 -- 172.21.15.26:0/3589888905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd180c8cb0 msgr2=0x7fbd1814d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:28.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.368+0000 7fbd1cd2a640 1 --2- 172.21.15.26:0/3589888905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd180c8cb0 0x7fbd1814d370 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbd0800c450 tx=0x7fbd0800c910 comp rx=0 tx=0).stop 2023-10-14T11:12:28.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.368+0000 7fbd1cd2a640 1 -- 172.21.15.26:0/3589888905 shutdown_connections 2023-10-14T11:12:28.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.368+0000 7fbd1cd2a640 1 --2- 172.21.15.26:0/3589888905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd18159ba0 0x7fbd18146330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.368+0000 7fbd1cd2a640 1 --2- 172.21.15.26:0/3589888905 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd181597c0 0x7fbd1814a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.368+0000 7fbd1cd2a640 1 --2- 172.21.15.26:0/3589888905 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbcf80664a0 0x7fbcf8068960 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.368+0000 7fbd1cd2a640 1 --2- 172.21.15.26:0/3589888905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd180c8cb0 0x7fbd1814d370 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.368+0000 7fbd1cd2a640 1 -- 172.21.15.26:0/3589888905 >> 172.21.15.26:0/3589888905 conn(0x7fbd1806c190 msgr2=0x7fbd180ae460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:28.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.368+0000 7fbd1cd2a640 1 -- 172.21.15.26:0/3589888905 shutdown_connections 2023-10-14T11:12:28.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.368+0000 7fbd1cd2a640 1 -- 172.21.15.26:0/3589888905 wait complete. 2023-10-14T11:12:28.393 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:12:28.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.532+0000 7f5e64180640 1 Processor -- start 2023-10-14T11:12:28.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.532+0000 7f5e64180640 1 -- start start 2023-10-14T11:12:28.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.532+0000 7f5e64180640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e5c0d15d0 0x7f5e5c0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:28.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.532+0000 7f5e64180640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5e5c0d3010 0x7f5e5c0c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:28.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.532+0000 7f5e64180640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e5c0ce770 con 0x7f5e5c15cb90 2023-10-14T11:12:28.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.532+0000 7f5e64180640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5c0d0600 con 0x7f5e5c0d3010 2023-10-14T11:12:28.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.532+0000 7f5e64180640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c0c6450 con 0x7f5e5c0d15d0 2023-10-14T11:12:28.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.532+0000 7f5e61f1c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5e5c15cb90 0x7f5e5c0d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42464/0 (socket says 172.21.15.26:42464) 2023-10-14T11:12:28.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.532+0000 7f5e61f1c640 1 -- 172.21.15.26:0/2793673788 learned_addr learned my addr 172.21.15.26:0/2793673788 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:28.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.532+0000 7f5e6271d640 1 --2- 172.21.15.26:0/2793673788 >> v2:172.21.15.110:3300/0 conn(0x7f5e5c0d3010 0x7f5e5c0c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:28.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.532+0000 7f5e6171b640 1 --2- 172.21.15.26:0/2793673788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e5c0d15d0 0x7f5e5c0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:28.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.532+0000 7f5e60f1a640 1 -- 172.21.15.26:0/2793673788 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256234602 0 0) 0x7f5e5c0ce770 con 0x7f5e5c15cb90 2023-10-14T11:12:28.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.532+0000 7f5e60f1a640 1 -- 172.21.15.26:0/2793673788 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e48003530 con 0x7f5e5c15cb90 2023-10-14T11:12:28.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.532+0000 7f5e6171b640 1 -- 172.21.15.26:0/2793673788 >> v2:172.21.15.110:3300/0 conn(0x7f5e5c0d3010 msgr2=0x7f5e5c0c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:28.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.532+0000 7f5e6171b640 1 --2- 172.21.15.26:0/2793673788 >> v2:172.21.15.110:3300/0 conn(0x7f5e5c0d3010 0x7f5e5c0c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.532+0000 7f5e6171b640 1 -- 172.21.15.26:0/2793673788 >> v1:172.21.15.26:6789/0 conn(0x7f5e5c15cb90 legacy=0x7f5e5c0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:28.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.532+0000 7f5e6171b640 1 -- 172.21.15.26:0/2793673788 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5c0d08a0 con 0x7f5e5c0d15d0 2023-10-14T11:12:28.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.532+0000 7f5e6271d640 1 --2- 172.21.15.26:0/2793673788 >> v2:172.21.15.110:3300/0 conn(0x7f5e5c0d3010 0x7f5e5c0c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:12:28.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.536+0000 7f5e6171b640 1 --2- 172.21.15.26:0/2793673788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e5c0d15d0 0x7f5e5c0cfb10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c0097c0 tx=0x7f5e4c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9abf82ff3b6706a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:28.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.536+0000 7f5e60f1a640 1 -- 172.21.15.26:0/2793673788 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c0ac620 con 0x7f5e5c0d15d0 2023-10-14T11:12:28.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.536+0000 7f5e60f1a640 1 -- 172.21.15.26:0/2793673788 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4c0ac780 con 0x7f5e5c0d15d0 2023-10-14T11:12:28.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.536+0000 7f5e60f1a640 1 -- 172.21.15.26:0/2793673788 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c0acb10 con 0x7f5e5c0d15d0 2023-10-14T11:12:28.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.536+0000 7f5e64180640 1 -- 172.21.15.26:0/2793673788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e5c0d15d0 msgr2=0x7f5e5c0cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:28.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.536+0000 7f5e64180640 1 --2- 172.21.15.26:0/2793673788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e5c0d15d0 0x7f5e5c0cfb10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c0097c0 tx=0x7f5e4c01c3c0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.536+0000 7f5e64180640 1 -- 172.21.15.26:0/2793673788 shutdown_connections 2023-10-14T11:12:28.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.536+0000 7f5e64180640 1 --2- 172.21.15.26:0/2793673788 >> v2:172.21.15.110:3300/0 conn(0x7f5e5c0d3010 0x7f5e5c0c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.536+0000 7f5e64180640 1 --2- 172.21.15.26:0/2793673788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e5c0d15d0 0x7f5e5c0cfb10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.536+0000 7f5e64180640 1 -- 172.21.15.26:0/2793673788 >> 172.21.15.26:0/2793673788 conn(0x7f5e5c09bc50 msgr2=0x7f5e5c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:28.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e64180640 1 -- 172.21.15.26:0/2793673788 shutdown_connections 2023-10-14T11:12:28.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e64180640 1 -- 172.21.15.26:0/2793673788 wait complete. 2023-10-14T11:12:28.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e64180640 1 Processor -- start 2023-10-14T11:12:28.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e64180640 1 -- start start 2023-10-14T11:12:28.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e64180640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e5c0d15d0 0x7f5e5c156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:28.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e64180640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e5c0d3010 0x7f5e5c157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:28.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e64180640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e5c15cb90 0x7f5e5c152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:28.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e64180640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c0b5f30 con 0x7f5e5c0d15d0 2023-10-14T11:12:28.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e64180640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c0b6c50 con 0x7f5e5c0d3010 2023-10-14T11:12:28.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e64180640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c0b6180 con 0x7f5e5c15cb90 2023-10-14T11:12:28.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e61f1c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e5c0d15d0 0x7f5e5c156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:28.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e61f1c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e5c0d15d0 0x7f5e5c156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52276/0 (socket says 172.21.15.26:52276) 2023-10-14T11:12:28.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e61f1c640 1 -- 172.21.15.26:0/334850730 learned_addr learned my addr 172.21.15.26:0/334850730 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:28.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e6271d640 1 --2- 172.21.15.26:0/334850730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e5c15cb90 0x7f5e5c152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:28.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e61f1c640 1 -- 172.21.15.26:0/334850730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e5c15cb90 msgr2=0x7f5e5c152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:28.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e6171b640 1 --2- 172.21.15.26:0/334850730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e5c0d3010 0x7f5e5c157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:28.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e61f1c640 1 --2- 172.21.15.26:0/334850730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e5c15cb90 0x7f5e5c152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e61f1c640 1 -- 172.21.15.26:0/334850730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e5c0d3010 msgr2=0x7f5e5c157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:28.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e61f1c640 1 --2- 172.21.15.26:0/334850730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e5c0d3010 0x7f5e5c157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e61f1c640 1 -- 172.21.15.26:0/334850730 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e54009a70 con 0x7f5e5c0d15d0 2023-10-14T11:12:28.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e6271d640 1 --2- 172.21.15.26:0/334850730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e5c15cb90 0x7f5e5c152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:28.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e6171b640 1 --2- 172.21.15.26:0/334850730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e5c0d3010 0x7f5e5c157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:28.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e61f1c640 1 --2- 172.21.15.26:0/334850730 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e5c0d15d0 0x7f5e5c156060 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5e58001270 tx=0x7f5e5800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:28.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e527fc640 1 -- 172.21.15.26:0/334850730 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e580074e0 con 0x7f5e5c0d15d0 2023-10-14T11:12:28.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e527fc640 1 -- 172.21.15.26:0/334850730 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e58007640 con 0x7f5e5c0d15d0 2023-10-14T11:12:28.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e527fc640 1 -- 172.21.15.26:0/334850730 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e580059b0 con 0x7f5e5c0d15d0 2023-10-14T11:12:28.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.540+0000 7f5e64180640 1 -- 172.21.15.26:0/334850730 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e4c009420 con 0x7f5e5c0d15d0 2023-10-14T11:12:28.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.544+0000 7f5e64180640 1 -- 172.21.15.26:0/334850730 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5c0b6740 con 0x7f5e5c0d15d0 2023-10-14T11:12:28.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.544+0000 7f5e64180640 1 -- 172.21.15.26:0/334850730 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5c074010 con 0x7f5e5c0d15d0 2023-10-14T11:12:28.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.544+0000 7f5e527fc640 1 -- 172.21.15.26:0/334850730 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5e58005b10 con 0x7f5e5c0d15d0 2023-10-14T11:12:28.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.544+0000 7f5e527fc640 1 --2- 172.21.15.26:0/334850730 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5e400664d0 0x7f5e40068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:28.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.544+0000 7f5e527fc640 1 -- 172.21.15.26:0/334850730 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5e58083750 con 0x7f5e5c0d15d0 2023-10-14T11:12:28.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.544+0000 7f5e6171b640 1 --2- 172.21.15.26:0/334850730 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5e400664d0 0x7f5e40068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:28.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.544+0000 7f5e6171b640 1 --2- 172.21.15.26:0/334850730 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5e400664d0 0x7f5e40068990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c0ae000 tx=0x7f5e4c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:28.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.548+0000 7f5e527fc640 1 -- 172.21.15.26:0/334850730 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5e580508d0 con 0x7f5e5c0d15d0 2023-10-14T11:12:28.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.708+0000 7f5e64180640 1 -- 172.21.15.26:0/334850730 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e5c06cf70 con 0x7f5e5c0d15d0 2023-10-14T11:12:28.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.708+0000 7f5e527fc640 1 -- 172.21.15.26:0/334850730 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f5e58017090 con 0x7f5e5c0d15d0 2023-10-14T11:12:28.711 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:28.712 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":25,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:12:27.398936+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:12:28.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.708+0000 7f5e64180640 1 -- 172.21.15.26:0/334850730 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5e400664d0 msgr2=0x7f5e40068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:28.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.708+0000 7f5e64180640 1 --2- 172.21.15.26:0/334850730 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5e400664d0 0x7f5e40068990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c0ae000 tx=0x7f5e4c008040 comp rx=0 tx=0).stop 2023-10-14T11:12:28.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.708+0000 7f5e64180640 1 -- 172.21.15.26:0/334850730 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e5c0d15d0 msgr2=0x7f5e5c156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:28.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.708+0000 7f5e64180640 1 --2- 172.21.15.26:0/334850730 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e5c0d15d0 0x7f5e5c156060 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5e58001270 tx=0x7f5e5800c8e0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.712+0000 7f5e64180640 1 -- 172.21.15.26:0/334850730 shutdown_connections 2023-10-14T11:12:28.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.712+0000 7f5e64180640 1 --2- 172.21.15.26:0/334850730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e5c15cb90 0x7f5e5c152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.712+0000 7f5e64180640 1 --2- 172.21.15.26:0/334850730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e5c0d3010 0x7f5e5c157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.712+0000 7f5e64180640 1 --2- 172.21.15.26:0/334850730 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5e400664d0 0x7f5e40068990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.712+0000 7f5e64180640 1 --2- 172.21.15.26:0/334850730 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e5c0d15d0 0x7f5e5c156060 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.712+0000 7f5e64180640 1 -- 172.21.15.26:0/334850730 >> 172.21.15.26:0/334850730 conn(0x7f5e5c09bc50 msgr2=0x7f5e5c0ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:28.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.712+0000 7f5e64180640 1 -- 172.21.15.26:0/334850730 shutdown_connections 2023-10-14T11:12:28.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.712+0000 7f5e64180640 1 -- 172.21.15.26:0/334850730 wait complete. 2023-10-14T11:12:28.733 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:12:28.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6ea17640 1 Processor -- start 2023-10-14T11:12:28.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6ea17640 1 -- start start 2023-10-14T11:12:28.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6ea17640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9f6815c910 0x7f9f680d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:28.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6ea17640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f680ce730 con 0x7f9f680d3170 2023-10-14T11:12:28.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6ea17640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f680d0dd0 con 0x7f9f680cefe0 2023-10-14T11:12:28.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6ea17640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f680ce540 con 0x7f9f6815c910 2023-10-14T11:12:28.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6d214640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9f680d3170 0x7f9f680cde30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42480/0 (socket says 172.21.15.26:42480) 2023-10-14T11:12:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6d214640 1 -- 172.21.15.26:0/2127656382 learned_addr learned my addr 172.21.15.26:0/2127656382 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:28.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6da15640 1 --2- 172.21.15.26:0/2127656382 >> v2:172.21.15.110:3300/0 conn(0x7f9f6815c910 0x7f9f680d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:28.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6ca13640 1 -- 172.21.15.26:0/2127656382 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773706483 0 0) 0x7f9f680ce730 con 0x7f9f680d3170 2023-10-14T11:12:28.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6ca13640 1 -- 172.21.15.26:0/2127656382 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f54003530 con 0x7f9f680d3170 2023-10-14T11:12:28.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6ca13640 1 -- 172.21.15.26:0/2127656382 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2793445014 0 0) 0x7f9f54003530 con 0x7f9f680d3170 2023-10-14T11:12:28.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6ca13640 1 -- 172.21.15.26:0/2127656382 >> v2:172.21.15.110:3300/0 conn(0x7f9f6815c910 msgr2=0x7f9f680d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:28.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6ca13640 1 --2- 172.21.15.26:0/2127656382 >> v2:172.21.15.110:3300/0 conn(0x7f9f6815c910 0x7f9f680d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6ca13640 1 -- 172.21.15.26:0/2127656382 >> v1:172.21.15.110:6789/0 conn(0x7f9f680cefe0 legacy=0x7f9f6806b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:28.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6ca13640 1 -- 172.21.15.26:0/2127656382 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f680d04a0 con 0x7f9f680d3170 2023-10-14T11:12:28.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6ca13640 1 -- 172.21.15.26:0/2127656382 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f9f58001680 con 0x7f9f680d3170 2023-10-14T11:12:28.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6ca13640 1 -- 172.21.15.26:0/2127656382 >> v1:172.21.15.26:6789/0 conn(0x7f9f680d3170 legacy=0x7f9f680cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:28.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6ca13640 1 --2- 172.21.15.26:0/2127656382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f54003a60 0x7f9f54003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:28.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6ca13640 1 --2- 172.21.15.26:0/2127656382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f540047d0 0x7f9f54004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:28.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6ca13640 1 --2- 172.21.15.26:0/2127656382 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f54005260 0x7f9f5400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:28.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6ca13640 1 -- 172.21.15.26:0/2127656382 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5400c180 con 0x7f9f540047d0 2023-10-14T11:12:28.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6ca13640 1 -- 172.21.15.26:0/2127656382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5400c2f0 con 0x7f9f54003a60 2023-10-14T11:12:28.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6ca13640 1 -- 172.21.15.26:0/2127656382 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5400c4b0 con 0x7f9f54005260 2023-10-14T11:12:28.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6d214640 1 --2- 172.21.15.26:0/2127656382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f540047d0 0x7f9f54004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:28.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6e216640 1 --2- 172.21.15.26:0/2127656382 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f54005260 0x7f9f5400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:28.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6da15640 1 --2- 172.21.15.26:0/2127656382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f54003a60 0x7f9f54003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:28.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6d214640 1 -- 172.21.15.26:0/2127656382 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f54005260 msgr2=0x7f9f5400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:28.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6d214640 1 --2- 172.21.15.26:0/2127656382 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f54005260 0x7f9f5400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6d214640 1 -- 172.21.15.26:0/2127656382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f54003a60 msgr2=0x7f9f54003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:28.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6d214640 1 --2- 172.21.15.26:0/2127656382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f54003a60 0x7f9f54003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6d214640 1 -- 172.21.15.26:0/2127656382 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f54003530 con 0x7f9f540047d0 2023-10-14T11:12:28.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6e216640 1 -- 172.21.15.26:0/2127656382 reap_dead start 2023-10-14T11:12:28.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.876+0000 7f9f6da15640 1 --2- 172.21.15.26:0/2127656382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f54003a60 0x7f9f54003e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:28.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.880+0000 7f9f6d214640 1 --2- 172.21.15.26:0/2127656382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f540047d0 0x7f9f54004c50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800c190 tx=0x7f9f5801cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda8c92391bb14ad server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:28.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.880+0000 7f9f6ca13640 1 -- 172.21.15.26:0/2127656382 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f58005ae0 con 0x7f9f540047d0 2023-10-14T11:12:28.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.880+0000 7f9f6ca13640 1 -- 172.21.15.26:0/2127656382 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f58005c40 con 0x7f9f540047d0 2023-10-14T11:12:28.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.880+0000 7f9f6ca13640 1 -- 172.21.15.26:0/2127656382 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f580a5a90 con 0x7f9f540047d0 2023-10-14T11:12:28.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.880+0000 7f9f6ea17640 1 -- 172.21.15.26:0/2127656382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f540047d0 msgr2=0x7f9f54004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:28.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.880+0000 7f9f6ea17640 1 --2- 172.21.15.26:0/2127656382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f540047d0 0x7f9f54004c50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800c190 tx=0x7f9f5801cbd0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.880+0000 7f9f6ea17640 1 -- 172.21.15.26:0/2127656382 shutdown_connections 2023-10-14T11:12:28.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.880+0000 7f9f6ea17640 1 --2- 172.21.15.26:0/2127656382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f540047d0 0x7f9f54004c50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.880+0000 7f9f6ea17640 1 -- 172.21.15.26:0/2127656382 >> 172.21.15.26:0/2127656382 conn(0x7f9f6809bb50 msgr2=0x7f9f680d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:28.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.880+0000 7f9f6ea17640 1 -- 172.21.15.26:0/2127656382 shutdown_connections 2023-10-14T11:12:28.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.880+0000 7f9f6ea17640 1 -- 172.21.15.26:0/2127656382 wait complete. 2023-10-14T11:12:28.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f6ea17640 1 Processor -- start 2023-10-14T11:12:28.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f6ea17640 1 -- start start 2023-10-14T11:12:28.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f6ea17640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f540047d0 0x7f9f680c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:28.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f6ea17640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f6809d490 0x7f9f680c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:28.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f6ea17640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f681f4c40 0x7f9f680b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:28.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f6ea17640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6809e780 con 0x7f9f681f4c40 2023-10-14T11:12:28.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f6ea17640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6809d910 con 0x7f9f6809d490 2023-10-14T11:12:28.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f6ea17640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6809db70 con 0x7f9f540047d0 2023-10-14T11:12:28.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f6e216640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f681f4c40 0x7f9f680b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:28.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f6e216640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f681f4c40 0x7f9f680b33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52290/0 (socket says 172.21.15.26:52290) 2023-10-14T11:12:28.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f6e216640 1 -- 172.21.15.26:0/3714653126 learned_addr learned my addr 172.21.15.26:0/3714653126 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:28.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f6da15640 1 --2- 172.21.15.26:0/3714653126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f540047d0 0x7f9f680c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:28.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f6d214640 1 --2- 172.21.15.26:0/3714653126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f6809d490 0x7f9f680c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:28.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f6e216640 1 -- 172.21.15.26:0/3714653126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f540047d0 msgr2=0x7f9f680c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:28.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f6e216640 1 --2- 172.21.15.26:0/3714653126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f540047d0 0x7f9f680c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f6e216640 1 -- 172.21.15.26:0/3714653126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f6809d490 msgr2=0x7f9f680c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:28.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f6e216640 1 --2- 172.21.15.26:0/3714653126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f6809d490 0x7f9f680c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:28.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f6e216640 1 -- 172.21.15.26:0/3714653126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6809de50 con 0x7f9f681f4c40 2023-10-14T11:12:28.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f6e216640 1 --2- 172.21.15.26:0/3714653126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f681f4c40 0x7f9f680b33f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9f680d38a0 tx=0x7f9f6000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:28.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f5e7fc640 1 -- 172.21.15.26:0/3714653126 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f60003980 con 0x7f9f681f4c40 2023-10-14T11:12:28.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f5e7fc640 1 -- 172.21.15.26:0/3714653126 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f60003b00 con 0x7f9f681f4c40 2023-10-14T11:12:28.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f5e7fc640 1 -- 172.21.15.26:0/3714653126 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f600050d0 con 0x7f9f681f4c40 2023-10-14T11:12:28.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f6ea17640 1 -- 172.21.15.26:0/3714653126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f6809e130 con 0x7f9f681f4c40 2023-10-14T11:12:28.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.884+0000 7f9f6ea17640 1 -- 172.21.15.26:0/3714653126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f680c8270 con 0x7f9f681f4c40 2023-10-14T11:12:28.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.888+0000 7f9f6ea17640 1 -- 172.21.15.26:0/3714653126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f6804e9c0 con 0x7f9f681f4c40 2023-10-14T11:12:28.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.888+0000 7f9f5e7fc640 1 -- 172.21.15.26:0/3714653126 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9f60005230 con 0x7f9f681f4c40 2023-10-14T11:12:28.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.888+0000 7f9f5e7fc640 1 --2- 172.21.15.26:0/3714653126 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9f4c0664a0 0x7f9f4c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:28.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.888+0000 7f9f5e7fc640 1 -- 172.21.15.26:0/3714653126 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9f60083f70 con 0x7f9f681f4c40 2023-10-14T11:12:28.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.888+0000 7f9f6da15640 1 --2- 172.21.15.26:0/3714653126 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9f4c0664a0 0x7f9f4c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:28.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.888+0000 7f9f6da15640 1 --2- 172.21.15.26:0/3714653126 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9f4c0664a0 0x7f9f4c068960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9f68074c60 tx=0x7f9f64008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:28.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:28.892+0000 7f9f5e7fc640 1 -- 172.21.15.26:0/3714653126 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9f600510f0 con 0x7f9f681f4c40 2023-10-14T11:12:29.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.052+0000 7f9f6ea17640 1 -- 172.21.15.26:0/3714653126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f6809e8c0 con 0x7f9f681f4c40 2023-10-14T11:12:29.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.052+0000 7f9f5e7fc640 1 -- 172.21.15.26:0/3714653126 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f9f60054710 con 0x7f9f681f4c40 2023-10-14T11:12:29.056 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:29.057 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":25,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:12:27.398936+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:12:29.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.056+0000 7f9f6ea17640 1 -- 172.21.15.26:0/3714653126 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9f4c0664a0 msgr2=0x7f9f4c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:29.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.056+0000 7f9f6ea17640 1 --2- 172.21.15.26:0/3714653126 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9f4c0664a0 0x7f9f4c068960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9f68074c60 tx=0x7f9f64008040 comp rx=0 tx=0).stop 2023-10-14T11:12:29.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.056+0000 7f9f6ea17640 1 -- 172.21.15.26:0/3714653126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f681f4c40 msgr2=0x7f9f680b33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:29.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.056+0000 7f9f6ea17640 1 --2- 172.21.15.26:0/3714653126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f681f4c40 0x7f9f680b33f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9f680d38a0 tx=0x7f9f6000ec10 comp rx=0 tx=0).stop 2023-10-14T11:12:29.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.056+0000 7f9f6ea17640 1 -- 172.21.15.26:0/3714653126 shutdown_connections 2023-10-14T11:12:29.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.056+0000 7f9f6ea17640 1 --2- 172.21.15.26:0/3714653126 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9f4c0664a0 0x7f9f4c068960 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.056+0000 7f9f6ea17640 1 --2- 172.21.15.26:0/3714653126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f681f4c40 0x7f9f680b33f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.056+0000 7f9f6ea17640 1 --2- 172.21.15.26:0/3714653126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f6809d490 0x7f9f680c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.056+0000 7f9f6ea17640 1 --2- 172.21.15.26:0/3714653126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f540047d0 0x7f9f680c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.056+0000 7f9f6ea17640 1 -- 172.21.15.26:0/3714653126 >> 172.21.15.26:0/3714653126 conn(0x7f9f6809bb50 msgr2=0x7f9f680af8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:29.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.056+0000 7f9f6ea17640 1 -- 172.21.15.26:0/3714653126 shutdown_connections 2023-10-14T11:12:29.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.056+0000 7f9f6ea17640 1 -- 172.21.15.26:0/3714653126 wait complete. 2023-10-14T11:12:29.094 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:12:29.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.236+0000 7fb066068640 1 Processor -- start 2023-10-14T11:12:29.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.236+0000 7fb066068640 1 -- start start 2023-10-14T11:12:29.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.236+0000 7fb066068640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb06015cb90 0x7fb0600cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:29.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.236+0000 7fb066068640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb0600d3010 0x7fb0600d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:29.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.236+0000 7fb066068640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0600d1850 con 0x7fb0600d1400 2023-10-14T11:12:29.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.236+0000 7fb066068640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0600ce770 con 0x7fb0600d3010 2023-10-14T11:12:29.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.236+0000 7fb066068640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0600d0600 con 0x7fb06015cb90 2023-10-14T11:12:29.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.236+0000 7fb05effd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb0600d3010 0x7fb0600d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:29.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.236+0000 7fb05ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb0600d1400 0x7fb0600cd3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42496/0 (socket says 172.21.15.26:42496) 2023-10-14T11:12:29.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.236+0000 7fb05ffff640 1 -- 172.21.15.26:0/3882686646 learned_addr learned my addr 172.21.15.26:0/3882686646 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:29.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.236+0000 7fb05effd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb0600d3010 0x7fb0600d0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52300/0 (socket says 172.21.15.26:52300) 2023-10-14T11:12:29.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.236+0000 7fb05f7fe640 1 --2- 172.21.15.26:0/3882686646 >> v2:172.21.15.110:3300/0 conn(0x7fb06015cb90 0x7fb0600cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:29.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.236+0000 7fb05effd640 1 -- 172.21.15.26:0/3882686646 >> v2:172.21.15.110:3300/0 conn(0x7fb06015cb90 msgr2=0x7fb0600cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:29.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.236+0000 7fb05effd640 1 --2- 172.21.15.26:0/3882686646 >> v2:172.21.15.110:3300/0 conn(0x7fb06015cb90 0x7fb0600cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.236+0000 7fb05effd640 1 -- 172.21.15.26:0/3882686646 >> v1:172.21.15.26:6789/0 conn(0x7fb0600d1400 legacy=0x7fb0600cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:29.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.236+0000 7fb05effd640 1 -- 172.21.15.26:0/3882686646 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0600c6450 con 0x7fb0600d3010 2023-10-14T11:12:29.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.236+0000 7fb05f7fe640 1 --2- 172.21.15.26:0/3882686646 >> v2:172.21.15.110:3300/0 conn(0x7fb06015cb90 0x7fb0600cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:29.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.236+0000 7fb05e7fc640 1 -- 172.21.15.26:0/3882686646 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015833817 0 0) 0x7fb0580014a0 con 0x7fb0600d1400 2023-10-14T11:12:29.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.240+0000 7fb05effd640 1 --2- 172.21.15.26:0/3882686646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0600d3010 0x7fb0600d0ec0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb06008ba70 tx=0x7fb05401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd4d927c0a69cca server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:29.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.240+0000 7fb05e7fc640 1 -- 172.21.15.26:0/3882686646 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0540ac600 con 0x7fb0600d3010 2023-10-14T11:12:29.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.240+0000 7fb05e7fc640 1 -- 172.21.15.26:0/3882686646 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0540a8050 con 0x7fb0600d3010 2023-10-14T11:12:29.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.240+0000 7fb05e7fc640 1 -- 172.21.15.26:0/3882686646 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0540ac980 con 0x7fb0600d3010 2023-10-14T11:12:29.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.240+0000 7fb066068640 1 -- 172.21.15.26:0/3882686646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0600d3010 msgr2=0x7fb0600d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:29.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.240+0000 7fb066068640 1 --2- 172.21.15.26:0/3882686646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0600d3010 0x7fb0600d0ec0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb06008ba70 tx=0x7fb05401c3a0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.240+0000 7fb066068640 1 -- 172.21.15.26:0/3882686646 shutdown_connections 2023-10-14T11:12:29.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.240+0000 7fb066068640 1 --2- 172.21.15.26:0/3882686646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0600d3010 0x7fb0600d0ec0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.240+0000 7fb066068640 1 --2- 172.21.15.26:0/3882686646 >> v2:172.21.15.110:3300/0 conn(0x7fb06015cb90 0x7fb0600cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.240+0000 7fb066068640 1 -- 172.21.15.26:0/3882686646 >> 172.21.15.26:0/3882686646 conn(0x7fb06009bc50 msgr2=0x7fb0600d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:29.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.240+0000 7fb066068640 1 -- 172.21.15.26:0/3882686646 shutdown_connections 2023-10-14T11:12:29.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.240+0000 7fb066068640 1 -- 172.21.15.26:0/3882686646 wait complete. 2023-10-14T11:12:29.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb066068640 1 Processor -- start 2023-10-14T11:12:29.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb066068640 1 -- start start 2023-10-14T11:12:29.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb066068640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0600d1400 0x7fb060156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:29.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb066068640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0600d3010 0x7fb060158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:29.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb066068640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb06015cb90 0x7fb060154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:29.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb066068640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb060158150 con 0x7fb0600d1400 2023-10-14T11:12:29.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb066068640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb060158ab0 con 0x7fb0600d3010 2023-10-14T11:12:29.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb066068640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0601574d0 con 0x7fb06015cb90 2023-10-14T11:12:29.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb05f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0600d1400 0x7fb060156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:29.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb05f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0600d1400 0x7fb060156ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52302/0 (socket says 172.21.15.26:52302) 2023-10-14T11:12:29.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb05f7fe640 1 -- 172.21.15.26:0/1860508871 learned_addr learned my addr 172.21.15.26:0/1860508871 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:29.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb05effd640 1 --2- 172.21.15.26:0/1860508871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0600d3010 0x7fb060158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:29.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb05ffff640 1 --2- 172.21.15.26:0/1860508871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb06015cb90 0x7fb060154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:29.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb05f7fe640 1 -- 172.21.15.26:0/1860508871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb06015cb90 msgr2=0x7fb060154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:29.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb05f7fe640 1 --2- 172.21.15.26:0/1860508871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb06015cb90 0x7fb060154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb05f7fe640 1 -- 172.21.15.26:0/1860508871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0600d3010 msgr2=0x7fb060158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:29.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb05f7fe640 1 --2- 172.21.15.26:0/1860508871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0600d3010 0x7fb060158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb05f7fe640 1 -- 172.21.15.26:0/1860508871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb054009420 con 0x7fb0600d1400 2023-10-14T11:12:29.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb05ffff640 1 --2- 172.21.15.26:0/1860508871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb06015cb90 0x7fb060154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:29.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb05f7fe640 1 --2- 172.21.15.26:0/1860508871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0600d1400 0x7fb060156ef0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb05000e730 tx=0x7fb05000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:29.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb047fff640 1 -- 172.21.15.26:0/1860508871 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb050005ba0 con 0x7fb0600d1400 2023-10-14T11:12:29.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb047fff640 1 -- 172.21.15.26:0/1860508871 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb050005d00 con 0x7fb0600d1400 2023-10-14T11:12:29.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb047fff640 1 -- 172.21.15.26:0/1860508871 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb050004250 con 0x7fb0600d1400 2023-10-14T11:12:29.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb066068640 1 -- 172.21.15.26:0/1860508871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0601577b0 con 0x7fb0600d1400 2023-10-14T11:12:29.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.244+0000 7fb066068640 1 -- 172.21.15.26:0/1860508871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb060157d70 con 0x7fb0600d1400 2023-10-14T11:12:29.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.248+0000 7fb066068640 1 -- 172.21.15.26:0/1860508871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb060074010 con 0x7fb0600d1400 2023-10-14T11:12:29.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.248+0000 7fb047fff640 1 -- 172.21.15.26:0/1860508871 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb0500043b0 con 0x7fb0600d1400 2023-10-14T11:12:29.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.248+0000 7fb047fff640 1 --2- 172.21.15.26:0/1860508871 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb04c0664a0 0x7fb04c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:29.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.248+0000 7fb047fff640 1 -- 172.21.15.26:0/1860508871 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb050084080 con 0x7fb0600d1400 2023-10-14T11:12:29.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.248+0000 7fb05effd640 1 --2- 172.21.15.26:0/1860508871 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb04c0664a0 0x7fb04c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:29.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.248+0000 7fb05effd640 1 --2- 172.21.15.26:0/1860508871 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb04c0664a0 0x7fb04c068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb0540ae000 tx=0x7fb0540a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:29.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.252+0000 7fb047fff640 1 -- 172.21.15.26:0/1860508871 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb0500512a0 con 0x7fb0600d1400 2023-10-14T11:12:29.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.444+0000 7fb066068640 1 -- 172.21.15.26:0/1860508871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb060154bb0 con 0x7fb0600d1400 2023-10-14T11:12:29.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.444+0000 7fb047fff640 1 -- 172.21.15.26:0/1860508871 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4915 (secure 0 0 0) 0x7fb0500548c0 con 0x7fb0600d1400 2023-10-14T11:12:29.447 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:29.447 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/2685368784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2685368784},{"type":"v1","addr":"172.21.15.110:6834","nonce":2685368784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6836/4242453713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":4242453713},{"type":"v1","addr":"172.21.15.26:6836","nonce":4242453713}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3507761146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":3507761146},{"type":"v1","addr":"172.21.15.26:6837","nonce":3507761146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:12:22.355867+0000","modified":"2023-10-14T11:12:27.399160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3522025152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3522025152},{"type":"v1","addr":"172.21.15.110:6835","nonce":3522025152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-14T11:12:29.449 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 7 2023-10-14T11:12:29.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.444+0000 7fb066068640 1 -- 172.21.15.26:0/1860508871 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb04c0664a0 msgr2=0x7fb04c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:29.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.444+0000 7fb066068640 1 --2- 172.21.15.26:0/1860508871 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb04c0664a0 0x7fb04c068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb0540ae000 tx=0x7fb0540a7000 comp rx=0 tx=0).stop 2023-10-14T11:12:29.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.444+0000 7fb066068640 1 -- 172.21.15.26:0/1860508871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0600d1400 msgr2=0x7fb060156ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:29.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.444+0000 7fb066068640 1 --2- 172.21.15.26:0/1860508871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0600d1400 0x7fb060156ef0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb05000e730 tx=0x7fb05000ebf0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.444+0000 7fb066068640 1 -- 172.21.15.26:0/1860508871 shutdown_connections 2023-10-14T11:12:29.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.444+0000 7fb066068640 1 --2- 172.21.15.26:0/1860508871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb06015cb90 0x7fb060154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.444+0000 7fb066068640 1 --2- 172.21.15.26:0/1860508871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0600d3010 0x7fb060158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.444+0000 7fb066068640 1 --2- 172.21.15.26:0/1860508871 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb04c0664a0 0x7fb04c068960 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.444+0000 7fb066068640 1 --2- 172.21.15.26:0/1860508871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0600d1400 0x7fb060156ef0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.444+0000 7fb066068640 1 -- 172.21.15.26:0/1860508871 >> 172.21.15.26:0/1860508871 conn(0x7fb06009bc50 msgr2=0x7fb0600d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:29.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.444+0000 7fb066068640 1 -- 172.21.15.26:0/1860508871 shutdown_connections 2023-10-14T11:12:29.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.444+0000 7fb066068640 1 -- 172.21.15.26:0/1860508871 wait complete. 2023-10-14T11:12:29.468 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:12:29.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.608+0000 7fcb2ca9e640 1 Processor -- start 2023-10-14T11:12:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.608+0000 7fcb2ca9e640 1 -- start start 2023-10-14T11:12:29.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.608+0000 7fcb2ca9e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcb28164520 0x7fcb280ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:29.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.608+0000 7fcb2ca9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb280b07f0 0x7fcb280cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:29.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.608+0000 7fcb2ca9e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb280c96f0 con 0x7fcb280ad960 2023-10-14T11:12:29.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.608+0000 7fcb2ca9e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb28164900 con 0x7fcb28164520 2023-10-14T11:12:29.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.608+0000 7fcb2ca9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb280cb950 con 0x7fcb280b07f0 2023-10-14T11:12:29.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.612+0000 7fcb25d9b640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcb280ad960 0x7fcb280b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42510/0 (socket says 172.21.15.26:42510) 2023-10-14T11:12:29.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.612+0000 7fcb25d9b640 1 -- 172.21.15.26:0/746736145 learned_addr learned my addr 172.21.15.26:0/746736145 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:29.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.612+0000 7fcb2659c640 1 --2- 172.21.15.26:0/746736145 >> v2:172.21.15.110:3300/0 conn(0x7fcb28164520 0x7fcb280ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:29.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.612+0000 7fcb26d9d640 1 --2- 172.21.15.26:0/746736145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb280b07f0 0x7fcb280cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:29.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.612+0000 7fcb2559a640 1 -- 172.21.15.26:0/746736145 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017565507 0 0) 0x7fcb280c96f0 con 0x7fcb280ad960 2023-10-14T11:12:29.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.612+0000 7fcb2559a640 1 -- 172.21.15.26:0/746736145 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb10003530 con 0x7fcb280ad960 2023-10-14T11:12:29.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.612+0000 7fcb2659c640 1 -- 172.21.15.26:0/746736145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb280b07f0 msgr2=0x7fcb280cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:29.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.612+0000 7fcb2659c640 1 --2- 172.21.15.26:0/746736145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb280b07f0 0x7fcb280cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.612+0000 7fcb2659c640 1 -- 172.21.15.26:0/746736145 >> v1:172.21.15.26:6789/0 conn(0x7fcb280ad960 legacy=0x7fcb280b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:29.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.612+0000 7fcb2659c640 1 -- 172.21.15.26:0/746736145 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb280cbed0 con 0x7fcb28164520 2023-10-14T11:12:29.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.612+0000 7fcb2659c640 1 --2- 172.21.15.26:0/746736145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb28164520 0x7fcb280ce010 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcb180097c0 tx=0x7fcb1801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e013c77ee512c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:29.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.612+0000 7fcb2559a640 1 -- 172.21.15.26:0/746736145 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb180ab670 con 0x7fcb28164520 2023-10-14T11:12:29.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.612+0000 7fcb2559a640 1 -- 172.21.15.26:0/746736145 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb180ab7d0 con 0x7fcb28164520 2023-10-14T11:12:29.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.612+0000 7fcb2559a640 1 -- 172.21.15.26:0/746736145 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb180abb60 con 0x7fcb28164520 2023-10-14T11:12:29.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.616+0000 7fcb2ca9e640 1 -- 172.21.15.26:0/746736145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb28164520 msgr2=0x7fcb280ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:29.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.616+0000 7fcb2ca9e640 1 --2- 172.21.15.26:0/746736145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb28164520 0x7fcb280ce010 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcb180097c0 tx=0x7fcb1801c450 comp rx=0 tx=0).stop 2023-10-14T11:12:29.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.616+0000 7fcb2ca9e640 1 -- 172.21.15.26:0/746736145 shutdown_connections 2023-10-14T11:12:29.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.616+0000 7fcb2ca9e640 1 --2- 172.21.15.26:0/746736145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb280b07f0 0x7fcb280cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.616+0000 7fcb2ca9e640 1 --2- 172.21.15.26:0/746736145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb28164520 0x7fcb280ce010 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.616+0000 7fcb2ca9e640 1 -- 172.21.15.26:0/746736145 >> 172.21.15.26:0/746736145 conn(0x7fcb2806c190 msgr2=0x7fcb2806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:29.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.616+0000 7fcb2ca9e640 1 -- 172.21.15.26:0/746736145 shutdown_connections 2023-10-14T11:12:29.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.616+0000 7fcb2ca9e640 1 -- 172.21.15.26:0/746736145 wait complete. 2023-10-14T11:12:29.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.616+0000 7fcb2ca9e640 1 Processor -- start 2023-10-14T11:12:29.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.616+0000 7fcb2ca9e640 1 -- start start 2023-10-14T11:12:29.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.616+0000 7fcb2ca9e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb280ad960 0x7fcb28144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:29.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.616+0000 7fcb2ca9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb280b07f0 0x7fcb2815ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:29.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.616+0000 7fcb2ca9e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb28164520 0x7fcb2815b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:29.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.616+0000 7fcb2ca9e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb28159ab0 con 0x7fcb280ad960 2023-10-14T11:12:29.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.616+0000 7fcb2ca9e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb280c5e20 con 0x7fcb28164520 2023-10-14T11:12:29.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.616+0000 7fcb2ca9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2815dbb0 con 0x7fcb280b07f0 2023-10-14T11:12:29.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.616+0000 7fcb2659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb280ad960 0x7fcb28144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:29.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.616+0000 7fcb2659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb280ad960 0x7fcb28144d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52316/0 (socket says 172.21.15.26:52316) 2023-10-14T11:12:29.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.616+0000 7fcb2659c640 1 -- 172.21.15.26:0/3563481631 learned_addr learned my addr 172.21.15.26:0/3563481631 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:29.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.620+0000 7fcb25d9b640 1 --2- 172.21.15.26:0/3563481631 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb280b07f0 0x7fcb2815ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:29.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.620+0000 7fcb26d9d640 1 --2- 172.21.15.26:0/3563481631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb28164520 0x7fcb2815b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:29.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.620+0000 7fcb2659c640 1 -- 172.21.15.26:0/3563481631 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb280b07f0 msgr2=0x7fcb2815ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:29.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.620+0000 7fcb2659c640 1 --2- 172.21.15.26:0/3563481631 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb280b07f0 0x7fcb2815ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.620+0000 7fcb2659c640 1 -- 172.21.15.26:0/3563481631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb28164520 msgr2=0x7fcb2815b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:29.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.620+0000 7fcb2659c640 1 --2- 172.21.15.26:0/3563481631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb28164520 0x7fcb2815b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.620+0000 7fcb2659c640 1 -- 172.21.15.26:0/3563481631 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb18009420 con 0x7fcb280ad960 2023-10-14T11:12:29.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.620+0000 7fcb26d9d640 1 --2- 172.21.15.26:0/3563481631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb28164520 0x7fcb2815b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:29.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.620+0000 7fcb2659c640 1 --2- 172.21.15.26:0/3563481631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb280ad960 0x7fcb28144d00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcb180ad040 tx=0x7fcb1801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:29.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.620+0000 7fcb16ffd640 1 -- 172.21.15.26:0/3563481631 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb180bf610 con 0x7fcb280ad960 2023-10-14T11:12:29.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.620+0000 7fcb16ffd640 1 -- 172.21.15.26:0/3563481631 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb180bf770 con 0x7fcb280ad960 2023-10-14T11:12:29.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.620+0000 7fcb16ffd640 1 -- 172.21.15.26:0/3563481631 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb180bfb20 con 0x7fcb280ad960 2023-10-14T11:12:29.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.620+0000 7fcb2ca9e640 1 -- 172.21.15.26:0/3563481631 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb2815de90 con 0x7fcb280ad960 2023-10-14T11:12:29.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.620+0000 7fcb2ca9e640 1 -- 172.21.15.26:0/3563481631 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2815e450 con 0x7fcb280ad960 2023-10-14T11:12:29.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.620+0000 7fcb2ca9e640 1 -- 172.21.15.26:0/3563481631 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb280c5f90 con 0x7fcb280ad960 2023-10-14T11:12:29.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.620+0000 7fcb16ffd640 1 -- 172.21.15.26:0/3563481631 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcb180bfc80 con 0x7fcb280ad960 2023-10-14T11:12:29.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.620+0000 7fcb16ffd640 1 --2- 172.21.15.26:0/3563481631 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcb080664f0 0x7fcb080689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:29.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.620+0000 7fcb16ffd640 1 -- 172.21.15.26:0/3563481631 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcb1811ece0 con 0x7fcb280ad960 2023-10-14T11:12:29.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.624+0000 7fcb25d9b640 1 --2- 172.21.15.26:0/3563481631 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcb080664f0 0x7fcb080689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:29.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.624+0000 7fcb25d9b640 1 --2- 172.21.15.26:0/3563481631 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcb080664f0 0x7fcb080689b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcb2814bd00 tx=0x7fcb1c007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:29.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.624+0000 7fcb16ffd640 1 -- 172.21.15.26:0/3563481631 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcb180ebf70 con 0x7fcb280ad960 2023-10-14T11:12:29.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.780+0000 7fcb2ca9e640 1 -- 172.21.15.26:0/3563481631 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb28074010 con 0x7fcb280ad960 2023-10-14T11:12:29.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.784+0000 7fcb16ffd640 1 -- 172.21.15.26:0/3563481631 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fcb180ef590 con 0x7fcb280ad960 2023-10-14T11:12:29.786 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:29.787 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":25,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:12:27.398936+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:12:29.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.784+0000 7fcb2ca9e640 1 -- 172.21.15.26:0/3563481631 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcb080664f0 msgr2=0x7fcb080689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:29.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.784+0000 7fcb2ca9e640 1 --2- 172.21.15.26:0/3563481631 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcb080664f0 0x7fcb080689b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcb2814bd00 tx=0x7fcb1c007d40 comp rx=0 tx=0).stop 2023-10-14T11:12:29.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.784+0000 7fcb2ca9e640 1 -- 172.21.15.26:0/3563481631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb280ad960 msgr2=0x7fcb28144d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:29.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.784+0000 7fcb2ca9e640 1 --2- 172.21.15.26:0/3563481631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb280ad960 0x7fcb28144d00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcb180ad040 tx=0x7fcb1801ac90 comp rx=0 tx=0).stop 2023-10-14T11:12:29.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.784+0000 7fcb2ca9e640 1 -- 172.21.15.26:0/3563481631 shutdown_connections 2023-10-14T11:12:29.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.784+0000 7fcb2ca9e640 1 --2- 172.21.15.26:0/3563481631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb28164520 0x7fcb2815b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.784+0000 7fcb2ca9e640 1 --2- 172.21.15.26:0/3563481631 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb280b07f0 0x7fcb2815ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.784+0000 7fcb2ca9e640 1 --2- 172.21.15.26:0/3563481631 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcb080664f0 0x7fcb080689b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.784+0000 7fcb2ca9e640 1 --2- 172.21.15.26:0/3563481631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb280ad960 0x7fcb28144d00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:29.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.784+0000 7fcb2ca9e640 1 -- 172.21.15.26:0/3563481631 >> 172.21.15.26:0/3563481631 conn(0x7fcb2806c190 msgr2=0x7fcb280afd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:29.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.784+0000 7fcb2ca9e640 1 -- 172.21.15.26:0/3563481631 shutdown_connections 2023-10-14T11:12:29.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:29.784+0000 7fcb2ca9e640 1 -- 172.21.15.26:0/3563481631 wait complete. 2023-10-14T11:12:30.210 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T11:12:22.355867+0000', 'modified': '2023-10-14T11:12:27.399160+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.110:6835/3522025152', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6833', 'nonce': 3522025152}, {'type': 'v1', 'addr': '172.21.15.110:6835', 'nonce': 3522025152}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-10-14T11:12:30.210 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T11:12:30.211 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-14T11:12:30.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.352+0000 7efc7ca74640 1 Processor -- start 2023-10-14T11:12:30.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.352+0000 7efc7ca74640 1 -- start start 2023-10-14T11:12:30.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.356+0000 7efc7ca74640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efc7815c980 0x7efc7806af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.356+0000 7efc7ca74640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7815cd60 0x7efc780b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.356+0000 7efc7ca74640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc780d3510 con 0x7efc780d0d80 2023-10-14T11:12:30.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.356+0000 7efc7ca74640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc780cd2b0 con 0x7efc7815c980 2023-10-14T11:12:30.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.356+0000 7efc7ca74640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc780d2f50 con 0x7efc7815cd60 2023-10-14T11:12:30.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.356+0000 7efc777fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efc7815c980 0x7efc7806af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.356+0000 7efc76ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7815cd60 0x7efc780b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.356+0000 7efc76ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7815cd60 0x7efc780b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:57874/0 (socket says 172.21.15.26:57874) 2023-10-14T11:12:30.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.356+0000 7efc76ffd640 1 -- 172.21.15.26:0/2555816539 learned_addr learned my addr 172.21.15.26:0/2555816539 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:30.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.356+0000 7efc777fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efc7815c980 0x7efc7806af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:43472/0 (socket says 172.21.15.26:43472) 2023-10-14T11:12:30.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.356+0000 7efc77fff640 1 --1- 172.21.15.26:0/2555816539 >> v1:172.21.15.110:6789/0 conn(0x7efc780d0d80 0x7efc780cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:42392/0 (socket says 172.21.15.26:42392) 2023-10-14T11:12:30.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.356+0000 7efc76ffd640 1 -- 172.21.15.26:0/2555816539 >> v2:172.21.15.110:3300/0 conn(0x7efc7815c980 msgr2=0x7efc7806af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:30.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.356+0000 7efc76ffd640 1 --2- 172.21.15.26:0/2555816539 >> v2:172.21.15.110:3300/0 conn(0x7efc7815c980 0x7efc7806af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.356+0000 7efc76ffd640 1 -- 172.21.15.26:0/2555816539 >> v1:172.21.15.110:6789/0 conn(0x7efc780d0d80 legacy=0x7efc780cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:30.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.356+0000 7efc76ffd640 1 -- 172.21.15.26:0/2555816539 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc780d3230 con 0x7efc7815cd60 2023-10-14T11:12:30.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.360+0000 7efc76ffd640 1 --2- 172.21.15.26:0/2555816539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7815cd60 0x7efc780b1b90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efc6c009870 tx=0x7efc6c01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59069120982af6cf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:30.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.360+0000 7efc767fc640 1 -- 172.21.15.26:0/2555816539 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c0ab650 con 0x7efc7815cd60 2023-10-14T11:12:30.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.360+0000 7efc767fc640 1 -- 172.21.15.26:0/2555816539 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6c0ab7b0 con 0x7efc7815cd60 2023-10-14T11:12:30.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.360+0000 7efc767fc640 1 -- 172.21.15.26:0/2555816539 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c0abb40 con 0x7efc7815cd60 2023-10-14T11:12:30.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.360+0000 7efc7ca74640 1 -- 172.21.15.26:0/2555816539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7815cd60 msgr2=0x7efc780b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:30.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.360+0000 7efc7ca74640 1 --2- 172.21.15.26:0/2555816539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7815cd60 0x7efc780b1b90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efc6c009870 tx=0x7efc6c01c540 comp rx=0 tx=0).stop 2023-10-14T11:12:30.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.360+0000 7efc7ca74640 1 -- 172.21.15.26:0/2555816539 shutdown_connections 2023-10-14T11:12:30.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.360+0000 7efc7ca74640 1 --2- 172.21.15.26:0/2555816539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7815cd60 0x7efc780b1b90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.360+0000 7efc7ca74640 1 --2- 172.21.15.26:0/2555816539 >> v2:172.21.15.110:3300/0 conn(0x7efc7815c980 0x7efc7806af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.360+0000 7efc7ca74640 1 -- 172.21.15.26:0/2555816539 >> 172.21.15.26:0/2555816539 conn(0x7efc7809ba80 msgr2=0x7efc780d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:30.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.360+0000 7efc7ca74640 1 -- 172.21.15.26:0/2555816539 shutdown_connections 2023-10-14T11:12:30.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.360+0000 7efc7ca74640 1 -- 172.21.15.26:0/2555816539 wait complete. 2023-10-14T11:12:30.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.360+0000 7efc7ca74640 1 Processor -- start 2023-10-14T11:12:30.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.360+0000 7efc7ca74640 1 -- start start 2023-10-14T11:12:30.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.364+0000 7efc7ca74640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc780d0d80 0x7efc780c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.364+0000 7efc7ca74640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7815c980 0x7efc780c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.364+0000 7efc7ca74640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7815cd60 0x7efc780ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.364+0000 7efc7ca74640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc780b5f40 con 0x7efc7815c980 2023-10-14T11:12:30.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.364+0000 7efc7ca74640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc78159f90 con 0x7efc780d0d80 2023-10-14T11:12:30.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.364+0000 7efc7ca74640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc78159c60 con 0x7efc7815cd60 2023-10-14T11:12:30.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.364+0000 7efc76ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7815c980 0x7efc780c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.364+0000 7efc76ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7815c980 0x7efc780c9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52326/0 (socket says 172.21.15.26:52326) 2023-10-14T11:12:30.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.364+0000 7efc76ffd640 1 -- 172.21.15.26:0/2337342411 learned_addr learned my addr 172.21.15.26:0/2337342411 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:30.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.364+0000 7efc777fe640 1 --2- 172.21.15.26:0/2337342411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc780d0d80 0x7efc780c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.364+0000 7efc77fff640 1 --2- 172.21.15.26:0/2337342411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7815cd60 0x7efc780ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.364+0000 7efc76ffd640 1 -- 172.21.15.26:0/2337342411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7815cd60 msgr2=0x7efc780ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:30.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.364+0000 7efc76ffd640 1 --2- 172.21.15.26:0/2337342411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7815cd60 0x7efc780ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.364+0000 7efc76ffd640 1 -- 172.21.15.26:0/2337342411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc780d0d80 msgr2=0x7efc780c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:30.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.364+0000 7efc76ffd640 1 --2- 172.21.15.26:0/2337342411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc780d0d80 0x7efc780c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.364+0000 7efc76ffd640 1 -- 172.21.15.26:0/2337342411 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c0094d0 con 0x7efc7815c980 2023-10-14T11:12:30.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.364+0000 7efc76ffd640 1 --2- 172.21.15.26:0/2337342411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7815c980 0x7efc780c9db0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0ad040 tx=0x7efc6c0192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:30.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.364+0000 7efc5ffff640 1 -- 172.21.15.26:0/2337342411 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c0b5810 con 0x7efc7815c980 2023-10-14T11:12:30.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.364+0000 7efc5ffff640 1 -- 172.21.15.26:0/2337342411 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6c0b5970 con 0x7efc7815c980 2023-10-14T11:12:30.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.364+0000 7efc5ffff640 1 -- 172.21.15.26:0/2337342411 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c0b5d20 con 0x7efc7815c980 2023-10-14T11:12:30.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.364+0000 7efc7ca74640 1 -- 172.21.15.26:0/2337342411 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc780d1720 con 0x7efc7815c980 2023-10-14T11:12:30.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.364+0000 7efc7ca74640 1 -- 172.21.15.26:0/2337342411 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc780cbb60 con 0x7efc7815c980 2023-10-14T11:12:30.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc5ffff640 1 -- 172.21.15.26:0/2337342411 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efc6c0b4390 con 0x7efc7815c980 2023-10-14T11:12:30.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc5ffff640 1 --2- 172.21.15.26:0/2337342411 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efc640664a0 0x7efc64068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc5ffff640 1 -- 172.21.15.26:0/2337342411 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efc6c11e690 con 0x7efc7815c980 2023-10-14T11:12:30.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc777fe640 1 --2- 172.21.15.26:0/2337342411 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efc640664a0 0x7efc64068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc777fe640 1 --2- 172.21.15.26:0/2337342411 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efc640664a0 0x7efc64068960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efc78071590 tx=0x7efc68006f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:30.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc8105a000 1 Processor -- start 2023-10-14T11:12:30.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc8105a000 1 -- start start 2023-10-14T11:12:30.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc8105a000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd61358a0 0x563fd6135c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc8105a000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563fd61361c0 0x563fd60eb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc8105a000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563fd60ebc50 0x563fd60ec030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc8105a000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd5ee0cc0 con 0x563fd61358a0 2023-10-14T11:12:30.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc8105a000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd5f43920 con 0x563fd61361c0 2023-10-14T11:12:30.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc8105a000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x563fd5f40e50 con 0x563fd60ebc50 2023-10-14T11:12:30.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc777fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd61358a0 0x563fd6135c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc777fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd61358a0 0x563fd6135c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52338/0 (socket says 172.21.15.26:52338) 2023-10-14T11:12:30.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc777fe640 1 -- 172.21.15.26:0/1735697175 learned_addr learned my addr 172.21.15.26:0/1735697175 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:30.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc76ffd640 1 --2- 172.21.15.26:0/1735697175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563fd61361c0 0x563fd60eb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc77fff640 1 --2- 172.21.15.26:0/1735697175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563fd60ebc50 0x563fd60ec030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc777fe640 1 -- 172.21.15.26:0/1735697175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563fd60ebc50 msgr2=0x563fd60ec030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:30.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc777fe640 1 --2- 172.21.15.26:0/1735697175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563fd60ebc50 0x563fd60ec030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc777fe640 1 -- 172.21.15.26:0/1735697175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563fd61361c0 msgr2=0x563fd60eb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:30.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc777fe640 1 --2- 172.21.15.26:0/1735697175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563fd61361c0 0x563fd60eb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc777fe640 1 -- 172.21.15.26:0/1735697175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fd5c35890 con 0x563fd61358a0 2023-10-14T11:12:30.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.368+0000 7efc777fe640 1 --2- 172.21.15.26:0/1735697175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd61358a0 0x563fd6135c80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efc68011f00 tx=0x7efc68014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f646eb77fb024771 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:30.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc5d7fa640 1 -- 172.21.15.26:0/1735697175 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc68006050 con 0x563fd61358a0 2023-10-14T11:12:30.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc5d7fa640 1 -- 172.21.15.26:0/1735697175 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc680061b0 con 0x563fd61358a0 2023-10-14T11:12:30.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc5d7fa640 1 -- 172.21.15.26:0/1735697175 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc68006540 con 0x563fd61358a0 2023-10-14T11:12:30.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc8105a000 1 -- 172.21.15.26:0/1735697175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd61358a0 msgr2=0x563fd6135c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:30.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc8105a000 1 --2- 172.21.15.26:0/1735697175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd61358a0 0x563fd6135c80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efc68011f00 tx=0x7efc68014000 comp rx=0 tx=0).stop 2023-10-14T11:12:30.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc8105a000 1 -- 172.21.15.26:0/1735697175 shutdown_connections 2023-10-14T11:12:30.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc8105a000 1 --2- 172.21.15.26:0/1735697175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563fd60ebc50 0x563fd60ec030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc8105a000 1 --2- 172.21.15.26:0/1735697175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563fd61361c0 0x563fd60eb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc8105a000 1 --2- 172.21.15.26:0/1735697175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd61358a0 0x563fd6135c80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc8105a000 1 -- 172.21.15.26:0/1735697175 >> 172.21.15.26:0/1735697175 conn(0x563fd60e2fc0 msgr2=0x563fd60e9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:30.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc8105a000 1 -- 172.21.15.26:0/1735697175 shutdown_connections 2023-10-14T11:12:30.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc8105a000 1 -- 172.21.15.26:0/1735697175 wait complete. 2023-10-14T11:12:30.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc8105a000 1 -- start start 2023-10-14T11:12:30.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc8105a000 1 Processor -- start 2023-10-14T11:12:30.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc8105a000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563fd60ebc50 0x563fd60f0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc8105a000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd61358a0 0x563fd60f1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc8105a000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563fd61361c0 0x563fd6123d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc8105a000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd5f3c740 con 0x563fd61358a0 2023-10-14T11:12:30.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc8105a000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd5efbd10 con 0x563fd60ebc50 2023-10-14T11:12:30.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc8105a000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x563fd5efb9b0 con 0x563fd61361c0 2023-10-14T11:12:30.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc8105a000 10 client.0 _ll_register_callbacks cb 0x563fd60d7390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T11:12:30.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc76ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd61358a0 0x563fd60f1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc76ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd61358a0 0x563fd60f1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52350/0 (socket says 172.21.15.26:52350) 2023-10-14T11:12:30.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc76ffd640 1 -- 172.21.15.26:0/3372428647 learned_addr learned my addr 172.21.15.26:0/3372428647 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:30.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc77fff640 1 --2- 172.21.15.26:0/3372428647 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563fd61361c0 0x563fd6123d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc777fe640 1 --2- 172.21.15.26:0/3372428647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563fd60ebc50 0x563fd60f0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc76ffd640 1 -- 172.21.15.26:0/3372428647 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563fd61361c0 msgr2=0x563fd6123d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:30.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc76ffd640 1 --2- 172.21.15.26:0/3372428647 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563fd61361c0 0x563fd6123d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc76ffd640 1 -- 172.21.15.26:0/3372428647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563fd60ebc50 msgr2=0x563fd60f0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:30.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc76ffd640 1 --2- 172.21.15.26:0/3372428647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563fd60ebc50 0x563fd60f0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc76ffd640 1 -- 172.21.15.26:0/3372428647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc68011be0 con 0x563fd61358a0 2023-10-14T11:12:30.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc777fe640 1 --2- 172.21.15.26:0/3372428647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563fd60ebc50 0x563fd60f0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:30.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc76ffd640 1 --2- 172.21.15.26:0/3372428647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd61358a0 0x563fd60f1430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efc6c11c8d0 tx=0x7efc6c0ef0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a0d527db93d7ee server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:30.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.372+0000 7efc567fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-14T11:12:30.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc567fc640 1 -- 172.21.15.26:0/3372428647 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c0f7470 con 0x563fd61358a0 2023-10-14T11:12:30.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc8105a000 1 -- 172.21.15.26:0/3372428647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563fd5ef0370 con 0x563fd61358a0 2023-10-14T11:12:30.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc567fc640 1 -- 172.21.15.26:0/3372428647 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efc6c0f75d0 con 0x563fd61358a0 2023-10-14T11:12:30.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc567fc640 1 -- 172.21.15.26:0/3372428647 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc6c0eb4a0 con 0x563fd61358a0 2023-10-14T11:12:30.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc8105a000 10 client.4413 fetch_fsmap learned FSMap version 7 2023-10-14T11:12:30.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc8105a000 1 -- 172.21.15.26:0/3372428647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x563fd5efe460 con 0x563fd61358a0 2023-10-14T11:12:30.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc567fc640 1 -- 172.21.15.26:0/3372428647 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563fd5ef0370 con 0x563fd61358a0 2023-10-14T11:12:30.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc567fc640 1 -- 172.21.15.26:0/3372428647 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7efc6c0eb600 con 0x563fd61358a0 2023-10-14T11:12:30.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc8105a000 10 client.4413 fetch_fsmap finished waiting for FSMap version 7 2023-10-14T11:12:30.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc8105a000 10 client.4413 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-14T11:12:30.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc8105a000 20 client.4413 populate_metadata read hostname 'smithi026' 2023-10-14T11:12:30.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc8105a000 1 --2- 172.21.15.26:0/3372428647 >> [v2:172.21.15.110:6833/3522025152,v1:172.21.15.110:6835/3522025152] conn(0x563fd6124790 0x563fd6147950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc8105a000 4 client.4413 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T11:12:30.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc8105a000 1 -- 172.21.15.26:0/3372428647 --> [v2:172.21.15.110:6833/3522025152,v1:172.21.15.110:6835/3522025152] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563fd5ed62d0 con 0x563fd6124790 2023-10-14T11:12:30.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc777fe640 1 --2- 172.21.15.26:0/3372428647 >> [v2:172.21.15.110:6833/3522025152,v1:172.21.15.110:6835/3522025152] conn(0x563fd6124790 0x563fd6147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc777fe640 1 --2- 172.21.15.26:0/3372428647 >> [v2:172.21.15.110:6833/3522025152,v1:172.21.15.110:6835/3522025152] conn(0x563fd6124790 0x563fd6147950 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae95218ac7489373 server_cookie=eb420a5acc67111c in_seq=0 out_seq=0 2023-10-14T11:12:30.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc567fc640 10 client.4413 ms_handle_connect on v2:172.21.15.110:6833/3522025152 2023-10-14T11:12:30.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc567fc640 1 -- 172.21.15.26:0/3372428647 <== mds.0 v2:172.21.15.110:6833/3522025152 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563fd5ed62d0 con 0x563fd6124790 2023-10-14T11:12:30.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc567fc640 10 client.4413 handle_command_reply: tid=0 2023-10-14T11:12:30.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc8105a000 1 client.4413 shutdown 2023-10-14T11:12:30.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc8105a000 1 -- 172.21.15.26:0/3372428647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd61358a0 msgr2=0x563fd60f1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:30.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc8105a000 1 --2- 172.21.15.26:0/3372428647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd61358a0 0x563fd60f1430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efc6c11c8d0 tx=0x7efc6c0ef0d0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc8105a000 1 -- 172.21.15.26:0/3372428647 shutdown_connections 2023-10-14T11:12:30.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc8105a000 1 --2- 172.21.15.26:0/3372428647 >> [v2:172.21.15.110:6833/3522025152,v1:172.21.15.110:6835/3522025152] conn(0x563fd6124790 0x563fd6147950 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc8105a000 1 --2- 172.21.15.26:0/3372428647 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563fd61361c0 0x563fd6123d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc8105a000 1 --2- 172.21.15.26:0/3372428647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd61358a0 0x563fd60f1430 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc8105a000 1 --2- 172.21.15.26:0/3372428647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563fd60ebc50 0x563fd60f0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc567fc640 0 client.4413 ms_handle_reset on v2:172.21.15.110:6833/3522025152 2023-10-14T11:12:30.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc8105a000 1 -- 172.21.15.26:0/3372428647 >> 172.21.15.26:0/3372428647 conn(0x563fd60e2fc0 msgr2=0x563fd60ea6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:30.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc8105a000 1 -- 172.21.15.26:0/3372428647 shutdown_connections 2023-10-14T11:12:30.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc8105a000 1 -- 172.21.15.26:0/3372428647 wait complete. 2023-10-14T11:12:30.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.376+0000 7efc8105a000 20 client.4413 trim_cache size 0 max 16384 2023-10-14T11:12:30.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.392+0000 7efc8105a000 1 Processor -- start 2023-10-14T11:12:30.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.392+0000 7efc8105a000 1 -- start start 2023-10-14T11:12:30.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.392+0000 7efc8105a000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd60ebc50 0x563fd6149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.392+0000 7efc8105a000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563fd61358a0 0x563fd61495b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.392+0000 7efc8105a000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563fd61361c0 0x563fd611e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc8105a000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd5bf6940 con 0x563fd60ebc50 2023-10-14T11:12:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc8105a000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd5f46200 con 0x563fd61358a0 2023-10-14T11:12:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc8105a000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x563fd5f3b5d0 con 0x563fd61361c0 2023-10-14T11:12:30.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc777fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd60ebc50 0x563fd6149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc777fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd60ebc50 0x563fd6149070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52364/0 (socket says 172.21.15.26:52364) 2023-10-14T11:12:30.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc777fe640 1 -- 172.21.15.26:0/2329024263 learned_addr learned my addr 172.21.15.26:0/2329024263 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:30.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc76ffd640 1 --2- 172.21.15.26:0/2329024263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563fd61358a0 0x563fd61495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc77fff640 1 --2- 172.21.15.26:0/2329024263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563fd61361c0 0x563fd611e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc777fe640 1 -- 172.21.15.26:0/2329024263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563fd61361c0 msgr2=0x563fd611e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:30.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc777fe640 1 --2- 172.21.15.26:0/2329024263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563fd61361c0 0x563fd611e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc777fe640 1 -- 172.21.15.26:0/2329024263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563fd61358a0 msgr2=0x563fd61495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:30.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc777fe640 1 --2- 172.21.15.26:0/2329024263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563fd61358a0 0x563fd61495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc777fe640 1 -- 172.21.15.26:0/2329024263 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fd5ee4760 con 0x563fd60ebc50 2023-10-14T11:12:30.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc777fe640 1 --2- 172.21.15.26:0/2329024263 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd60ebc50 0x563fd6149070 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efc68011ed0 tx=0x7efc68016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b94e9da6cb82fab server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:30.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc5dffb640 1 -- 172.21.15.26:0/2329024263 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc68034070 con 0x563fd60ebc50 2023-10-14T11:12:30.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc5dffb640 1 -- 172.21.15.26:0/2329024263 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc68004100 con 0x563fd60ebc50 2023-10-14T11:12:30.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc5dffb640 1 -- 172.21.15.26:0/2329024263 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc68035450 con 0x563fd60ebc50 2023-10-14T11:12:30.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc8105a000 1 -- 172.21.15.26:0/2329024263 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd60ebc50 msgr2=0x563fd6149070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:30.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc8105a000 1 --2- 172.21.15.26:0/2329024263 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd60ebc50 0x563fd6149070 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efc68011ed0 tx=0x7efc68016000 comp rx=0 tx=0).stop 2023-10-14T11:12:30.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc8105a000 1 -- 172.21.15.26:0/2329024263 shutdown_connections 2023-10-14T11:12:30.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc8105a000 1 --2- 172.21.15.26:0/2329024263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563fd61361c0 0x563fd611e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc8105a000 1 --2- 172.21.15.26:0/2329024263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563fd61358a0 0x563fd61495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc8105a000 1 --2- 172.21.15.26:0/2329024263 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd60ebc50 0x563fd6149070 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc8105a000 1 -- 172.21.15.26:0/2329024263 >> 172.21.15.26:0/2329024263 conn(0x563fd60e2fc0 msgr2=0x563fd6147950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:30.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc8105a000 1 -- 172.21.15.26:0/2329024263 shutdown_connections 2023-10-14T11:12:30.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc8105a000 1 -- 172.21.15.26:0/2329024263 wait complete. 2023-10-14T11:12:30.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc8105a000 1 -- start start 2023-10-14T11:12:30.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc8105a000 1 Processor -- start 2023-10-14T11:12:30.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc8105a000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd60ebc50 0x563fd6122050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc8105a000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563fd61358a0 0x563fd6150d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc8105a000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563fd61361c0 0x563fd6151250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc8105a000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd5f40740 con 0x563fd60ebc50 2023-10-14T11:12:30.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc8105a000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd5f05720 con 0x563fd61358a0 2023-10-14T11:12:30.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc8105a000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x563fd5f93d90 con 0x563fd61361c0 2023-10-14T11:12:30.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.396+0000 7efc8105a000 10 client.0 _ll_register_callbacks cb 0x7efc68011a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T11:12:30.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc777fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd60ebc50 0x563fd6122050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc777fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd60ebc50 0x563fd6122050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52378/0 (socket says 172.21.15.26:52378) 2023-10-14T11:12:30.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc777fe640 1 -- 172.21.15.26:0/2336701831 learned_addr learned my addr 172.21.15.26:0/2336701831 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:30.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc77fff640 1 --2- 172.21.15.26:0/2336701831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563fd61361c0 0x563fd6151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc76ffd640 1 --2- 172.21.15.26:0/2336701831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563fd61358a0 0x563fd6150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc777fe640 1 -- 172.21.15.26:0/2336701831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563fd61361c0 msgr2=0x563fd6151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:30.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc777fe640 1 --2- 172.21.15.26:0/2336701831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563fd61361c0 0x563fd6151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc777fe640 1 -- 172.21.15.26:0/2336701831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563fd61358a0 msgr2=0x563fd6150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:30.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc777fe640 1 --2- 172.21.15.26:0/2336701831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563fd61358a0 0x563fd6150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc777fe640 1 -- 172.21.15.26:0/2336701831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563fd5c35890 con 0x563fd60ebc50 2023-10-14T11:12:30.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc777fe640 1 --2- 172.21.15.26:0/2336701831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd60ebc50 0x563fd6122050 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efc68004290 tx=0x7efc68004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddba17ff52162248 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:30.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc567fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-14T11:12:30.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc567fc640 1 -- 172.21.15.26:0/2336701831 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc68034040 con 0x563fd60ebc50 2023-10-14T11:12:30.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc567fc640 1 -- 172.21.15.26:0/2336701831 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efc68035460 con 0x563fd60ebc50 2023-10-14T11:12:30.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc8105a000 1 -- 172.21.15.26:0/2336701831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563fd60ee3b0 con 0x563fd60ebc50 2023-10-14T11:12:30.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc567fc640 1 -- 172.21.15.26:0/2336701831 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc680357a0 con 0x563fd60ebc50 2023-10-14T11:12:30.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc8105a000 10 client.4419 fetch_fsmap learned FSMap version 7 2023-10-14T11:12:30.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc8105a000 1 -- 172.21.15.26:0/2336701831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x563fd5c35cc0 con 0x563fd60ebc50 2023-10-14T11:12:30.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc567fc640 1 -- 172.21.15.26:0/2336701831 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563fd60ee3b0 con 0x563fd60ebc50 2023-10-14T11:12:30.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc567fc640 1 -- 172.21.15.26:0/2336701831 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7efc68035900 con 0x563fd60ebc50 2023-10-14T11:12:30.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc8105a000 10 client.4419 fetch_fsmap finished waiting for FSMap version 7 2023-10-14T11:12:30.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc8105a000 10 client.4419 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-14T11:12:30.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc8105a000 20 client.4419 populate_metadata read hostname 'smithi026' 2023-10-14T11:12:30.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc8105a000 1 --2- 172.21.15.26:0/2336701831 >> [v2:172.21.15.110:6833/3522025152,v1:172.21.15.110:6835/3522025152] conn(0x563fd61944a0 0x563fd6194880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc8105a000 4 client.4419 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T11:12:30.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc8105a000 1 -- 172.21.15.26:0/2336701831 --> [v2:172.21.15.110:6833/3522025152,v1:172.21.15.110:6835/3522025152] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563fd5ed46f0 con 0x563fd61944a0 2023-10-14T11:12:30.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc76ffd640 1 --2- 172.21.15.26:0/2336701831 >> [v2:172.21.15.110:6833/3522025152,v1:172.21.15.110:6835/3522025152] conn(0x563fd61944a0 0x563fd6194880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc76ffd640 1 --2- 172.21.15.26:0/2336701831 >> [v2:172.21.15.110:6833/3522025152,v1:172.21.15.110:6835/3522025152] conn(0x563fd61944a0 0x563fd6194880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28e2a670ccb05b41 server_cookie=e6aa5acc59b861b5 in_seq=0 out_seq=0 2023-10-14T11:12:30.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc567fc640 10 client.4419 ms_handle_connect on v2:172.21.15.110:6833/3522025152 2023-10-14T11:12:30.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc567fc640 1 -- 172.21.15.26:0/2336701831 <== mds.0 v2:172.21.15.110:6833/3522025152 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x563fd5ed46f0 con 0x563fd61944a0 2023-10-14T11:12:30.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc567fc640 10 client.4419 handle_command_reply: tid=0 2023-10-14T11:12:30.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc8105a000 1 client.4419 shutdown 2023-10-14T11:12:30.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc8105a000 1 -- 172.21.15.26:0/2336701831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd60ebc50 msgr2=0x563fd6122050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:30.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc8105a000 1 --2- 172.21.15.26:0/2336701831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd60ebc50 0x563fd6122050 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efc68004290 tx=0x7efc68004740 comp rx=0 tx=0).stop 2023-10-14T11:12:30.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc8105a000 1 -- 172.21.15.26:0/2336701831 shutdown_connections 2023-10-14T11:12:30.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc8105a000 1 --2- 172.21.15.26:0/2336701831 >> [v2:172.21.15.110:6833/3522025152,v1:172.21.15.110:6835/3522025152] conn(0x563fd61944a0 0x563fd6194880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc8105a000 1 --2- 172.21.15.26:0/2336701831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563fd61361c0 0x563fd6151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc8105a000 1 --2- 172.21.15.26:0/2336701831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563fd61358a0 0x563fd6150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc8105a000 1 --2- 172.21.15.26:0/2336701831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563fd60ebc50 0x563fd6122050 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc567fc640 0 client.4419 ms_handle_reset on v2:172.21.15.110:6833/3522025152 2023-10-14T11:12:30.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc8105a000 1 -- 172.21.15.26:0/2336701831 >> 172.21.15.26:0/2336701831 conn(0x563fd60e2fc0 msgr2=0x563fd6147950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:30.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc8105a000 1 -- 172.21.15.26:0/2336701831 shutdown_connections 2023-10-14T11:12:30.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc8105a000 1 -- 172.21.15.26:0/2336701831 wait complete. 2023-10-14T11:12:30.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc8105a000 20 client.4419 trim_cache size 0 max 16384 2023-10-14T11:12:30.437 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:12:30.437 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "9730719c-9713-4147-aaa1-ca8aabbbe5ad", 2023-10-14T11:12:30.437 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-10-14T11:12:30.437 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4282, 2023-10-14T11:12:30.438 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-10-14T11:12:30.438 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-10-14T11:12:30.438 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-10-14T11:12:30.438 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 7.4417685330000003, 2023-10-14T11:12:30.438 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 7, 2023-10-14T11:12:30.439 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 25, 2023-10-14T11:12:30.439 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 24, 2023-10-14T11:12:30.439 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 15.001301102999999 2023-10-14T11:12:30.439 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:12:30.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc7ca74640 1 -- 172.21.15.26:0/2337342411 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efc640664a0 msgr2=0x7efc64068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:30.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc7ca74640 1 --2- 172.21.15.26:0/2337342411 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efc640664a0 0x7efc64068960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efc78071590 tx=0x7efc68006f90 comp rx=0 tx=0).stop 2023-10-14T11:12:30.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc7ca74640 1 -- 172.21.15.26:0/2337342411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7815c980 msgr2=0x7efc780c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:30.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.400+0000 7efc7ca74640 1 --2- 172.21.15.26:0/2337342411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7815c980 0x7efc780c9db0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0ad040 tx=0x7efc6c0192e0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.404+0000 7efc7ca74640 1 -- 172.21.15.26:0/2337342411 shutdown_connections 2023-10-14T11:12:30.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.404+0000 7efc7ca74640 1 --2- 172.21.15.26:0/2337342411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7815cd60 0x7efc780ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.404+0000 7efc7ca74640 1 --2- 172.21.15.26:0/2337342411 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efc640664a0 0x7efc64068960 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.404+0000 7efc7ca74640 1 --2- 172.21.15.26:0/2337342411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7815c980 0x7efc780c9db0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.404+0000 7efc7ca74640 1 --2- 172.21.15.26:0/2337342411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc780d0d80 0x7efc780c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.404+0000 7efc7ca74640 1 -- 172.21.15.26:0/2337342411 >> 172.21.15.26:0/2337342411 conn(0x7efc7809ba80 msgr2=0x7efc78159320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:30.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.404+0000 7efc7ca74640 1 -- 172.21.15.26:0/2337342411 shutdown_connections 2023-10-14T11:12:30.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.404+0000 7efc7ca74640 1 -- 172.21.15.26:0/2337342411 wait complete. 2023-10-14T11:12:30.444 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T11:12:30.445 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-14T11:12:30.445 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T11:12:30.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.584+0000 7fb32b8d6640 1 Processor -- start 2023-10-14T11:12:30.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.584+0000 7fb32b8d6640 1 -- start start 2023-10-14T11:12:30.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.588+0000 7fb32b8d6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb324164520 0x7fb3240ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.588+0000 7fb32b8d6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3240ad960 0x7fb3240b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.588+0000 7fb32b8d6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb3240c9b80 0x7fb3240b0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.588+0000 7fb32b8d6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb324164900 con 0x7fb3240c9b80 2023-10-14T11:12:30.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.588+0000 7fb32b8d6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3240c96f0 con 0x7fb324164520 2023-10-14T11:12:30.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.588+0000 7fb32b8d6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3240cb950 con 0x7fb3240ad960 2023-10-14T11:12:30.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.588+0000 7fb329e73640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb3240c9b80 0x7fb3240b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.588+0000 7fb329e73640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb3240c9b80 0x7fb3240b0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52394/0 (socket says 172.21.15.26:52394) 2023-10-14T11:12:30.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.588+0000 7fb329e73640 1 -- 172.21.15.26:0/1070722858 learned_addr learned my addr 172.21.15.26:0/1070722858 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:30.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.588+0000 7fb328e71640 1 --2- 172.21.15.26:0/1070722858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3240ad960 0x7fb3240b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.588+0000 7fb329672640 1 --2- 172.21.15.26:0/1070722858 >> v2:172.21.15.110:3300/0 conn(0x7fb324164520 0x7fb3240ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.588+0000 7fb329e73640 1 -- 172.21.15.26:0/1070722858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3240ad960 msgr2=0x7fb3240b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:30.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.588+0000 7fb329e73640 1 --2- 172.21.15.26:0/1070722858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3240ad960 0x7fb3240b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.588+0000 7fb329e73640 1 -- 172.21.15.26:0/1070722858 >> v2:172.21.15.110:3300/0 conn(0x7fb324164520 msgr2=0x7fb3240ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:30.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.588+0000 7fb329e73640 1 --2- 172.21.15.26:0/1070722858 >> v2:172.21.15.110:3300/0 conn(0x7fb324164520 0x7fb3240ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.588+0000 7fb329e73640 1 -- 172.21.15.26:0/1070722858 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3240cbed0 con 0x7fb3240c9b80 2023-10-14T11:12:30.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.588+0000 7fb328e71640 1 --2- 172.21.15.26:0/1070722858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3240ad960 0x7fb3240b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:30.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.588+0000 7fb329672640 1 --2- 172.21.15.26:0/1070722858 >> v2:172.21.15.110:3300/0 conn(0x7fb324164520 0x7fb3240ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:30.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.592+0000 7fb329e73640 1 --2- 172.21.15.26:0/1070722858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3240c9b80 0x7fb3240b0620 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb3240cf6f0 tx=0x7fb31c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4968f2bbefb1f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:30.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.592+0000 7fb31bfff640 1 -- 172.21.15.26:0/1070722858 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0a5870 con 0x7fb3240c9b80 2023-10-14T11:12:30.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.592+0000 7fb31bfff640 1 -- 172.21.15.26:0/1070722858 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c0a59d0 con 0x7fb3240c9b80 2023-10-14T11:12:30.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.592+0000 7fb31bfff640 1 -- 172.21.15.26:0/1070722858 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0a5d60 con 0x7fb3240c9b80 2023-10-14T11:12:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.592+0000 7fb32b8d6640 1 -- 172.21.15.26:0/1070722858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3240c9b80 msgr2=0x7fb3240b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.592+0000 7fb32b8d6640 1 --2- 172.21.15.26:0/1070722858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3240c9b80 0x7fb3240b0620 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb3240cf6f0 tx=0x7fb31c01c9d0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.592+0000 7fb32b8d6640 1 -- 172.21.15.26:0/1070722858 shutdown_connections 2023-10-14T11:12:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.592+0000 7fb32b8d6640 1 --2- 172.21.15.26:0/1070722858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3240c9b80 0x7fb3240b0620 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.592+0000 7fb32b8d6640 1 --2- 172.21.15.26:0/1070722858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3240ad960 0x7fb3240b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.592+0000 7fb32b8d6640 1 --2- 172.21.15.26:0/1070722858 >> v2:172.21.15.110:3300/0 conn(0x7fb324164520 0x7fb3240ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.592+0000 7fb32b8d6640 1 -- 172.21.15.26:0/1070722858 >> 172.21.15.26:0/1070722858 conn(0x7fb32406c190 msgr2=0x7fb32406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:30.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.592+0000 7fb32b8d6640 1 -- 172.21.15.26:0/1070722858 shutdown_connections 2023-10-14T11:12:30.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.592+0000 7fb32b8d6640 1 -- 172.21.15.26:0/1070722858 wait complete. 2023-10-14T11:12:30.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.592+0000 7fb32b8d6640 1 Processor -- start 2023-10-14T11:12:30.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.592+0000 7fb32b8d6640 1 -- start start 2023-10-14T11:12:30.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.592+0000 7fb32b8d6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3240ad960 0x7fb3240b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.592+0000 7fb32b8d6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3240c9b80 0x7fb3241564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.592+0000 7fb32b8d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb324164520 0x7fb3240c3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.592+0000 7fb32b8d6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3240b1750 con 0x7fb324164520 2023-10-14T11:12:30.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.592+0000 7fb32b8d6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb324156a30 con 0x7fb3240c9b80 2023-10-14T11:12:30.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.592+0000 7fb32b8d6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3240c3f30 con 0x7fb3240ad960 2023-10-14T11:12:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.596+0000 7fb329e73640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb324164520 0x7fb3240c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.596+0000 7fb329e73640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb324164520 0x7fb3240c3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52396/0 (socket says 172.21.15.26:52396) 2023-10-14T11:12:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.596+0000 7fb329e73640 1 -- 172.21.15.26:0/3841887479 learned_addr learned my addr 172.21.15.26:0/3841887479 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.596+0000 7fb329672640 1 --2- 172.21.15.26:0/3841887479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3240ad960 0x7fb3240b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.596+0000 7fb328e71640 1 --2- 172.21.15.26:0/3841887479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3240c9b80 0x7fb3241564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.596+0000 7fb329e73640 1 -- 172.21.15.26:0/3841887479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3240ad960 msgr2=0x7fb3240b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:30.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.596+0000 7fb329e73640 1 --2- 172.21.15.26:0/3841887479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3240ad960 0x7fb3240b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.596+0000 7fb329e73640 1 -- 172.21.15.26:0/3841887479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3240c9b80 msgr2=0x7fb3241564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:30.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.596+0000 7fb329e73640 1 --2- 172.21.15.26:0/3841887479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3240c9b80 0x7fb3241564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.596+0000 7fb329e73640 1 -- 172.21.15.26:0/3841887479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c009b30 con 0x7fb324164520 2023-10-14T11:12:30.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.596+0000 7fb328e71640 1 --2- 172.21.15.26:0/3841887479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3240c9b80 0x7fb3241564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:30.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.596+0000 7fb329e73640 1 --2- 172.21.15.26:0/3841887479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb324164520 0x7fb3240c3350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb31c01b080 tx=0x7fb31c019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:30.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.596+0000 7fb319ffb640 1 -- 172.21.15.26:0/3841887479 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0b8670 con 0x7fb324164520 2023-10-14T11:12:30.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.596+0000 7fb319ffb640 1 -- 172.21.15.26:0/3841887479 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c0b87d0 con 0x7fb324164520 2023-10-14T11:12:30.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.596+0000 7fb319ffb640 1 -- 172.21.15.26:0/3841887479 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0b8b80 con 0x7fb324164520 2023-10-14T11:12:30.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.596+0000 7fb32b8d6640 1 -- 172.21.15.26:0/3841887479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3240c3c50 con 0x7fb324164520 2023-10-14T11:12:30.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.596+0000 7fb32b8d6640 1 -- 172.21.15.26:0/3841887479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3240b1370 con 0x7fb324164520 2023-10-14T11:12:30.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.596+0000 7fb32b8d6640 1 -- 172.21.15.26:0/3841887479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3240b0ef0 con 0x7fb324164520 2023-10-14T11:12:30.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.596+0000 7fb319ffb640 1 -- 172.21.15.26:0/3841887479 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb31c0b8ce0 con 0x7fb324164520 2023-10-14T11:12:30.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.600+0000 7fb319ffb640 1 --2- 172.21.15.26:0/3841887479 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb3080664a0 0x7fb308068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:30.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.600+0000 7fb319ffb640 1 -- 172.21.15.26:0/3841887479 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb31c11f760 con 0x7fb324164520 2023-10-14T11:12:30.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.600+0000 7fb329672640 1 --2- 172.21.15.26:0/3841887479 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb3080664a0 0x7fb308068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:30.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.600+0000 7fb329672640 1 --2- 172.21.15.26:0/3841887479 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb3080664a0 0x7fb308068960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb3200045f0 tx=0x7fb320008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:30.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.600+0000 7fb319ffb640 1 -- 172.21.15.26:0/3841887479 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb3240b0ef0 con 0x7fb324164520 2023-10-14T11:12:30.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.792+0000 7fb32b8d6640 1 -- 172.21.15.26:0/3841887479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb3240b1890 con 0x7fb324164520 2023-10-14T11:12:30.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.792+0000 7fb319ffb640 1 -- 172.21.15.26:0/3841887479 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb3240b1890 con 0x7fb324164520 2023-10-14T11:12:30.797 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-14T11:12:30.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.796+0000 7fb32b8d6640 1 -- 172.21.15.26:0/3841887479 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb3080664a0 msgr2=0x7fb308068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:30.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.796+0000 7fb32b8d6640 1 --2- 172.21.15.26:0/3841887479 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb3080664a0 0x7fb308068960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb3200045f0 tx=0x7fb320008040 comp rx=0 tx=0).stop 2023-10-14T11:12:30.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.796+0000 7fb32b8d6640 1 -- 172.21.15.26:0/3841887479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb324164520 msgr2=0x7fb3240c3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:30.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.796+0000 7fb32b8d6640 1 --2- 172.21.15.26:0/3841887479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb324164520 0x7fb3240c3350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb31c01b080 tx=0x7fb31c019770 comp rx=0 tx=0).stop 2023-10-14T11:12:30.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.796+0000 7fb32b8d6640 1 -- 172.21.15.26:0/3841887479 shutdown_connections 2023-10-14T11:12:30.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.796+0000 7fb32b8d6640 1 --2- 172.21.15.26:0/3841887479 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb3080664a0 0x7fb308068960 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.796+0000 7fb32b8d6640 1 --2- 172.21.15.26:0/3841887479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb324164520 0x7fb3240c3350 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.796+0000 7fb32b8d6640 1 --2- 172.21.15.26:0/3841887479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3240c9b80 0x7fb3241564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.796+0000 7fb32b8d6640 1 --2- 172.21.15.26:0/3841887479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3240ad960 0x7fb3240b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:30.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.796+0000 7fb32b8d6640 1 -- 172.21.15.26:0/3841887479 >> 172.21.15.26:0/3841887479 conn(0x7fb32406c190 msgr2=0x7fb324071cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:30.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.796+0000 7fb32b8d6640 1 -- 172.21.15.26:0/3841887479 shutdown_connections 2023-10-14T11:12:30.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:30.796+0000 7fb32b8d6640 1 -- 172.21.15.26:0/3841887479 wait complete. 2023-10-14T11:12:30.818 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T11:12:30.819 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T11:12:30.819 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-14T11:12:30.819 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-14T11:12:30.820 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-14T11:12:30.820 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T11:12:30.820 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T11:12:30.821 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T11:12:30.821 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-14T11:12:30.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:30.822 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-14T11:12:30.831 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:12:30.831 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:12:30.831 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:12:30.832 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:12:30.832 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-14T11:12:30.832 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:12:30.832 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:12:30.832 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-14T11:12:30.833 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-14T11:12:30.833 INFO:teuthology.orchestra.run.smithi026.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T11:12:30.833 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:12:30.833 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-14T11:12:30.833 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-14T11:12:30.834 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42426sec preferred_lft 42426sec 2023-10-14T11:12:30.834 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-14T11:12:30.834 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:12:30.834 INFO:teuthology.orchestra.run.smithi026.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:12:30.834 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-14T11:12:30.835 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-14T11:12:30.835 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:12:30.835 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:12:30.835 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-14T11:12:30.835 INFO:teuthology.orchestra.run.smithi026.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-14T11:12:30.836 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 02:42:e1:29:12:f0 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:12:30.836 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-14T11:12:30.836 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:12:30.837 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T11:12:30.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:30.838 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-14T11:12:30.839 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-14T11:12:30.839 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add name ceph-brx type bridge 2023-10-14T11:12:30.839 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr flush dev ceph-brx 2023-10-14T11:12:30.839 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set ceph-brx up 2023-10-14T11:12:30.840 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T11:12:30.840 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-14T11:12:30.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:30.959 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T11:12:30.980 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-14T11:12:30.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:30.983 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-14T11:12:31.573 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-14T11:12:31.573 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T11:12:31.574 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-14T11:12:31.574 INFO:teuthology.orchestra.run.smithi026.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-14T11:12:31.574 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-14T11:12:31.574 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T11:12:31.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:31.575 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-14T11:12:31.576 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-14T11:12:31.576 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T11:12:31.577 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T11:12:31.577 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T11:12:31.577 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-14T11:12:31.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:31.636 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-14T11:12:31.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:31.648 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list-id 2023-10-14T11:12:31.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:31.699 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-14T11:12:31.699 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-14T11:12:31.700 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-14T11:12:31.700 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-14T11:12:31.700 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-14T11:12:31.789 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-14T11:12:31.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:31.790 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-14T11:12:31.791 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-14T11:12:31.791 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-14T11:12:31.792 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T11:12:31.792 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-14T11:12:31.792 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-14T11:12:31.793 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-14T11:12:31.793 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-14T11:12:31.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:31.961 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-14T11:12:31.961 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-14T11:12:31.962 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-10-14T11:12:31.962 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T11:12:31.962 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-14T11:12:32.005 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-14T11:12:32.006 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:12:32.006 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-14T11:12:32.061 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-14T11:12:32.062 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:12:32.062 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-14T11:12:32.112 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-10-14T11:12:32.179 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:12:32.231 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2023-10-14T11:12:32.232 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2023-10-14T11:12:32.232 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2023-10-14T11:12:32.233 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2023-10-14T11:12:32.234 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2023-10-14T11:12:32.234 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2023-10-14T11:12:32.235 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2023-10-14T11:12:32.235 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2023-10-14T11:12:32.235 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2023-10-14T11:12:32.236 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2023-10-14T11:12:32.236 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2023-10-14T11:12:32.236 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2023-10-14T11:12:32.237 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:12:32.237 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2023-10-14T11:12:32.237 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2023-10-14T11:12:32.237 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2023-10-14T11:12:32.238 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2023-10-14T11:12:32.238 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2023-10-14T11:12:32.238 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2023-10-14T11:12:32.238 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2023-10-14T11:12:32.238 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:12:32.239 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2023-10-14T11:12:32.239 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2023-10-14T11:12:32.239 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2023-10-14T11:12:32.239 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T11:12:32.239 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T11:12:32.240 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T11:12:32.240 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T11:12:32.240 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2023-10-14T11:12:32.240 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-14T11:12:32.240 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-14T11:12:32.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:32.242 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-10-14T11:12:32.298 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-14T11:12:32.299 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-14T11:12:32.344 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-10-14T11:12:32.367 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:12:32.423 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2023-10-14T11:12:32.423 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2023-10-14T11:12:32.423 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2023-10-14T11:12:32.424 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2023-10-14T11:12:32.424 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2023-10-14T11:12:32.424 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2023-10-14T11:12:32.424 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2023-10-14T11:12:32.424 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2023-10-14T11:12:32.424 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2023-10-14T11:12:32.425 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2023-10-14T11:12:32.425 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2023-10-14T11:12:32.425 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2023-10-14T11:12:32.425 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:12:32.425 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2023-10-14T11:12:32.426 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2023-10-14T11:12:32.426 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2023-10-14T11:12:32.426 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2023-10-14T11:12:32.426 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2023-10-14T11:12:32.426 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2023-10-14T11:12:32.427 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2023-10-14T11:12:32.427 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:12:32.427 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2023-10-14T11:12:32.427 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2023-10-14T11:12:32.427 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2023-10-14T11:12:32.427 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T11:12:32.428 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T11:12:32.428 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T11:12:32.428 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T11:12:32.428 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2023-10-14T11:12:32.428 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-14T11:12:32.429 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-14T11:12:32.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:32.430 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-10-14T11:12:32.452 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi026.stderr:2023-10-14T11:12:32.448+0000 7f1fa3a49580 -1 init, newargv = 0x55cd91878a10 newargc=15 2023-10-14T11:12:32.452 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi026.stderr:ceph-fuse[42931]: starting ceph client 2023-10-14T11:12:32.463 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi026.stderr:ceph-fuse[42931]: starting fuse 2023-10-14T11:12:33.562 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-10-14T11:12:33.588 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:12:33.644 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2023-10-14T11:12:33.644 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2023-10-14T11:12:33.644 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2023-10-14T11:12:33.645 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2023-10-14T11:12:33.645 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2023-10-14T11:12:33.645 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2023-10-14T11:12:33.645 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2023-10-14T11:12:33.645 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2023-10-14T11:12:33.646 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2023-10-14T11:12:33.646 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2023-10-14T11:12:33.646 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2023-10-14T11:12:33.646 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2023-10-14T11:12:33.646 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:12:33.647 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2023-10-14T11:12:33.647 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2023-10-14T11:12:33.647 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2023-10-14T11:12:33.647 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2023-10-14T11:12:33.647 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2023-10-14T11:12:33.647 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2023-10-14T11:12:33.648 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2023-10-14T11:12:33.648 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:12:33.648 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2023-10-14T11:12:33.648 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2023-10-14T11:12:33.648 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2023-10-14T11:12:33.649 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T11:12:33.649 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T11:12:33.649 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T11:12:33.649 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T11:12:33.649 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2023-10-14T11:12:33.649 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-14T11:12:33.650 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-14T11:12:33.650 INFO:teuthology.orchestra.run.smithi026.stdout:/home/ubuntu/cephtest/mnt.admin 2023-10-14T11:12:33.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:33.651 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-10-14T11:12:33.702 INFO:teuthology.orchestra.run.smithi026.stdout:43 2023-10-14T11:12:33.702 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-10-14T11:12:33.703 DEBUG:teuthology.orchestra.run.smithi026:> sudo stdin-killer -- python3 -c ' 2023-10-14T11:12:33.703 DEBUG:teuthology.orchestra.run.smithi026:> import glob 2023-10-14T11:12:33.703 DEBUG:teuthology.orchestra.run.smithi026:> import re 2023-10-14T11:12:33.704 DEBUG:teuthology.orchestra.run.smithi026:> import os 2023-10-14T11:12:33.704 DEBUG:teuthology.orchestra.run.smithi026:> import subprocess 2023-10-14T11:12:33.705 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:12:33.705 DEBUG:teuthology.orchestra.run.smithi026:> def _find_admin_socket(client_name): 2023-10-14T11:12:33.705 DEBUG:teuthology.orchestra.run.smithi026:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-14T11:12:33.706 DEBUG:teuthology.orchestra.run.smithi026:> files = glob.glob(asok_path) 2023-10-14T11:12:33.706 DEBUG:teuthology.orchestra.run.smithi026:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-14T11:12:33.706 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:12:33.707 DEBUG:teuthology.orchestra.run.smithi026:> # Given a non-glob path, it better be there 2023-10-14T11:12:33.707 DEBUG:teuthology.orchestra.run.smithi026:> if "*" not in asok_path: 2023-10-14T11:12:33.707 DEBUG:teuthology.orchestra.run.smithi026:> assert(len(files) == 1) 2023-10-14T11:12:33.708 DEBUG:teuthology.orchestra.run.smithi026:> return files[0] 2023-10-14T11:12:33.708 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:12:33.708 DEBUG:teuthology.orchestra.run.smithi026:> for f in files: 2023-10-14T11:12:33.709 DEBUG:teuthology.orchestra.run.smithi026:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-14T11:12:33.709 DEBUG:teuthology.orchestra.run.smithi026:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-14T11:12:33.709 DEBUG:teuthology.orchestra.run.smithi026:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-14T11:12:33.710 DEBUG:teuthology.orchestra.run.smithi026:> contents = proc_f.read() 2023-10-14T11:12:33.710 DEBUG:teuthology.orchestra.run.smithi026:> if mountpoint in contents: 2023-10-14T11:12:33.710 DEBUG:teuthology.orchestra.run.smithi026:> return f 2023-10-14T11:12:33.711 DEBUG:teuthology.orchestra.run.smithi026:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-14T11:12:33.711 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:12:33.711 DEBUG:teuthology.orchestra.run.smithi026:> print(_find_admin_socket("client.admin")) 2023-10-14T11:12:33.712 DEBUG:teuthology.orchestra.run.smithi026:> ' 2023-10-14T11:12:33.838 INFO:teuthology.orchestra.run.smithi026.stdout:/var/run/ceph/ceph-client.admin.42931.asok 2023-10-14T11:12:33.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-14T11:12:33.852 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42931.asok 2023-10-14T11:12:33.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:33.852 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42931.asok status 2023-10-14T11:12:34.028 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:12:34.029 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": { 2023-10-14T11:12:34.029 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-14T11:12:34.029 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T11:12:34.029 INFO:teuthology.orchestra.run.smithi026.stdout: "entity_id": "admin", 2023-10-14T11:12:34.029 INFO:teuthology.orchestra.run.smithi026.stdout: "hostname": "smithi026", 2023-10-14T11:12:34.030 INFO:teuthology.orchestra.run.smithi026.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-14T11:12:34.030 INFO:teuthology.orchestra.run.smithi026.stdout: "pid": "42931", 2023-10-14T11:12:34.030 INFO:teuthology.orchestra.run.smithi026.stdout: "root": "/" 2023-10-14T11:12:34.030 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:12:34.030 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_count": 0, 2023-10-14T11:12:34.031 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_pinned_count": 0, 2023-10-14T11:12:34.031 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4434, 2023-10-14T11:12:34.031 INFO:teuthology.orchestra.run.smithi026.stdout: "inst": { 2023-10-14T11:12:34.031 INFO:teuthology.orchestra.run.smithi026.stdout: "name": { 2023-10-14T11:12:34.031 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "client", 2023-10-14T11:12:34.032 INFO:teuthology.orchestra.run.smithi026.stdout: "num": 4434 2023-10-14T11:12:34.032 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:12:34.032 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-10-14T11:12:34.032 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-14T11:12:34.032 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2023-10-14T11:12:34.032 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 1201338480 2023-10-14T11:12:34.033 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:12:34.033 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:12:34.033 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-10-14T11:12:34.033 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-14T11:12:34.033 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2023-10-14T11:12:34.034 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 1201338480 2023-10-14T11:12:34.034 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:12:34.034 INFO:teuthology.orchestra.run.smithi026.stdout: "inst_str": "client.4434 192.168.0.1:0/1201338480", 2023-10-14T11:12:34.034 INFO:teuthology.orchestra.run.smithi026.stdout: "addr_str": "192.168.0.1:0/1201338480", 2023-10-14T11:12:34.034 INFO:teuthology.orchestra.run.smithi026.stdout: "inode_count": 1, 2023-10-14T11:12:34.035 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_epoch": 7, 2023-10-14T11:12:34.035 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch": 25, 2023-10-14T11:12:34.035 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch_barrier": 0, 2023-10-14T11:12:34.035 INFO:teuthology.orchestra.run.smithi026.stdout: "blocklisted": false, 2023-10-14T11:12:34.035 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs" 2023-10-14T11:12:34.036 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:12:34.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:34.044 DEBUG:teuthology.orchestra.run.smithi026:> stat --file-system '--printf=%T 2023-10-14T11:12:34.044 DEBUG:teuthology.orchestra.run.smithi026:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-14T11:12:34.054 INFO:teuthology.orchestra.run.smithi026.stdout:fuseblk 2023-10-14T11:12:34.055 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-14T11:12:34.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:34.056 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-14T11:12:34.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:34.119 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-14T11:12:34.220 INFO:teuthology.orchestra.run.smithi026.stdout:# file: . 2023-10-14T11:12:34.220 INFO:teuthology.orchestra.run.smithi026.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-14T11:12:34.220 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:34.221 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:12:34.222 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:12:34.231 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:12:34.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.416+0000 7f6b8512a640 1 Processor -- start 2023-10-14T11:12:34.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.416+0000 7f6b8512a640 1 -- start start 2023-10-14T11:12:34.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.416+0000 7f6b8512a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6b8015cb90 0x7f6b800cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:34.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.416+0000 7f6b8512a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b800ce770 con 0x7f6b800d3010 2023-10-14T11:12:34.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.416+0000 7f6b8512a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b800d0600 con 0x7f6b800d15d0 2023-10-14T11:12:34.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.416+0000 7f6b8512a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b800c6450 con 0x7f6b8015cb90 2023-10-14T11:12:34.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.416+0000 7f6b7ed9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6b8015cb90 0x7f6b800cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:34.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.416+0000 7f6b7e59c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6b800d3010 0x7f6b800d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38282/0 (socket says 172.21.15.26:38282) 2023-10-14T11:12:34.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.416+0000 7f6b7e59c640 1 -- 172.21.15.26:0/2893418368 learned_addr learned my addr 172.21.15.26:0/2893418368 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:34.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.416+0000 7f6b7ed9d640 1 -- 172.21.15.26:0/2893418368 >> v1:172.21.15.110:6789/0 conn(0x7f6b800d15d0 legacy=0x7f6b800c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:34.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.416+0000 7f6b7ed9d640 1 -- 172.21.15.26:0/2893418368 >> v1:172.21.15.26:6789/0 conn(0x7f6b800d3010 legacy=0x7f6b800d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:34.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.416+0000 7f6b7ed9d640 1 -- 172.21.15.26:0/2893418368 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b800d08a0 con 0x7f6b8015cb90 2023-10-14T11:12:34.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.416+0000 7f6b7dd9b640 1 -- 172.21.15.26:0/2893418368 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622189144 0 0) 0x7f6b800ce770 con 0x7f6b800d3010 2023-10-14T11:12:34.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.420+0000 7f6b7ed9d640 1 --2- 172.21.15.26:0/2893418368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b8015cb90 0x7f6b800cfb10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6b700097a0 tx=0x7f6b7001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ec5ae310d72a1b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:34.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.420+0000 7f6b7dd9b640 1 -- 172.21.15.26:0/2893418368 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b700ad660 con 0x7f6b8015cb90 2023-10-14T11:12:34.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.420+0000 7f6b7dd9b640 1 -- 172.21.15.26:0/2893418368 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b700ad7c0 con 0x7f6b8015cb90 2023-10-14T11:12:34.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.420+0000 7f6b7dd9b640 1 -- 172.21.15.26:0/2893418368 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b700adb50 con 0x7f6b8015cb90 2023-10-14T11:12:34.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.420+0000 7f6b8512a640 1 -- 172.21.15.26:0/2893418368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b8015cb90 msgr2=0x7f6b800cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:34.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.420+0000 7f6b8512a640 1 --2- 172.21.15.26:0/2893418368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b8015cb90 0x7f6b800cfb10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6b700097a0 tx=0x7f6b7001c360 comp rx=0 tx=0).stop 2023-10-14T11:12:34.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.420+0000 7f6b8512a640 1 -- 172.21.15.26:0/2893418368 shutdown_connections 2023-10-14T11:12:34.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.420+0000 7f6b8512a640 1 --2- 172.21.15.26:0/2893418368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b8015cb90 0x7f6b800cfb10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:34.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.420+0000 7f6b8512a640 1 -- 172.21.15.26:0/2893418368 >> 172.21.15.26:0/2893418368 conn(0x7f6b8009bc50 msgr2=0x7f6b800d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:34.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.420+0000 7f6b8512a640 1 -- 172.21.15.26:0/2893418368 shutdown_connections 2023-10-14T11:12:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.420+0000 7f6b8512a640 1 -- 172.21.15.26:0/2893418368 wait complete. 2023-10-14T11:12:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b8512a640 1 Processor -- start 2023-10-14T11:12:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b8512a640 1 -- start start 2023-10-14T11:12:34.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b8512a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b800d15d0 0x7f6b800b7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:34.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b8512a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b800d3010 0x7f6b80145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b8512a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b8015cb90 0x7f6b80145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b8512a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b80153950 con 0x7f6b8015cb90 2023-10-14T11:12:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b8512a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b80159270 con 0x7f6b800d3010 2023-10-14T11:12:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b8512a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b80159550 con 0x7f6b800d15d0 2023-10-14T11:12:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b7f59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b8015cb90 0x7f6b80145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:34.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b7f59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b8015cb90 0x7f6b80145c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32830/0 (socket says 172.21.15.26:32830) 2023-10-14T11:12:34.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b7f59e640 1 -- 172.21.15.26:0/231889723 learned_addr learned my addr 172.21.15.26:0/231889723 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:34.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b7ed9d640 1 --2- 172.21.15.26:0/231889723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b800d15d0 0x7f6b800b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:34.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b7e59c640 1 --2- 172.21.15.26:0/231889723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b800d3010 0x7f6b80145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:34.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b7f59e640 1 -- 172.21.15.26:0/231889723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b800d15d0 msgr2=0x7f6b800b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:34.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b7f59e640 1 --2- 172.21.15.26:0/231889723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b800d15d0 0x7f6b800b7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b7f59e640 1 -- 172.21.15.26:0/231889723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b800d3010 msgr2=0x7f6b80145710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b7f59e640 1 --2- 172.21.15.26:0/231889723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b800d3010 0x7f6b80145710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b7f59e640 1 -- 172.21.15.26:0/231889723 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b700093b0 con 0x7f6b8015cb90 2023-10-14T11:12:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b7f59e640 1 --2- 172.21.15.26:0/231889723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b8015cb90 0x7f6b80145c50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800c780 tx=0x7f6b7800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b677fe640 1 -- 172.21.15.26:0/231889723 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b78003d90 con 0x7f6b8015cb90 2023-10-14T11:12:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b677fe640 1 -- 172.21.15.26:0/231889723 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7800ce90 con 0x7f6b8015cb90 2023-10-14T11:12:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b677fe640 1 -- 172.21.15.26:0/231889723 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b780052b0 con 0x7f6b8015cb90 2023-10-14T11:12:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b8512a640 1 -- 172.21.15.26:0/231889723 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b80159830 con 0x7f6b8015cb90 2023-10-14T11:12:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.424+0000 7f6b8512a640 1 -- 172.21.15.26:0/231889723 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b80159df0 con 0x7f6b8015cb90 2023-10-14T11:12:34.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.428+0000 7f6b8512a640 1 -- 172.21.15.26:0/231889723 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b8015a010 con 0x7f6b8015cb90 2023-10-14T11:12:34.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.428+0000 7f6b677fe640 1 -- 172.21.15.26:0/231889723 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6b78005410 con 0x7f6b8015cb90 2023-10-14T11:12:34.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.428+0000 7f6b677fe640 1 --2- 172.21.15.26:0/231889723 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6b6c0664a0 0x7f6b6c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:34.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.428+0000 7f6b677fe640 1 -- 172.21.15.26:0/231889723 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6b78083640 con 0x7f6b8015cb90 2023-10-14T11:12:34.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.428+0000 7f6b7ed9d640 1 --2- 172.21.15.26:0/231889723 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6b6c0664a0 0x7f6b6c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:34.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.428+0000 7f6b7ed9d640 1 --2- 172.21.15.26:0/231889723 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6b6c0664a0 0x7f6b6c068960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6b700af000 tx=0x7f6b700a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:34.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.432+0000 7f6b677fe640 1 -- 172.21.15.26:0/231889723 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6b780507e0 con 0x7f6b8015cb90 2023-10-14T11:12:34.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.592+0000 7f6b8512a640 1 -- 172.21.15.26:0/231889723 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b80074010 con 0x7f6b8015cb90 2023-10-14T11:12:34.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.596+0000 7f6b677fe640 1 -- 172.21.15.26:0/231889723 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f6b78053e00 con 0x7f6b8015cb90 2023-10-14T11:12:34.598 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:34.598 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":25,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:12:27.398936+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:12:34.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.596+0000 7f6b8512a640 1 -- 172.21.15.26:0/231889723 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6b6c0664a0 msgr2=0x7f6b6c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:34.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.596+0000 7f6b8512a640 1 --2- 172.21.15.26:0/231889723 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6b6c0664a0 0x7f6b6c068960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6b700af000 tx=0x7f6b700a7000 comp rx=0 tx=0).stop 2023-10-14T11:12:34.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.596+0000 7f6b8512a640 1 -- 172.21.15.26:0/231889723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b8015cb90 msgr2=0x7f6b80145c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:34.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.596+0000 7f6b8512a640 1 --2- 172.21.15.26:0/231889723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b8015cb90 0x7f6b80145c50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800c780 tx=0x7f6b7800cc40 comp rx=0 tx=0).stop 2023-10-14T11:12:34.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.596+0000 7f6b8512a640 1 -- 172.21.15.26:0/231889723 shutdown_connections 2023-10-14T11:12:34.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.596+0000 7f6b8512a640 1 --2- 172.21.15.26:0/231889723 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6b6c0664a0 0x7f6b6c068960 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:34.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.596+0000 7f6b8512a640 1 --2- 172.21.15.26:0/231889723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b8015cb90 0x7f6b80145c50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:34.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.596+0000 7f6b8512a640 1 --2- 172.21.15.26:0/231889723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b800d3010 0x7f6b80145710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:34.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.596+0000 7f6b8512a640 1 --2- 172.21.15.26:0/231889723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b800d15d0 0x7f6b800b7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:34.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.596+0000 7f6b8512a640 1 -- 172.21.15.26:0/231889723 >> 172.21.15.26:0/231889723 conn(0x7f6b8009bc50 msgr2=0x7f6b8015be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:34.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.596+0000 7f6b8512a640 1 -- 172.21.15.26:0/231889723 shutdown_connections 2023-10-14T11:12:34.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.596+0000 7f6b8512a640 1 -- 172.21.15.26:0/231889723 wait complete. 2023-10-14T11:12:34.619 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:12:20.179562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:12:21.346111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T11:12:25.025159+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T11:12:34.620 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:12:34.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.764+0000 7f31a5ac9640 1 Processor -- start 2023-10-14T11:12:34.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.764+0000 7f31a5ac9640 1 -- start start 2023-10-14T11:12:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.764+0000 7f31a5ac9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f31a006d010 0x7f31a00c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:34.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.764+0000 7f31a5ac9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f31a00c26b0 0x7f31a00c2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:34.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.764+0000 7f31a5ac9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a015ae30 con 0x7f31a0069e90 2023-10-14T11:12:34.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.764+0000 7f31a5ac9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a00cb090 con 0x7f31a00c26b0 2023-10-14T11:12:34.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.764+0000 7f31a5ac9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a006d470 con 0x7f31a006d010 2023-10-14T11:12:34.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.764+0000 7f319f7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f31a0069e90 0x7f31a006a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38288/0 (socket says 172.21.15.26:38288) 2023-10-14T11:12:34.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.764+0000 7f319ffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f31a00c26b0 0x7f31a00c2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:34.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.764+0000 7f319f7fe640 1 -- 172.21.15.26:0/2384275998 learned_addr learned my addr 172.21.15.26:0/2384275998 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:34.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.764+0000 7f319effd640 1 --2- 172.21.15.26:0/2384275998 >> v2:172.21.15.110:3300/0 conn(0x7f31a006d010 0x7f31a00c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:34.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.764+0000 7f319ffff640 1 -- 172.21.15.26:0/2384275998 >> v2:172.21.15.110:3300/0 conn(0x7f31a006d010 msgr2=0x7f31a00c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:34.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.764+0000 7f319ffff640 1 --2- 172.21.15.26:0/2384275998 >> v2:172.21.15.110:3300/0 conn(0x7f31a006d010 0x7f31a00c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:34.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.764+0000 7f319ffff640 1 -- 172.21.15.26:0/2384275998 >> v1:172.21.15.26:6789/0 conn(0x7f31a0069e90 legacy=0x7f31a006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:34.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.764+0000 7f319ffff640 1 -- 172.21.15.26:0/2384275998 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a00ca510 con 0x7f31a00c26b0 2023-10-14T11:12:34.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.764+0000 7f319effd640 1 --2- 172.21.15.26:0/2384275998 >> v2:172.21.15.110:3300/0 conn(0x7f31a006d010 0x7f31a00c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:34.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.764+0000 7f319e7fc640 1 -- 172.21.15.26:0/2384275998 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512679637 0 0) 0x7f31a015ae30 con 0x7f31a0069e90 2023-10-14T11:12:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.768+0000 7f319ffff640 1 --2- 172.21.15.26:0/2384275998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31a00c26b0 0x7f31a00c2b20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f31a006ada0 tx=0x7f319801f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325c9b5df246ba21 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.768+0000 7f319e7fc640 1 -- 172.21.15.26:0/2384275998 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31980b0440 con 0x7f31a00c26b0 2023-10-14T11:12:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.768+0000 7f319e7fc640 1 -- 172.21.15.26:0/2384275998 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31980b05a0 con 0x7f31a00c26b0 2023-10-14T11:12:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.768+0000 7f319e7fc640 1 -- 172.21.15.26:0/2384275998 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31980b0930 con 0x7f31a00c26b0 2023-10-14T11:12:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.768+0000 7f31a5ac9640 1 -- 172.21.15.26:0/2384275998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31a00c26b0 msgr2=0x7f31a00c2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:34.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.768+0000 7f31a5ac9640 1 --2- 172.21.15.26:0/2384275998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31a00c26b0 0x7f31a00c2b20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f31a006ada0 tx=0x7f319801f0f0 comp rx=0 tx=0).stop 2023-10-14T11:12:34.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.768+0000 7f31a5ac9640 1 -- 172.21.15.26:0/2384275998 shutdown_connections 2023-10-14T11:12:34.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.768+0000 7f31a5ac9640 1 --2- 172.21.15.26:0/2384275998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31a00c26b0 0x7f31a00c2b20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:34.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.768+0000 7f31a5ac9640 1 --2- 172.21.15.26:0/2384275998 >> v2:172.21.15.110:3300/0 conn(0x7f31a006d010 0x7f31a00c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:34.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.768+0000 7f31a5ac9640 1 -- 172.21.15.26:0/2384275998 >> 172.21.15.26:0/2384275998 conn(0x7f31a00b0da0 msgr2=0x7f31a00ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:34.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.768+0000 7f31a5ac9640 1 -- 172.21.15.26:0/2384275998 shutdown_connections 2023-10-14T11:12:34.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.768+0000 7f31a5ac9640 1 -- 172.21.15.26:0/2384275998 wait complete. 2023-10-14T11:12:34.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f31a5ac9640 1 Processor -- start 2023-10-14T11:12:34.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f31a5ac9640 1 -- start start 2023-10-14T11:12:34.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f31a5ac9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31a0069e90 0x7f31a00c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:34.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f31a5ac9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31a006d010 0x7f31a014d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:34.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f31a5ac9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31a00c26b0 0x7f31a014dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:34.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f31a5ac9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a00ad2d0 con 0x7f31a00c26b0 2023-10-14T11:12:34.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f31a5ac9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a00acff0 con 0x7f31a006d010 2023-10-14T11:12:34.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f31a5ac9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a00cc610 con 0x7f31a0069e90 2023-10-14T11:12:34.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f319ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31a00c26b0 0x7f31a014dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:34.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f319ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31a00c26b0 0x7f31a014dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32844/0 (socket says 172.21.15.26:32844) 2023-10-14T11:12:34.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f319ffff640 1 -- 172.21.15.26:0/722831331 learned_addr learned my addr 172.21.15.26:0/722831331 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:34.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f319f7fe640 1 --2- 172.21.15.26:0/722831331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31a0069e90 0x7f31a00c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:34.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f319effd640 1 --2- 172.21.15.26:0/722831331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31a006d010 0x7f31a014d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:34.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f319ffff640 1 -- 172.21.15.26:0/722831331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31a0069e90 msgr2=0x7f31a00c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:34.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f319ffff640 1 --2- 172.21.15.26:0/722831331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31a0069e90 0x7f31a00c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:34.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f319ffff640 1 -- 172.21.15.26:0/722831331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31a006d010 msgr2=0x7f31a014d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:34.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f319ffff640 1 --2- 172.21.15.26:0/722831331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31a006d010 0x7f31a014d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:34.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f319ffff640 1 -- 172.21.15.26:0/722831331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3198009a70 con 0x7f31a00c26b0 2023-10-14T11:12:34.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f319ffff640 1 --2- 172.21.15.26:0/722831331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31a00c26b0 0x7f31a014dd00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f319801bd00 tx=0x7f319801be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:34.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f3187fff640 1 -- 172.21.15.26:0/722831331 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31980c2070 con 0x7f31a00c26b0 2023-10-14T11:12:34.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f3187fff640 1 -- 172.21.15.26:0/722831331 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3198009450 con 0x7f31a00c26b0 2023-10-14T11:12:34.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f3187fff640 1 -- 172.21.15.26:0/722831331 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31980b0440 con 0x7f31a00c26b0 2023-10-14T11:12:34.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f31a5ac9640 1 -- 172.21.15.26:0/722831331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a00cc8f0 con 0x7f31a00c26b0 2023-10-14T11:12:34.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f31a5ac9640 1 -- 172.21.15.26:0/722831331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a00c6800 con 0x7f31a00c26b0 2023-10-14T11:12:34.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.772+0000 7f31a5ac9640 1 -- 172.21.15.26:0/722831331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a00c69f0 con 0x7f31a00c26b0 2023-10-14T11:12:34.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.776+0000 7f3187fff640 1 -- 172.21.15.26:0/722831331 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f31980b7050 con 0x7f31a00c26b0 2023-10-14T11:12:34.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.776+0000 7f3187fff640 1 --2- 172.21.15.26:0/722831331 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f318c0664a0 0x7f318c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:34.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.776+0000 7f3187fff640 1 -- 172.21.15.26:0/722831331 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f31981220d0 con 0x7f31a00c26b0 2023-10-14T11:12:34.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.776+0000 7f319f7fe640 1 --2- 172.21.15.26:0/722831331 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f318c0664a0 0x7f318c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:34.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.776+0000 7f319f7fe640 1 --2- 172.21.15.26:0/722831331 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f318c0664a0 0x7f318c068960 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3190007fd0 tx=0x7f3190007d60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:34.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.780+0000 7f3187fff640 1 -- 172.21.15.26:0/722831331 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f31a00c69f0 con 0x7f31a00c26b0 2023-10-14T11:12:34.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.936+0000 7f31a5ac9640 1 -- 172.21.15.26:0/722831331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f31a00cc470 con 0x7f31a00c26b0 2023-10-14T11:12:34.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.936+0000 7f3187fff640 1 -- 172.21.15.26:0/722831331 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f31a00cc470 con 0x7f31a00c26b0 2023-10-14T11:12:34.938 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:12:34.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.936+0000 7f31a5ac9640 1 -- 172.21.15.26:0/722831331 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f318c0664a0 msgr2=0x7f318c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:34.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.936+0000 7f31a5ac9640 1 --2- 172.21.15.26:0/722831331 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f318c0664a0 0x7f318c068960 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3190007fd0 tx=0x7f3190007d60 comp rx=0 tx=0).stop 2023-10-14T11:12:34.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.936+0000 7f31a5ac9640 1 -- 172.21.15.26:0/722831331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31a00c26b0 msgr2=0x7f31a014dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:34.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.936+0000 7f31a5ac9640 1 --2- 172.21.15.26:0/722831331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31a00c26b0 0x7f31a014dd00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f319801bd00 tx=0x7f319801be90 comp rx=0 tx=0).stop 2023-10-14T11:12:34.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.936+0000 7f31a5ac9640 1 -- 172.21.15.26:0/722831331 shutdown_connections 2023-10-14T11:12:34.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.936+0000 7f31a5ac9640 1 --2- 172.21.15.26:0/722831331 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f318c0664a0 0x7f318c068960 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:34.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.936+0000 7f31a5ac9640 1 --2- 172.21.15.26:0/722831331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31a00c26b0 0x7f31a014dd00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:34.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.936+0000 7f31a5ac9640 1 --2- 172.21.15.26:0/722831331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31a006d010 0x7f31a014d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:34.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.936+0000 7f31a5ac9640 1 --2- 172.21.15.26:0/722831331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31a0069e90 0x7f31a00c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:34.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.936+0000 7f31a5ac9640 1 -- 172.21.15.26:0/722831331 >> 172.21.15.26:0/722831331 conn(0x7f31a00b0da0 msgr2=0x7f31a00c2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:34.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.936+0000 7f31a5ac9640 1 -- 172.21.15.26:0/722831331 shutdown_connections 2023-10-14T11:12:34.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:34.936+0000 7f31a5ac9640 1 -- 172.21.15.26:0/722831331 wait complete. 2023-10-14T11:12:34.959 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:12:35.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb88ea640 1 Processor -- start 2023-10-14T11:12:35.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb88ea640 1 -- start start 2023-10-14T11:12:35.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb88ea640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6cb40b84e0 0x7f6cb40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:35.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb88ea640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb40d1670 con 0x7f6cb415cba0 2023-10-14T11:12:35.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb88ea640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb40d1950 con 0x7f6cb40d0210 2023-10-14T11:12:35.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb88ea640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb40d1460 con 0x7f6cb40b84e0 2023-10-14T11:12:35.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb259c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6cb415cba0 0x7f6cb40cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38302/0 (socket says 172.21.15.26:38302) 2023-10-14T11:12:35.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb259c640 1 -- 172.21.15.26:0/2460877077 learned_addr learned my addr 172.21.15.26:0/2460877077 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:35.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb1d9b640 1 -- 172.21.15.26:0/2460877077 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251711775 0 0) 0x7f6cb40d1670 con 0x7f6cb415cba0 2023-10-14T11:12:35.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb1d9b640 1 -- 172.21.15.26:0/2460877077 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ca0003530 con 0x7f6cb415cba0 2023-10-14T11:12:35.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb2d9d640 1 --2- 172.21.15.26:0/2460877077 >> v2:172.21.15.110:3300/0 conn(0x7f6cb40b84e0 0x7f6cb40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:35.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb1d9b640 1 -- 172.21.15.26:0/2460877077 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4117566177 0 0) 0x7f6ca0003530 con 0x7f6cb415cba0 2023-10-14T11:12:35.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb1d9b640 1 -- 172.21.15.26:0/2460877077 >> v2:172.21.15.110:3300/0 conn(0x7f6cb40b84e0 msgr2=0x7f6cb40d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:35.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb1d9b640 1 --2- 172.21.15.26:0/2460877077 >> v2:172.21.15.110:3300/0 conn(0x7f6cb40b84e0 0x7f6cb40d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb1d9b640 1 -- 172.21.15.26:0/2460877077 >> v1:172.21.15.110:6789/0 conn(0x7f6cb40d0210 legacy=0x7f6cb40b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:35.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb1d9b640 1 -- 172.21.15.26:0/2460877077 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb40d1c30 con 0x7f6cb415cba0 2023-10-14T11:12:35.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb1d9b640 1 -- 172.21.15.26:0/2460877077 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f6ca4001680 con 0x7f6cb415cba0 2023-10-14T11:12:35.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb1d9b640 1 -- 172.21.15.26:0/2460877077 >> v1:172.21.15.26:6789/0 conn(0x7f6cb415cba0 legacy=0x7f6cb40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:35.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb1d9b640 1 --2- 172.21.15.26:0/2460877077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ca00039d0 0x7f6ca0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:35.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb1d9b640 1 --2- 172.21.15.26:0/2460877077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ca00047d0 0x7f6ca0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:35.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb1d9b640 1 --2- 172.21.15.26:0/2460877077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ca00051e0 0x7f6ca000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:35.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb1d9b640 1 -- 172.21.15.26:0/2460877077 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb40d1460 con 0x7f6ca00051e0 2023-10-14T11:12:35.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb1d9b640 1 -- 172.21.15.26:0/2460877077 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca000c130 con 0x7f6ca00047d0 2023-10-14T11:12:35.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb1d9b640 1 -- 172.21.15.26:0/2460877077 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca000c2f0 con 0x7f6ca00039d0 2023-10-14T11:12:35.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb259c640 1 --2- 172.21.15.26:0/2460877077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ca00039d0 0x7f6ca0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:35.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cabfff640 1 --2- 172.21.15.26:0/2460877077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ca00047d0 0x7f6ca0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:35.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.108+0000 7f6cb2d9d640 1 --2- 172.21.15.26:0/2460877077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ca00051e0 0x7f6ca000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:35.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.112+0000 7f6cabfff640 1 -- 172.21.15.26:0/2460877077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ca00039d0 msgr2=0x7f6ca0003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:35.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.112+0000 7f6cabfff640 1 --2- 172.21.15.26:0/2460877077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ca00039d0 0x7f6ca0003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.112+0000 7f6cabfff640 1 -- 172.21.15.26:0/2460877077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ca00051e0 msgr2=0x7f6ca000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:35.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.112+0000 7f6cabfff640 1 --2- 172.21.15.26:0/2460877077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ca00051e0 0x7f6ca000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.112+0000 7f6cabfff640 1 -- 172.21.15.26:0/2460877077 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca0003530 con 0x7f6ca00047d0 2023-10-14T11:12:35.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.112+0000 7f6cb2d9d640 1 --2- 172.21.15.26:0/2460877077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ca00051e0 0x7f6ca000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:12:35.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.112+0000 7f6cb2d9d640 1 -- 172.21.15.26:0/2460877077 reap_dead start 2023-10-14T11:12:35.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.112+0000 7f6cabfff640 1 --2- 172.21.15.26:0/2460877077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ca00047d0 0x7f6ca0004c50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40b5aa0 tx=0x7f6c9c01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a786b10cd98b4c24 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:35.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.112+0000 7f6cb1d9b640 1 -- 172.21.15.26:0/2460877077 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c0052d0 con 0x7f6ca00047d0 2023-10-14T11:12:35.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.112+0000 7f6cb1d9b640 1 -- 172.21.15.26:0/2460877077 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9c0a7050 con 0x7f6ca00047d0 2023-10-14T11:12:35.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.112+0000 7f6cb1d9b640 1 -- 172.21.15.26:0/2460877077 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c003600 con 0x7f6ca00047d0 2023-10-14T11:12:35.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.112+0000 7f6cb88ea640 1 -- 172.21.15.26:0/2460877077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ca00047d0 msgr2=0x7f6ca0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:35.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.112+0000 7f6cb88ea640 1 --2- 172.21.15.26:0/2460877077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ca00047d0 0x7f6ca0004c50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40b5aa0 tx=0x7f6c9c01c380 comp rx=0 tx=0).stop 2023-10-14T11:12:35.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb88ea640 1 -- 172.21.15.26:0/2460877077 shutdown_connections 2023-10-14T11:12:35.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb88ea640 1 --2- 172.21.15.26:0/2460877077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ca00047d0 0x7f6ca0004c50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb88ea640 1 -- 172.21.15.26:0/2460877077 >> 172.21.15.26:0/2460877077 conn(0x7f6cb40719c0 msgr2=0x7f6cb4071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:35.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb88ea640 1 -- 172.21.15.26:0/2460877077 shutdown_connections 2023-10-14T11:12:35.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb88ea640 1 -- 172.21.15.26:0/2460877077 wait complete. 2023-10-14T11:12:35.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb88ea640 1 Processor -- start 2023-10-14T11:12:35.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb88ea640 1 -- start start 2023-10-14T11:12:35.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb88ea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ca00047d0 0x7f6cb41537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:35.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb88ea640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cb40cde30 0x7f6cb4153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:35.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb88ea640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6cb41f22b0 0x7f6cb415ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:35.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb88ea640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb41f3280 con 0x7f6ca00047d0 2023-10-14T11:12:35.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb88ea640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb41f2cc0 con 0x7f6cb40cde30 2023-10-14T11:12:35.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb88ea640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb41f2fa0 con 0x7f6cb41f22b0 2023-10-14T11:12:35.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ca00047d0 0x7f6cb41537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:35.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ca00047d0 0x7f6cb41537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32864/0 (socket says 172.21.15.26:32864) 2023-10-14T11:12:35.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb259c640 1 -- 172.21.15.26:0/2919975044 learned_addr learned my addr 172.21.15.26:0/2919975044 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:35.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb2d9d640 1 --2- 172.21.15.26:0/2919975044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6cb41f22b0 0x7f6cb415ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:35.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cabfff640 1 --2- 172.21.15.26:0/2919975044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cb40cde30 0x7f6cb4153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:35.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb259c640 1 -- 172.21.15.26:0/2919975044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6cb41f22b0 msgr2=0x7f6cb415ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:35.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb259c640 1 --2- 172.21.15.26:0/2919975044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6cb41f22b0 0x7f6cb415ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb259c640 1 -- 172.21.15.26:0/2919975044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cb40cde30 msgr2=0x7f6cb4153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:35.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb259c640 1 --2- 172.21.15.26:0/2919975044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cb40cde30 0x7f6cb4153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb259c640 1 -- 172.21.15.26:0/2919975044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb415d120 con 0x7f6ca00047d0 2023-10-14T11:12:35.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.116+0000 7f6cb259c640 1 --2- 172.21.15.26:0/2919975044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ca00047d0 0x7f6cb41537a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6ca40017b0 tx=0x7f6ca4012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:35.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.120+0000 7f6caaffd640 1 -- 172.21.15.26:0/2919975044 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4014810 con 0x7f6ca00047d0 2023-10-14T11:12:35.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.120+0000 7f6caaffd640 1 -- 172.21.15.26:0/2919975044 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca4014970 con 0x7f6ca00047d0 2023-10-14T11:12:35.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.120+0000 7f6caaffd640 1 -- 172.21.15.26:0/2919975044 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4014d20 con 0x7f6ca00047d0 2023-10-14T11:12:35.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.120+0000 7f6cb88ea640 1 -- 172.21.15.26:0/2919975044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb415d400 con 0x7f6ca00047d0 2023-10-14T11:12:35.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.120+0000 7f6cb88ea640 1 -- 172.21.15.26:0/2919975044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb41f2900 con 0x7f6ca00047d0 2023-10-14T11:12:35.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.120+0000 7f6cb88ea640 1 -- 172.21.15.26:0/2919975044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb415cf80 con 0x7f6ca00047d0 2023-10-14T11:12:35.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.120+0000 7f6caaffd640 1 -- 172.21.15.26:0/2919975044 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6ca40153e0 con 0x7f6ca00047d0 2023-10-14T11:12:35.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.120+0000 7f6caaffd640 1 --2- 172.21.15.26:0/2919975044 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6c940664a0 0x7f6c94068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:35.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.120+0000 7f6caaffd640 1 -- 172.21.15.26:0/2919975044 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6ca40869d0 con 0x7f6ca00047d0 2023-10-14T11:12:35.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.120+0000 7f6cabfff640 1 --2- 172.21.15.26:0/2919975044 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6c940664a0 0x7f6c94068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:35.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.124+0000 7f6cabfff640 1 --2- 172.21.15.26:0/2919975044 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6c940664a0 0x7f6c94068960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0004750 tx=0x7f6c9c0011a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:35.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.124+0000 7f6caaffd640 1 -- 172.21.15.26:0/2919975044 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6cb415cf80 con 0x7f6ca00047d0 2023-10-14T11:12:35.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.284+0000 7f6cb88ea640 1 -- 172.21.15.26:0/2919975044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6cb415cf80 con 0x7f6ca00047d0 2023-10-14T11:12:35.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.284+0000 7f6caaffd640 1 -- 172.21.15.26:0/2919975044 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6ca401c020 con 0x7f6ca00047d0 2023-10-14T11:12:35.287 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:12:35.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.284+0000 7f6cb88ea640 1 -- 172.21.15.26:0/2919975044 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6c940664a0 msgr2=0x7f6c94068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:35.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.284+0000 7f6cb88ea640 1 --2- 172.21.15.26:0/2919975044 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6c940664a0 0x7f6c94068960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0004750 tx=0x7f6c9c0011a0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.284+0000 7f6cb88ea640 1 -- 172.21.15.26:0/2919975044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ca00047d0 msgr2=0x7f6cb41537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:35.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.284+0000 7f6cb88ea640 1 --2- 172.21.15.26:0/2919975044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ca00047d0 0x7f6cb41537a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6ca40017b0 tx=0x7f6ca4012920 comp rx=0 tx=0).stop 2023-10-14T11:12:35.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.284+0000 7f6cb88ea640 1 -- 172.21.15.26:0/2919975044 shutdown_connections 2023-10-14T11:12:35.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.284+0000 7f6cb88ea640 1 --2- 172.21.15.26:0/2919975044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6cb41f22b0 0x7f6cb415ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.284+0000 7f6cb88ea640 1 --2- 172.21.15.26:0/2919975044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cb40cde30 0x7f6cb4153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.284+0000 7f6cb88ea640 1 --2- 172.21.15.26:0/2919975044 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6c940664a0 0x7f6c94068960 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.284+0000 7f6cb88ea640 1 --2- 172.21.15.26:0/2919975044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ca00047d0 0x7f6cb41537a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.284+0000 7f6cb88ea640 1 -- 172.21.15.26:0/2919975044 >> 172.21.15.26:0/2919975044 conn(0x7f6cb40719c0 msgr2=0x7f6cb415b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:35.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.284+0000 7f6cb88ea640 1 -- 172.21.15.26:0/2919975044 shutdown_connections 2023-10-14T11:12:35.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.284+0000 7f6cb88ea640 1 -- 172.21.15.26:0/2919975044 wait complete. 2023-10-14T11:12:35.307 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:12:35.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.448+0000 7f26a4e09640 1 Processor -- start 2023-10-14T11:12:35.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.448+0000 7f26a4e09640 1 -- start start 2023-10-14T11:12:35.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.452+0000 7f26a4e09640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f26a00b3cb0 0x7f26a00cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:35.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.452+0000 7f26a4e09640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a00d0880 con 0x7f26a015cdc0 2023-10-14T11:12:35.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.452+0000 7f26a4e09640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a00b1c00 con 0x7f26a00cf210 2023-10-14T11:12:35.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.452+0000 7f26a4e09640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a00b1ee0 con 0x7f26a00b3cb0 2023-10-14T11:12:35.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.452+0000 7f269effd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f26a015cdc0 0x7f26a00cd4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38314/0 (socket says 172.21.15.26:38314) 2023-10-14T11:12:35.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.452+0000 7f269effd640 1 -- 172.21.15.26:0/1732625819 learned_addr learned my addr 172.21.15.26:0/1732625819 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:35.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.452+0000 7f269ffff640 1 --2- 172.21.15.26:0/1732625819 >> v2:172.21.15.26:3300/0 conn(0x7f26a00b3cb0 0x7f26a00cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:35.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.452+0000 7f269ffff640 1 -- 172.21.15.26:0/1732625819 >> v1:172.21.15.110:6789/0 conn(0x7f26a00cf210 legacy=0x7f26a00cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:35.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.452+0000 7f269ffff640 1 -- 172.21.15.26:0/1732625819 >> v1:172.21.15.26:6789/0 conn(0x7f26a015cdc0 legacy=0x7f26a00cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:35.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.452+0000 7f269ffff640 1 -- 172.21.15.26:0/1732625819 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a00b21c0 con 0x7f26a00b3cb0 2023-10-14T11:12:35.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.452+0000 7f269e7fc640 1 -- 172.21.15.26:0/1732625819 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 139785659 0 0) 0x7f26a00d0880 con 0x7f26a015cdc0 2023-10-14T11:12:35.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.456+0000 7f269ffff640 1 --2- 172.21.15.26:0/1732625819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26a00b3cb0 0x7f26a00cdbd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2698009d90 tx=0x7f269801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8df337627de552c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:35.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.456+0000 7f269e7fc640 1 -- 172.21.15.26:0/1732625819 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26980a58f0 con 0x7f26a00b3cb0 2023-10-14T11:12:35.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.456+0000 7f269e7fc640 1 -- 172.21.15.26:0/1732625819 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26980a5a50 con 0x7f26a00b3cb0 2023-10-14T11:12:35.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.456+0000 7f269e7fc640 1 -- 172.21.15.26:0/1732625819 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26980a5de0 con 0x7f26a00b3cb0 2023-10-14T11:12:35.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.456+0000 7f26a4e09640 1 -- 172.21.15.26:0/1732625819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26a00b3cb0 msgr2=0x7f26a00cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:35.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.456+0000 7f26a4e09640 1 --2- 172.21.15.26:0/1732625819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26a00b3cb0 0x7f26a00cdbd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2698009d90 tx=0x7f269801c920 comp rx=0 tx=0).stop 2023-10-14T11:12:35.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.456+0000 7f26a4e09640 1 -- 172.21.15.26:0/1732625819 shutdown_connections 2023-10-14T11:12:35.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.456+0000 7f26a4e09640 1 --2- 172.21.15.26:0/1732625819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26a00b3cb0 0x7f26a00cdbd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.456+0000 7f26a4e09640 1 -- 172.21.15.26:0/1732625819 >> 172.21.15.26:0/1732625819 conn(0x7f26a00d2800 msgr2=0x7f26a00d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:35.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.456+0000 7f26a4e09640 1 -- 172.21.15.26:0/1732625819 shutdown_connections 2023-10-14T11:12:35.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.456+0000 7f26a4e09640 1 -- 172.21.15.26:0/1732625819 wait complete. 2023-10-14T11:12:35.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.456+0000 7f26a4e09640 1 Processor -- start 2023-10-14T11:12:35.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.456+0000 7f26a4e09640 1 -- start start 2023-10-14T11:12:35.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.456+0000 7f26a4e09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26a00b3cb0 0x7f26a014c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:35.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.456+0000 7f26a4e09640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26a00cf210 0x7f26a01544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:35.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.456+0000 7f26a4e09640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26a015cdc0 0x7f26a00c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:35.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.456+0000 7f26a4e09640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a0157cf0 con 0x7f26a00b3cb0 2023-10-14T11:12:35.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.456+0000 7f26a4e09640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a01570e0 con 0x7f26a00cf210 2023-10-14T11:12:35.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.456+0000 7f26a4e09640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a01573c0 con 0x7f26a015cdc0 2023-10-14T11:12:35.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.460+0000 7f269f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26a00b3cb0 0x7f26a014c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:35.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.460+0000 7f269f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26a00b3cb0 0x7f26a014c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32884/0 (socket says 172.21.15.26:32884) 2023-10-14T11:12:35.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.460+0000 7f269f7fe640 1 -- 172.21.15.26:0/3072838030 learned_addr learned my addr 172.21.15.26:0/3072838030 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:35.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.460+0000 7f269effd640 1 --2- 172.21.15.26:0/3072838030 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26a00cf210 0x7f26a01544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:35.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.460+0000 7f269ffff640 1 --2- 172.21.15.26:0/3072838030 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26a015cdc0 0x7f26a00c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:35.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.460+0000 7f269f7fe640 1 -- 172.21.15.26:0/3072838030 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26a015cdc0 msgr2=0x7f26a00c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:35.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.460+0000 7f269f7fe640 1 --2- 172.21.15.26:0/3072838030 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26a015cdc0 0x7f26a00c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.460+0000 7f269f7fe640 1 -- 172.21.15.26:0/3072838030 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26a00cf210 msgr2=0x7f26a01544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:35.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.460+0000 7f269f7fe640 1 --2- 172.21.15.26:0/3072838030 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26a00cf210 0x7f26a01544b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.460+0000 7f269f7fe640 1 -- 172.21.15.26:0/3072838030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2698009a70 con 0x7f26a00b3cb0 2023-10-14T11:12:35.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.460+0000 7f269f7fe640 1 --2- 172.21.15.26:0/3072838030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26a00b3cb0 0x7f26a014c630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f269000c450 tx=0x7f269000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:35.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.460+0000 7f2687fff640 1 -- 172.21.15.26:0/3072838030 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26900052d0 con 0x7f26a00b3cb0 2023-10-14T11:12:35.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.460+0000 7f2687fff640 1 -- 172.21.15.26:0/3072838030 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2690005430 con 0x7f26a00b3cb0 2023-10-14T11:12:35.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.460+0000 7f26a4e09640 1 -- 172.21.15.26:0/3072838030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a01576a0 con 0x7f26a00b3cb0 2023-10-14T11:12:35.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.460+0000 7f2687fff640 1 -- 172.21.15.26:0/3072838030 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2690003890 con 0x7f26a00b3cb0 2023-10-14T11:12:35.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.460+0000 7f26a4e09640 1 -- 172.21.15.26:0/3072838030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a014cb70 con 0x7f26a00b3cb0 2023-10-14T11:12:35.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.460+0000 7f26a4e09640 1 -- 172.21.15.26:0/3072838030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a004e9c0 con 0x7f26a00b3cb0 2023-10-14T11:12:35.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.460+0000 7f2687fff640 1 -- 172.21.15.26:0/3072838030 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f26900039f0 con 0x7f26a00b3cb0 2023-10-14T11:12:35.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.464+0000 7f2687fff640 1 --2- 172.21.15.26:0/3072838030 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f268c0664a0 0x7f268c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:35.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.464+0000 7f2687fff640 1 -- 172.21.15.26:0/3072838030 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2690083bb0 con 0x7f26a00b3cb0 2023-10-14T11:12:35.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.464+0000 7f269effd640 1 --2- 172.21.15.26:0/3072838030 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f268c0664a0 0x7f268c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:35.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.464+0000 7f269effd640 1 --2- 172.21.15.26:0/3072838030 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f268c0664a0 0x7f268c068960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f26a01f85d0 tx=0x7f2694007240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:35.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.468+0000 7f2687fff640 1 -- 172.21.15.26:0/3072838030 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2690050df0 con 0x7f26a00b3cb0 2023-10-14T11:12:35.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.620+0000 7f26a4e09640 1 -- 172.21.15.26:0/3072838030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f26a00d0bc0 con 0x7f26a00b3cb0 2023-10-14T11:12:35.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.620+0000 7f2687fff640 1 -- 172.21.15.26:0/3072838030 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2690054410 con 0x7f26a00b3cb0 2023-10-14T11:12:35.625 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:12:35.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.624+0000 7f26a4e09640 1 -- 172.21.15.26:0/3072838030 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f268c0664a0 msgr2=0x7f268c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:35.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.624+0000 7f26a4e09640 1 --2- 172.21.15.26:0/3072838030 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f268c0664a0 0x7f268c068960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f26a01f85d0 tx=0x7f2694007240 comp rx=0 tx=0).stop 2023-10-14T11:12:35.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.624+0000 7f26a4e09640 1 -- 172.21.15.26:0/3072838030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26a00b3cb0 msgr2=0x7f26a014c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:35.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.624+0000 7f26a4e09640 1 --2- 172.21.15.26:0/3072838030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26a00b3cb0 0x7f26a014c630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f269000c450 tx=0x7f269000c910 comp rx=0 tx=0).stop 2023-10-14T11:12:35.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.624+0000 7f26a4e09640 1 -- 172.21.15.26:0/3072838030 shutdown_connections 2023-10-14T11:12:35.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.624+0000 7f26a4e09640 1 --2- 172.21.15.26:0/3072838030 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26a015cdc0 0x7f26a00c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.624+0000 7f26a4e09640 1 --2- 172.21.15.26:0/3072838030 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26a00cf210 0x7f26a01544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.624+0000 7f26a4e09640 1 --2- 172.21.15.26:0/3072838030 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f268c0664a0 0x7f268c068960 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.624+0000 7f26a4e09640 1 --2- 172.21.15.26:0/3072838030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26a00b3cb0 0x7f26a014c630 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.624+0000 7f26a4e09640 1 -- 172.21.15.26:0/3072838030 >> 172.21.15.26:0/3072838030 conn(0x7f26a00d2800 msgr2=0x7f26a00d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:35.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.624+0000 7f26a4e09640 1 -- 172.21.15.26:0/3072838030 shutdown_connections 2023-10-14T11:12:35.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.624+0000 7f26a4e09640 1 -- 172.21.15.26:0/3072838030 wait complete. 2023-10-14T11:12:35.646 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T11:12:35.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.788+0000 7f4ae230f640 1 Processor -- start 2023-10-14T11:12:35.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.788+0000 7f4ae230f640 1 -- start start 2023-10-14T11:12:35.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.788+0000 7f4ae230f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4adc15cba0 0x7f4adc0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:35.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.788+0000 7f4ae230f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4adc0d1670 con 0x7f4adc0d0210 2023-10-14T11:12:35.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.788+0000 7f4ae230f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4adc0d1950 con 0x7f4adc0b84e0 2023-10-14T11:12:35.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.788+0000 7f4ae230f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4adc0d1460 con 0x7f4adc15cba0 2023-10-14T11:12:35.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.788+0000 7f4ae08ac640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4adc0d0210 0x7f4adc0b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38320/0 (socket says 172.21.15.26:38320) 2023-10-14T11:12:35.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.788+0000 7f4ae08ac640 1 -- 172.21.15.26:0/926190670 learned_addr learned my addr 172.21.15.26:0/926190670 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:35.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.788+0000 7f4adbfff640 1 --2- 172.21.15.26:0/926190670 >> v2:172.21.15.110:3300/0 conn(0x7f4adc15cba0 0x7f4adc0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:35.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.792+0000 7f4adaffd640 1 -- 172.21.15.26:0/926190670 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806876857 0 0) 0x7f4adc0d1670 con 0x7f4adc0d0210 2023-10-14T11:12:35.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.792+0000 7f4adaffd640 1 -- 172.21.15.26:0/926190670 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ac4003530 con 0x7f4adc0d0210 2023-10-14T11:12:35.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.792+0000 7f4adaffd640 1 -- 172.21.15.26:0/926190670 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64673882 0 0) 0x7f4adc0d1950 con 0x7f4adc0b84e0 2023-10-14T11:12:35.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.792+0000 7f4adaffd640 1 -- 172.21.15.26:0/926190670 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4adc0d1670 con 0x7f4adc0b84e0 2023-10-14T11:12:35.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.792+0000 7f4adbfff640 1 -- 172.21.15.26:0/926190670 >> v1:172.21.15.110:6789/0 conn(0x7f4adc0b84e0 legacy=0x7f4adc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:35.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.792+0000 7f4adbfff640 1 -- 172.21.15.26:0/926190670 >> v1:172.21.15.26:6789/0 conn(0x7f4adc0d0210 legacy=0x7f4adc0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:35.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.792+0000 7f4adaffd640 1 -- 172.21.15.26:0/926190670 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2434185657 0 0) 0x7f4ac4003530 con 0x7f4adc0d0210 2023-10-14T11:12:35.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.792+0000 7f4adbfff640 1 -- 172.21.15.26:0/926190670 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4adc0d1c30 con 0x7f4adc15cba0 2023-10-14T11:12:35.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.792+0000 7f4adbfff640 1 --2- 172.21.15.26:0/926190670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4adc15cba0 0x7f4adc0d0f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0097c0 tx=0x7f4acc01c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45fd8ec27b5a1a1d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:35.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.792+0000 7f4adaffd640 1 -- 172.21.15.26:0/926190670 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4001a00 con 0x7f4adc15cba0 2023-10-14T11:12:35.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.792+0000 7f4adaffd640 1 -- 172.21.15.26:0/926190670 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4acc0a7050 con 0x7f4adc15cba0 2023-10-14T11:12:35.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.792+0000 7f4adaffd640 1 -- 172.21.15.26:0/926190670 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc0ab620 con 0x7f4adc15cba0 2023-10-14T11:12:35.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae230f640 1 -- 172.21.15.26:0/926190670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4adc15cba0 msgr2=0x7f4adc0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:35.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae230f640 1 --2- 172.21.15.26:0/926190670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4adc15cba0 0x7f4adc0d0f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0097c0 tx=0x7f4acc01c310 comp rx=0 tx=0).stop 2023-10-14T11:12:35.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae230f640 1 -- 172.21.15.26:0/926190670 shutdown_connections 2023-10-14T11:12:35.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae230f640 1 --2- 172.21.15.26:0/926190670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4adc15cba0 0x7f4adc0d0f20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae230f640 1 -- 172.21.15.26:0/926190670 >> 172.21.15.26:0/926190670 conn(0x7f4adc0719c0 msgr2=0x7f4adc071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:35.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae230f640 1 -- 172.21.15.26:0/926190670 shutdown_connections 2023-10-14T11:12:35.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae230f640 1 -- 172.21.15.26:0/926190670 wait complete. 2023-10-14T11:12:35.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae230f640 1 Processor -- start 2023-10-14T11:12:35.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae230f640 1 -- start start 2023-10-14T11:12:35.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae230f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4adc0b84e0 0x7f4adc15e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:35.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae230f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4adc0d0210 0x7f4adc14eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:35.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae230f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4adc15cba0 0x7f4adc14f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:35.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae230f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc0c7b40 con 0x7f4adc15cba0 2023-10-14T11:12:35.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae230f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc0c6ec0 con 0x7f4adc0b84e0 2023-10-14T11:12:35.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae230f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc0c71a0 con 0x7f4adc0d0210 2023-10-14T11:12:35.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae08ac640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4adc15cba0 0x7f4adc14f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:35.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae08ac640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4adc15cba0 0x7f4adc14f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32886/0 (socket says 172.21.15.26:32886) 2023-10-14T11:12:35.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae08ac640 1 -- 172.21.15.26:0/232299871 learned_addr learned my addr 172.21.15.26:0/232299871 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:35.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4adbfff640 1 --2- 172.21.15.26:0/232299871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4adc0b84e0 0x7f4adc15e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:35.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4adb7fe640 1 --2- 172.21.15.26:0/232299871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4adc0d0210 0x7f4adc14eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:35.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae08ac640 1 -- 172.21.15.26:0/232299871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4adc0d0210 msgr2=0x7f4adc14eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:35.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae08ac640 1 --2- 172.21.15.26:0/232299871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4adc0d0210 0x7f4adc14eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae08ac640 1 -- 172.21.15.26:0/232299871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4adc0b84e0 msgr2=0x7f4adc15e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:35.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae08ac640 1 --2- 172.21.15.26:0/232299871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4adc0b84e0 0x7f4adc15e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.796+0000 7f4ae08ac640 1 -- 172.21.15.26:0/232299871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc009420 con 0x7f4adc15cba0 2023-10-14T11:12:35.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.800+0000 7f4ae08ac640 1 --2- 172.21.15.26:0/232299871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4adc15cba0 0x7f4adc14f070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4001fb0 tx=0x7f4ad400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:35.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.800+0000 7f4ad8ff9640 1 -- 172.21.15.26:0/232299871 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4012400 con 0x7f4adc15cba0 2023-10-14T11:12:35.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.800+0000 7f4ad8ff9640 1 -- 172.21.15.26:0/232299871 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad4012560 con 0x7f4adc15cba0 2023-10-14T11:12:35.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.800+0000 7f4ae230f640 1 -- 172.21.15.26:0/232299871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4adc0c7480 con 0x7f4adc15cba0 2023-10-14T11:12:35.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.800+0000 7f4ad8ff9640 1 -- 172.21.15.26:0/232299871 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4012910 con 0x7f4adc15cba0 2023-10-14T11:12:35.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.800+0000 7f4ae230f640 1 -- 172.21.15.26:0/232299871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4adc15ea30 con 0x7f4adc15cba0 2023-10-14T11:12:35.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.800+0000 7f4ae230f640 1 -- 172.21.15.26:0/232299871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4adc0cada0 con 0x7f4adc15cba0 2023-10-14T11:12:35.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.800+0000 7f4ad8ff9640 1 -- 172.21.15.26:0/232299871 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4ad4012a70 con 0x7f4adc15cba0 2023-10-14T11:12:35.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.800+0000 7f4ad8ff9640 1 --2- 172.21.15.26:0/232299871 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4ac80664a0 0x7f4ac8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:35.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.800+0000 7f4ad8ff9640 1 -- 172.21.15.26:0/232299871 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4ad4084b00 con 0x7f4adc15cba0 2023-10-14T11:12:35.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.800+0000 7f4adbfff640 1 --2- 172.21.15.26:0/232299871 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4ac80664a0 0x7f4ac8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:35.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.800+0000 7f4adbfff640 1 --2- 172.21.15.26:0/232299871 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4ac80664a0 0x7f4ac8068960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0ad000 tx=0x7f4acc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:35.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.804+0000 7f4ad8ff9640 1 -- 172.21.15.26:0/232299871 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4ad4086e60 con 0x7f4adc15cba0 2023-10-14T11:12:35.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.964+0000 7f4ae230f640 1 -- 172.21.15.26:0/232299871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4adc04e170 con 0x7f4adc15cba0 2023-10-14T11:12:35.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.964+0000 7f4ad8ff9640 1 -- 172.21.15.26:0/232299871 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4ad4051b60 con 0x7f4adc15cba0 2023-10-14T11:12:35.966 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:12:35.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.964+0000 7f4ae230f640 1 -- 172.21.15.26:0/232299871 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4ac80664a0 msgr2=0x7f4ac8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:35.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.964+0000 7f4ae230f640 1 --2- 172.21.15.26:0/232299871 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4ac80664a0 0x7f4ac8068960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0ad000 tx=0x7f4acc0a6000 comp rx=0 tx=0).stop 2023-10-14T11:12:35.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.964+0000 7f4ae230f640 1 -- 172.21.15.26:0/232299871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4adc15cba0 msgr2=0x7f4adc14f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:35.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.964+0000 7f4ae230f640 1 --2- 172.21.15.26:0/232299871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4adc15cba0 0x7f4adc14f070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4001fb0 tx=0x7f4ad400a430 comp rx=0 tx=0).stop 2023-10-14T11:12:35.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.964+0000 7f4ae230f640 1 -- 172.21.15.26:0/232299871 shutdown_connections 2023-10-14T11:12:35.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.964+0000 7f4ae230f640 1 --2- 172.21.15.26:0/232299871 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4ac80664a0 0x7f4ac8068960 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.964+0000 7f4ae230f640 1 --2- 172.21.15.26:0/232299871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4adc15cba0 0x7f4adc14f070 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.964+0000 7f4ae230f640 1 --2- 172.21.15.26:0/232299871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4adc0d0210 0x7f4adc14eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.964+0000 7f4ae230f640 1 --2- 172.21.15.26:0/232299871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4adc0b84e0 0x7f4adc15e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:35.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.964+0000 7f4ae230f640 1 -- 172.21.15.26:0/232299871 >> 172.21.15.26:0/232299871 conn(0x7f4adc0719c0 msgr2=0x7f4adc15ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:35.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.964+0000 7f4ae230f640 1 -- 172.21.15.26:0/232299871 shutdown_connections 2023-10-14T11:12:35.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:35.964+0000 7f4ae230f640 1 -- 172.21.15.26:0/232299871 wait complete. 2023-10-14T11:12:35.989 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:12:36.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.132+0000 7fcd4911d640 1 Processor -- start 2023-10-14T11:12:36.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.132+0000 7fcd4911d640 1 -- start start 2023-10-14T11:12:36.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.132+0000 7fcd4911d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcd4415ca50 0x7fcd4406c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:36.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.132+0000 7fcd4911d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd440b21c0 0x7fcd440b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.132+0000 7fcd4911d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd441607e0 con 0x7fcd4415ce30 2023-10-14T11:12:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.132+0000 7fcd4911d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd440cb4a0 con 0x7fcd4415ca50 2023-10-14T11:12:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.132+0000 7fcd4911d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd440b2b30 con 0x7fcd440b21c0 2023-10-14T11:12:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.132+0000 7fcd42d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcd4415ca50 0x7fcd4406c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.132+0000 7fcd42d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcd4415ca50 0x7fcd4406c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32900/0 (socket says 172.21.15.26:32900) 2023-10-14T11:12:36.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.132+0000 7fcd42d9d640 1 -- 172.21.15.26:0/517210832 learned_addr learned my addr 172.21.15.26:0/517210832 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:36.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.132+0000 7fcd42d9d640 1 -- 172.21.15.26:0/517210832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd440b21c0 msgr2=0x7fcd440b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:36.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.132+0000 7fcd4359e640 1 --2- 172.21.15.26:0/517210832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd440b21c0 0x7fcd440b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:36.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.132+0000 7fcd42d9d640 1 --2- 172.21.15.26:0/517210832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd440b21c0 0x7fcd440b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.132+0000 7fcd42d9d640 1 -- 172.21.15.26:0/517210832 >> v1:172.21.15.110:6789/0 conn(0x7fcd4415ce30 legacy=0x7fcd440cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:36.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.132+0000 7fcd42d9d640 1 -- 172.21.15.26:0/517210832 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd440cf060 con 0x7fcd4415ca50 2023-10-14T11:12:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.132+0000 7fcd4359e640 1 --2- 172.21.15.26:0/517210832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd440b21c0 0x7fcd440b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:36.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.136+0000 7fcd42d9d640 1 --2- 172.21.15.26:0/517210832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd4415ca50 0x7fcd4406c980 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009870 tx=0x7fcd3401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47c5af10e800dc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:36.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.136+0000 7fcd41d9b640 1 -- 172.21.15.26:0/517210832 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd340aa5f0 con 0x7fcd4415ca50 2023-10-14T11:12:36.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.136+0000 7fcd41d9b640 1 -- 172.21.15.26:0/517210832 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd340aa750 con 0x7fcd4415ca50 2023-10-14T11:12:36.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.136+0000 7fcd41d9b640 1 -- 172.21.15.26:0/517210832 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd340aaae0 con 0x7fcd4415ca50 2023-10-14T11:12:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.136+0000 7fcd4911d640 1 -- 172.21.15.26:0/517210832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd4415ca50 msgr2=0x7fcd4406c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.136+0000 7fcd4911d640 1 --2- 172.21.15.26:0/517210832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd4415ca50 0x7fcd4406c980 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009870 tx=0x7fcd3401c4d0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.136+0000 7fcd4911d640 1 -- 172.21.15.26:0/517210832 shutdown_connections 2023-10-14T11:12:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.136+0000 7fcd4911d640 1 --2- 172.21.15.26:0/517210832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd440b21c0 0x7fcd440b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.136+0000 7fcd4911d640 1 --2- 172.21.15.26:0/517210832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd4415ca50 0x7fcd4406c980 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.136+0000 7fcd4911d640 1 -- 172.21.15.26:0/517210832 >> 172.21.15.26:0/517210832 conn(0x7fcd440cd1c0 msgr2=0x7fcd440cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:36.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.136+0000 7fcd4911d640 1 -- 172.21.15.26:0/517210832 shutdown_connections 2023-10-14T11:12:36.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.136+0000 7fcd4911d640 1 -- 172.21.15.26:0/517210832 wait complete. 2023-10-14T11:12:36.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd4911d640 1 Processor -- start 2023-10-14T11:12:36.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd4911d640 1 -- start start 2023-10-14T11:12:36.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd4911d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd440b21c0 0x7fcd4415c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:36.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd4911d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd4415ca50 0x7fcd440b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:36.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd4911d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd4415ce30 0x7fcd440cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:36.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd4911d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4415b080 con 0x7fcd4415ca50 2023-10-14T11:12:36.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd4911d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4415b360 con 0x7fcd4415ce30 2023-10-14T11:12:36.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd4911d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4415b640 con 0x7fcd440b21c0 2023-10-14T11:12:36.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd4259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd4415ca50 0x7fcd440b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:36.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd4259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd4415ca50 0x7fcd440b3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32910/0 (socket says 172.21.15.26:32910) 2023-10-14T11:12:36.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd4259c640 1 -- 172.21.15.26:0/3292633633 learned_addr learned my addr 172.21.15.26:0/3292633633 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:36.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd42d9d640 1 --2- 172.21.15.26:0/3292633633 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd440b21c0 0x7fcd4415c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:36.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd4359e640 1 --2- 172.21.15.26:0/3292633633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd4415ce30 0x7fcd440cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:36.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd4259c640 1 -- 172.21.15.26:0/3292633633 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd440b21c0 msgr2=0x7fcd4415c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:36.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd4259c640 1 --2- 172.21.15.26:0/3292633633 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd440b21c0 0x7fcd4415c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd4259c640 1 -- 172.21.15.26:0/3292633633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd4415ce30 msgr2=0x7fcd440cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:36.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd4259c640 1 --2- 172.21.15.26:0/3292633633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd4415ce30 0x7fcd440cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd4259c640 1 -- 172.21.15.26:0/3292633633 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd340094d0 con 0x7fcd4415ca50 2023-10-14T11:12:36.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd42d9d640 1 --2- 172.21.15.26:0/3292633633 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd440b21c0 0x7fcd4415c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:36.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd4359e640 1 --2- 172.21.15.26:0/3292633633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd4415ce30 0x7fcd440cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:36.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd4259c640 1 --2- 172.21.15.26:0/3292633633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd4415ca50 0x7fcd440b3d10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800b410 tx=0x7fcd3800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:36.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd2b7fe640 1 -- 172.21.15.26:0/3292633633 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38004020 con 0x7fcd4415ca50 2023-10-14T11:12:36.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd2b7fe640 1 -- 172.21.15.26:0/3292633633 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd38004180 con 0x7fcd4415ca50 2023-10-14T11:12:36.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd2b7fe640 1 -- 172.21.15.26:0/3292633633 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38011630 con 0x7fcd4415ca50 2023-10-14T11:12:36.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd4911d640 1 -- 172.21.15.26:0/3292633633 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4415b920 con 0x7fcd4415ca50 2023-10-14T11:12:36.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd4911d640 1 -- 172.21.15.26:0/3292633633 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4415ad10 con 0x7fcd4415ca50 2023-10-14T11:12:36.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.140+0000 7fcd4911d640 1 -- 172.21.15.26:0/3292633633 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd4415c660 con 0x7fcd4415ca50 2023-10-14T11:12:36.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.144+0000 7fcd2b7fe640 1 -- 172.21.15.26:0/3292633633 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcd38011790 con 0x7fcd4415ca50 2023-10-14T11:12:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.144+0000 7fcd2b7fe640 1 --2- 172.21.15.26:0/3292633633 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcd300664a0 0x7fcd30068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.144+0000 7fcd2b7fe640 1 -- 172.21.15.26:0/3292633633 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcd38083fe0 con 0x7fcd4415ca50 2023-10-14T11:12:36.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.144+0000 7fcd42d9d640 1 --2- 172.21.15.26:0/3292633633 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcd300664a0 0x7fcd30068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:36.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.144+0000 7fcd42d9d640 1 --2- 172.21.15.26:0/3292633633 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcd300664a0 0x7fcd30068960 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcd340ae000 tx=0x7fcd340a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:36.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.148+0000 7fcd2b7fe640 1 -- 172.21.15.26:0/3292633633 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcd380510a0 con 0x7fcd4415ca50 2023-10-14T11:12:36.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.320+0000 7fcd4911d640 1 -- 172.21.15.26:0/3292633633 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcd44074010 con 0x7fcd4415ca50 2023-10-14T11:12:36.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.320+0000 7fcd2b7fe640 1 -- 172.21.15.26:0/3292633633 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcd38015080 con 0x7fcd4415ca50 2023-10-14T11:12:36.324 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-10-14T11:12:36.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.320+0000 7fcd4911d640 1 -- 172.21.15.26:0/3292633633 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcd300664a0 msgr2=0x7fcd30068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:36.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.320+0000 7fcd4911d640 1 --2- 172.21.15.26:0/3292633633 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcd300664a0 0x7fcd30068960 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcd340ae000 tx=0x7fcd340a7000 comp rx=0 tx=0).stop 2023-10-14T11:12:36.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.320+0000 7fcd4911d640 1 -- 172.21.15.26:0/3292633633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd4415ca50 msgr2=0x7fcd440b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:36.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.320+0000 7fcd4911d640 1 --2- 172.21.15.26:0/3292633633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd4415ca50 0x7fcd440b3d10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800b410 tx=0x7fcd3800b8d0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.320+0000 7fcd4911d640 1 -- 172.21.15.26:0/3292633633 shutdown_connections 2023-10-14T11:12:36.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.320+0000 7fcd4911d640 1 --2- 172.21.15.26:0/3292633633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd4415ce30 0x7fcd440cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.320+0000 7fcd4911d640 1 --2- 172.21.15.26:0/3292633633 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcd300664a0 0x7fcd30068960 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.320+0000 7fcd4911d640 1 --2- 172.21.15.26:0/3292633633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd4415ca50 0x7fcd440b3d10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.320+0000 7fcd4911d640 1 --2- 172.21.15.26:0/3292633633 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd440b21c0 0x7fcd4415c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.320+0000 7fcd4911d640 1 -- 172.21.15.26:0/3292633633 >> 172.21.15.26:0/3292633633 conn(0x7fcd440cd1c0 msgr2=0x7fcd4406c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:36.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.320+0000 7fcd4911d640 1 -- 172.21.15.26:0/3292633633 shutdown_connections 2023-10-14T11:12:36.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.320+0000 7fcd4911d640 1 -- 172.21.15.26:0/3292633633 wait complete. 2023-10-14T11:12:36.345 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:12:36.345 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:12:36.359 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:12:36.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.544+0000 7f2fc2d0f640 1 Processor -- start 2023-10-14T11:12:36.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.544+0000 7f2fc2d0f640 1 -- start start 2023-10-14T11:12:36.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.544+0000 7f2fc2d0f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2fbc15cb90 0x7f2fbc0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:36.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.544+0000 7f2fc2d0f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fbc0d3010 0x7f2fbc0d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:36.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.544+0000 7f2fc2d0f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc0ce770 con 0x7f2fbc0d1400 2023-10-14T11:12:36.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.544+0000 7f2fc2d0f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fbc0d1890 con 0x7f2fbc15cb90 2023-10-14T11:12:36.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.544+0000 7f2fc2d0f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0d0600 con 0x7f2fbc0d3010 2023-10-14T11:12:36.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.544+0000 7f2fc0aab640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2fbc15cb90 0x7f2fbc0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:36.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.544+0000 7f2fbbfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fbc0d3010 0x7f2fbc0d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:36.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.544+0000 7f2fbbfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fbc0d3010 0x7f2fbc0d0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:46278/0 (socket says 172.21.15.26:46278) 2023-10-14T11:12:36.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.544+0000 7f2fbbfff640 1 -- 172.21.15.26:0/4049457143 learned_addr learned my addr 172.21.15.26:0/4049457143 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:36.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.544+0000 7f2fbbfff640 1 -- 172.21.15.26:0/4049457143 >> v2:172.21.15.110:3300/0 conn(0x7f2fbc15cb90 msgr2=0x7f2fbc0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:36.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.544+0000 7f2fbbfff640 1 --2- 172.21.15.26:0/4049457143 >> v2:172.21.15.110:3300/0 conn(0x7f2fbc15cb90 0x7f2fbc0cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.544+0000 7f2fbbfff640 1 -- 172.21.15.26:0/4049457143 >> v1:172.21.15.110:6789/0 conn(0x7f2fbc0d1400 legacy=0x7f2fbc0cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:36.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.544+0000 7f2fbbfff640 1 -- 172.21.15.26:0/4049457143 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc0c6450 con 0x7f2fbc0d3010 2023-10-14T11:12:36.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.548+0000 7f2fbbfff640 1 --2- 172.21.15.26:0/4049457143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fbc0d3010 0x7f2fbc0d0ec0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8009870 tx=0x7f2fa801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22fe5d95476af343 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.548+0000 7f2fbb7fe640 1 -- 172.21.15.26:0/4049457143 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa80ab680 con 0x7f2fbc0d3010 2023-10-14T11:12:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.548+0000 7f2fbb7fe640 1 -- 172.21.15.26:0/4049457143 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa80ab7e0 con 0x7f2fbc0d3010 2023-10-14T11:12:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.548+0000 7f2fbb7fe640 1 -- 172.21.15.26:0/4049457143 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa80abb70 con 0x7f2fbc0d3010 2023-10-14T11:12:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.548+0000 7f2fc2d0f640 1 -- 172.21.15.26:0/4049457143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fbc0d3010 msgr2=0x7f2fbc0d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.548+0000 7f2fc2d0f640 1 --2- 172.21.15.26:0/4049457143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fbc0d3010 0x7f2fbc0d0ec0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8009870 tx=0x7f2fa801c480 comp rx=0 tx=0).stop 2023-10-14T11:12:36.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.548+0000 7f2fc2d0f640 1 -- 172.21.15.26:0/4049457143 shutdown_connections 2023-10-14T11:12:36.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.548+0000 7f2fc2d0f640 1 --2- 172.21.15.26:0/4049457143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fbc0d3010 0x7f2fbc0d0ec0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.548+0000 7f2fc2d0f640 1 --2- 172.21.15.26:0/4049457143 >> v2:172.21.15.110:3300/0 conn(0x7f2fbc15cb90 0x7f2fbc0cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.548+0000 7f2fc2d0f640 1 -- 172.21.15.26:0/4049457143 >> 172.21.15.26:0/4049457143 conn(0x7f2fbc09bc50 msgr2=0x7f2fbc0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:36.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.548+0000 7f2fc2d0f640 1 -- 172.21.15.26:0/4049457143 shutdown_connections 2023-10-14T11:12:36.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.548+0000 7f2fc2d0f640 1 -- 172.21.15.26:0/4049457143 wait complete. 2023-10-14T11:12:36.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fc2d0f640 1 Processor -- start 2023-10-14T11:12:36.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fc2d0f640 1 -- start start 2023-10-14T11:12:36.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fc2d0f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fbc0d1400 0x7f2fbc154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:36.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fc2d0f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fbc0d3010 0x7f2fbc0cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:36.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fc2d0f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fbc15cb90 0x7f2fbc155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:36.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fc2d0f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0cc8b0 con 0x7f2fbc0d1400 2023-10-14T11:12:36.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fc2d0f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc154c50 con 0x7f2fbc15cb90 2023-10-14T11:12:36.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fc2d0f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0cc2f0 con 0x7f2fbc0d3010 2023-10-14T11:12:36.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fc0aab640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fbc0d1400 0x7f2fbc154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:36.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fc0aab640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fbc0d1400 0x7f2fbc154710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32916/0 (socket says 172.21.15.26:32916) 2023-10-14T11:12:36.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fc0aab640 1 -- 172.21.15.26:0/347481297 learned_addr learned my addr 172.21.15.26:0/347481297 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:36.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fbbfff640 1 --2- 172.21.15.26:0/347481297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fbc0d3010 0x7f2fbc0cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:36.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fc12ac640 1 --2- 172.21.15.26:0/347481297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fbc15cb90 0x7f2fbc155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:36.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fc0aab640 1 -- 172.21.15.26:0/347481297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fbc0d3010 msgr2=0x7f2fbc0cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:36.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fc0aab640 1 --2- 172.21.15.26:0/347481297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fbc0d3010 0x7f2fbc0cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fc0aab640 1 -- 172.21.15.26:0/347481297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fbc15cb90 msgr2=0x7f2fbc155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:36.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fc0aab640 1 --2- 172.21.15.26:0/347481297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fbc15cb90 0x7f2fbc155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fc0aab640 1 -- 172.21.15.26:0/347481297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa80094d0 con 0x7f2fbc0d1400 2023-10-14T11:12:36.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fc0aab640 1 --2- 172.21.15.26:0/347481297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fbc0d1400 0x7f2fbc154710 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000e9b0 tx=0x7f2fb000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:36.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fb97fa640 1 -- 172.21.15.26:0/347481297 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0009670 con 0x7f2fbc0d1400 2023-10-14T11:12:36.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fb97fa640 1 -- 172.21.15.26:0/347481297 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb000c9a0 con 0x7f2fbc0d1400 2023-10-14T11:12:36.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fb97fa640 1 -- 172.21.15.26:0/347481297 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb000cd10 con 0x7f2fbc0d1400 2023-10-14T11:12:36.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.552+0000 7f2fc2d0f640 1 -- 172.21.15.26:0/347481297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fbc0cc5d0 con 0x7f2fbc0d1400 2023-10-14T11:12:36.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.556+0000 7f2fc2d0f640 1 -- 172.21.15.26:0/347481297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fbc0b58a0 con 0x7f2fbc0d1400 2023-10-14T11:12:36.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.556+0000 7f2fc2d0f640 1 -- 172.21.15.26:0/347481297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fbc074010 con 0x7f2fbc0d1400 2023-10-14T11:12:36.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.556+0000 7f2fb97fa640 1 -- 172.21.15.26:0/347481297 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2fb0013470 con 0x7f2fbc0d1400 2023-10-14T11:12:36.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.556+0000 7f2fb97fa640 1 --2- 172.21.15.26:0/347481297 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2fa00664a0 0x7f2fa0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:36.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.556+0000 7f2fb97fa640 1 -- 172.21.15.26:0/347481297 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2fb00847d0 con 0x7f2fbc0d1400 2023-10-14T11:12:36.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.556+0000 7f2fbbfff640 1 --2- 172.21.15.26:0/347481297 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2fa00664a0 0x7f2fa0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:36.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.556+0000 7f2fbbfff640 1 --2- 172.21.15.26:0/347481297 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2fa00664a0 0x7f2fa0068960 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2fa80af000 tx=0x7f2fa80b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:36.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.560+0000 7f2fb97fa640 1 -- 172.21.15.26:0/347481297 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2fb0051970 con 0x7f2fbc0d1400 2023-10-14T11:12:36.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.716+0000 7f2fc2d0f640 1 -- 172.21.15.26:0/347481297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fbc0c79e0 con 0x7f2fbc0d1400 2023-10-14T11:12:36.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.720+0000 7f2fb97fa640 1 -- 172.21.15.26:0/347481297 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f2fb0054f90 con 0x7f2fbc0d1400 2023-10-14T11:12:36.722 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:36.722 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":25,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:12:27.398936+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:12:36.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.720+0000 7f2fc2d0f640 1 -- 172.21.15.26:0/347481297 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2fa00664a0 msgr2=0x7f2fa0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:36.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.720+0000 7f2fc2d0f640 1 --2- 172.21.15.26:0/347481297 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2fa00664a0 0x7f2fa0068960 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2fa80af000 tx=0x7f2fa80b6040 comp rx=0 tx=0).stop 2023-10-14T11:12:36.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.720+0000 7f2fc2d0f640 1 -- 172.21.15.26:0/347481297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fbc0d1400 msgr2=0x7f2fbc154710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:36.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.720+0000 7f2fc2d0f640 1 --2- 172.21.15.26:0/347481297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fbc0d1400 0x7f2fbc154710 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000e9b0 tx=0x7f2fb000ee70 comp rx=0 tx=0).stop 2023-10-14T11:12:36.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.720+0000 7f2fc2d0f640 1 -- 172.21.15.26:0/347481297 shutdown_connections 2023-10-14T11:12:36.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.720+0000 7f2fc2d0f640 1 --2- 172.21.15.26:0/347481297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fbc15cb90 0x7f2fbc155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.720+0000 7f2fc2d0f640 1 --2- 172.21.15.26:0/347481297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fbc0d3010 0x7f2fbc0cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.720+0000 7f2fc2d0f640 1 --2- 172.21.15.26:0/347481297 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2fa00664a0 0x7f2fa0068960 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.720+0000 7f2fc2d0f640 1 --2- 172.21.15.26:0/347481297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fbc0d1400 0x7f2fbc154710 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.720+0000 7f2fc2d0f640 1 -- 172.21.15.26:0/347481297 >> 172.21.15.26:0/347481297 conn(0x7f2fbc09bc50 msgr2=0x7f2fbc159590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:36.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.720+0000 7f2fc2d0f640 1 -- 172.21.15.26:0/347481297 shutdown_connections 2023-10-14T11:12:36.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.720+0000 7f2fc2d0f640 1 -- 172.21.15.26:0/347481297 wait complete. 2023-10-14T11:12:36.743 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:12:20.179562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:12:21.346111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T11:12:25.025159+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T11:12:36.744 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:12:36.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.888+0000 7ff0fb194640 1 Processor -- start 2023-10-14T11:12:36.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.888+0000 7ff0fb194640 1 -- start start 2023-10-14T11:12:36.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.888+0000 7ff0fb194640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff0f415cba0 0x7ff0f40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:36.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.888+0000 7ff0fb194640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff0f40b84e0 0x7ff0f40cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:36.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.888+0000 7ff0fb194640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f40d1670 con 0x7ff0f40d0040 2023-10-14T11:12:36.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.888+0000 7ff0fb194640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f40d1460 con 0x7ff0f40b84e0 2023-10-14T11:12:36.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.888+0000 7ff0fb194640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f40d04b0 con 0x7ff0f415cba0 2023-10-14T11:12:36.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.888+0000 7ff0ebfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff0f40b84e0 0x7ff0f40cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:36.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.888+0000 7ff0ebfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff0f40b84e0 0x7ff0f40cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32918/0 (socket says 172.21.15.26:32918) 2023-10-14T11:12:36.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.888+0000 7ff0ebfff640 1 -- 172.21.15.26:0/3119329864 learned_addr learned my addr 172.21.15.26:0/3119329864 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:36.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.888+0000 7ff0f8f30640 1 --2- 172.21.15.26:0/3119329864 >> v2:172.21.15.110:3300/0 conn(0x7ff0f415cba0 0x7ff0f40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:36.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.888+0000 7ff0f8f30640 1 -- 172.21.15.26:0/3119329864 >> v2:172.21.15.26:3300/0 conn(0x7ff0f40b84e0 msgr2=0x7ff0f40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:36.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.888+0000 7ff0f8f30640 1 --2- 172.21.15.26:0/3119329864 >> v2:172.21.15.26:3300/0 conn(0x7ff0f40b84e0 0x7ff0f40cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.888+0000 7ff0f8f30640 1 -- 172.21.15.26:0/3119329864 >> v1:172.21.15.110:6789/0 conn(0x7ff0f40d0040 legacy=0x7ff0f40d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:36.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.888+0000 7ff0f8f30640 1 -- 172.21.15.26:0/3119329864 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f40d1950 con 0x7ff0f415cba0 2023-10-14T11:12:36.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.892+0000 7ff0f8f30640 1 --2- 172.21.15.26:0/3119329864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f415cba0 0x7ff0f40d0f20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40b4890 tx=0x7ff0f001c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2ccba10f2674082 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:36.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.892+0000 7ff0eb7fe640 1 -- 172.21.15.26:0/3119329864 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f00ab600 con 0x7ff0f415cba0 2023-10-14T11:12:36.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.892+0000 7ff0eb7fe640 1 -- 172.21.15.26:0/3119329864 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f00a7050 con 0x7ff0f415cba0 2023-10-14T11:12:36.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.892+0000 7ff0eb7fe640 1 -- 172.21.15.26:0/3119329864 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f00ab980 con 0x7ff0f415cba0 2023-10-14T11:12:36.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.892+0000 7ff0fb194640 1 -- 172.21.15.26:0/3119329864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f415cba0 msgr2=0x7ff0f40d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:36.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.892+0000 7ff0fb194640 1 --2- 172.21.15.26:0/3119329864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f415cba0 0x7ff0f40d0f20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40b4890 tx=0x7ff0f001c3d0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.892+0000 7ff0fb194640 1 -- 172.21.15.26:0/3119329864 shutdown_connections 2023-10-14T11:12:36.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.892+0000 7ff0fb194640 1 --2- 172.21.15.26:0/3119329864 >> v2:172.21.15.26:3300/0 conn(0x7ff0f40b84e0 0x7ff0f40cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.892+0000 7ff0fb194640 1 --2- 172.21.15.26:0/3119329864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f415cba0 0x7ff0f40d0f20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.892+0000 7ff0fb194640 1 -- 172.21.15.26:0/3119329864 >> 172.21.15.26:0/3119329864 conn(0x7ff0f40719c0 msgr2=0x7ff0f4071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:36.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.892+0000 7ff0fb194640 1 -- 172.21.15.26:0/3119329864 shutdown_connections 2023-10-14T11:12:36.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.892+0000 7ff0fb194640 1 -- 172.21.15.26:0/3119329864 wait complete. 2023-10-14T11:12:36.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0fb194640 1 Processor -- start 2023-10-14T11:12:36.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0fb194640 1 -- start start 2023-10-14T11:12:36.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0fb194640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0f40b84e0 0x7ff0f4159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:36.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0fb194640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f40d0040 0x7ff0f40c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:36.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0fb194640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0f415cba0 0x7ff0f414f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:36.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0fb194640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f40c6d80 con 0x7ff0f415cba0 2023-10-14T11:12:36.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0fb194640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f40c7060 con 0x7ff0f40d0040 2023-10-14T11:12:36.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0fb194640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f40c7340 con 0x7ff0f40b84e0 2023-10-14T11:12:36.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0f9731640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0f415cba0 0x7ff0f414f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:36.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0f9731640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0f415cba0 0x7ff0f414f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32920/0 (socket says 172.21.15.26:32920) 2023-10-14T11:12:36.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0f9731640 1 -- 172.21.15.26:0/3406401594 learned_addr learned my addr 172.21.15.26:0/3406401594 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:36.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0ebfff640 1 --2- 172.21.15.26:0/3406401594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f40d0040 0x7ff0f40c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:36.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0f8f30640 1 --2- 172.21.15.26:0/3406401594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0f40b84e0 0x7ff0f4159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:36.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0f9731640 1 -- 172.21.15.26:0/3406401594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0f40b84e0 msgr2=0x7ff0f4159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:36.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0f9731640 1 --2- 172.21.15.26:0/3406401594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0f40b84e0 0x7ff0f4159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0f9731640 1 -- 172.21.15.26:0/3406401594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f40d0040 msgr2=0x7ff0f40c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:36.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0f9731640 1 --2- 172.21.15.26:0/3406401594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f40d0040 0x7ff0f40c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:36.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0f9731640 1 -- 172.21.15.26:0/3406401594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f0009420 con 0x7ff0f415cba0 2023-10-14T11:12:36.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0f9731640 1 --2- 172.21.15.26:0/3406401594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0f415cba0 0x7ff0f414f730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00c770 tx=0x7ff0ec00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:36.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0e97fa640 1 -- 172.21.15.26:0/3406401594 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec003b80 con 0x7ff0f415cba0 2023-10-14T11:12:36.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0e97fa640 1 -- 172.21.15.26:0/3406401594 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ec003ce0 con 0x7ff0f415cba0 2023-10-14T11:12:36.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0e97fa640 1 -- 172.21.15.26:0/3406401594 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec00aa90 con 0x7ff0f415cba0 2023-10-14T11:12:36.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0fb194640 1 -- 172.21.15.26:0/3406401594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f40c7620 con 0x7ff0f415cba0 2023-10-14T11:12:36.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.896+0000 7ff0fb194640 1 -- 172.21.15.26:0/3406401594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f40c7a00 con 0x7ff0f415cba0 2023-10-14T11:12:36.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.900+0000 7ff0fb194640 1 -- 172.21.15.26:0/3406401594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f404e170 con 0x7ff0f415cba0 2023-10-14T11:12:36.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.900+0000 7ff0e97fa640 1 -- 172.21.15.26:0/3406401594 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff0ec00abf0 con 0x7ff0f415cba0 2023-10-14T11:12:36.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.900+0000 7ff0e97fa640 1 --2- 172.21.15.26:0/3406401594 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff0e00664a0 0x7ff0e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:36.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.900+0000 7ff0e97fa640 1 -- 172.21.15.26:0/3406401594 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff0ec083f40 con 0x7ff0f415cba0 2023-10-14T11:12:36.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.900+0000 7ff0f8f30640 1 --2- 172.21.15.26:0/3406401594 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff0e00664a0 0x7ff0e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:36.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.900+0000 7ff0f8f30640 1 --2- 172.21.15.26:0/3406401594 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff0e00664a0 0x7ff0e0068960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00ad000 tx=0x7ff0f00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:36.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:36.904+0000 7ff0e97fa640 1 -- 172.21.15.26:0/3406401594 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff0ec051160 con 0x7ff0f415cba0 2023-10-14T11:12:37.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.064+0000 7ff0fb194640 1 -- 172.21.15.26:0/3406401594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff0f40b82a0 con 0x7ff0f415cba0 2023-10-14T11:12:37.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.064+0000 7ff0e97fa640 1 -- 172.21.15.26:0/3406401594 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff0ec054780 con 0x7ff0f415cba0 2023-10-14T11:12:37.069 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:12:37.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.068+0000 7ff0fb194640 1 -- 172.21.15.26:0/3406401594 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff0e00664a0 msgr2=0x7ff0e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:37.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.068+0000 7ff0fb194640 1 --2- 172.21.15.26:0/3406401594 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff0e00664a0 0x7ff0e0068960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00ad000 tx=0x7ff0f00a6000 comp rx=0 tx=0).stop 2023-10-14T11:12:37.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.068+0000 7ff0fb194640 1 -- 172.21.15.26:0/3406401594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0f415cba0 msgr2=0x7ff0f414f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:37.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.068+0000 7ff0fb194640 1 --2- 172.21.15.26:0/3406401594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0f415cba0 0x7ff0f414f730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00c770 tx=0x7ff0ec00cc30 comp rx=0 tx=0).stop 2023-10-14T11:12:37.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.068+0000 7ff0fb194640 1 -- 172.21.15.26:0/3406401594 shutdown_connections 2023-10-14T11:12:37.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.068+0000 7ff0fb194640 1 --2- 172.21.15.26:0/3406401594 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff0e00664a0 0x7ff0e0068960 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.068+0000 7ff0fb194640 1 --2- 172.21.15.26:0/3406401594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0f415cba0 0x7ff0f414f730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.068+0000 7ff0fb194640 1 --2- 172.21.15.26:0/3406401594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f40d0040 0x7ff0f40c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.068+0000 7ff0fb194640 1 --2- 172.21.15.26:0/3406401594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0f40b84e0 0x7ff0f4159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.068+0000 7ff0fb194640 1 -- 172.21.15.26:0/3406401594 >> 172.21.15.26:0/3406401594 conn(0x7ff0f40719c0 msgr2=0x7ff0f415a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:37.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.068+0000 7ff0fb194640 1 -- 172.21.15.26:0/3406401594 shutdown_connections 2023-10-14T11:12:37.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.068+0000 7ff0fb194640 1 -- 172.21.15.26:0/3406401594 wait complete. 2023-10-14T11:12:37.090 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:12:37.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.232+0000 7f4bf45d0640 1 Processor -- start 2023-10-14T11:12:37.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.232+0000 7f4bf45d0640 1 -- start start 2023-10-14T11:12:37.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.236+0000 7f4bf45d0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4bec0d0210 0x7f4bec0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:37.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.236+0000 7f4bf45d0640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4bec0b84e0 0x7f4bec0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:37.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.236+0000 7f4bf45d0640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bec0d1670 con 0x7f4bec15cba0 2023-10-14T11:12:37.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.236+0000 7f4bf45d0640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bec0d1460 con 0x7f4bec0b84e0 2023-10-14T11:12:37.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.236+0000 7f4bf45d0640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bec0d1950 con 0x7f4bec0d0210 2023-10-14T11:12:37.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.236+0000 7f4bf2b6d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4bec0b84e0 0x7f4bec0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:37.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.236+0000 7f4bf236c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4bec15cba0 0x7f4bec0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38328/0 (socket says 172.21.15.26:38328) 2023-10-14T11:12:37.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.236+0000 7f4bf236c640 1 -- 172.21.15.26:0/1373412123 learned_addr learned my addr 172.21.15.26:0/1373412123 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:37.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.236+0000 7f4bf1b6b640 1 --2- 172.21.15.26:0/1373412123 >> v2:172.21.15.110:3300/0 conn(0x7f4bec0d0210 0x7f4bec0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:37.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.236+0000 7f4bf2b6d640 1 -- 172.21.15.26:0/1373412123 >> v2:172.21.15.110:3300/0 conn(0x7f4bec0d0210 msgr2=0x7f4bec0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:37.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.236+0000 7f4bf2b6d640 1 --2- 172.21.15.26:0/1373412123 >> v2:172.21.15.110:3300/0 conn(0x7f4bec0d0210 0x7f4bec0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.236+0000 7f4bf2b6d640 1 -- 172.21.15.26:0/1373412123 >> v1:172.21.15.26:6789/0 conn(0x7f4bec15cba0 legacy=0x7f4bec0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:37.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.236+0000 7f4bf136a640 1 -- 172.21.15.26:0/1373412123 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283259567 0 0) 0x7f4bec0d1670 con 0x7f4bec15cba0 2023-10-14T11:12:37.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.236+0000 7f4bf2b6d640 1 -- 172.21.15.26:0/1373412123 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec0d1c30 con 0x7f4bec0b84e0 2023-10-14T11:12:37.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.236+0000 7f4bf1b6b640 1 --2- 172.21.15.26:0/1373412123 >> v2:172.21.15.110:3300/0 conn(0x7f4bec0d0210 0x7f4bec0d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:37.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.240+0000 7f4bf2b6d640 1 --2- 172.21.15.26:0/1373412123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bec0b84e0 0x7f4bec0b5cf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4bec0cf010 tx=0x7f4be401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503b500a0b1b99c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.240+0000 7f4bf136a640 1 -- 172.21.15.26:0/1373412123 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be40a5940 con 0x7f4bec0b84e0 2023-10-14T11:12:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.240+0000 7f4bf136a640 1 -- 172.21.15.26:0/1373412123 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be40a5aa0 con 0x7f4bec0b84e0 2023-10-14T11:12:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.240+0000 7f4bf136a640 1 -- 172.21.15.26:0/1373412123 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be40a5e30 con 0x7f4bec0b84e0 2023-10-14T11:12:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.240+0000 7f4bf45d0640 1 -- 172.21.15.26:0/1373412123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bec0b84e0 msgr2=0x7f4bec0b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.240+0000 7f4bf45d0640 1 --2- 172.21.15.26:0/1373412123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bec0b84e0 0x7f4bec0b5cf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4bec0cf010 tx=0x7f4be401c880 comp rx=0 tx=0).stop 2023-10-14T11:12:37.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.240+0000 7f4bf45d0640 1 -- 172.21.15.26:0/1373412123 shutdown_connections 2023-10-14T11:12:37.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.240+0000 7f4bf45d0640 1 --2- 172.21.15.26:0/1373412123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bec0b84e0 0x7f4bec0b5cf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.240+0000 7f4bf45d0640 1 --2- 172.21.15.26:0/1373412123 >> v2:172.21.15.110:3300/0 conn(0x7f4bec0d0210 0x7f4bec0d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.240+0000 7f4bf45d0640 1 -- 172.21.15.26:0/1373412123 >> 172.21.15.26:0/1373412123 conn(0x7f4bec0719c0 msgr2=0x7f4bec071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:37.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.240+0000 7f4bf45d0640 1 -- 172.21.15.26:0/1373412123 shutdown_connections 2023-10-14T11:12:37.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.240+0000 7f4bf45d0640 1 -- 172.21.15.26:0/1373412123 wait complete. 2023-10-14T11:12:37.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.240+0000 7f4bf45d0640 1 Processor -- start 2023-10-14T11:12:37.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.240+0000 7f4bf45d0640 1 -- start start 2023-10-14T11:12:37.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.240+0000 7f4bf45d0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bec0b84e0 0x7f4bec156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:37.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.244+0000 7f4bf45d0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bec0d0210 0x7f4bec0cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:37.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.244+0000 7f4bf45d0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4bec15cba0 0x7f4bec0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:37.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.244+0000 7f4bf45d0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec0cbe80 con 0x7f4bec0b84e0 2023-10-14T11:12:37.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.244+0000 7f4bf45d0640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec1574a0 con 0x7f4bec0d0210 2023-10-14T11:12:37.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.244+0000 7f4bf45d0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec0ca7f0 con 0x7f4bec15cba0 2023-10-14T11:12:37.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.244+0000 7f4bf236c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bec0b84e0 0x7f4bec156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:37.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.244+0000 7f4bf236c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bec0b84e0 0x7f4bec156ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32940/0 (socket says 172.21.15.26:32940) 2023-10-14T11:12:37.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.244+0000 7f4bf236c640 1 -- 172.21.15.26:0/301401556 learned_addr learned my addr 172.21.15.26:0/301401556 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:37.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.244+0000 7f4bf1b6b640 1 --2- 172.21.15.26:0/301401556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bec0d0210 0x7f4bec0cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:37.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.244+0000 7f4bf236c640 1 -- 172.21.15.26:0/301401556 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4bec15cba0 msgr2=0x7f4bec0c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:37.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.244+0000 7f4bf236c640 1 --2- 172.21.15.26:0/301401556 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4bec15cba0 0x7f4bec0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.244+0000 7f4bf236c640 1 -- 172.21.15.26:0/301401556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bec0d0210 msgr2=0x7f4bec0cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:37.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.244+0000 7f4bf236c640 1 --2- 172.21.15.26:0/301401556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bec0d0210 0x7f4bec0cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.244+0000 7f4bf236c640 1 -- 172.21.15.26:0/301401556 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be4009a70 con 0x7f4bec0b84e0 2023-10-14T11:12:37.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.244+0000 7f4bf236c640 1 --2- 172.21.15.26:0/301401556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bec0b84e0 0x7f4bec156ec0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4be800c480 tx=0x7f4be800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:37.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.244+0000 7f4be2ffd640 1 -- 172.21.15.26:0/301401556 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be80074e0 con 0x7f4bec0b84e0 2023-10-14T11:12:37.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.244+0000 7f4be2ffd640 1 -- 172.21.15.26:0/301401556 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be8007660 con 0x7f4bec0b84e0 2023-10-14T11:12:37.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.244+0000 7f4bf45d0640 1 -- 172.21.15.26:0/301401556 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bec0caad0 con 0x7f4bec0b84e0 2023-10-14T11:12:37.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.244+0000 7f4be2ffd640 1 -- 172.21.15.26:0/301401556 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be8004a30 con 0x7f4bec0b84e0 2023-10-14T11:12:37.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.244+0000 7f4bf45d0640 1 -- 172.21.15.26:0/301401556 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bec14a610 con 0x7f4bec0b84e0 2023-10-14T11:12:37.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.244+0000 7f4bf45d0640 1 -- 172.21.15.26:0/301401556 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bec04e170 con 0x7f4bec0b84e0 2023-10-14T11:12:37.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.244+0000 7f4be2ffd640 1 -- 172.21.15.26:0/301401556 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4be8004b90 con 0x7f4bec0b84e0 2023-10-14T11:12:37.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.248+0000 7f4be2ffd640 1 --2- 172.21.15.26:0/301401556 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4bd00664a0 0x7f4bd0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:37.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.248+0000 7f4be2ffd640 1 -- 172.21.15.26:0/301401556 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4be80836b0 con 0x7f4bec0b84e0 2023-10-14T11:12:37.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.248+0000 7f4bf1b6b640 1 --2- 172.21.15.26:0/301401556 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4bd00664a0 0x7f4bd0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:37.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.248+0000 7f4bf1b6b640 1 --2- 172.21.15.26:0/301401556 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4bd00664a0 0x7f4bd0068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4bec157ae0 tx=0x7f4bdc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:37.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.252+0000 7f4be2ffd640 1 -- 172.21.15.26:0/301401556 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4be80542c0 con 0x7f4bec0b84e0 2023-10-14T11:12:37.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.404+0000 7f4bf45d0640 1 -- 172.21.15.26:0/301401556 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4bec0cdc30 con 0x7f4bec0b84e0 2023-10-14T11:12:37.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.408+0000 7f4be2ffd640 1 -- 172.21.15.26:0/301401556 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4be8053e50 con 0x7f4bec0b84e0 2023-10-14T11:12:37.410 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:12:37.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.408+0000 7f4bf45d0640 1 -- 172.21.15.26:0/301401556 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4bd00664a0 msgr2=0x7f4bd0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:37.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.408+0000 7f4bf45d0640 1 --2- 172.21.15.26:0/301401556 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4bd00664a0 0x7f4bd0068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4bec157ae0 tx=0x7f4bdc008040 comp rx=0 tx=0).stop 2023-10-14T11:12:37.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.408+0000 7f4bf45d0640 1 -- 172.21.15.26:0/301401556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bec0b84e0 msgr2=0x7f4bec156ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:37.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.408+0000 7f4bf45d0640 1 --2- 172.21.15.26:0/301401556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bec0b84e0 0x7f4bec156ec0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4be800c480 tx=0x7f4be800c940 comp rx=0 tx=0).stop 2023-10-14T11:12:37.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.408+0000 7f4bf45d0640 1 -- 172.21.15.26:0/301401556 shutdown_connections 2023-10-14T11:12:37.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.408+0000 7f4bf45d0640 1 --2- 172.21.15.26:0/301401556 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4bec15cba0 0x7f4bec0c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.408+0000 7f4bf45d0640 1 --2- 172.21.15.26:0/301401556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bec0d0210 0x7f4bec0cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.408+0000 7f4bf45d0640 1 --2- 172.21.15.26:0/301401556 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4bd00664a0 0x7f4bd0068960 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.408+0000 7f4bf45d0640 1 --2- 172.21.15.26:0/301401556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bec0b84e0 0x7f4bec156ec0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.408+0000 7f4bf45d0640 1 -- 172.21.15.26:0/301401556 >> 172.21.15.26:0/301401556 conn(0x7f4bec0719c0 msgr2=0x7f4bec072820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:37.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.408+0000 7f4bf45d0640 1 -- 172.21.15.26:0/301401556 shutdown_connections 2023-10-14T11:12:37.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.408+0000 7f4bf45d0640 1 -- 172.21.15.26:0/301401556 wait complete. 2023-10-14T11:12:37.430 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:12:37.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.572+0000 7f4ffd572640 1 Processor -- start 2023-10-14T11:12:37.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.572+0000 7f4ffd572640 1 -- start start 2023-10-14T11:12:37.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.576+0000 7f4ffd572640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ff80d0210 0x7f4ff80d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:37.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.576+0000 7f4ffd572640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff80d1670 con 0x7f4ff80b84e0 2023-10-14T11:12:37.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.576+0000 7f4ffd572640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff80d1950 con 0x7f4ff815cba0 2023-10-14T11:12:37.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.576+0000 7f4ffd572640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff80d1460 con 0x7f4ff80d0210 2023-10-14T11:12:37.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.576+0000 7f4ff77fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4ff80b84e0 0x7f4ff80b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38338/0 (socket says 172.21.15.26:38338) 2023-10-14T11:12:37.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.576+0000 7f4ff77fe640 1 -- 172.21.15.26:0/182144466 learned_addr learned my addr 172.21.15.26:0/182144466 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:37.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.576+0000 7f4feffff640 1 --2- 172.21.15.26:0/182144466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ff80d0210 0x7f4ff80d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:37.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.576+0000 7f4ff67fc640 1 -- 172.21.15.26:0/182144466 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761573473 0 0) 0x7f4ff80d1670 con 0x7f4ff80b84e0 2023-10-14T11:12:37.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.576+0000 7f4ff67fc640 1 -- 172.21.15.26:0/182144466 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fe4003530 con 0x7f4ff80b84e0 2023-10-14T11:12:37.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.576+0000 7f4ff67fc640 1 -- 172.21.15.26:0/182144466 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2561203291 0 0) 0x7f4ff80d1950 con 0x7f4ff815cba0 2023-10-14T11:12:37.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.576+0000 7f4ff67fc640 1 -- 172.21.15.26:0/182144466 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ff80d1670 con 0x7f4ff815cba0 2023-10-14T11:12:37.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.576+0000 7f4feffff640 1 -- 172.21.15.26:0/182144466 >> v1:172.21.15.110:6789/0 conn(0x7f4ff815cba0 legacy=0x7f4ff80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:37.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.576+0000 7f4feffff640 1 -- 172.21.15.26:0/182144466 >> v1:172.21.15.26:6789/0 conn(0x7f4ff80b84e0 legacy=0x7f4ff80b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:37.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.576+0000 7f4feffff640 1 -- 172.21.15.26:0/182144466 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff80d1c30 con 0x7f4ff80d0210 2023-10-14T11:12:37.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.580+0000 7f4feffff640 1 --2- 172.21.15.26:0/182144466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ff80d0210 0x7f4ff80d0f20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4fe00097f0 tx=0x7f4fe001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=271a82945e7c2630 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:37.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.580+0000 7f4ff67fc640 1 -- 172.21.15.26:0/182144466 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe00aa620 con 0x7f4ff80d0210 2023-10-14T11:12:37.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.580+0000 7f4ff67fc640 1 -- 172.21.15.26:0/182144466 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe00aa780 con 0x7f4ff80d0210 2023-10-14T11:12:37.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.580+0000 7f4ff67fc640 1 -- 172.21.15.26:0/182144466 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe00aaaf0 con 0x7f4ff80d0210 2023-10-14T11:12:37.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.580+0000 7f4ffd572640 1 -- 172.21.15.26:0/182144466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ff80d0210 msgr2=0x7f4ff80d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:37.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.580+0000 7f4ffd572640 1 --2- 172.21.15.26:0/182144466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ff80d0210 0x7f4ff80d0f20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4fe00097f0 tx=0x7f4fe001c4c0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.580+0000 7f4ffd572640 1 -- 172.21.15.26:0/182144466 shutdown_connections 2023-10-14T11:12:37.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.580+0000 7f4ffd572640 1 --2- 172.21.15.26:0/182144466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ff80d0210 0x7f4ff80d0f20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.580+0000 7f4ffd572640 1 -- 172.21.15.26:0/182144466 >> 172.21.15.26:0/182144466 conn(0x7f4ff80719c0 msgr2=0x7f4ff8071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:37.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.580+0000 7f4ffd572640 1 -- 172.21.15.26:0/182144466 shutdown_connections 2023-10-14T11:12:37.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.580+0000 7f4ffd572640 1 -- 172.21.15.26:0/182144466 wait complete. 2023-10-14T11:12:37.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.580+0000 7f4ffd572640 1 Processor -- start 2023-10-14T11:12:37.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.580+0000 7f4ffd572640 1 -- start start 2023-10-14T11:12:37.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4ffd572640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ff80b84e0 0x7f4ff814c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:37.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4ffd572640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff80d0210 0x7f4ff815df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:37.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4ffd572640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ff815cba0 0x7f4ff8150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:37.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4ffd572640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff814cdb0 con 0x7f4ff80d0210 2023-10-14T11:12:37.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4ffd572640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff80c7ac0 con 0x7f4ff815cba0 2023-10-14T11:12:37.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4ffd572640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff81517f0 con 0x7f4ff80b84e0 2023-10-14T11:12:37.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4feffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff80d0210 0x7f4ff815df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:37.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4feffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff80d0210 0x7f4ff815df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32954/0 (socket says 172.21.15.26:32954) 2023-10-14T11:12:37.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4feffff640 1 -- 172.21.15.26:0/2496164033 learned_addr learned my addr 172.21.15.26:0/2496164033 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:37.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4ff6ffd640 1 --2- 172.21.15.26:0/2496164033 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ff80b84e0 0x7f4ff814c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:37.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4ff77fe640 1 --2- 172.21.15.26:0/2496164033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ff815cba0 0x7f4ff8150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:37.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4feffff640 1 -- 172.21.15.26:0/2496164033 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ff80b84e0 msgr2=0x7f4ff814c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:37.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4feffff640 1 --2- 172.21.15.26:0/2496164033 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ff80b84e0 0x7f4ff814c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4feffff640 1 -- 172.21.15.26:0/2496164033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ff815cba0 msgr2=0x7f4ff8150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:37.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4feffff640 1 --2- 172.21.15.26:0/2496164033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ff815cba0 0x7f4ff8150c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4feffff640 1 -- 172.21.15.26:0/2496164033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe0009420 con 0x7f4ff80d0210 2023-10-14T11:12:37.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4ff77fe640 1 --2- 172.21.15.26:0/2496164033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ff815cba0 0x7f4ff8150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:37.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4feffff640 1 --2- 172.21.15.26:0/2496164033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff80d0210 0x7f4ff815df70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4fe00ac040 tx=0x7f4fe0019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:37.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4fef7fe640 1 -- 172.21.15.26:0/2496164033 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0004450 con 0x7f4ff80d0210 2023-10-14T11:12:37.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4fef7fe640 1 -- 172.21.15.26:0/2496164033 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe00aa8f0 con 0x7f4ff80d0210 2023-10-14T11:12:37.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4fef7fe640 1 -- 172.21.15.26:0/2496164033 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe00aac80 con 0x7f4ff80d0210 2023-10-14T11:12:37.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4ffd572640 1 -- 172.21.15.26:0/2496164033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff8151ad0 con 0x7f4ff80d0210 2023-10-14T11:12:37.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4ffd572640 1 -- 172.21.15.26:0/2496164033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff80c7ff0 con 0x7f4ff80d0210 2023-10-14T11:12:37.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4ffd572640 1 -- 172.21.15.26:0/2496164033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff80c81e0 con 0x7f4ff80d0210 2023-10-14T11:12:37.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.584+0000 7f4fef7fe640 1 -- 172.21.15.26:0/2496164033 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4fe0003620 con 0x7f4ff80d0210 2023-10-14T11:12:37.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.588+0000 7f4fef7fe640 1 --2- 172.21.15.26:0/2496164033 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4fd80664a0 0x7f4fd8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:37.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.588+0000 7f4fef7fe640 1 -- 172.21.15.26:0/2496164033 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4fe011e080 con 0x7f4ff80d0210 2023-10-14T11:12:37.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.588+0000 7f4ff6ffd640 1 --2- 172.21.15.26:0/2496164033 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4fd80664a0 0x7f4fd8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:37.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.588+0000 7f4ff6ffd640 1 --2- 172.21.15.26:0/2496164033 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4fd80664a0 0x7f4fd8068960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4fe80011f0 tx=0x7f4fe8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:37.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.592+0000 7f4fef7fe640 1 -- 172.21.15.26:0/2496164033 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4fe00eb2a0 con 0x7f4ff80d0210 2023-10-14T11:12:37.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.744+0000 7f4ffd572640 1 -- 172.21.15.26:0/2496164033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ff804e170 con 0x7f4ff80d0210 2023-10-14T11:12:37.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.744+0000 7f4fef7fe640 1 -- 172.21.15.26:0/2496164033 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4fe00ee8c0 con 0x7f4ff80d0210 2023-10-14T11:12:37.749 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:12:37.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.748+0000 7f4ffd572640 1 -- 172.21.15.26:0/2496164033 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4fd80664a0 msgr2=0x7f4fd8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:37.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.748+0000 7f4ffd572640 1 --2- 172.21.15.26:0/2496164033 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4fd80664a0 0x7f4fd8068960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4fe80011f0 tx=0x7f4fe8009040 comp rx=0 tx=0).stop 2023-10-14T11:12:37.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.748+0000 7f4ffd572640 1 -- 172.21.15.26:0/2496164033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff80d0210 msgr2=0x7f4ff815df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:37.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.748+0000 7f4ffd572640 1 --2- 172.21.15.26:0/2496164033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff80d0210 0x7f4ff815df70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4fe00ac040 tx=0x7f4fe0019260 comp rx=0 tx=0).stop 2023-10-14T11:12:37.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.748+0000 7f4ffd572640 1 -- 172.21.15.26:0/2496164033 shutdown_connections 2023-10-14T11:12:37.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.748+0000 7f4ffd572640 1 --2- 172.21.15.26:0/2496164033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ff815cba0 0x7f4ff8150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.748+0000 7f4ffd572640 1 --2- 172.21.15.26:0/2496164033 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4fd80664a0 0x7f4fd8068960 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.748+0000 7f4ffd572640 1 --2- 172.21.15.26:0/2496164033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff80d0210 0x7f4ff815df70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.748+0000 7f4ffd572640 1 --2- 172.21.15.26:0/2496164033 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ff80b84e0 0x7f4ff814c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.748+0000 7f4ffd572640 1 -- 172.21.15.26:0/2496164033 >> 172.21.15.26:0/2496164033 conn(0x7f4ff80719c0 msgr2=0x7f4ff815b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:37.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.748+0000 7f4ffd572640 1 -- 172.21.15.26:0/2496164033 shutdown_connections 2023-10-14T11:12:37.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.748+0000 7f4ffd572640 1 -- 172.21.15.26:0/2496164033 wait complete. 2023-10-14T11:12:37.770 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T11:12:37.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.912+0000 7f9312217640 1 Processor -- start 2023-10-14T11:12:37.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.912+0000 7f9312217640 1 -- start start 2023-10-14T11:12:37.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.916+0000 7f9312217640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f930c161390 0x7f930c0ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:37.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.916+0000 7f9312217640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f930c06e2f0 0x7f930c06e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:37.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.916+0000 7f9312217640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930c0cdc30 con 0x7f930c15ce10 2023-10-14T11:12:37.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.916+0000 7f9312217640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f930c1617f0 con 0x7f930c161390 2023-10-14T11:12:37.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.916+0000 7f9312217640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930c06eca0 con 0x7f930c06e2f0 2023-10-14T11:12:37.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.916+0000 7f930affd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f930c161390 0x7f930c0ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:37.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.916+0000 7f930affd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f930c161390 0x7f930c0ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:51370/0 (socket says 172.21.15.26:51370) 2023-10-14T11:12:37.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.916+0000 7f930affd640 1 -- 172.21.15.26:0/4040411132 learned_addr learned my addr 172.21.15.26:0/4040411132 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:37.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.916+0000 7f930bfff640 1 --2- 172.21.15.26:0/4040411132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f930c06e2f0 0x7f930c06e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:37.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.916+0000 7f930affd640 1 -- 172.21.15.26:0/4040411132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f930c06e2f0 msgr2=0x7f930c06e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:37.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.916+0000 7f930affd640 1 --2- 172.21.15.26:0/4040411132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f930c06e2f0 0x7f930c06e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.916+0000 7f930affd640 1 -- 172.21.15.26:0/4040411132 >> v1:172.21.15.110:6789/0 conn(0x7f930c15ce10 legacy=0x7f930c0cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:37.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.916+0000 7f930affd640 1 -- 172.21.15.26:0/4040411132 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c0c9750 con 0x7f930c161390 2023-10-14T11:12:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.920+0000 7f930affd640 1 --2- 172.21.15.26:0/4040411132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f930c161390 0x7f930c0ca7b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f93000098a0 tx=0x7f930001c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6a0e18e9df0edce server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.920+0000 7f930a7fc640 1 -- 172.21.15.26:0/4040411132 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93000aa680 con 0x7f930c161390 2023-10-14T11:12:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.920+0000 7f930a7fc640 1 -- 172.21.15.26:0/4040411132 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93000aa7e0 con 0x7f930c161390 2023-10-14T11:12:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.920+0000 7f930a7fc640 1 -- 172.21.15.26:0/4040411132 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93000aab70 con 0x7f930c161390 2023-10-14T11:12:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.920+0000 7f9312217640 1 -- 172.21.15.26:0/4040411132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f930c161390 msgr2=0x7f930c0ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.920+0000 7f9312217640 1 --2- 172.21.15.26:0/4040411132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f930c161390 0x7f930c0ca7b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f93000098a0 tx=0x7f930001c520 comp rx=0 tx=0).stop 2023-10-14T11:12:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.920+0000 7f9312217640 1 -- 172.21.15.26:0/4040411132 shutdown_connections 2023-10-14T11:12:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.920+0000 7f9312217640 1 --2- 172.21.15.26:0/4040411132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f930c06e2f0 0x7f930c06e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.920+0000 7f9312217640 1 --2- 172.21.15.26:0/4040411132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f930c161390 0x7f930c0ca7b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.920+0000 7f9312217640 1 -- 172.21.15.26:0/4040411132 >> 172.21.15.26:0/4040411132 conn(0x7f930c0cef20 msgr2=0x7f930c0cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.920+0000 7f9312217640 1 -- 172.21.15.26:0/4040411132 shutdown_connections 2023-10-14T11:12:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.920+0000 7f9312217640 1 -- 172.21.15.26:0/4040411132 wait complete. 2023-10-14T11:12:37.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.920+0000 7f9312217640 1 Processor -- start 2023-10-14T11:12:37.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.920+0000 7f9312217640 1 -- start start 2023-10-14T11:12:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.920+0000 7f9312217640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f930c06e2f0 0x7f930c14b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.920+0000 7f9312217640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f930c161390 0x7f930c15d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.920+0000 7f9312217640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f930c15e590 0x7f930c15d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.920+0000 7f9312217640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c14fe70 con 0x7f930c161390 2023-10-14T11:12:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.924+0000 7f9312217640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c14f4b0 con 0x7f930c06e2f0 2023-10-14T11:12:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.924+0000 7f9312217640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930c15c1c0 con 0x7f930c15e590 2023-10-14T11:12:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.924+0000 7f930affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f930c161390 0x7f930c15d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.924+0000 7f930affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f930c161390 0x7f930c15d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32956/0 (socket says 172.21.15.26:32956) 2023-10-14T11:12:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.924+0000 7f930affd640 1 -- 172.21.15.26:0/274867304 learned_addr learned my addr 172.21.15.26:0/274867304 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.924+0000 7f930b7fe640 1 --2- 172.21.15.26:0/274867304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f930c06e2f0 0x7f930c14b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.924+0000 7f930bfff640 1 --2- 172.21.15.26:0/274867304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f930c15e590 0x7f930c15d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.924+0000 7f930affd640 1 -- 172.21.15.26:0/274867304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f930c15e590 msgr2=0x7f930c15d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.924+0000 7f930affd640 1 --2- 172.21.15.26:0/274867304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f930c15e590 0x7f930c15d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.924+0000 7f930affd640 1 -- 172.21.15.26:0/274867304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f930c06e2f0 msgr2=0x7f930c14b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.924+0000 7f930affd640 1 --2- 172.21.15.26:0/274867304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f930c06e2f0 0x7f930c14b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.924+0000 7f930affd640 1 -- 172.21.15.26:0/274867304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93000094d0 con 0x7f930c161390 2023-10-14T11:12:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.924+0000 7f930affd640 1 --2- 172.21.15.26:0/274867304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f930c161390 0x7f930c15d200 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f93000ac040 tx=0x7f93000192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.924+0000 7f92f3fff640 1 -- 172.21.15.26:0/274867304 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93000b4810 con 0x7f930c161390 2023-10-14T11:12:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.924+0000 7f92f3fff640 1 -- 172.21.15.26:0/274867304 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93000b49b0 con 0x7f930c161390 2023-10-14T11:12:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.924+0000 7f92f3fff640 1 -- 172.21.15.26:0/274867304 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93000b4d60 con 0x7f930c161390 2023-10-14T11:12:37.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.924+0000 7f9312217640 1 -- 172.21.15.26:0/274867304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930c0c17a0 con 0x7f930c161390 2023-10-14T11:12:37.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.924+0000 7f9312217640 1 -- 172.21.15.26:0/274867304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930c0c1a80 con 0x7f930c161390 2023-10-14T11:12:37.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.924+0000 7f9312217640 1 -- 172.21.15.26:0/274867304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f930c04e170 con 0x7f930c161390 2023-10-14T11:12:37.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.924+0000 7f92f3fff640 1 -- 172.21.15.26:0/274867304 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f93000be410 con 0x7f930c161390 2023-10-14T11:12:37.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.928+0000 7f92f3fff640 1 --2- 172.21.15.26:0/274867304 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f92f80664a0 0x7f92f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:37.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.928+0000 7f92f3fff640 1 -- 172.21.15.26:0/274867304 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f930011ec10 con 0x7f930c161390 2023-10-14T11:12:37.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.928+0000 7f930b7fe640 1 --2- 172.21.15.26:0/274867304 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f92f80664a0 0x7f92f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:37.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.928+0000 7f930b7fe640 1 --2- 172.21.15.26:0/274867304 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f92f80664a0 0x7f92f8068960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f92fc007fd0 tx=0x7f92fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:37.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:37.932+0000 7f92f3fff640 1 -- 172.21.15.26:0/274867304 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f93000ebf60 con 0x7f930c161390 2023-10-14T11:12:38.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.088+0000 7f9312217640 1 -- 172.21.15.26:0/274867304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f930c06ef60 con 0x7f930c161390 2023-10-14T11:12:38.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.092+0000 7f92f3fff640 1 -- 172.21.15.26:0/274867304 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f93000ef580 con 0x7f930c161390 2023-10-14T11:12:38.094 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:12:38.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.092+0000 7f9312217640 1 -- 172.21.15.26:0/274867304 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f92f80664a0 msgr2=0x7f92f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:38.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.092+0000 7f9312217640 1 --2- 172.21.15.26:0/274867304 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f92f80664a0 0x7f92f8068960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f92fc007fd0 tx=0x7f92fc009040 comp rx=0 tx=0).stop 2023-10-14T11:12:38.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.092+0000 7f9312217640 1 -- 172.21.15.26:0/274867304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f930c161390 msgr2=0x7f930c15d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:38.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.092+0000 7f9312217640 1 --2- 172.21.15.26:0/274867304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f930c161390 0x7f930c15d200 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f93000ac040 tx=0x7f93000192c0 comp rx=0 tx=0).stop 2023-10-14T11:12:38.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.092+0000 7f9312217640 1 -- 172.21.15.26:0/274867304 shutdown_connections 2023-10-14T11:12:38.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.092+0000 7f9312217640 1 --2- 172.21.15.26:0/274867304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f930c15e590 0x7f930c15d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:38.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.092+0000 7f9312217640 1 --2- 172.21.15.26:0/274867304 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f92f80664a0 0x7f92f8068960 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:38.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.092+0000 7f9312217640 1 --2- 172.21.15.26:0/274867304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f930c161390 0x7f930c15d200 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:38.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.092+0000 7f9312217640 1 --2- 172.21.15.26:0/274867304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f930c06e2f0 0x7f930c14b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:38.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.092+0000 7f9312217640 1 -- 172.21.15.26:0/274867304 >> 172.21.15.26:0/274867304 conn(0x7f930c0cef20 msgr2=0x7f930c070ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:38.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.092+0000 7f9312217640 1 -- 172.21.15.26:0/274867304 shutdown_connections 2023-10-14T11:12:38.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.092+0000 7f9312217640 1 -- 172.21.15.26:0/274867304 wait complete. 2023-10-14T11:12:38.115 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:12:38.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.256+0000 7fe3cf254640 1 Processor -- start 2023-10-14T11:12:38.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.256+0000 7fe3cf254640 1 -- start start 2023-10-14T11:12:38.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.256+0000 7fe3cf254640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe3c8070c40 0x7fe3c815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:38.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.256+0000 7fe3cf254640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3c80b4020 0x7fe3c80b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:38.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.256+0000 7fe3cf254640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c815be60 con 0x7fe3c80b0620 2023-10-14T11:12:38.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.256+0000 7fe3cf254640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c815b3b0 con 0x7fe3c80b4020 2023-10-14T11:12:38.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.256+0000 7fe3cf254640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c815c1f0 con 0x7fe3c8070c40 2023-10-14T11:12:38.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.260+0000 7fe3c7fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3c80b4020 0x7fe3c80b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:38.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.260+0000 7fe3c7fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3c80b4020 0x7fe3c80b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32966/0 (socket says 172.21.15.26:32966) 2023-10-14T11:12:38.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.260+0000 7fe3c7fff640 1 -- 172.21.15.26:0/2060163240 learned_addr learned my addr 172.21.15.26:0/2060163240 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:38.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.260+0000 7fe3ccff0640 1 --2- 172.21.15.26:0/2060163240 >> v2:172.21.15.110:3300/0 conn(0x7fe3c8070c40 0x7fe3c815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:38.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.260+0000 7fe3c7fff640 1 -- 172.21.15.26:0/2060163240 >> v2:172.21.15.110:3300/0 conn(0x7fe3c8070c40 msgr2=0x7fe3c815ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:38.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.260+0000 7fe3c7fff640 1 --2- 172.21.15.26:0/2060163240 >> v2:172.21.15.110:3300/0 conn(0x7fe3c8070c40 0x7fe3c815ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:38.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.260+0000 7fe3c7fff640 1 -- 172.21.15.26:0/2060163240 >> v1:172.21.15.110:6789/0 conn(0x7fe3c80b0620 legacy=0x7fe3c815c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:38.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.260+0000 7fe3c7fff640 1 -- 172.21.15.26:0/2060163240 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c80b0a30 con 0x7fe3c80b4020 2023-10-14T11:12:38.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.260+0000 7fe3ccff0640 1 --2- 172.21.15.26:0/2060163240 >> v2:172.21.15.110:3300/0 conn(0x7fe3c8070c40 0x7fe3c815ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:38.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.260+0000 7fe3c7fff640 1 --2- 172.21.15.26:0/2060163240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3c80b4020 0x7fe3c80b00e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe3c806ae80 tx=0x7fe3b401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535c08a531084acc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:38.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.260+0000 7fe3c77fe640 1 -- 172.21.15.26:0/2060163240 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b40ab670 con 0x7fe3c80b4020 2023-10-14T11:12:38.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.260+0000 7fe3c77fe640 1 -- 172.21.15.26:0/2060163240 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b40ab7d0 con 0x7fe3c80b4020 2023-10-14T11:12:38.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.260+0000 7fe3c77fe640 1 -- 172.21.15.26:0/2060163240 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b40abb60 con 0x7fe3c80b4020 2023-10-14T11:12:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.264+0000 7fe3cf254640 1 -- 172.21.15.26:0/2060163240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3c80b4020 msgr2=0x7fe3c80b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.264+0000 7fe3cf254640 1 --2- 172.21.15.26:0/2060163240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3c80b4020 0x7fe3c80b00e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe3c806ae80 tx=0x7fe3b401c470 comp rx=0 tx=0).stop 2023-10-14T11:12:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.264+0000 7fe3cf254640 1 -- 172.21.15.26:0/2060163240 shutdown_connections 2023-10-14T11:12:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.264+0000 7fe3cf254640 1 --2- 172.21.15.26:0/2060163240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3c80b4020 0x7fe3c80b00e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.264+0000 7fe3cf254640 1 --2- 172.21.15.26:0/2060163240 >> v2:172.21.15.110:3300/0 conn(0x7fe3c8070c40 0x7fe3c815ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.264+0000 7fe3cf254640 1 -- 172.21.15.26:0/2060163240 >> 172.21.15.26:0/2060163240 conn(0x7fe3c806c190 msgr2=0x7fe3c806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.264+0000 7fe3cf254640 1 -- 172.21.15.26:0/2060163240 shutdown_connections 2023-10-14T11:12:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.264+0000 7fe3cf254640 1 -- 172.21.15.26:0/2060163240 wait complete. 2023-10-14T11:12:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.264+0000 7fe3cf254640 1 Processor -- start 2023-10-14T11:12:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.264+0000 7fe3cf254640 1 -- start start 2023-10-14T11:12:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.264+0000 7fe3cf254640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3c8070c40 0x7fe3c80c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:38.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.264+0000 7fe3cf254640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c80b0620 0x7fe3c814fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:38.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.264+0000 7fe3cf254640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3c80b4020 0x7fe3c80b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:38.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.264+0000 7fe3cf254640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c80c3e10 con 0x7fe3c8070c40 2023-10-14T11:12:38.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.264+0000 7fe3cf254640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c80c2400 con 0x7fe3c80b0620 2023-10-14T11:12:38.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.264+0000 7fe3cf254640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c80c25e0 con 0x7fe3c80b4020 2023-10-14T11:12:38.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.264+0000 7fe3ccff0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3c8070c40 0x7fe3c80c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:38.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.264+0000 7fe3ccff0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3c8070c40 0x7fe3c80c38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32976/0 (socket says 172.21.15.26:32976) 2023-10-14T11:12:38.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.264+0000 7fe3ccff0640 1 -- 172.21.15.26:0/2627130398 learned_addr learned my addr 172.21.15.26:0/2627130398 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:38.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.264+0000 7fe3c7fff640 1 --2- 172.21.15.26:0/2627130398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c80b0620 0x7fe3c814fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:38.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.264+0000 7fe3cd7f1640 1 --2- 172.21.15.26:0/2627130398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3c80b4020 0x7fe3c80b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:38.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.268+0000 7fe3ccff0640 1 -- 172.21.15.26:0/2627130398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3c80b4020 msgr2=0x7fe3c80b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:38.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.268+0000 7fe3ccff0640 1 --2- 172.21.15.26:0/2627130398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3c80b4020 0x7fe3c80b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:38.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.268+0000 7fe3ccff0640 1 -- 172.21.15.26:0/2627130398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c80b0620 msgr2=0x7fe3c814fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:38.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.268+0000 7fe3ccff0640 1 --2- 172.21.15.26:0/2627130398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c80b0620 0x7fe3c814fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:38.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.268+0000 7fe3ccff0640 1 -- 172.21.15.26:0/2627130398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b40094d0 con 0x7fe3c8070c40 2023-10-14T11:12:38.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.268+0000 7fe3ccff0640 1 --2- 172.21.15.26:0/2627130398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3c8070c40 0x7fe3c80c38d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00e810 tx=0x7fe3bc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:38.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.268+0000 7fe3c57fa640 1 -- 172.21.15.26:0/2627130398 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc00c8d0 con 0x7fe3c8070c40 2023-10-14T11:12:38.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.268+0000 7fe3c57fa640 1 -- 172.21.15.26:0/2627130398 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc00ca30 con 0x7fe3c8070c40 2023-10-14T11:12:38.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.268+0000 7fe3c57fa640 1 -- 172.21.15.26:0/2627130398 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc00cde0 con 0x7fe3c8070c40 2023-10-14T11:12:38.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.268+0000 7fe3cf254640 1 -- 172.21.15.26:0/2627130398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c80c2830 con 0x7fe3c8070c40 2023-10-14T11:12:38.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.268+0000 7fe3cf254640 1 -- 172.21.15.26:0/2627130398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c80c2df0 con 0x7fe3c8070c40 2023-10-14T11:12:38.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.268+0000 7fe3cf254640 1 -- 172.21.15.26:0/2627130398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c8074010 con 0x7fe3c8070c40 2023-10-14T11:12:38.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.268+0000 7fe3c57fa640 1 -- 172.21.15.26:0/2627130398 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe3bc013410 con 0x7fe3c8070c40 2023-10-14T11:12:38.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.268+0000 7fe3c57fa640 1 --2- 172.21.15.26:0/2627130398 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe3ac0664a0 0x7fe3ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:38.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.268+0000 7fe3c57fa640 1 -- 172.21.15.26:0/2627130398 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe3bc083f10 con 0x7fe3c8070c40 2023-10-14T11:12:38.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.268+0000 7fe3c7fff640 1 --2- 172.21.15.26:0/2627130398 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe3ac0664a0 0x7fe3ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:38.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.272+0000 7fe3c7fff640 1 --2- 172.21.15.26:0/2627130398 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe3ac0664a0 0x7fe3ac068960 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40af000 tx=0x7fe3b40b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:38.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.272+0000 7fe3c57fa640 1 -- 172.21.15.26:0/2627130398 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe3bc051150 con 0x7fe3c8070c40 2023-10-14T11:12:38.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.444+0000 7fe3cf254640 1 -- 172.21.15.26:0/2627130398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe3c815d930 con 0x7fe3c8070c40 2023-10-14T11:12:38.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.444+0000 7fe3c57fa640 1 -- 172.21.15.26:0/2627130398 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe3bc054770 con 0x7fe3c8070c40 2023-10-14T11:12:38.448 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-10-14T11:12:38.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.448+0000 7fe3cf254640 1 -- 172.21.15.26:0/2627130398 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe3ac0664a0 msgr2=0x7fe3ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:38.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.448+0000 7fe3cf254640 1 --2- 172.21.15.26:0/2627130398 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe3ac0664a0 0x7fe3ac068960 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40af000 tx=0x7fe3b40b6040 comp rx=0 tx=0).stop 2023-10-14T11:12:38.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.448+0000 7fe3cf254640 1 -- 172.21.15.26:0/2627130398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3c8070c40 msgr2=0x7fe3c80c38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:38.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.448+0000 7fe3cf254640 1 --2- 172.21.15.26:0/2627130398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3c8070c40 0x7fe3c80c38d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00e810 tx=0x7fe3bc00ecd0 comp rx=0 tx=0).stop 2023-10-14T11:12:38.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.448+0000 7fe3cf254640 1 -- 172.21.15.26:0/2627130398 shutdown_connections 2023-10-14T11:12:38.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.448+0000 7fe3cf254640 1 --2- 172.21.15.26:0/2627130398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3c80b4020 0x7fe3c80b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:38.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.448+0000 7fe3cf254640 1 --2- 172.21.15.26:0/2627130398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c80b0620 0x7fe3c814fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:38.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.448+0000 7fe3cf254640 1 --2- 172.21.15.26:0/2627130398 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe3ac0664a0 0x7fe3ac068960 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:38.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.448+0000 7fe3cf254640 1 --2- 172.21.15.26:0/2627130398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3c8070c40 0x7fe3c80c38d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:38.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.448+0000 7fe3cf254640 1 -- 172.21.15.26:0/2627130398 >> 172.21.15.26:0/2627130398 conn(0x7fe3c806c190 msgr2=0x7fe3c80b1140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:38.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.448+0000 7fe3cf254640 1 -- 172.21.15.26:0/2627130398 shutdown_connections 2023-10-14T11:12:38.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:38.448+0000 7fe3cf254640 1 -- 172.21.15.26:0/2627130398 wait complete. 2023-10-14T11:12:38.469 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi026.front.sepia.ceph.com... 2023-10-14T11:12:38.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:38.470 DEBUG:teuthology.orchestra.run.smithi026:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-14T11:12:38.496 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi026.stderr:ceph-fuse[42931]: fuse finished with error 0 and tester_r 0 2023-10-14T11:12:38.499 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:12:44.601 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T11:12:44.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:44.602 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-14T11:12:44.623 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:12:44.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0293f8640 1 Processor -- start 2023-10-14T11:12:44.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0293f8640 1 -- start start 2023-10-14T11:12:44.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0293f8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0240d3010 0x7fc0240cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:44.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0293f8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0240ce770 con 0x7fc0240d15d0 2023-10-14T11:12:44.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0293f8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0240d0600 con 0x7fc02415cb90 2023-10-14T11:12:44.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0293f8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0240c6450 con 0x7fc0240d3010 2023-10-14T11:12:44.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc01a7fc640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc0240d15d0 0x7fc0240c6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57810/0 (socket says 172.21.15.26:57810) 2023-10-14T11:12:44.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc01a7fc640 1 -- 172.21.15.26:0/4137207226 learned_addr learned my addr 172.21.15.26:0/4137207226 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:44.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0237fe640 1 --2- 172.21.15.26:0/4137207226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0240d3010 0x7fc0240cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:44.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0227fc640 1 -- 172.21.15.26:0/4137207226 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053029582 0 0) 0x7fc0240ce770 con 0x7fc0240d15d0 2023-10-14T11:12:44.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0227fc640 1 -- 172.21.15.26:0/4137207226 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc010003530 con 0x7fc0240d15d0 2023-10-14T11:12:44.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0227fc640 1 -- 172.21.15.26:0/4137207226 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629783946 0 0) 0x7fc0240d0600 con 0x7fc02415cb90 2023-10-14T11:12:44.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0227fc640 1 -- 172.21.15.26:0/4137207226 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0240ce770 con 0x7fc02415cb90 2023-10-14T11:12:44.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0227fc640 1 -- 172.21.15.26:0/4137207226 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2364232487 0 0) 0x7fc010003530 con 0x7fc0240d15d0 2023-10-14T11:12:44.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0227fc640 1 -- 172.21.15.26:0/4137207226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0240d3010 msgr2=0x7fc0240cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:44.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0227fc640 1 --2- 172.21.15.26:0/4137207226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0240d3010 0x7fc0240cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:44.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0227fc640 1 -- 172.21.15.26:0/4137207226 >> v1:172.21.15.110:6789/0 conn(0x7fc02415cb90 legacy=0x7fc0240d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:44.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0227fc640 1 -- 172.21.15.26:0/4137207226 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0240d08a0 con 0x7fc0240d15d0 2023-10-14T11:12:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0227fc640 1 -- 172.21.15.26:0/4137207226 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7fc00c001680 con 0x7fc0240d15d0 2023-10-14T11:12:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0227fc640 1 -- 172.21.15.26:0/4137207226 >> v1:172.21.15.26:6789/0 conn(0x7fc0240d15d0 legacy=0x7fc0240c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0227fc640 1 --2- 172.21.15.26:0/4137207226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc010003b40 0x7fc010003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0227fc640 1 --2- 172.21.15.26:0/4137207226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0100047d0 0x7fc010004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0227fc640 1 --2- 172.21.15.26:0/4137207226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0240d3010 0x7fc0100051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0227fc640 1 -- 172.21.15.26:0/4137207226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0240c6450 con 0x7fc010003b40 2023-10-14T11:12:44.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0227fc640 1 -- 172.21.15.26:0/4137207226 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01000baa0 con 0x7fc0100047d0 2023-10-14T11:12:44.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0227fc640 1 -- 172.21.15.26:0/4137207226 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01000bc60 con 0x7fc0240d3010 2023-10-14T11:12:44.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc022ffd640 1 --2- 172.21.15.26:0/4137207226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc010003b40 0x7fc010003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:44.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc01a7fc640 1 --2- 172.21.15.26:0/4137207226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0100047d0 0x7fc010004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:44.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.816+0000 7fc0237fe640 1 --2- 172.21.15.26:0/4137207226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0240d3010 0x7fc0100051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:44.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.820+0000 7fc022ffd640 1 -- 172.21.15.26:0/4137207226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0240d3010 msgr2=0x7fc0100051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:44.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.820+0000 7fc022ffd640 1 --2- 172.21.15.26:0/4137207226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0240d3010 0x7fc0100051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:44.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.820+0000 7fc022ffd640 1 -- 172.21.15.26:0/4137207226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0100047d0 msgr2=0x7fc010004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:44.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.820+0000 7fc022ffd640 1 --2- 172.21.15.26:0/4137207226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0100047d0 0x7fc010004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:44.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.820+0000 7fc022ffd640 1 -- 172.21.15.26:0/4137207226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc010003530 con 0x7fc010003b40 2023-10-14T11:12:44.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.820+0000 7fc022ffd640 1 --2- 172.21.15.26:0/4137207226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc010003b40 0x7fc010003f40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc014002040 tx=0x7fc01401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379f091775a063a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:44.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.820+0000 7fc0227fc640 1 -- 172.21.15.26:0/4137207226 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc014003bd0 con 0x7fc010003b40 2023-10-14T11:12:44.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.820+0000 7fc0227fc640 1 -- 172.21.15.26:0/4137207226 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc014003d50 con 0x7fc010003b40 2023-10-14T11:12:44.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.820+0000 7fc0227fc640 1 -- 172.21.15.26:0/4137207226 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc014005310 con 0x7fc010003b40 2023-10-14T11:12:44.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.820+0000 7fc0293f8640 1 -- 172.21.15.26:0/4137207226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc010003b40 msgr2=0x7fc010003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:44.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.820+0000 7fc0293f8640 1 --2- 172.21.15.26:0/4137207226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc010003b40 0x7fc010003f40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc014002040 tx=0x7fc01401c8b0 comp rx=0 tx=0).stop 2023-10-14T11:12:44.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.820+0000 7fc0237fe640 1 -- 172.21.15.26:0/4137207226 reap_dead start 2023-10-14T11:12:44.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.820+0000 7fc0293f8640 1 -- 172.21.15.26:0/4137207226 shutdown_connections 2023-10-14T11:12:44.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.820+0000 7fc0293f8640 1 -- 172.21.15.26:0/4137207226 >> 172.21.15.26:0/4137207226 conn(0x7fc02409bc50 msgr2=0x7fc0240d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:44.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.824+0000 7fc0293f8640 1 -- 172.21.15.26:0/4137207226 shutdown_connections 2023-10-14T11:12:44.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.824+0000 7fc0293f8640 1 -- 172.21.15.26:0/4137207226 wait complete. 2023-10-14T11:12:44.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.824+0000 7fc0293f8640 1 Processor -- start 2023-10-14T11:12:44.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.824+0000 7fc0293f8640 1 -- start start 2023-10-14T11:12:44.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.824+0000 7fc0293f8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc010003b40 0x7fc024158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:44.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.824+0000 7fc0293f8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc024150180 0x7fc024151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:44.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.824+0000 7fc0293f8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0240cd390 0x7fc0240cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:44.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.824+0000 7fc0293f8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0240cdd80 con 0x7fc024150180 2023-10-14T11:12:44.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.824+0000 7fc0293f8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0241597f0 con 0x7fc0240cd390 2023-10-14T11:12:44.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.824+0000 7fc0293f8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc024150600 con 0x7fc010003b40 2023-10-14T11:12:44.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.824+0000 7fc01a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc024150180 0x7fc024151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:44.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.824+0000 7fc01a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc024150180 0x7fc024151d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35994/0 (socket says 172.21.15.26:35994) 2023-10-14T11:12:44.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.824+0000 7fc01a7fc640 1 -- 172.21.15.26:0/2438566775 learned_addr learned my addr 172.21.15.26:0/2438566775 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:44.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.824+0000 7fc022ffd640 1 --2- 172.21.15.26:0/2438566775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc010003b40 0x7fc024158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:44.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.824+0000 7fc0237fe640 1 --2- 172.21.15.26:0/2438566775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0240cd390 0x7fc0240cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:44.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.824+0000 7fc01a7fc640 1 -- 172.21.15.26:0/2438566775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc010003b40 msgr2=0x7fc024158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:44.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.824+0000 7fc01a7fc640 1 --2- 172.21.15.26:0/2438566775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc010003b40 0x7fc024158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:44.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.824+0000 7fc01a7fc640 1 -- 172.21.15.26:0/2438566775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0240cd390 msgr2=0x7fc0240cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:44.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.824+0000 7fc01a7fc640 1 --2- 172.21.15.26:0/2438566775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0240cd390 0x7fc0240cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:44.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.824+0000 7fc01a7fc640 1 -- 172.21.15.26:0/2438566775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc024158f50 con 0x7fc024150180 2023-10-14T11:12:44.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.824+0000 7fc0237fe640 1 --2- 172.21.15.26:0/2438566775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0240cd390 0x7fc0240cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:44.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.824+0000 7fc01a7fc640 1 --2- 172.21.15.26:0/2438566775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc024150180 0x7fc024151d90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc00c007340 tx=0x7fc00c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:44.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.828+0000 7fc01bfff640 1 -- 172.21.15.26:0/2438566775 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c00f960 con 0x7fc024150180 2023-10-14T11:12:44.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.828+0000 7fc01bfff640 1 -- 172.21.15.26:0/2438566775 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00c00fae0 con 0x7fc024150180 2023-10-14T11:12:44.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.828+0000 7fc01bfff640 1 -- 172.21.15.26:0/2438566775 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c00fe90 con 0x7fc024150180 2023-10-14T11:12:44.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.828+0000 7fc0293f8640 1 -- 172.21.15.26:0/2438566775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc024159230 con 0x7fc024150180 2023-10-14T11:12:44.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.828+0000 7fc0293f8640 1 -- 172.21.15.26:0/2438566775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0240b6210 con 0x7fc024150180 2023-10-14T11:12:44.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.828+0000 7fc0293f8640 1 -- 172.21.15.26:0/2438566775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0240b6430 con 0x7fc024150180 2023-10-14T11:12:44.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.828+0000 7fc01bfff640 1 -- 172.21.15.26:0/2438566775 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc00c01d460 con 0x7fc024150180 2023-10-14T11:12:44.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.828+0000 7fc01bfff640 1 --2- 172.21.15.26:0/2438566775 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc0040664d0 0x7fc004068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:44.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.828+0000 7fc01bfff640 1 -- 172.21.15.26:0/2438566775 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc00c084150 con 0x7fc024150180 2023-10-14T11:12:44.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.828+0000 7fc022ffd640 1 --2- 172.21.15.26:0/2438566775 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc0040664d0 0x7fc004068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:44.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.828+0000 7fc022ffd640 1 --2- 172.21.15.26:0/2438566775 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc0040664d0 0x7fc004068990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc0140ac000 tx=0x7fc0140a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:44.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:44.832+0000 7fc01bfff640 1 -- 172.21.15.26:0/2438566775 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc00c0512d0 con 0x7fc024150180 2023-10-14T11:12:45.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.000+0000 7fc0293f8640 1 -- 172.21.15.26:0/2438566775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc024074010 con 0x7fc024150180 2023-10-14T11:12:45.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.004+0000 7fc01bfff640 1 -- 172.21.15.26:0/2438566775 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fc00c0548f0 con 0x7fc024150180 2023-10-14T11:12:45.006 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:45.007 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":25,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:12:27.398936+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:12:45.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.004+0000 7fc0293f8640 1 -- 172.21.15.26:0/2438566775 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc0040664d0 msgr2=0x7fc004068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:45.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.004+0000 7fc0293f8640 1 --2- 172.21.15.26:0/2438566775 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc0040664d0 0x7fc004068990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc0140ac000 tx=0x7fc0140a7000 comp rx=0 tx=0).stop 2023-10-14T11:12:45.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.004+0000 7fc0293f8640 1 -- 172.21.15.26:0/2438566775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc024150180 msgr2=0x7fc024151d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:45.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.004+0000 7fc0293f8640 1 --2- 172.21.15.26:0/2438566775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc024150180 0x7fc024151d90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc00c007340 tx=0x7fc00c007800 comp rx=0 tx=0).stop 2023-10-14T11:12:45.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.004+0000 7fc0293f8640 1 -- 172.21.15.26:0/2438566775 shutdown_connections 2023-10-14T11:12:45.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.004+0000 7fc0293f8640 1 --2- 172.21.15.26:0/2438566775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0240cd390 0x7fc0240cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.004+0000 7fc0293f8640 1 --2- 172.21.15.26:0/2438566775 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc0040664d0 0x7fc004068990 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.004+0000 7fc0293f8640 1 --2- 172.21.15.26:0/2438566775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc024150180 0x7fc024151d90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.004+0000 7fc0293f8640 1 --2- 172.21.15.26:0/2438566775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc010003b40 0x7fc024158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.004+0000 7fc0293f8640 1 -- 172.21.15.26:0/2438566775 >> 172.21.15.26:0/2438566775 conn(0x7fc02409bc50 msgr2=0x7fc0240d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:45.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.004+0000 7fc0293f8640 1 -- 172.21.15.26:0/2438566775 shutdown_connections 2023-10-14T11:12:45.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.004+0000 7fc0293f8640 1 -- 172.21.15.26:0/2438566775 wait complete. 2023-10-14T11:12:45.028 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:12:45.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.168+0000 7f764c13e640 1 Processor -- start 2023-10-14T11:12:45.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.168+0000 7f764c13e640 1 -- start start 2023-10-14T11:12:45.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.172+0000 7f764c13e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f764415aa30 0x7f76440b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:45.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.172+0000 7f764c13e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f764415e4b0 0x7f76440b2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:45.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.172+0000 7f764c13e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76440cfb80 0x7f76440cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:45.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.172+0000 7f764c13e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76440d0530 con 0x7f764415e4b0 2023-10-14T11:12:45.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.172+0000 7f764c13e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f764415ae10 con 0x7f764415aa30 2023-10-14T11:12:45.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.172+0000 7f764c13e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76440cb9e0 con 0x7f76440cfb80 2023-10-14T11:12:45.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.172+0000 7f76496d9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f764415e4b0 0x7f76440b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:45.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.172+0000 7f76496d9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f764415e4b0 0x7f76440b2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35998/0 (socket says 172.21.15.26:35998) 2023-10-14T11:12:45.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.172+0000 7f76496d9640 1 -- 172.21.15.26:0/2916119649 learned_addr learned my addr 172.21.15.26:0/2916119649 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:45.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.172+0000 7f7649eda640 1 --2- 172.21.15.26:0/2916119649 >> v2:172.21.15.110:3300/0 conn(0x7f764415aa30 0x7f76440b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.172+0000 7f764a6db640 1 --2- 172.21.15.26:0/2916119649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76440cfb80 0x7f76440cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.172+0000 7f76496d9640 1 -- 172.21.15.26:0/2916119649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76440cfb80 msgr2=0x7f76440cfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.172+0000 7f76496d9640 1 --2- 172.21.15.26:0/2916119649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76440cfb80 0x7f76440cfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.172+0000 7f76496d9640 1 -- 172.21.15.26:0/2916119649 >> v2:172.21.15.110:3300/0 conn(0x7f764415aa30 msgr2=0x7f76440b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.172+0000 7f76496d9640 1 --2- 172.21.15.26:0/2916119649 >> v2:172.21.15.110:3300/0 conn(0x7f764415aa30 0x7f76440b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.172+0000 7f76496d9640 1 -- 172.21.15.26:0/2916119649 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76440b3ad0 con 0x7f764415e4b0 2023-10-14T11:12:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.172+0000 7f764a6db640 1 --2- 172.21.15.26:0/2916119649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76440cfb80 0x7f76440cfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:45.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.176+0000 7f76496d9640 1 --2- 172.21.15.26:0/2916119649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f764415e4b0 0x7f76440b2750 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7644072570 tx=0x7f763401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec324283feb9b9a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:45.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.176+0000 7f7648ed8640 1 -- 172.21.15.26:0/2916119649 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76340ab600 con 0x7f764415e4b0 2023-10-14T11:12:45.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.176+0000 7f7648ed8640 1 -- 172.21.15.26:0/2916119649 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76340ab760 con 0x7f764415e4b0 2023-10-14T11:12:45.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.176+0000 7f7648ed8640 1 -- 172.21.15.26:0/2916119649 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76340abaf0 con 0x7f764415e4b0 2023-10-14T11:12:45.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.176+0000 7f764c13e640 1 -- 172.21.15.26:0/2916119649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f764415e4b0 msgr2=0x7f76440b2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:45.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.176+0000 7f764c13e640 1 --2- 172.21.15.26:0/2916119649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f764415e4b0 0x7f76440b2750 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7644072570 tx=0x7f763401c440 comp rx=0 tx=0).stop 2023-10-14T11:12:45.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.176+0000 7f764c13e640 1 -- 172.21.15.26:0/2916119649 shutdown_connections 2023-10-14T11:12:45.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.176+0000 7f764c13e640 1 --2- 172.21.15.26:0/2916119649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76440cfb80 0x7f76440cfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.176+0000 7f764c13e640 1 --2- 172.21.15.26:0/2916119649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f764415e4b0 0x7f76440b2750 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.176+0000 7f764c13e640 1 --2- 172.21.15.26:0/2916119649 >> v2:172.21.15.110:3300/0 conn(0x7f764415aa30 0x7f76440b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.176+0000 7f764c13e640 1 -- 172.21.15.26:0/2916119649 >> 172.21.15.26:0/2916119649 conn(0x7f76440cd1c0 msgr2=0x7f76440cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:45.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.176+0000 7f764c13e640 1 -- 172.21.15.26:0/2916119649 shutdown_connections 2023-10-14T11:12:45.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.176+0000 7f764c13e640 1 -- 172.21.15.26:0/2916119649 wait complete. 2023-10-14T11:12:45.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.176+0000 7f764c13e640 1 Processor -- start 2023-10-14T11:12:45.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.176+0000 7f764c13e640 1 -- start start 2023-10-14T11:12:45.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.176+0000 7f764c13e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76440cfb80 0x7f7644152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:45.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.176+0000 7f764c13e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f764415aa30 0x7f764414c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:45.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.176+0000 7f764c13e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f764415e4b0 0x7f7644163640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:45.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.176+0000 7f764c13e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764414cc60 con 0x7f764415e4b0 2023-10-14T11:12:45.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.176+0000 7f764c13e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764406bd00 con 0x7f76440cfb80 2023-10-14T11:12:45.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.176+0000 7f764c13e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76441f5070 con 0x7f764415aa30 2023-10-14T11:12:45.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.180+0000 7f764a6db640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f764415e4b0 0x7f7644163640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:45.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.180+0000 7f7649eda640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76440cfb80 0x7f7644152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:45.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.180+0000 7f76496d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f764415aa30 0x7f764414c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:45.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.180+0000 7f764a6db640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f764415e4b0 0x7f7644163640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36012/0 (socket says 172.21.15.26:36012) 2023-10-14T11:12:45.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.180+0000 7f764a6db640 1 -- 172.21.15.26:0/3504057483 learned_addr learned my addr 172.21.15.26:0/3504057483 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:45.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.180+0000 7f764a6db640 1 -- 172.21.15.26:0/3504057483 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f764415aa30 msgr2=0x7f764414c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:45.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.180+0000 7f764a6db640 1 --2- 172.21.15.26:0/3504057483 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f764415aa30 0x7f764414c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.180+0000 7f764a6db640 1 -- 172.21.15.26:0/3504057483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76440cfb80 msgr2=0x7f7644152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:45.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.180+0000 7f764a6db640 1 --2- 172.21.15.26:0/3504057483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76440cfb80 0x7f7644152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.180+0000 7f764a6db640 1 -- 172.21.15.26:0/3504057483 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76340094d0 con 0x7f764415e4b0 2023-10-14T11:12:45.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.180+0000 7f764a6db640 1 --2- 172.21.15.26:0/3504057483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f764415e4b0 0x7f7644163640 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f763c007ef0 tx=0x7f763c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:45.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.180+0000 7f763a7fc640 1 -- 172.21.15.26:0/3504057483 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c003ba0 con 0x7f764415e4b0 2023-10-14T11:12:45.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.180+0000 7f763a7fc640 1 -- 172.21.15.26:0/3504057483 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c00f040 con 0x7f764415e4b0 2023-10-14T11:12:45.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.180+0000 7f763a7fc640 1 -- 172.21.15.26:0/3504057483 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c00de80 con 0x7f764415e4b0 2023-10-14T11:12:45.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.180+0000 7f764c13e640 1 -- 172.21.15.26:0/3504057483 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76441f5350 con 0x7f764415e4b0 2023-10-14T11:12:45.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.180+0000 7f764c13e640 1 -- 172.21.15.26:0/3504057483 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76441f5910 con 0x7f764415e4b0 2023-10-14T11:12:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.180+0000 7f764c13e640 1 -- 172.21.15.26:0/3504057483 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7644074010 con 0x7f764415e4b0 2023-10-14T11:12:45.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.180+0000 7f763a7fc640 1 -- 172.21.15.26:0/3504057483 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f763c004030 con 0x7f764415e4b0 2023-10-14T11:12:45.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.180+0000 7f763a7fc640 1 --2- 172.21.15.26:0/3504057483 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f76280664a0 0x7f7628068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:45.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.184+0000 7f763a7fc640 1 -- 172.21.15.26:0/3504057483 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f763c084580 con 0x7f764415e4b0 2023-10-14T11:12:45.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.184+0000 7f7649eda640 1 --2- 172.21.15.26:0/3504057483 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f76280664a0 0x7f7628068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:45.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.184+0000 7f7649eda640 1 --2- 172.21.15.26:0/3504057483 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f76280664a0 0x7f7628068960 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7644159f90 tx=0x7f7640009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:45.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.188+0000 7f763a7fc640 1 -- 172.21.15.26:0/3504057483 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f763c051690 con 0x7f764415e4b0 2023-10-14T11:12:45.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.344+0000 7f764c13e640 1 -- 172.21.15.26:0/3504057483 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76440cddb0 con 0x7f764415e4b0 2023-10-14T11:12:45.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.344+0000 7f763a7fc640 1 -- 172.21.15.26:0/3504057483 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f763c054cb0 con 0x7f764415e4b0 2023-10-14T11:12:45.349 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:45.349 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":25,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:12:27.398936+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:12:45.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.348+0000 7f764c13e640 1 -- 172.21.15.26:0/3504057483 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f76280664a0 msgr2=0x7f7628068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:45.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.348+0000 7f764c13e640 1 --2- 172.21.15.26:0/3504057483 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f76280664a0 0x7f7628068960 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7644159f90 tx=0x7f7640009190 comp rx=0 tx=0).stop 2023-10-14T11:12:45.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.348+0000 7f764c13e640 1 -- 172.21.15.26:0/3504057483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f764415e4b0 msgr2=0x7f7644163640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:45.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.348+0000 7f764c13e640 1 --2- 172.21.15.26:0/3504057483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f764415e4b0 0x7f7644163640 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f763c007ef0 tx=0x7f763c00d4a0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.348+0000 7f764c13e640 1 -- 172.21.15.26:0/3504057483 shutdown_connections 2023-10-14T11:12:45.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.348+0000 7f764c13e640 1 --2- 172.21.15.26:0/3504057483 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f76280664a0 0x7f7628068960 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.348+0000 7f764c13e640 1 --2- 172.21.15.26:0/3504057483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f764415e4b0 0x7f7644163640 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.348+0000 7f764c13e640 1 --2- 172.21.15.26:0/3504057483 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f764415aa30 0x7f764414c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.348+0000 7f764c13e640 1 --2- 172.21.15.26:0/3504057483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76440cfb80 0x7f7644152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.348+0000 7f764c13e640 1 -- 172.21.15.26:0/3504057483 >> 172.21.15.26:0/3504057483 conn(0x7f76440cd1c0 msgr2=0x7f76440b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:45.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.348+0000 7f764c13e640 1 -- 172.21.15.26:0/3504057483 shutdown_connections 2023-10-14T11:12:45.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.348+0000 7f764c13e640 1 -- 172.21.15.26:0/3504057483 wait complete. 2023-10-14T11:12:45.371 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T11:12:45.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.512+0000 7fa297e79640 1 Processor -- start 2023-10-14T11:12:45.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa297e79640 1 -- start start 2023-10-14T11:12:45.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa297e79640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa2900d0210 0x7fa2900d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:45.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa297e79640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2900d1670 con 0x7fa29015cba0 2023-10-14T11:12:45.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa297e79640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2900d1950 con 0x7fa2900b84e0 2023-10-14T11:12:45.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa297e79640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2900d1460 con 0x7fa2900d0210 2023-10-14T11:12:45.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa295c15640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa29015cba0 0x7fa2900cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57820/0 (socket says 172.21.15.26:57820) 2023-10-14T11:12:45.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa295c15640 1 -- 172.21.15.26:0/2573323074 learned_addr learned my addr 172.21.15.26:0/2573323074 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:45.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa295414640 1 --2- 172.21.15.26:0/2573323074 >> v2:172.21.15.110:3300/0 conn(0x7fa2900d0210 0x7fa2900d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:45.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa294c13640 1 -- 172.21.15.26:0/2573323074 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161165757 0 0) 0x7fa2900d1670 con 0x7fa29015cba0 2023-10-14T11:12:45.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa294c13640 1 -- 172.21.15.26:0/2573323074 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa27c003530 con 0x7fa29015cba0 2023-10-14T11:12:45.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa294c13640 1 -- 172.21.15.26:0/2573323074 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1874680770 0 0) 0x7fa27c003530 con 0x7fa29015cba0 2023-10-14T11:12:45.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa294c13640 1 -- 172.21.15.26:0/2573323074 >> v2:172.21.15.110:3300/0 conn(0x7fa2900d0210 msgr2=0x7fa2900d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:45.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa294c13640 1 --2- 172.21.15.26:0/2573323074 >> v2:172.21.15.110:3300/0 conn(0x7fa2900d0210 0x7fa2900d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa294c13640 1 -- 172.21.15.26:0/2573323074 >> v1:172.21.15.110:6789/0 conn(0x7fa2900b84e0 legacy=0x7fa2900b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:45.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa294c13640 1 -- 172.21.15.26:0/2573323074 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2900d1c30 con 0x7fa29015cba0 2023-10-14T11:12:45.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa294c13640 1 -- 172.21.15.26:0/2573323074 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7fa28c001680 con 0x7fa29015cba0 2023-10-14T11:12:45.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa295414640 1 --2- 172.21.15.26:0/2573323074 >> v2:172.21.15.110:3300/0 conn(0x7fa2900d0210 0x7fa2900d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:12:45.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa294c13640 1 -- 172.21.15.26:0/2573323074 >> v1:172.21.15.26:6789/0 conn(0x7fa29015cba0 legacy=0x7fa2900cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:45.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa294c13640 1 --2- 172.21.15.26:0/2573323074 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa27c003980 0x7fa27c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:45.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa294c13640 1 --2- 172.21.15.26:0/2573323074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa27c0047d0 0x7fa27c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:45.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa294c13640 1 --2- 172.21.15.26:0/2573323074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa27c005190 0x7fa27c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:45.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa294c13640 1 -- 172.21.15.26:0/2573323074 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2900d1460 con 0x7fa27c0047d0 2023-10-14T11:12:45.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa294c13640 1 -- 172.21.15.26:0/2573323074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c00c130 con 0x7fa27c005190 2023-10-14T11:12:45.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa294c13640 1 -- 172.21.15.26:0/2573323074 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c00c2f0 con 0x7fa27c003980 2023-10-14T11:12:45.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa295414640 1 --2- 172.21.15.26:0/2573323074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa27c0047d0 0x7fa27c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:45.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa295c15640 1 --2- 172.21.15.26:0/2573323074 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa27c003980 0x7fa27c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:45.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa296416640 1 --2- 172.21.15.26:0/2573323074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa27c005190 0x7fa27c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:45.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa295414640 1 -- 172.21.15.26:0/2573323074 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa27c003980 msgr2=0x7fa27c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:45.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa295414640 1 --2- 172.21.15.26:0/2573323074 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa27c003980 0x7fa27c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa295414640 1 -- 172.21.15.26:0/2573323074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa27c005190 msgr2=0x7fa27c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:45.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa295414640 1 --2- 172.21.15.26:0/2573323074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa27c005190 0x7fa27c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa295414640 1 -- 172.21.15.26:0/2573323074 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27c003530 con 0x7fa27c0047d0 2023-10-14T11:12:45.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.516+0000 7fa296416640 1 -- 172.21.15.26:0/2573323074 reap_dead start 2023-10-14T11:12:45.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.520+0000 7fa295414640 1 --2- 172.21.15.26:0/2573323074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa27c0047d0 0x7fa27c004c50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa280009c80 tx=0x7fa28001cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b41cbd1ec5aa7a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:45.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.520+0000 7fa294c13640 1 -- 172.21.15.26:0/2573323074 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280004020 con 0x7fa27c0047d0 2023-10-14T11:12:45.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.520+0000 7fa294c13640 1 -- 172.21.15.26:0/2573323074 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa280004180 con 0x7fa27c0047d0 2023-10-14T11:12:45.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.520+0000 7fa294c13640 1 -- 172.21.15.26:0/2573323074 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2800a5760 con 0x7fa27c0047d0 2023-10-14T11:12:45.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.520+0000 7fa297e79640 1 -- 172.21.15.26:0/2573323074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa27c0047d0 msgr2=0x7fa27c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:45.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.520+0000 7fa297e79640 1 --2- 172.21.15.26:0/2573323074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa27c0047d0 0x7fa27c004c50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa280009c80 tx=0x7fa28001cbb0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.520+0000 7fa297e79640 1 -- 172.21.15.26:0/2573323074 shutdown_connections 2023-10-14T11:12:45.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.520+0000 7fa297e79640 1 --2- 172.21.15.26:0/2573323074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa27c0047d0 0x7fa27c004c50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.520+0000 7fa297e79640 1 -- 172.21.15.26:0/2573323074 >> 172.21.15.26:0/2573323074 conn(0x7fa2900719c0 msgr2=0x7fa290071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:45.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.520+0000 7fa297e79640 1 -- 172.21.15.26:0/2573323074 shutdown_connections 2023-10-14T11:12:45.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.520+0000 7fa297e79640 1 -- 172.21.15.26:0/2573323074 wait complete. 2023-10-14T11:12:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa297e79640 1 Processor -- start 2023-10-14T11:12:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa297e79640 1 -- start start 2023-10-14T11:12:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa297e79640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa27c0047d0 0x7fa2900cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa297e79640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2900c9e50 0x7fa290144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa297e79640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2901f5440 0x7fa290155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa297e79640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2900cce90 con 0x7fa2901f5440 2023-10-14T11:12:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa297e79640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa290144f40 con 0x7fa2900c9e50 2023-10-14T11:12:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa297e79640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2900cb8b0 con 0x7fa27c0047d0 2023-10-14T11:12:45.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa296416640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2901f5440 0x7fa290155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:45.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa296416640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2901f5440 0x7fa290155a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36036/0 (socket says 172.21.15.26:36036) 2023-10-14T11:12:45.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa296416640 1 -- 172.21.15.26:0/4049359827 learned_addr learned my addr 172.21.15.26:0/4049359827 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:45.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa295414640 1 --2- 172.21.15.26:0/4049359827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2900c9e50 0x7fa290144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:45.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa295c15640 1 --2- 172.21.15.26:0/4049359827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa27c0047d0 0x7fa2900cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:45.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa296416640 1 -- 172.21.15.26:0/4049359827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa27c0047d0 msgr2=0x7fa2900cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:45.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa296416640 1 --2- 172.21.15.26:0/4049359827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa27c0047d0 0x7fa2900cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa296416640 1 -- 172.21.15.26:0/4049359827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2900c9e50 msgr2=0x7fa290144a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:45.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa296416640 1 --2- 172.21.15.26:0/4049359827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2900c9e50 0x7fa290144a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:45.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa296416640 1 -- 172.21.15.26:0/4049359827 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2900cbb90 con 0x7fa2901f5440 2023-10-14T11:12:45.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa295414640 1 --2- 172.21.15.26:0/4049359827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2900c9e50 0x7fa290144a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:45.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa295c15640 1 --2- 172.21.15.26:0/4049359827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa27c0047d0 0x7fa2900cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:45.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa296416640 1 --2- 172.21.15.26:0/4049359827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2901f5440 0x7fa290155a50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa2900d06b0 tx=0x7fa28800e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:45.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa2867fc640 1 -- 172.21.15.26:0/4049359827 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa288006e30 con 0x7fa2901f5440 2023-10-14T11:12:45.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa2867fc640 1 -- 172.21.15.26:0/4049359827 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa288003980 con 0x7fa2901f5440 2023-10-14T11:12:45.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa2867fc640 1 -- 172.21.15.26:0/4049359827 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa288003d30 con 0x7fa2901f5440 2023-10-14T11:12:45.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa297e79640 1 -- 172.21.15.26:0/4049359827 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2900cbe70 con 0x7fa2901f5440 2023-10-14T11:12:45.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa297e79640 1 -- 172.21.15.26:0/4049359827 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2900cc430 con 0x7fa2901f5440 2023-10-14T11:12:45.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.524+0000 7fa297e79640 1 -- 172.21.15.26:0/4049359827 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29004e170 con 0x7fa2901f5440 2023-10-14T11:12:45.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.528+0000 7fa2867fc640 1 -- 172.21.15.26:0/4049359827 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa288005070 con 0x7fa2901f5440 2023-10-14T11:12:45.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.528+0000 7fa2867fc640 1 --2- 172.21.15.26:0/4049359827 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa2740664a0 0x7fa274068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:45.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.528+0000 7fa2867fc640 1 -- 172.21.15.26:0/4049359827 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa2880839a0 con 0x7fa2901f5440 2023-10-14T11:12:45.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.528+0000 7fa295c15640 1 --2- 172.21.15.26:0/4049359827 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa2740664a0 0x7fa274068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:45.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.528+0000 7fa295c15640 1 --2- 172.21.15.26:0/4049359827 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa2740664a0 0x7fa274068960 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa28c007d50 tx=0x7fa28c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:45.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.532+0000 7fa2867fc640 1 -- 172.21.15.26:0/4049359827 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa288050a90 con 0x7fa2901f5440 2023-10-14T11:12:45.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:45.720+0000 7fa297e79640 1 -- 172.21.15.26:0/4049359827 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa29015c3b0 con 0x7fa2901f5440 2023-10-14T11:12:46.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.056+0000 7fa2867fc640 1 -- 172.21.15.26:0/4049359827 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa2880540b0 con 0x7fa2901f5440 2023-10-14T11:12:46.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.056+0000 7fa297e79640 1 -- 172.21.15.26:0/4049359827 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa2740664a0 msgr2=0x7fa274068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:46.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.056+0000 7fa297e79640 1 --2- 172.21.15.26:0/4049359827 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa2740664a0 0x7fa274068960 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa28c007d50 tx=0x7fa28c009040 comp rx=0 tx=0).stop 2023-10-14T11:12:46.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.056+0000 7fa297e79640 1 -- 172.21.15.26:0/4049359827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2901f5440 msgr2=0x7fa290155a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:46.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.056+0000 7fa297e79640 1 --2- 172.21.15.26:0/4049359827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2901f5440 0x7fa290155a50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa2900d06b0 tx=0x7fa28800e960 comp rx=0 tx=0).stop 2023-10-14T11:12:46.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.056+0000 7fa297e79640 1 -- 172.21.15.26:0/4049359827 shutdown_connections 2023-10-14T11:12:46.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.056+0000 7fa297e79640 1 --2- 172.21.15.26:0/4049359827 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa2740664a0 0x7fa274068960 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:46.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.056+0000 7fa297e79640 1 --2- 172.21.15.26:0/4049359827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2901f5440 0x7fa290155a50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:46.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.056+0000 7fa297e79640 1 --2- 172.21.15.26:0/4049359827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2900c9e50 0x7fa290144a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:46.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.056+0000 7fa297e79640 1 --2- 172.21.15.26:0/4049359827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa27c0047d0 0x7fa2900cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:46.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.060+0000 7fa297e79640 1 -- 172.21.15.26:0/4049359827 >> 172.21.15.26:0/4049359827 conn(0x7fa2900719c0 msgr2=0x7fa290072820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:46.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.060+0000 7fa297e79640 1 -- 172.21.15.26:0/4049359827 shutdown_connections 2023-10-14T11:12:46.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.060+0000 7fa297e79640 1 -- 172.21.15.26:0/4049359827 wait complete. 2023-10-14T11:12:46.081 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-10-14T11:12:46.081 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T11:12:46.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.224+0000 7f898532a640 1 Processor -- start 2023-10-14T11:12:46.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.224+0000 7f898532a640 1 -- start start 2023-10-14T11:12:46.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.224+0000 7f898532a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f89800c36c0 0x7f8980165570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:46.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.224+0000 7f898532a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f898015ae30 con 0x7f8980069e90 2023-10-14T11:12:46.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.224+0000 7f898532a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89800ca510 con 0x7f898006d010 2023-10-14T11:12:46.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.224+0000 7f898532a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89800cb090 con 0x7f89800c36c0 2023-10-14T11:12:46.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.228+0000 7f897f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f89800c36c0 0x7f8980165570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:46.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.228+0000 7f897f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f89800c36c0 0x7f8980165570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36052/0 (socket says 172.21.15.26:36052) 2023-10-14T11:12:46.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.228+0000 7f897f7fe640 1 -- 172.21.15.26:0/3380337197 learned_addr learned my addr 172.21.15.26:0/3380337197 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:46.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.228+0000 7f897f7fe640 1 -- 172.21.15.26:0/3380337197 >> v1:172.21.15.110:6789/0 conn(0x7f898006d010 legacy=0x7f89800c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:46.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.228+0000 7f897f7fe640 1 -- 172.21.15.26:0/3380337197 >> v1:172.21.15.26:6789/0 conn(0x7f8980069e90 legacy=0x7f898006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:46.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.228+0000 7f897f7fe640 1 -- 172.21.15.26:0/3380337197 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89800ca7f0 con 0x7f89800c36c0 2023-10-14T11:12:46.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.228+0000 7f897e7fc640 1 -- 172.21.15.26:0/3380337197 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502193143 0 0) 0x7f898015ae30 con 0x7f8980069e90 2023-10-14T11:12:46.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.228+0000 7f897f7fe640 1 --2- 172.21.15.26:0/3380337197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89800c36c0 0x7f8980165570 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8978009e50 tx=0x7f897801f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d49226703c05f1e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:46.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.228+0000 7f897e7fc640 1 -- 172.21.15.26:0/3380337197 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89780af400 con 0x7f89800c36c0 2023-10-14T11:12:46.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.228+0000 7f897e7fc640 1 -- 172.21.15.26:0/3380337197 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89780ab050 con 0x7f89800c36c0 2023-10-14T11:12:46.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.228+0000 7f897e7fc640 1 -- 172.21.15.26:0/3380337197 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89780af780 con 0x7f89800c36c0 2023-10-14T11:12:46.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f898532a640 1 -- 172.21.15.26:0/3380337197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89800c36c0 msgr2=0x7f8980165570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:46.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f898532a640 1 --2- 172.21.15.26:0/3380337197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89800c36c0 0x7f8980165570 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8978009e50 tx=0x7f897801f1f0 comp rx=0 tx=0).stop 2023-10-14T11:12:46.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f898532a640 1 -- 172.21.15.26:0/3380337197 shutdown_connections 2023-10-14T11:12:46.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f898532a640 1 --2- 172.21.15.26:0/3380337197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89800c36c0 0x7f8980165570 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:46.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f898532a640 1 -- 172.21.15.26:0/3380337197 >> 172.21.15.26:0/3380337197 conn(0x7f89800b0da0 msgr2=0x7f89800ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:46.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f898532a640 1 -- 172.21.15.26:0/3380337197 shutdown_connections 2023-10-14T11:12:46.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f898532a640 1 -- 172.21.15.26:0/3380337197 wait complete. 2023-10-14T11:12:46.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f898532a640 1 Processor -- start 2023-10-14T11:12:46.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f898532a640 1 -- start start 2023-10-14T11:12:46.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f898532a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8980069e90 0x7f8980159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:46.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f898532a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f898006d010 0x7f89800acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:46.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f898532a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89800c36c0 0x7f8980157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:46.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f898532a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89801584e0 con 0x7f8980069e90 2023-10-14T11:12:46.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f898532a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89801587c0 con 0x7f898006d010 2023-10-14T11:12:46.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f898532a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8980158aa0 con 0x7f89800c36c0 2023-10-14T11:12:46.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f897effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8980069e90 0x7f8980159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:46.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f897effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8980069e90 0x7f8980159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36054/0 (socket says 172.21.15.26:36054) 2023-10-14T11:12:46.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f897effd640 1 -- 172.21.15.26:0/1240823047 learned_addr learned my addr 172.21.15.26:0/1240823047 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:46.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f8977fff640 1 --2- 172.21.15.26:0/1240823047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f898006d010 0x7f89800acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:46.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f897f7fe640 1 --2- 172.21.15.26:0/1240823047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89800c36c0 0x7f8980157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:46.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f897effd640 1 -- 172.21.15.26:0/1240823047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89800c36c0 msgr2=0x7f8980157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:46.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f897effd640 1 --2- 172.21.15.26:0/1240823047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89800c36c0 0x7f8980157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:46.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f897effd640 1 -- 172.21.15.26:0/1240823047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f898006d010 msgr2=0x7f89800acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:46.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f897effd640 1 --2- 172.21.15.26:0/1240823047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f898006d010 0x7f89800acfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:46.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f897effd640 1 -- 172.21.15.26:0/1240823047 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8978009b30 con 0x7f8980069e90 2023-10-14T11:12:46.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f8977fff640 1 --2- 172.21.15.26:0/1240823047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f898006d010 0x7f89800acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:46.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f897f7fe640 1 --2- 172.21.15.26:0/1240823047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89800c36c0 0x7f8980157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:46.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.232+0000 7f897effd640 1 --2- 172.21.15.26:0/1240823047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8980069e90 0x7f8980159580 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f897000c4d0 tx=0x7f897000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:46.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.236+0000 7f89777fe640 1 -- 172.21.15.26:0/1240823047 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8970005480 con 0x7f8980069e90 2023-10-14T11:12:46.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.236+0000 7f89777fe640 1 -- 172.21.15.26:0/1240823047 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8970003600 con 0x7f8980069e90 2023-10-14T11:12:46.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.236+0000 7f89777fe640 1 -- 172.21.15.26:0/1240823047 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89700039b0 con 0x7f8980069e90 2023-10-14T11:12:46.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.236+0000 7f898532a640 1 -- 172.21.15.26:0/1240823047 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8980158d80 con 0x7f8980069e90 2023-10-14T11:12:46.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.236+0000 7f898532a640 1 -- 172.21.15.26:0/1240823047 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89801580b0 con 0x7f8980069e90 2023-10-14T11:12:46.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.236+0000 7f898532a640 1 -- 172.21.15.26:0/1240823047 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89800caab0 con 0x7f8980069e90 2023-10-14T11:12:46.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.236+0000 7f89777fe640 1 -- 172.21.15.26:0/1240823047 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8970003b10 con 0x7f8980069e90 2023-10-14T11:12:46.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.236+0000 7f89777fe640 1 --2- 172.21.15.26:0/1240823047 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f89600664a0 0x7f8960068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:46.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.236+0000 7f89777fe640 1 -- 172.21.15.26:0/1240823047 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8970083840 con 0x7f8980069e90 2023-10-14T11:12:46.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.236+0000 7f8977fff640 1 --2- 172.21.15.26:0/1240823047 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f89600664a0 0x7f8960068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:46.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.236+0000 7f8977fff640 1 --2- 172.21.15.26:0/1240823047 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f89600664a0 0x7f8960068960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8980140450 tx=0x7f8968009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:46.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.240+0000 7f89777fe640 1 -- 172.21.15.26:0/1240823047 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f89800caab0 con 0x7f8980069e90 2023-10-14T11:12:46.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:46.431+0000 7f898532a640 1 -- 172.21.15.26:0/1240823047 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f89800caab0 con 0x7f8980069e90 2023-10-14T11:12:47.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.059+0000 7f89777fe640 1 -- 172.21.15.26:0/1240823047 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f89800caab0 con 0x7f8980069e90 2023-10-14T11:12:47.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.063+0000 7f898532a640 1 -- 172.21.15.26:0/1240823047 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f89600664a0 msgr2=0x7f8960068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:47.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.063+0000 7f898532a640 1 --2- 172.21.15.26:0/1240823047 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f89600664a0 0x7f8960068960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8980140450 tx=0x7f8968009040 comp rx=0 tx=0).stop 2023-10-14T11:12:47.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.063+0000 7f898532a640 1 -- 172.21.15.26:0/1240823047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8980069e90 msgr2=0x7f8980159580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:47.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.063+0000 7f898532a640 1 --2- 172.21.15.26:0/1240823047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8980069e90 0x7f8980159580 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f897000c4d0 tx=0x7f897000c990 comp rx=0 tx=0).stop 2023-10-14T11:12:47.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.063+0000 7f898532a640 1 -- 172.21.15.26:0/1240823047 shutdown_connections 2023-10-14T11:12:47.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.063+0000 7f898532a640 1 --2- 172.21.15.26:0/1240823047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89800c36c0 0x7f8980157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.063+0000 7f898532a640 1 --2- 172.21.15.26:0/1240823047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f898006d010 0x7f89800acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.063+0000 7f898532a640 1 --2- 172.21.15.26:0/1240823047 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f89600664a0 0x7f8960068960 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.063+0000 7f898532a640 1 --2- 172.21.15.26:0/1240823047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8980069e90 0x7f8980159580 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.063+0000 7f898532a640 1 -- 172.21.15.26:0/1240823047 >> 172.21.15.26:0/1240823047 conn(0x7f89800b0da0 msgr2=0x7f89800cb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:47.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.063+0000 7f898532a640 1 -- 172.21.15.26:0/1240823047 shutdown_connections 2023-10-14T11:12:47.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.063+0000 7f898532a640 1 -- 172.21.15.26:0/1240823047 wait complete. 2023-10-14T11:12:47.091 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-14T11:12:47.091 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:12:47.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d57d65640 1 Processor -- start 2023-10-14T11:12:47.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d57d65640 1 -- start start 2023-10-14T11:12:47.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d57d65640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1d5015cb90 0x7f1d500cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:47.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d57d65640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d500ce770 con 0x7f1d500d3010 2023-10-14T11:12:47.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d57d65640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d500d0600 con 0x7f1d500d15d0 2023-10-14T11:12:47.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d57d65640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d500c6450 con 0x7f1d5015cb90 2023-10-14T11:12:47.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d55300640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1d500d3010 0x7f1d500d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57830/0 (socket says 172.21.15.26:57830) 2023-10-14T11:12:47.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d55300640 1 -- 172.21.15.26:0/170302586 learned_addr learned my addr 172.21.15.26:0/170302586 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:47.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d55b01640 1 --2- 172.21.15.26:0/170302586 >> v2:172.21.15.110:3300/0 conn(0x7f1d5015cb90 0x7f1d500cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:47.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d54aff640 1 -- 172.21.15.26:0/170302586 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409095265 0 0) 0x7f1d500ce770 con 0x7f1d500d3010 2023-10-14T11:12:47.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d54aff640 1 -- 172.21.15.26:0/170302586 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d3c003530 con 0x7f1d500d3010 2023-10-14T11:12:47.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d54aff640 1 -- 172.21.15.26:0/170302586 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138097105 0 0) 0x7f1d500d0600 con 0x7f1d500d15d0 2023-10-14T11:12:47.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d54aff640 1 -- 172.21.15.26:0/170302586 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d500ce770 con 0x7f1d500d15d0 2023-10-14T11:12:47.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d54aff640 1 -- 172.21.15.26:0/170302586 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2249806183 0 0) 0x7f1d3c003530 con 0x7f1d500d3010 2023-10-14T11:12:47.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d54aff640 1 -- 172.21.15.26:0/170302586 >> v2:172.21.15.110:3300/0 conn(0x7f1d5015cb90 msgr2=0x7f1d500cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:47.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d54aff640 1 --2- 172.21.15.26:0/170302586 >> v2:172.21.15.110:3300/0 conn(0x7f1d5015cb90 0x7f1d500cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d54aff640 1 -- 172.21.15.26:0/170302586 >> v1:172.21.15.110:6789/0 conn(0x7f1d500d15d0 legacy=0x7f1d500c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:47.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d54aff640 1 -- 172.21.15.26:0/170302586 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d500d08a0 con 0x7f1d500d3010 2023-10-14T11:12:47.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d54aff640 1 -- 172.21.15.26:0/170302586 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f1d40001620 con 0x7f1d500d3010 2023-10-14T11:12:47.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d54aff640 1 -- 172.21.15.26:0/170302586 >> v1:172.21.15.26:6789/0 conn(0x7f1d500d3010 legacy=0x7f1d500d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:47.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d54aff640 1 --2- 172.21.15.26:0/170302586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d3c003b60 0x7f1d3c003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:47.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d54aff640 1 --2- 172.21.15.26:0/170302586 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3c0047d0 0x7f1d3c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:47.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d54aff640 1 --2- 172.21.15.26:0/170302586 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3c0051e0 0x7f1d3c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:47.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d54aff640 1 -- 172.21.15.26:0/170302586 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d500c6450 con 0x7f1d3c0047d0 2023-10-14T11:12:47.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d54aff640 1 -- 172.21.15.26:0/170302586 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c00c110 con 0x7f1d3c003b60 2023-10-14T11:12:47.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.235+0000 7f1d54aff640 1 -- 172.21.15.26:0/170302586 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c00c2d0 con 0x7f1d3c0051e0 2023-10-14T11:12:47.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.239+0000 7f1d55300640 1 --2- 172.21.15.26:0/170302586 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3c0047d0 0x7f1d3c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:47.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.239+0000 7f1d55b01640 1 --2- 172.21.15.26:0/170302586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d3c003b60 0x7f1d3c003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:47.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.239+0000 7f1d56302640 1 --2- 172.21.15.26:0/170302586 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3c0051e0 0x7f1d3c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:47.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.239+0000 7f1d55300640 1 -- 172.21.15.26:0/170302586 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3c0051e0 msgr2=0x7f1d3c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:47.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.239+0000 7f1d55300640 1 --2- 172.21.15.26:0/170302586 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3c0051e0 0x7f1d3c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.239+0000 7f1d55300640 1 -- 172.21.15.26:0/170302586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d3c003b60 msgr2=0x7f1d3c003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:47.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.239+0000 7f1d55300640 1 --2- 172.21.15.26:0/170302586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d3c003b60 0x7f1d3c003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.239+0000 7f1d55300640 1 -- 172.21.15.26:0/170302586 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c003530 con 0x7f1d3c0047d0 2023-10-14T11:12:47.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.239+0000 7f1d56302640 1 -- 172.21.15.26:0/170302586 reap_dead start 2023-10-14T11:12:47.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.239+0000 7f1d55300640 1 --2- 172.21.15.26:0/170302586 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3c0047d0 0x7f1d3c004c50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1d40007f40 tx=0x7f1d4001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eabedfcf87cfbe6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:47.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.239+0000 7f1d54aff640 1 -- 172.21.15.26:0/170302586 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d40005ba0 con 0x7f1d3c0047d0 2023-10-14T11:12:47.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.239+0000 7f1d54aff640 1 -- 172.21.15.26:0/170302586 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d40005d00 con 0x7f1d3c0047d0 2023-10-14T11:12:47.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.239+0000 7f1d54aff640 1 -- 172.21.15.26:0/170302586 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d400a59f0 con 0x7f1d3c0047d0 2023-10-14T11:12:47.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d57d65640 1 -- 172.21.15.26:0/170302586 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3c0047d0 msgr2=0x7f1d3c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d57d65640 1 --2- 172.21.15.26:0/170302586 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3c0047d0 0x7f1d3c004c50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1d40007f40 tx=0x7f1d4001ca30 comp rx=0 tx=0).stop 2023-10-14T11:12:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d57d65640 1 -- 172.21.15.26:0/170302586 shutdown_connections 2023-10-14T11:12:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d57d65640 1 --2- 172.21.15.26:0/170302586 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3c0047d0 0x7f1d3c004c50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d57d65640 1 -- 172.21.15.26:0/170302586 >> 172.21.15.26:0/170302586 conn(0x7f1d5009bc50 msgr2=0x7f1d500d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d57d65640 1 -- 172.21.15.26:0/170302586 shutdown_connections 2023-10-14T11:12:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d57d65640 1 -- 172.21.15.26:0/170302586 wait complete. 2023-10-14T11:12:47.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d57d65640 1 Processor -- start 2023-10-14T11:12:47.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d57d65640 1 -- start start 2023-10-14T11:12:47.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d57d65640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3c0047d0 0x7f1d50154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:47.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d57d65640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d501564b0 0x7f1d500cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:47.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d57d65640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d500cc090 0x7f1d500b7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:47.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d57d65640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d501552f0 con 0x7f1d500cc090 2023-10-14T11:12:47.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d57d65640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d500b62b0 con 0x7f1d501564b0 2023-10-14T11:12:47.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d57d65640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d501f8d30 con 0x7f1d3c0047d0 2023-10-14T11:12:47.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d56302640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d500cc090 0x7f1d500b7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:47.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d56302640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d500cc090 0x7f1d500b7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36074/0 (socket says 172.21.15.26:36074) 2023-10-14T11:12:47.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d56302640 1 -- 172.21.15.26:0/3981363196 learned_addr learned my addr 172.21.15.26:0/3981363196 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:47.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d55300640 1 --2- 172.21.15.26:0/3981363196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d501564b0 0x7f1d500cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:47.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d55b01640 1 --2- 172.21.15.26:0/3981363196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3c0047d0 0x7f1d50154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:47.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d56302640 1 -- 172.21.15.26:0/3981363196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3c0047d0 msgr2=0x7f1d50154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:47.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d56302640 1 --2- 172.21.15.26:0/3981363196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3c0047d0 0x7f1d50154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d56302640 1 -- 172.21.15.26:0/3981363196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d501564b0 msgr2=0x7f1d500cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:47.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d56302640 1 --2- 172.21.15.26:0/3981363196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d501564b0 0x7f1d500cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.243+0000 7f1d56302640 1 -- 172.21.15.26:0/3981363196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d500b56a0 con 0x7f1d500cc090 2023-10-14T11:12:47.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.247+0000 7f1d56302640 1 --2- 172.21.15.26:0/3981363196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d500cc090 0x7f1d500b7cb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1d500c9420 tx=0x7f1d4800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:47.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.247+0000 7f1d467fc640 1 -- 172.21.15.26:0/3981363196 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48006b60 con 0x7f1d500cc090 2023-10-14T11:12:47.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.247+0000 7f1d467fc640 1 -- 172.21.15.26:0/3981363196 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d48006ce0 con 0x7f1d500cc090 2023-10-14T11:12:47.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.247+0000 7f1d57d65640 1 -- 172.21.15.26:0/3981363196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d500b5980 con 0x7f1d500cc090 2023-10-14T11:12:47.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.247+0000 7f1d467fc640 1 -- 172.21.15.26:0/3981363196 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48003bc0 con 0x7f1d500cc090 2023-10-14T11:12:47.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.247+0000 7f1d57d65640 1 -- 172.21.15.26:0/3981363196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d500b5f40 con 0x7f1d500cc090 2023-10-14T11:12:47.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.247+0000 7f1d57d65640 1 -- 172.21.15.26:0/3981363196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d500b6100 con 0x7f1d500cc090 2023-10-14T11:12:47.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.247+0000 7f1d467fc640 1 -- 172.21.15.26:0/3981363196 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1d48003d20 con 0x7f1d500cc090 2023-10-14T11:12:47.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.247+0000 7f1d467fc640 1 --2- 172.21.15.26:0/3981363196 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d340664a0 0x7f1d34068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:47.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.247+0000 7f1d467fc640 1 -- 172.21.15.26:0/3981363196 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1d48083940 con 0x7f1d500cc090 2023-10-14T11:12:47.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.247+0000 7f1d55b01640 1 --2- 172.21.15.26:0/3981363196 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d340664a0 0x7f1d34068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:47.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.251+0000 7f1d55b01640 1 --2- 172.21.15.26:0/3981363196 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d340664a0 0x7f1d34068960 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1d501e9f40 tx=0x7f1d4c006f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:47.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.255+0000 7f1d467fc640 1 -- 172.21.15.26:0/3981363196 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1d48050b80 con 0x7f1d500cc090 2023-10-14T11:12:47.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.443+0000 7f1d57d65640 1 -- 172.21.15.26:0/3981363196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d500d00b0 con 0x7f1d500cc090 2023-10-14T11:12:47.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.443+0000 7f1d467fc640 1 -- 172.21.15.26:0/3981363196 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f1d480541a0 con 0x7f1d500cc090 2023-10-14T11:12:47.451 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:47.451 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/2685368784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2685368784},{"type":"v1","addr":"172.21.15.110:6834","nonce":2685368784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6836/4242453713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":4242453713},{"type":"v1","addr":"172.21.15.26:6836","nonce":4242453713}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3507761146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":3507761146},{"type":"v1","addr":"172.21.15.26:6837","nonce":3507761146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:12:22.355867+0000","modified":"2023-10-14T11:12:46.435346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3522025152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3522025152},{"type":"v1","addr":"172.21.15.110:6835","nonce":3522025152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T11:12:47.452 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 9 2023-10-14T11:12:47.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.447+0000 7f1d57d65640 1 -- 172.21.15.26:0/3981363196 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d340664a0 msgr2=0x7f1d34068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:47.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.447+0000 7f1d57d65640 1 --2- 172.21.15.26:0/3981363196 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d340664a0 0x7f1d34068960 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1d501e9f40 tx=0x7f1d4c006f90 comp rx=0 tx=0).stop 2023-10-14T11:12:47.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.447+0000 7f1d57d65640 1 -- 172.21.15.26:0/3981363196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d500cc090 msgr2=0x7f1d500b7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:47.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.447+0000 7f1d57d65640 1 --2- 172.21.15.26:0/3981363196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d500cc090 0x7f1d500b7cb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1d500c9420 tx=0x7f1d4800eb20 comp rx=0 tx=0).stop 2023-10-14T11:12:47.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.447+0000 7f1d57d65640 1 -- 172.21.15.26:0/3981363196 shutdown_connections 2023-10-14T11:12:47.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.447+0000 7f1d57d65640 1 --2- 172.21.15.26:0/3981363196 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d340664a0 0x7f1d34068960 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.447+0000 7f1d57d65640 1 --2- 172.21.15.26:0/3981363196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d500cc090 0x7f1d500b7cb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.447+0000 7f1d57d65640 1 --2- 172.21.15.26:0/3981363196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d501564b0 0x7f1d500cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.447+0000 7f1d57d65640 1 --2- 172.21.15.26:0/3981363196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3c0047d0 0x7f1d50154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.447+0000 7f1d57d65640 1 -- 172.21.15.26:0/3981363196 >> 172.21.15.26:0/3981363196 conn(0x7f1d5009bc50 msgr2=0x7f1d500b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:47.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.447+0000 7f1d57d65640 1 -- 172.21.15.26:0/3981363196 shutdown_connections 2023-10-14T11:12:47.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.447+0000 7f1d57d65640 1 -- 172.21.15.26:0/3981363196 wait complete. 2023-10-14T11:12:47.470 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:12:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.611+0000 7f03c1b3e640 1 Processor -- start 2023-10-14T11:12:47.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.611+0000 7f03c1b3e640 1 -- start start 2023-10-14T11:12:47.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.611+0000 7f03c1b3e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f03bc0cf090 0x7f03bc0cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:47.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.611+0000 7f03c1b3e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03bc0c65f0 con 0x7f03bc15ca70 2023-10-14T11:12:47.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.611+0000 7f03c1b3e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03bc0cdf80 con 0x7f03bc0c6ad0 2023-10-14T11:12:47.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.611+0000 7f03c1b3e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03bc0cfa60 con 0x7f03bc0cf090 2023-10-14T11:12:47.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.611+0000 7f03baffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f03bc0cf090 0x7f03bc0cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:47.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.611+0000 7f03bb7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f03bc15ca70 0x7f03bc0d3010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57844/0 (socket says 172.21.15.26:57844) 2023-10-14T11:12:47.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.611+0000 7f03bb7fe640 1 -- 172.21.15.26:0/3418959280 learned_addr learned my addr 172.21.15.26:0/3418959280 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:47.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.611+0000 7f03baffd640 1 -- 172.21.15.26:0/3418959280 >> v1:172.21.15.110:6789/0 conn(0x7f03bc0c6ad0 legacy=0x7f03bc0c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:47.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.611+0000 7f03baffd640 1 -- 172.21.15.26:0/3418959280 >> v1:172.21.15.26:6789/0 conn(0x7f03bc15ca70 legacy=0x7f03bc0d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:47.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.611+0000 7f03ba7fc640 1 -- 172.21.15.26:0/3418959280 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2356575130 0 0) 0x7f03bc0c65f0 con 0x7f03bc15ca70 2023-10-14T11:12:47.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.611+0000 7f03baffd640 1 -- 172.21.15.26:0/3418959280 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03bc0ce260 con 0x7f03bc0cf090 2023-10-14T11:12:47.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.615+0000 7f03baffd640 1 --2- 172.21.15.26:0/3418959280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03bc0cf090 0x7f03bc0cf520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f03b00097c0 tx=0x7f03b001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d711f3b45af8e16 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:47.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.615+0000 7f03ba7fc640 1 -- 172.21.15.26:0/3418959280 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b00ab600 con 0x7f03bc0cf090 2023-10-14T11:12:47.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.615+0000 7f03ba7fc640 1 -- 172.21.15.26:0/3418959280 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b00a7050 con 0x7f03bc0cf090 2023-10-14T11:12:47.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.615+0000 7f03ba7fc640 1 -- 172.21.15.26:0/3418959280 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b00ab980 con 0x7f03bc0cf090 2023-10-14T11:12:47.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.615+0000 7f03c1b3e640 1 -- 172.21.15.26:0/3418959280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03bc0cf090 msgr2=0x7f03bc0cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:47.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.615+0000 7f03c1b3e640 1 --2- 172.21.15.26:0/3418959280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03bc0cf090 0x7f03bc0cf520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f03b00097c0 tx=0x7f03b001c480 comp rx=0 tx=0).stop 2023-10-14T11:12:47.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.615+0000 7f03c1b3e640 1 -- 172.21.15.26:0/3418959280 shutdown_connections 2023-10-14T11:12:47.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.615+0000 7f03c1b3e640 1 --2- 172.21.15.26:0/3418959280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03bc0cf090 0x7f03bc0cf520 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.615+0000 7f03c1b3e640 1 -- 172.21.15.26:0/3418959280 >> 172.21.15.26:0/3418959280 conn(0x7f03bc09bc50 msgr2=0x7f03bc0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:47.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.615+0000 7f03c1b3e640 1 -- 172.21.15.26:0/3418959280 shutdown_connections 2023-10-14T11:12:47.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.615+0000 7f03c1b3e640 1 -- 172.21.15.26:0/3418959280 wait complete. 2023-10-14T11:12:47.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03c1b3e640 1 Processor -- start 2023-10-14T11:12:47.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03c1b3e640 1 -- start start 2023-10-14T11:12:47.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03c1b3e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03bc0c6ad0 0x7f03bc153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:47.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03c1b3e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03bc0cf090 0x7f03bc15ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:47.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03c1b3e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03bc15ca70 0x7f03bc15b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:47.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03c1b3e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc0b5e20 con 0x7f03bc0c6ad0 2023-10-14T11:12:47.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03c1b3e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc15b920 con 0x7f03bc0cf090 2023-10-14T11:12:47.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03c1b3e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc15bc00 con 0x7f03bc15ca70 2023-10-14T11:12:47.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03bb7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03bc0c6ad0 0x7f03bc153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:47.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03bb7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03bc0c6ad0 0x7f03bc153150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36098/0 (socket says 172.21.15.26:36098) 2023-10-14T11:12:47.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03bb7fe640 1 -- 172.21.15.26:0/2199968755 learned_addr learned my addr 172.21.15.26:0/2199968755 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:47.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03bb7fe640 1 -- 172.21.15.26:0/2199968755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03bc15ca70 msgr2=0x7f03bc15b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:47.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03bb7fe640 1 --2- 172.21.15.26:0/2199968755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03bc15ca70 0x7f03bc15b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03bb7fe640 1 -- 172.21.15.26:0/2199968755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03bc0cf090 msgr2=0x7f03bc15ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:47.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03bb7fe640 1 --2- 172.21.15.26:0/2199968755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03bc0cf090 0x7f03bc15ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03bb7fe640 1 -- 172.21.15.26:0/2199968755 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b0009420 con 0x7f03bc0c6ad0 2023-10-14T11:12:47.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03bb7fe640 1 --2- 172.21.15.26:0/2199968755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03bc0c6ad0 0x7f03bc153150 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f03ac00c750 tx=0x7f03ac00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:47.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03a3fff640 1 -- 172.21.15.26:0/2199968755 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac007270 con 0x7f03bc0c6ad0 2023-10-14T11:12:47.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03a3fff640 1 -- 172.21.15.26:0/2199968755 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ac0073d0 con 0x7f03bc0c6ad0 2023-10-14T11:12:47.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03a3fff640 1 -- 172.21.15.26:0/2199968755 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac001d30 con 0x7f03bc0c6ad0 2023-10-14T11:12:47.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03c1b3e640 1 -- 172.21.15.26:0/2199968755 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03bc0d38a0 con 0x7f03bc0c6ad0 2023-10-14T11:12:47.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03c1b3e640 1 -- 172.21.15.26:0/2199968755 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03bc15c1c0 con 0x7f03bc0c6ad0 2023-10-14T11:12:47.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.619+0000 7f03c1b3e640 1 -- 172.21.15.26:0/2199968755 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03bc074010 con 0x7f03bc0c6ad0 2023-10-14T11:12:47.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.623+0000 7f03a3fff640 1 -- 172.21.15.26:0/2199968755 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f03ac0057b0 con 0x7f03bc0c6ad0 2023-10-14T11:12:47.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.623+0000 7f03a3fff640 1 --2- 172.21.15.26:0/2199968755 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f03a8066520 0x7f03a80689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:47.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.623+0000 7f03a3fff640 1 -- 172.21.15.26:0/2199968755 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f03ac083db0 con 0x7f03bc0c6ad0 2023-10-14T11:12:47.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.623+0000 7f03baffd640 1 --2- 172.21.15.26:0/2199968755 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f03a8066520 0x7f03a80689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:47.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.623+0000 7f03baffd640 1 --2- 172.21.15.26:0/2199968755 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f03a8066520 0x7f03a80689e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f03b00ad000 tx=0x7f03b0004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:47.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.627+0000 7f03a3fff640 1 -- 172.21.15.26:0/2199968755 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f03ac088070 con 0x7f03bc0c6ad0 2023-10-14T11:12:47.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.783+0000 7f03c1b3e640 1 -- 172.21.15.26:0/2199968755 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03bc0b5f60 con 0x7f03bc0c6ad0 2023-10-14T11:12:47.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.783+0000 7f03a3fff640 1 -- 172.21.15.26:0/2199968755 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f03bc0b5f60 con 0x7f03bc0c6ad0 2023-10-14T11:12:47.789 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:47.790 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":25,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:12:27.398936+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:12:47.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.787+0000 7f03c1b3e640 1 -- 172.21.15.26:0/2199968755 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f03a8066520 msgr2=0x7f03a80689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:47.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.787+0000 7f03c1b3e640 1 --2- 172.21.15.26:0/2199968755 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f03a8066520 0x7f03a80689e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f03b00ad000 tx=0x7f03b0004740 comp rx=0 tx=0).stop 2023-10-14T11:12:47.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.787+0000 7f03c1b3e640 1 -- 172.21.15.26:0/2199968755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03bc0c6ad0 msgr2=0x7f03bc153150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:47.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.787+0000 7f03c1b3e640 1 --2- 172.21.15.26:0/2199968755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03bc0c6ad0 0x7f03bc153150 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f03ac00c750 tx=0x7f03ac00cc10 comp rx=0 tx=0).stop 2023-10-14T11:12:47.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.787+0000 7f03c1b3e640 1 -- 172.21.15.26:0/2199968755 shutdown_connections 2023-10-14T11:12:47.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.787+0000 7f03c1b3e640 1 --2- 172.21.15.26:0/2199968755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03bc15ca70 0x7f03bc15b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.787+0000 7f03c1b3e640 1 --2- 172.21.15.26:0/2199968755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03bc0cf090 0x7f03bc15ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.787+0000 7f03c1b3e640 1 --2- 172.21.15.26:0/2199968755 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f03a8066520 0x7f03a80689e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.787+0000 7f03c1b3e640 1 --2- 172.21.15.26:0/2199968755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03bc0c6ad0 0x7f03bc153150 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.787+0000 7f03c1b3e640 1 -- 172.21.15.26:0/2199968755 >> 172.21.15.26:0/2199968755 conn(0x7f03bc09bc50 msgr2=0x7f03bc158580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:47.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.787+0000 7f03c1b3e640 1 -- 172.21.15.26:0/2199968755 shutdown_connections 2023-10-14T11:12:47.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.787+0000 7f03c1b3e640 1 -- 172.21.15.26:0/2199968755 wait complete. 2023-10-14T11:12:47.812 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T11:12:47.813 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:12:47.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.951+0000 7fa077009640 1 Processor -- start 2023-10-14T11:12:47.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.951+0000 7fa077009640 1 -- start start 2023-10-14T11:12:47.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.955+0000 7fa077009640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa0700cf520 0x7fa0700c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:47.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.955+0000 7fa077009640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0700c65f0 con 0x7fa07015ca70 2023-10-14T11:12:47.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.955+0000 7fa077009640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0700cdf80 con 0x7fa0700cf090 2023-10-14T11:12:47.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.955+0000 7fa077009640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0700ce820 con 0x7fa0700cf520 2023-10-14T11:12:47.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.955+0000 7fa074da5640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa07015ca70 0x7fa0700d3010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57848/0 (socket says 172.21.15.26:57848) 2023-10-14T11:12:47.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.955+0000 7fa074da5640 1 -- 172.21.15.26:0/4658612 learned_addr learned my addr 172.21.15.26:0/4658612 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:47.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.955+0000 7fa0755a6640 1 --2- 172.21.15.26:0/4658612 >> v2:172.21.15.110:3300/0 conn(0x7fa0700cf520 0x7fa0700c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:47.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.955+0000 7fa0677fe640 1 -- 172.21.15.26:0/4658612 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947806771 0 0) 0x7fa0700c65f0 con 0x7fa07015ca70 2023-10-14T11:12:47.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.955+0000 7fa0677fe640 1 -- 172.21.15.26:0/4658612 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa058003530 con 0x7fa07015ca70 2023-10-14T11:12:47.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.955+0000 7fa0677fe640 1 -- 172.21.15.26:0/4658612 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1780275960 0 0) 0x7fa058003530 con 0x7fa07015ca70 2023-10-14T11:12:47.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.955+0000 7fa0755a6640 1 -- 172.21.15.26:0/4658612 >> v1:172.21.15.110:6789/0 conn(0x7fa0700cf090 legacy=0x7fa0700c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:47.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.955+0000 7fa0755a6640 1 -- 172.21.15.26:0/4658612 >> v1:172.21.15.26:6789/0 conn(0x7fa07015ca70 legacy=0x7fa0700d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:47.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.955+0000 7fa0755a6640 1 -- 172.21.15.26:0/4658612 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0700ce260 con 0x7fa0700cf520 2023-10-14T11:12:47.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.959+0000 7fa0755a6640 1 --2- 172.21.15.26:0/4658612 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0700cf520 0x7fa0700c71e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa068009d90 tx=0x7fa06801c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa42dec76f573801 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:47.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.959+0000 7fa0677fe640 1 -- 172.21.15.26:0/4658612 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c001800 con 0x7fa0700cf520 2023-10-14T11:12:47.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.959+0000 7fa0677fe640 1 -- 172.21.15.26:0/4658612 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0680a5640 con 0x7fa0700cf520 2023-10-14T11:12:47.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.959+0000 7fa0677fe640 1 -- 172.21.15.26:0/4658612 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0680a59d0 con 0x7fa0700cf520 2023-10-14T11:12:47.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.959+0000 7fa077009640 1 -- 172.21.15.26:0/4658612 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0700cf520 msgr2=0x7fa0700c71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:47.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.959+0000 7fa077009640 1 --2- 172.21.15.26:0/4658612 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0700cf520 0x7fa0700c71e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa068009d90 tx=0x7fa06801c840 comp rx=0 tx=0).stop 2023-10-14T11:12:47.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.959+0000 7fa077009640 1 -- 172.21.15.26:0/4658612 shutdown_connections 2023-10-14T11:12:47.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.959+0000 7fa077009640 1 --2- 172.21.15.26:0/4658612 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0700cf520 0x7fa0700c71e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.959+0000 7fa077009640 1 -- 172.21.15.26:0/4658612 >> 172.21.15.26:0/4658612 conn(0x7fa07009bc50 msgr2=0x7fa0700d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:47.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.959+0000 7fa077009640 1 -- 172.21.15.26:0/4658612 shutdown_connections 2023-10-14T11:12:47.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.959+0000 7fa077009640 1 -- 172.21.15.26:0/4658612 wait complete. 2023-10-14T11:12:47.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.959+0000 7fa077009640 1 Processor -- start 2023-10-14T11:12:47.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.959+0000 7fa077009640 1 -- start start 2023-10-14T11:12:47.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa077009640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0700cf090 0x7fa0700cad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:47.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa077009640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0700cf520 0x7fa07015a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:47.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa077009640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa07015ca70 0x7fa070156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:47.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa077009640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07015b790 con 0x7fa0700cf090 2023-10-14T11:12:47.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa077009640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07015ab80 con 0x7fa07015ca70 2023-10-14T11:12:47.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa077009640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07015ae60 con 0x7fa0700cf520 2023-10-14T11:12:47.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa074da5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0700cf090 0x7fa0700cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:47.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa074da5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0700cf090 0x7fa0700cad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36106/0 (socket says 172.21.15.26:36106) 2023-10-14T11:12:47.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa074da5640 1 -- 172.21.15.26:0/2717933328 learned_addr learned my addr 172.21.15.26:0/2717933328 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:47.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa0755a6640 1 --2- 172.21.15.26:0/2717933328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa07015ca70 0x7fa070156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:47.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa074da5640 1 -- 172.21.15.26:0/2717933328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0700cf520 msgr2=0x7fa07015a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:47.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa067fff640 1 --2- 172.21.15.26:0/2717933328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0700cf520 0x7fa07015a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:47.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa074da5640 1 --2- 172.21.15.26:0/2717933328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0700cf520 0x7fa07015a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa074da5640 1 -- 172.21.15.26:0/2717933328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa07015ca70 msgr2=0x7fa070156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:47.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa074da5640 1 --2- 172.21.15.26:0/2717933328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa07015ca70 0x7fa070156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:47.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa074da5640 1 -- 172.21.15.26:0/2717933328 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa068009a70 con 0x7fa0700cf090 2023-10-14T11:12:47.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa0755a6640 1 --2- 172.21.15.26:0/2717933328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa07015ca70 0x7fa070156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:47.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa067fff640 1 --2- 172.21.15.26:0/2717933328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0700cf520 0x7fa07015a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:47.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa074da5640 1 --2- 172.21.15.26:0/2717933328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0700cf090 0x7fa0700cad10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00c780 tx=0x7fa06c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:47.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa0657fa640 1 -- 172.21.15.26:0/2717933328 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c007270 con 0x7fa0700cf090 2023-10-14T11:12:47.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa0657fa640 1 -- 172.21.15.26:0/2717933328 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06c007410 con 0x7fa0700cf090 2023-10-14T11:12:47.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa077009640 1 -- 172.21.15.26:0/2717933328 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0700d38a0 con 0x7fa0700cf090 2023-10-14T11:12:47.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa0657fa640 1 -- 172.21.15.26:0/2717933328 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c0057b0 con 0x7fa0700cf090 2023-10-14T11:12:47.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa077009640 1 -- 172.21.15.26:0/2717933328 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07015b420 con 0x7fa0700cf090 2023-10-14T11:12:47.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa077009640 1 -- 172.21.15.26:0/2717933328 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa070074010 con 0x7fa0700cf090 2023-10-14T11:12:47.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.963+0000 7fa0657fa640 1 -- 172.21.15.26:0/2717933328 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa06c005910 con 0x7fa0700cf090 2023-10-14T11:12:47.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.967+0000 7fa0657fa640 1 --2- 172.21.15.26:0/2717933328 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa05c0664a0 0x7fa05c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:47.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.967+0000 7fa0657fa640 1 -- 172.21.15.26:0/2717933328 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa06c083820 con 0x7fa0700cf090 2023-10-14T11:12:47.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.967+0000 7fa067fff640 1 --2- 172.21.15.26:0/2717933328 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa05c0664a0 0x7fa05c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:47.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.967+0000 7fa067fff640 1 --2- 172.21.15.26:0/2717933328 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa05c0664a0 0x7fa05c068960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa0700c8f80 tx=0x7fa060009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:47.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:47.971+0000 7fa0657fa640 1 -- 172.21.15.26:0/2717933328 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa06c054500 con 0x7fa0700cf090 2023-10-14T11:12:48.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.127+0000 7fa077009640 1 -- 172.21.15.26:0/2717933328 --> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa07015afd0 con 0x7fa05c0664a0 2023-10-14T11:12:48.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.139+0000 7fa0657fa640 1 -- 172.21.15.26:0/2717933328 <== mgr.4101 v2:172.21.15.26:6832/4136446821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345277 (secure 0 0 0) 0x7fa07015afd0 con 0x7fa05c0664a0 2023-10-14T11:12:48.147 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:48.150 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-14T11:12:48.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.143+0000 7fa077009640 1 -- 172.21.15.26:0/2717933328 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa05c0664a0 msgr2=0x7fa05c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:48.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.143+0000 7fa077009640 1 --2- 172.21.15.26:0/2717933328 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa05c0664a0 0x7fa05c068960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa0700c8f80 tx=0x7fa060009040 comp rx=0 tx=0).stop 2023-10-14T11:12:48.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.143+0000 7fa077009640 1 -- 172.21.15.26:0/2717933328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0700cf090 msgr2=0x7fa0700cad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:48.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.143+0000 7fa077009640 1 --2- 172.21.15.26:0/2717933328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0700cf090 0x7fa0700cad10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00c780 tx=0x7fa06c00cc40 comp rx=0 tx=0).stop 2023-10-14T11:12:48.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.143+0000 7fa077009640 1 -- 172.21.15.26:0/2717933328 shutdown_connections 2023-10-14T11:12:48.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.143+0000 7fa077009640 1 --2- 172.21.15.26:0/2717933328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa07015ca70 0x7fa070156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:48.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.143+0000 7fa077009640 1 --2- 172.21.15.26:0/2717933328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0700cf520 0x7fa07015a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:48.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.143+0000 7fa077009640 1 --2- 172.21.15.26:0/2717933328 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa05c0664a0 0x7fa05c068960 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:48.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.143+0000 7fa077009640 1 --2- 172.21.15.26:0/2717933328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0700cf090 0x7fa0700cad10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:48.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.143+0000 7fa077009640 1 -- 172.21.15.26:0/2717933328 >> 172.21.15.26:0/2717933328 conn(0x7fa07009bc50 msgr2=0x7fa0700ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:48.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.143+0000 7fa077009640 1 -- 172.21.15.26:0/2717933328 shutdown_connections 2023-10-14T11:12:48.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.143+0000 7fa077009640 1 -- 172.21.15.26:0/2717933328 wait complete. 2023-10-14T11:12:48.167 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-10-14T11:12:46.164866+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227784,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754746936,"statfs":{"total":773094113280,"available":772860862464,"internally_reserved":0,"allocated":3383296,"data_stored":2025622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":229756472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003176"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.011921+0000","last_change":"2023-10-14T11:12:21.968131+0000","last_active":"2023-10-14T11:12:27.011921+0000","last_peered":"2023-10-14T11:12:27.011921+0000","last_clean":"2023-10-14T11:12:27.011921+0000","last_became_active":"2023-10-14T11:12:21.967795+0000","last_became_peered":"2023-10-14T11:12:21.967795+0000","last_unstale":"2023-10-14T11:12:27.011921+0000","last_undegraded":"2023-10-14T11:12:27.011921+0000","last_fullsized":"2023-10-14T11:12:27.011921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:40.617646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000703+0000","last_change":"2023-10-14T11:12:22.996026+0000","last_active":"2023-10-14T11:12:27.000703+0000","last_peered":"2023-10-14T11:12:27.000703+0000","last_clean":"2023-10-14T11:12:27.000703+0000","last_became_active":"2023-10-14T11:12:22.995661+0000","last_became_peered":"2023-10-14T11:12:22.995661+0000","last_unstale":"2023-10-14T11:12:27.000703+0000","last_undegraded":"2023-10-14T11:12:27.000703+0000","last_fullsized":"2023-10-14T11:12:27.000703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:38.252309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992306+0000","last_change":"2023-10-14T11:12:27.273682+0000","last_active":"2023-10-14T11:12:27.992306+0000","last_peered":"2023-10-14T11:12:27.992306+0000","last_clean":"2023-10-14T11:12:27.992306+0000","last_became_active":"2023-10-14T11:12:27.273214+0000","last_became_peered":"2023-10-14T11:12:27.273214+0000","last_unstale":"2023-10-14T11:12:27.992306+0000","last_undegraded":"2023-10-14T11:12:27.992306+0000","last_fullsized":"2023-10-14T11:12:27.992306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:47.514617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000801+0000","last_change":"2023-10-14T11:12:21.965767+0000","last_active":"2023-10-14T11:12:27.000801+0000","last_peered":"2023-10-14T11:12:27.000801+0000","last_clean":"2023-10-14T11:12:27.000801+0000","last_became_active":"2023-10-14T11:12:21.963959+0000","last_became_peered":"2023-10-14T11:12:21.963959+0000","last_unstale":"2023-10-14T11:12:27.000801+0000","last_undegraded":"2023-10-14T11:12:27.000801+0000","last_fullsized":"2023-10-14T11:12:27.000801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:40.617646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.011705+0000","last_change":"2023-10-14T11:12:22.985764+0000","last_active":"2023-10-14T11:12:27.011705+0000","last_peered":"2023-10-14T11:12:27.011705+0000","last_clean":"2023-10-14T11:12:27.011705+0000","last_became_active":"2023-10-14T11:12:22.984086+0000","last_became_peered":"2023-10-14T11:12:22.984086+0000","last_unstale":"2023-10-14T11:12:27.011705+0000","last_undegraded":"2023-10-14T11:12:27.011705+0000","last_fullsized":"2023-10-14T11:12:27.011705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:27.066313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.994145+0000","last_change":"2023-10-14T11:12:27.029908+0000","last_active":"2023-10-14T11:12:27.994145+0000","last_peered":"2023-10-14T11:12:27.994145+0000","last_clean":"2023-10-14T11:12:27.994145+0000","last_became_active":"2023-10-14T11:12:27.029420+0000","last_became_peered":"2023-10-14T11:12:27.029420+0000","last_unstale":"2023-10-14T11:12:27.994145+0000","last_undegraded":"2023-10-14T11:12:27.994145+0000","last_fullsized":"2023-10-14T11:12:27.994145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:07.549080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265378+0000","last_change":"2023-10-14T11:12:21.979625+0000","last_active":"2023-10-14T11:12:27.265378+0000","last_peered":"2023-10-14T11:12:27.265378+0000","last_clean":"2023-10-14T11:12:27.265378+0000","last_became_active":"2023-10-14T11:12:21.979220+0000","last_became_peered":"2023-10-14T11:12:21.979220+0000","last_unstale":"2023-10-14T11:12:27.265378+0000","last_undegraded":"2023-10-14T11:12:27.265378+0000","last_fullsized":"2023-10-14T11:12:27.265378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:18.236450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.989996+0000","last_change":"2023-10-14T11:12:22.980954+0000","last_active":"2023-10-14T11:12:26.989996+0000","last_peered":"2023-10-14T11:12:26.989996+0000","last_clean":"2023-10-14T11:12:26.989996+0000","last_became_active":"2023-10-14T11:12:22.980685+0000","last_became_peered":"2023-10-14T11:12:22.980685+0000","last_unstale":"2023-10-14T11:12:26.989996+0000","last_undegraded":"2023-10-14T11:12:26.989996+0000","last_fullsized":"2023-10-14T11:12:26.989996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:24.943192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992649+0000","last_change":"2023-10-14T11:12:27.018281+0000","last_active":"2023-10-14T11:12:27.992649+0000","last_peered":"2023-10-14T11:12:27.992649+0000","last_clean":"2023-10-14T11:12:27.992649+0000","last_became_active":"2023-10-14T11:12:27.017878+0000","last_became_peered":"2023-10-14T11:12:27.017878+0000","last_unstale":"2023-10-14T11:12:27.992649+0000","last_undegraded":"2023-10-14T11:12:27.992649+0000","last_fullsized":"2023-10-14T11:12:27.992649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:18:15.471120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265116+0000","last_change":"2023-10-14T11:12:21.976549+0000","last_active":"2023-10-14T11:12:27.265116+0000","last_peered":"2023-10-14T11:12:27.265116+0000","last_clean":"2023-10-14T11:12:27.265116+0000","last_became_active":"2023-10-14T11:12:21.976164+0000","last_became_peered":"2023-10-14T11:12:21.976164+0000","last_unstale":"2023-10-14T11:12:27.265116+0000","last_undegraded":"2023-10-14T11:12:27.265116+0000","last_fullsized":"2023-10-14T11:12:27.265116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:05.484874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990424+0000","last_change":"2023-10-14T11:12:22.970775+0000","last_active":"2023-10-14T11:12:26.990424+0000","last_peered":"2023-10-14T11:12:26.990424+0000","last_clean":"2023-10-14T11:12:26.990424+0000","last_became_active":"2023-10-14T11:12:22.970331+0000","last_became_peered":"2023-10-14T11:12:22.970331+0000","last_unstale":"2023-10-14T11:12:26.990424+0000","last_undegraded":"2023-10-14T11:12:26.990424+0000","last_fullsized":"2023-10-14T11:12:26.990424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:15.184385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992665+0000","last_change":"2023-10-14T11:12:27.011037+0000","last_active":"2023-10-14T11:12:27.992665+0000","last_peered":"2023-10-14T11:12:27.992665+0000","last_clean":"2023-10-14T11:12:27.992665+0000","last_became_active":"2023-10-14T11:12:27.010126+0000","last_became_peered":"2023-10-14T11:12:27.010126+0000","last_unstale":"2023-10-14T11:12:27.992665+0000","last_undegraded":"2023-10-14T11:12:27.992665+0000","last_fullsized":"2023-10-14T11:12:27.992665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:42.289011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.992180+0000","last_change":"2023-10-14T11:12:22.983577+0000","last_active":"2023-10-14T11:12:26.992180+0000","last_peered":"2023-10-14T11:12:26.992180+0000","last_clean":"2023-10-14T11:12:26.992180+0000","last_became_active":"2023-10-14T11:12:22.982026+0000","last_became_peered":"2023-10-14T11:12:22.982026+0000","last_unstale":"2023-10-14T11:12:26.992180+0000","last_undegraded":"2023-10-14T11:12:26.992180+0000","last_fullsized":"2023-10-14T11:12:26.992180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:06.491915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265315+0000","last_change":"2023-10-14T11:12:21.979924+0000","last_active":"2023-10-14T11:12:27.265315+0000","last_peered":"2023-10-14T11:12:27.265315+0000","last_clean":"2023-10-14T11:12:27.265315+0000","last_became_active":"2023-10-14T11:12:21.979434+0000","last_became_peered":"2023-10-14T11:12:21.979434+0000","last_unstale":"2023-10-14T11:12:27.265315+0000","last_undegraded":"2023-10-14T11:12:27.265315+0000","last_fullsized":"2023-10-14T11:12:27.265315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:31:07.362240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993464+0000","last_change":"2023-10-14T11:12:27.025486+0000","last_active":"2023-10-14T11:12:27.993464+0000","last_peered":"2023-10-14T11:12:27.993464+0000","last_clean":"2023-10-14T11:12:27.993464+0000","last_became_active":"2023-10-14T11:12:27.025086+0000","last_became_peered":"2023-10-14T11:12:27.025086+0000","last_unstale":"2023-10-14T11:12:27.993464+0000","last_undegraded":"2023-10-14T11:12:27.993464+0000","last_fullsized":"2023-10-14T11:12:27.993464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:19.221087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.994599+0000","last_change":"2023-10-14T11:12:22.975476+0000","last_active":"2023-10-14T11:12:26.994599+0000","last_peered":"2023-10-14T11:12:26.994599+0000","last_clean":"2023-10-14T11:12:26.994599+0000","last_became_active":"2023-10-14T11:12:22.975171+0000","last_became_peered":"2023-10-14T11:12:22.975171+0000","last_unstale":"2023-10-14T11:12:26.994599+0000","last_undegraded":"2023-10-14T11:12:26.994599+0000","last_fullsized":"2023-10-14T11:12:26.994599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:18:11.434418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.003734+0000","last_change":"2023-10-14T11:12:21.967707+0000","last_active":"2023-10-14T11:12:27.003734+0000","last_peered":"2023-10-14T11:12:27.003734+0000","last_clean":"2023-10-14T11:12:27.003734+0000","last_became_active":"2023-10-14T11:12:21.967412+0000","last_became_peered":"2023-10-14T11:12:21.967412+0000","last_unstale":"2023-10-14T11:12:27.003734+0000","last_undegraded":"2023-10-14T11:12:27.003734+0000","last_fullsized":"2023-10-14T11:12:27.003734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:11:08.840029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992628+0000","last_change":"2023-10-14T11:12:27.026337+0000","last_active":"2023-10-14T11:12:27.992628+0000","last_peered":"2023-10-14T11:12:27.992628+0000","last_clean":"2023-10-14T11:12:27.992628+0000","last_became_active":"2023-10-14T11:12:27.025956+0000","last_became_peered":"2023-10-14T11:12:27.025956+0000","last_unstale":"2023-10-14T11:12:27.992628+0000","last_undegraded":"2023-10-14T11:12:27.992628+0000","last_fullsized":"2023-10-14T11:12:27.992628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:52:42.055532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.996024+0000","last_change":"2023-10-14T11:12:22.968547+0000","last_active":"2023-10-14T11:12:26.996024+0000","last_peered":"2023-10-14T11:12:26.996024+0000","last_clean":"2023-10-14T11:12:26.996024+0000","last_became_active":"2023-10-14T11:12:22.968263+0000","last_became_peered":"2023-10-14T11:12:22.968263+0000","last_unstale":"2023-10-14T11:12:26.996024+0000","last_undegraded":"2023-10-14T11:12:26.996024+0000","last_fullsized":"2023-10-14T11:12:26.996024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:24:53.742274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000375+0000","last_change":"2023-10-14T11:12:21.975718+0000","last_active":"2023-10-14T11:12:27.000375+0000","last_peered":"2023-10-14T11:12:27.000375+0000","last_clean":"2023-10-14T11:12:27.000375+0000","last_became_active":"2023-10-14T11:12:21.975455+0000","last_became_peered":"2023-10-14T11:12:21.975455+0000","last_unstale":"2023-10-14T11:12:27.000375+0000","last_undegraded":"2023-10-14T11:12:27.000375+0000","last_fullsized":"2023-10-14T11:12:27.000375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:40:43.612359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.053490+0000","last_change":"2023-10-14T11:12:27.271875+0000","last_active":"2023-10-14T11:12:29.053490+0000","last_peered":"2023-10-14T11:12:29.053490+0000","last_clean":"2023-10-14T11:12:29.053490+0000","last_became_active":"2023-10-14T11:12:27.271472+0000","last_became_peered":"2023-10-14T11:12:27.271472+0000","last_unstale":"2023-10-14T11:12:29.053490+0000","last_undegraded":"2023-10-14T11:12:29.053490+0000","last_fullsized":"2023-10-14T11:12:29.053490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:28.979894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.997514+0000","last_change":"2023-10-14T11:12:22.980084+0000","last_active":"2023-10-14T11:12:26.997514+0000","last_peered":"2023-10-14T11:12:26.997514+0000","last_clean":"2023-10-14T11:12:26.997514+0000","last_became_active":"2023-10-14T11:12:22.979078+0000","last_became_peered":"2023-10-14T11:12:22.979078+0000","last_unstale":"2023-10-14T11:12:26.997514+0000","last_undegraded":"2023-10-14T11:12:26.997514+0000","last_fullsized":"2023-10-14T11:12:26.997514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:43:00.534216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264588+0000","last_change":"2023-10-14T11:12:21.975091+0000","last_active":"2023-10-14T11:12:27.264588+0000","last_peered":"2023-10-14T11:12:27.264588+0000","last_clean":"2023-10-14T11:12:27.264588+0000","last_became_active":"2023-10-14T11:12:21.974797+0000","last_became_peered":"2023-10-14T11:12:21.974797+0000","last_unstale":"2023-10-14T11:12:27.264588+0000","last_undegraded":"2023-10-14T11:12:27.264588+0000","last_fullsized":"2023-10-14T11:12:27.264588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:37.017137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993949+0000","last_change":"2023-10-14T11:12:27.025785+0000","last_active":"2023-10-14T11:12:27.993949+0000","last_peered":"2023-10-14T11:12:27.993949+0000","last_clean":"2023-10-14T11:12:27.993949+0000","last_became_active":"2023-10-14T11:12:27.025299+0000","last_became_peered":"2023-10-14T11:12:27.025299+0000","last_unstale":"2023-10-14T11:12:27.993949+0000","last_undegraded":"2023-10-14T11:12:27.993949+0000","last_fullsized":"2023-10-14T11:12:27.993949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:58.469102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.011387+0000","last_change":"2023-10-14T11:12:22.982412+0000","last_active":"2023-10-14T11:12:27.011387+0000","last_peered":"2023-10-14T11:12:27.011387+0000","last_clean":"2023-10-14T11:12:27.011387+0000","last_became_active":"2023-10-14T11:12:22.981232+0000","last_became_peered":"2023-10-14T11:12:22.981232+0000","last_unstale":"2023-10-14T11:12:27.011387+0000","last_undegraded":"2023-10-14T11:12:27.011387+0000","last_fullsized":"2023-10-14T11:12:27.011387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:19.243490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.992495+0000","last_change":"2023-10-14T11:12:21.979890+0000","last_active":"2023-10-14T11:12:26.992495+0000","last_peered":"2023-10-14T11:12:26.992495+0000","last_clean":"2023-10-14T11:12:26.992495+0000","last_became_active":"2023-10-14T11:12:21.979626+0000","last_became_peered":"2023-10-14T11:12:21.979626+0000","last_unstale":"2023-10-14T11:12:26.992495+0000","last_undegraded":"2023-10-14T11:12:26.992495+0000","last_fullsized":"2023-10-14T11:12:26.992495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:33.347794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993164+0000","last_change":"2023-10-14T11:12:27.274768+0000","last_active":"2023-10-14T11:12:27.993164+0000","last_peered":"2023-10-14T11:12:27.993164+0000","last_clean":"2023-10-14T11:12:27.993164+0000","last_became_active":"2023-10-14T11:12:27.274146+0000","last_became_peered":"2023-10-14T11:12:27.274146+0000","last_unstale":"2023-10-14T11:12:27.993164+0000","last_undegraded":"2023-10-14T11:12:27.993164+0000","last_fullsized":"2023-10-14T11:12:27.993164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:23.589522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000910+0000","last_change":"2023-10-14T11:12:22.985137+0000","last_active":"2023-10-14T11:12:27.000910+0000","last_peered":"2023-10-14T11:12:27.000910+0000","last_clean":"2023-10-14T11:12:27.000910+0000","last_became_active":"2023-10-14T11:12:22.984832+0000","last_became_peered":"2023-10-14T11:12:22.984832+0000","last_unstale":"2023-10-14T11:12:27.000910+0000","last_undegraded":"2023-10-14T11:12:27.000910+0000","last_fullsized":"2023-10-14T11:12:27.000910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:46.533477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.013073+0000","last_change":"2023-10-14T11:12:21.973653+0000","last_active":"2023-10-14T11:12:27.013073+0000","last_peered":"2023-10-14T11:12:27.013073+0000","last_clean":"2023-10-14T11:12:27.013073+0000","last_became_active":"2023-10-14T11:12:21.973384+0000","last_became_peered":"2023-10-14T11:12:21.973384+0000","last_unstale":"2023-10-14T11:12:27.013073+0000","last_undegraded":"2023-10-14T11:12:27.013073+0000","last_fullsized":"2023-10-14T11:12:27.013073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:31:07.362240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992214+0000","last_change":"2023-10-14T11:12:27.274360+0000","last_active":"2023-10-14T11:12:27.992214+0000","last_peered":"2023-10-14T11:12:27.992214+0000","last_clean":"2023-10-14T11:12:27.992214+0000","last_became_active":"2023-10-14T11:12:27.273104+0000","last_became_peered":"2023-10-14T11:12:27.273104+0000","last_unstale":"2023-10-14T11:12:27.992214+0000","last_undegraded":"2023-10-14T11:12:27.992214+0000","last_fullsized":"2023-10-14T11:12:27.992214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:23:51.698322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.013376+0000","last_change":"2023-10-14T11:12:22.973372+0000","last_active":"2023-10-14T11:12:27.013376+0000","last_peered":"2023-10-14T11:12:27.013376+0000","last_clean":"2023-10-14T11:12:27.013376+0000","last_became_active":"2023-10-14T11:12:22.973009+0000","last_became_peered":"2023-10-14T11:12:22.973009+0000","last_unstale":"2023-10-14T11:12:27.013376+0000","last_undegraded":"2023-10-14T11:12:27.013376+0000","last_fullsized":"2023-10-14T11:12:27.013376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:19.243490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265475+0000","last_change":"2023-10-14T11:12:21.975624+0000","last_active":"2023-10-14T11:12:27.265475+0000","last_peered":"2023-10-14T11:12:27.265475+0000","last_clean":"2023-10-14T11:12:27.265475+0000","last_became_active":"2023-10-14T11:12:21.975359+0000","last_became_peered":"2023-10-14T11:12:21.975359+0000","last_unstale":"2023-10-14T11:12:27.265475+0000","last_undegraded":"2023-10-14T11:12:27.265475+0000","last_fullsized":"2023-10-14T11:12:27.265475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:24:52.735234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.387618+0000","last_change":"2023-10-14T11:12:27.272156+0000","last_active":"2023-10-14T11:12:28.387618+0000","last_peered":"2023-10-14T11:12:28.387618+0000","last_clean":"2023-10-14T11:12:28.387618+0000","last_became_active":"2023-10-14T11:12:27.271460+0000","last_became_peered":"2023-10-14T11:12:27.271460+0000","last_unstale":"2023-10-14T11:12:28.387618+0000","last_undegraded":"2023-10-14T11:12:28.387618+0000","last_fullsized":"2023-10-14T11:12:28.387618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:23.589522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990518+0000","last_change":"2023-10-14T11:12:22.970602+0000","last_active":"2023-10-14T11:12:26.990518+0000","last_peered":"2023-10-14T11:12:26.990518+0000","last_clean":"2023-10-14T11:12:26.990518+0000","last_became_active":"2023-10-14T11:12:22.969961+0000","last_became_peered":"2023-10-14T11:12:22.969961+0000","last_unstale":"2023-10-14T11:12:26.990518+0000","last_undegraded":"2023-10-14T11:12:26.990518+0000","last_fullsized":"2023-10-14T11:12:26.990518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:03.512378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.013519+0000","last_change":"2023-10-14T11:12:21.972694+0000","last_active":"2023-10-14T11:12:27.013519+0000","last_peered":"2023-10-14T11:12:27.013519+0000","last_clean":"2023-10-14T11:12:27.013519+0000","last_became_active":"2023-10-14T11:12:21.972386+0000","last_became_peered":"2023-10-14T11:12:21.972386+0000","last_unstale":"2023-10-14T11:12:27.013519+0000","last_undegraded":"2023-10-14T11:12:27.013519+0000","last_fullsized":"2023-10-14T11:12:27.013519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:40.617646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.052804+0000","last_change":"2023-10-14T11:12:27.019652+0000","last_active":"2023-10-14T11:12:29.052804+0000","last_peered":"2023-10-14T11:12:29.052804+0000","last_clean":"2023-10-14T11:12:29.052804+0000","last_became_active":"2023-10-14T11:12:27.019232+0000","last_became_peered":"2023-10-14T11:12:27.019232+0000","last_unstale":"2023-10-14T11:12:29.052804+0000","last_undegraded":"2023-10-14T11:12:29.052804+0000","last_fullsized":"2023-10-14T11:12:29.052804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:23.589522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.999351+0000","last_change":"2023-10-14T11:12:22.973223+0000","last_active":"2023-10-14T11:12:26.999351+0000","last_peered":"2023-10-14T11:12:26.999351+0000","last_clean":"2023-10-14T11:12:26.999351+0000","last_became_active":"2023-10-14T11:12:22.972863+0000","last_became_peered":"2023-10-14T11:12:22.972863+0000","last_unstale":"2023-10-14T11:12:26.999351+0000","last_undegraded":"2023-10-14T11:12:26.999351+0000","last_fullsized":"2023-10-14T11:12:26.999351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:41.624687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.989010+0000","last_change":"2023-10-14T11:12:21.972184+0000","last_active":"2023-10-14T11:12:26.989010+0000","last_peered":"2023-10-14T11:12:26.989010+0000","last_clean":"2023-10-14T11:12:26.989010+0000","last_became_active":"2023-10-14T11:12:21.968811+0000","last_became_peered":"2023-10-14T11:12:21.968811+0000","last_unstale":"2023-10-14T11:12:26.989010+0000","last_undegraded":"2023-10-14T11:12:26.989010+0000","last_fullsized":"2023-10-14T11:12:26.989010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:24:52.735234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.053250+0000","last_change":"2023-10-14T11:12:27.018825+0000","last_active":"2023-10-14T11:12:29.053250+0000","last_peered":"2023-10-14T11:12:29.053250+0000","last_clean":"2023-10-14T11:12:29.053250+0000","last_became_active":"2023-10-14T11:12:27.018145+0000","last_became_peered":"2023-10-14T11:12:27.018145+0000","last_unstale":"2023-10-14T11:12:29.053250+0000","last_undegraded":"2023-10-14T11:12:29.053250+0000","last_fullsized":"2023-10-14T11:12:29.053250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:58.469102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.994330+0000","last_change":"2023-10-14T11:12:22.973626+0000","last_active":"2023-10-14T11:12:26.994330+0000","last_peered":"2023-10-14T11:12:26.994330+0000","last_clean":"2023-10-14T11:12:26.994330+0000","last_became_active":"2023-10-14T11:12:22.973107+0000","last_became_peered":"2023-10-14T11:12:22.973107+0000","last_unstale":"2023-10-14T11:12:26.994330+0000","last_undegraded":"2023-10-14T11:12:26.994330+0000","last_fullsized":"2023-10-14T11:12:26.994330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:07:23.864178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988809+0000","last_change":"2023-10-14T11:12:21.977761+0000","last_active":"2023-10-14T11:12:26.988809+0000","last_peered":"2023-10-14T11:12:26.988809+0000","last_clean":"2023-10-14T11:12:26.988809+0000","last_became_active":"2023-10-14T11:12:21.976298+0000","last_became_peered":"2023-10-14T11:12:21.976298+0000","last_unstale":"2023-10-14T11:12:26.988809+0000","last_undegraded":"2023-10-14T11:12:26.988809+0000","last_fullsized":"2023-10-14T11:12:26.988809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:44:17.928096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.053501+0000","last_change":"2023-10-14T11:12:27.024825+0000","last_active":"2023-10-14T11:12:29.053501+0000","last_peered":"2023-10-14T11:12:29.053501+0000","last_clean":"2023-10-14T11:12:29.053501+0000","last_became_active":"2023-10-14T11:12:27.024317+0000","last_became_peered":"2023-10-14T11:12:27.024317+0000","last_unstale":"2023-10-14T11:12:29.053501+0000","last_undegraded":"2023-10-14T11:12:29.053501+0000","last_fullsized":"2023-10-14T11:12:29.053501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:07.549080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.995557+0000","last_change":"2023-10-14T11:12:22.992830+0000","last_active":"2023-10-14T11:12:26.995557+0000","last_peered":"2023-10-14T11:12:26.995557+0000","last_clean":"2023-10-14T11:12:26.995557+0000","last_became_active":"2023-10-14T11:12:22.992514+0000","last_became_peered":"2023-10-14T11:12:22.992514+0000","last_unstale":"2023-10-14T11:12:26.995557+0000","last_undegraded":"2023-10-14T11:12:26.995557+0000","last_fullsized":"2023-10-14T11:12:26.995557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:02.330265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264602+0000","last_change":"2023-10-14T11:12:21.980791+0000","last_active":"2023-10-14T11:12:27.264602+0000","last_peered":"2023-10-14T11:12:27.264602+0000","last_clean":"2023-10-14T11:12:27.264602+0000","last_became_active":"2023-10-14T11:12:21.980499+0000","last_became_peered":"2023-10-14T11:12:21.980499+0000","last_unstale":"2023-10-14T11:12:27.264602+0000","last_undegraded":"2023-10-14T11:12:27.264602+0000","last_fullsized":"2023-10-14T11:12:27.264602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:01.323224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.387968+0000","last_change":"2023-10-14T11:12:27.273604+0000","last_active":"2023-10-14T11:12:28.387968+0000","last_peered":"2023-10-14T11:12:28.387968+0000","last_clean":"2023-10-14T11:12:28.387968+0000","last_became_active":"2023-10-14T11:12:27.273160+0000","last_became_peered":"2023-10-14T11:12:27.273160+0000","last_unstale":"2023-10-14T11:12:28.387968+0000","last_undegraded":"2023-10-14T11:12:28.387968+0000","last_fullsized":"2023-10-14T11:12:28.387968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:28.979894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.999882+0000","last_change":"2023-10-14T11:12:22.983334+0000","last_active":"2023-10-14T11:12:26.999882+0000","last_peered":"2023-10-14T11:12:26.999882+0000","last_clean":"2023-10-14T11:12:26.999882+0000","last_became_active":"2023-10-14T11:12:22.981836+0000","last_became_peered":"2023-10-14T11:12:22.981836+0000","last_unstale":"2023-10-14T11:12:26.999882+0000","last_undegraded":"2023-10-14T11:12:26.999882+0000","last_fullsized":"2023-10-14T11:12:26.999882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:17.701734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988703+0000","last_change":"2023-10-14T11:12:21.968246+0000","last_active":"2023-10-14T11:12:26.988703+0000","last_peered":"2023-10-14T11:12:26.988703+0000","last_clean":"2023-10-14T11:12:26.988703+0000","last_became_active":"2023-10-14T11:12:21.967758+0000","last_became_peered":"2023-10-14T11:12:21.967758+0000","last_unstale":"2023-10-14T11:12:26.988703+0000","last_undegraded":"2023-10-14T11:12:26.988703+0000","last_fullsized":"2023-10-14T11:12:26.988703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:23.226723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264683+0000","last_change":"2023-10-14T11:12:12.162289+0000","last_active":"2023-10-14T11:12:27.264683+0000","last_peered":"2023-10-14T11:12:27.264683+0000","last_clean":"2023-10-14T11:12:27.264683+0000","last_became_active":"2023-10-14T11:12:12.161055+0000","last_became_peered":"2023-10-14T11:12:12.161055+0000","last_unstale":"2023-10-14T11:12:27.264683+0000","last_undegraded":"2023-10-14T11:12:27.264683+0000","last_fullsized":"2023-10-14T11:12:27.264683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_clean_scrub_stamp":"2023-10-14T11:12:10.853576+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:52.154107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.051902+0000","last_change":"2023-10-14T11:12:27.270500+0000","last_active":"2023-10-14T11:12:29.051902+0000","last_peered":"2023-10-14T11:12:29.051902+0000","last_clean":"2023-10-14T11:12:29.051902+0000","last_became_active":"2023-10-14T11:12:27.270051+0000","last_became_peered":"2023-10-14T11:12:27.270051+0000","last_unstale":"2023-10-14T11:12:29.051902+0000","last_undegraded":"2023-10-14T11:12:29.051902+0000","last_fullsized":"2023-10-14T11:12:29.051902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:19.221087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265306+0000","last_change":"2023-10-14T11:12:22.987192+0000","last_active":"2023-10-14T11:12:27.265306+0000","last_peered":"2023-10-14T11:12:27.265306+0000","last_clean":"2023-10-14T11:12:27.265306+0000","last_became_active":"2023-10-14T11:12:22.986270+0000","last_became_peered":"2023-10-14T11:12:22.986270+0000","last_unstale":"2023-10-14T11:12:27.265306+0000","last_undegraded":"2023-10-14T11:12:27.265306+0000","last_fullsized":"2023-10-14T11:12:27.265306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:03.512378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988910+0000","last_change":"2023-10-14T11:12:21.977756+0000","last_active":"2023-10-14T11:12:26.988910+0000","last_peered":"2023-10-14T11:12:26.988910+0000","last_clean":"2023-10-14T11:12:26.988910+0000","last_became_active":"2023-10-14T11:12:21.976702+0000","last_became_peered":"2023-10-14T11:12:21.976702+0000","last_unstale":"2023-10-14T11:12:26.988910+0000","last_undegraded":"2023-10-14T11:12:26.988910+0000","last_fullsized":"2023-10-14T11:12:26.988910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:51.562205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.051590+0000","last_change":"2023-10-14T11:12:27.266768+0000","last_active":"2023-10-14T11:12:29.051590+0000","last_peered":"2023-10-14T11:12:29.051590+0000","last_clean":"2023-10-14T11:12:29.051590+0000","last_became_active":"2023-10-14T11:12:27.266293+0000","last_became_peered":"2023-10-14T11:12:27.266293+0000","last_unstale":"2023-10-14T11:12:29.051590+0000","last_undegraded":"2023-10-14T11:12:29.051590+0000","last_fullsized":"2023-10-14T11:12:29.051590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:23.589522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990099+0000","last_change":"2023-10-14T11:12:22.971787+0000","last_active":"2023-10-14T11:12:26.990099+0000","last_peered":"2023-10-14T11:12:26.990099+0000","last_clean":"2023-10-14T11:12:26.990099+0000","last_became_active":"2023-10-14T11:12:22.971485+0000","last_became_peered":"2023-10-14T11:12:22.971485+0000","last_unstale":"2023-10-14T11:12:26.990099+0000","last_undegraded":"2023-10-14T11:12:26.990099+0000","last_fullsized":"2023-10-14T11:12:26.990099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:32.409154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010620+0000","last_change":"2023-10-14T11:12:21.980821+0000","last_active":"2023-10-14T11:12:27.010620+0000","last_peered":"2023-10-14T11:12:27.010620+0000","last_clean":"2023-10-14T11:12:27.010620+0000","last_became_active":"2023-10-14T11:12:21.980483+0000","last_became_peered":"2023-10-14T11:12:21.980483+0000","last_unstale":"2023-10-14T11:12:27.010620+0000","last_undegraded":"2023-10-14T11:12:27.010620+0000","last_fullsized":"2023-10-14T11:12:27.010620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:37.017137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.387892+0000","last_change":"2023-10-14T11:12:27.026598+0000","last_active":"2023-10-14T11:12:28.387892+0000","last_peered":"2023-10-14T11:12:28.387892+0000","last_clean":"2023-10-14T11:12:28.387892+0000","last_became_active":"2023-10-14T11:12:27.026041+0000","last_became_peered":"2023-10-14T11:12:27.026041+0000","last_unstale":"2023-10-14T11:12:28.387892+0000","last_undegraded":"2023-10-14T11:12:28.387892+0000","last_fullsized":"2023-10-14T11:12:28.387892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:07.549080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265979+0000","last_change":"2023-10-14T11:12:22.999134+0000","last_active":"2023-10-14T11:12:27.265979+0000","last_peered":"2023-10-14T11:12:27.265979+0000","last_clean":"2023-10-14T11:12:27.265979+0000","last_became_active":"2023-10-14T11:12:22.998882+0000","last_became_peered":"2023-10-14T11:12:22.998882+0000","last_unstale":"2023-10-14T11:12:27.265979+0000","last_undegraded":"2023-10-14T11:12:27.265979+0000","last_fullsized":"2023-10-14T11:12:27.265979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:48:29.403505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988956+0000","last_change":"2023-10-14T11:12:21.975400+0000","last_active":"2023-10-14T11:12:26.988956+0000","last_peered":"2023-10-14T11:12:26.988956+0000","last_clean":"2023-10-14T11:12:26.988956+0000","last_became_active":"2023-10-14T11:12:21.974763+0000","last_became_peered":"2023-10-14T11:12:21.974763+0000","last_unstale":"2023-10-14T11:12:26.988956+0000","last_undegraded":"2023-10-14T11:12:26.988956+0000","last_fullsized":"2023-10-14T11:12:26.988956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:10:00.086669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.991862+0000","last_change":"2023-10-14T11:12:27.270370+0000","last_active":"2023-10-14T11:12:27.991862+0000","last_peered":"2023-10-14T11:12:27.991862+0000","last_clean":"2023-10-14T11:12:27.991862+0000","last_became_active":"2023-10-14T11:12:27.269897+0000","last_became_peered":"2023-10-14T11:12:27.269897+0000","last_unstale":"2023-10-14T11:12:27.991862+0000","last_undegraded":"2023-10-14T11:12:27.991862+0000","last_fullsized":"2023-10-14T11:12:27.991862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:47.514617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265595+0000","last_change":"2023-10-14T11:12:22.999066+0000","last_active":"2023-10-14T11:12:27.265595+0000","last_peered":"2023-10-14T11:12:27.265595+0000","last_clean":"2023-10-14T11:12:27.265595+0000","last_became_active":"2023-10-14T11:12:22.998776+0000","last_became_peered":"2023-10-14T11:12:22.998776+0000","last_unstale":"2023-10-14T11:12:27.265595+0000","last_undegraded":"2023-10-14T11:12:27.265595+0000","last_fullsized":"2023-10-14T11:12:27.265595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:24.943192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.001153+0000","last_change":"2023-10-14T11:12:21.964558+0000","last_active":"2023-10-14T11:12:27.001153+0000","last_peered":"2023-10-14T11:12:27.001153+0000","last_clean":"2023-10-14T11:12:27.001153+0000","last_became_active":"2023-10-14T11:12:21.964064+0000","last_became_peered":"2023-10-14T11:12:21.964064+0000","last_unstale":"2023-10-14T11:12:27.001153+0000","last_undegraded":"2023-10-14T11:12:27.001153+0000","last_fullsized":"2023-10-14T11:12:27.001153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:10:00.086669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992867+0000","last_change":"2023-10-14T11:12:27.018556+0000","last_active":"2023-10-14T11:12:27.992867+0000","last_peered":"2023-10-14T11:12:27.992867+0000","last_clean":"2023-10-14T11:12:27.992867+0000","last_became_active":"2023-10-14T11:12:27.017714+0000","last_became_peered":"2023-10-14T11:12:27.017714+0000","last_unstale":"2023-10-14T11:12:27.992867+0000","last_undegraded":"2023-10-14T11:12:27.992867+0000","last_fullsized":"2023-10-14T11:12:27.992867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:23.718575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264735+0000","last_change":"2023-10-14T11:12:22.994290+0000","last_active":"2023-10-14T11:12:27.264735+0000","last_peered":"2023-10-14T11:12:27.264735+0000","last_clean":"2023-10-14T11:12:27.264735+0000","last_became_active":"2023-10-14T11:12:22.993935+0000","last_became_peered":"2023-10-14T11:12:22.993935+0000","last_unstale":"2023-10-14T11:12:27.264735+0000","last_undegraded":"2023-10-14T11:12:27.264735+0000","last_fullsized":"2023-10-14T11:12:27.264735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:54.432400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988665+0000","last_change":"2023-10-14T11:12:21.976195+0000","last_active":"2023-10-14T11:12:26.988665+0000","last_peered":"2023-10-14T11:12:26.988665+0000","last_clean":"2023-10-14T11:12:26.988665+0000","last_became_active":"2023-10-14T11:12:21.975885+0000","last_became_peered":"2023-10-14T11:12:21.975885+0000","last_unstale":"2023-10-14T11:12:26.988665+0000","last_undegraded":"2023-10-14T11:12:26.988665+0000","last_fullsized":"2023-10-14T11:12:26.988665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:11:08.840029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.387881+0000","last_change":"2023-10-14T11:12:27.016759+0000","last_active":"2023-10-14T11:12:28.387881+0000","last_peered":"2023-10-14T11:12:28.387881+0000","last_clean":"2023-10-14T11:12:28.387881+0000","last_became_active":"2023-10-14T11:12:27.016334+0000","last_became_peered":"2023-10-14T11:12:27.016334+0000","last_unstale":"2023-10-14T11:12:28.387881+0000","last_undegraded":"2023-10-14T11:12:28.387881+0000","last_fullsized":"2023-10-14T11:12:28.387881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:58.469102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990942+0000","last_change":"2023-10-14T11:12:22.972397+0000","last_active":"2023-10-14T11:12:26.990942+0000","last_peered":"2023-10-14T11:12:26.990942+0000","last_clean":"2023-10-14T11:12:26.990942+0000","last_became_active":"2023-10-14T11:12:22.972093+0000","last_became_peered":"2023-10-14T11:12:22.972093+0000","last_unstale":"2023-10-14T11:12:26.990942+0000","last_undegraded":"2023-10-14T11:12:26.990942+0000","last_fullsized":"2023-10-14T11:12:26.990942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:27.066313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.991065+0000","last_change":"2023-10-14T11:12:21.976321+0000","last_active":"2023-10-14T11:12:26.991065+0000","last_peered":"2023-10-14T11:12:26.991065+0000","last_clean":"2023-10-14T11:12:26.991065+0000","last_became_active":"2023-10-14T11:12:21.975848+0000","last_became_peered":"2023-10-14T11:12:21.975848+0000","last_unstale":"2023-10-14T11:12:26.991065+0000","last_undegraded":"2023-10-14T11:12:26.991065+0000","last_fullsized":"2023-10-14T11:12:26.991065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:31:07.362240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993559+0000","last_change":"2023-10-14T11:12:27.271736+0000","last_active":"2023-10-14T11:12:27.993559+0000","last_peered":"2023-10-14T11:12:27.993559+0000","last_clean":"2023-10-14T11:12:27.993559+0000","last_became_active":"2023-10-14T11:12:27.271274+0000","last_became_peered":"2023-10-14T11:12:27.271274+0000","last_unstale":"2023-10-14T11:12:27.993559+0000","last_undegraded":"2023-10-14T11:12:27.993559+0000","last_fullsized":"2023-10-14T11:12:27.993559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:34.380738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265050+0000","last_change":"2023-10-14T11:12:22.995743+0000","last_active":"2023-10-14T11:12:27.265050+0000","last_peered":"2023-10-14T11:12:27.265050+0000","last_clean":"2023-10-14T11:12:27.265050+0000","last_became_active":"2023-10-14T11:12:22.995464+0000","last_became_peered":"2023-10-14T11:12:22.995464+0000","last_unstale":"2023-10-14T11:12:27.265050+0000","last_undegraded":"2023-10-14T11:12:27.265050+0000","last_fullsized":"2023-10-14T11:12:27.265050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:19.552820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988900+0000","last_change":"2023-10-14T11:12:21.976206+0000","last_active":"2023-10-14T11:12:26.988900+0000","last_peered":"2023-10-14T11:12:26.988900+0000","last_clean":"2023-10-14T11:12:26.988900+0000","last_became_active":"2023-10-14T11:12:21.975934+0000","last_became_peered":"2023-10-14T11:12:21.975934+0000","last_unstale":"2023-10-14T11:12:26.988900+0000","last_undegraded":"2023-10-14T11:12:26.988900+0000","last_fullsized":"2023-10-14T11:12:26.988900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:16.694694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993189+0000","last_change":"2023-10-14T11:12:27.268251+0000","last_active":"2023-10-14T11:12:27.993189+0000","last_peered":"2023-10-14T11:12:27.993189+0000","last_clean":"2023-10-14T11:12:27.993189+0000","last_became_active":"2023-10-14T11:12:27.267788+0000","last_became_peered":"2023-10-14T11:12:27.267788+0000","last_unstale":"2023-10-14T11:12:27.993189+0000","last_undegraded":"2023-10-14T11:12:27.993189+0000","last_fullsized":"2023-10-14T11:12:27.993189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:00:07.198517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.007533+0000","last_change":"2023-10-14T11:12:22.987370+0000","last_active":"2023-10-14T11:12:27.007533+0000","last_peered":"2023-10-14T11:12:27.007533+0000","last_clean":"2023-10-14T11:12:27.007533+0000","last_became_active":"2023-10-14T11:12:22.987096+0000","last_became_peered":"2023-10-14T11:12:22.987096+0000","last_unstale":"2023-10-14T11:12:27.007533+0000","last_undegraded":"2023-10-14T11:12:27.007533+0000","last_fullsized":"2023-10-14T11:12:27.007533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:34.354835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010769+0000","last_change":"2023-10-14T11:12:21.964329+0000","last_active":"2023-10-14T11:12:27.010769+0000","last_peered":"2023-10-14T11:12:27.010769+0000","last_clean":"2023-10-14T11:12:27.010769+0000","last_became_active":"2023-10-14T11:12:21.963491+0000","last_became_peered":"2023-10-14T11:12:21.963491+0000","last_unstale":"2023-10-14T11:12:27.010769+0000","last_undegraded":"2023-10-14T11:12:27.010769+0000","last_fullsized":"2023-10-14T11:12:27.010769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:37.017137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993765+0000","last_change":"2023-10-14T11:12:27.267716+0000","last_active":"2023-10-14T11:12:27.993765+0000","last_peered":"2023-10-14T11:12:27.993765+0000","last_clean":"2023-10-14T11:12:27.993765+0000","last_became_active":"2023-10-14T11:12:27.267311+0000","last_became_peered":"2023-10-14T11:12:27.267311+0000","last_unstale":"2023-10-14T11:12:27.993765+0000","last_undegraded":"2023-10-14T11:12:27.993765+0000","last_fullsized":"2023-10-14T11:12:27.993765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:19:12.033636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265215+0000","last_change":"2023-10-14T11:12:22.987373+0000","last_active":"2023-10-14T11:12:27.265215+0000","last_peered":"2023-10-14T11:12:27.265215+0000","last_clean":"2023-10-14T11:12:27.265215+0000","last_became_active":"2023-10-14T11:12:22.986837+0000","last_became_peered":"2023-10-14T11:12:22.986837+0000","last_unstale":"2023-10-14T11:12:27.265215+0000","last_undegraded":"2023-10-14T11:12:27.265215+0000","last_fullsized":"2023-10-14T11:12:27.265215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:15.184385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:38.498227+0000","last_change":"2023-10-14T11:12:21.976712+0000","last_active":"2023-10-14T11:12:38.498227+0000","last_peered":"2023-10-14T11:12:38.498227+0000","last_clean":"2023-10-14T11:12:38.498227+0000","last_became_active":"2023-10-14T11:12:21.975439+0000","last_became_peered":"2023-10-14T11:12:21.975439+0000","last_unstale":"2023-10-14T11:12:38.498227+0000","last_undegraded":"2023-10-14T11:12:38.498227+0000","last_fullsized":"2023-10-14T11:12:38.498227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:37.017137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.052976+0000","last_change":"2023-10-14T11:12:27.018600+0000","last_active":"2023-10-14T11:12:29.052976+0000","last_peered":"2023-10-14T11:12:29.052976+0000","last_clean":"2023-10-14T11:12:29.052976+0000","last_became_active":"2023-10-14T11:12:27.018091+0000","last_became_peered":"2023-10-14T11:12:27.018091+0000","last_unstale":"2023-10-14T11:12:29.052976+0000","last_undegraded":"2023-10-14T11:12:29.052976+0000","last_fullsized":"2023-10-14T11:12:29.052976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:19.221087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.999245+0000","last_change":"2023-10-14T11:12:22.989506+0000","last_active":"2023-10-14T11:12:26.999245+0000","last_peered":"2023-10-14T11:12:26.999245+0000","last_clean":"2023-10-14T11:12:26.999245+0000","last_became_active":"2023-10-14T11:12:22.989177+0000","last_became_peered":"2023-10-14T11:12:22.989177+0000","last_unstale":"2023-10-14T11:12:26.999245+0000","last_undegraded":"2023-10-14T11:12:26.999245+0000","last_fullsized":"2023-10-14T11:12:26.999245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:02.330265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010526+0000","last_change":"2023-10-14T11:12:21.980802+0000","last_active":"2023-10-14T11:12:27.010526+0000","last_peered":"2023-10-14T11:12:27.010526+0000","last_clean":"2023-10-14T11:12:27.010526+0000","last_became_active":"2023-10-14T11:12:21.980604+0000","last_became_peered":"2023-10-14T11:12:21.980604+0000","last_unstale":"2023-10-14T11:12:27.010526+0000","last_undegraded":"2023-10-14T11:12:27.010526+0000","last_fullsized":"2023-10-14T11:12:27.010526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:01.323224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992999+0000","last_change":"2023-10-14T11:12:27.018243+0000","last_active":"2023-10-14T11:12:27.992999+0000","last_peered":"2023-10-14T11:12:27.992999+0000","last_clean":"2023-10-14T11:12:27.992999+0000","last_became_active":"2023-10-14T11:12:27.017731+0000","last_became_peered":"2023-10-14T11:12:27.017731+0000","last_unstale":"2023-10-14T11:12:27.992999+0000","last_undegraded":"2023-10-14T11:12:27.992999+0000","last_fullsized":"2023-10-14T11:12:27.992999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:50.570179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.011824+0000","last_change":"2023-10-14T11:12:22.985657+0000","last_active":"2023-10-14T11:12:27.011824+0000","last_peered":"2023-10-14T11:12:27.011824+0000","last_clean":"2023-10-14T11:12:27.011824+0000","last_became_active":"2023-10-14T11:12:22.984323+0000","last_became_peered":"2023-10-14T11:12:22.984323+0000","last_unstale":"2023-10-14T11:12:27.011824+0000","last_undegraded":"2023-10-14T11:12:27.011824+0000","last_fullsized":"2023-10-14T11:12:27.011824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:17.701734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990340+0000","last_change":"2023-10-14T11:12:21.973531+0000","last_active":"2023-10-14T11:12:26.990340+0000","last_peered":"2023-10-14T11:12:26.990340+0000","last_clean":"2023-10-14T11:12:26.990340+0000","last_became_active":"2023-10-14T11:12:21.973256+0000","last_became_peered":"2023-10-14T11:12:21.973256+0000","last_unstale":"2023-10-14T11:12:26.990340+0000","last_undegraded":"2023-10-14T11:12:26.990340+0000","last_fullsized":"2023-10-14T11:12:26.990340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:18.236450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992367+0000","last_change":"2023-10-14T11:12:27.027134+0000","last_active":"2023-10-14T11:12:27.992367+0000","last_peered":"2023-10-14T11:12:27.992367+0000","last_clean":"2023-10-14T11:12:27.992367+0000","last_became_active":"2023-10-14T11:12:27.026437+0000","last_became_peered":"2023-10-14T11:12:27.026437+0000","last_unstale":"2023-10-14T11:12:27.992367+0000","last_undegraded":"2023-10-14T11:12:27.992367+0000","last_fullsized":"2023-10-14T11:12:27.992367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:19:12.033636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990233+0000","last_change":"2023-10-14T11:12:22.993432+0000","last_active":"2023-10-14T11:12:26.990233+0000","last_peered":"2023-10-14T11:12:26.990233+0000","last_clean":"2023-10-14T11:12:26.990233+0000","last_became_active":"2023-10-14T11:12:22.993082+0000","last_became_peered":"2023-10-14T11:12:22.993082+0000","last_unstale":"2023-10-14T11:12:26.990233+0000","last_undegraded":"2023-10-14T11:12:26.990233+0000","last_fullsized":"2023-10-14T11:12:26.990233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:19.552820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.992391+0000","last_change":"2023-10-14T11:12:21.982821+0000","last_active":"2023-10-14T11:12:26.992391+0000","last_peered":"2023-10-14T11:12:26.992391+0000","last_clean":"2023-10-14T11:12:26.992391+0000","last_became_active":"2023-10-14T11:12:21.982328+0000","last_became_peered":"2023-10-14T11:12:21.982328+0000","last_unstale":"2023-10-14T11:12:26.992391+0000","last_undegraded":"2023-10-14T11:12:26.992391+0000","last_fullsized":"2023-10-14T11:12:26.992391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:40:43.612359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992497+0000","last_change":"2023-10-14T11:12:27.268498+0000","last_active":"2023-10-14T11:12:27.992497+0000","last_peered":"2023-10-14T11:12:27.992497+0000","last_clean":"2023-10-14T11:12:27.992497+0000","last_became_active":"2023-10-14T11:12:27.267751+0000","last_became_peered":"2023-10-14T11:12:27.267751+0000","last_unstale":"2023-10-14T11:12:27.992497+0000","last_undegraded":"2023-10-14T11:12:27.992497+0000","last_fullsized":"2023-10-14T11:12:27.992497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:53.991279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.387797+0000","last_change":"2023-10-14T11:12:27.274997+0000","last_active":"2023-10-14T11:12:28.387797+0000","last_peered":"2023-10-14T11:12:28.387797+0000","last_clean":"2023-10-14T11:12:28.387797+0000","last_became_active":"2023-10-14T11:12:27.273447+0000","last_became_peered":"2023-10-14T11:12:27.273447+0000","last_unstale":"2023-10-14T11:12:28.387797+0000","last_undegraded":"2023-10-14T11:12:28.387797+0000","last_fullsized":"2023-10-14T11:12:28.387797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:19.221087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000217+0000","last_change":"2023-10-14T11:12:22.965644+0000","last_active":"2023-10-14T11:12:27.000217+0000","last_peered":"2023-10-14T11:12:27.000217+0000","last_clean":"2023-10-14T11:12:27.000217+0000","last_became_active":"2023-10-14T11:12:22.965113+0000","last_became_peered":"2023-10-14T11:12:22.965113+0000","last_unstale":"2023-10-14T11:12:27.000217+0000","last_undegraded":"2023-10-14T11:12:27.000217+0000","last_fullsized":"2023-10-14T11:12:27.000217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:02:49.769267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.989018+0000","last_change":"2023-10-14T11:12:21.972862+0000","last_active":"2023-10-14T11:12:26.989018+0000","last_peered":"2023-10-14T11:12:26.989018+0000","last_clean":"2023-10-14T11:12:26.989018+0000","last_became_active":"2023-10-14T11:12:21.971652+0000","last_became_peered":"2023-10-14T11:12:21.971652+0000","last_unstale":"2023-10-14T11:12:26.989018+0000","last_undegraded":"2023-10-14T11:12:26.989018+0000","last_fullsized":"2023-10-14T11:12:26.989018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:37.017137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.051905+0000","last_change":"2023-10-14T11:12:27.024091+0000","last_active":"2023-10-14T11:12:29.051905+0000","last_peered":"2023-10-14T11:12:29.051905+0000","last_clean":"2023-10-14T11:12:29.051905+0000","last_became_active":"2023-10-14T11:12:27.023591+0000","last_became_peered":"2023-10-14T11:12:27.023591+0000","last_unstale":"2023-10-14T11:12:29.051905+0000","last_undegraded":"2023-10-14T11:12:29.051905+0000","last_fullsized":"2023-10-14T11:12:29.051905+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:58.469102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.995932+0000","last_change":"2023-10-14T11:12:22.976553+0000","last_active":"2023-10-14T11:12:26.995932+0000","last_peered":"2023-10-14T11:12:26.995932+0000","last_clean":"2023-10-14T11:12:26.995932+0000","last_became_active":"2023-10-14T11:12:22.976280+0000","last_became_peered":"2023-10-14T11:12:22.976280+0000","last_unstale":"2023-10-14T11:12:26.995932+0000","last_undegraded":"2023-10-14T11:12:26.995932+0000","last_fullsized":"2023-10-14T11:12:26.995932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:02:49.769267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.995666+0000","last_change":"2023-10-14T11:12:21.971386+0000","last_active":"2023-10-14T11:12:26.995666+0000","last_peered":"2023-10-14T11:12:26.995666+0000","last_clean":"2023-10-14T11:12:26.995666+0000","last_became_active":"2023-10-14T11:12:21.971087+0000","last_became_peered":"2023-10-14T11:12:21.971087+0000","last_unstale":"2023-10-14T11:12:26.995666+0000","last_undegraded":"2023-10-14T11:12:26.995666+0000","last_fullsized":"2023-10-14T11:12:26.995666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:40:43.612359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.992534+0000","last_change":"2023-10-14T11:12:21.975576+0000","last_active":"2023-10-14T11:12:26.992534+0000","last_peered":"2023-10-14T11:12:26.992534+0000","last_clean":"2023-10-14T11:12:26.992534+0000","last_became_active":"2023-10-14T11:12:21.975207+0000","last_became_peered":"2023-10-14T11:12:21.975207+0000","last_unstale":"2023-10-14T11:12:26.992534+0000","last_undegraded":"2023-10-14T11:12:26.992534+0000","last_fullsized":"2023-10-14T11:12:26.992534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:01.323224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010668+0000","last_change":"2023-10-14T11:12:22.992785+0000","last_active":"2023-10-14T11:12:27.010668+0000","last_peered":"2023-10-14T11:12:27.010668+0000","last_clean":"2023-10-14T11:12:27.010668+0000","last_became_active":"2023-10-14T11:12:22.992508+0000","last_became_peered":"2023-10-14T11:12:22.992508+0000","last_unstale":"2023-10-14T11:12:27.010668+0000","last_undegraded":"2023-10-14T11:12:27.010668+0000","last_fullsized":"2023-10-14T11:12:27.010668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:07:23.864178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.702964+0000","last_change":"2023-10-14T11:12:27.023027+0000","last_active":"2023-10-14T11:12:28.702964+0000","last_peered":"2023-10-14T11:12:28.702964+0000","last_clean":"2023-10-14T11:12:28.702964+0000","last_became_active":"2023-10-14T11:12:27.020646+0000","last_became_peered":"2023-10-14T11:12:27.020646+0000","last_unstale":"2023-10-14T11:12:28.702964+0000","last_undegraded":"2023-10-14T11:12:28.702964+0000","last_fullsized":"2023-10-14T11:12:28.702964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:40:48.656102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.998432+0000","last_change":"2023-10-14T11:12:21.976762+0000","last_active":"2023-10-14T11:12:26.998432+0000","last_peered":"2023-10-14T11:12:26.998432+0000","last_clean":"2023-10-14T11:12:26.998432+0000","last_became_active":"2023-10-14T11:12:21.976437+0000","last_became_peered":"2023-10-14T11:12:21.976437+0000","last_unstale":"2023-10-14T11:12:26.998432+0000","last_undegraded":"2023-10-14T11:12:26.998432+0000","last_fullsized":"2023-10-14T11:12:26.998432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:31:07.362240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.997365+0000","last_change":"2023-10-14T11:12:22.960803+0000","last_active":"2023-10-14T11:12:26.997365+0000","last_peered":"2023-10-14T11:12:26.997365+0000","last_clean":"2023-10-14T11:12:26.997365+0000","last_became_active":"2023-10-14T11:12:22.960504+0000","last_became_peered":"2023-10-14T11:12:22.960504+0000","last_unstale":"2023-10-14T11:12:26.997365+0000","last_undegraded":"2023-10-14T11:12:26.997365+0000","last_fullsized":"2023-10-14T11:12:26.997365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:24.233763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993298+0000","last_change":"2023-10-14T11:12:27.016102+0000","last_active":"2023-10-14T11:12:27.993298+0000","last_peered":"2023-10-14T11:12:27.993298+0000","last_clean":"2023-10-14T11:12:27.993298+0000","last_became_active":"2023-10-14T11:12:27.015599+0000","last_became_peered":"2023-10-14T11:12:27.015599+0000","last_unstale":"2023-10-14T11:12:27.993298+0000","last_undegraded":"2023-10-14T11:12:27.993298+0000","last_fullsized":"2023-10-14T11:12:27.993298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:04:28.117008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988221+0000","last_change":"2023-10-14T11:12:22.974947+0000","last_active":"2023-10-14T11:12:26.988221+0000","last_peered":"2023-10-14T11:12:26.988221+0000","last_clean":"2023-10-14T11:12:26.988221+0000","last_became_active":"2023-10-14T11:12:22.974647+0000","last_became_peered":"2023-10-14T11:12:22.974647+0000","last_unstale":"2023-10-14T11:12:26.988221+0000","last_undegraded":"2023-10-14T11:12:26.988221+0000","last_fullsized":"2023-10-14T11:12:26.988221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:02:49.769267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988737+0000","last_change":"2023-10-14T11:12:22.987590+0000","last_active":"2023-10-14T11:12:26.988737+0000","last_peered":"2023-10-14T11:12:26.988737+0000","last_clean":"2023-10-14T11:12:26.988737+0000","last_became_active":"2023-10-14T11:12:22.985815+0000","last_became_peered":"2023-10-14T11:12:22.985815+0000","last_unstale":"2023-10-14T11:12:26.988737+0000","last_undegraded":"2023-10-14T11:12:26.988737+0000","last_fullsized":"2023-10-14T11:12:26.988737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:24.233763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988803+0000","last_change":"2023-10-14T11:12:22.971785+0000","last_active":"2023-10-14T11:12:26.988803+0000","last_peered":"2023-10-14T11:12:26.988803+0000","last_clean":"2023-10-14T11:12:26.988803+0000","last_became_active":"2023-10-14T11:12:22.971415+0000","last_became_peered":"2023-10-14T11:12:22.971415+0000","last_unstale":"2023-10-14T11:12:26.988803+0000","last_undegraded":"2023-10-14T11:12:26.988803+0000","last_fullsized":"2023-10-14T11:12:26.988803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:54.432400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010852+0000","last_change":"2023-10-14T11:12:22.981024+0000","last_active":"2023-10-14T11:12:27.010852+0000","last_peered":"2023-10-14T11:12:27.010852+0000","last_clean":"2023-10-14T11:12:27.010852+0000","last_became_active":"2023-10-14T11:12:22.977993+0000","last_became_peered":"2023-10-14T11:12:22.977993+0000","last_unstale":"2023-10-14T11:12:27.010852+0000","last_undegraded":"2023-10-14T11:12:27.010852+0000","last_fullsized":"2023-10-14T11:12:27.010852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:31:08.369281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.999570+0000","last_change":"2023-10-14T11:12:22.969832+0000","last_active":"2023-10-14T11:12:26.999570+0000","last_peered":"2023-10-14T11:12:26.999570+0000","last_clean":"2023-10-14T11:12:26.999570+0000","last_became_active":"2023-10-14T11:12:22.969627+0000","last_became_peered":"2023-10-14T11:12:22.969627+0000","last_unstale":"2023-10-14T11:12:26.999570+0000","last_undegraded":"2023-10-14T11:12:26.999570+0000","last_fullsized":"2023-10-14T11:12:26.999570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:52:38.018829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010439+0000","last_change":"2023-10-14T11:12:22.966311+0000","last_active":"2023-10-14T11:12:27.010439+0000","last_peered":"2023-10-14T11:12:27.010439+0000","last_clean":"2023-10-14T11:12:27.010439+0000","last_became_active":"2023-10-14T11:12:22.965987+0000","last_became_peered":"2023-10-14T11:12:22.965987+0000","last_unstale":"2023-10-14T11:12:27.010439+0000","last_undegraded":"2023-10-14T11:12:27.010439+0000","last_fullsized":"2023-10-14T11:12:27.010439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:27.066313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.991696+0000","last_change":"2023-10-14T11:12:22.992696+0000","last_active":"2023-10-14T11:12:26.991696+0000","last_peered":"2023-10-14T11:12:26.991696+0000","last_clean":"2023-10-14T11:12:26.991696+0000","last_became_active":"2023-10-14T11:12:22.991959+0000","last_became_peered":"2023-10-14T11:12:22.991959+0000","last_unstale":"2023-10-14T11:12:26.991696+0000","last_undegraded":"2023-10-14T11:12:26.991696+0000","last_fullsized":"2023-10-14T11:12:26.991696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:52:38.018829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000914+0000","last_change":"2023-10-14T11:12:22.984405+0000","last_active":"2023-10-14T11:12:27.000914+0000","last_peered":"2023-10-14T11:12:27.000914+0000","last_clean":"2023-10-14T11:12:27.000914+0000","last_became_active":"2023-10-14T11:12:22.978369+0000","last_became_peered":"2023-10-14T11:12:22.978369+0000","last_unstale":"2023-10-14T11:12:27.000914+0000","last_undegraded":"2023-10-14T11:12:27.000914+0000","last_fullsized":"2023-10-14T11:12:27.000914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:19.681873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988858+0000","last_change":"2023-10-14T11:12:22.969040+0000","last_active":"2023-10-14T11:12:26.988858+0000","last_peered":"2023-10-14T11:12:26.988858+0000","last_clean":"2023-10-14T11:12:26.988858+0000","last_became_active":"2023-10-14T11:12:22.968583+0000","last_became_peered":"2023-10-14T11:12:22.968583+0000","last_unstale":"2023-10-14T11:12:26.988858+0000","last_undegraded":"2023-10-14T11:12:26.988858+0000","last_fullsized":"2023-10-14T11:12:26.988858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:38.252309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.995566+0000","last_change":"2023-10-14T11:12:22.966174+0000","last_active":"2023-10-14T11:12:26.995566+0000","last_peered":"2023-10-14T11:12:26.995566+0000","last_clean":"2023-10-14T11:12:26.995566+0000","last_became_active":"2023-10-14T11:12:22.965570+0000","last_became_peered":"2023-10-14T11:12:22.965570+0000","last_unstale":"2023-10-14T11:12:26.995566+0000","last_undegraded":"2023-10-14T11:12:26.995566+0000","last_fullsized":"2023-10-14T11:12:26.995566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:19.243490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988714+0000","last_change":"2023-10-14T11:12:22.982352+0000","last_active":"2023-10-14T11:12:26.988714+0000","last_peered":"2023-10-14T11:12:26.988714+0000","last_clean":"2023-10-14T11:12:26.988714+0000","last_became_active":"2023-10-14T11:12:22.982026+0000","last_became_peered":"2023-10-14T11:12:22.982026+0000","last_unstale":"2023-10-14T11:12:26.988714+0000","last_undegraded":"2023-10-14T11:12:26.988714+0000","last_fullsized":"2023-10-14T11:12:26.988714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:19.681873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010463+0000","last_change":"2023-10-14T11:12:22.989236+0000","last_active":"2023-10-14T11:12:27.010463+0000","last_peered":"2023-10-14T11:12:27.010463+0000","last_clean":"2023-10-14T11:12:27.010463+0000","last_became_active":"2023-10-14T11:12:22.988644+0000","last_became_peered":"2023-10-14T11:12:22.988644+0000","last_unstale":"2023-10-14T11:12:27.010463+0000","last_undegraded":"2023-10-14T11:12:27.010463+0000","last_fullsized":"2023-10-14T11:12:27.010463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:40:44.619400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.991230+0000","last_change":"2023-10-14T11:12:22.983434+0000","last_active":"2023-10-14T11:12:26.991230+0000","last_peered":"2023-10-14T11:12:26.991230+0000","last_clean":"2023-10-14T11:12:26.991230+0000","last_became_active":"2023-10-14T11:12:22.982702+0000","last_became_peered":"2023-10-14T11:12:22.982702+0000","last_unstale":"2023-10-14T11:12:26.991230+0000","last_undegraded":"2023-10-14T11:12:26.991230+0000","last_fullsized":"2023-10-14T11:12:26.991230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:19.243490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265404+0000","last_change":"2023-10-14T11:12:22.985280+0000","last_active":"2023-10-14T11:12:27.265404+0000","last_peered":"2023-10-14T11:12:27.265404+0000","last_clean":"2023-10-14T11:12:27.265404+0000","last_became_active":"2023-10-14T11:12:22.984745+0000","last_became_peered":"2023-10-14T11:12:22.984745+0000","last_unstale":"2023-10-14T11:12:27.265404+0000","last_undegraded":"2023-10-14T11:12:27.265404+0000","last_fullsized":"2023-10-14T11:12:27.265404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:32.409154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988912+0000","last_change":"2023-10-14T11:12:22.996375+0000","last_active":"2023-10-14T11:12:26.988912+0000","last_peered":"2023-10-14T11:12:26.988912+0000","last_clean":"2023-10-14T11:12:26.988912+0000","last_became_active":"2023-10-14T11:12:22.995986+0000","last_became_peered":"2023-10-14T11:12:22.995986+0000","last_unstale":"2023-10-14T11:12:26.988912+0000","last_undegraded":"2023-10-14T11:12:26.988912+0000","last_fullsized":"2023-10-14T11:12:26.988912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:41.624687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990653+0000","last_change":"2023-10-14T11:12:22.982260+0000","last_active":"2023-10-14T11:12:26.990653+0000","last_peered":"2023-10-14T11:12:26.990653+0000","last_clean":"2023-10-14T11:12:26.990653+0000","last_became_active":"2023-10-14T11:12:22.981981+0000","last_became_peered":"2023-10-14T11:12:22.981981+0000","last_unstale":"2023-10-14T11:12:26.990653+0000","last_undegraded":"2023-10-14T11:12:26.990653+0000","last_fullsized":"2023-10-14T11:12:26.990653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:08.508676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988763+0000","last_change":"2023-10-14T11:12:22.972200+0000","last_active":"2023-10-14T11:12:26.988763+0000","last_peered":"2023-10-14T11:12:26.988763+0000","last_clean":"2023-10-14T11:12:26.988763+0000","last_became_active":"2023-10-14T11:12:22.971852+0000","last_became_peered":"2023-10-14T11:12:22.971852+0000","last_unstale":"2023-10-14T11:12:26.988763+0000","last_undegraded":"2023-10-14T11:12:26.988763+0000","last_fullsized":"2023-10-14T11:12:26.988763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:52:38.018829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000298+0000","last_change":"2023-10-14T11:12:22.964369+0000","last_active":"2023-10-14T11:12:27.000298+0000","last_peered":"2023-10-14T11:12:27.000298+0000","last_clean":"2023-10-14T11:12:27.000298+0000","last_became_active":"2023-10-14T11:12:22.963993+0000","last_became_peered":"2023-10-14T11:12:22.963993+0000","last_unstale":"2023-10-14T11:12:27.000298+0000","last_undegraded":"2023-10-14T11:12:27.000298+0000","last_fullsized":"2023-10-14T11:12:27.000298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:06.491915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.007442+0000","last_change":"2023-10-14T11:12:22.982867+0000","last_active":"2023-10-14T11:12:27.007442+0000","last_peered":"2023-10-14T11:12:27.007442+0000","last_clean":"2023-10-14T11:12:27.007442+0000","last_became_active":"2023-10-14T11:12:22.981049+0000","last_became_peered":"2023-10-14T11:12:22.981049+0000","last_unstale":"2023-10-14T11:12:27.007442+0000","last_undegraded":"2023-10-14T11:12:27.007442+0000","last_fullsized":"2023-10-14T11:12:27.007442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:06.491915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.994506+0000","last_change":"2023-10-14T11:12:22.968823+0000","last_active":"2023-10-14T11:12:26.994506+0000","last_peered":"2023-10-14T11:12:26.994506+0000","last_clean":"2023-10-14T11:12:26.994506+0000","last_became_active":"2023-10-14T11:12:22.968557+0000","last_became_peered":"2023-10-14T11:12:22.968557+0000","last_unstale":"2023-10-14T11:12:26.994506+0000","last_undegraded":"2023-10-14T11:12:26.994506+0000","last_fullsized":"2023-10-14T11:12:26.994506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:27.066313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.999040+0000","last_change":"2023-10-14T11:12:22.970768+0000","last_active":"2023-10-14T11:12:26.999040+0000","last_peered":"2023-10-14T11:12:26.999040+0000","last_clean":"2023-10-14T11:12:26.999040+0000","last_became_active":"2023-10-14T11:12:22.970449+0000","last_became_peered":"2023-10-14T11:12:22.970449+0000","last_unstale":"2023-10-14T11:12:26.999040+0000","last_undegraded":"2023-10-14T11:12:26.999040+0000","last_fullsized":"2023-10-14T11:12:26.999040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:38.024178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.991296+0000","last_change":"2023-10-14T11:12:22.984404+0000","last_active":"2023-10-14T11:12:26.991296+0000","last_peered":"2023-10-14T11:12:26.991296+0000","last_clean":"2023-10-14T11:12:26.991296+0000","last_became_active":"2023-10-14T11:12:22.984162+0000","last_became_peered":"2023-10-14T11:12:22.984162+0000","last_unstale":"2023-10-14T11:12:26.991296+0000","last_undegraded":"2023-10-14T11:12:26.991296+0000","last_fullsized":"2023-10-14T11:12:26.991296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:17.701734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.991597+0000","last_change":"2023-10-14T11:12:22.992927+0000","last_active":"2023-10-14T11:12:26.991597+0000","last_peered":"2023-10-14T11:12:26.991597+0000","last_clean":"2023-10-14T11:12:26.991597+0000","last_became_active":"2023-10-14T11:12:22.992333+0000","last_became_peered":"2023-10-14T11:12:22.992333+0000","last_unstale":"2023-10-14T11:12:26.991597+0000","last_undegraded":"2023-10-14T11:12:26.991597+0000","last_fullsized":"2023-10-14T11:12:26.991597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:24:53.742274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265899+0000","last_change":"2023-10-14T11:12:22.986073+0000","last_active":"2023-10-14T11:12:27.265899+0000","last_peered":"2023-10-14T11:12:27.265899+0000","last_clean":"2023-10-14T11:12:27.265899+0000","last_became_active":"2023-10-14T11:12:22.985686+0000","last_became_peered":"2023-10-14T11:12:22.985686+0000","last_unstale":"2023-10-14T11:12:27.265899+0000","last_undegraded":"2023-10-14T11:12:27.265899+0000","last_fullsized":"2023-10-14T11:12:27.265899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:15:12.849455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.995735+0000","last_change":"2023-10-14T11:12:22.982684+0000","last_active":"2023-10-14T11:12:26.995735+0000","last_peered":"2023-10-14T11:12:26.995735+0000","last_clean":"2023-10-14T11:12:26.995735+0000","last_became_active":"2023-10-14T11:12:22.982328+0000","last_became_peered":"2023-10-14T11:12:22.982328+0000","last_unstale":"2023-10-14T11:12:26.995735+0000","last_undegraded":"2023-10-14T11:12:26.995735+0000","last_fullsized":"2023-10-14T11:12:26.995735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:06.491915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264743+0000","last_change":"2023-10-14T11:12:22.989563+0000","last_active":"2023-10-14T11:12:27.264743+0000","last_peered":"2023-10-14T11:12:27.264743+0000","last_clean":"2023-10-14T11:12:27.264743+0000","last_became_active":"2023-10-14T11:12:22.989283+0000","last_became_peered":"2023-10-14T11:12:22.989283+0000","last_unstale":"2023-10-14T11:12:27.264743+0000","last_undegraded":"2023-10-14T11:12:27.264743+0000","last_fullsized":"2023-10-14T11:12:27.264743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:19.681873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988614+0000","last_change":"2023-10-14T11:12:22.973627+0000","last_active":"2023-10-14T11:12:26.988614+0000","last_peered":"2023-10-14T11:12:26.988614+0000","last_clean":"2023-10-14T11:12:26.988614+0000","last_became_active":"2023-10-14T11:12:22.973284+0000","last_became_peered":"2023-10-14T11:12:22.973284+0000","last_unstale":"2023-10-14T11:12:26.988614+0000","last_undegraded":"2023-10-14T11:12:26.988614+0000","last_fullsized":"2023-10-14T11:12:26.988614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:18:11.434418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264837+0000","last_change":"2023-10-14T11:12:22.981086+0000","last_active":"2023-10-14T11:12:27.264837+0000","last_peered":"2023-10-14T11:12:27.264837+0000","last_clean":"2023-10-14T11:12:27.264837+0000","last_became_active":"2023-10-14T11:12:22.980768+0000","last_became_peered":"2023-10-14T11:12:22.980768+0000","last_unstale":"2023-10-14T11:12:27.264837+0000","last_undegraded":"2023-10-14T11:12:27.264837+0000","last_fullsized":"2023-10-14T11:12:27.264837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:46.533477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.989398+0000","last_change":"2023-10-14T11:12:22.972884+0000","last_active":"2023-10-14T11:12:26.989398+0000","last_peered":"2023-10-14T11:12:26.989398+0000","last_clean":"2023-10-14T11:12:26.989398+0000","last_became_active":"2023-10-14T11:12:22.972548+0000","last_became_peered":"2023-10-14T11:12:22.972548+0000","last_unstale":"2023-10-14T11:12:26.989398+0000","last_undegraded":"2023-10-14T11:12:26.989398+0000","last_fullsized":"2023-10-14T11:12:26.989398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:46.533477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010562+0000","last_change":"2023-10-14T11:12:22.975055+0000","last_active":"2023-10-14T11:12:27.010562+0000","last_peered":"2023-10-14T11:12:27.010562+0000","last_clean":"2023-10-14T11:12:27.010562+0000","last_became_active":"2023-10-14T11:12:22.974759+0000","last_became_peered":"2023-10-14T11:12:22.974759+0000","last_unstale":"2023-10-14T11:12:27.010562+0000","last_undegraded":"2023-10-14T11:12:27.010562+0000","last_fullsized":"2023-10-14T11:12:27.010562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:02:49.769267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.012397+0000","last_change":"2023-10-14T11:12:22.973923+0000","last_active":"2023-10-14T11:12:27.012397+0000","last_peered":"2023-10-14T11:12:27.012397+0000","last_clean":"2023-10-14T11:12:27.012397+0000","last_became_active":"2023-10-14T11:12:22.973626+0000","last_became_peered":"2023-10-14T11:12:22.973626+0000","last_unstale":"2023-10-14T11:12:27.012397+0000","last_undegraded":"2023-10-14T11:12:27.012397+0000","last_fullsized":"2023-10-14T11:12:27.012397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:17.701734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265807+0000","last_change":"2023-10-14T11:12:22.987825+0000","last_active":"2023-10-14T11:12:27.265807+0000","last_peered":"2023-10-14T11:12:27.265807+0000","last_clean":"2023-10-14T11:12:27.265807+0000","last_became_active":"2023-10-14T11:12:22.987045+0000","last_became_peered":"2023-10-14T11:12:22.987045+0000","last_unstale":"2023-10-14T11:12:27.265807+0000","last_undegraded":"2023-10-14T11:12:27.265807+0000","last_fullsized":"2023-10-14T11:12:27.265807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:08.508676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":864256,"data_stored":695401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":104541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":278528,"data_stored":104577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":104451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":104611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":695457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:12:48.175 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:12:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.347+0000 7ff40190f640 1 Processor -- start 2023-10-14T11:12:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.347+0000 7ff40190f640 1 -- start start 2023-10-14T11:12:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.347+0000 7ff40190f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff3fc15cb90 0x7ff3fc0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.347+0000 7ff40190f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff3fc0d15d0 0x7ff3fc0c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.347+0000 7ff40190f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3fc0ce770 con 0x7ff3fc0d3010 2023-10-14T11:12:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.347+0000 7ff40190f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3fc0d0600 con 0x7ff3fc0d15d0 2023-10-14T11:12:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.347+0000 7ff40190f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3fc0c6450 con 0x7ff3fc15cb90 2023-10-14T11:12:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.347+0000 7ff3fb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff3fc0d15d0 0x7ff3fc0c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.347+0000 7ff3fb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff3fc0d15d0 0x7ff3fc0c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36108/0 (socket says 172.21.15.26:36108) 2023-10-14T11:12:48.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.347+0000 7ff3fb7fe640 1 -- 172.21.15.26:0/950757388 learned_addr learned my addr 172.21.15.26:0/950757388 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:48.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.347+0000 7ff3faffd640 1 --2- 172.21.15.26:0/950757388 >> v2:172.21.15.110:3300/0 conn(0x7ff3fc15cb90 0x7ff3fc0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:48.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.347+0000 7ff3fb7fe640 1 -- 172.21.15.26:0/950757388 >> v2:172.21.15.110:3300/0 conn(0x7ff3fc15cb90 msgr2=0x7ff3fc0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:48.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.347+0000 7ff3fb7fe640 1 --2- 172.21.15.26:0/950757388 >> v2:172.21.15.110:3300/0 conn(0x7ff3fc15cb90 0x7ff3fc0cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:48.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.347+0000 7ff3fb7fe640 1 -- 172.21.15.26:0/950757388 >> v1:172.21.15.110:6789/0 conn(0x7ff3fc0d3010 legacy=0x7ff3fc0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:48.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.347+0000 7ff3fb7fe640 1 -- 172.21.15.26:0/950757388 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc0d08a0 con 0x7ff3fc0d15d0 2023-10-14T11:12:48.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.351+0000 7ff3fb7fe640 1 --2- 172.21.15.26:0/950757388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3fc0d15d0 0x7ff3fc0c6c10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0ccee0 tx=0x7ff3f401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2d37e768ae5008 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:48.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.351+0000 7ff3fa7fc640 1 -- 172.21.15.26:0/950757388 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f40a5770 con 0x7ff3fc0d15d0 2023-10-14T11:12:48.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.351+0000 7ff3fa7fc640 1 -- 172.21.15.26:0/950757388 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f40a58d0 con 0x7ff3fc0d15d0 2023-10-14T11:12:48.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.351+0000 7ff3fa7fc640 1 -- 172.21.15.26:0/950757388 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f40a5c60 con 0x7ff3fc0d15d0 2023-10-14T11:12:48.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.351+0000 7ff40190f640 1 -- 172.21.15.26:0/950757388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3fc0d15d0 msgr2=0x7ff3fc0c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:48.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.351+0000 7ff40190f640 1 --2- 172.21.15.26:0/950757388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3fc0d15d0 0x7ff3fc0c6c10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0ccee0 tx=0x7ff3f401c8b0 comp rx=0 tx=0).stop 2023-10-14T11:12:48.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.351+0000 7ff40190f640 1 -- 172.21.15.26:0/950757388 shutdown_connections 2023-10-14T11:12:48.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.351+0000 7ff40190f640 1 --2- 172.21.15.26:0/950757388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3fc0d15d0 0x7ff3fc0c6c10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:48.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.351+0000 7ff40190f640 1 --2- 172.21.15.26:0/950757388 >> v2:172.21.15.110:3300/0 conn(0x7ff3fc15cb90 0x7ff3fc0cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:48.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.351+0000 7ff40190f640 1 -- 172.21.15.26:0/950757388 >> 172.21.15.26:0/950757388 conn(0x7ff3fc09bc50 msgr2=0x7ff3fc0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:48.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.351+0000 7ff40190f640 1 -- 172.21.15.26:0/950757388 shutdown_connections 2023-10-14T11:12:48.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.351+0000 7ff40190f640 1 -- 172.21.15.26:0/950757388 wait complete. 2023-10-14T11:12:48.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff40190f640 1 Processor -- start 2023-10-14T11:12:48.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff40190f640 1 -- start start 2023-10-14T11:12:48.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff40190f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3fc0d15d0 0x7ff3fc153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:48.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff40190f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3fc0d3010 0x7ff3fc156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:48.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff40190f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3fc15cb90 0x7ff3fc1574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:48.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff40190f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc153680 con 0x7ff3fc0d15d0 2023-10-14T11:12:48.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff40190f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc15ad40 con 0x7ff3fc0d3010 2023-10-14T11:12:48.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff40190f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc0caff0 con 0x7ff3fc15cb90 2023-10-14T11:12:48.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff3faffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3fc0d15d0 0x7ff3fc153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:48.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff3faffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3fc0d15d0 0x7ff3fc153140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36122/0 (socket says 172.21.15.26:36122) 2023-10-14T11:12:48.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff3faffd640 1 -- 172.21.15.26:0/4102925803 learned_addr learned my addr 172.21.15.26:0/4102925803 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:48.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff3fb7fe640 1 --2- 172.21.15.26:0/4102925803 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3fc15cb90 0x7ff3fc1574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:48.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff3f3fff640 1 --2- 172.21.15.26:0/4102925803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3fc0d3010 0x7ff3fc156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:48.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff3faffd640 1 -- 172.21.15.26:0/4102925803 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3fc15cb90 msgr2=0x7ff3fc1574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:48.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff3faffd640 1 --2- 172.21.15.26:0/4102925803 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3fc15cb90 0x7ff3fc1574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:48.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff3faffd640 1 -- 172.21.15.26:0/4102925803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3fc0d3010 msgr2=0x7ff3fc156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:48.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff3faffd640 1 --2- 172.21.15.26:0/4102925803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3fc0d3010 0x7ff3fc156f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:48.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff3faffd640 1 -- 172.21.15.26:0/4102925803 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f4009b30 con 0x7ff3fc0d15d0 2023-10-14T11:12:48.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff3faffd640 1 --2- 172.21.15.26:0/4102925803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3fc0d15d0 0x7ff3fc153140 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00d7d0 tx=0x7ff3ec00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:48.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff3f8ff9640 1 -- 172.21.15.26:0/4102925803 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec00b6c0 con 0x7ff3fc0d15d0 2023-10-14T11:12:48.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff3f8ff9640 1 -- 172.21.15.26:0/4102925803 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ec00b820 con 0x7ff3fc0d15d0 2023-10-14T11:12:48.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff3f8ff9640 1 -- 172.21.15.26:0/4102925803 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec00bbd0 con 0x7ff3fc0d15d0 2023-10-14T11:12:48.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff40190f640 1 -- 172.21.15.26:0/4102925803 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3fc0cb2d0 con 0x7ff3fc0d15d0 2023-10-14T11:12:48.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.355+0000 7ff40190f640 1 -- 172.21.15.26:0/4102925803 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3fc0cb890 con 0x7ff3fc0d15d0 2023-10-14T11:12:48.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.359+0000 7ff40190f640 1 -- 172.21.15.26:0/4102925803 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3fc074010 con 0x7ff3fc0d15d0 2023-10-14T11:12:48.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.359+0000 7ff3f8ff9640 1 -- 172.21.15.26:0/4102925803 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff3ec00bd30 con 0x7ff3fc0d15d0 2023-10-14T11:12:48.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.359+0000 7ff3f8ff9640 1 --2- 172.21.15.26:0/4102925803 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff3dc0664a0 0x7ff3dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:48.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.359+0000 7ff3f8ff9640 1 -- 172.21.15.26:0/4102925803 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff3ec0846d0 con 0x7ff3fc0d15d0 2023-10-14T11:12:48.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.359+0000 7ff3f3fff640 1 --2- 172.21.15.26:0/4102925803 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff3dc0664a0 0x7ff3dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:48.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.359+0000 7ff3f3fff640 1 --2- 172.21.15.26:0/4102925803 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff3dc0664a0 0x7ff3dc068960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc1f7fe0 tx=0x7ff3e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:48.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.363+0000 7ff3f8ff9640 1 -- 172.21.15.26:0/4102925803 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff3ec0517c0 con 0x7ff3fc0d15d0 2023-10-14T11:12:48.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.519+0000 7ff40190f640 1 -- 172.21.15.26:0/4102925803 --> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3fc15cf70 con 0x7ff3dc0664a0 2023-10-14T11:12:48.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.527+0000 7ff3f8ff9640 1 -- 172.21.15.26:0/4102925803 <== mgr.4101 v2:172.21.15.26:6832/4136446821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345277 (secure 0 0 0) 0x7ff3e4005380 con 0x7ff3dc0664a0 2023-10-14T11:12:48.535 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-14T11:12:48.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.531+0000 7ff40190f640 1 -- 172.21.15.26:0/4102925803 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff3dc0664a0 msgr2=0x7ff3dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:48.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.531+0000 7ff40190f640 1 --2- 172.21.15.26:0/4102925803 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff3dc0664a0 0x7ff3dc068960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc1f7fe0 tx=0x7ff3e4009040 comp rx=0 tx=0).stop 2023-10-14T11:12:48.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.531+0000 7ff40190f640 1 -- 172.21.15.26:0/4102925803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3fc0d15d0 msgr2=0x7ff3fc153140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:48.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.531+0000 7ff40190f640 1 --2- 172.21.15.26:0/4102925803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3fc0d15d0 0x7ff3fc153140 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00d7d0 tx=0x7ff3ec00dc90 comp rx=0 tx=0).stop 2023-10-14T11:12:48.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.531+0000 7ff40190f640 1 -- 172.21.15.26:0/4102925803 shutdown_connections 2023-10-14T11:12:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.531+0000 7ff40190f640 1 --2- 172.21.15.26:0/4102925803 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3fc15cb90 0x7ff3fc1574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.531+0000 7ff40190f640 1 --2- 172.21.15.26:0/4102925803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3fc0d3010 0x7ff3fc156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.531+0000 7ff40190f640 1 --2- 172.21.15.26:0/4102925803 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff3dc0664a0 0x7ff3dc068960 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.531+0000 7ff40190f640 1 --2- 172.21.15.26:0/4102925803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3fc0d15d0 0x7ff3fc153140 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.531+0000 7ff40190f640 1 -- 172.21.15.26:0/4102925803 >> 172.21.15.26:0/4102925803 conn(0x7ff3fc09bc50 msgr2=0x7ff3fc0d1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:48.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.531+0000 7ff40190f640 1 -- 172.21.15.26:0/4102925803 shutdown_connections 2023-10-14T11:12:48.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.531+0000 7ff40190f640 1 -- 172.21.15.26:0/4102925803 wait complete. 2023-10-14T11:12:48.556 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-10-14T11:12:48.165174+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227784,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754746936,"statfs":{"total":773094113280,"available":772860862464,"internally_reserved":0,"allocated":3383296,"data_stored":2025622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":229756472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002991"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.011921+0000","last_change":"2023-10-14T11:12:21.968131+0000","last_active":"2023-10-14T11:12:27.011921+0000","last_peered":"2023-10-14T11:12:27.011921+0000","last_clean":"2023-10-14T11:12:27.011921+0000","last_became_active":"2023-10-14T11:12:21.967795+0000","last_became_peered":"2023-10-14T11:12:21.967795+0000","last_unstale":"2023-10-14T11:12:27.011921+0000","last_undegraded":"2023-10-14T11:12:27.011921+0000","last_fullsized":"2023-10-14T11:12:27.011921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:40.617646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000703+0000","last_change":"2023-10-14T11:12:22.996026+0000","last_active":"2023-10-14T11:12:27.000703+0000","last_peered":"2023-10-14T11:12:27.000703+0000","last_clean":"2023-10-14T11:12:27.000703+0000","last_became_active":"2023-10-14T11:12:22.995661+0000","last_became_peered":"2023-10-14T11:12:22.995661+0000","last_unstale":"2023-10-14T11:12:27.000703+0000","last_undegraded":"2023-10-14T11:12:27.000703+0000","last_fullsized":"2023-10-14T11:12:27.000703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:38.252309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992306+0000","last_change":"2023-10-14T11:12:27.273682+0000","last_active":"2023-10-14T11:12:27.992306+0000","last_peered":"2023-10-14T11:12:27.992306+0000","last_clean":"2023-10-14T11:12:27.992306+0000","last_became_active":"2023-10-14T11:12:27.273214+0000","last_became_peered":"2023-10-14T11:12:27.273214+0000","last_unstale":"2023-10-14T11:12:27.992306+0000","last_undegraded":"2023-10-14T11:12:27.992306+0000","last_fullsized":"2023-10-14T11:12:27.992306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:47.514617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000801+0000","last_change":"2023-10-14T11:12:21.965767+0000","last_active":"2023-10-14T11:12:27.000801+0000","last_peered":"2023-10-14T11:12:27.000801+0000","last_clean":"2023-10-14T11:12:27.000801+0000","last_became_active":"2023-10-14T11:12:21.963959+0000","last_became_peered":"2023-10-14T11:12:21.963959+0000","last_unstale":"2023-10-14T11:12:27.000801+0000","last_undegraded":"2023-10-14T11:12:27.000801+0000","last_fullsized":"2023-10-14T11:12:27.000801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:40.617646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.011705+0000","last_change":"2023-10-14T11:12:22.985764+0000","last_active":"2023-10-14T11:12:27.011705+0000","last_peered":"2023-10-14T11:12:27.011705+0000","last_clean":"2023-10-14T11:12:27.011705+0000","last_became_active":"2023-10-14T11:12:22.984086+0000","last_became_peered":"2023-10-14T11:12:22.984086+0000","last_unstale":"2023-10-14T11:12:27.011705+0000","last_undegraded":"2023-10-14T11:12:27.011705+0000","last_fullsized":"2023-10-14T11:12:27.011705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:27.066313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.994145+0000","last_change":"2023-10-14T11:12:27.029908+0000","last_active":"2023-10-14T11:12:27.994145+0000","last_peered":"2023-10-14T11:12:27.994145+0000","last_clean":"2023-10-14T11:12:27.994145+0000","last_became_active":"2023-10-14T11:12:27.029420+0000","last_became_peered":"2023-10-14T11:12:27.029420+0000","last_unstale":"2023-10-14T11:12:27.994145+0000","last_undegraded":"2023-10-14T11:12:27.994145+0000","last_fullsized":"2023-10-14T11:12:27.994145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:07.549080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265378+0000","last_change":"2023-10-14T11:12:21.979625+0000","last_active":"2023-10-14T11:12:27.265378+0000","last_peered":"2023-10-14T11:12:27.265378+0000","last_clean":"2023-10-14T11:12:27.265378+0000","last_became_active":"2023-10-14T11:12:21.979220+0000","last_became_peered":"2023-10-14T11:12:21.979220+0000","last_unstale":"2023-10-14T11:12:27.265378+0000","last_undegraded":"2023-10-14T11:12:27.265378+0000","last_fullsized":"2023-10-14T11:12:27.265378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:18.236450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.989996+0000","last_change":"2023-10-14T11:12:22.980954+0000","last_active":"2023-10-14T11:12:26.989996+0000","last_peered":"2023-10-14T11:12:26.989996+0000","last_clean":"2023-10-14T11:12:26.989996+0000","last_became_active":"2023-10-14T11:12:22.980685+0000","last_became_peered":"2023-10-14T11:12:22.980685+0000","last_unstale":"2023-10-14T11:12:26.989996+0000","last_undegraded":"2023-10-14T11:12:26.989996+0000","last_fullsized":"2023-10-14T11:12:26.989996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:24.943192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992649+0000","last_change":"2023-10-14T11:12:27.018281+0000","last_active":"2023-10-14T11:12:27.992649+0000","last_peered":"2023-10-14T11:12:27.992649+0000","last_clean":"2023-10-14T11:12:27.992649+0000","last_became_active":"2023-10-14T11:12:27.017878+0000","last_became_peered":"2023-10-14T11:12:27.017878+0000","last_unstale":"2023-10-14T11:12:27.992649+0000","last_undegraded":"2023-10-14T11:12:27.992649+0000","last_fullsized":"2023-10-14T11:12:27.992649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:18:15.471120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265116+0000","last_change":"2023-10-14T11:12:21.976549+0000","last_active":"2023-10-14T11:12:27.265116+0000","last_peered":"2023-10-14T11:12:27.265116+0000","last_clean":"2023-10-14T11:12:27.265116+0000","last_became_active":"2023-10-14T11:12:21.976164+0000","last_became_peered":"2023-10-14T11:12:21.976164+0000","last_unstale":"2023-10-14T11:12:27.265116+0000","last_undegraded":"2023-10-14T11:12:27.265116+0000","last_fullsized":"2023-10-14T11:12:27.265116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:05.484874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990424+0000","last_change":"2023-10-14T11:12:22.970775+0000","last_active":"2023-10-14T11:12:26.990424+0000","last_peered":"2023-10-14T11:12:26.990424+0000","last_clean":"2023-10-14T11:12:26.990424+0000","last_became_active":"2023-10-14T11:12:22.970331+0000","last_became_peered":"2023-10-14T11:12:22.970331+0000","last_unstale":"2023-10-14T11:12:26.990424+0000","last_undegraded":"2023-10-14T11:12:26.990424+0000","last_fullsized":"2023-10-14T11:12:26.990424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:15.184385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992665+0000","last_change":"2023-10-14T11:12:27.011037+0000","last_active":"2023-10-14T11:12:27.992665+0000","last_peered":"2023-10-14T11:12:27.992665+0000","last_clean":"2023-10-14T11:12:27.992665+0000","last_became_active":"2023-10-14T11:12:27.010126+0000","last_became_peered":"2023-10-14T11:12:27.010126+0000","last_unstale":"2023-10-14T11:12:27.992665+0000","last_undegraded":"2023-10-14T11:12:27.992665+0000","last_fullsized":"2023-10-14T11:12:27.992665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:42.289011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.992180+0000","last_change":"2023-10-14T11:12:22.983577+0000","last_active":"2023-10-14T11:12:26.992180+0000","last_peered":"2023-10-14T11:12:26.992180+0000","last_clean":"2023-10-14T11:12:26.992180+0000","last_became_active":"2023-10-14T11:12:22.982026+0000","last_became_peered":"2023-10-14T11:12:22.982026+0000","last_unstale":"2023-10-14T11:12:26.992180+0000","last_undegraded":"2023-10-14T11:12:26.992180+0000","last_fullsized":"2023-10-14T11:12:26.992180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:06.491915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265315+0000","last_change":"2023-10-14T11:12:21.979924+0000","last_active":"2023-10-14T11:12:27.265315+0000","last_peered":"2023-10-14T11:12:27.265315+0000","last_clean":"2023-10-14T11:12:27.265315+0000","last_became_active":"2023-10-14T11:12:21.979434+0000","last_became_peered":"2023-10-14T11:12:21.979434+0000","last_unstale":"2023-10-14T11:12:27.265315+0000","last_undegraded":"2023-10-14T11:12:27.265315+0000","last_fullsized":"2023-10-14T11:12:27.265315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:31:07.362240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993464+0000","last_change":"2023-10-14T11:12:27.025486+0000","last_active":"2023-10-14T11:12:27.993464+0000","last_peered":"2023-10-14T11:12:27.993464+0000","last_clean":"2023-10-14T11:12:27.993464+0000","last_became_active":"2023-10-14T11:12:27.025086+0000","last_became_peered":"2023-10-14T11:12:27.025086+0000","last_unstale":"2023-10-14T11:12:27.993464+0000","last_undegraded":"2023-10-14T11:12:27.993464+0000","last_fullsized":"2023-10-14T11:12:27.993464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:19.221087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.994599+0000","last_change":"2023-10-14T11:12:22.975476+0000","last_active":"2023-10-14T11:12:26.994599+0000","last_peered":"2023-10-14T11:12:26.994599+0000","last_clean":"2023-10-14T11:12:26.994599+0000","last_became_active":"2023-10-14T11:12:22.975171+0000","last_became_peered":"2023-10-14T11:12:22.975171+0000","last_unstale":"2023-10-14T11:12:26.994599+0000","last_undegraded":"2023-10-14T11:12:26.994599+0000","last_fullsized":"2023-10-14T11:12:26.994599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:18:11.434418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.003734+0000","last_change":"2023-10-14T11:12:21.967707+0000","last_active":"2023-10-14T11:12:27.003734+0000","last_peered":"2023-10-14T11:12:27.003734+0000","last_clean":"2023-10-14T11:12:27.003734+0000","last_became_active":"2023-10-14T11:12:21.967412+0000","last_became_peered":"2023-10-14T11:12:21.967412+0000","last_unstale":"2023-10-14T11:12:27.003734+0000","last_undegraded":"2023-10-14T11:12:27.003734+0000","last_fullsized":"2023-10-14T11:12:27.003734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:11:08.840029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992628+0000","last_change":"2023-10-14T11:12:27.026337+0000","last_active":"2023-10-14T11:12:27.992628+0000","last_peered":"2023-10-14T11:12:27.992628+0000","last_clean":"2023-10-14T11:12:27.992628+0000","last_became_active":"2023-10-14T11:12:27.025956+0000","last_became_peered":"2023-10-14T11:12:27.025956+0000","last_unstale":"2023-10-14T11:12:27.992628+0000","last_undegraded":"2023-10-14T11:12:27.992628+0000","last_fullsized":"2023-10-14T11:12:27.992628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:52:42.055532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.996024+0000","last_change":"2023-10-14T11:12:22.968547+0000","last_active":"2023-10-14T11:12:26.996024+0000","last_peered":"2023-10-14T11:12:26.996024+0000","last_clean":"2023-10-14T11:12:26.996024+0000","last_became_active":"2023-10-14T11:12:22.968263+0000","last_became_peered":"2023-10-14T11:12:22.968263+0000","last_unstale":"2023-10-14T11:12:26.996024+0000","last_undegraded":"2023-10-14T11:12:26.996024+0000","last_fullsized":"2023-10-14T11:12:26.996024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:24:53.742274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000375+0000","last_change":"2023-10-14T11:12:21.975718+0000","last_active":"2023-10-14T11:12:27.000375+0000","last_peered":"2023-10-14T11:12:27.000375+0000","last_clean":"2023-10-14T11:12:27.000375+0000","last_became_active":"2023-10-14T11:12:21.975455+0000","last_became_peered":"2023-10-14T11:12:21.975455+0000","last_unstale":"2023-10-14T11:12:27.000375+0000","last_undegraded":"2023-10-14T11:12:27.000375+0000","last_fullsized":"2023-10-14T11:12:27.000375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:40:43.612359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.053490+0000","last_change":"2023-10-14T11:12:27.271875+0000","last_active":"2023-10-14T11:12:29.053490+0000","last_peered":"2023-10-14T11:12:29.053490+0000","last_clean":"2023-10-14T11:12:29.053490+0000","last_became_active":"2023-10-14T11:12:27.271472+0000","last_became_peered":"2023-10-14T11:12:27.271472+0000","last_unstale":"2023-10-14T11:12:29.053490+0000","last_undegraded":"2023-10-14T11:12:29.053490+0000","last_fullsized":"2023-10-14T11:12:29.053490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:28.979894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.997514+0000","last_change":"2023-10-14T11:12:22.980084+0000","last_active":"2023-10-14T11:12:26.997514+0000","last_peered":"2023-10-14T11:12:26.997514+0000","last_clean":"2023-10-14T11:12:26.997514+0000","last_became_active":"2023-10-14T11:12:22.979078+0000","last_became_peered":"2023-10-14T11:12:22.979078+0000","last_unstale":"2023-10-14T11:12:26.997514+0000","last_undegraded":"2023-10-14T11:12:26.997514+0000","last_fullsized":"2023-10-14T11:12:26.997514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:43:00.534216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264588+0000","last_change":"2023-10-14T11:12:21.975091+0000","last_active":"2023-10-14T11:12:27.264588+0000","last_peered":"2023-10-14T11:12:27.264588+0000","last_clean":"2023-10-14T11:12:27.264588+0000","last_became_active":"2023-10-14T11:12:21.974797+0000","last_became_peered":"2023-10-14T11:12:21.974797+0000","last_unstale":"2023-10-14T11:12:27.264588+0000","last_undegraded":"2023-10-14T11:12:27.264588+0000","last_fullsized":"2023-10-14T11:12:27.264588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:37.017137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993949+0000","last_change":"2023-10-14T11:12:27.025785+0000","last_active":"2023-10-14T11:12:27.993949+0000","last_peered":"2023-10-14T11:12:27.993949+0000","last_clean":"2023-10-14T11:12:27.993949+0000","last_became_active":"2023-10-14T11:12:27.025299+0000","last_became_peered":"2023-10-14T11:12:27.025299+0000","last_unstale":"2023-10-14T11:12:27.993949+0000","last_undegraded":"2023-10-14T11:12:27.993949+0000","last_fullsized":"2023-10-14T11:12:27.993949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:58.469102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.011387+0000","last_change":"2023-10-14T11:12:22.982412+0000","last_active":"2023-10-14T11:12:27.011387+0000","last_peered":"2023-10-14T11:12:27.011387+0000","last_clean":"2023-10-14T11:12:27.011387+0000","last_became_active":"2023-10-14T11:12:22.981232+0000","last_became_peered":"2023-10-14T11:12:22.981232+0000","last_unstale":"2023-10-14T11:12:27.011387+0000","last_undegraded":"2023-10-14T11:12:27.011387+0000","last_fullsized":"2023-10-14T11:12:27.011387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:19.243490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.992495+0000","last_change":"2023-10-14T11:12:21.979890+0000","last_active":"2023-10-14T11:12:26.992495+0000","last_peered":"2023-10-14T11:12:26.992495+0000","last_clean":"2023-10-14T11:12:26.992495+0000","last_became_active":"2023-10-14T11:12:21.979626+0000","last_became_peered":"2023-10-14T11:12:21.979626+0000","last_unstale":"2023-10-14T11:12:26.992495+0000","last_undegraded":"2023-10-14T11:12:26.992495+0000","last_fullsized":"2023-10-14T11:12:26.992495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:33.347794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993164+0000","last_change":"2023-10-14T11:12:27.274768+0000","last_active":"2023-10-14T11:12:27.993164+0000","last_peered":"2023-10-14T11:12:27.993164+0000","last_clean":"2023-10-14T11:12:27.993164+0000","last_became_active":"2023-10-14T11:12:27.274146+0000","last_became_peered":"2023-10-14T11:12:27.274146+0000","last_unstale":"2023-10-14T11:12:27.993164+0000","last_undegraded":"2023-10-14T11:12:27.993164+0000","last_fullsized":"2023-10-14T11:12:27.993164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:23.589522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000910+0000","last_change":"2023-10-14T11:12:22.985137+0000","last_active":"2023-10-14T11:12:27.000910+0000","last_peered":"2023-10-14T11:12:27.000910+0000","last_clean":"2023-10-14T11:12:27.000910+0000","last_became_active":"2023-10-14T11:12:22.984832+0000","last_became_peered":"2023-10-14T11:12:22.984832+0000","last_unstale":"2023-10-14T11:12:27.000910+0000","last_undegraded":"2023-10-14T11:12:27.000910+0000","last_fullsized":"2023-10-14T11:12:27.000910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:46.533477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.013073+0000","last_change":"2023-10-14T11:12:21.973653+0000","last_active":"2023-10-14T11:12:27.013073+0000","last_peered":"2023-10-14T11:12:27.013073+0000","last_clean":"2023-10-14T11:12:27.013073+0000","last_became_active":"2023-10-14T11:12:21.973384+0000","last_became_peered":"2023-10-14T11:12:21.973384+0000","last_unstale":"2023-10-14T11:12:27.013073+0000","last_undegraded":"2023-10-14T11:12:27.013073+0000","last_fullsized":"2023-10-14T11:12:27.013073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:31:07.362240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992214+0000","last_change":"2023-10-14T11:12:27.274360+0000","last_active":"2023-10-14T11:12:27.992214+0000","last_peered":"2023-10-14T11:12:27.992214+0000","last_clean":"2023-10-14T11:12:27.992214+0000","last_became_active":"2023-10-14T11:12:27.273104+0000","last_became_peered":"2023-10-14T11:12:27.273104+0000","last_unstale":"2023-10-14T11:12:27.992214+0000","last_undegraded":"2023-10-14T11:12:27.992214+0000","last_fullsized":"2023-10-14T11:12:27.992214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:23:51.698322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.013376+0000","last_change":"2023-10-14T11:12:22.973372+0000","last_active":"2023-10-14T11:12:27.013376+0000","last_peered":"2023-10-14T11:12:27.013376+0000","last_clean":"2023-10-14T11:12:27.013376+0000","last_became_active":"2023-10-14T11:12:22.973009+0000","last_became_peered":"2023-10-14T11:12:22.973009+0000","last_unstale":"2023-10-14T11:12:27.013376+0000","last_undegraded":"2023-10-14T11:12:27.013376+0000","last_fullsized":"2023-10-14T11:12:27.013376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:19.243490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265475+0000","last_change":"2023-10-14T11:12:21.975624+0000","last_active":"2023-10-14T11:12:27.265475+0000","last_peered":"2023-10-14T11:12:27.265475+0000","last_clean":"2023-10-14T11:12:27.265475+0000","last_became_active":"2023-10-14T11:12:21.975359+0000","last_became_peered":"2023-10-14T11:12:21.975359+0000","last_unstale":"2023-10-14T11:12:27.265475+0000","last_undegraded":"2023-10-14T11:12:27.265475+0000","last_fullsized":"2023-10-14T11:12:27.265475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:24:52.735234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.387618+0000","last_change":"2023-10-14T11:12:27.272156+0000","last_active":"2023-10-14T11:12:28.387618+0000","last_peered":"2023-10-14T11:12:28.387618+0000","last_clean":"2023-10-14T11:12:28.387618+0000","last_became_active":"2023-10-14T11:12:27.271460+0000","last_became_peered":"2023-10-14T11:12:27.271460+0000","last_unstale":"2023-10-14T11:12:28.387618+0000","last_undegraded":"2023-10-14T11:12:28.387618+0000","last_fullsized":"2023-10-14T11:12:28.387618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:23.589522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990518+0000","last_change":"2023-10-14T11:12:22.970602+0000","last_active":"2023-10-14T11:12:26.990518+0000","last_peered":"2023-10-14T11:12:26.990518+0000","last_clean":"2023-10-14T11:12:26.990518+0000","last_became_active":"2023-10-14T11:12:22.969961+0000","last_became_peered":"2023-10-14T11:12:22.969961+0000","last_unstale":"2023-10-14T11:12:26.990518+0000","last_undegraded":"2023-10-14T11:12:26.990518+0000","last_fullsized":"2023-10-14T11:12:26.990518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:03.512378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.013519+0000","last_change":"2023-10-14T11:12:21.972694+0000","last_active":"2023-10-14T11:12:27.013519+0000","last_peered":"2023-10-14T11:12:27.013519+0000","last_clean":"2023-10-14T11:12:27.013519+0000","last_became_active":"2023-10-14T11:12:21.972386+0000","last_became_peered":"2023-10-14T11:12:21.972386+0000","last_unstale":"2023-10-14T11:12:27.013519+0000","last_undegraded":"2023-10-14T11:12:27.013519+0000","last_fullsized":"2023-10-14T11:12:27.013519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:40.617646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.052804+0000","last_change":"2023-10-14T11:12:27.019652+0000","last_active":"2023-10-14T11:12:29.052804+0000","last_peered":"2023-10-14T11:12:29.052804+0000","last_clean":"2023-10-14T11:12:29.052804+0000","last_became_active":"2023-10-14T11:12:27.019232+0000","last_became_peered":"2023-10-14T11:12:27.019232+0000","last_unstale":"2023-10-14T11:12:29.052804+0000","last_undegraded":"2023-10-14T11:12:29.052804+0000","last_fullsized":"2023-10-14T11:12:29.052804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:23.589522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.999351+0000","last_change":"2023-10-14T11:12:22.973223+0000","last_active":"2023-10-14T11:12:26.999351+0000","last_peered":"2023-10-14T11:12:26.999351+0000","last_clean":"2023-10-14T11:12:26.999351+0000","last_became_active":"2023-10-14T11:12:22.972863+0000","last_became_peered":"2023-10-14T11:12:22.972863+0000","last_unstale":"2023-10-14T11:12:26.999351+0000","last_undegraded":"2023-10-14T11:12:26.999351+0000","last_fullsized":"2023-10-14T11:12:26.999351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:41.624687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.989010+0000","last_change":"2023-10-14T11:12:21.972184+0000","last_active":"2023-10-14T11:12:26.989010+0000","last_peered":"2023-10-14T11:12:26.989010+0000","last_clean":"2023-10-14T11:12:26.989010+0000","last_became_active":"2023-10-14T11:12:21.968811+0000","last_became_peered":"2023-10-14T11:12:21.968811+0000","last_unstale":"2023-10-14T11:12:26.989010+0000","last_undegraded":"2023-10-14T11:12:26.989010+0000","last_fullsized":"2023-10-14T11:12:26.989010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:24:52.735234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.053250+0000","last_change":"2023-10-14T11:12:27.018825+0000","last_active":"2023-10-14T11:12:29.053250+0000","last_peered":"2023-10-14T11:12:29.053250+0000","last_clean":"2023-10-14T11:12:29.053250+0000","last_became_active":"2023-10-14T11:12:27.018145+0000","last_became_peered":"2023-10-14T11:12:27.018145+0000","last_unstale":"2023-10-14T11:12:29.053250+0000","last_undegraded":"2023-10-14T11:12:29.053250+0000","last_fullsized":"2023-10-14T11:12:29.053250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:58.469102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.994330+0000","last_change":"2023-10-14T11:12:22.973626+0000","last_active":"2023-10-14T11:12:26.994330+0000","last_peered":"2023-10-14T11:12:26.994330+0000","last_clean":"2023-10-14T11:12:26.994330+0000","last_became_active":"2023-10-14T11:12:22.973107+0000","last_became_peered":"2023-10-14T11:12:22.973107+0000","last_unstale":"2023-10-14T11:12:26.994330+0000","last_undegraded":"2023-10-14T11:12:26.994330+0000","last_fullsized":"2023-10-14T11:12:26.994330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:07:23.864178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988809+0000","last_change":"2023-10-14T11:12:21.977761+0000","last_active":"2023-10-14T11:12:26.988809+0000","last_peered":"2023-10-14T11:12:26.988809+0000","last_clean":"2023-10-14T11:12:26.988809+0000","last_became_active":"2023-10-14T11:12:21.976298+0000","last_became_peered":"2023-10-14T11:12:21.976298+0000","last_unstale":"2023-10-14T11:12:26.988809+0000","last_undegraded":"2023-10-14T11:12:26.988809+0000","last_fullsized":"2023-10-14T11:12:26.988809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:44:17.928096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.053501+0000","last_change":"2023-10-14T11:12:27.024825+0000","last_active":"2023-10-14T11:12:29.053501+0000","last_peered":"2023-10-14T11:12:29.053501+0000","last_clean":"2023-10-14T11:12:29.053501+0000","last_became_active":"2023-10-14T11:12:27.024317+0000","last_became_peered":"2023-10-14T11:12:27.024317+0000","last_unstale":"2023-10-14T11:12:29.053501+0000","last_undegraded":"2023-10-14T11:12:29.053501+0000","last_fullsized":"2023-10-14T11:12:29.053501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:07.549080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.995557+0000","last_change":"2023-10-14T11:12:22.992830+0000","last_active":"2023-10-14T11:12:26.995557+0000","last_peered":"2023-10-14T11:12:26.995557+0000","last_clean":"2023-10-14T11:12:26.995557+0000","last_became_active":"2023-10-14T11:12:22.992514+0000","last_became_peered":"2023-10-14T11:12:22.992514+0000","last_unstale":"2023-10-14T11:12:26.995557+0000","last_undegraded":"2023-10-14T11:12:26.995557+0000","last_fullsized":"2023-10-14T11:12:26.995557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:02.330265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264602+0000","last_change":"2023-10-14T11:12:21.980791+0000","last_active":"2023-10-14T11:12:27.264602+0000","last_peered":"2023-10-14T11:12:27.264602+0000","last_clean":"2023-10-14T11:12:27.264602+0000","last_became_active":"2023-10-14T11:12:21.980499+0000","last_became_peered":"2023-10-14T11:12:21.980499+0000","last_unstale":"2023-10-14T11:12:27.264602+0000","last_undegraded":"2023-10-14T11:12:27.264602+0000","last_fullsized":"2023-10-14T11:12:27.264602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:01.323224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.387968+0000","last_change":"2023-10-14T11:12:27.273604+0000","last_active":"2023-10-14T11:12:28.387968+0000","last_peered":"2023-10-14T11:12:28.387968+0000","last_clean":"2023-10-14T11:12:28.387968+0000","last_became_active":"2023-10-14T11:12:27.273160+0000","last_became_peered":"2023-10-14T11:12:27.273160+0000","last_unstale":"2023-10-14T11:12:28.387968+0000","last_undegraded":"2023-10-14T11:12:28.387968+0000","last_fullsized":"2023-10-14T11:12:28.387968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:28.979894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.999882+0000","last_change":"2023-10-14T11:12:22.983334+0000","last_active":"2023-10-14T11:12:26.999882+0000","last_peered":"2023-10-14T11:12:26.999882+0000","last_clean":"2023-10-14T11:12:26.999882+0000","last_became_active":"2023-10-14T11:12:22.981836+0000","last_became_peered":"2023-10-14T11:12:22.981836+0000","last_unstale":"2023-10-14T11:12:26.999882+0000","last_undegraded":"2023-10-14T11:12:26.999882+0000","last_fullsized":"2023-10-14T11:12:26.999882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:17.701734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988703+0000","last_change":"2023-10-14T11:12:21.968246+0000","last_active":"2023-10-14T11:12:26.988703+0000","last_peered":"2023-10-14T11:12:26.988703+0000","last_clean":"2023-10-14T11:12:26.988703+0000","last_became_active":"2023-10-14T11:12:21.967758+0000","last_became_peered":"2023-10-14T11:12:21.967758+0000","last_unstale":"2023-10-14T11:12:26.988703+0000","last_undegraded":"2023-10-14T11:12:26.988703+0000","last_fullsized":"2023-10-14T11:12:26.988703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:23.226723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264683+0000","last_change":"2023-10-14T11:12:12.162289+0000","last_active":"2023-10-14T11:12:27.264683+0000","last_peered":"2023-10-14T11:12:27.264683+0000","last_clean":"2023-10-14T11:12:27.264683+0000","last_became_active":"2023-10-14T11:12:12.161055+0000","last_became_peered":"2023-10-14T11:12:12.161055+0000","last_unstale":"2023-10-14T11:12:27.264683+0000","last_undegraded":"2023-10-14T11:12:27.264683+0000","last_fullsized":"2023-10-14T11:12:27.264683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_clean_scrub_stamp":"2023-10-14T11:12:10.853576+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:52.154107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.051902+0000","last_change":"2023-10-14T11:12:27.270500+0000","last_active":"2023-10-14T11:12:29.051902+0000","last_peered":"2023-10-14T11:12:29.051902+0000","last_clean":"2023-10-14T11:12:29.051902+0000","last_became_active":"2023-10-14T11:12:27.270051+0000","last_became_peered":"2023-10-14T11:12:27.270051+0000","last_unstale":"2023-10-14T11:12:29.051902+0000","last_undegraded":"2023-10-14T11:12:29.051902+0000","last_fullsized":"2023-10-14T11:12:29.051902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:19.221087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265306+0000","last_change":"2023-10-14T11:12:22.987192+0000","last_active":"2023-10-14T11:12:27.265306+0000","last_peered":"2023-10-14T11:12:27.265306+0000","last_clean":"2023-10-14T11:12:27.265306+0000","last_became_active":"2023-10-14T11:12:22.986270+0000","last_became_peered":"2023-10-14T11:12:22.986270+0000","last_unstale":"2023-10-14T11:12:27.265306+0000","last_undegraded":"2023-10-14T11:12:27.265306+0000","last_fullsized":"2023-10-14T11:12:27.265306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:03.512378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988910+0000","last_change":"2023-10-14T11:12:21.977756+0000","last_active":"2023-10-14T11:12:26.988910+0000","last_peered":"2023-10-14T11:12:26.988910+0000","last_clean":"2023-10-14T11:12:26.988910+0000","last_became_active":"2023-10-14T11:12:21.976702+0000","last_became_peered":"2023-10-14T11:12:21.976702+0000","last_unstale":"2023-10-14T11:12:26.988910+0000","last_undegraded":"2023-10-14T11:12:26.988910+0000","last_fullsized":"2023-10-14T11:12:26.988910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:51.562205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.051590+0000","last_change":"2023-10-14T11:12:27.266768+0000","last_active":"2023-10-14T11:12:29.051590+0000","last_peered":"2023-10-14T11:12:29.051590+0000","last_clean":"2023-10-14T11:12:29.051590+0000","last_became_active":"2023-10-14T11:12:27.266293+0000","last_became_peered":"2023-10-14T11:12:27.266293+0000","last_unstale":"2023-10-14T11:12:29.051590+0000","last_undegraded":"2023-10-14T11:12:29.051590+0000","last_fullsized":"2023-10-14T11:12:29.051590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:23.589522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990099+0000","last_change":"2023-10-14T11:12:22.971787+0000","last_active":"2023-10-14T11:12:26.990099+0000","last_peered":"2023-10-14T11:12:26.990099+0000","last_clean":"2023-10-14T11:12:26.990099+0000","last_became_active":"2023-10-14T11:12:22.971485+0000","last_became_peered":"2023-10-14T11:12:22.971485+0000","last_unstale":"2023-10-14T11:12:26.990099+0000","last_undegraded":"2023-10-14T11:12:26.990099+0000","last_fullsized":"2023-10-14T11:12:26.990099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:32.409154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010620+0000","last_change":"2023-10-14T11:12:21.980821+0000","last_active":"2023-10-14T11:12:27.010620+0000","last_peered":"2023-10-14T11:12:27.010620+0000","last_clean":"2023-10-14T11:12:27.010620+0000","last_became_active":"2023-10-14T11:12:21.980483+0000","last_became_peered":"2023-10-14T11:12:21.980483+0000","last_unstale":"2023-10-14T11:12:27.010620+0000","last_undegraded":"2023-10-14T11:12:27.010620+0000","last_fullsized":"2023-10-14T11:12:27.010620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:37.017137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.387892+0000","last_change":"2023-10-14T11:12:27.026598+0000","last_active":"2023-10-14T11:12:28.387892+0000","last_peered":"2023-10-14T11:12:28.387892+0000","last_clean":"2023-10-14T11:12:28.387892+0000","last_became_active":"2023-10-14T11:12:27.026041+0000","last_became_peered":"2023-10-14T11:12:27.026041+0000","last_unstale":"2023-10-14T11:12:28.387892+0000","last_undegraded":"2023-10-14T11:12:28.387892+0000","last_fullsized":"2023-10-14T11:12:28.387892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:07.549080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265979+0000","last_change":"2023-10-14T11:12:22.999134+0000","last_active":"2023-10-14T11:12:27.265979+0000","last_peered":"2023-10-14T11:12:27.265979+0000","last_clean":"2023-10-14T11:12:27.265979+0000","last_became_active":"2023-10-14T11:12:22.998882+0000","last_became_peered":"2023-10-14T11:12:22.998882+0000","last_unstale":"2023-10-14T11:12:27.265979+0000","last_undegraded":"2023-10-14T11:12:27.265979+0000","last_fullsized":"2023-10-14T11:12:27.265979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:48:29.403505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988956+0000","last_change":"2023-10-14T11:12:21.975400+0000","last_active":"2023-10-14T11:12:26.988956+0000","last_peered":"2023-10-14T11:12:26.988956+0000","last_clean":"2023-10-14T11:12:26.988956+0000","last_became_active":"2023-10-14T11:12:21.974763+0000","last_became_peered":"2023-10-14T11:12:21.974763+0000","last_unstale":"2023-10-14T11:12:26.988956+0000","last_undegraded":"2023-10-14T11:12:26.988956+0000","last_fullsized":"2023-10-14T11:12:26.988956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:10:00.086669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.991862+0000","last_change":"2023-10-14T11:12:27.270370+0000","last_active":"2023-10-14T11:12:27.991862+0000","last_peered":"2023-10-14T11:12:27.991862+0000","last_clean":"2023-10-14T11:12:27.991862+0000","last_became_active":"2023-10-14T11:12:27.269897+0000","last_became_peered":"2023-10-14T11:12:27.269897+0000","last_unstale":"2023-10-14T11:12:27.991862+0000","last_undegraded":"2023-10-14T11:12:27.991862+0000","last_fullsized":"2023-10-14T11:12:27.991862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:47.514617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265595+0000","last_change":"2023-10-14T11:12:22.999066+0000","last_active":"2023-10-14T11:12:27.265595+0000","last_peered":"2023-10-14T11:12:27.265595+0000","last_clean":"2023-10-14T11:12:27.265595+0000","last_became_active":"2023-10-14T11:12:22.998776+0000","last_became_peered":"2023-10-14T11:12:22.998776+0000","last_unstale":"2023-10-14T11:12:27.265595+0000","last_undegraded":"2023-10-14T11:12:27.265595+0000","last_fullsized":"2023-10-14T11:12:27.265595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:24.943192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.001153+0000","last_change":"2023-10-14T11:12:21.964558+0000","last_active":"2023-10-14T11:12:27.001153+0000","last_peered":"2023-10-14T11:12:27.001153+0000","last_clean":"2023-10-14T11:12:27.001153+0000","last_became_active":"2023-10-14T11:12:21.964064+0000","last_became_peered":"2023-10-14T11:12:21.964064+0000","last_unstale":"2023-10-14T11:12:27.001153+0000","last_undegraded":"2023-10-14T11:12:27.001153+0000","last_fullsized":"2023-10-14T11:12:27.001153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:10:00.086669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992867+0000","last_change":"2023-10-14T11:12:27.018556+0000","last_active":"2023-10-14T11:12:27.992867+0000","last_peered":"2023-10-14T11:12:27.992867+0000","last_clean":"2023-10-14T11:12:27.992867+0000","last_became_active":"2023-10-14T11:12:27.017714+0000","last_became_peered":"2023-10-14T11:12:27.017714+0000","last_unstale":"2023-10-14T11:12:27.992867+0000","last_undegraded":"2023-10-14T11:12:27.992867+0000","last_fullsized":"2023-10-14T11:12:27.992867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:23.718575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264735+0000","last_change":"2023-10-14T11:12:22.994290+0000","last_active":"2023-10-14T11:12:27.264735+0000","last_peered":"2023-10-14T11:12:27.264735+0000","last_clean":"2023-10-14T11:12:27.264735+0000","last_became_active":"2023-10-14T11:12:22.993935+0000","last_became_peered":"2023-10-14T11:12:22.993935+0000","last_unstale":"2023-10-14T11:12:27.264735+0000","last_undegraded":"2023-10-14T11:12:27.264735+0000","last_fullsized":"2023-10-14T11:12:27.264735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:54.432400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988665+0000","last_change":"2023-10-14T11:12:21.976195+0000","last_active":"2023-10-14T11:12:26.988665+0000","last_peered":"2023-10-14T11:12:26.988665+0000","last_clean":"2023-10-14T11:12:26.988665+0000","last_became_active":"2023-10-14T11:12:21.975885+0000","last_became_peered":"2023-10-14T11:12:21.975885+0000","last_unstale":"2023-10-14T11:12:26.988665+0000","last_undegraded":"2023-10-14T11:12:26.988665+0000","last_fullsized":"2023-10-14T11:12:26.988665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:11:08.840029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.387881+0000","last_change":"2023-10-14T11:12:27.016759+0000","last_active":"2023-10-14T11:12:28.387881+0000","last_peered":"2023-10-14T11:12:28.387881+0000","last_clean":"2023-10-14T11:12:28.387881+0000","last_became_active":"2023-10-14T11:12:27.016334+0000","last_became_peered":"2023-10-14T11:12:27.016334+0000","last_unstale":"2023-10-14T11:12:28.387881+0000","last_undegraded":"2023-10-14T11:12:28.387881+0000","last_fullsized":"2023-10-14T11:12:28.387881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:58.469102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990942+0000","last_change":"2023-10-14T11:12:22.972397+0000","last_active":"2023-10-14T11:12:26.990942+0000","last_peered":"2023-10-14T11:12:26.990942+0000","last_clean":"2023-10-14T11:12:26.990942+0000","last_became_active":"2023-10-14T11:12:22.972093+0000","last_became_peered":"2023-10-14T11:12:22.972093+0000","last_unstale":"2023-10-14T11:12:26.990942+0000","last_undegraded":"2023-10-14T11:12:26.990942+0000","last_fullsized":"2023-10-14T11:12:26.990942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:27.066313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.991065+0000","last_change":"2023-10-14T11:12:21.976321+0000","last_active":"2023-10-14T11:12:26.991065+0000","last_peered":"2023-10-14T11:12:26.991065+0000","last_clean":"2023-10-14T11:12:26.991065+0000","last_became_active":"2023-10-14T11:12:21.975848+0000","last_became_peered":"2023-10-14T11:12:21.975848+0000","last_unstale":"2023-10-14T11:12:26.991065+0000","last_undegraded":"2023-10-14T11:12:26.991065+0000","last_fullsized":"2023-10-14T11:12:26.991065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:31:07.362240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993559+0000","last_change":"2023-10-14T11:12:27.271736+0000","last_active":"2023-10-14T11:12:27.993559+0000","last_peered":"2023-10-14T11:12:27.993559+0000","last_clean":"2023-10-14T11:12:27.993559+0000","last_became_active":"2023-10-14T11:12:27.271274+0000","last_became_peered":"2023-10-14T11:12:27.271274+0000","last_unstale":"2023-10-14T11:12:27.993559+0000","last_undegraded":"2023-10-14T11:12:27.993559+0000","last_fullsized":"2023-10-14T11:12:27.993559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:34.380738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265050+0000","last_change":"2023-10-14T11:12:22.995743+0000","last_active":"2023-10-14T11:12:27.265050+0000","last_peered":"2023-10-14T11:12:27.265050+0000","last_clean":"2023-10-14T11:12:27.265050+0000","last_became_active":"2023-10-14T11:12:22.995464+0000","last_became_peered":"2023-10-14T11:12:22.995464+0000","last_unstale":"2023-10-14T11:12:27.265050+0000","last_undegraded":"2023-10-14T11:12:27.265050+0000","last_fullsized":"2023-10-14T11:12:27.265050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:19.552820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988900+0000","last_change":"2023-10-14T11:12:21.976206+0000","last_active":"2023-10-14T11:12:26.988900+0000","last_peered":"2023-10-14T11:12:26.988900+0000","last_clean":"2023-10-14T11:12:26.988900+0000","last_became_active":"2023-10-14T11:12:21.975934+0000","last_became_peered":"2023-10-14T11:12:21.975934+0000","last_unstale":"2023-10-14T11:12:26.988900+0000","last_undegraded":"2023-10-14T11:12:26.988900+0000","last_fullsized":"2023-10-14T11:12:26.988900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:16.694694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993189+0000","last_change":"2023-10-14T11:12:27.268251+0000","last_active":"2023-10-14T11:12:27.993189+0000","last_peered":"2023-10-14T11:12:27.993189+0000","last_clean":"2023-10-14T11:12:27.993189+0000","last_became_active":"2023-10-14T11:12:27.267788+0000","last_became_peered":"2023-10-14T11:12:27.267788+0000","last_unstale":"2023-10-14T11:12:27.993189+0000","last_undegraded":"2023-10-14T11:12:27.993189+0000","last_fullsized":"2023-10-14T11:12:27.993189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:00:07.198517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.007533+0000","last_change":"2023-10-14T11:12:22.987370+0000","last_active":"2023-10-14T11:12:27.007533+0000","last_peered":"2023-10-14T11:12:27.007533+0000","last_clean":"2023-10-14T11:12:27.007533+0000","last_became_active":"2023-10-14T11:12:22.987096+0000","last_became_peered":"2023-10-14T11:12:22.987096+0000","last_unstale":"2023-10-14T11:12:27.007533+0000","last_undegraded":"2023-10-14T11:12:27.007533+0000","last_fullsized":"2023-10-14T11:12:27.007533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:34.354835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010769+0000","last_change":"2023-10-14T11:12:21.964329+0000","last_active":"2023-10-14T11:12:27.010769+0000","last_peered":"2023-10-14T11:12:27.010769+0000","last_clean":"2023-10-14T11:12:27.010769+0000","last_became_active":"2023-10-14T11:12:21.963491+0000","last_became_peered":"2023-10-14T11:12:21.963491+0000","last_unstale":"2023-10-14T11:12:27.010769+0000","last_undegraded":"2023-10-14T11:12:27.010769+0000","last_fullsized":"2023-10-14T11:12:27.010769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:37.017137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993765+0000","last_change":"2023-10-14T11:12:27.267716+0000","last_active":"2023-10-14T11:12:27.993765+0000","last_peered":"2023-10-14T11:12:27.993765+0000","last_clean":"2023-10-14T11:12:27.993765+0000","last_became_active":"2023-10-14T11:12:27.267311+0000","last_became_peered":"2023-10-14T11:12:27.267311+0000","last_unstale":"2023-10-14T11:12:27.993765+0000","last_undegraded":"2023-10-14T11:12:27.993765+0000","last_fullsized":"2023-10-14T11:12:27.993765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:19:12.033636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265215+0000","last_change":"2023-10-14T11:12:22.987373+0000","last_active":"2023-10-14T11:12:27.265215+0000","last_peered":"2023-10-14T11:12:27.265215+0000","last_clean":"2023-10-14T11:12:27.265215+0000","last_became_active":"2023-10-14T11:12:22.986837+0000","last_became_peered":"2023-10-14T11:12:22.986837+0000","last_unstale":"2023-10-14T11:12:27.265215+0000","last_undegraded":"2023-10-14T11:12:27.265215+0000","last_fullsized":"2023-10-14T11:12:27.265215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:15.184385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:38.498227+0000","last_change":"2023-10-14T11:12:21.976712+0000","last_active":"2023-10-14T11:12:38.498227+0000","last_peered":"2023-10-14T11:12:38.498227+0000","last_clean":"2023-10-14T11:12:38.498227+0000","last_became_active":"2023-10-14T11:12:21.975439+0000","last_became_peered":"2023-10-14T11:12:21.975439+0000","last_unstale":"2023-10-14T11:12:38.498227+0000","last_undegraded":"2023-10-14T11:12:38.498227+0000","last_fullsized":"2023-10-14T11:12:38.498227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:37.017137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.052976+0000","last_change":"2023-10-14T11:12:27.018600+0000","last_active":"2023-10-14T11:12:29.052976+0000","last_peered":"2023-10-14T11:12:29.052976+0000","last_clean":"2023-10-14T11:12:29.052976+0000","last_became_active":"2023-10-14T11:12:27.018091+0000","last_became_peered":"2023-10-14T11:12:27.018091+0000","last_unstale":"2023-10-14T11:12:29.052976+0000","last_undegraded":"2023-10-14T11:12:29.052976+0000","last_fullsized":"2023-10-14T11:12:29.052976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:19.221087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.999245+0000","last_change":"2023-10-14T11:12:22.989506+0000","last_active":"2023-10-14T11:12:26.999245+0000","last_peered":"2023-10-14T11:12:26.999245+0000","last_clean":"2023-10-14T11:12:26.999245+0000","last_became_active":"2023-10-14T11:12:22.989177+0000","last_became_peered":"2023-10-14T11:12:22.989177+0000","last_unstale":"2023-10-14T11:12:26.999245+0000","last_undegraded":"2023-10-14T11:12:26.999245+0000","last_fullsized":"2023-10-14T11:12:26.999245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:02.330265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010526+0000","last_change":"2023-10-14T11:12:21.980802+0000","last_active":"2023-10-14T11:12:27.010526+0000","last_peered":"2023-10-14T11:12:27.010526+0000","last_clean":"2023-10-14T11:12:27.010526+0000","last_became_active":"2023-10-14T11:12:21.980604+0000","last_became_peered":"2023-10-14T11:12:21.980604+0000","last_unstale":"2023-10-14T11:12:27.010526+0000","last_undegraded":"2023-10-14T11:12:27.010526+0000","last_fullsized":"2023-10-14T11:12:27.010526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:01.323224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992999+0000","last_change":"2023-10-14T11:12:27.018243+0000","last_active":"2023-10-14T11:12:27.992999+0000","last_peered":"2023-10-14T11:12:27.992999+0000","last_clean":"2023-10-14T11:12:27.992999+0000","last_became_active":"2023-10-14T11:12:27.017731+0000","last_became_peered":"2023-10-14T11:12:27.017731+0000","last_unstale":"2023-10-14T11:12:27.992999+0000","last_undegraded":"2023-10-14T11:12:27.992999+0000","last_fullsized":"2023-10-14T11:12:27.992999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:50.570179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.011824+0000","last_change":"2023-10-14T11:12:22.985657+0000","last_active":"2023-10-14T11:12:27.011824+0000","last_peered":"2023-10-14T11:12:27.011824+0000","last_clean":"2023-10-14T11:12:27.011824+0000","last_became_active":"2023-10-14T11:12:22.984323+0000","last_became_peered":"2023-10-14T11:12:22.984323+0000","last_unstale":"2023-10-14T11:12:27.011824+0000","last_undegraded":"2023-10-14T11:12:27.011824+0000","last_fullsized":"2023-10-14T11:12:27.011824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:17.701734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990340+0000","last_change":"2023-10-14T11:12:21.973531+0000","last_active":"2023-10-14T11:12:26.990340+0000","last_peered":"2023-10-14T11:12:26.990340+0000","last_clean":"2023-10-14T11:12:26.990340+0000","last_became_active":"2023-10-14T11:12:21.973256+0000","last_became_peered":"2023-10-14T11:12:21.973256+0000","last_unstale":"2023-10-14T11:12:26.990340+0000","last_undegraded":"2023-10-14T11:12:26.990340+0000","last_fullsized":"2023-10-14T11:12:26.990340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:18.236450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992367+0000","last_change":"2023-10-14T11:12:27.027134+0000","last_active":"2023-10-14T11:12:27.992367+0000","last_peered":"2023-10-14T11:12:27.992367+0000","last_clean":"2023-10-14T11:12:27.992367+0000","last_became_active":"2023-10-14T11:12:27.026437+0000","last_became_peered":"2023-10-14T11:12:27.026437+0000","last_unstale":"2023-10-14T11:12:27.992367+0000","last_undegraded":"2023-10-14T11:12:27.992367+0000","last_fullsized":"2023-10-14T11:12:27.992367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:19:12.033636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990233+0000","last_change":"2023-10-14T11:12:22.993432+0000","last_active":"2023-10-14T11:12:26.990233+0000","last_peered":"2023-10-14T11:12:26.990233+0000","last_clean":"2023-10-14T11:12:26.990233+0000","last_became_active":"2023-10-14T11:12:22.993082+0000","last_became_peered":"2023-10-14T11:12:22.993082+0000","last_unstale":"2023-10-14T11:12:26.990233+0000","last_undegraded":"2023-10-14T11:12:26.990233+0000","last_fullsized":"2023-10-14T11:12:26.990233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:19.552820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.992391+0000","last_change":"2023-10-14T11:12:21.982821+0000","last_active":"2023-10-14T11:12:26.992391+0000","last_peered":"2023-10-14T11:12:26.992391+0000","last_clean":"2023-10-14T11:12:26.992391+0000","last_became_active":"2023-10-14T11:12:21.982328+0000","last_became_peered":"2023-10-14T11:12:21.982328+0000","last_unstale":"2023-10-14T11:12:26.992391+0000","last_undegraded":"2023-10-14T11:12:26.992391+0000","last_fullsized":"2023-10-14T11:12:26.992391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:40:43.612359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992497+0000","last_change":"2023-10-14T11:12:27.268498+0000","last_active":"2023-10-14T11:12:27.992497+0000","last_peered":"2023-10-14T11:12:27.992497+0000","last_clean":"2023-10-14T11:12:27.992497+0000","last_became_active":"2023-10-14T11:12:27.267751+0000","last_became_peered":"2023-10-14T11:12:27.267751+0000","last_unstale":"2023-10-14T11:12:27.992497+0000","last_undegraded":"2023-10-14T11:12:27.992497+0000","last_fullsized":"2023-10-14T11:12:27.992497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:53.991279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.387797+0000","last_change":"2023-10-14T11:12:27.274997+0000","last_active":"2023-10-14T11:12:28.387797+0000","last_peered":"2023-10-14T11:12:28.387797+0000","last_clean":"2023-10-14T11:12:28.387797+0000","last_became_active":"2023-10-14T11:12:27.273447+0000","last_became_peered":"2023-10-14T11:12:27.273447+0000","last_unstale":"2023-10-14T11:12:28.387797+0000","last_undegraded":"2023-10-14T11:12:28.387797+0000","last_fullsized":"2023-10-14T11:12:28.387797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:19.221087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000217+0000","last_change":"2023-10-14T11:12:22.965644+0000","last_active":"2023-10-14T11:12:27.000217+0000","last_peered":"2023-10-14T11:12:27.000217+0000","last_clean":"2023-10-14T11:12:27.000217+0000","last_became_active":"2023-10-14T11:12:22.965113+0000","last_became_peered":"2023-10-14T11:12:22.965113+0000","last_unstale":"2023-10-14T11:12:27.000217+0000","last_undegraded":"2023-10-14T11:12:27.000217+0000","last_fullsized":"2023-10-14T11:12:27.000217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:02:49.769267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.989018+0000","last_change":"2023-10-14T11:12:21.972862+0000","last_active":"2023-10-14T11:12:26.989018+0000","last_peered":"2023-10-14T11:12:26.989018+0000","last_clean":"2023-10-14T11:12:26.989018+0000","last_became_active":"2023-10-14T11:12:21.971652+0000","last_became_peered":"2023-10-14T11:12:21.971652+0000","last_unstale":"2023-10-14T11:12:26.989018+0000","last_undegraded":"2023-10-14T11:12:26.989018+0000","last_fullsized":"2023-10-14T11:12:26.989018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:37.017137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.051905+0000","last_change":"2023-10-14T11:12:27.024091+0000","last_active":"2023-10-14T11:12:29.051905+0000","last_peered":"2023-10-14T11:12:29.051905+0000","last_clean":"2023-10-14T11:12:29.051905+0000","last_became_active":"2023-10-14T11:12:27.023591+0000","last_became_peered":"2023-10-14T11:12:27.023591+0000","last_unstale":"2023-10-14T11:12:29.051905+0000","last_undegraded":"2023-10-14T11:12:29.051905+0000","last_fullsized":"2023-10-14T11:12:29.051905+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:58.469102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.995932+0000","last_change":"2023-10-14T11:12:22.976553+0000","last_active":"2023-10-14T11:12:26.995932+0000","last_peered":"2023-10-14T11:12:26.995932+0000","last_clean":"2023-10-14T11:12:26.995932+0000","last_became_active":"2023-10-14T11:12:22.976280+0000","last_became_peered":"2023-10-14T11:12:22.976280+0000","last_unstale":"2023-10-14T11:12:26.995932+0000","last_undegraded":"2023-10-14T11:12:26.995932+0000","last_fullsized":"2023-10-14T11:12:26.995932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:02:49.769267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.995666+0000","last_change":"2023-10-14T11:12:21.971386+0000","last_active":"2023-10-14T11:12:26.995666+0000","last_peered":"2023-10-14T11:12:26.995666+0000","last_clean":"2023-10-14T11:12:26.995666+0000","last_became_active":"2023-10-14T11:12:21.971087+0000","last_became_peered":"2023-10-14T11:12:21.971087+0000","last_unstale":"2023-10-14T11:12:26.995666+0000","last_undegraded":"2023-10-14T11:12:26.995666+0000","last_fullsized":"2023-10-14T11:12:26.995666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:40:43.612359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.992534+0000","last_change":"2023-10-14T11:12:21.975576+0000","last_active":"2023-10-14T11:12:26.992534+0000","last_peered":"2023-10-14T11:12:26.992534+0000","last_clean":"2023-10-14T11:12:26.992534+0000","last_became_active":"2023-10-14T11:12:21.975207+0000","last_became_peered":"2023-10-14T11:12:21.975207+0000","last_unstale":"2023-10-14T11:12:26.992534+0000","last_undegraded":"2023-10-14T11:12:26.992534+0000","last_fullsized":"2023-10-14T11:12:26.992534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:01.323224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010668+0000","last_change":"2023-10-14T11:12:22.992785+0000","last_active":"2023-10-14T11:12:27.010668+0000","last_peered":"2023-10-14T11:12:27.010668+0000","last_clean":"2023-10-14T11:12:27.010668+0000","last_became_active":"2023-10-14T11:12:22.992508+0000","last_became_peered":"2023-10-14T11:12:22.992508+0000","last_unstale":"2023-10-14T11:12:27.010668+0000","last_undegraded":"2023-10-14T11:12:27.010668+0000","last_fullsized":"2023-10-14T11:12:27.010668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:07:23.864178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.702964+0000","last_change":"2023-10-14T11:12:27.023027+0000","last_active":"2023-10-14T11:12:28.702964+0000","last_peered":"2023-10-14T11:12:28.702964+0000","last_clean":"2023-10-14T11:12:28.702964+0000","last_became_active":"2023-10-14T11:12:27.020646+0000","last_became_peered":"2023-10-14T11:12:27.020646+0000","last_unstale":"2023-10-14T11:12:28.702964+0000","last_undegraded":"2023-10-14T11:12:28.702964+0000","last_fullsized":"2023-10-14T11:12:28.702964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:40:48.656102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.998432+0000","last_change":"2023-10-14T11:12:21.976762+0000","last_active":"2023-10-14T11:12:26.998432+0000","last_peered":"2023-10-14T11:12:26.998432+0000","last_clean":"2023-10-14T11:12:26.998432+0000","last_became_active":"2023-10-14T11:12:21.976437+0000","last_became_peered":"2023-10-14T11:12:21.976437+0000","last_unstale":"2023-10-14T11:12:26.998432+0000","last_undegraded":"2023-10-14T11:12:26.998432+0000","last_fullsized":"2023-10-14T11:12:26.998432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:31:07.362240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.997365+0000","last_change":"2023-10-14T11:12:22.960803+0000","last_active":"2023-10-14T11:12:26.997365+0000","last_peered":"2023-10-14T11:12:26.997365+0000","last_clean":"2023-10-14T11:12:26.997365+0000","last_became_active":"2023-10-14T11:12:22.960504+0000","last_became_peered":"2023-10-14T11:12:22.960504+0000","last_unstale":"2023-10-14T11:12:26.997365+0000","last_undegraded":"2023-10-14T11:12:26.997365+0000","last_fullsized":"2023-10-14T11:12:26.997365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:24.233763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993298+0000","last_change":"2023-10-14T11:12:27.016102+0000","last_active":"2023-10-14T11:12:27.993298+0000","last_peered":"2023-10-14T11:12:27.993298+0000","last_clean":"2023-10-14T11:12:27.993298+0000","last_became_active":"2023-10-14T11:12:27.015599+0000","last_became_peered":"2023-10-14T11:12:27.015599+0000","last_unstale":"2023-10-14T11:12:27.993298+0000","last_undegraded":"2023-10-14T11:12:27.993298+0000","last_fullsized":"2023-10-14T11:12:27.993298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:04:28.117008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988221+0000","last_change":"2023-10-14T11:12:22.974947+0000","last_active":"2023-10-14T11:12:26.988221+0000","last_peered":"2023-10-14T11:12:26.988221+0000","last_clean":"2023-10-14T11:12:26.988221+0000","last_became_active":"2023-10-14T11:12:22.974647+0000","last_became_peered":"2023-10-14T11:12:22.974647+0000","last_unstale":"2023-10-14T11:12:26.988221+0000","last_undegraded":"2023-10-14T11:12:26.988221+0000","last_fullsized":"2023-10-14T11:12:26.988221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:02:49.769267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988737+0000","last_change":"2023-10-14T11:12:22.987590+0000","last_active":"2023-10-14T11:12:26.988737+0000","last_peered":"2023-10-14T11:12:26.988737+0000","last_clean":"2023-10-14T11:12:26.988737+0000","last_became_active":"2023-10-14T11:12:22.985815+0000","last_became_peered":"2023-10-14T11:12:22.985815+0000","last_unstale":"2023-10-14T11:12:26.988737+0000","last_undegraded":"2023-10-14T11:12:26.988737+0000","last_fullsized":"2023-10-14T11:12:26.988737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:24.233763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988803+0000","last_change":"2023-10-14T11:12:22.971785+0000","last_active":"2023-10-14T11:12:26.988803+0000","last_peered":"2023-10-14T11:12:26.988803+0000","last_clean":"2023-10-14T11:12:26.988803+0000","last_became_active":"2023-10-14T11:12:22.971415+0000","last_became_peered":"2023-10-14T11:12:22.971415+0000","last_unstale":"2023-10-14T11:12:26.988803+0000","last_undegraded":"2023-10-14T11:12:26.988803+0000","last_fullsized":"2023-10-14T11:12:26.988803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:54.432400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010852+0000","last_change":"2023-10-14T11:12:22.981024+0000","last_active":"2023-10-14T11:12:27.010852+0000","last_peered":"2023-10-14T11:12:27.010852+0000","last_clean":"2023-10-14T11:12:27.010852+0000","last_became_active":"2023-10-14T11:12:22.977993+0000","last_became_peered":"2023-10-14T11:12:22.977993+0000","last_unstale":"2023-10-14T11:12:27.010852+0000","last_undegraded":"2023-10-14T11:12:27.010852+0000","last_fullsized":"2023-10-14T11:12:27.010852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:31:08.369281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.999570+0000","last_change":"2023-10-14T11:12:22.969832+0000","last_active":"2023-10-14T11:12:26.999570+0000","last_peered":"2023-10-14T11:12:26.999570+0000","last_clean":"2023-10-14T11:12:26.999570+0000","last_became_active":"2023-10-14T11:12:22.969627+0000","last_became_peered":"2023-10-14T11:12:22.969627+0000","last_unstale":"2023-10-14T11:12:26.999570+0000","last_undegraded":"2023-10-14T11:12:26.999570+0000","last_fullsized":"2023-10-14T11:12:26.999570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:52:38.018829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010439+0000","last_change":"2023-10-14T11:12:22.966311+0000","last_active":"2023-10-14T11:12:27.010439+0000","last_peered":"2023-10-14T11:12:27.010439+0000","last_clean":"2023-10-14T11:12:27.010439+0000","last_became_active":"2023-10-14T11:12:22.965987+0000","last_became_peered":"2023-10-14T11:12:22.965987+0000","last_unstale":"2023-10-14T11:12:27.010439+0000","last_undegraded":"2023-10-14T11:12:27.010439+0000","last_fullsized":"2023-10-14T11:12:27.010439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:27.066313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.991696+0000","last_change":"2023-10-14T11:12:22.992696+0000","last_active":"2023-10-14T11:12:26.991696+0000","last_peered":"2023-10-14T11:12:26.991696+0000","last_clean":"2023-10-14T11:12:26.991696+0000","last_became_active":"2023-10-14T11:12:22.991959+0000","last_became_peered":"2023-10-14T11:12:22.991959+0000","last_unstale":"2023-10-14T11:12:26.991696+0000","last_undegraded":"2023-10-14T11:12:26.991696+0000","last_fullsized":"2023-10-14T11:12:26.991696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:52:38.018829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000914+0000","last_change":"2023-10-14T11:12:22.984405+0000","last_active":"2023-10-14T11:12:27.000914+0000","last_peered":"2023-10-14T11:12:27.000914+0000","last_clean":"2023-10-14T11:12:27.000914+0000","last_became_active":"2023-10-14T11:12:22.978369+0000","last_became_peered":"2023-10-14T11:12:22.978369+0000","last_unstale":"2023-10-14T11:12:27.000914+0000","last_undegraded":"2023-10-14T11:12:27.000914+0000","last_fullsized":"2023-10-14T11:12:27.000914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:19.681873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988858+0000","last_change":"2023-10-14T11:12:22.969040+0000","last_active":"2023-10-14T11:12:26.988858+0000","last_peered":"2023-10-14T11:12:26.988858+0000","last_clean":"2023-10-14T11:12:26.988858+0000","last_became_active":"2023-10-14T11:12:22.968583+0000","last_became_peered":"2023-10-14T11:12:22.968583+0000","last_unstale":"2023-10-14T11:12:26.988858+0000","last_undegraded":"2023-10-14T11:12:26.988858+0000","last_fullsized":"2023-10-14T11:12:26.988858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:38.252309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.995566+0000","last_change":"2023-10-14T11:12:22.966174+0000","last_active":"2023-10-14T11:12:26.995566+0000","last_peered":"2023-10-14T11:12:26.995566+0000","last_clean":"2023-10-14T11:12:26.995566+0000","last_became_active":"2023-10-14T11:12:22.965570+0000","last_became_peered":"2023-10-14T11:12:22.965570+0000","last_unstale":"2023-10-14T11:12:26.995566+0000","last_undegraded":"2023-10-14T11:12:26.995566+0000","last_fullsized":"2023-10-14T11:12:26.995566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:19.243490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988714+0000","last_change":"2023-10-14T11:12:22.982352+0000","last_active":"2023-10-14T11:12:26.988714+0000","last_peered":"2023-10-14T11:12:26.988714+0000","last_clean":"2023-10-14T11:12:26.988714+0000","last_became_active":"2023-10-14T11:12:22.982026+0000","last_became_peered":"2023-10-14T11:12:22.982026+0000","last_unstale":"2023-10-14T11:12:26.988714+0000","last_undegraded":"2023-10-14T11:12:26.988714+0000","last_fullsized":"2023-10-14T11:12:26.988714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:19.681873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010463+0000","last_change":"2023-10-14T11:12:22.989236+0000","last_active":"2023-10-14T11:12:27.010463+0000","last_peered":"2023-10-14T11:12:27.010463+0000","last_clean":"2023-10-14T11:12:27.010463+0000","last_became_active":"2023-10-14T11:12:22.988644+0000","last_became_peered":"2023-10-14T11:12:22.988644+0000","last_unstale":"2023-10-14T11:12:27.010463+0000","last_undegraded":"2023-10-14T11:12:27.010463+0000","last_fullsized":"2023-10-14T11:12:27.010463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:40:44.619400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.991230+0000","last_change":"2023-10-14T11:12:22.983434+0000","last_active":"2023-10-14T11:12:26.991230+0000","last_peered":"2023-10-14T11:12:26.991230+0000","last_clean":"2023-10-14T11:12:26.991230+0000","last_became_active":"2023-10-14T11:12:22.982702+0000","last_became_peered":"2023-10-14T11:12:22.982702+0000","last_unstale":"2023-10-14T11:12:26.991230+0000","last_undegraded":"2023-10-14T11:12:26.991230+0000","last_fullsized":"2023-10-14T11:12:26.991230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:19.243490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265404+0000","last_change":"2023-10-14T11:12:22.985280+0000","last_active":"2023-10-14T11:12:27.265404+0000","last_peered":"2023-10-14T11:12:27.265404+0000","last_clean":"2023-10-14T11:12:27.265404+0000","last_became_active":"2023-10-14T11:12:22.984745+0000","last_became_peered":"2023-10-14T11:12:22.984745+0000","last_unstale":"2023-10-14T11:12:27.265404+0000","last_undegraded":"2023-10-14T11:12:27.265404+0000","last_fullsized":"2023-10-14T11:12:27.265404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:32.409154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988912+0000","last_change":"2023-10-14T11:12:22.996375+0000","last_active":"2023-10-14T11:12:26.988912+0000","last_peered":"2023-10-14T11:12:26.988912+0000","last_clean":"2023-10-14T11:12:26.988912+0000","last_became_active":"2023-10-14T11:12:22.995986+0000","last_became_peered":"2023-10-14T11:12:22.995986+0000","last_unstale":"2023-10-14T11:12:26.988912+0000","last_undegraded":"2023-10-14T11:12:26.988912+0000","last_fullsized":"2023-10-14T11:12:26.988912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:41.624687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990653+0000","last_change":"2023-10-14T11:12:22.982260+0000","last_active":"2023-10-14T11:12:26.990653+0000","last_peered":"2023-10-14T11:12:26.990653+0000","last_clean":"2023-10-14T11:12:26.990653+0000","last_became_active":"2023-10-14T11:12:22.981981+0000","last_became_peered":"2023-10-14T11:12:22.981981+0000","last_unstale":"2023-10-14T11:12:26.990653+0000","last_undegraded":"2023-10-14T11:12:26.990653+0000","last_fullsized":"2023-10-14T11:12:26.990653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:08.508676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988763+0000","last_change":"2023-10-14T11:12:22.972200+0000","last_active":"2023-10-14T11:12:26.988763+0000","last_peered":"2023-10-14T11:12:26.988763+0000","last_clean":"2023-10-14T11:12:26.988763+0000","last_became_active":"2023-10-14T11:12:22.971852+0000","last_became_peered":"2023-10-14T11:12:22.971852+0000","last_unstale":"2023-10-14T11:12:26.988763+0000","last_undegraded":"2023-10-14T11:12:26.988763+0000","last_fullsized":"2023-10-14T11:12:26.988763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:52:38.018829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000298+0000","last_change":"2023-10-14T11:12:22.964369+0000","last_active":"2023-10-14T11:12:27.000298+0000","last_peered":"2023-10-14T11:12:27.000298+0000","last_clean":"2023-10-14T11:12:27.000298+0000","last_became_active":"2023-10-14T11:12:22.963993+0000","last_became_peered":"2023-10-14T11:12:22.963993+0000","last_unstale":"2023-10-14T11:12:27.000298+0000","last_undegraded":"2023-10-14T11:12:27.000298+0000","last_fullsized":"2023-10-14T11:12:27.000298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:06.491915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.007442+0000","last_change":"2023-10-14T11:12:22.982867+0000","last_active":"2023-10-14T11:12:27.007442+0000","last_peered":"2023-10-14T11:12:27.007442+0000","last_clean":"2023-10-14T11:12:27.007442+0000","last_became_active":"2023-10-14T11:12:22.981049+0000","last_became_peered":"2023-10-14T11:12:22.981049+0000","last_unstale":"2023-10-14T11:12:27.007442+0000","last_undegraded":"2023-10-14T11:12:27.007442+0000","last_fullsized":"2023-10-14T11:12:27.007442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:06.491915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.994506+0000","last_change":"2023-10-14T11:12:22.968823+0000","last_active":"2023-10-14T11:12:26.994506+0000","last_peered":"2023-10-14T11:12:26.994506+0000","last_clean":"2023-10-14T11:12:26.994506+0000","last_became_active":"2023-10-14T11:12:22.968557+0000","last_became_peered":"2023-10-14T11:12:22.968557+0000","last_unstale":"2023-10-14T11:12:26.994506+0000","last_undegraded":"2023-10-14T11:12:26.994506+0000","last_fullsized":"2023-10-14T11:12:26.994506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:27.066313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.999040+0000","last_change":"2023-10-14T11:12:22.970768+0000","last_active":"2023-10-14T11:12:26.999040+0000","last_peered":"2023-10-14T11:12:26.999040+0000","last_clean":"2023-10-14T11:12:26.999040+0000","last_became_active":"2023-10-14T11:12:22.970449+0000","last_became_peered":"2023-10-14T11:12:22.970449+0000","last_unstale":"2023-10-14T11:12:26.999040+0000","last_undegraded":"2023-10-14T11:12:26.999040+0000","last_fullsized":"2023-10-14T11:12:26.999040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:38.024178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.991296+0000","last_change":"2023-10-14T11:12:22.984404+0000","last_active":"2023-10-14T11:12:26.991296+0000","last_peered":"2023-10-14T11:12:26.991296+0000","last_clean":"2023-10-14T11:12:26.991296+0000","last_became_active":"2023-10-14T11:12:22.984162+0000","last_became_peered":"2023-10-14T11:12:22.984162+0000","last_unstale":"2023-10-14T11:12:26.991296+0000","last_undegraded":"2023-10-14T11:12:26.991296+0000","last_fullsized":"2023-10-14T11:12:26.991296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:17.701734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.991597+0000","last_change":"2023-10-14T11:12:22.992927+0000","last_active":"2023-10-14T11:12:26.991597+0000","last_peered":"2023-10-14T11:12:26.991597+0000","last_clean":"2023-10-14T11:12:26.991597+0000","last_became_active":"2023-10-14T11:12:22.992333+0000","last_became_peered":"2023-10-14T11:12:22.992333+0000","last_unstale":"2023-10-14T11:12:26.991597+0000","last_undegraded":"2023-10-14T11:12:26.991597+0000","last_fullsized":"2023-10-14T11:12:26.991597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:24:53.742274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265899+0000","last_change":"2023-10-14T11:12:22.986073+0000","last_active":"2023-10-14T11:12:27.265899+0000","last_peered":"2023-10-14T11:12:27.265899+0000","last_clean":"2023-10-14T11:12:27.265899+0000","last_became_active":"2023-10-14T11:12:22.985686+0000","last_became_peered":"2023-10-14T11:12:22.985686+0000","last_unstale":"2023-10-14T11:12:27.265899+0000","last_undegraded":"2023-10-14T11:12:27.265899+0000","last_fullsized":"2023-10-14T11:12:27.265899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:15:12.849455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.995735+0000","last_change":"2023-10-14T11:12:22.982684+0000","last_active":"2023-10-14T11:12:26.995735+0000","last_peered":"2023-10-14T11:12:26.995735+0000","last_clean":"2023-10-14T11:12:26.995735+0000","last_became_active":"2023-10-14T11:12:22.982328+0000","last_became_peered":"2023-10-14T11:12:22.982328+0000","last_unstale":"2023-10-14T11:12:26.995735+0000","last_undegraded":"2023-10-14T11:12:26.995735+0000","last_fullsized":"2023-10-14T11:12:26.995735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:06.491915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264743+0000","last_change":"2023-10-14T11:12:22.989563+0000","last_active":"2023-10-14T11:12:27.264743+0000","last_peered":"2023-10-14T11:12:27.264743+0000","last_clean":"2023-10-14T11:12:27.264743+0000","last_became_active":"2023-10-14T11:12:22.989283+0000","last_became_peered":"2023-10-14T11:12:22.989283+0000","last_unstale":"2023-10-14T11:12:27.264743+0000","last_undegraded":"2023-10-14T11:12:27.264743+0000","last_fullsized":"2023-10-14T11:12:27.264743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:19.681873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988614+0000","last_change":"2023-10-14T11:12:22.973627+0000","last_active":"2023-10-14T11:12:26.988614+0000","last_peered":"2023-10-14T11:12:26.988614+0000","last_clean":"2023-10-14T11:12:26.988614+0000","last_became_active":"2023-10-14T11:12:22.973284+0000","last_became_peered":"2023-10-14T11:12:22.973284+0000","last_unstale":"2023-10-14T11:12:26.988614+0000","last_undegraded":"2023-10-14T11:12:26.988614+0000","last_fullsized":"2023-10-14T11:12:26.988614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:18:11.434418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264837+0000","last_change":"2023-10-14T11:12:22.981086+0000","last_active":"2023-10-14T11:12:27.264837+0000","last_peered":"2023-10-14T11:12:27.264837+0000","last_clean":"2023-10-14T11:12:27.264837+0000","last_became_active":"2023-10-14T11:12:22.980768+0000","last_became_peered":"2023-10-14T11:12:22.980768+0000","last_unstale":"2023-10-14T11:12:27.264837+0000","last_undegraded":"2023-10-14T11:12:27.264837+0000","last_fullsized":"2023-10-14T11:12:27.264837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:46.533477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.989398+0000","last_change":"2023-10-14T11:12:22.972884+0000","last_active":"2023-10-14T11:12:26.989398+0000","last_peered":"2023-10-14T11:12:26.989398+0000","last_clean":"2023-10-14T11:12:26.989398+0000","last_became_active":"2023-10-14T11:12:22.972548+0000","last_became_peered":"2023-10-14T11:12:22.972548+0000","last_unstale":"2023-10-14T11:12:26.989398+0000","last_undegraded":"2023-10-14T11:12:26.989398+0000","last_fullsized":"2023-10-14T11:12:26.989398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:46.533477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010562+0000","last_change":"2023-10-14T11:12:22.975055+0000","last_active":"2023-10-14T11:12:27.010562+0000","last_peered":"2023-10-14T11:12:27.010562+0000","last_clean":"2023-10-14T11:12:27.010562+0000","last_became_active":"2023-10-14T11:12:22.974759+0000","last_became_peered":"2023-10-14T11:12:22.974759+0000","last_unstale":"2023-10-14T11:12:27.010562+0000","last_undegraded":"2023-10-14T11:12:27.010562+0000","last_fullsized":"2023-10-14T11:12:27.010562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:02:49.769267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.012397+0000","last_change":"2023-10-14T11:12:22.973923+0000","last_active":"2023-10-14T11:12:27.012397+0000","last_peered":"2023-10-14T11:12:27.012397+0000","last_clean":"2023-10-14T11:12:27.012397+0000","last_became_active":"2023-10-14T11:12:22.973626+0000","last_became_peered":"2023-10-14T11:12:22.973626+0000","last_unstale":"2023-10-14T11:12:27.012397+0000","last_undegraded":"2023-10-14T11:12:27.012397+0000","last_fullsized":"2023-10-14T11:12:27.012397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:17.701734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265807+0000","last_change":"2023-10-14T11:12:22.987825+0000","last_active":"2023-10-14T11:12:27.265807+0000","last_peered":"2023-10-14T11:12:27.265807+0000","last_clean":"2023-10-14T11:12:27.265807+0000","last_became_active":"2023-10-14T11:12:22.987045+0000","last_became_peered":"2023-10-14T11:12:22.987045+0000","last_unstale":"2023-10-14T11:12:27.265807+0000","last_undegraded":"2023-10-14T11:12:27.265807+0000","last_fullsized":"2023-10-14T11:12:27.265807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:08.508676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":864256,"data_stored":695401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":104541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":278528,"data_stored":104577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":104451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":104611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":695457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:12:48.568 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T11:12:48.569 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-14T11:12:48.569 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-14T11:12:48.570 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-14T11:12:48.571 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-14T11:12:48.694 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:12:48.698 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:12:48.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.739+0000 7fd35cc79640 1 Processor -- start 2023-10-14T11:12:48.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.739+0000 7fd35cc79640 1 -- start start 2023-10-14T11:12:48.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.743+0000 7fd35cc79640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3581597c0 0x7fd3580ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:48.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.743+0000 7fd35cc79640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3580723d0 con 0x7fd3580adc10 2023-10-14T11:12:48.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.743+0000 7fd35cc79640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3580717c0 con 0x7fd358159ba0 2023-10-14T11:12:48.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.743+0000 7fd35cc79640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd358071aa0 con 0x7fd3581597c0 2023-10-14T11:12:48.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.743+0000 7fd35659c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3581597c0 0x7fd3580ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:48.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.743+0000 7fd35659c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3581597c0 0x7fd3580ad6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36132/0 (socket says 172.21.15.26:36132) 2023-10-14T11:12:48.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.743+0000 7fd35659c640 1 -- 172.21.15.26:0/3487370607 learned_addr learned my addr 172.21.15.26:0/3487370607 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:48.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.743+0000 7fd356d9d640 1 --1- 172.21.15.26:0/3487370607 >> v1:172.21.15.26:6789/0 conn(0x7fd3580adc10 0x7fd35815d4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57850/0 (socket says 172.21.15.26:57850) 2023-10-14T11:12:48.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.743+0000 7fd35659c640 1 -- 172.21.15.26:0/3487370607 >> v1:172.21.15.110:6789/0 conn(0x7fd358159ba0 legacy=0x7fd3580cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:48.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.743+0000 7fd35659c640 1 -- 172.21.15.26:0/3487370607 >> v1:172.21.15.26:6789/0 conn(0x7fd3580adc10 legacy=0x7fd35815d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:48.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.743+0000 7fd35659c640 1 -- 172.21.15.26:0/3487370607 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd358071d80 con 0x7fd3581597c0 2023-10-14T11:12:48.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.743+0000 7fd355d9b640 1 -- 172.21.15.26:0/3487370607 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631592973 0 0) 0x7fd3580723d0 con 0x7fd3580adc10 2023-10-14T11:12:48.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.747+0000 7fd35659c640 1 --2- 172.21.15.26:0/3487370607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3581597c0 0x7fd3580ad6d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd348009870 tx=0x7fd34801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6471a07b315c0a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:48.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.747+0000 7fd355d9b640 1 -- 172.21.15.26:0/3487370607 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3480ab670 con 0x7fd3581597c0 2023-10-14T11:12:48.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.747+0000 7fd355d9b640 1 -- 172.21.15.26:0/3487370607 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3480ab7d0 con 0x7fd3581597c0 2023-10-14T11:12:48.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.747+0000 7fd355d9b640 1 -- 172.21.15.26:0/3487370607 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3480abb60 con 0x7fd3581597c0 2023-10-14T11:12:48.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.747+0000 7fd35cc79640 1 -- 172.21.15.26:0/3487370607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3581597c0 msgr2=0x7fd3580ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.747+0000 7fd35cc79640 1 --2- 172.21.15.26:0/3487370607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3581597c0 0x7fd3580ad6d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd348009870 tx=0x7fd34801c4d0 comp rx=0 tx=0).stop 2023-10-14T11:12:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.747+0000 7fd35cc79640 1 -- 172.21.15.26:0/3487370607 shutdown_connections 2023-10-14T11:12:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.747+0000 7fd35cc79640 1 --2- 172.21.15.26:0/3487370607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3581597c0 0x7fd3580ad6d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:48.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.747+0000 7fd35cc79640 1 -- 172.21.15.26:0/3487370607 >> 172.21.15.26:0/3487370607 conn(0x7fd35806c190 msgr2=0x7fd35806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:48.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.747+0000 7fd35cc79640 1 -- 172.21.15.26:0/3487370607 shutdown_connections 2023-10-14T11:12:48.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.747+0000 7fd35cc79640 1 -- 172.21.15.26:0/3487370607 wait complete. 2023-10-14T11:12:48.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.747+0000 7fd35cc79640 1 Processor -- start 2023-10-14T11:12:48.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.747+0000 7fd35cc79640 1 -- start start 2023-10-14T11:12:48.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd35cc79640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3580adc10 0x7fd3581557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:48.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd35cc79640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3581597c0 0x7fd358158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:48.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd35cc79640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd358159ba0 0x7fd35814f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:48.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd35cc79640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35814ffc0 con 0x7fd358159ba0 2023-10-14T11:12:48.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd35cc79640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd358155db0 con 0x7fd3580adc10 2023-10-14T11:12:48.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd35cc79640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd358156090 con 0x7fd3581597c0 2023-10-14T11:12:48.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd356d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd358159ba0 0x7fd35814f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd356d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd358159ba0 0x7fd35814f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36134/0 (socket says 172.21.15.26:36134) 2023-10-14T11:12:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd356d9d640 1 -- 172.21.15.26:0/2131851557 learned_addr learned my addr 172.21.15.26:0/2131851557 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd35659c640 1 --2- 172.21.15.26:0/2131851557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3580adc10 0x7fd3581557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd34ffff640 1 --2- 172.21.15.26:0/2131851557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3581597c0 0x7fd358158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd356d9d640 1 -- 172.21.15.26:0/2131851557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3581597c0 msgr2=0x7fd358158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd356d9d640 1 --2- 172.21.15.26:0/2131851557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3581597c0 0x7fd358158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd356d9d640 1 -- 172.21.15.26:0/2131851557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3580adc10 msgr2=0x7fd3581557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd356d9d640 1 --2- 172.21.15.26:0/2131851557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3580adc10 0x7fd3581557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd356d9d640 1 -- 172.21.15.26:0/2131851557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3480094d0 con 0x7fd358159ba0 2023-10-14T11:12:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd356d9d640 1 --2- 172.21.15.26:0/2131851557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd358159ba0 0x7fd35814f480 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd35000c780 tx=0x7fd35000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:48.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd34effd640 1 -- 172.21.15.26:0/2131851557 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35000ce30 con 0x7fd358159ba0 2023-10-14T11:12:48.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd34effd640 1 -- 172.21.15.26:0/2131851557 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35000a640 con 0x7fd358159ba0 2023-10-14T11:12:48.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd34effd640 1 -- 172.21.15.26:0/2131851557 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35000aa30 con 0x7fd358159ba0 2023-10-14T11:12:48.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd35cc79640 1 -- 172.21.15.26:0/2131851557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd358156370 con 0x7fd358159ba0 2023-10-14T11:12:48.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd35cc79640 1 -- 172.21.15.26:0/2131851557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd358156930 con 0x7fd358159ba0 2023-10-14T11:12:48.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd35cc79640 1 -- 172.21.15.26:0/2131851557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd358074010 con 0x7fd358159ba0 2023-10-14T11:12:48.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.751+0000 7fd34effd640 1 -- 172.21.15.26:0/2131851557 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd35000ab90 con 0x7fd358159ba0 2023-10-14T11:12:48.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.755+0000 7fd34effd640 1 --2- 172.21.15.26:0/2131851557 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd3380664a0 0x7fd338068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:48.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.755+0000 7fd34effd640 1 -- 172.21.15.26:0/2131851557 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd350083540 con 0x7fd358159ba0 2023-10-14T11:12:48.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.755+0000 7fd35659c640 1 --2- 172.21.15.26:0/2131851557 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd3380664a0 0x7fd338068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:48.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.755+0000 7fd35659c640 1 --2- 172.21.15.26:0/2131851557 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd3380664a0 0x7fd338068960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd3480af000 tx=0x7fd3480a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:48.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.759+0000 7fd34effd640 1 -- 172.21.15.26:0/2131851557 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd350050770 con 0x7fd358159ba0 2023-10-14T11:12:48.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.955+0000 7fd35cc79640 1 -- 172.21.15.26:0/2131851557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd3580cd3f0 con 0x7fd358159ba0 2023-10-14T11:12:48.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.955+0000 7fd34effd640 1 -- 172.21.15.26:0/2131851557 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164430 (secure 0 0 0) 0x7fd350001770 con 0x7fd358159ba0 2023-10-14T11:12:48.962 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:48.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.959+0000 7fd35cc79640 1 -- 172.21.15.26:0/2131851557 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd3380664a0 msgr2=0x7fd338068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:48.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.959+0000 7fd35cc79640 1 --2- 172.21.15.26:0/2131851557 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd3380664a0 0x7fd338068960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd3480af000 tx=0x7fd3480a7000 comp rx=0 tx=0).stop 2023-10-14T11:12:48.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.959+0000 7fd35cc79640 1 -- 172.21.15.26:0/2131851557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd358159ba0 msgr2=0x7fd35814f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:48.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.959+0000 7fd35cc79640 1 --2- 172.21.15.26:0/2131851557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd358159ba0 0x7fd35814f480 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd35000c780 tx=0x7fd35000cc40 comp rx=0 tx=0).stop 2023-10-14T11:12:48.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.959+0000 7fd35cc79640 1 -- 172.21.15.26:0/2131851557 shutdown_connections 2023-10-14T11:12:48.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.959+0000 7fd35cc79640 1 --2- 172.21.15.26:0/2131851557 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd3380664a0 0x7fd338068960 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:48.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.959+0000 7fd35cc79640 1 --2- 172.21.15.26:0/2131851557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd358159ba0 0x7fd35814f480 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:48.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.959+0000 7fd35cc79640 1 --2- 172.21.15.26:0/2131851557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3581597c0 0x7fd358158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:48.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.959+0000 7fd35cc79640 1 --2- 172.21.15.26:0/2131851557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3580adc10 0x7fd3581557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:48.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.959+0000 7fd35cc79640 1 -- 172.21.15.26:0/2131851557 >> 172.21.15.26:0/2131851557 conn(0x7fd35806c190 msgr2=0x7fd3580ca8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:48.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.959+0000 7fd35cc79640 1 -- 172.21.15.26:0/2131851557 shutdown_connections 2023-10-14T11:12:48.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:48.959+0000 7fd35cc79640 1 -- 172.21.15.26:0/2131851557 wait complete. 2023-10-14T11:12:48.983 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":5,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4136446821},{"type":"v1","addr":"172.21.15.26:6833","nonce":4136446821}]},"active_addr":"172.21.15.26:6833/4136446821","active_change":"2023-10-14T11:12:02.146846+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4112,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":2618880439}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":2158922848}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":3991776297}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":3203037453}]}]} 2023-10-14T11:12:48.987 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-14T11:12:48.987 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-14T11:12:48.988 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:12:49.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.163+0000 7f597c8d6640 1 Processor -- start 2023-10-14T11:12:49.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.163+0000 7f597c8d6640 1 -- start start 2023-10-14T11:12:49.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.167+0000 7f597c8d6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f597815cb90 0x7f59780cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.167+0000 7f597c8d6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f59780d15d0 0x7f59780c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.167+0000 7f597c8d6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59780ce770 con 0x7f59780d3010 2023-10-14T11:12:49.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.167+0000 7f597c8d6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59780d0600 con 0x7f59780d15d0 2023-10-14T11:12:49.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.167+0000 7f597c8d6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59780c6450 con 0x7f597815cb90 2023-10-14T11:12:49.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.167+0000 7f596ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f59780d3010 0x7f59780d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57866/0 (socket says 172.21.15.26:57866) 2023-10-14T11:12:49.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.167+0000 7f596ffff640 1 -- 172.21.15.26:0/1320535805 learned_addr learned my addr 172.21.15.26:0/1320535805 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:49.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.167+0000 7f5976d9d640 1 --2- 172.21.15.26:0/1320535805 >> v2:172.21.15.110:3300/0 conn(0x7f59780d15d0 0x7f59780c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.167+0000 7f597659c640 1 --2- 172.21.15.26:0/1320535805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f597815cb90 0x7f59780cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.167+0000 7f5975d9b640 1 -- 172.21.15.26:0/1320535805 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3284588420 0 0) 0x7f59780ce770 con 0x7f59780d3010 2023-10-14T11:12:49.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.167+0000 7f5975d9b640 1 -- 172.21.15.26:0/1320535805 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5964003530 con 0x7f59780d3010 2023-10-14T11:12:49.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.167+0000 7f5976d9d640 1 -- 172.21.15.26:0/1320535805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f597815cb90 msgr2=0x7f59780cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:49.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.167+0000 7f5976d9d640 1 --2- 172.21.15.26:0/1320535805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f597815cb90 0x7f59780cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.167+0000 7f5976d9d640 1 -- 172.21.15.26:0/1320535805 >> v1:172.21.15.26:6789/0 conn(0x7f59780d3010 legacy=0x7f59780d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.167+0000 7f5976d9d640 1 -- 172.21.15.26:0/1320535805 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59780d08a0 con 0x7f59780d15d0 2023-10-14T11:12:49.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.167+0000 7f597659c640 1 --2- 172.21.15.26:0/1320535805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f597815cb90 0x7f59780cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:12:49.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.171+0000 7f5976d9d640 1 --2- 172.21.15.26:0/1320535805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59780d15d0 0x7f59780c6c10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5970009d90 tx=0x7f597001c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=269778d2aa9d4f3b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:49.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.171+0000 7f5975d9b640 1 -- 172.21.15.26:0/1320535805 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59700a5950 con 0x7f59780d15d0 2023-10-14T11:12:49.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.171+0000 7f5975d9b640 1 -- 172.21.15.26:0/1320535805 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59700a5ab0 con 0x7f59780d15d0 2023-10-14T11:12:49.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.171+0000 7f5975d9b640 1 -- 172.21.15.26:0/1320535805 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59700a5e40 con 0x7f59780d15d0 2023-10-14T11:12:49.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.171+0000 7f597c8d6640 1 -- 172.21.15.26:0/1320535805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59780d15d0 msgr2=0x7f59780c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.171+0000 7f597c8d6640 1 --2- 172.21.15.26:0/1320535805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59780d15d0 0x7f59780c6c10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5970009d90 tx=0x7f597001c890 comp rx=0 tx=0).stop 2023-10-14T11:12:49.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.171+0000 7f597c8d6640 1 -- 172.21.15.26:0/1320535805 shutdown_connections 2023-10-14T11:12:49.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.171+0000 7f597c8d6640 1 --2- 172.21.15.26:0/1320535805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59780d15d0 0x7f59780c6c10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.171+0000 7f597c8d6640 1 --2- 172.21.15.26:0/1320535805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f597815cb90 0x7f59780cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.171+0000 7f597c8d6640 1 -- 172.21.15.26:0/1320535805 >> 172.21.15.26:0/1320535805 conn(0x7f597809bc50 msgr2=0x7f59780d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:49.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.171+0000 7f597c8d6640 1 -- 172.21.15.26:0/1320535805 shutdown_connections 2023-10-14T11:12:49.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.171+0000 7f597c8d6640 1 -- 172.21.15.26:0/1320535805 wait complete. 2023-10-14T11:12:49.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.171+0000 7f597c8d6640 1 Processor -- start 2023-10-14T11:12:49.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.171+0000 7f597c8d6640 1 -- start start 2023-10-14T11:12:49.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.171+0000 7f597c8d6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59780d15d0 0x7f597806bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f597c8d6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59780d3010 0x7f59781501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f597c8d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f597815cb90 0x7f59780cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f597c8d6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597806c1d0 con 0x7f597815cb90 2023-10-14T11:12:49.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f597c8d6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5978150700 con 0x7f59780d15d0 2023-10-14T11:12:49.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f597c8d6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597813ecc0 con 0x7f59780d3010 2023-10-14T11:12:49.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f5976d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f597815cb90 0x7f59780cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f5976d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f597815cb90 0x7f59780cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36144/0 (socket says 172.21.15.26:36144) 2023-10-14T11:12:49.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f5976d9d640 1 -- 172.21.15.26:0/431510557 learned_addr learned my addr 172.21.15.26:0/431510557 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:49.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f596ffff640 1 --2- 172.21.15.26:0/431510557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59780d3010 0x7f59781501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f597659c640 1 --2- 172.21.15.26:0/431510557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59780d15d0 0x7f597806bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f5976d9d640 1 -- 172.21.15.26:0/431510557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59780d3010 msgr2=0x7f59781501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f5976d9d640 1 --2- 172.21.15.26:0/431510557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59780d3010 0x7f59781501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f5976d9d640 1 -- 172.21.15.26:0/431510557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59780d15d0 msgr2=0x7f597806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f5976d9d640 1 --2- 172.21.15.26:0/431510557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59780d15d0 0x7f597806bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f5976d9d640 1 -- 172.21.15.26:0/431510557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59680093b0 con 0x7f597815cb90 2023-10-14T11:12:49.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f596ffff640 1 --2- 172.21.15.26:0/431510557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59780d3010 0x7f59781501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:49.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f597659c640 1 --2- 172.21.15.26:0/431510557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59780d15d0 0x7f597806bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:49.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f5976d9d640 1 --2- 172.21.15.26:0/431510557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f597815cb90 0x7f59780cbd10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f59700b0040 tx=0x7f5970019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:49.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f596effd640 1 -- 172.21.15.26:0/431510557 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59700adce0 con 0x7f597815cb90 2023-10-14T11:12:49.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f596effd640 1 -- 172.21.15.26:0/431510557 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59700ade40 con 0x7f597815cb90 2023-10-14T11:12:49.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f596effd640 1 -- 172.21.15.26:0/431510557 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59700b9690 con 0x7f597815cb90 2023-10-14T11:12:49.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f597c8d6640 1 -- 172.21.15.26:0/431510557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5970009a70 con 0x7f597815cb90 2023-10-14T11:12:49.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f597c8d6640 1 -- 172.21.15.26:0/431510557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f597813f280 con 0x7f597815cb90 2023-10-14T11:12:49.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f597c8d6640 1 -- 172.21.15.26:0/431510557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5978074010 con 0x7f597815cb90 2023-10-14T11:12:49.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.175+0000 7f596effd640 1 -- 172.21.15.26:0/431510557 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f59700b97f0 con 0x7f597815cb90 2023-10-14T11:12:49.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.179+0000 7f596effd640 1 --2- 172.21.15.26:0/431510557 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f59580664a0 0x7f5958068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.179+0000 7f596effd640 1 -- 172.21.15.26:0/431510557 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f597011f9b0 con 0x7f597815cb90 2023-10-14T11:12:49.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.179+0000 7f597659c640 1 --2- 172.21.15.26:0/431510557 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f59580664a0 0x7f5958068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.179+0000 7f597659c640 1 --2- 172.21.15.26:0/431510557 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f59580664a0 0x7f5958068960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5968009c80 tx=0x7f5968008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:49.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.183+0000 7f596effd640 1 -- 172.21.15.26:0/431510557 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f59700ecbc0 con 0x7f597815cb90 2023-10-14T11:12:49.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.339+0000 7f597c8d6640 1 -- 172.21.15.26:0/431510557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59781530b0 con 0x7f597815cb90 2023-10-14T11:12:49.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.339+0000 7f596effd640 1 -- 172.21.15.26:0/431510557 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f5970009450 con 0x7f597815cb90 2023-10-14T11:12:49.343 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:49.344 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":25,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:12:27.398936+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:12:49.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.339+0000 7f597c8d6640 1 -- 172.21.15.26:0/431510557 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f59580664a0 msgr2=0x7f5958068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.339+0000 7f597c8d6640 1 --2- 172.21.15.26:0/431510557 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f59580664a0 0x7f5958068960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5968009c80 tx=0x7f5968008040 comp rx=0 tx=0).stop 2023-10-14T11:12:49.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.339+0000 7f597c8d6640 1 -- 172.21.15.26:0/431510557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f597815cb90 msgr2=0x7f59780cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.339+0000 7f597c8d6640 1 --2- 172.21.15.26:0/431510557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f597815cb90 0x7f59780cbd10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f59700b0040 tx=0x7f5970019630 comp rx=0 tx=0).stop 2023-10-14T11:12:49.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.343+0000 7f597c8d6640 1 -- 172.21.15.26:0/431510557 shutdown_connections 2023-10-14T11:12:49.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.343+0000 7f597c8d6640 1 --2- 172.21.15.26:0/431510557 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f59580664a0 0x7f5958068960 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.343+0000 7f597c8d6640 1 --2- 172.21.15.26:0/431510557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f597815cb90 0x7f59780cbd10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.343+0000 7f597c8d6640 1 --2- 172.21.15.26:0/431510557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59780d3010 0x7f59781501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.343+0000 7f597c8d6640 1 --2- 172.21.15.26:0/431510557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59780d15d0 0x7f597806bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.343+0000 7f597c8d6640 1 -- 172.21.15.26:0/431510557 >> 172.21.15.26:0/431510557 conn(0x7f597809bc50 msgr2=0x7f59780d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:49.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.343+0000 7f597c8d6640 1 -- 172.21.15.26:0/431510557 shutdown_connections 2023-10-14T11:12:49.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.343+0000 7f597c8d6640 1 -- 172.21.15.26:0/431510557 wait complete. 2023-10-14T11:12:49.365 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-14T11:12:49.365 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:12:49.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.503+0000 7f2eaa50f640 1 Processor -- start 2023-10-14T11:12:49.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.503+0000 7f2eaa50f640 1 -- start start 2023-10-14T11:12:49.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.507+0000 7f2eaa50f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2ea40cf090 0x7f2ea40cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.507+0000 7f2eaa50f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2ea40c6ad0 0x7f2ea40c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.507+0000 7f2eaa50f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea40c65f0 con 0x7f2ea415ca70 2023-10-14T11:12:49.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.507+0000 7f2eaa50f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea40cfa60 con 0x7f2ea40c6ad0 2023-10-14T11:12:49.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.507+0000 7f2eaa50f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea40ce820 con 0x7f2ea40cf090 2023-10-14T11:12:49.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.507+0000 7f2ea3fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2ea415ca70 0x7f2ea40d3010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57872/0 (socket says 172.21.15.26:57872) 2023-10-14T11:12:49.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.507+0000 7f2ea8aac640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2ea40c6ad0 0x7f2ea40c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.507+0000 7f2ea3fff640 1 -- 172.21.15.26:0/3709284356 learned_addr learned my addr 172.21.15.26:0/3709284356 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:49.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.507+0000 7f2ea37fe640 1 --2- 172.21.15.26:0/3709284356 >> v2:172.21.15.110:3300/0 conn(0x7f2ea40cf090 0x7f2ea40cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.507+0000 7f2ea8aac640 1 -- 172.21.15.26:0/3709284356 >> v2:172.21.15.110:3300/0 conn(0x7f2ea40cf090 msgr2=0x7f2ea40cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:49.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.507+0000 7f2ea8aac640 1 --2- 172.21.15.26:0/3709284356 >> v2:172.21.15.110:3300/0 conn(0x7f2ea40cf090 0x7f2ea40cf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.507+0000 7f2ea8aac640 1 -- 172.21.15.26:0/3709284356 >> v1:172.21.15.26:6789/0 conn(0x7f2ea415ca70 legacy=0x7f2ea40d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.507+0000 7f2ea8aac640 1 -- 172.21.15.26:0/3709284356 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea40cdf80 con 0x7f2ea40c6ad0 2023-10-14T11:12:49.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.507+0000 7f2ea8aac640 1 --2- 172.21.15.26:0/3709284356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ea40c6ad0 0x7f2ea40c6f00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40b54f0 tx=0x7f2e9c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e351e39e1d2960fb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:49.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.507+0000 7f2ea2ffd640 1 -- 172.21.15.26:0/3709284356 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c0a59a0 con 0x7f2ea40c6ad0 2023-10-14T11:12:49.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.507+0000 7f2ea2ffd640 1 -- 172.21.15.26:0/3709284356 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9c0a5b00 con 0x7f2ea40c6ad0 2023-10-14T11:12:49.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.507+0000 7f2ea2ffd640 1 -- 172.21.15.26:0/3709284356 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c0a5e90 con 0x7f2ea40c6ad0 2023-10-14T11:12:49.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.511+0000 7f2eaa50f640 1 -- 172.21.15.26:0/3709284356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ea40c6ad0 msgr2=0x7f2ea40c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.511+0000 7f2eaa50f640 1 --2- 172.21.15.26:0/3709284356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ea40c6ad0 0x7f2ea40c6f00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40b54f0 tx=0x7f2e9c01c8e0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.511+0000 7f2eaa50f640 1 -- 172.21.15.26:0/3709284356 shutdown_connections 2023-10-14T11:12:49.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.511+0000 7f2eaa50f640 1 --2- 172.21.15.26:0/3709284356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ea40c6ad0 0x7f2ea40c6f00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.511+0000 7f2eaa50f640 1 --2- 172.21.15.26:0/3709284356 >> v2:172.21.15.110:3300/0 conn(0x7f2ea40cf090 0x7f2ea40cf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.511+0000 7f2eaa50f640 1 -- 172.21.15.26:0/3709284356 >> 172.21.15.26:0/3709284356 conn(0x7f2ea409bc50 msgr2=0x7f2ea40d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.511+0000 7f2eaa50f640 1 -- 172.21.15.26:0/3709284356 shutdown_connections 2023-10-14T11:12:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.511+0000 7f2eaa50f640 1 -- 172.21.15.26:0/3709284356 wait complete. 2023-10-14T11:12:49.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.511+0000 7f2eaa50f640 1 Processor -- start 2023-10-14T11:12:49.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.511+0000 7f2eaa50f640 1 -- start start 2023-10-14T11:12:49.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.511+0000 7f2eaa50f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ea40c6ad0 0x7f2ea414c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.511+0000 7f2eaa50f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ea40cf090 0x7f2ea414b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.511+0000 7f2eaa50f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ea415ca70 0x7f2ea414fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.511+0000 7f2eaa50f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea4156840 con 0x7f2ea40c6ad0 2023-10-14T11:12:49.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.511+0000 7f2eaa50f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea414e2b0 con 0x7f2ea415ca70 2023-10-14T11:12:49.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.511+0000 7f2eaa50f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea414d340 con 0x7f2ea40cf090 2023-10-14T11:12:49.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.511+0000 7f2ea3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ea40c6ad0 0x7f2ea414c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.511+0000 7f2ea3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ea40c6ad0 0x7f2ea414c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36156/0 (socket says 172.21.15.26:36156) 2023-10-14T11:12:49.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.511+0000 7f2ea3fff640 1 -- 172.21.15.26:0/2128646495 learned_addr learned my addr 172.21.15.26:0/2128646495 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:49.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.511+0000 7f2ea37fe640 1 --2- 172.21.15.26:0/2128646495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ea40cf090 0x7f2ea414b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.511+0000 7f2ea8aac640 1 --2- 172.21.15.26:0/2128646495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ea415ca70 0x7f2ea414fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.515+0000 7f2ea3fff640 1 -- 172.21.15.26:0/2128646495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ea40cf090 msgr2=0x7f2ea414b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.515+0000 7f2ea3fff640 1 --2- 172.21.15.26:0/2128646495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ea40cf090 0x7f2ea414b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.515+0000 7f2ea3fff640 1 -- 172.21.15.26:0/2128646495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ea415ca70 msgr2=0x7f2ea414fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.515+0000 7f2ea3fff640 1 --2- 172.21.15.26:0/2128646495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ea415ca70 0x7f2ea414fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.515+0000 7f2ea3fff640 1 -- 172.21.15.26:0/2128646495 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c009a70 con 0x7f2ea40c6ad0 2023-10-14T11:12:49.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.515+0000 7f2ea3fff640 1 --2- 172.21.15.26:0/2128646495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ea40c6ad0 0x7f2ea414c190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2e94007fd0 tx=0x7f2e9400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:49.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.515+0000 7f2ea0ff9640 1 -- 172.21.15.26:0/2128646495 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e940074e0 con 0x7f2ea40c6ad0 2023-10-14T11:12:49.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.515+0000 7f2ea0ff9640 1 -- 172.21.15.26:0/2128646495 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e94007640 con 0x7f2ea40c6ad0 2023-10-14T11:12:49.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.515+0000 7f2ea0ff9640 1 -- 172.21.15.26:0/2128646495 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e940059b0 con 0x7f2ea40c6ad0 2023-10-14T11:12:49.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.515+0000 7f2eaa50f640 1 -- 172.21.15.26:0/2128646495 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea40d38a0 con 0x7f2ea40c6ad0 2023-10-14T11:12:49.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.515+0000 7f2eaa50f640 1 -- 172.21.15.26:0/2128646495 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea414cd80 con 0x7f2ea40c6ad0 2023-10-14T11:12:49.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.515+0000 7f2eaa50f640 1 -- 172.21.15.26:0/2128646495 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea4074010 con 0x7f2ea40c6ad0 2023-10-14T11:12:49.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.515+0000 7f2ea0ff9640 1 -- 172.21.15.26:0/2128646495 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2e94005b10 con 0x7f2ea40c6ad0 2023-10-14T11:12:49.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.515+0000 7f2ea0ff9640 1 --2- 172.21.15.26:0/2128646495 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2e900664a0 0x7f2e90068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.519+0000 7f2ea0ff9640 1 -- 172.21.15.26:0/2128646495 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2e94083650 con 0x7f2ea40c6ad0 2023-10-14T11:12:49.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.519+0000 7f2ea37fe640 1 --2- 172.21.15.26:0/2128646495 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2e900664a0 0x7f2e90068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.519+0000 7f2ea37fe640 1 --2- 172.21.15.26:0/2128646495 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2e900664a0 0x7f2e90068960 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2ea414f290 tx=0x7f2e98008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:49.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.519+0000 7f2ea0ff9640 1 -- 172.21.15.26:0/2128646495 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2e94050880 con 0x7f2ea40c6ad0 2023-10-14T11:12:49.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.679+0000 7f2eaa50f640 1 -- 172.21.15.26:0/2128646495 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ea40c7050 con 0x7f2ea40c6ad0 2023-10-14T11:12:49.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.679+0000 7f2ea0ff9640 1 -- 172.21.15.26:0/2128646495 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f2e94053ea0 con 0x7f2ea40c6ad0 2023-10-14T11:12:49.684 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:49.684 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":25,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:12:27.398936+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:12:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.683+0000 7f2eaa50f640 1 -- 172.21.15.26:0/2128646495 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2e900664a0 msgr2=0x7f2e90068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.683+0000 7f2eaa50f640 1 --2- 172.21.15.26:0/2128646495 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2e900664a0 0x7f2e90068960 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2ea414f290 tx=0x7f2e98008040 comp rx=0 tx=0).stop 2023-10-14T11:12:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.683+0000 7f2eaa50f640 1 -- 172.21.15.26:0/2128646495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ea40c6ad0 msgr2=0x7f2ea414c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.683+0000 7f2eaa50f640 1 --2- 172.21.15.26:0/2128646495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ea40c6ad0 0x7f2ea414c190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2e94007fd0 tx=0x7f2e9400c890 comp rx=0 tx=0).stop 2023-10-14T11:12:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.683+0000 7f2eaa50f640 1 -- 172.21.15.26:0/2128646495 shutdown_connections 2023-10-14T11:12:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.683+0000 7f2eaa50f640 1 --2- 172.21.15.26:0/2128646495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ea415ca70 0x7f2ea414fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.683+0000 7f2eaa50f640 1 --2- 172.21.15.26:0/2128646495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ea40cf090 0x7f2ea414b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.683+0000 7f2eaa50f640 1 --2- 172.21.15.26:0/2128646495 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2e900664a0 0x7f2e90068960 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.683+0000 7f2eaa50f640 1 --2- 172.21.15.26:0/2128646495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ea40c6ad0 0x7f2ea414c190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.683+0000 7f2eaa50f640 1 -- 172.21.15.26:0/2128646495 >> 172.21.15.26:0/2128646495 conn(0x7f2ea409bc50 msgr2=0x7f2ea40d2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.683+0000 7f2eaa50f640 1 -- 172.21.15.26:0/2128646495 shutdown_connections 2023-10-14T11:12:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.683+0000 7f2eaa50f640 1 -- 172.21.15.26:0/2128646495 wait complete. 2023-10-14T11:12:49.706 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-14T11:12:49.707 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-14T11:12:49.708 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-14T11:12:49.708 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-14T11:12:49.709 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-14T11:12:49.710 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-14T11:12:49.710 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-14T11:12:49.711 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-14T11:12:49.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.903+0000 7facd7209640 1 Processor -- start 2023-10-14T11:12:49.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.907+0000 7facd7209640 1 -- start start 2023-10-14T11:12:49.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.907+0000 7facd7209640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facc8050280 0x7facc8007410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.907+0000 7facd7209640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc8006370 con 0x7facc8005ee0 2023-10-14T11:12:49.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.907+0000 7facd7209640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc8006650 con 0x7facc80df460 2023-10-14T11:12:49.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.907+0000 7facd7209640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc8006930 con 0x7facc8050280 2023-10-14T11:12:49.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.907+0000 7facd4fa5640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7facc80df460 0x7facc804fb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:48530/0 (socket says 172.21.15.26:48530) 2023-10-14T11:12:49.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.907+0000 7facd4fa5640 1 -- 172.21.15.26:0/947447625 learned_addr learned my addr 172.21.15.26:0/947447625 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:49.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.907+0000 7facd57a6640 1 --2- 172.21.15.26:0/947447625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facc8050280 0x7facc8007410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.911+0000 7faccf7fe640 1 -- 172.21.15.26:0/947447625 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622821342 0 0) 0x7facc8006650 con 0x7facc80df460 2023-10-14T11:12:49.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.911+0000 7faccf7fe640 1 -- 172.21.15.26:0/947447625 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facc0003530 con 0x7facc80df460 2023-10-14T11:12:49.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.911+0000 7facd57a6640 1 -- 172.21.15.26:0/947447625 >> v1:172.21.15.110:6789/0 conn(0x7facc80df460 legacy=0x7facc804fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.911+0000 7facd57a6640 1 -- 172.21.15.26:0/947447625 >> v1:172.21.15.26:6789/0 conn(0x7facc8005ee0 legacy=0x7facc80380d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:49.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.911+0000 7facd57a6640 1 -- 172.21.15.26:0/947447625 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc8006c10 con 0x7facc8050280 2023-10-14T11:12:49.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.915+0000 7facd57a6640 1 --2- 172.21.15.26:0/947447625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facc8050280 0x7facc8007410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7facbc00ba80 tx=0x7facbc01e910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf226c017d3b61e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:49.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.915+0000 7faccf7fe640 1 -- 172.21.15.26:0/947447625 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc0a78f0 con 0x7facc8050280 2023-10-14T11:12:49.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.915+0000 7faccf7fe640 1 -- 172.21.15.26:0/947447625 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc0ab070 con 0x7facc8050280 2023-10-14T11:12:49.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.915+0000 7faccf7fe640 1 -- 172.21.15.26:0/947447625 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc0a7c70 con 0x7facc8050280 2023-10-14T11:12:49.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.919+0000 7facd7209640 1 -- 172.21.15.26:0/947447625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facc8050280 msgr2=0x7facc8007410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.919+0000 7facd7209640 1 --2- 172.21.15.26:0/947447625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facc8050280 0x7facc8007410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7facbc00ba80 tx=0x7facbc01e910 comp rx=0 tx=0).stop 2023-10-14T11:12:49.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.919+0000 7facd7209640 1 -- 172.21.15.26:0/947447625 shutdown_connections 2023-10-14T11:12:49.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.919+0000 7facd7209640 1 --2- 172.21.15.26:0/947447625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facc8050280 0x7facc8007410 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.919+0000 7facd7209640 1 -- 172.21.15.26:0/947447625 >> 172.21.15.26:0/947447625 conn(0x7facc8054b10 msgr2=0x7facc8054f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:49.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.919+0000 7facd7209640 1 -- 172.21.15.26:0/947447625 shutdown_connections 2023-10-14T11:12:49.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.919+0000 7facd7209640 1 -- 172.21.15.26:0/947447625 wait complete. 2023-10-14T11:12:49.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.923+0000 7facd7209640 1 Processor -- start 2023-10-14T11:12:49.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.923+0000 7facd7209640 1 -- start start 2023-10-14T11:12:49.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.923+0000 7facd7209640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facc8050280 0x7facc8189600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.923+0000 7facd7209640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facc80df460 0x7facc8182960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.923+0000 7facd7209640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facc804bbe0 0x7facc80d4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.923+0000 7faccffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facc80df460 0x7facc8182960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.923+0000 7faccffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facc80df460 0x7facc8182960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58242/0 (socket says 172.21.15.26:58242) 2023-10-14T11:12:49.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.923+0000 7facd57a6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facc804bbe0 0x7facc80d4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.923+0000 7facd57a6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facc804bbe0 0x7facc80d4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36168/0 (socket says 172.21.15.26:36168) 2023-10-14T11:12:49.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.923+0000 7facd57a6640 1 -- 172.21.15.26:0/2567922566 learned_addr learned my addr 172.21.15.26:0/2567922566 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:49.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.923+0000 7facd7209640 1 -- 172.21.15.26:0/2567922566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc8189b40 con 0x7facc804bbe0 2023-10-14T11:12:49.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.923+0000 7facd7209640 1 -- 172.21.15.26:0/2567922566 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc80dfcd0 con 0x7facc8050280 2023-10-14T11:12:49.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.927+0000 7facd4fa5640 1 --2- 172.21.15.26:0/2567922566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facc8050280 0x7facc8189600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.927+0000 7facd7209640 1 -- 172.21.15.26:0/2567922566 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc80dffb0 con 0x7facc80df460 2023-10-14T11:12:49.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.927+0000 7facd57a6640 1 -- 172.21.15.26:0/2567922566 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facc80df460 msgr2=0x7facc8182960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.927+0000 7facd57a6640 1 --2- 172.21.15.26:0/2567922566 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facc80df460 0x7facc8182960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.927+0000 7facd57a6640 1 -- 172.21.15.26:0/2567922566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facc8050280 msgr2=0x7facc8189600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.927+0000 7facd57a6640 1 --2- 172.21.15.26:0/2567922566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facc8050280 0x7facc8189600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.927+0000 7facd57a6640 1 -- 172.21.15.26:0/2567922566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc00b6b0 con 0x7facc804bbe0 2023-10-14T11:12:49.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.927+0000 7facd4fa5640 1 --2- 172.21.15.26:0/2567922566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facc8050280 0x7facc8189600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:12:49.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.927+0000 7faccffff640 1 --2- 172.21.15.26:0/2567922566 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facc80df460 0x7facc8182960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:49.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.927+0000 7facd57a6640 1 --2- 172.21.15.26:0/2567922566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facc804bbe0 0x7facc80d4d30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7facbc00ba80 tx=0x7facbc01b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:49.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.927+0000 7faccd7fa640 1 -- 172.21.15.26:0/2567922566 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc006d20 con 0x7facc804bbe0 2023-10-14T11:12:49.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.927+0000 7facd7209640 1 -- 172.21.15.26:0/2567922566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc80e0290 con 0x7facc804bbe0 2023-10-14T11:12:49.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.927+0000 7facd7209640 1 -- 172.21.15.26:0/2567922566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc80e0850 con 0x7facc804bbe0 2023-10-14T11:12:49.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.931+0000 7faccd7fa640 1 -- 172.21.15.26:0/2567922566 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc0b1610 con 0x7facc804bbe0 2023-10-14T11:12:49.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.931+0000 7faccd7fa640 1 -- 172.21.15.26:0/2567922566 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc0b19c0 con 0x7facc804bbe0 2023-10-14T11:12:49.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.931+0000 7facbaffd640 1 -- 172.21.15.26:0/2567922566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7facb0000fd0 con 0x7facc804bbe0 2023-10-14T11:12:49.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.935+0000 7faccd7fa640 1 -- 172.21.15.26:0/2567922566 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7facbc0b1b20 con 0x7facc804bbe0 2023-10-14T11:12:49.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.935+0000 7faccd7fa640 1 --2- 172.21.15.26:0/2567922566 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7facb4066500 0x7facb40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.935+0000 7faccd7fa640 1 -- 172.21.15.26:0/2567922566 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7facbc0efc10 con 0x7facc804bbe0 2023-10-14T11:12:49.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.935+0000 7facd4fa5640 1 --2- 172.21.15.26:0/2567922566 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7facb4066500 0x7facb40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.939+0000 7faccd7fa640 1 --2- 172.21.15.26:0/2567922566 >> [v2:172.21.15.110:6800/3436135045,v1:172.21.15.110:6801/3436135045] conn(0x7facb406fa40 0x7facb4071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.939+0000 7faccd7fa640 1 -- 172.21.15.26:0/2567922566 --> [v2:172.21.15.110:6800/3436135045,v1:172.21.15.110:6801/3436135045] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7facb4072550 con 0x7facb406fa40 2023-10-14T11:12:49.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.939+0000 7faccd7fa640 1 -- 172.21.15.26:0/2567922566 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7facbc0b19c0 con 0x7facc804bbe0 2023-10-14T11:12:49.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.939+0000 7faccffff640 1 --2- 172.21.15.26:0/2567922566 >> [v2:172.21.15.110:6800/3436135045,v1:172.21.15.110:6801/3436135045] conn(0x7facb406fa40 0x7facb4071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.939+0000 7faccffff640 1 --2- 172.21.15.26:0/2567922566 >> [v2:172.21.15.110:6800/3436135045,v1:172.21.15.110:6801/3436135045] conn(0x7facb406fa40 0x7facb4071e80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:49.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.939+0000 7facd4fa5640 1 --2- 172.21.15.26:0/2567922566 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7facb4066500 0x7facb40689c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7facc40011f0 tx=0x7facc4007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:49.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.939+0000 7faccd7fa640 1 -- 172.21.15.26:0/2567922566 <== osd.4 v2:172.21.15.110:6800/3436135045 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7facb4072550 con 0x7facb406fa40 2023-10-14T11:12:49.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.955+0000 7ff6c7fff640 1 Processor -- start 2023-10-14T11:12:49.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.955+0000 7ff6c7fff640 1 -- start start 2023-10-14T11:12:49.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.959+0000 7ff6c7fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff6c0057810 0x7ff6c00eb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.959+0000 7ff6c7fff640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c0055630 con 0x7ff6c00eaa50 2023-10-14T11:12:49.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.959+0000 7ff6c7fff640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c0054a20 con 0x7ff6c0055ac0 2023-10-14T11:12:49.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.959+0000 7ff6c7fff640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c0053320 con 0x7ff6c0057810 2023-10-14T11:12:49.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.959+0000 7ff6c6ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff6c00eaa50 0x7ff6c00eb260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57892/0 (socket says 172.21.15.26:57892) 2023-10-14T11:12:49.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.959+0000 7ff6c6ffd640 1 -- 172.21.15.26:0/2282046181 learned_addr learned my addr 172.21.15.26:0/2282046181 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:49.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.959+0000 7ff6c67fc640 1 --2- 172.21.15.26:0/2282046181 >> v2:172.21.15.110:3300/0 conn(0x7ff6c0057810 0x7ff6c00eb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.959+0000 7ff6c67fc640 1 -- 172.21.15.26:0/2282046181 >> v1:172.21.15.110:6789/0 conn(0x7ff6c0055ac0 legacy=0x7ff6c0055ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T11:12:49.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.959+0000 7ff6c67fc640 1 -- 172.21.15.26:0/2282046181 >> v1:172.21.15.26:6789/0 conn(0x7ff6c00eaa50 legacy=0x7ff6c00eb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.959+0000 7ff6c67fc640 1 -- 172.21.15.26:0/2282046181 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c0054d00 con 0x7ff6c0057810 2023-10-14T11:12:49.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.967+0000 7faa7c491640 1 Processor -- start 2023-10-14T11:12:49.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.967+0000 7faa7c491640 1 -- start start 2023-10-14T11:12:49.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.967+0000 7f4015cd6640 1 Processor -- start 2023-10-14T11:12:49.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.967+0000 7ff6c67fc640 1 --2- 172.21.15.26:0/2282046181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6c0057810 0x7ff6c00eb970 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8000b70 tx=0x7ff6c80964a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bfcab22c29d7403 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:49.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.967+0000 7f4015cd6640 1 -- start start 2023-10-14T11:12:49.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.967+0000 7ff6c5ffb640 1 -- 172.21.15.26:0/2282046181 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8072040 con 0x7ff6c0057810 2023-10-14T11:12:49.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.967+0000 7ff6c5ffb640 1 -- 172.21.15.26:0/2282046181 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c8122050 con 0x7ff6c0057810 2023-10-14T11:12:49.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.967+0000 7ff6c5ffb640 1 -- 172.21.15.26:0/2282046181 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c81268c0 con 0x7ff6c0057810 2023-10-14T11:12:49.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.967+0000 7ff6c7fff640 1 -- 172.21.15.26:0/2282046181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6c0057810 msgr2=0x7ff6c00eb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.967+0000 7ff6c7fff640 1 --2- 172.21.15.26:0/2282046181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6c0057810 0x7ff6c00eb970 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8000b70 tx=0x7ff6c80964a0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.967+0000 7faa7c491640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faa740c9d00 0x7faa740cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.967+0000 7faa7c491640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7415d210 con 0x7faa740ccec0 2023-10-14T11:12:49.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.967+0000 7faa7c491640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7415d4f0 con 0x7faa740c9920 2023-10-14T11:12:49.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.967+0000 7faa7c491640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa74070af0 con 0x7faa740c9d00 2023-10-14T11:12:49.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7faa7a22d640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7faa740c9920 0x7faa7415c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:48554/0 (socket says 172.21.15.26:48554) 2023-10-14T11:12:49.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7faa7a22d640 1 -- 172.21.15.26:0/2025924868 learned_addr learned my addr 172.21.15.26:0/2025924868 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:49.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7ff6c7fff640 1 -- 172.21.15.26:0/2282046181 shutdown_connections 2023-10-14T11:12:49.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7ff6c7fff640 1 --2- 172.21.15.26:0/2282046181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6c0057810 0x7ff6c00eb970 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7ff6c7fff640 1 -- 172.21.15.26:0/2282046181 >> 172.21.15.26:0/2282046181 conn(0x7ff6c0056d20 msgr2=0x7ff6c0057100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:49.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.967+0000 7f4015cd6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40100cae00 0x7f40100705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.967+0000 7f4015cd6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f40100cea20 0x7f4010158500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7f400ffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f40100cea20 0x7f4010158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7f400ffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f40100cea20 0x7f4010158500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:37146/0 (socket says 172.21.15.26:37146) 2023-10-14T11:12:49.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7f400ffff640 1 -- 172.21.15.26:0/2631189436 learned_addr learned my addr 172.21.15.26:0/2631189436 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:49.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7facbaffd640 1 -- 172.21.15.26:0/2567922566 --> [v2:172.21.15.110:6800/3436135045,v1:172.21.15.110:6801/3436135045] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7facb0002cc0 con 0x7facb406fa40 2023-10-14T11:12:49.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7f4015cd6640 1 -- 172.21.15.26:0/2631189436 --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4010070ee0 con 0x7f401015cfd0 2023-10-14T11:12:49.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7f4015cd6640 1 -- 172.21.15.26:0/2631189436 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4010072120 con 0x7f40100cea20 2023-10-14T11:12:49.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7f4015cd6640 1 -- 172.21.15.26:0/2631189436 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40100711c0 con 0x7f40100cae00 2023-10-14T11:12:49.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7f400f7fe640 1 --2- 172.21.15.26:0/2631189436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40100cae00 0x7f40100705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7ff6c7fff640 1 -- 172.21.15.26:0/2282046181 shutdown_connections 2023-10-14T11:12:49.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7faa79a2c640 1 --2- 172.21.15.26:0/2025924868 >> v2:172.21.15.110:3300/0 conn(0x7faa740c9d00 0x7faa740cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7faa7922b640 1 -- 172.21.15.26:0/2025924868 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069816235 0 0) 0x7faa7415d4f0 con 0x7faa740c9920 2023-10-14T11:12:49.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7faa7922b640 1 -- 172.21.15.26:0/2025924868 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa64003530 con 0x7faa740c9920 2023-10-14T11:12:49.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7ff6c7fff640 1 -- 172.21.15.26:0/2282046181 wait complete. 2023-10-14T11:12:49.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7f400ffff640 1 -- 172.21.15.26:0/2631189436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40100cae00 msgr2=0x7f40100705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:49.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7f400ffff640 1 --2- 172.21.15.26:0/2631189436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40100cae00 0x7f40100705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7f400ffff640 1 -- 172.21.15.26:0/2631189436 >> v1:172.21.15.26:6789/0 conn(0x7f401015cfd0 legacy=0x7f40100ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7faa7922b640 1 -- 172.21.15.26:0/2025924868 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 689289675 0 0) 0x7faa64003530 con 0x7faa740c9920 2023-10-14T11:12:49.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7faa7922b640 1 -- 172.21.15.26:0/2025924868 >> v2:172.21.15.110:3300/0 conn(0x7faa740c9d00 msgr2=0x7faa740cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:49.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7faa7922b640 1 --2- 172.21.15.26:0/2025924868 >> v2:172.21.15.110:3300/0 conn(0x7faa740c9d00 0x7faa740cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7faa7922b640 1 -- 172.21.15.26:0/2025924868 >> v1:172.21.15.26:6789/0 conn(0x7faa740ccec0 legacy=0x7faa740712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7faa7922b640 1 -- 172.21.15.26:0/2025924868 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa74070dd0 con 0x7faa740c9920 2023-10-14T11:12:49.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7f400ffff640 1 -- 172.21.15.26:0/2631189436 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40100714a0 con 0x7f40100cea20 2023-10-14T11:12:49.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7faccd7fa640 1 -- 172.21.15.26:0/2567922566 <== osd.4 v2:172.21.15.110:6800/3436135045 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7facb0002cc0 con 0x7facb406fa40 2023-10-14T11:12:49.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7facbaffd640 1 -- 172.21.15.26:0/2567922566 >> [v2:172.21.15.110:6800/3436135045,v1:172.21.15.110:6801/3436135045] conn(0x7facb406fa40 msgr2=0x7facb4071e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7facbaffd640 1 --2- 172.21.15.26:0/2567922566 >> [v2:172.21.15.110:6800/3436135045,v1:172.21.15.110:6801/3436135045] conn(0x7facb406fa40 0x7facb4071e80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7faa7922b640 1 -- 172.21.15.26:0/2025924868 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7faa68001680 con 0x7faa740c9920 2023-10-14T11:12:49.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7faa7922b640 1 -- 172.21.15.26:0/2025924868 >> v1:172.21.15.110:6789/0 conn(0x7faa740c9920 legacy=0x7faa7415c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7faa7922b640 1 --2- 172.21.15.26:0/2025924868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa640039d0 0x7faa64003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7faa7922b640 1 --2- 172.21.15.26:0/2025924868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa64004330 0x7faa640047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7faa7922b640 1 --2- 172.21.15.26:0/2025924868 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa64005070 0x7faa6400ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7faa7922b640 1 -- 172.21.15.26:0/2025924868 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa74070af0 con 0x7faa64004330 2023-10-14T11:12:49.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7faa7922b640 1 -- 172.21.15.26:0/2025924868 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa64007b10 con 0x7faa640039d0 2023-10-14T11:12:49.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7faa7922b640 1 -- 172.21.15.26:0/2025924868 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa64007cd0 con 0x7faa64005070 2023-10-14T11:12:49.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7facbaffd640 1 -- 172.21.15.26:0/2567922566 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7facb4066500 msgr2=0x7facb40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7facbaffd640 1 --2- 172.21.15.26:0/2567922566 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7facb4066500 0x7facb40689c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7facc40011f0 tx=0x7facc4007d40 comp rx=0 tx=0).stop 2023-10-14T11:12:49.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7facbaffd640 1 -- 172.21.15.26:0/2567922566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facc804bbe0 msgr2=0x7facc80d4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:49.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7facbaffd640 1 --2- 172.21.15.26:0/2567922566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facc804bbe0 0x7facc80d4d30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7facbc00ba80 tx=0x7facbc01b6b0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7facd57a6640 1 -- 172.21.15.26:0/2567922566 reap_dead start 2023-10-14T11:12:49.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7faa7aa2e640 1 --2- 172.21.15.26:0/2025924868 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa64005070 0x7faa6400ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7ff6c7fff640 1 Processor -- start 2023-10-14T11:12:49.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.971+0000 7faa7a22d640 1 --2- 172.21.15.26:0/2025924868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa640039d0 0x7faa64003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7facbaffd640 1 -- 172.21.15.26:0/2567922566 shutdown_connections 2023-10-14T11:12:49.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7faa7aa2e640 1 -- 172.21.15.26:0/2025924868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa640039d0 msgr2=0x7faa64003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:49.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7faa7aa2e640 1 --2- 172.21.15.26:0/2025924868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa640039d0 0x7faa64003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7faa79a2c640 1 --2- 172.21.15.26:0/2025924868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa64004330 0x7faa640047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:49.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7ff6c7fff640 1 -- start start 2023-10-14T11:12:49.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7facbaffd640 1 -- 172.21.15.26:0/2567922566 >> 172.21.15.26:0/2567922566 conn(0x7facc8054b10 msgr2=0x7facc8004990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:49.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7faa7aa2e640 1 -- 172.21.15.26:0/2025924868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa64004330 msgr2=0x7faa640047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:49.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7faa7aa2e640 1 --2- 172.21.15.26:0/2025924868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa64004330 0x7faa640047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:49.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7faa7aa2e640 1 -- 172.21.15.26:0/2025924868 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa64003530 con 0x7faa64005070 2023-10-14T11:12:49.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7faa79a2c640 1 --2- 172.21.15.26:0/2025924868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa64004330 0x7faa640047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:49.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7facbaffd640 1 -- 172.21.15.26:0/2567922566 shutdown_connections 2023-10-14T11:12:49.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7facbaffd640 1 -- 172.21.15.26:0/2567922566 wait complete. 2023-10-14T11:12:49.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7ff6c7fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6c0055ac0 0x7ff6c00dd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7ff6c7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6c0057810 0x7ff6c0037e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7ff6c7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6c00eaa50 0x7ff6c00084d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:49.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7ff6c7fff640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c0037a00 con 0x7ff6c0057810 2023-10-14T11:12:49.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7ff6c7fff640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c00db5b0 con 0x7ff6c00eaa50 2023-10-14T11:12:49.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7ff6c7fff640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c0009040 con 0x7ff6c0055ac0 2023-10-14T11:12:49.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7f7550a17640 1 Processor -- start 2023-10-14T11:12:50.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7f7550a17640 1 -- start start 2023-10-14T11:12:50.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7ff6c6ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6c0055ac0 0x7ff6c00dd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7ff6c6ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6c0055ac0 0x7ff6c00dd4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58274/0 (socket says 172.21.15.26:58274) 2023-10-14T11:12:50.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7ff6c6ffd640 1 -- 172.21.15.26:0/745691091 learned_addr learned my addr 172.21.15.26:0/745691091 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7ff6c77fe640 1 --2- 172.21.15.26:0/745691091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6c00eaa50 0x7ff6c00084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7ff6c6ffd640 1 -- 172.21.15.26:0/745691091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6c00eaa50 msgr2=0x7ff6c00084d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7ff6c6ffd640 1 --2- 172.21.15.26:0/745691091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6c00eaa50 0x7ff6c00084d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7ff6c6ffd640 1 -- 172.21.15.26:0/745691091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6c0057810 msgr2=0x7ff6c0037e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7ff6c6ffd640 1 --2- 172.21.15.26:0/745691091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6c0057810 0x7ff6c0037e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7ff6c6ffd640 1 -- 172.21.15.26:0/745691091 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c804f100 con 0x7ff6c0055ac0 2023-10-14T11:12:50.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7ff6c77fe640 1 --2- 172.21.15.26:0/745691091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6c00eaa50 0x7ff6c00084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:12:50.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7ff6c6ffd640 1 --2- 172.21.15.26:0/745691091 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6c0055ac0 0x7ff6c00dd4d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff6b800c400 tx=0x7ff6b800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7ff6af7fe640 1 -- 172.21.15.26:0/745691091 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8005cf0 con 0x7ff6c0055ac0 2023-10-14T11:12:50.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7ff6af7fe640 1 -- 172.21.15.26:0/745691091 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b8005e50 con 0x7ff6c0055ac0 2023-10-14T11:12:50.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7ff6af7fe640 1 -- 172.21.15.26:0/745691091 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b80072d0 con 0x7ff6c0055ac0 2023-10-14T11:12:50.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.975+0000 7f400ffff640 1 --2- 172.21.15.26:0/2631189436 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40100cea20 0x7f4010158500 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4008009e50 tx=0x7f400801f210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24fcd7fd939dd104 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f400effd640 1 -- 172.21.15.26:0/2631189436 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40080af400 con 0x7f40100cea20 2023-10-14T11:12:50.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f400effd640 1 -- 172.21.15.26:0/2631189436 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40080ab050 con 0x7f40100cea20 2023-10-14T11:12:50.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f400effd640 1 -- 172.21.15.26:0/2631189436 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40080af780 con 0x7f40100cea20 2023-10-14T11:12:50.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7ff6c7fff640 1 -- 172.21.15.26:0/745691091 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c0009320 con 0x7ff6c0055ac0 2023-10-14T11:12:50.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7ff6c7fff640 1 -- 172.21.15.26:0/745691091 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c0037690 con 0x7ff6c0055ac0 2023-10-14T11:12:50.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7faa7aa2e640 1 -- 172.21.15.26:0/2025924868 reap_dead start 2023-10-14T11:12:50.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f7550a17640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f754c0ce0b0 0x7f754c0d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f7550a17640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f754c0d1240 0x7f754c0b6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f7550a17640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f754c0d16b0 con 0x7f754c15cf00 2023-10-14T11:12:50.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f7550a17640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f754c15d2e0 con 0x7f754c0ce0b0 2023-10-14T11:12:50.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f7550a17640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c0d1930 con 0x7f754c0d1240 2023-10-14T11:12:50.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f4015cd6640 1 -- 172.21.15.26:0/2631189436 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40100cea20 msgr2=0x7f4010158500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f4015cd6640 1 --2- 172.21.15.26:0/2631189436 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40100cea20 0x7f4010158500 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4008009e50 tx=0x7f400801f210 comp rx=0 tx=0).stop 2023-10-14T11:12:50.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f4015cd6640 1 -- 172.21.15.26:0/2631189436 shutdown_connections 2023-10-14T11:12:50.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7faa7aa2e640 1 --2- 172.21.15.26:0/2025924868 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa64005070 0x7faa6400ffa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faa6c001e70 tx=0x7faa6c01c700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=113e7edff70178e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f754ad9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f754c0d1240 0x7f754c0b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f754ad9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f754c0d1240 0x7f754c0b6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58278/0 (socket says 172.21.15.26:58278) 2023-10-14T11:12:50.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f754ad9d640 1 -- 172.21.15.26:0/754433958 learned_addr learned my addr 172.21.15.26:0/754433958 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f4015cd6640 1 --2- 172.21.15.26:0/2631189436 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40100cea20 0x7f4010158500 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f754ad9d640 1 -- 172.21.15.26:0/754433958 >> v2:172.21.15.110:3300/0 conn(0x7f754c0ce0b0 msgr2=0x7f754c0d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:50.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f4015cd6640 1 --2- 172.21.15.26:0/2631189436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40100cae00 0x7f40100705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f4015cd6640 1 -- 172.21.15.26:0/2631189436 >> 172.21.15.26:0/2631189436 conn(0x7f401006a290 msgr2=0x7f401006a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7faa7922b640 1 -- 172.21.15.26:0/2025924868 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c003b80 con 0x7faa64005070 2023-10-14T11:12:50.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7faa7922b640 1 -- 172.21.15.26:0/2025924868 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c003d00 con 0x7faa64005070 2023-10-14T11:12:50.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7faa7922b640 1 -- 172.21.15.26:0/2025924868 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c005310 con 0x7faa64005070 2023-10-14T11:12:50.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f7549d9b640 1 --2- 172.21.15.26:0/754433958 >> v2:172.21.15.110:3300/0 conn(0x7f754c0ce0b0 0x7f754c0d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f4015cd6640 1 -- 172.21.15.26:0/2631189436 shutdown_connections 2023-10-14T11:12:50.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7faa7c491640 1 -- 172.21.15.26:0/2025924868 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa64005070 msgr2=0x7faa6400ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7faa7c491640 1 --2- 172.21.15.26:0/2025924868 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa64005070 0x7faa6400ffa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faa6c001e70 tx=0x7faa6c01c700 comp rx=0 tx=0).stop 2023-10-14T11:12:50.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7ff6ad7fa640 1 -- 172.21.15.26:0/745691091 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff6c0056a00 con 0x7ff6c0055ac0 2023-10-14T11:12:50.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f754ad9d640 1 --2- 172.21.15.26:0/754433958 >> v2:172.21.15.110:3300/0 conn(0x7f754c0ce0b0 0x7f754c0d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f754ad9d640 1 -- 172.21.15.26:0/754433958 >> v1:172.21.15.26:6789/0 conn(0x7f754c15cf00 legacy=0x7f754c0cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f754ad9d640 1 -- 172.21.15.26:0/754433958 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c0d1c10 con 0x7f754c0d1240 2023-10-14T11:12:50.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.979+0000 7f7549d9b640 1 --2- 172.21.15.26:0/754433958 >> v2:172.21.15.110:3300/0 conn(0x7f754c0ce0b0 0x7f754c0d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:50.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.983+0000 7f4015cd6640 1 -- 172.21.15.26:0/2631189436 wait complete. 2023-10-14T11:12:50.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.983+0000 7faa7c491640 1 -- 172.21.15.26:0/2025924868 shutdown_connections 2023-10-14T11:12:50.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.983+0000 7faa7c491640 1 --2- 172.21.15.26:0/2025924868 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa64005070 0x7faa6400ffa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.983+0000 7faa7c491640 1 -- 172.21.15.26:0/2025924868 >> 172.21.15.26:0/2025924868 conn(0x7faa7406c190 msgr2=0x7faa7406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.983+0000 7ff6af7fe640 1 -- 172.21.15.26:0/745691091 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff6b8007430 con 0x7ff6c0055ac0 2023-10-14T11:12:50.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.983+0000 7f45160ea640 1 Processor -- start 2023-10-14T11:12:50.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.983+0000 7faa7c491640 1 -- 172.21.15.26:0/2025924868 shutdown_connections 2023-10-14T11:12:50.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.983+0000 7faa7c491640 1 -- 172.21.15.26:0/2025924868 wait complete. 2023-10-14T11:12:50.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.983+0000 7f45160ea640 1 -- start start 2023-10-14T11:12:50.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.983+0000 7ff6af7fe640 1 --2- 172.21.15.26:0/745691091 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff6b40664d0 0x7ff6b4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.983+0000 7ff6af7fe640 1 -- 172.21.15.26:0/745691091 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff6b8083690 con 0x7ff6c0055ac0 2023-10-14T11:12:50.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.983+0000 7ff6af7fe640 1 --2- 172.21.15.26:0/745691091 >> [v2:172.21.15.26:6824/1796231477,v1:172.21.15.26:6825/1796231477] conn(0x7ff6b406fa90 0x7ff6b4071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.983+0000 7ff6af7fe640 1 -- 172.21.15.26:0/745691091 --> [v2:172.21.15.26:6824/1796231477,v1:172.21.15.26:6825/1796231477] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6b40725a0 con 0x7ff6b406fa90 2023-10-14T11:12:50.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.983+0000 7ff6af7fe640 1 -- 172.21.15.26:0/745691091 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6b8050830 con 0x7ff6c0055ac0 2023-10-14T11:12:50.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.983+0000 7f45160ea640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45101591e0 0x7f45100c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f4015cd6640 1 Processor -- start 2023-10-14T11:12:50.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f45160ea640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f45100ca430 0x7f4510071c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f45160ea640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4510071020 con 0x7f45100721b0 2023-10-14T11:12:50.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7faa7c491640 1 Processor -- start 2023-10-14T11:12:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f754ad9d640 1 --2- 172.21.15.26:0/754433958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f754c0d1240 0x7f754c0b6650 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7544009870 tx=0x7f754401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=300940f89eeca5e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f4015cd6640 1 -- start start 2023-10-14T11:12:50.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f45160ea640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45100c8e50 con 0x7f45100ca430 2023-10-14T11:12:50.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f45160ea640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45100c9130 con 0x7f45101591e0 2023-10-14T11:12:50.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f450f7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45101591e0 0x7f45100c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7ff6c67fc640 1 --2- 172.21.15.26:0/745691091 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff6b40664d0 0x7ff6b4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f450effd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f45100ca430 0x7f4510071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f450f7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45101591e0 0x7f45100c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58280/0 (socket says 172.21.15.26:58280) 2023-10-14T11:12:50.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f450f7fe640 1 -- 172.21.15.26:0/3905684725 learned_addr learned my addr 172.21.15.26:0/3905684725 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7ff6c77fe640 1 --2- 172.21.15.26:0/745691091 >> [v2:172.21.15.26:6824/1796231477,v1:172.21.15.26:6825/1796231477] conn(0x7ff6b406fa90 0x7ff6b4071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f754959a640 1 -- 172.21.15.26:0/754433958 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75440aa610 con 0x7f754c0d1240 2023-10-14T11:12:50.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f754959a640 1 -- 172.21.15.26:0/754433958 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75440a6040 con 0x7f754c0d1240 2023-10-14T11:12:50.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f754959a640 1 -- 172.21.15.26:0/754433958 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75440aa610 con 0x7f754c0d1240 2023-10-14T11:12:50.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f4015cd6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40100cae00 0x7f4010152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7ff6c77fe640 1 --2- 172.21.15.26:0/745691091 >> [v2:172.21.15.26:6824/1796231477,v1:172.21.15.26:6825/1796231477] conn(0x7ff6b406fa90 0x7ff6b4071ed0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7ff6c67fc640 1 --2- 172.21.15.26:0/745691091 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff6b40664d0 0x7ff6b4068990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0039910 tx=0x7ff6c8067b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f4015cd6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40100cea20 0x7f40100b3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f4015cd6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f401015cfd0 0x7f4010149c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f4006ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40100cea20 0x7f40100b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f400ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f401015cfd0 0x7f4010149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7faa7c491640 1 -- start start 2023-10-14T11:12:50.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f4006ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40100cea20 0x7f40100b3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36192/0 (socket says 172.21.15.26:36192) 2023-10-14T11:12:50.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7faa7c491640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa64005070 0x7faa74157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7faa7c491640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa74157780 0x7faa74157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7faa7c491640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa740b3500 0x7faa740b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7faa7c491640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa740b3ec0 con 0x7faa64005070 2023-10-14T11:12:50.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7faa7c491640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa740c5ec0 con 0x7faa740b3500 2023-10-14T11:12:50.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7faa7c491640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa74157570 con 0x7faa74157780 2023-10-14T11:12:50.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f400f7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40100cae00 0x7f4010152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7faa7a22d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa64005070 0x7faa74157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7faa7aa2e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa740b3500 0x7faa740b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7faa7a22d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa64005070 0x7faa74157cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36200/0 (socket says 172.21.15.26:36200) 2023-10-14T11:12:50.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7faa7a22d640 1 -- 172.21.15.26:0/2398437551 learned_addr learned my addr 172.21.15.26:0/2398437551 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f400f7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40100cae00 0x7f4010152180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58284/0 (socket says 172.21.15.26:58284) 2023-10-14T11:12:50.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f4006ffd640 1 -- 172.21.15.26:0/2171784204 learned_addr learned my addr 172.21.15.26:0/2171784204 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f4015cd6640 1 -- 172.21.15.26:0/2171784204 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401015bc80 con 0x7f40100cea20 2023-10-14T11:12:50.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f4015cd6640 1 -- 172.21.15.26:0/2171784204 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4010159be0 con 0x7f401015cfd0 2023-10-14T11:12:50.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f4015cd6640 1 -- 172.21.15.26:0/2171784204 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4010159ec0 con 0x7f40100cae00 2023-10-14T11:12:50.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f400f7fe640 1 -- 172.21.15.26:0/2171784204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f401015cfd0 msgr2=0x7f4010149c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f7550a17640 1 -- 172.21.15.26:0/754433958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f754c0d1240 msgr2=0x7f754c0b6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f7550a17640 1 --2- 172.21.15.26:0/754433958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f754c0d1240 0x7f754c0b6650 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7544009870 tx=0x7f754401c4b0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f7550a17640 1 -- 172.21.15.26:0/754433958 shutdown_connections 2023-10-14T11:12:50.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f7550a17640 1 --2- 172.21.15.26:0/754433958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f754c0d1240 0x7f754c0b6650 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f7550a17640 1 --2- 172.21.15.26:0/754433958 >> v2:172.21.15.110:3300/0 conn(0x7f754c0ce0b0 0x7f754c0d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f450e7fc640 1 -- 172.21.15.26:0/3905684725 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008161758 0 0) 0x7f4510071020 con 0x7f45100721b0 2023-10-14T11:12:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f450e7fc640 1 -- 172.21.15.26:0/3905684725 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44f8003530 con 0x7f45100721b0 2023-10-14T11:12:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f450e7fc640 1 -- 172.21.15.26:0/3905684725 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 980686676 0 0) 0x7f44f8003530 con 0x7f45100721b0 2023-10-14T11:12:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f450e7fc640 1 -- 172.21.15.26:0/3905684725 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45101591e0 msgr2=0x7f45100c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f450e7fc640 1 --2- 172.21.15.26:0/3905684725 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45101591e0 0x7f45100c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f450e7fc640 1 -- 172.21.15.26:0/3905684725 >> v2:172.21.15.110:3300/0 conn(0x7f45100ca430 msgr2=0x7f4510071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:50.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f450e7fc640 1 --2- 172.21.15.26:0/3905684725 >> v2:172.21.15.110:3300/0 conn(0x7f45100ca430 0x7f4510071c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f450e7fc640 1 -- 172.21.15.26:0/3905684725 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45100c9410 con 0x7f45100721b0 2023-10-14T11:12:50.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f450e7fc640 1 -- 172.21.15.26:0/3905684725 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f4500001680 con 0x7f45100721b0 2023-10-14T11:12:50.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f450e7fc640 1 -- 172.21.15.26:0/3905684725 >> v1:172.21.15.110:6789/0 conn(0x7f45100721b0 legacy=0x7f45100b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f450e7fc640 1 --2- 172.21.15.26:0/3905684725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44f8003980 0x7f44f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f450e7fc640 1 --2- 172.21.15.26:0/3905684725 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44f80047d0 0x7f44f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f450e7fc640 1 --2- 172.21.15.26:0/3905684725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44f8009980 0x7f44f8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f450e7fc640 1 -- 172.21.15.26:0/3905684725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100c8e50 con 0x7f44f8003980 2023-10-14T11:12:50.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f450e7fc640 1 -- 172.21.15.26:0/3905684725 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100c9130 con 0x7f44f8009980 2023-10-14T11:12:50.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f450e7fc640 1 -- 172.21.15.26:0/3905684725 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f8009df0 con 0x7f44f80047d0 2023-10-14T11:12:50.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f450ffff640 1 --2- 172.21.15.26:0/3905684725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44f8009980 0x7f44f8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f450ffff640 1 -- 172.21.15.26:0/3905684725 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44f80047d0 msgr2=0x7f44f8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:50.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f450ffff640 1 --2- 172.21.15.26:0/3905684725 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44f80047d0 0x7f44f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f450ffff640 1 -- 172.21.15.26:0/3905684725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44f8003980 msgr2=0x7f44f8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:50.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f450ffff640 1 --2- 172.21.15.26:0/3905684725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44f8003980 0x7f44f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f450ffff640 1 -- 172.21.15.26:0/3905684725 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f8003530 con 0x7f44f8009980 2023-10-14T11:12:50.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7faa7a22d640 1 -- 172.21.15.26:0/2398437551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa74157780 msgr2=0x7faa74157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7faa7a22d640 1 --2- 172.21.15.26:0/2398437551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa74157780 0x7faa74157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f7550a17640 1 -- 172.21.15.26:0/754433958 >> 172.21.15.26:0/754433958 conn(0x7f754c0b4470 msgr2=0x7f754c0b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7faa7a22d640 1 -- 172.21.15.26:0/2398437551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa740b3500 msgr2=0x7faa740b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7faa7a22d640 1 --2- 172.21.15.26:0/2398437551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa740b3500 0x7faa740b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.987+0000 7f400ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f401015cfd0 0x7f4010149c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:37196/0 (socket says 172.21.15.26:37196) 2023-10-14T11:12:50.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7ff6af7fe640 1 -- 172.21.15.26:0/745691091 <== osd.0 v2:172.21.15.26:6824/1796231477 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7ff6b40725a0 con 0x7ff6b406fa90 2023-10-14T11:12:50.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f400f7fe640 1 --2- 172.21.15.26:0/2171784204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f401015cfd0 0x7f4010149c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f400f7fe640 1 -- 172.21.15.26:0/2171784204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40100cea20 msgr2=0x7f40100b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f400f7fe640 1 --2- 172.21.15.26:0/2171784204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40100cea20 0x7f40100b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f400f7fe640 1 -- 172.21.15.26:0/2171784204 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4008009b30 con 0x7f40100cae00 2023-10-14T11:12:50.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f400ffff640 1 --2- 172.21.15.26:0/2171784204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f401015cfd0 0x7f4010149c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-10-14T11:12:50.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7faa7a22d640 1 -- 172.21.15.26:0/2398437551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa740b24d0 con 0x7faa64005070 2023-10-14T11:12:50.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f400f7fe640 1 --2- 172.21.15.26:0/2171784204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40100cae00 0x7f4010152180 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f400000e870 tx=0x7f400000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f7550a17640 1 -- 172.21.15.26:0/754433958 shutdown_connections 2023-10-14T11:12:50.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f7550a17640 1 -- 172.21.15.26:0/754433958 wait complete. 2023-10-14T11:12:50.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f400cff9640 1 -- 172.21.15.26:0/2171784204 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400000ee60 con 0x7f40100cae00 2023-10-14T11:12:50.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7faa7a22d640 1 --2- 172.21.15.26:0/2398437551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa64005070 0x7faa74157cb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7faa68004f10 tx=0x7faa68007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f400cff9640 1 -- 172.21.15.26:0/2171784204 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400000c940 con 0x7f40100cae00 2023-10-14T11:12:50.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f400cff9640 1 -- 172.21.15.26:0/2171784204 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400000ccd0 con 0x7f40100cae00 2023-10-14T11:12:50.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7faa72ffd640 1 -- 172.21.15.26:0/2398437551 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6800f7b0 con 0x7faa64005070 2023-10-14T11:12:50.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7faa72ffd640 1 -- 172.21.15.26:0/2398437551 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6800f930 con 0x7faa64005070 2023-10-14T11:12:50.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7faa72ffd640 1 -- 172.21.15.26:0/2398437551 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6800fce0 con 0x7faa64005070 2023-10-14T11:12:50.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f4015cd6640 1 -- 172.21.15.26:0/2171784204 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f401015b630 con 0x7f40100cae00 2023-10-14T11:12:50.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.991+0000 7f4015cd6640 1 -- 172.21.15.26:0/2171784204 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40101598b0 con 0x7f40100cae00 2023-10-14T11:12:50.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7faa7c491640 1 -- 172.21.15.26:0/2398437551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa740b27b0 con 0x7faa64005070 2023-10-14T11:12:50.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7faa7c491640 1 -- 172.21.15.26:0/2398437551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa740c5b50 con 0x7faa64005070 2023-10-14T11:12:50.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f4015cd6640 1 -- 172.21.15.26:0/2171784204 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f401015b4b0 con 0x7f40100cae00 2023-10-14T11:12:50.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7faa7c491640 1 -- 172.21.15.26:0/2398437551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa740b2cd0 con 0x7faa64005070 2023-10-14T11:12:50.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f7550a17640 1 Processor -- start 2023-10-14T11:12:50.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f7550a17640 1 -- start start 2023-10-14T11:12:50.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f7550a17640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f754c0ce0b0 0x7f754c159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f7550a17640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f754c0d1240 0x7f754c150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f7550a17640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f754c15cf00 0x7f754c0cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f7550a17640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c0ca790 con 0x7f754c0d1240 2023-10-14T11:12:50.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f7550a17640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c151300 con 0x7f754c0ce0b0 2023-10-14T11:12:50.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f7550a17640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c1515e0 con 0x7f754c15cf00 2023-10-14T11:12:50.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f754ad9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f754c15cf00 0x7f754c0cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f754ad9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f754c15cf00 0x7f754c0cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58312/0 (socket says 172.21.15.26:58312) 2023-10-14T11:12:50.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f754ad9d640 1 -- 172.21.15.26:0/2429743661 learned_addr learned my addr 172.21.15.26:0/2429743661 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f754a59c640 1 --2- 172.21.15.26:0/2429743661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f754c0ce0b0 0x7f754c159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f7549d9b640 1 --2- 172.21.15.26:0/2429743661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f754c0d1240 0x7f754c150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f754ad9d640 1 -- 172.21.15.26:0/2429743661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f754c0ce0b0 msgr2=0x7f754c159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f754ad9d640 1 --2- 172.21.15.26:0/2429743661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f754c0ce0b0 0x7f754c159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f754ad9d640 1 -- 172.21.15.26:0/2429743661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f754c0d1240 msgr2=0x7f754c150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f754ad9d640 1 --2- 172.21.15.26:0/2429743661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f754c0d1240 0x7f754c150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f754ad9d640 1 -- 172.21.15.26:0/2429743661 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75440094d0 con 0x7f754c15cf00 2023-10-14T11:12:50.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7f754ad9d640 1 --2- 172.21.15.26:0/2429743661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f754c15cf00 0x7f754c0cb230 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f75440ac040 tx=0x7f754401acf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7f7542ffd640 1 -- 172.21.15.26:0/2429743661 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75440aa610 con 0x7f754c15cf00 2023-10-14T11:12:50.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7f7542ffd640 1 -- 172.21.15.26:0/2429743661 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75440b3600 con 0x7f754c15cf00 2023-10-14T11:12:50.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7f7542ffd640 1 -- 172.21.15.26:0/2429743661 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75440b3990 con 0x7f754c15cf00 2023-10-14T11:12:50.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7f7550a17640 1 -- 172.21.15.26:0/2429743661 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754c0caa30 con 0x7f754c15cf00 2023-10-14T11:12:50.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7f7550a17640 1 -- 172.21.15.26:0/2429743661 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754c0cc670 con 0x7f754c15cf00 2023-10-14T11:12:50.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f400cff9640 1 -- 172.21.15.26:0/2171784204 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4000013470 con 0x7f40100cae00 2023-10-14T11:12:50.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7f400cff9640 1 --2- 172.21.15.26:0/2171784204 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3ff0066570 0x7f3ff0068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7f400cff9640 1 -- 172.21.15.26:0/2171784204 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f40000841b0 con 0x7f40100cae00 2023-10-14T11:12:50.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7f400cff9640 1 --2- 172.21.15.26:0/2171784204 >> [v2:172.21.15.26:6800/603797368,v1:172.21.15.26:6801/603797368] conn(0x7f3ff006fb30 0x7f3ff0071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7f400cff9640 1 -- 172.21.15.26:0/2171784204 --> [v2:172.21.15.26:6800/603797368,v1:172.21.15.26:6801/603797368] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ff0072640 con 0x7f3ff006fb30 2023-10-14T11:12:50.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7f400cff9640 1 -- 172.21.15.26:0/2171784204 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4000051320 con 0x7f40100cae00 2023-10-14T11:12:50.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7faa72ffd640 1 -- 172.21.15.26:0/2398437551 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faa6801d460 con 0x7faa64005070 2023-10-14T11:12:50.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7faa72ffd640 1 --2- 172.21.15.26:0/2398437551 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7faa580664f0 0x7faa580689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7f7542ffd640 1 -- 172.21.15.26:0/2429743661 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f75440b3af0 con 0x7f754c15cf00 2023-10-14T11:12:50.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7f4006ffd640 1 --2- 172.21.15.26:0/2171784204 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3ff0066570 0x7f3ff0068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f450ffff640 1 --2- 172.21.15.26:0/3905684725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44f8009980 0x7f44f8005190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4500007f60 tx=0x7f450001caa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69fa4652b456404c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f450e7fc640 1 -- 172.21.15.26:0/3905684725 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45000a5800 con 0x7f44f8009980 2023-10-14T11:12:50.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f450e7fc640 1 -- 172.21.15.26:0/3905684725 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45000a5960 con 0x7f44f8009980 2023-10-14T11:12:50.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.995+0000 7f450e7fc640 1 -- 172.21.15.26:0/3905684725 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45000a5dd0 con 0x7f44f8009980 2023-10-14T11:12:50.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7faa79a2c640 1 --2- 172.21.15.26:0/2398437551 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7faa580664f0 0x7faa580689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7f45160ea640 1 -- 172.21.15.26:0/3905684725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44f8009980 msgr2=0x7f44f8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7f45160ea640 1 --2- 172.21.15.26:0/3905684725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44f8009980 0x7f44f8005190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4500007f60 tx=0x7f450001caa0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7f450ffff640 1 -- 172.21.15.26:0/3905684725 reap_dead start 2023-10-14T11:12:50.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7f45160ea640 1 -- 172.21.15.26:0/3905684725 shutdown_connections 2023-10-14T11:12:50.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7f45160ea640 1 -- 172.21.15.26:0/3905684725 >> 172.21.15.26:0/3905684725 conn(0x7f451006c190 msgr2=0x7f451006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7f45160ea640 1 -- 172.21.15.26:0/3905684725 shutdown_connections 2023-10-14T11:12:50.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:49.999+0000 7f45160ea640 1 -- 172.21.15.26:0/3905684725 wait complete. 2023-10-14T11:12:50.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.003+0000 7f45160ea640 1 Processor -- start 2023-10-14T11:12:50.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.003+0000 7f400ffff640 1 --2- 172.21.15.26:0/2171784204 >> [v2:172.21.15.26:6800/603797368,v1:172.21.15.26:6801/603797368] conn(0x7f3ff006fb30 0x7f3ff0071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.003+0000 7f7542ffd640 1 --2- 172.21.15.26:0/2429743661 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f752c0664f0 0x7f752c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.003+0000 7f45160ea640 1 -- start start 2023-10-14T11:12:50.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.003+0000 7f7550a17640 1 -- 172.21.15.26:0/2429743661 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f754c0b5de0 con 0x7f754c15cf00 2023-10-14T11:12:50.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.003+0000 7faa79a2c640 1 --2- 172.21.15.26:0/2398437551 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7faa580664f0 0x7faa580689b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faa7415ba70 tx=0x7faa6000e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.003+0000 7f754a59c640 1 --2- 172.21.15.26:0/2429743661 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f752c0664f0 0x7f752c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.003+0000 7f4006ffd640 1 --2- 172.21.15.26:0/2171784204 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3ff0066570 0x7f3ff0068a30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8001770 tx=0x7f3ff8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.003+0000 7f45160ea640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45101f0980 0x7f45101f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.003+0000 7f45160ea640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45100c8290 0x7f45100c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.003+0000 7f45160ea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45101f1350 0x7f451015a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.003+0000 7f400ffff640 1 --2- 172.21.15.26:0/2171784204 >> [v2:172.21.15.26:6800/603797368,v1:172.21.15.26:6801/603797368] conn(0x7f3ff006fb30 0x7f3ff0071f70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.003+0000 7f45160ea640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100c40e0 con 0x7f45101f1350 2023-10-14T11:12:50.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.003+0000 7faa72ffd640 1 -- 172.21.15.26:0/2398437551 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faa680561c0 con 0x7faa64005070 2023-10-14T11:12:50.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.003+0000 7f45160ea640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100c43c0 con 0x7f45100c8290 2023-10-14T11:12:50.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.003+0000 7f45160ea640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45100c46a0 con 0x7f45101f0980 2023-10-14T11:12:50.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7faa72ffd640 1 --2- 172.21.15.26:0/2398437551 >> [v2:172.21.15.26:6804/1022580976,v1:172.21.15.26:6807/1022580976] conn(0x7faa58070780 0x7faa58072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7faa72ffd640 1 -- 172.21.15.26:0/2398437551 --> [v2:172.21.15.26:6804/1022580976,v1:172.21.15.26:6807/1022580976] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa580732f0 con 0x7faa58070780 2023-10-14T11:12:50.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.003+0000 7f7542ffd640 1 -- 172.21.15.26:0/2429743661 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f754411e9f0 con 0x7f754c15cf00 2023-10-14T11:12:50.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7faa72ffd640 1 -- 172.21.15.26:0/2398437551 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa68055890 con 0x7faa64005070 2023-10-14T11:12:50.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7f7542ffd640 1 --2- 172.21.15.26:0/2429743661 >> [v2:172.21.15.110:6808/3405567465,v1:172.21.15.110:6809/3405567465] conn(0x7f752c06fb30 0x7f752c071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7faa7aa2e640 1 --2- 172.21.15.26:0/2398437551 >> [v2:172.21.15.26:6804/1022580976,v1:172.21.15.26:6807/1022580976] conn(0x7faa58070780 0x7faa58072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7f754a59c640 1 --2- 172.21.15.26:0/2429743661 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f752c0664f0 0x7f752c0689b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f754c153cb0 tx=0x7f753c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7f450f7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45101f0980 0x7f45101f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7f7542ffd640 1 -- 172.21.15.26:0/2429743661 --> [v2:172.21.15.110:6808/3405567465,v1:172.21.15.110:6809/3405567465] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f752c072640 con 0x7f752c06fb30 2023-10-14T11:12:50.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7f450f7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45101f0980 0x7f45101f0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58328/0 (socket says 172.21.15.26:58328) 2023-10-14T11:12:50.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7f450f7fe640 1 -- 172.21.15.26:0/602837849 learned_addr learned my addr 172.21.15.26:0/602837849 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7f450effd640 1 --2- 172.21.15.26:0/602837849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45100c8290 0x7f45100c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7f400cff9640 1 -- 172.21.15.26:0/2171784204 <== osd.3 v2:172.21.15.26:6800/603797368 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f3ff0072640 con 0x7f3ff006fb30 2023-10-14T11:12:50.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7f7542ffd640 1 -- 172.21.15.26:0/2429743661 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75441232c0 con 0x7f754c15cf00 2023-10-14T11:12:50.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7f7549d9b640 1 --2- 172.21.15.26:0/2429743661 >> [v2:172.21.15.110:6808/3405567465,v1:172.21.15.110:6809/3405567465] conn(0x7f752c06fb30 0x7f752c071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7f7549d9b640 1 --2- 172.21.15.26:0/2429743661 >> [v2:172.21.15.110:6808/3405567465,v1:172.21.15.110:6809/3405567465] conn(0x7f752c06fb30 0x7f752c071f70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7f450effd640 1 -- 172.21.15.26:0/602837849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45101f0980 msgr2=0x7f45101f0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7f450effd640 1 --2- 172.21.15.26:0/602837849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45101f0980 0x7f45101f0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7f450effd640 1 -- 172.21.15.26:0/602837849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45101f1350 msgr2=0x7f451015a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7f450effd640 1 --2- 172.21.15.26:0/602837849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45101f1350 0x7f451015a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7f450effd640 1 -- 172.21.15.26:0/602837849 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45100c7d70 con 0x7f45100c8290 2023-10-14T11:12:50.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7f450effd640 1 --2- 172.21.15.26:0/602837849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45100c8290 0x7f45100c49e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f450400e7c0 tx=0x7f450400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7f7542ffd640 1 -- 172.21.15.26:0/2429743661 <== osd.5 v2:172.21.15.110:6808/3405567465 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f752c072640 con 0x7f752c06fb30 2023-10-14T11:12:50.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.007+0000 7faa7aa2e640 1 --2- 172.21.15.26:0/2398437551 >> [v2:172.21.15.26:6804/1022580976,v1:172.21.15.26:6807/1022580976] conn(0x7faa58070780 0x7faa58072c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.011+0000 7f44f7fff640 1 -- 172.21.15.26:0/602837849 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450400ee70 con 0x7f45100c8290 2023-10-14T11:12:50.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.011+0000 7f44f7fff640 1 -- 172.21.15.26:0/602837849 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450400c940 con 0x7f45100c8290 2023-10-14T11:12:50.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.011+0000 7f44f7fff640 1 -- 172.21.15.26:0/602837849 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450400ccf0 con 0x7f45100c8290 2023-10-14T11:12:50.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.011+0000 7f45160ea640 1 -- 172.21.15.26:0/602837849 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45100c7a40 con 0x7f45100c8290 2023-10-14T11:12:50.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.011+0000 7f45160ea640 1 -- 172.21.15.26:0/602837849 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451015ac20 con 0x7f45100c8290 2023-10-14T11:12:50.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.011+0000 7faa72ffd640 1 -- 172.21.15.26:0/2398437551 <== osd.2 v2:172.21.15.26:6804/1022580976 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7faa580732f0 con 0x7faa58070780 2023-10-14T11:12:50.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.011+0000 7fbbc8806640 1 Processor -- start 2023-10-14T11:12:50.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.011+0000 7fbbc8806640 1 -- start start 2023-10-14T11:12:50.088 INFO:teuthology.orchestra.run.smithi026.stdout:55834574858 2023-10-14T11:12:50.089 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-14T11:12:50.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.015+0000 7fbbc8806640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbbbc058a10 0x7fbbbc055440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.015+0000 7fbbc8806640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbbbc0579d0 0x7fbbbc006d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.015+0000 7fbbc8806640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbbc053840 con 0x7fbbbc0eaa20 2023-10-14T11:12:50.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.015+0000 7fbbc8806640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbbc054050 con 0x7fbbbc058a10 2023-10-14T11:12:50.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.015+0000 7fbbc8806640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbbc0eae00 con 0x7fbbbc0579d0 2023-10-14T11:12:50.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.015+0000 7fbbc9a68640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fbbbc0eaa20 0x7fbbbc056dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:48574/0 (socket says 172.21.15.26:48574) 2023-10-14T11:12:50.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.015+0000 7fbbc9a68640 1 -- 172.21.15.26:0/2304702823 learned_addr learned my addr 172.21.15.26:0/2304702823 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:50.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.015+0000 7fbbc2ffd640 1 --2- 172.21.15.26:0/2304702823 >> v2:172.21.15.26:3300/0 conn(0x7fbbbc058a10 0x7fbbbc055440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.015+0000 7fbbc2ffd640 1 -- 172.21.15.26:0/2304702823 >> v2:172.21.15.110:3300/0 conn(0x7fbbbc0579d0 msgr2=0x7fbbbc006d10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T11:12:50.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.015+0000 7fbbc2ffd640 1 --2- 172.21.15.26:0/2304702823 >> v2:172.21.15.110:3300/0 conn(0x7fbbbc0579d0 0x7fbbbc006d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.015+0000 7fbbc2ffd640 1 -- 172.21.15.26:0/2304702823 >> v1:172.21.15.110:6789/0 conn(0x7fbbbc0eaa20 legacy=0x7fbbbc056dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.019+0000 7fbbc2ffd640 1 -- 172.21.15.26:0/2304702823 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbbc058ea0 con 0x7fbbbc058a10 2023-10-14T11:12:50.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.015+0000 7f44f5ffb640 1 -- 172.21.15.26:0/602837849 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f45100c9ef0 con 0x7f45100c8290 2023-10-14T11:12:50.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.015+0000 7f44f7fff640 1 -- 172.21.15.26:0/602837849 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4504013470 con 0x7f45100c8290 2023-10-14T11:12:50.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.015+0000 7f44f7fff640 1 --2- 172.21.15.26:0/602837849 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f44fc066520 0x7f44fc0689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.019+0000 7f450f7fe640 1 --2- 172.21.15.26:0/602837849 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f44fc066520 0x7f44fc0689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.019+0000 7f450f7fe640 1 --2- 172.21.15.26:0/602837849 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f44fc066520 0x7f44fc0689e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4508004b40 tx=0x7f450800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.019+0000 7f44f7fff640 1 -- 172.21.15.26:0/602837849 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4504054fc0 con 0x7f45100c8290 2023-10-14T11:12:50.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.019+0000 7f44f7fff640 1 --2- 172.21.15.26:0/602837849 >> [v2:172.21.15.110:6816/3205286209,v1:172.21.15.110:6817/3205286209] conn(0x7f44fc0707b0 0x7f44fc072c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.019+0000 7ff6ad7fa640 1 -- 172.21.15.26:0/745691091 --> [v2:172.21.15.26:6824/1796231477,v1:172.21.15.26:6825/1796231477] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff6c00057a0 con 0x7ff6b406fa90 2023-10-14T11:12:50.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.019+0000 7f44f7fff640 1 -- 172.21.15.26:0/602837849 --> [v2:172.21.15.110:6816/3205286209,v1:172.21.15.110:6817/3205286209] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f44fc073320 con 0x7f44fc0707b0 2023-10-14T11:12:50.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.019+0000 7f44f7fff640 1 -- 172.21.15.26:0/602837849 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4504004690 con 0x7f45100c8290 2023-10-14T11:12:50.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.019+0000 7ff6af7fe640 1 -- 172.21.15.26:0/745691091 <== osd.0 v2:172.21.15.26:6824/1796231477 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff6c00057a0 con 0x7ff6b406fa90 2023-10-14T11:12:50.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.019+0000 7f450ffff640 1 --2- 172.21.15.26:0/602837849 >> [v2:172.21.15.110:6816/3205286209,v1:172.21.15.110:6817/3205286209] conn(0x7f44fc0707b0 0x7f44fc072c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.023+0000 7f450ffff640 1 --2- 172.21.15.26:0/602837849 >> [v2:172.21.15.110:6816/3205286209,v1:172.21.15.110:6817/3205286209] conn(0x7f44fc0707b0 0x7f44fc072c50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.023+0000 7ff6ad7fa640 1 -- 172.21.15.26:0/745691091 >> [v2:172.21.15.26:6824/1796231477,v1:172.21.15.26:6825/1796231477] conn(0x7ff6b406fa90 msgr2=0x7ff6b4071ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.023+0000 7ff6ad7fa640 1 --2- 172.21.15.26:0/745691091 >> [v2:172.21.15.26:6824/1796231477,v1:172.21.15.26:6825/1796231477] conn(0x7ff6b406fa90 0x7ff6b4071ed0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.023+0000 7fbbc2ffd640 1 --2- 172.21.15.26:0/2304702823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbbc058a10 0x7fbbbc055440 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc008800 tx=0x7fbbb801c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a681f40ea3295a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.023+0000 7ff6ad7fa640 1 -- 172.21.15.26:0/745691091 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff6b40664d0 msgr2=0x7ff6b4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.023+0000 7ff6ad7fa640 1 --2- 172.21.15.26:0/745691091 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff6b40664d0 0x7ff6b4068990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0039910 tx=0x7ff6c8067b60 comp rx=0 tx=0).stop 2023-10-14T11:12:50.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.023+0000 7ff6ad7fa640 1 -- 172.21.15.26:0/745691091 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6c0055ac0 msgr2=0x7ff6c00dd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.023+0000 7ff6ad7fa640 1 --2- 172.21.15.26:0/745691091 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6c0055ac0 0x7ff6c00dd4d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff6b800c400 tx=0x7ff6b800c8c0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.023+0000 7f44f7fff640 1 -- 172.21.15.26:0/602837849 <== osd.7 v2:172.21.15.110:6816/3205286209 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f44fc073320 con 0x7f44fc0707b0 2023-10-14T11:12:50.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.023+0000 7ff6c77fe640 1 -- 172.21.15.26:0/745691091 reap_dead start 2023-10-14T11:12:50.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.027+0000 7ff6ad7fa640 1 -- 172.21.15.26:0/745691091 shutdown_connections 2023-10-14T11:12:50.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.027+0000 7ff6ad7fa640 1 -- 172.21.15.26:0/745691091 >> 172.21.15.26:0/745691091 conn(0x7ff6c0056d20 msgr2=0x7ff6c0050b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.027+0000 7ff6ad7fa640 1 -- 172.21.15.26:0/745691091 shutdown_connections 2023-10-14T11:12:50.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.027+0000 7fbbc27fc640 1 -- 172.21.15.26:0/2304702823 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb80b0600 con 0x7fbbbc058a10 2023-10-14T11:12:50.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.027+0000 7ff6ad7fa640 1 -- 172.21.15.26:0/745691091 wait complete. 2023-10-14T11:12:50.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.027+0000 7fbbc27fc640 1 -- 172.21.15.26:0/2304702823 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb80b0760 con 0x7fbbbc058a10 2023-10-14T11:12:50.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.027+0000 7fbbc27fc640 1 -- 172.21.15.26:0/2304702823 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb80b0af0 con 0x7fbbbc058a10 2023-10-14T11:12:50.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.027+0000 7fbbc8806640 1 -- 172.21.15.26:0/2304702823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbbc058a10 msgr2=0x7fbbbc055440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.027+0000 7fbbc8806640 1 --2- 172.21.15.26:0/2304702823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbbc058a10 0x7fbbbc055440 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc008800 tx=0x7fbbb801c700 comp rx=0 tx=0).stop 2023-10-14T11:12:50.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.027+0000 7fbbc8806640 1 -- 172.21.15.26:0/2304702823 shutdown_connections 2023-10-14T11:12:50.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.027+0000 7fbbc8806640 1 --2- 172.21.15.26:0/2304702823 >> v2:172.21.15.110:3300/0 conn(0x7fbbbc0579d0 0x7fbbbc006d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.027+0000 7fbbc8806640 1 --2- 172.21.15.26:0/2304702823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbbc058a10 0x7fbbbc055440 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.027+0000 7fbbc8806640 1 -- 172.21.15.26:0/2304702823 >> 172.21.15.26:0/2304702823 conn(0x7fbbbc0591f0 msgr2=0x7fbbbc059600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.027+0000 7fbbc8806640 1 -- 172.21.15.26:0/2304702823 shutdown_connections 2023-10-14T11:12:50.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.027+0000 7fbbc8806640 1 -- 172.21.15.26:0/2304702823 wait complete. 2023-10-14T11:12:50.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.031+0000 7fbbc8806640 1 Processor -- start 2023-10-14T11:12:50.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.031+0000 7fbbc8806640 1 -- start start 2023-10-14T11:12:50.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.031+0000 7fbbc8806640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbbc0579d0 0x7fbbbc0df550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.031+0000 7fbbc8806640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbbc0eaa20 0x7fbbbc052ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.031+0000 7fbbc8806640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbbc053010 0x7fbbbc03ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.031+0000 7fbbc37fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbbc053010 0x7fbbbc03ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.031+0000 7fbbc9a68640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbbc0579d0 0x7fbbbc0df550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.031+0000 7fbbc37fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbbc053010 0x7fbbbc03ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58340/0 (socket says 172.21.15.26:58340) 2023-10-14T11:12:50.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.031+0000 7fbbc8806640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbbc050940 con 0x7fbbbc0579d0 2023-10-14T11:12:50.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.031+0000 7fbbc8806640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbbc04cd00 con 0x7fbbbc0eaa20 2023-10-14T11:12:50.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.031+0000 7fbbc8806640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbbc0e0910 con 0x7fbbbc053010 2023-10-14T11:12:50.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.031+0000 7fbbc37fe640 1 -- 172.21.15.26:0/3394450995 learned_addr learned my addr 172.21.15.26:0/3394450995 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.035+0000 7fbbc2ffd640 1 --2- 172.21.15.26:0/3394450995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbbc0eaa20 0x7fbbbc052ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.035+0000 7fbbc37fe640 1 -- 172.21.15.26:0/3394450995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbbc0eaa20 msgr2=0x7fbbbc052ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.035+0000 7fbbc37fe640 1 --2- 172.21.15.26:0/3394450995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbbc0eaa20 0x7fbbbc052ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.035+0000 7fbbc37fe640 1 -- 172.21.15.26:0/3394450995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbbc0579d0 msgr2=0x7fbbbc0df550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.035+0000 7fbbc37fe640 1 --2- 172.21.15.26:0/3394450995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbbc0579d0 0x7fbbbc0df550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.035+0000 7fbbc37fe640 1 -- 172.21.15.26:0/3394450995 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb8009420 con 0x7fbbbc053010 2023-10-14T11:12:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.035+0000 7fbbc2ffd640 1 --2- 172.21.15.26:0/3394450995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbbc0eaa20 0x7fbbbc052ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.035+0000 7fbbc37fe640 1 --2- 172.21.15.26:0/3394450995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbbc053010 0x7fbbbc03ce20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000b410 tx=0x7fbbb000b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.035+0000 7fbbaffff640 1 -- 172.21.15.26:0/3394450995 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0011830 con 0x7fbbbc053010 2023-10-14T11:12:50.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.035+0000 7fbbaffff640 1 -- 172.21.15.26:0/3394450995 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb0011990 con 0x7fbbbc053010 2023-10-14T11:12:50.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.035+0000 7fbbaffff640 1 -- 172.21.15.26:0/3394450995 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0011d40 con 0x7fbbbc053010 2023-10-14T11:12:50.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.035+0000 7fbbc8806640 1 -- 172.21.15.26:0/3394450995 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbbc0516a0 con 0x7fbbbc053010 2023-10-14T11:12:50.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.035+0000 7fbbc8806640 1 -- 172.21.15.26:0/3394450995 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbbc050e00 con 0x7fbbbc053010 2023-10-14T11:12:50.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.035+0000 7fbbc8806640 1 -- 172.21.15.26:0/3394450995 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbba4000fd0 con 0x7fbbbc053010 2023-10-14T11:12:50.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.039+0000 7f7550a17640 1 -- 172.21.15.26:0/2429743661 --> [v2:172.21.15.110:6808/3405567465,v1:172.21.15.110:6809/3405567465] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f754c151800 con 0x7f752c06fb30 2023-10-14T11:12:50.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.039+0000 7f6396e9e640 1 Processor -- start 2023-10-14T11:12:50.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.039+0000 7f7542ffd640 1 -- 172.21.15.26:0/2429743661 <== osd.5 v2:172.21.15.110:6808/3405567465 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f754c151800 con 0x7f752c06fb30 2023-10-14T11:12:50.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.039+0000 7fbbaffff640 1 -- 172.21.15.26:0/3394450995 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbbb001a400 con 0x7fbbbc053010 2023-10-14T11:12:50.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.039+0000 7f6396e9e640 1 -- start start 2023-10-14T11:12:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.039+0000 7f7550a17640 1 -- 172.21.15.26:0/2429743661 >> [v2:172.21.15.110:6808/3405567465,v1:172.21.15.110:6809/3405567465] conn(0x7f752c06fb30 msgr2=0x7f752c071f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.039+0000 7f7550a17640 1 --2- 172.21.15.26:0/2429743661 >> [v2:172.21.15.110:6808/3405567465,v1:172.21.15.110:6809/3405567465] conn(0x7f752c06fb30 0x7f752c071f70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.039+0000 7f7550a17640 1 -- 172.21.15.26:0/2429743661 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f752c0664f0 msgr2=0x7f752c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.039+0000 7f7550a17640 1 --2- 172.21.15.26:0/2429743661 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f752c0664f0 0x7f752c0689b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f754c153cb0 tx=0x7f753c009040 comp rx=0 tx=0).stop 2023-10-14T11:12:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.039+0000 7f7550a17640 1 -- 172.21.15.26:0/2429743661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f754c15cf00 msgr2=0x7f754c0cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.039+0000 7f7550a17640 1 --2- 172.21.15.26:0/2429743661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f754c15cf00 0x7f754c0cb230 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f75440ac040 tx=0x7f754401acf0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.039+0000 7f754ad9d640 1 -- 172.21.15.26:0/2429743661 reap_dead start 2023-10-14T11:12:50.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.039+0000 7f7550a17640 1 -- 172.21.15.26:0/2429743661 shutdown_connections 2023-10-14T11:12:50.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.039+0000 7f7550a17640 1 -- 172.21.15.26:0/2429743661 >> 172.21.15.26:0/2429743661 conn(0x7f754c0b4470 msgr2=0x7f754c0b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.039+0000 7fbbaffff640 1 --2- 172.21.15.26:0/3394450995 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbba80664a0 0x7fbba8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.039+0000 7f7550a17640 1 -- 172.21.15.26:0/2429743661 shutdown_connections 2023-10-14T11:12:50.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.039+0000 7f7550a17640 1 -- 172.21.15.26:0/2429743661 wait complete. 2023-10-14T11:12:50.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.039+0000 7fbbaffff640 1 -- 172.21.15.26:0/3394450995 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbbb0054910 con 0x7fbbbc053010 2023-10-14T11:12:50.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.039+0000 7f4015cd6640 1 -- 172.21.15.26:0/2171784204 --> [v2:172.21.15.26:6800/603797368,v1:172.21.15.26:6801/603797368] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f401015d410 con 0x7f3ff006fb30 2023-10-14T11:12:50.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7fbbaffff640 1 --2- 172.21.15.26:0/3394450995 >> [v2:172.21.15.26:6816/3885030983,v1:172.21.15.26:6817/3885030983] conn(0x7fbba80706b0 0x7fbba8072b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.039+0000 7f6396e9e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f63900ce0b0 0x7f63900d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.039+0000 7f6396e9e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f63900d1240 0x7f63900b6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.039+0000 7f6396e9e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63900d1670 con 0x7f639015cf00 2023-10-14T11:12:50.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f6396e9e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f639015d2e0 con 0x7f63900ce0b0 2023-10-14T11:12:50.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f6396e9e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63900d1930 con 0x7f63900d1240 2023-10-14T11:12:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7fbbaffff640 1 -- 172.21.15.26:0/3394450995 --> [v2:172.21.15.26:6816/3885030983,v1:172.21.15.26:6817/3885030983] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbba8073220 con 0x7fbba80706b0 2023-10-14T11:12:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7fbbc2ffd640 1 --2- 172.21.15.26:0/3394450995 >> [v2:172.21.15.26:6816/3885030983,v1:172.21.15.26:6817/3885030983] conn(0x7fbba80706b0 0x7fbba8072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7fbbaffff640 1 -- 172.21.15.26:0/3394450995 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbb0011ea0 con 0x7fbbbc053010 2023-10-14T11:12:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f639543b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f63900d1240 0x7f63900b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f6394c3a640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f639015cf00 0x7f63900cd9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57920/0 (socket says 172.21.15.26:57920) 2023-10-14T11:12:50.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f6394c3a640 1 -- 172.21.15.26:0/204393034 learned_addr learned my addr 172.21.15.26:0/204393034 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:50.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f638ffff640 1 --2- 172.21.15.26:0/204393034 >> v2:172.21.15.26:3300/0 conn(0x7f63900ce0b0 0x7f63900d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7fbbc9a68640 1 --2- 172.21.15.26:0/3394450995 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbba80664a0 0x7fbba8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f639543b640 1 -- 172.21.15.26:0/204393034 >> v2:172.21.15.26:3300/0 conn(0x7f63900ce0b0 msgr2=0x7f63900d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:50.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f639543b640 1 --2- 172.21.15.26:0/204393034 >> v2:172.21.15.26:3300/0 conn(0x7f63900ce0b0 0x7f63900d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f400cff9640 1 -- 172.21.15.26:0/2171784204 <== osd.3 v2:172.21.15.26:6800/603797368 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4008009210 con 0x7f3ff006fb30 2023-10-14T11:12:50.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f4015cd6640 1 -- 172.21.15.26:0/2171784204 >> [v2:172.21.15.26:6800/603797368,v1:172.21.15.26:6801/603797368] conn(0x7f3ff006fb30 msgr2=0x7f3ff0071f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f4015cd6640 1 --2- 172.21.15.26:0/2171784204 >> [v2:172.21.15.26:6800/603797368,v1:172.21.15.26:6801/603797368] conn(0x7f3ff006fb30 0x7f3ff0071f70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f4015cd6640 1 -- 172.21.15.26:0/2171784204 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3ff0066570 msgr2=0x7f3ff0068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f4015cd6640 1 --2- 172.21.15.26:0/2171784204 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3ff0066570 0x7f3ff0068a30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8001770 tx=0x7f3ff8009040 comp rx=0 tx=0).stop 2023-10-14T11:12:50.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f4015cd6640 1 -- 172.21.15.26:0/2171784204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40100cae00 msgr2=0x7f4010152180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f4015cd6640 1 --2- 172.21.15.26:0/2171784204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40100cae00 0x7f4010152180 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f400000e870 tx=0x7f400000ed30 comp rx=0 tx=0).stop 2023-10-14T11:12:50.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f400ffff640 1 -- 172.21.15.26:0/2171784204 reap_dead start 2023-10-14T11:12:50.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f4015cd6640 1 -- 172.21.15.26:0/2171784204 shutdown_connections 2023-10-14T11:12:50.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f4015cd6640 1 -- 172.21.15.26:0/2171784204 >> 172.21.15.26:0/2171784204 conn(0x7f401006a290 msgr2=0x7f40100cc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f639543b640 1 -- 172.21.15.26:0/204393034 >> v1:172.21.15.26:6789/0 conn(0x7f639015cf00 legacy=0x7f63900cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f639543b640 1 -- 172.21.15.26:0/204393034 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63900d1c10 con 0x7f63900d1240 2023-10-14T11:12:50.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f638ffff640 1 --2- 172.21.15.26:0/204393034 >> v2:172.21.15.26:3300/0 conn(0x7f63900ce0b0 0x7f63900d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:50.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7fbbc2ffd640 1 --2- 172.21.15.26:0/3394450995 >> [v2:172.21.15.26:6816/3885030983,v1:172.21.15.26:6817/3885030983] conn(0x7fbba80706b0 0x7fbba8072b50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.047+0000 7fbbc9a68640 1 --2- 172.21.15.26:0/3394450995 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbba80664a0 0x7fbba8068960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbbc404fab0 tx=0x7fbbc408af90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f4015cd6640 1 -- 172.21.15.26:0/2171784204 shutdown_connections 2023-10-14T11:12:50.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.043+0000 7f4015cd6640 1 -- 172.21.15.26:0/2171784204 wait complete. 2023-10-14T11:12:50.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.047+0000 7fbbaffff640 1 -- 172.21.15.26:0/3394450995 <== osd.1 v2:172.21.15.26:6816/3885030983 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fbba8073220 con 0x7fbba80706b0 2023-10-14T11:12:50.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.051+0000 7f639543b640 1 --2- 172.21.15.26:0/204393034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63900d1240 0x7f63900b6650 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f63900d0480 tx=0x7f637801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=882255096b72c86e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.051+0000 7f638f7fe640 1 -- 172.21.15.26:0/204393034 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63780ac630 con 0x7f63900d1240 2023-10-14T11:12:50.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.051+0000 7f638f7fe640 1 -- 172.21.15.26:0/204393034 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63780ac790 con 0x7f63900d1240 2023-10-14T11:12:50.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.051+0000 7faa7c491640 1 -- 172.21.15.26:0/2398437551 --> [v2:172.21.15.26:6804/1022580976,v1:172.21.15.26:6807/1022580976] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faa740c6000 con 0x7faa58070780 2023-10-14T11:12:50.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.051+0000 7f638f7fe640 1 -- 172.21.15.26:0/204393034 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63780acb20 con 0x7f63900d1240 2023-10-14T11:12:50.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.051+0000 7f6396e9e640 1 -- 172.21.15.26:0/204393034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63900d1240 msgr2=0x7f63900b6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.051+0000 7f6396e9e640 1 --2- 172.21.15.26:0/204393034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63900d1240 0x7f63900b6650 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f63900d0480 tx=0x7f637801c3f0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.051+0000 7f6396e9e640 1 -- 172.21.15.26:0/204393034 shutdown_connections 2023-10-14T11:12:50.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.051+0000 7f6396e9e640 1 --2- 172.21.15.26:0/204393034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63900d1240 0x7f63900b6650 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.051+0000 7f6396e9e640 1 --2- 172.21.15.26:0/204393034 >> v2:172.21.15.26:3300/0 conn(0x7f63900ce0b0 0x7f63900d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.051+0000 7f6396e9e640 1 -- 172.21.15.26:0/204393034 >> 172.21.15.26:0/204393034 conn(0x7f63900b4470 msgr2=0x7f63900b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.051+0000 7f6396e9e640 1 -- 172.21.15.26:0/204393034 shutdown_connections 2023-10-14T11:12:50.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.051+0000 7f6396e9e640 1 -- 172.21.15.26:0/204393034 wait complete. 2023-10-14T11:12:50.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.055+0000 7f44f5ffb640 1 -- 172.21.15.26:0/602837849 --> [v2:172.21.15.110:6816/3205286209,v1:172.21.15.110:6817/3205286209] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4510074010 con 0x7f44fc0707b0 2023-10-14T11:12:50.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.055+0000 7faa72ffd640 1 -- 172.21.15.26:0/2398437551 <== osd.2 v2:172.21.15.26:6804/1022580976 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faa580732f0 con 0x7faa58070780 2023-10-14T11:12:50.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.055+0000 7f44f7fff640 1 -- 172.21.15.26:0/602837849 <== osd.7 v2:172.21.15.110:6816/3205286209 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4510074010 con 0x7f44fc0707b0 2023-10-14T11:12:50.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.055+0000 7f44f5ffb640 1 -- 172.21.15.26:0/602837849 >> [v2:172.21.15.110:6816/3205286209,v1:172.21.15.110:6817/3205286209] conn(0x7f44fc0707b0 msgr2=0x7f44fc072c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.055+0000 7f44f5ffb640 1 --2- 172.21.15.26:0/602837849 >> [v2:172.21.15.110:6816/3205286209,v1:172.21.15.110:6817/3205286209] conn(0x7f44fc0707b0 0x7f44fc072c50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.055+0000 7f6396e9e640 1 Processor -- start 2023-10-14T11:12:50.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.055+0000 7f44f5ffb640 1 -- 172.21.15.26:0/602837849 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f44fc066520 msgr2=0x7f44fc0689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.055+0000 7f6396e9e640 1 -- start start 2023-10-14T11:12:50.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.055+0000 7f44f5ffb640 1 --2- 172.21.15.26:0/602837849 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f44fc066520 0x7f44fc0689e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4508004b40 tx=0x7f450800b040 comp rx=0 tx=0).stop 2023-10-14T11:12:50.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.055+0000 7f44f5ffb640 1 -- 172.21.15.26:0/602837849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45100c8290 msgr2=0x7f45100c49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.055+0000 7f44f5ffb640 1 --2- 172.21.15.26:0/602837849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45100c8290 0x7f45100c49e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f450400e7c0 tx=0x7f450400ec80 comp rx=0 tx=0).stop 2023-10-14T11:12:50.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f6396e9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63900ce0b0 0x7f639014a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f6396e9e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63900d1240 0x7f63900cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f6396e9e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f639015cf00 0x7f63900ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f6396e9e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63900cd4d0 con 0x7f639015cf00 2023-10-14T11:12:50.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f6396e9e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63900ca6d0 con 0x7f63900d1240 2023-10-14T11:12:50.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f6396e9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f639015fc90 con 0x7f63900ce0b0 2023-10-14T11:12:50.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f639543b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f639015cf00 0x7f63900ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7faa7c491640 1 -- 172.21.15.26:0/2398437551 >> [v2:172.21.15.26:6804/1022580976,v1:172.21.15.26:6807/1022580976] conn(0x7faa58070780 msgr2=0x7faa58072c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7faa7c491640 1 --2- 172.21.15.26:0/2398437551 >> [v2:172.21.15.26:6804/1022580976,v1:172.21.15.26:6807/1022580976] conn(0x7faa58070780 0x7faa58072c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f639543b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f639015cf00 0x7f63900ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36284/0 (socket says 172.21.15.26:36284) 2023-10-14T11:12:50.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f639543b640 1 -- 172.21.15.26:0/1190532853 learned_addr learned my addr 172.21.15.26:0/1190532853 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f638ffff640 1 --2- 172.21.15.26:0/1190532853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63900d1240 0x7f63900cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7faa7c491640 1 -- 172.21.15.26:0/2398437551 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7faa580664f0 msgr2=0x7faa580689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7faa7c491640 1 --2- 172.21.15.26:0/2398437551 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7faa580664f0 0x7faa580689b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faa7415ba70 tx=0x7faa6000e040 comp rx=0 tx=0).stop 2023-10-14T11:12:50.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7faa7c491640 1 -- 172.21.15.26:0/2398437551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa64005070 msgr2=0x7faa74157cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7faa7c491640 1 --2- 172.21.15.26:0/2398437551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa64005070 0x7faa74157cb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7faa68004f10 tx=0x7faa68007430 comp rx=0 tx=0).stop 2023-10-14T11:12:50.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7faa7aa2e640 1 -- 172.21.15.26:0/2398437551 reap_dead start 2023-10-14T11:12:50.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7faa7c491640 1 -- 172.21.15.26:0/2398437551 shutdown_connections 2023-10-14T11:12:50.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7faa7c491640 1 -- 172.21.15.26:0/2398437551 >> 172.21.15.26:0/2398437551 conn(0x7faa7406c190 msgr2=0x7faa740c3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f638ffff640 1 -- 172.21.15.26:0/1190532853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63900ce0b0 msgr2=0x7f639014a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T11:12:50.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f638ffff640 1 --2- 172.21.15.26:0/1190532853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63900ce0b0 0x7f639014a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f638ffff640 1 -- 172.21.15.26:0/1190532853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f639015cf00 msgr2=0x7f63900ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f638ffff640 1 --2- 172.21.15.26:0/1190532853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f639015cf00 0x7f63900ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f638ffff640 1 -- 172.21.15.26:0/1190532853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6378009420 con 0x7f63900d1240 2023-10-14T11:12:50.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f638ffff640 1 --2- 172.21.15.26:0/1190532853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63900d1240 0x7f63900cc510 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f638000cea0 tx=0x7f638000cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f450ffff640 1 -- 172.21.15.26:0/602837849 reap_dead start 2023-10-14T11:12:50.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f638d7fa640 1 -- 172.21.15.26:0/1190532853 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638000d840 con 0x7f63900d1240 2023-10-14T11:12:50.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f638d7fa640 1 -- 172.21.15.26:0/1190532853 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638000d9a0 con 0x7f63900d1240 2023-10-14T11:12:50.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f638d7fa640 1 -- 172.21.15.26:0/1190532853 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638000dd30 con 0x7f63900d1240 2023-10-14T11:12:50.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f6396e9e640 1 -- 172.21.15.26:0/1190532853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f639015ff70 con 0x7f63900d1240 2023-10-14T11:12:50.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f44f5ffb640 1 -- 172.21.15.26:0/602837849 shutdown_connections 2023-10-14T11:12:50.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7f44f5ffb640 1 -- 172.21.15.26:0/602837849 >> 172.21.15.26:0/602837849 conn(0x7f451006c190 msgr2=0x7f451006c730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.059+0000 7faa7c491640 1 -- 172.21.15.26:0/2398437551 shutdown_connections 2023-10-14T11:12:50.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.063+0000 7faa7c491640 1 -- 172.21.15.26:0/2398437551 wait complete. 2023-10-14T11:12:50.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.063+0000 7f6396e9e640 1 -- 172.21.15.26:0/1190532853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63900cbd10 con 0x7f63900d1240 2023-10-14T11:12:50.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.063+0000 7f44f5ffb640 1 -- 172.21.15.26:0/602837849 shutdown_connections 2023-10-14T11:12:50.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.063+0000 7f44f5ffb640 1 -- 172.21.15.26:0/602837849 wait complete. 2023-10-14T11:12:50.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.063+0000 7f6396e9e640 1 -- 172.21.15.26:0/1190532853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f63900b5de0 con 0x7f63900d1240 2023-10-14T11:12:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.063+0000 7f638d7fa640 1 -- 172.21.15.26:0/1190532853 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6380015440 con 0x7f63900d1240 2023-10-14T11:12:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.063+0000 7f638d7fa640 1 --2- 172.21.15.26:0/1190532853 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f63700664a0 0x7f6370068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.063+0000 7f638d7fa640 1 -- 172.21.15.26:0/1190532853 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f63800848c0 con 0x7f63900d1240 2023-10-14T11:12:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.067+0000 7f638d7fa640 1 --2- 172.21.15.26:0/1190532853 >> [v2:172.21.15.110:6824/3095626813,v1:172.21.15.110:6825/3095626813] conn(0x7f637006fa60 0x7f6370071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.067+0000 7f638d7fa640 1 -- 172.21.15.26:0/1190532853 --> [v2:172.21.15.110:6824/3095626813,v1:172.21.15.110:6825/3095626813] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6370072570 con 0x7f637006fa60 2023-10-14T11:12:50.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.067+0000 7f638d7fa640 1 -- 172.21.15.26:0/1190532853 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6380084c40 con 0x7f63900d1240 2023-10-14T11:12:50.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.067+0000 7f6394c3a640 1 --2- 172.21.15.26:0/1190532853 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f63700664a0 0x7f6370068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.067+0000 7f639543b640 1 --2- 172.21.15.26:0/1190532853 >> [v2:172.21.15.110:6824/3095626813,v1:172.21.15.110:6825/3095626813] conn(0x7f637006fa60 0x7f6370071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.153 INFO:teuthology.orchestra.run.smithi026.stdout:55834574860 2023-10-14T11:12:50.153 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T11:12:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.067+0000 7f639543b640 1 --2- 172.21.15.26:0/1190532853 >> [v2:172.21.15.110:6824/3095626813,v1:172.21.15.110:6825/3095626813] conn(0x7f637006fa60 0x7f6370071ea0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.067+0000 7f6394c3a640 1 --2- 172.21.15.26:0/1190532853 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f63700664a0 0x7f6370068960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6388000f70 tx=0x7f6388007a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.067+0000 7f638d7fa640 1 -- 172.21.15.26:0/1190532853 <== osd.6 v2:172.21.15.110:6824/3095626813 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f6370072570 con 0x7f637006fa60 2023-10-14T11:12:50.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.075+0000 7fbbc8806640 1 -- 172.21.15.26:0/3394450995 --> [v2:172.21.15.26:6816/3885030983,v1:172.21.15.26:6817/3885030983] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbba4002cc0 con 0x7fbba80706b0 2023-10-14T11:12:50.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.075+0000 7fbbaffff640 1 -- 172.21.15.26:0/3394450995 <== osd.1 v2:172.21.15.26:6816/3885030983 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbba4002cc0 con 0x7fbba80706b0 2023-10-14T11:12:50.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.079+0000 7fbbc8806640 1 -- 172.21.15.26:0/3394450995 >> [v2:172.21.15.26:6816/3885030983,v1:172.21.15.26:6817/3885030983] conn(0x7fbba80706b0 msgr2=0x7fbba8072b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.079+0000 7fbbc8806640 1 --2- 172.21.15.26:0/3394450995 >> [v2:172.21.15.26:6816/3885030983,v1:172.21.15.26:6817/3885030983] conn(0x7fbba80706b0 0x7fbba8072b50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.079+0000 7fbbc8806640 1 -- 172.21.15.26:0/3394450995 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbba80664a0 msgr2=0x7fbba8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.157 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2023-10-14T11:12:50.158 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-14T11:12:50.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.079+0000 7fbbc8806640 1 --2- 172.21.15.26:0/3394450995 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbba80664a0 0x7fbba8068960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbbc404fab0 tx=0x7fbbc408af90 comp rx=0 tx=0).stop 2023-10-14T11:12:50.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.079+0000 7fbbc8806640 1 -- 172.21.15.26:0/3394450995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbbc053010 msgr2=0x7fbbbc03ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.079+0000 7fbbc8806640 1 --2- 172.21.15.26:0/3394450995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbbc053010 0x7fbbbc03ce20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000b410 tx=0x7fbbb000b8d0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.079+0000 7fbbc37fe640 1 -- 172.21.15.26:0/3394450995 reap_dead start 2023-10-14T11:12:50.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.079+0000 7fbbc8806640 1 -- 172.21.15.26:0/3394450995 shutdown_connections 2023-10-14T11:12:50.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.079+0000 7fbbc8806640 1 -- 172.21.15.26:0/3394450995 >> 172.21.15.26:0/3394450995 conn(0x7fbbbc0591f0 msgr2=0x7fbbbc0e8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.079+0000 7fbbc8806640 1 -- 172.21.15.26:0/3394450995 shutdown_connections 2023-10-14T11:12:50.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.079+0000 7fbbc8806640 1 -- 172.21.15.26:0/3394450995 wait complete. 2023-10-14T11:12:50.161 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2023-10-14T11:12:50.162 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-14T11:12:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.091+0000 7f6396e9e640 1 -- 172.21.15.26:0/1190532853 --> [v2:172.21.15.110:6824/3095626813,v1:172.21.15.110:6825/3095626813] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f63900cbb70 con 0x7f637006fa60 2023-10-14T11:12:50.163 INFO:teuthology.orchestra.run.smithi026.stdout:55834574861 2023-10-14T11:12:50.164 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-14T11:12:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.091+0000 7f638d7fa640 1 -- 172.21.15.26:0/1190532853 <== osd.6 v2:172.21.15.110:6824/3095626813 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f63900cbb70 con 0x7f637006fa60 2023-10-14T11:12:50.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.095+0000 7f6396e9e640 1 -- 172.21.15.26:0/1190532853 >> [v2:172.21.15.110:6824/3095626813,v1:172.21.15.110:6825/3095626813] conn(0x7f637006fa60 msgr2=0x7f6370071ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.095+0000 7f6396e9e640 1 --2- 172.21.15.26:0/1190532853 >> [v2:172.21.15.110:6824/3095626813,v1:172.21.15.110:6825/3095626813] conn(0x7f637006fa60 0x7f6370071ea0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.095+0000 7f6396e9e640 1 -- 172.21.15.26:0/1190532853 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f63700664a0 msgr2=0x7f6370068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.095+0000 7f6396e9e640 1 --2- 172.21.15.26:0/1190532853 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f63700664a0 0x7f6370068960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6388000f70 tx=0x7f6388007a10 comp rx=0 tx=0).stop 2023-10-14T11:12:50.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.095+0000 7f6396e9e640 1 -- 172.21.15.26:0/1190532853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63900d1240 msgr2=0x7f63900cc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.095+0000 7f6396e9e640 1 --2- 172.21.15.26:0/1190532853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63900d1240 0x7f63900cc510 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f638000cea0 tx=0x7f638000cf90 comp rx=0 tx=0).stop 2023-10-14T11:12:50.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.095+0000 7f639543b640 1 -- 172.21.15.26:0/1190532853 reap_dead start 2023-10-14T11:12:50.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.095+0000 7f6396e9e640 1 -- 172.21.15.26:0/1190532853 shutdown_connections 2023-10-14T11:12:50.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.095+0000 7f6396e9e640 1 -- 172.21.15.26:0/1190532853 >> 172.21.15.26:0/1190532853 conn(0x7f63900b4470 msgr2=0x7f63900b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.095+0000 7f6396e9e640 1 -- 172.21.15.26:0/1190532853 shutdown_connections 2023-10-14T11:12:50.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.095+0000 7f6396e9e640 1 -- 172.21.15.26:0/1190532853 wait complete. 2023-10-14T11:12:50.169 INFO:teuthology.orchestra.run.smithi026.stdout:55834574858 2023-10-14T11:12:50.170 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T11:12:50.171 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2023-10-14T11:12:50.171 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T11:12:50.172 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2023-10-14T11:12:50.172 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-14T11:12:50.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.467+0000 7ff4c23e4640 1 Processor -- start 2023-10-14T11:12:50.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.467+0000 7ff4c23e4640 1 -- start start 2023-10-14T11:12:50.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.467+0000 7fbbf1daa640 1 Processor -- start 2023-10-14T11:12:50.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.467+0000 7ff4c23e4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff4bc15a6e0 0x7ff4bc15e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.467+0000 7ff4c23e4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4bc15aac0 0x7ff4bc0c1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.467+0000 7ff4c23e4640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4bc15f340 con 0x7ff4bc0ca720 2023-10-14T11:12:50.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.467+0000 7ff4c23e4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4bc15eaa0 con 0x7ff4bc15aac0 2023-10-14T11:12:50.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.467+0000 7ff4c23e4640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4bc15ed80 con 0x7ff4bc15a6e0 2023-10-14T11:12:50.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.467+0000 7fbbf1daa640 1 -- start start 2023-10-14T11:12:50.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.471+0000 7fbbf1daa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbec15cf00 0x7fbbec0cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.471+0000 7fbbf1daa640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbbec0cdee0 0x7fbbec0d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.471+0000 7fbbf1daa640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbec0ce340 con 0x7fbbec0d1240 2023-10-14T11:12:50.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.471+0000 7fbbf1daa640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbec15d2e0 con 0x7fbbec0cdee0 2023-10-14T11:12:50.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.471+0000 7fbbf1daa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec0d16d0 con 0x7fbbec15cf00 2023-10-14T11:12:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.471+0000 7f2aa67a7640 1 Processor -- start 2023-10-14T11:12:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.471+0000 7fbbeaffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbbec0cdee0 0x7fbbec0d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.471+0000 7fbbeaffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbbec0cdee0 0x7fbbec0d0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36302/0 (socket says 172.21.15.26:36302) 2023-10-14T11:12:50.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.467+0000 7ff4c0be1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4bc15aac0 0x7ff4bc0c1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.467+0000 7ff4c0be1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4bc15aac0 0x7ff4bc0c1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36298/0 (socket says 172.21.15.26:36298) 2023-10-14T11:12:50.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.467+0000 7ff4c0be1640 1 -- 172.21.15.26:0/3408061375 learned_addr learned my addr 172.21.15.26:0/3408061375 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.471+0000 7fbbeaffd640 1 -- 172.21.15.26:0/127985383 learned_addr learned my addr 172.21.15.26:0/127985383 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.467+0000 7ff4c13e2640 1 --2- 172.21.15.26:0/3408061375 >> v2:172.21.15.110:3300/0 conn(0x7ff4bc15a6e0 0x7ff4bc15e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.471+0000 7ff4c0be1640 1 -- 172.21.15.26:0/3408061375 >> v2:172.21.15.110:3300/0 conn(0x7ff4bc15a6e0 msgr2=0x7ff4bc15e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:50.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.471+0000 7ff4c0be1640 1 --2- 172.21.15.26:0/3408061375 >> v2:172.21.15.110:3300/0 conn(0x7ff4bc15a6e0 0x7ff4bc15e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.471+0000 7ff4c0be1640 1 -- 172.21.15.26:0/3408061375 >> v1:172.21.15.110:6789/0 conn(0x7ff4bc0ca720 legacy=0x7ff4bc0cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:50.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.471+0000 7ff4c0be1640 1 -- 172.21.15.26:0/3408061375 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc15f060 con 0x7ff4bc15aac0 2023-10-14T11:12:50.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.471+0000 7f2aa67a7640 1 -- start start 2023-10-14T11:12:50.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.471+0000 7fbbeaffd640 1 -- 172.21.15.26:0/127985383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbec15cf00 msgr2=0x7fbbec0cd9a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T11:12:50.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.471+0000 7fbbeaffd640 1 --2- 172.21.15.26:0/127985383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbec15cf00 0x7fbbec0cd9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.471+0000 7fbbeaffd640 1 -- 172.21.15.26:0/127985383 >> v1:172.21.15.26:6789/0 conn(0x7fbbec0d1240 legacy=0x7fbbec06ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:50.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.471+0000 7fbbeaffd640 1 -- 172.21.15.26:0/127985383 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec0d1930 con 0x7fbbec0cdee0 2023-10-14T11:12:50.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.475+0000 7ff4c0be1640 1 --2- 172.21.15.26:0/3408061375 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4bc15aac0 0x7ff4bc0c1e80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc072630 tx=0x7ff4b001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397b2dfe26254554 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.475+0000 7ff2978c9640 1 Processor -- start 2023-10-14T11:12:50.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.475+0000 7f2aa67a7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa00c9070 0x7f2aa0163730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.475+0000 7f2aa67a7640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa00c95b0 con 0x7f2aa00b04a0 2023-10-14T11:12:50.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.475+0000 7f2aa67a7640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa00c9890 con 0x7f2aa0158710 2023-10-14T11:12:50.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.475+0000 7f2aa67a7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00cc670 con 0x7f2aa00c9070 2023-10-14T11:12:50.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.475+0000 7f2aa4fa4640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2aa00b04a0 0x7f2aa00c8960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57944/0 (socket says 172.21.15.26:57944) 2023-10-14T11:12:50.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.475+0000 7f2aa4fa4640 1 -- 172.21.15.26:0/2068160660 learned_addr learned my addr 172.21.15.26:0/2068160660 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:50.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.475+0000 7f2aa5fa6640 1 --2- 172.21.15.26:0/2068160660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa00c9070 0x7f2aa0163730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.475+0000 7ff2978c9640 1 -- start start 2023-10-14T11:12:50.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.475+0000 7ff4affff640 1 -- 172.21.15.26:0/3408061375 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b00090d0 con 0x7ff4bc15aac0 2023-10-14T11:12:50.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.475+0000 7f2a97fff640 1 -- 172.21.15.26:0/2068160660 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529506793 0 0) 0x7f2aa00c95b0 con 0x7f2aa00b04a0 2023-10-14T11:12:50.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.475+0000 7ff4affff640 1 -- 172.21.15.26:0/3408061375 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b0009230 con 0x7ff4bc15aac0 2023-10-14T11:12:50.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.475+0000 7f2a97fff640 1 -- 172.21.15.26:0/2068160660 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a8c003530 con 0x7f2aa00b04a0 2023-10-14T11:12:50.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.475+0000 7f2a97fff640 1 -- 172.21.15.26:0/2068160660 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1879999305 0 0) 0x7f2a8c003530 con 0x7f2aa00b04a0 2023-10-14T11:12:50.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.475+0000 7ff4affff640 1 -- 172.21.15.26:0/3408061375 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b00a5a60 con 0x7ff4bc15aac0 2023-10-14T11:12:50.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.475+0000 7f2a97fff640 1 -- 172.21.15.26:0/2068160660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa00c9070 msgr2=0x7f2aa0163730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:50.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.475+0000 7f2a97fff640 1 --2- 172.21.15.26:0/2068160660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa00c9070 0x7f2aa0163730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.475+0000 7f2a97fff640 1 -- 172.21.15.26:0/2068160660 >> v1:172.21.15.110:6789/0 conn(0x7f2aa0158710 legacy=0x7f2aa00afd90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T11:12:50.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.475+0000 7f2a97fff640 1 -- 172.21.15.26:0/2068160660 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa0070520 con 0x7f2aa00b04a0 2023-10-14T11:12:50.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7fbbeaffd640 1 --2- 172.21.15.26:0/127985383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbec0cdee0 0x7fbbec0d0d00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009870 tx=0x7fbbdc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693f363bc507d3e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7f2a97fff640 1 -- 172.21.15.26:0/2068160660 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f2a900016a0 con 0x7f2aa00b04a0 2023-10-14T11:12:50.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7ff2978c9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff2901597c0 0x7ff2900ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7f2a97fff640 1 -- 172.21.15.26:0/2068160660 >> v1:172.21.15.26:6789/0 conn(0x7f2aa00b04a0 legacy=0x7f2aa00c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7ff2978c9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff29015daf0 0x7ff2900c9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7ff4c23e4640 1 -- 172.21.15.26:0/3408061375 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4bc15aac0 msgr2=0x7ff4bc0c1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7ff4c23e4640 1 --2- 172.21.15.26:0/3408061375 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4bc15aac0 0x7ff4bc0c1e80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc072630 tx=0x7ff4b001c960 comp rx=0 tx=0).stop 2023-10-14T11:12:50.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7ff2978c9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2900c90c0 con 0x7ff29015dfa0 2023-10-14T11:12:50.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7fbbea7fc640 1 -- 172.21.15.26:0/127985383 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc0ab650 con 0x7fbbec0cdee0 2023-10-14T11:12:50.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7ff2978c9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2900cd180 con 0x7ff29015daf0 2023-10-14T11:12:50.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7ff2978c9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2900ad870 con 0x7ff2901597c0 2023-10-14T11:12:50.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7f2a97fff640 1 --2- 172.21.15.26:0/2068160660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a8c003a90 0x7f2a8c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7fbbea7fc640 1 -- 172.21.15.26:0/127985383 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc0ab7b0 con 0x7fbbec0cdee0 2023-10-14T11:12:50.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7ff295665640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff2901597c0 0x7ff2900ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7ff295665640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff2901597c0 0x7ff2900ccc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:37280/0 (socket says 172.21.15.26:37280) 2023-10-14T11:12:50.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7ff295665640 1 -- 172.21.15.26:0/1515694750 learned_addr learned my addr 172.21.15.26:0/1515694750 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7ff295e66640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff29015daf0 0x7ff2900c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7f2a97fff640 1 --2- 172.21.15.26:0/2068160660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa00c9070 0x7f2a8c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7f2a97fff640 1 --2- 172.21.15.26:0/2068160660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a8c004d10 0x7f2a8c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7f2a97fff640 1 -- 172.21.15.26:0/2068160660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c00ffa0 con 0x7f2a8c003a90 2023-10-14T11:12:50.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7f2a97fff640 1 -- 172.21.15.26:0/2068160660 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c0100e0 con 0x7f2a8c004d10 2023-10-14T11:12:50.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7f2a97fff640 1 -- 172.21.15.26:0/2068160660 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c010220 con 0x7f2aa00c9070 2023-10-14T11:12:50.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7fbbea7fc640 1 -- 172.21.15.26:0/127985383 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc0ab650 con 0x7fbbec0cdee0 2023-10-14T11:12:50.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7fbbf1daa640 1 -- 172.21.15.26:0/127985383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbec0cdee0 msgr2=0x7fbbec0d0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7fbbf1daa640 1 --2- 172.21.15.26:0/127985383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbec0cdee0 0x7fbbec0d0d00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009870 tx=0x7fbbdc01c490 comp rx=0 tx=0).stop 2023-10-14T11:12:50.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7f2aa4fa4640 1 --2- 172.21.15.26:0/2068160660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa00c9070 0x7f2a8c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7f2aa5fa6640 1 --2- 172.21.15.26:0/2068160660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a8c004d10 0x7f2a8c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7fbbf1daa640 1 -- 172.21.15.26:0/127985383 shutdown_connections 2023-10-14T11:12:50.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7fbbf1daa640 1 --2- 172.21.15.26:0/127985383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbec0cdee0 0x7fbbec0d0d00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7fbbf1daa640 1 --2- 172.21.15.26:0/127985383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbec15cf00 0x7fbbec0cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7fbbf1daa640 1 -- 172.21.15.26:0/127985383 >> 172.21.15.26:0/127985383 conn(0x7fbbec0b4470 msgr2=0x7fbbec0b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7ff295665640 1 -- 172.21.15.26:0/1515694750 >> v2:172.21.15.26:3300/0 conn(0x7ff29015daf0 msgr2=0x7ff2900c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:50.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7ff295665640 1 --2- 172.21.15.26:0/1515694750 >> v2:172.21.15.26:3300/0 conn(0x7ff29015daf0 0x7ff2900c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7ff295665640 1 -- 172.21.15.26:0/1515694750 >> v1:172.21.15.26:6789/0 conn(0x7ff29015dfa0 legacy=0x7ff29015d3e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T11:12:50.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7f2aa5fa6640 1 -- 172.21.15.26:0/2068160660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa00c9070 msgr2=0x7f2a8c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:50.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7fbbf1daa640 1 -- 172.21.15.26:0/127985383 shutdown_connections 2023-10-14T11:12:50.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7f2aa5fa6640 1 --2- 172.21.15.26:0/2068160660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa00c9070 0x7f2a8c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7f2aa5fa6640 1 -- 172.21.15.26:0/2068160660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a8c003a90 msgr2=0x7f2a8c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:50.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7fbbf1daa640 1 -- 172.21.15.26:0/127985383 wait complete. 2023-10-14T11:12:50.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7f2aa5fa6640 1 --2- 172.21.15.26:0/2068160660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a8c003a90 0x7f2a8c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7f2aa5fa6640 1 -- 172.21.15.26:0/2068160660 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8c003530 con 0x7f2a8c004d10 2023-10-14T11:12:50.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7ff4c23e4640 1 -- 172.21.15.26:0/3408061375 shutdown_connections 2023-10-14T11:12:50.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7ff4c23e4640 1 --2- 172.21.15.26:0/3408061375 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4bc15aac0 0x7ff4bc0c1e80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7ff4c23e4640 1 --2- 172.21.15.26:0/3408061375 >> v2:172.21.15.110:3300/0 conn(0x7ff4bc15a6e0 0x7ff4bc15e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.479+0000 7ff4c23e4640 1 -- 172.21.15.26:0/3408061375 >> 172.21.15.26:0/3408061375 conn(0x7ff4bc0afe60 msgr2=0x7ff4bc0b0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.483+0000 7ff4c23e4640 1 -- 172.21.15.26:0/3408061375 shutdown_connections 2023-10-14T11:12:50.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.483+0000 7ff4c23e4640 1 -- 172.21.15.26:0/3408061375 wait complete. 2023-10-14T11:12:50.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.483+0000 7fbbf1daa640 1 Processor -- start 2023-10-14T11:12:50.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.483+0000 7fbbf1daa640 1 -- start start 2023-10-14T11:12:50.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.483+0000 7ff4c23e4640 1 Processor -- start 2023-10-14T11:12:50.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.483+0000 7ff295665640 1 -- 172.21.15.26:0/1515694750 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2900adb50 con 0x7ff2901597c0 2023-10-14T11:12:50.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.483+0000 7ff4c23e4640 1 -- start start 2023-10-14T11:12:50.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7fbbf1daa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbec0cdee0 0x7fbbec0b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7ff295665640 1 --2- 172.21.15.26:0/1515694750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2901597c0 0x7ff2900ccc40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff2900cf760 tx=0x7ff28c01c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd52cf679a16020c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7fbbf1daa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbec0d1240 0x7fbbec1526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7f2aa5fa6640 1 --2- 172.21.15.26:0/2068160660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a8c004d10 0x7f2a8c005190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800a0f0 tx=0x7f2a9801cfb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3246b05c34aec576 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7fbbeb7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbec0cdee0 0x7fbbec0b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7fbbeb7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbec0cdee0 0x7fbbec0b3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58394/0 (socket says 172.21.15.26:58394) 2023-10-14T11:12:50.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7fbbeb7fe640 1 -- 172.21.15.26:0/52265023 learned_addr learned my addr 172.21.15.26:0/52265023 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7ff4c23e4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4bc0ca720 0x7ff4bc0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7ff4c23e4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4bc15a6e0 0x7ff4bc0b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7fbbf1daa640 1 --2- 172.21.15.26:0/52265023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbec15cf00 0x7fbbec0b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7ff4c23e4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4bc15aac0 0x7ff4bc0b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7fbbf1daa640 1 -- 172.21.15.26:0/52265023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec0b4040 con 0x7fbbec0d1240 2023-10-14T11:12:50.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7ff4c23e4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0b1a60 con 0x7ff4bc15a6e0 2023-10-14T11:12:50.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7ff4c23e4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0b2e20 con 0x7ff4bc0ca720 2023-10-14T11:12:50.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7ff4c23e4640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0b0de0 con 0x7ff4bc15aac0 2023-10-14T11:12:50.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7ff4c0be1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4bc15a6e0 0x7ff4bc0b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7ff4c1be3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4bc15aac0 0x7ff4bc0b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7fbbebfff640 1 --2- 172.21.15.26:0/52265023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbec15cf00 0x7fbbec0b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7fbbeaffd640 1 --2- 172.21.15.26:0/52265023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbec0d1240 0x7fbbec1526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7ff4c0be1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4bc15a6e0 0x7ff4bc0b23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36340/0 (socket says 172.21.15.26:36340) 2023-10-14T11:12:50.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7ff4c0be1640 1 -- 172.21.15.26:0/633296519 learned_addr learned my addr 172.21.15.26:0/633296519 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7ff4c13e2640 1 --2- 172.21.15.26:0/633296519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4bc0ca720 0x7ff4bc0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7f2a97fff640 1 -- 172.21.15.26:0/2068160660 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a980a5d00 con 0x7f2a8c004d10 2023-10-14T11:12:50.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7f2a97fff640 1 -- 172.21.15.26:0/2068160660 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a980a9070 con 0x7f2a8c004d10 2023-10-14T11:12:50.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7f2a97fff640 1 -- 172.21.15.26:0/2068160660 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a980a5ea0 con 0x7f2a8c004d10 2023-10-14T11:12:50.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7f2aa67a7640 1 -- 172.21.15.26:0/2068160660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a8c004d10 msgr2=0x7f2a8c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7f2aa67a7640 1 --2- 172.21.15.26:0/2068160660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a8c004d10 0x7f2a8c005190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800a0f0 tx=0x7f2a9801cfb0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7fbbf1daa640 1 -- 172.21.15.26:0/52265023 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec15bfd0 con 0x7fbbec15cf00 2023-10-14T11:12:50.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7fbbf1daa640 1 -- 172.21.15.26:0/52265023 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec15bb40 con 0x7fbbec0cdee0 2023-10-14T11:12:50.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7f2aa5fa6640 1 -- 172.21.15.26:0/2068160660 reap_dead start 2023-10-14T11:12:50.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7f2aa67a7640 1 -- 172.21.15.26:0/2068160660 shutdown_connections 2023-10-14T11:12:50.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7f2aa67a7640 1 -- 172.21.15.26:0/2068160660 >> 172.21.15.26:0/2068160660 conn(0x7f2aa00cad90 msgr2=0x7f2aa00cb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7ff4c1be3640 1 -- 172.21.15.26:0/633296519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4bc0ca720 msgr2=0x7ff4bc0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7ff4c1be3640 1 --2- 172.21.15.26:0/633296519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4bc0ca720 0x7ff4bc0c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7ff4c1be3640 1 -- 172.21.15.26:0/633296519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4bc15a6e0 msgr2=0x7ff4bc0b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7ff4c1be3640 1 --2- 172.21.15.26:0/633296519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4bc15a6e0 0x7ff4bc0b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7ff4c1be3640 1 -- 172.21.15.26:0/633296519 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b0009b30 con 0x7ff4bc15aac0 2023-10-14T11:12:50.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7ff287fff640 1 -- 172.21.15.26:0/1515694750 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c0aa5f0 con 0x7ff2901597c0 2023-10-14T11:12:50.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7fbbeb7fe640 1 -- 172.21.15.26:0/52265023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbec15cf00 msgr2=0x7fbbec0b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7fbbeb7fe640 1 --2- 172.21.15.26:0/52265023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbec15cf00 0x7fbbec0b23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7fbbeb7fe640 1 -- 172.21.15.26:0/52265023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbec0d1240 msgr2=0x7fbbec1526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7fbbeb7fe640 1 --2- 172.21.15.26:0/52265023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbec0d1240 0x7fbbec1526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7fbbeb7fe640 1 -- 172.21.15.26:0/52265023 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc0094d0 con 0x7fbbec0cdee0 2023-10-14T11:12:50.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7ff287fff640 1 -- 172.21.15.26:0/1515694750 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c0aa750 con 0x7ff2901597c0 2023-10-14T11:12:50.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.487+0000 7ff287fff640 1 -- 172.21.15.26:0/1515694750 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c0aaae0 con 0x7ff2901597c0 2023-10-14T11:12:50.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7f2aa67a7640 1 -- 172.21.15.26:0/2068160660 shutdown_connections 2023-10-14T11:12:50.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7ff4c1be3640 1 --2- 172.21.15.26:0/633296519 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4bc15aac0 0x7ff4bc0b28e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff4b800c410 tx=0x7ff4b800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7f2aa67a7640 1 -- 172.21.15.26:0/2068160660 wait complete. 2023-10-14T11:12:50.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7fbbeb7fe640 1 --2- 172.21.15.26:0/52265023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbec0cdee0 0x7fbbec0b3b00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400b3e0 tx=0x7fbbd400b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7fbbe3fff640 1 -- 172.21.15.26:0/52265023 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4011830 con 0x7fbbec0cdee0 2023-10-14T11:12:50.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7ff4adffb640 1 -- 172.21.15.26:0/633296519 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8005230 con 0x7ff4bc15aac0 2023-10-14T11:12:50.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7fbbf1daa640 1 -- 172.21.15.26:0/52265023 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbec15af30 con 0x7fbbec0cdee0 2023-10-14T11:12:50.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7fbbf1daa640 1 -- 172.21.15.26:0/52265023 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbec15b4f0 con 0x7fbbec0cdee0 2023-10-14T11:12:50.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7ff4adffb640 1 -- 172.21.15.26:0/633296519 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b8005390 con 0x7ff4bc15aac0 2023-10-14T11:12:50.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7ff4adffb640 1 -- 172.21.15.26:0/633296519 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b80047d0 con 0x7ff4bc15aac0 2023-10-14T11:12:50.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7ff2978c9640 1 -- 172.21.15.26:0/1515694750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2901597c0 msgr2=0x7ff2900ccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7ff2978c9640 1 --2- 172.21.15.26:0/1515694750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2901597c0 0x7ff2900ccc40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff2900cf760 tx=0x7ff28c01c490 comp rx=0 tx=0).stop 2023-10-14T11:12:50.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7ff4c23e4640 1 -- 172.21.15.26:0/633296519 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4bc0b10c0 con 0x7ff4bc15aac0 2023-10-14T11:12:50.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7ff4c23e4640 1 -- 172.21.15.26:0/633296519 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4bc0b1680 con 0x7ff4bc15aac0 2023-10-14T11:12:50.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7fbbe3fff640 1 -- 172.21.15.26:0/52265023 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd4011990 con 0x7fbbec0cdee0 2023-10-14T11:12:50.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7fbbe3fff640 1 -- 172.21.15.26:0/52265023 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4011830 con 0x7fbbec0cdee0 2023-10-14T11:12:50.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7f84f95c4640 1 Processor -- start 2023-10-14T11:12:50.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7f84f95c4640 1 -- start start 2023-10-14T11:12:50.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7f2aa67a7640 1 Processor -- start 2023-10-14T11:12:50.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7fbbe1ffb640 1 -- 172.21.15.26:0/52265023 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbec074010 con 0x7fbbec0cdee0 2023-10-14T11:12:50.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7ff2978c9640 1 -- 172.21.15.26:0/1515694750 shutdown_connections 2023-10-14T11:12:50.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7ff49f7fe640 1 -- 172.21.15.26:0/633296519 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4bc0b1ba0 con 0x7ff4bc15aac0 2023-10-14T11:12:50.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.491+0000 7f2aa67a7640 1 -- start start 2023-10-14T11:12:50.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7ff2978c9640 1 --2- 172.21.15.26:0/1515694750 >> v2:172.21.15.26:3300/0 conn(0x7ff29015daf0 0x7ff2900c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7ff2978c9640 1 --2- 172.21.15.26:0/1515694750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2901597c0 0x7ff2900ccc40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7ff2978c9640 1 -- 172.21.15.26:0/1515694750 >> 172.21.15.26:0/1515694750 conn(0x7ff29006c190 msgr2=0x7ff29006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7ff2978c9640 1 -- 172.21.15.26:0/1515694750 shutdown_connections 2023-10-14T11:12:50.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7f84f95c4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f84f40ce0b0 0x7f84f40d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7f84f95c4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f84f40d1240 0x7f84f40b6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7f84f95c4640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f40d1670 con 0x7f84f415cf00 2023-10-14T11:12:50.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7f84f95c4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f415d2e0 con 0x7f84f40d1240 2023-10-14T11:12:50.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7f84f95c4640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f40d1930 con 0x7f84f40ce0b0 2023-10-14T11:12:50.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7fbbe3fff640 1 -- 172.21.15.26:0/52265023 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbbd4011b20 con 0x7fbbec0cdee0 2023-10-14T11:12:50.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7f6b93654640 1 Processor -- start 2023-10-14T11:12:50.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7f2aa67a7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a8c004d10 0x7f2aa0150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7f2aa67a7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2aa006c070 0x7f2aa006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f2aa4fa4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2aa006c070 0x7f2aa006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f2aa67a7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa00b2bc0 0x7f2aa00b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f2aa67a7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa006ca30 con 0x7f2aa006c070 2023-10-14T11:12:50.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f2aa67a7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00b0e70 con 0x7f2a8c004d10 2023-10-14T11:12:50.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f2aa67a7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00b10c0 con 0x7f2aa00b2bc0 2023-10-14T11:12:50.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f2aa4fa4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2aa006c070 0x7f2aa006c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36358/0 (socket says 172.21.15.26:36358) 2023-10-14T11:12:50.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f2aa4fa4640 1 -- 172.21.15.26:0/583939595 learned_addr learned my addr 172.21.15.26:0/583939595 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7f2aa57a5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a8c004d10 0x7f2aa0150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7fbbe3fff640 1 --2- 172.21.15.26:0/52265023 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbbcc066530 0x7fbbcc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7fbbe3fff640 1 -- 172.21.15.26:0/52265023 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbbd4083e70 con 0x7fbbec0cdee0 2023-10-14T11:12:50.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7fbbeaffd640 1 --2- 172.21.15.26:0/52265023 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbbcc066530 0x7fbbcc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7fbbeaffd640 1 --2- 172.21.15.26:0/52265023 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbbcc066530 0x7fbbcc0689f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0af000 tx=0x7fbbdc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7ff4adffb640 1 -- 172.21.15.26:0/633296519 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff4b8004930 con 0x7ff4bc15aac0 2023-10-14T11:12:50.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7ff4adffb640 1 --2- 172.21.15.26:0/633296519 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff4a0066570 0x7ff4a0068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7ff4adffb640 1 -- 172.21.15.26:0/633296519 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff4b80835c0 con 0x7ff4bc15aac0 2023-10-14T11:12:50.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7ff2978c9640 1 -- 172.21.15.26:0/1515694750 wait complete. 2023-10-14T11:12:50.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7f84ea7fc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f84f40ce0b0 0x7f84f40d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7f84ea7fc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f84f40ce0b0 0x7f84f40d0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:37300/0 (socket says 172.21.15.26:37300) 2023-10-14T11:12:50.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7f84ea7fc640 1 -- 172.21.15.26:0/2295646298 learned_addr learned my addr 172.21.15.26:0/2295646298 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7f84f2ffd640 1 --1- 172.21.15.26:0/2295646298 >> v1:172.21.15.110:6789/0 conn(0x7f84f415cf00 0x7f84f40cd9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:48602/0 (socket says 172.21.15.26:48602) 2023-10-14T11:12:50.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7f84f37fe640 1 --2- 172.21.15.26:0/2295646298 >> v2:172.21.15.26:3300/0 conn(0x7f84f40d1240 0x7f84f40b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7f84ea7fc640 1 -- 172.21.15.26:0/2295646298 >> v2:172.21.15.26:3300/0 conn(0x7f84f40d1240 msgr2=0x7f84f40b6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:50.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7f84ea7fc640 1 --2- 172.21.15.26:0/2295646298 >> v2:172.21.15.26:3300/0 conn(0x7f84f40d1240 0x7f84f40b6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7f84ea7fc640 1 -- 172.21.15.26:0/2295646298 >> v1:172.21.15.110:6789/0 conn(0x7f84f415cf00 legacy=0x7f84f40cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:50.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7f84ea7fc640 1 -- 172.21.15.26:0/2295646298 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f40d1c10 con 0x7f84f40ce0b0 2023-10-14T11:12:50.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7f6b93654640 1 -- start start 2023-10-14T11:12:50.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.495+0000 7f6b93654640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6b8c06a5a0 0x7f6b8c06e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f6b93654640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b8c0c1e90 0x7f6b8c0cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7ff4c13e2640 1 --2- 172.21.15.26:0/633296519 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff4a0066570 0x7ff4a0068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f6b93654640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b8c161680 con 0x7f6b8c0ad950 2023-10-14T11:12:50.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f6b93654640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8c06ca50 con 0x7f6b8c06a5a0 2023-10-14T11:12:50.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f6b93654640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c06cd30 con 0x7f6b8c0c1e90 2023-10-14T11:12:50.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7febd3817640 1 Processor -- start 2023-10-14T11:12:50.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f2aa57a5640 1 -- 172.21.15.26:0/583939595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa00b2bc0 msgr2=0x7f2aa00b3040 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T11:12:50.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f2aa57a5640 1 --2- 172.21.15.26:0/583939595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa00b2bc0 0x7f2aa00b3040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f2aa57a5640 1 -- 172.21.15.26:0/583939595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2aa006c070 msgr2=0x7f2aa006c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f2aa57a5640 1 --2- 172.21.15.26:0/583939595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2aa006c070 0x7f2aa006c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f2aa57a5640 1 -- 172.21.15.26:0/583939595 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa00b13a0 con 0x7f2a8c004d10 2023-10-14T11:12:50.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7ff2978c9640 1 Processor -- start 2023-10-14T11:12:50.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f6b91bf1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b8c0c1e90 0x7f6b8c0cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f6b91bf1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b8c0c1e90 0x7f6b8c0cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58398/0 (socket says 172.21.15.26:58398) 2023-10-14T11:12:50.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f6b91bf1640 1 -- 172.21.15.26:0/3561103675 learned_addr learned my addr 172.21.15.26:0/3561103675 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f2aa57a5640 1 --2- 172.21.15.26:0/583939595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a8c004d10 0x7f2aa0150120 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00b410 tx=0x7f2a9c00b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f6b90bef640 1 --2- 172.21.15.26:0/3561103675 >> v2:172.21.15.26:3300/0 conn(0x7f6b8c06a5a0 0x7f6b8c06e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f6b91bf1640 1 -- 172.21.15.26:0/3561103675 >> v2:172.21.15.26:3300/0 conn(0x7f6b8c06a5a0 msgr2=0x7f6b8c06e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:50.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f6b91bf1640 1 --2- 172.21.15.26:0/3561103675 >> v2:172.21.15.26:3300/0 conn(0x7f6b8c06a5a0 0x7f6b8c06e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f6b91bf1640 1 -- 172.21.15.26:0/3561103675 >> v1:172.21.15.26:6789/0 conn(0x7f6b8c0ad950 legacy=0x7f6b8c069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:50.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f6b91bf1640 1 -- 172.21.15.26:0/3561103675 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8c06d010 con 0x7f6b8c0c1e90 2023-10-14T11:12:50.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7ff2978c9640 1 -- start start 2023-10-14T11:12:50.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f2a95ffb640 1 -- 172.21.15.26:0/583939595 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c011830 con 0x7f2a8c004d10 2023-10-14T11:12:50.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f2a95ffb640 1 -- 172.21.15.26:0/583939595 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c011990 con 0x7f2a8c004d10 2023-10-14T11:12:50.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f2a95ffb640 1 -- 172.21.15.26:0/583939595 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c011d80 con 0x7f2a8c004d10 2023-10-14T11:12:50.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f2aa67a7640 1 -- 172.21.15.26:0/583939595 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa00b1680 con 0x7f2a8c004d10 2023-10-14T11:12:50.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7ff2978c9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2901597c0 0x7ff2901f9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7f2aa67a7640 1 -- 172.21.15.26:0/583939595 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa00b3580 con 0x7f2a8c004d10 2023-10-14T11:12:50.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7febd3817640 1 -- start start 2023-10-14T11:12:50.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7febd3817640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7febcc15cb90 0x7febcc0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7febd3817640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc0d15d0 0x7febcc0c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7febd3817640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febcc0ce770 con 0x7febcc0d3010 2023-10-14T11:12:50.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7febd3817640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febcc0d0600 con 0x7febcc15cb90 2023-10-14T11:12:50.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7febd3817640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febcc0c6450 con 0x7febcc0d15d0 2023-10-14T11:12:50.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7ff4c13e2640 1 --2- 172.21.15.26:0/633296519 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff4a0066570 0x7ff4a0068a30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4007a60 tx=0x7ff4b4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7ff2978c9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff29015daf0 0x7ff29015b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7ff2978c9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff29015dfa0 0x7ff29015bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7ff2978c9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29015a7d0 con 0x7ff29015dfa0 2023-10-14T11:12:50.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7ff2978c9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29015c240 con 0x7ff2901597c0 2023-10-14T11:12:50.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7ff2978c9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff290159ea0 con 0x7ff29015daf0 2023-10-14T11:12:50.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.499+0000 7ff295665640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2901597c0 0x7ff2901f9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7ff295665640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2901597c0 0x7ff2901f9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:37310/0 (socket says 172.21.15.26:37310) 2023-10-14T11:12:50.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7ff295665640 1 -- 172.21.15.26:0/2983796256 learned_addr learned my addr 172.21.15.26:0/2983796256 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7ff294e64640 1 --2- 172.21.15.26:0/2983796256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff29015daf0 0x7ff29015b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7f84ea7fc640 1 --2- 172.21.15.26:0/2295646298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84f40ce0b0 0x7f84f40d0d00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f84f40b5490 tx=0x7f84e401c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a132ec19a7a8f8b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7fbbe3fff640 1 -- 172.21.15.26:0/52265023 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbbd4051000 con 0x7fbbec0cdee0 2023-10-14T11:12:50.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7febd15b3640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7febcc15cb90 0x7febcc0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7ff295e66640 1 --2- 172.21.15.26:0/2983796256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff29015dfa0 0x7ff29015bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7f84f27fc640 1 -- 172.21.15.26:0/2295646298 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e40a7070 con 0x7f84f40ce0b0 2023-10-14T11:12:50.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7febd1db4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc0d15d0 0x7febcc0c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7febd1db4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc0d15d0 0x7febcc0c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58428/0 (socket says 172.21.15.26:58428) 2023-10-14T11:12:50.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7febd1db4640 1 -- 172.21.15.26:0/1111611261 learned_addr learned my addr 172.21.15.26:0/1111611261 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7f84f27fc640 1 -- 172.21.15.26:0/2295646298 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e40ab430 con 0x7f84f40ce0b0 2023-10-14T11:12:50.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7f84f27fc640 1 -- 172.21.15.26:0/2295646298 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e40ab7c0 con 0x7f84f40ce0b0 2023-10-14T11:12:50.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7f2aa67a7640 1 -- 172.21.15.26:0/583939595 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa004e9c0 con 0x7f2a8c004d10 2023-10-14T11:12:50.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7ff294e64640 1 -- 172.21.15.26:0/2983796256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2901597c0 msgr2=0x7ff2901f9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7ff294e64640 1 --2- 172.21.15.26:0/2983796256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2901597c0 0x7ff2901f9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7ff294e64640 1 -- 172.21.15.26:0/2983796256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff29015dfa0 msgr2=0x7ff29015bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7ff294e64640 1 --2- 172.21.15.26:0/2983796256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff29015dfa0 0x7ff29015bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7febd1db4640 1 -- 172.21.15.26:0/1111611261 >> v2:172.21.15.110:3300/0 conn(0x7febcc15cb90 msgr2=0x7febcc0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:50.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7ff294e64640 1 -- 172.21.15.26:0/2983796256 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c0094d0 con 0x7ff29015daf0 2023-10-14T11:12:50.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7febd1db4640 1 --2- 172.21.15.26:0/1111611261 >> v2:172.21.15.110:3300/0 conn(0x7febcc15cb90 0x7febcc0cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7febd1db4640 1 -- 172.21.15.26:0/1111611261 >> v1:172.21.15.26:6789/0 conn(0x7febcc0d3010 legacy=0x7febcc0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:50.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7ff294e64640 1 --2- 172.21.15.26:0/2983796256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff29015daf0 0x7ff29015b6d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff28000b3e0 tx=0x7ff28000b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7f84f95c4640 1 -- 172.21.15.26:0/2295646298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84f40ce0b0 msgr2=0x7f84f40d0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7f84f95c4640 1 --2- 172.21.15.26:0/2295646298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84f40ce0b0 0x7f84f40d0d00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f84f40b5490 tx=0x7f84e401c430 comp rx=0 tx=0).stop 2023-10-14T11:12:50.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7f6b91bf1640 1 --2- 172.21.15.26:0/3561103675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b8c0c1e90 0x7f6b8c0cccc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009e50 tx=0x7f6b8401c9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55cc111639bcd29c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7f84f95c4640 1 -- 172.21.15.26:0/2295646298 shutdown_connections 2023-10-14T11:12:50.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7f84f95c4640 1 --2- 172.21.15.26:0/2295646298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84f40ce0b0 0x7f84f40d0d00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7f84f95c4640 1 --2- 172.21.15.26:0/2295646298 >> v2:172.21.15.26:3300/0 conn(0x7f84f40d1240 0x7f84f40b6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7f84f95c4640 1 -- 172.21.15.26:0/2295646298 >> 172.21.15.26:0/2295646298 conn(0x7f84f40b4470 msgr2=0x7f84f40b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7febd1db4640 1 -- 172.21.15.26:0/1111611261 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febcc0d08a0 con 0x7febcc0d15d0 2023-10-14T11:12:50.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7f84f95c4640 1 -- 172.21.15.26:0/2295646298 shutdown_connections 2023-10-14T11:12:50.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7f84f95c4640 1 -- 172.21.15.26:0/2295646298 wait complete. 2023-10-14T11:12:50.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.503+0000 7f2a95ffb640 1 -- 172.21.15.26:0/583939595 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2a9c0193b0 con 0x7f2a8c004d10 2023-10-14T11:12:50.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7f6b83fff640 1 -- 172.21.15.26:0/3561103675 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b840a5760 con 0x7f6b8c0c1e90 2023-10-14T11:12:50.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7f6b83fff640 1 -- 172.21.15.26:0/3561103675 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b840a58c0 con 0x7f6b8c0c1e90 2023-10-14T11:12:50.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7f6b83fff640 1 -- 172.21.15.26:0/3561103675 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b840a5c50 con 0x7f6b8c0c1e90 2023-10-14T11:12:50.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7f6b93654640 1 -- 172.21.15.26:0/3561103675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b8c0c1e90 msgr2=0x7f6b8c0cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7f6b93654640 1 --2- 172.21.15.26:0/3561103675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b8c0c1e90 0x7f6b8c0cccc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009e50 tx=0x7f6b8401c9d0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7ff4adffb640 1 -- 172.21.15.26:0/633296519 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff4b8050870 con 0x7ff4bc15aac0 2023-10-14T11:12:50.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7ff285ffb640 1 -- 172.21.15.26:0/2983796256 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280011830 con 0x7ff29015daf0 2023-10-14T11:12:50.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7ff285ffb640 1 -- 172.21.15.26:0/2983796256 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff280011990 con 0x7ff29015daf0 2023-10-14T11:12:50.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7ff285ffb640 1 -- 172.21.15.26:0/2983796256 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280011830 con 0x7ff29015daf0 2023-10-14T11:12:50.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7ff2978c9640 1 -- 172.21.15.26:0/2983796256 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29015a180 con 0x7ff29015daf0 2023-10-14T11:12:50.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7f84f95c4640 1 Processor -- start 2023-10-14T11:12:50.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7f2a95ffb640 1 --2- 172.21.15.26:0/583939595 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2a84066570 0x7f2a84068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7f2a95ffb640 1 -- 172.21.15.26:0/583939595 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2a9c083d60 con 0x7f2a8c004d10 2023-10-14T11:12:50.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7f2aa4fa4640 1 --2- 172.21.15.26:0/583939595 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2a84066570 0x7f2a84068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7ff2978c9640 1 -- 172.21.15.26:0/2983796256 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29015ac60 con 0x7ff29015daf0 2023-10-14T11:12:50.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7f6b93654640 1 -- 172.21.15.26:0/3561103675 shutdown_connections 2023-10-14T11:12:50.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7f6b93654640 1 --2- 172.21.15.26:0/3561103675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b8c0c1e90 0x7f6b8c0cccc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7f6b93654640 1 --2- 172.21.15.26:0/3561103675 >> v2:172.21.15.26:3300/0 conn(0x7f6b8c06a5a0 0x7f6b8c06e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7f84f95c4640 1 -- start start 2023-10-14T11:12:50.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7febd1db4640 1 --2- 172.21.15.26:0/1111611261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc0d15d0 0x7febcc0c6c10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7febcc08ba70 tx=0x7febbc01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70a617f20e457dbf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7f6b93654640 1 -- 172.21.15.26:0/3561103675 >> 172.21.15.26:0/3561103675 conn(0x7f6b8c0b0d30 msgr2=0x7f6b8c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7f6b93654640 1 -- 172.21.15.26:0/3561103675 shutdown_connections 2023-10-14T11:12:50.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7f6b93654640 1 -- 172.21.15.26:0/3561103675 wait complete. 2023-10-14T11:12:50.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7f2aa4fa4640 1 --2- 172.21.15.26:0/583939595 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2a84066570 0x7f2a84068a30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0153610 tx=0x7f2a90019040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7febc3fff640 1 -- 172.21.15.26:0/1111611261 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc0ac620 con 0x7febcc0d15d0 2023-10-14T11:12:50.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7febc3fff640 1 -- 172.21.15.26:0/1111611261 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc0ac780 con 0x7febcc0d15d0 2023-10-14T11:12:50.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7febc3fff640 1 -- 172.21.15.26:0/1111611261 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc0acb10 con 0x7febcc0d15d0 2023-10-14T11:12:50.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.507+0000 7ff2978c9640 1 -- 172.21.15.26:0/2983796256 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29015a980 con 0x7ff29015daf0 2023-10-14T11:12:50.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f84f95c4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f40ce0b0 0x7f84f4167350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f84f95c4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84f40d1240 0x7f84f415e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f84f95c4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84f415cf00 0x7f84f4157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f84f95c4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f4154a90 con 0x7f84f40ce0b0 2023-10-14T11:12:50.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f84f95c4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f415ded0 con 0x7f84f40d1240 2023-10-14T11:12:50.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f84f95c4640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f40b38f0 con 0x7f84f415cf00 2023-10-14T11:12:50.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7febd3817640 1 -- 172.21.15.26:0/1111611261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc0d15d0 msgr2=0x7febcc0c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7febd3817640 1 --2- 172.21.15.26:0/1111611261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc0d15d0 0x7febcc0c6c10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7febcc08ba70 tx=0x7febbc01c400 comp rx=0 tx=0).stop 2023-10-14T11:12:50.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f84f37fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84f415cf00 0x7f84f4157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f6b93654640 1 Processor -- start 2023-10-14T11:12:50.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7febd3817640 1 -- 172.21.15.26:0/1111611261 shutdown_connections 2023-10-14T11:12:50.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f84f37fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84f415cf00 0x7f84f4157ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58438/0 (socket says 172.21.15.26:58438) 2023-10-14T11:12:50.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f84f37fe640 1 -- 172.21.15.26:0/814560523 learned_addr learned my addr 172.21.15.26:0/814560523 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7febd3817640 1 --2- 172.21.15.26:0/1111611261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc0d15d0 0x7febcc0c6c10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7febd3817640 1 --2- 172.21.15.26:0/1111611261 >> v2:172.21.15.110:3300/0 conn(0x7febcc15cb90 0x7febcc0cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7febd3817640 1 -- 172.21.15.26:0/1111611261 >> 172.21.15.26:0/1111611261 conn(0x7febcc09bc50 msgr2=0x7febcc0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7ff285ffb640 1 -- 172.21.15.26:0/2983796256 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff280011b40 con 0x7ff29015daf0 2023-10-14T11:12:50.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f2a95ffb640 1 -- 172.21.15.26:0/583939595 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2a9c050f60 con 0x7f2a8c004d10 2023-10-14T11:12:50.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f6b93654640 1 -- start start 2023-10-14T11:12:50.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7febd3817640 1 -- 172.21.15.26:0/1111611261 shutdown_connections 2023-10-14T11:12:50.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7febd3817640 1 -- 172.21.15.26:0/1111611261 wait complete. 2023-10-14T11:12:50.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f84ea7fc640 1 --2- 172.21.15.26:0/814560523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84f40d1240 0x7f84f415e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f84ea7fc640 1 -- 172.21.15.26:0/814560523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84f415cf00 msgr2=0x7f84f4157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f84ea7fc640 1 --2- 172.21.15.26:0/814560523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84f415cf00 0x7f84f4157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f84ea7fc640 1 -- 172.21.15.26:0/814560523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f40ce0b0 msgr2=0x7f84f4167350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T11:12:50.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f84ea7fc640 1 --2- 172.21.15.26:0/814560523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f40ce0b0 0x7f84f4167350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f84ea7fc640 1 -- 172.21.15.26:0/814560523 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e40094d0 con 0x7f84f40d1240 2023-10-14T11:12:50.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f84ea7fc640 1 --2- 172.21.15.26:0/814560523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84f40d1240 0x7f84f415e940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f84e40ac000 tx=0x7f84e40191d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f84f37fe640 1 --2- 172.21.15.26:0/814560523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84f415cf00 0x7f84f4157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:12:50.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f6b93654640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b8c06a5a0 0x7f6b8c14d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7ff285ffb640 1 --2- 172.21.15.26:0/2983796256 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff274066560 0x7ff274068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7ff285ffb640 1 -- 172.21.15.26:0/2983796256 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff280083a40 con 0x7ff29015daf0 2023-10-14T11:12:50.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f6b93654640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b8c0ad950 0x7f6b8c0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f6b913f0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b8c06a5a0 0x7f6b8c14d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f6b913f0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b8c06a5a0 0x7f6b8c14d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58446/0 (socket says 172.21.15.26:58446) 2023-10-14T11:12:50.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f6b913f0640 1 -- 172.21.15.26:0/4262114864 learned_addr learned my addr 172.21.15.26:0/4262114864 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f6b90bef640 1 --2- 172.21.15.26:0/4262114864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b8c0ad950 0x7f6b8c0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f6b93654640 1 --2- 172.21.15.26:0/4262114864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b8c0c1e90 0x7f6b8c155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f6b93654640 1 -- 172.21.15.26:0/4262114864 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c149b30 con 0x7f6b8c0c1e90 2023-10-14T11:12:50.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f6b93654640 1 -- 172.21.15.26:0/4262114864 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c0b14e0 con 0x7f6b8c0ad950 2023-10-14T11:12:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f6b93654640 1 -- 172.21.15.26:0/4262114864 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c0b3b20 con 0x7f6b8c06a5a0 2023-10-14T11:12:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f6b91bf1640 1 --2- 172.21.15.26:0/4262114864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b8c0c1e90 0x7f6b8c155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7febd3817640 1 Processor -- start 2023-10-14T11:12:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7febd3817640 1 -- start start 2023-10-14T11:12:50.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f6b90bef640 1 -- 172.21.15.26:0/4262114864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b8c06a5a0 msgr2=0x7f6b8c14d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f6b90bef640 1 --2- 172.21.15.26:0/4262114864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b8c06a5a0 0x7f6b8c14d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f6b90bef640 1 -- 172.21.15.26:0/4262114864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b8c0c1e90 msgr2=0x7f6b8c155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f6b90bef640 1 --2- 172.21.15.26:0/4262114864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b8c0c1e90 0x7f6b8c155230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f6b90bef640 1 -- 172.21.15.26:0/4262114864 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b84009b30 con 0x7f6b8c0ad950 2023-10-14T11:12:50.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f6b91bf1640 1 --2- 172.21.15.26:0/4262114864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b8c0c1e90 0x7f6b8c155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:50.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.511+0000 7f84ebfff640 1 -- 172.21.15.26:0/814560523 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e40b4620 con 0x7f84f40d1240 2023-10-14T11:12:50.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f84ebfff640 1 -- 172.21.15.26:0/814560523 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e40b4780 con 0x7f84f40d1240 2023-10-14T11:12:50.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f84ebfff640 1 -- 172.21.15.26:0/814560523 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e40b4b10 con 0x7f84f40d1240 2023-10-14T11:12:50.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f84f95c4640 1 -- 172.21.15.26:0/814560523 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f415e140 con 0x7f84f40d1240 2023-10-14T11:12:50.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7ff295665640 1 --2- 172.21.15.26:0/2983796256 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff274066560 0x7ff274068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f84f95c4640 1 -- 172.21.15.26:0/814560523 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f415ee80 con 0x7f84f40d1240 2023-10-14T11:12:50.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f6b90bef640 1 --2- 172.21.15.26:0/4262114864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b8c0ad950 0x7f6b8c0b3220 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800d5f0 tx=0x7f6b8800dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f6b81ffb640 1 -- 172.21.15.26:0/4262114864 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b880125f0 con 0x7f6b8c0ad950 2023-10-14T11:12:50.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f6b81ffb640 1 -- 172.21.15.26:0/4262114864 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b88012750 con 0x7f6b8c0ad950 2023-10-14T11:12:50.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f6b81ffb640 1 -- 172.21.15.26:0/4262114864 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b88012ae0 con 0x7f6b8c0ad950 2023-10-14T11:12:50.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7febd3817640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febcc0d15d0 0x7febcc145b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7febd3817640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febcc0d3010 0x7febcc1f8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7febd3817640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc15cb90 0x7febcc158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7febd3817640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc1f8f10 con 0x7febcc0d15d0 2023-10-14T11:12:50.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7febd3817640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc1f8950 con 0x7febcc0d3010 2023-10-14T11:12:50.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7febd3817640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febcc1f8c30 con 0x7febcc15cb90 2023-10-14T11:12:50.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f6b93654640 1 -- 172.21.15.26:0/4262114864 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b8c0b1780 con 0x7f6b8c0ad950 2023-10-14T11:12:50.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f6b93654640 1 -- 172.21.15.26:0/4262114864 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b8c0b3e00 con 0x7f6b8c0ad950 2023-10-14T11:12:50.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7f84f95c4640 1 -- 172.21.15.26:0/814560523 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f4074010 con 0x7f84f40d1240 2023-10-14T11:12:50.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7febd15b3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febcc0d15d0 0x7febcc145b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7febd15b3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febcc0d15d0 0x7febcc145b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36398/0 (socket says 172.21.15.26:36398) 2023-10-14T11:12:50.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7febd15b3640 1 -- 172.21.15.26:0/3012112925 learned_addr learned my addr 172.21.15.26:0/3012112925 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.515+0000 7ff285ffb640 1 -- 172.21.15.26:0/2983796256 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff29015a980 con 0x7ff29015daf0 2023-10-14T11:12:50.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.519+0000 7febd15b3640 1 -- 172.21.15.26:0/3012112925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc15cb90 msgr2=0x7febcc158f70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T11:12:50.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.519+0000 7febd15b3640 1 --2- 172.21.15.26:0/3012112925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc15cb90 0x7febcc158f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.519+0000 7febd15b3640 1 -- 172.21.15.26:0/3012112925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febcc0d3010 msgr2=0x7febcc1f8050 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T11:12:50.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.519+0000 7febd15b3640 1 --2- 172.21.15.26:0/3012112925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febcc0d3010 0x7febcc1f8050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.519+0000 7febd15b3640 1 -- 172.21.15.26:0/3012112925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc0094d0 con 0x7febcc0d15d0 2023-10-14T11:12:50.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.519+0000 7ff295665640 1 --2- 172.21.15.26:0/2983796256 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff274066560 0x7ff274068a20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff28c01ab40 tx=0x7ff28c0b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.519+0000 7febd15b3640 1 --2- 172.21.15.26:0/3012112925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febcc0d15d0 0x7febcc145b60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7febc4007ef0 tx=0x7febc400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.519+0000 7febc1ffb640 1 -- 172.21.15.26:0/3012112925 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc4014620 con 0x7febcc0d15d0 2023-10-14T11:12:50.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.519+0000 7f6b93654640 1 -- 172.21.15.26:0/4262114864 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6c005260 con 0x7f6b8c0ad950 2023-10-14T11:12:50.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.519+0000 7febc1ffb640 1 -- 172.21.15.26:0/3012112925 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc400ee90 con 0x7febcc0d15d0 2023-10-14T11:12:50.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.519+0000 7febc1ffb640 1 -- 172.21.15.26:0/3012112925 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc4014620 con 0x7febcc0d15d0 2023-10-14T11:12:50.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.519+0000 7f6b81ffb640 1 -- 172.21.15.26:0/4262114864 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6b88012c40 con 0x7f6b8c0ad950 2023-10-14T11:12:50.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.519+0000 7febd3817640 1 -- 172.21.15.26:0/3012112925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febcc15a290 con 0x7febcc0d15d0 2023-10-14T11:12:50.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.519+0000 7f84ebfff640 1 -- 172.21.15.26:0/814560523 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f84e40b4c70 con 0x7f84f40d1240 2023-10-14T11:12:50.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.523+0000 7f84ebfff640 1 --2- 172.21.15.26:0/814560523 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f84d40664d0 0x7f84d4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.519+0000 7febd3817640 1 -- 172.21.15.26:0/3012112925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febcc1460a0 con 0x7febcc0d15d0 2023-10-14T11:12:50.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.523+0000 7f6b81ffb640 1 --2- 172.21.15.26:0/4262114864 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6b70066570 0x7f6b70068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.523+0000 7f6b81ffb640 1 -- 172.21.15.26:0/4262114864 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6b88084520 con 0x7f6b8c0ad950 2023-10-14T11:12:50.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.523+0000 7f84ebfff640 1 -- 172.21.15.26:0/814560523 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f84e411d580 con 0x7f84f40d1240 2023-10-14T11:12:50.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.523+0000 7f6b913f0640 1 --2- 172.21.15.26:0/4262114864 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6b70066570 0x7f6b70068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.523+0000 7febd3817640 1 -- 172.21.15.26:0/3012112925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febcc1f8d70 con 0x7febcc0d15d0 2023-10-14T11:12:50.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.523+0000 7f84f2ffd640 1 --2- 172.21.15.26:0/814560523 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f84d40664d0 0x7f84d4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.523+0000 7f6b81ffb640 1 -- 172.21.15.26:0/4262114864 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6b88051720 con 0x7f6b8c0ad950 2023-10-14T11:12:50.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.527+0000 7febc1ffb640 1 -- 172.21.15.26:0/3012112925 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7febc4006d50 con 0x7febcc0d15d0 2023-10-14T11:12:50.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.527+0000 7f6b913f0640 1 --2- 172.21.15.26:0/4262114864 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6b70066570 0x7f6b70068a30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0ae330 tx=0x7f6b7c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.527+0000 7f84f2ffd640 1 --2- 172.21.15.26:0/814560523 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f84d40664d0 0x7f84d4068990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0096b0 tx=0x7f84dc006b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.527+0000 7febc1ffb640 1 --2- 172.21.15.26:0/3012112925 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7febb0066530 0x7febb00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.527+0000 7febc1ffb640 1 -- 172.21.15.26:0/3012112925 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7febc4084410 con 0x7febcc0d15d0 2023-10-14T11:12:50.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.527+0000 7febd0db2640 1 --2- 172.21.15.26:0/3012112925 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7febb0066530 0x7febb00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.531+0000 7f84ebfff640 1 -- 172.21.15.26:0/814560523 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f84e40ea7b0 con 0x7f84f40d1240 2023-10-14T11:12:50.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.531+0000 7febd0db2640 1 --2- 172.21.15.26:0/3012112925 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7febb0066530 0x7febb00689f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7febcc0cf4a0 tx=0x7febc80079c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.535+0000 7f3506d65640 1 Processor -- start 2023-10-14T11:12:50.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.535+0000 7f3506d65640 1 -- start start 2023-10-14T11:12:50.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.535+0000 7f3506d65640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f35000ad960 0x7f35000ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.535+0000 7f3506d65640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35000c96f0 con 0x7f3500164520 2023-10-14T11:12:50.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.535+0000 7f3506d65640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35000cb950 con 0x7f35000b07f0 2023-10-14T11:12:50.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.535+0000 7f3506d65640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3500164900 con 0x7f35000ad960 2023-10-14T11:12:50.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.535+0000 7f34fffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f35000ad960 0x7f35000ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.535+0000 7f34fffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f35000ad960 0x7f35000ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36414/0 (socket says 172.21.15.26:36414) 2023-10-14T11:12:50.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.535+0000 7f34fffff640 1 -- 172.21.15.26:0/1458699143 learned_addr learned my addr 172.21.15.26:0/1458699143 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.539+0000 7febc1ffb640 1 -- 172.21.15.26:0/3012112925 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7febcc1f8d70 con 0x7febcc0d15d0 2023-10-14T11:12:50.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.535+0000 7f34fffff640 1 -- 172.21.15.26:0/1458699143 >> v1:172.21.15.110:6789/0 conn(0x7f35000b07f0 legacy=0x7f35000cc870 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T11:12:50.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.535+0000 7f34fffff640 1 -- 172.21.15.26:0/1458699143 >> v1:172.21.15.26:6789/0 conn(0x7f3500164520 legacy=0x7f35000b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:50.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.535+0000 7f34fffff640 1 -- 172.21.15.26:0/1458699143 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35000cbed0 con 0x7f35000ad960 2023-10-14T11:12:50.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.543+0000 7f34fffff640 1 --2- 172.21.15.26:0/1458699143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35000ad960 0x7f35000ce010 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f34ec009870 tx=0x7f34ec01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4123e7ea34cac8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.543+0000 7f34ff7fe640 1 -- 172.21.15.26:0/1458699143 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec0aa610 con 0x7f35000ad960 2023-10-14T11:12:50.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.543+0000 7f34ff7fe640 1 -- 172.21.15.26:0/1458699143 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec0a6040 con 0x7f35000ad960 2023-10-14T11:12:50.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.547+0000 7f3506d65640 1 -- 172.21.15.26:0/1458699143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35000ad960 msgr2=0x7f35000ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.547+0000 7f34ff7fe640 1 -- 172.21.15.26:0/1458699143 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec0aa610 con 0x7f35000ad960 2023-10-14T11:12:50.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.547+0000 7f3506d65640 1 --2- 172.21.15.26:0/1458699143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35000ad960 0x7f35000ce010 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f34ec009870 tx=0x7f34ec01c490 comp rx=0 tx=0).stop 2023-10-14T11:12:50.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.551+0000 7f3506d65640 1 -- 172.21.15.26:0/1458699143 shutdown_connections 2023-10-14T11:12:50.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.551+0000 7f3506d65640 1 --2- 172.21.15.26:0/1458699143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35000ad960 0x7f35000ce010 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.551+0000 7f3506d65640 1 -- 172.21.15.26:0/1458699143 >> 172.21.15.26:0/1458699143 conn(0x7f350006c190 msgr2=0x7f350006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.551+0000 7f3506d65640 1 -- 172.21.15.26:0/1458699143 shutdown_connections 2023-10-14T11:12:50.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.551+0000 7f3506d65640 1 -- 172.21.15.26:0/1458699143 wait complete. 2023-10-14T11:12:50.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.555+0000 7f3506d65640 1 Processor -- start 2023-10-14T11:12:50.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.555+0000 7f3506d65640 1 -- start start 2023-10-14T11:12:50.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.555+0000 7f3506d65640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35000ad960 0x7f3500161f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.555+0000 7f3506d65640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35000b07f0 0x7f35001543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.559+0000 7f3504b01640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35000ad960 0x7f3500161f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.559+0000 7f3504b01640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35000ad960 0x7f3500161f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58454/0 (socket says 172.21.15.26:58454) 2023-10-14T11:12:50.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.559+0000 7f3504b01640 1 -- 172.21.15.26:0/759477651 learned_addr learned my addr 172.21.15.26:0/759477651 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:50.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.559+0000 7f3506d65640 1 --2- 172.21.15.26:0/759477651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3500164520 0x7f35000b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.559+0000 7f3506d65640 1 -- 172.21.15.26:0/759477651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35000b1ce0 con 0x7f35000b07f0 2023-10-14T11:12:50.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.559+0000 7f3506d65640 1 -- 172.21.15.26:0/759477651 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35000b1fc0 con 0x7f3500164520 2023-10-14T11:12:50.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.559+0000 7f3506d65640 1 -- 172.21.15.26:0/759477651 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35000b22a0 con 0x7f35000ad960 2023-10-14T11:12:50.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.559+0000 7f3505302640 1 --2- 172.21.15.26:0/759477651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3500164520 0x7f35000b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.559+0000 7f3504b01640 1 -- 172.21.15.26:0/759477651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3500164520 msgr2=0x7f35000b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.559+0000 7f3504b01640 1 --2- 172.21.15.26:0/759477651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3500164520 0x7f35000b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.559+0000 7f3504b01640 1 -- 172.21.15.26:0/759477651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35000b07f0 msgr2=0x7f35001543e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T11:12:50.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.559+0000 7f34fffff640 1 --2- 172.21.15.26:0/759477651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35000b07f0 0x7f35001543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.559+0000 7f3504b01640 1 --2- 172.21.15.26:0/759477651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35000b07f0 0x7f35001543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.559+0000 7f3504b01640 1 -- 172.21.15.26:0/759477651 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec0094d0 con 0x7f35000ad960 2023-10-14T11:12:50.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.559+0000 7f34fffff640 1 --2- 172.21.15.26:0/759477651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35000b07f0 0x7f35001543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:50.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.559+0000 7f3504b01640 1 --2- 172.21.15.26:0/759477651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35000ad960 0x7f3500161f20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f34f400c490 tx=0x7f34f4001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.559+0000 7f34fd7fa640 1 -- 172.21.15.26:0/759477651 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f4003600 con 0x7f35000ad960 2023-10-14T11:12:50.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.559+0000 7f34fd7fa640 1 -- 172.21.15.26:0/759477651 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f4003780 con 0x7f35000ad960 2023-10-14T11:12:50.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.559+0000 7f34fd7fa640 1 -- 172.21.15.26:0/759477651 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f4003b70 con 0x7f35000ad960 2023-10-14T11:12:50.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.559+0000 7f3506d65640 1 -- 172.21.15.26:0/759477651 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35000b2580 con 0x7f35000ad960 2023-10-14T11:12:50.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.559+0000 7f3506d65640 1 -- 172.21.15.26:0/759477651 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35001629a0 con 0x7f35000ad960 2023-10-14T11:12:50.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.563+0000 7f3506d65640 1 -- 172.21.15.26:0/759477651 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3500074010 con 0x7f35000ad960 2023-10-14T11:12:50.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.563+0000 7f34fd7fa640 1 -- 172.21.15.26:0/759477651 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f34f4003cd0 con 0x7f35000ad960 2023-10-14T11:12:50.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.563+0000 7f34fd7fa640 1 --2- 172.21.15.26:0/759477651 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f34e40664f0 0x7f34e40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:50.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.567+0000 7f34fd7fa640 1 -- 172.21.15.26:0/759477651 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f34f4054d10 con 0x7f35000ad960 2023-10-14T11:12:50.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.567+0000 7f34fffff640 1 --2- 172.21.15.26:0/759477651 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f34e40664f0 0x7f34e40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:50.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.567+0000 7f34fffff640 1 --2- 172.21.15.26:0/759477651 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f34e40664f0 0x7f34e40689b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0ae000 tx=0x7f34ec0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:50.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.571+0000 7f34fd7fa640 1 -- 172.21.15.26:0/759477651 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f34f40510e0 con 0x7f35000ad960 2023-10-14T11:12:50.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.839+0000 7ff49f7fe640 1 -- 172.21.15.26:0/633296519 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff4bc073fa0 con 0x7ff4bc15aac0 2023-10-14T11:12:50.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.839+0000 7ff4adffb640 1 -- 172.21.15.26:0/633296519 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4b8053e90 con 0x7ff4bc15aac0 2023-10-14T11:12:50.845 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2023-10-14T11:12:50.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.843+0000 7fbbe1ffb640 1 -- 172.21.15.26:0/52265023 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fbbec0cee90 con 0x7fbbec0cdee0 2023-10-14T11:12:50.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.843+0000 7ff49f7fe640 1 -- 172.21.15.26:0/633296519 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff4a0066570 msgr2=0x7ff4a0068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.843+0000 7ff49f7fe640 1 --2- 172.21.15.26:0/633296519 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff4a0066570 0x7ff4a0068a30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4007a60 tx=0x7ff4b4008040 comp rx=0 tx=0).stop 2023-10-14T11:12:50.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.843+0000 7ff49f7fe640 1 -- 172.21.15.26:0/633296519 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4bc15aac0 msgr2=0x7ff4bc0b28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.843+0000 7ff49f7fe640 1 --2- 172.21.15.26:0/633296519 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4bc15aac0 0x7ff4bc0b28e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff4b800c410 tx=0x7ff4b800c8d0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.843+0000 7ff49f7fe640 1 -- 172.21.15.26:0/633296519 shutdown_connections 2023-10-14T11:12:50.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.843+0000 7ff49f7fe640 1 --2- 172.21.15.26:0/633296519 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4bc15aac0 0x7ff4bc0b28e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.843+0000 7ff49f7fe640 1 --2- 172.21.15.26:0/633296519 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff4a0066570 0x7ff4a0068a30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.843+0000 7ff49f7fe640 1 --2- 172.21.15.26:0/633296519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4bc15a6e0 0x7ff4bc0b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.843+0000 7ff49f7fe640 1 --2- 172.21.15.26:0/633296519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4bc0ca720 0x7ff4bc0c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.843+0000 7ff49f7fe640 1 -- 172.21.15.26:0/633296519 >> 172.21.15.26:0/633296519 conn(0x7ff4bc0afe60 msgr2=0x7ff4bc15b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.843+0000 7ff49f7fe640 1 -- 172.21.15.26:0/633296519 shutdown_connections 2023-10-14T11:12:50.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.843+0000 7ff49f7fe640 1 -- 172.21.15.26:0/633296519 wait complete. 2023-10-14T11:12:50.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.843+0000 7fbbe3fff640 1 -- 172.21.15.26:0/52265023 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbbd4015090 con 0x7fbbec0cdee0 2023-10-14T11:12:50.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.843+0000 7f2aa67a7640 1 -- 172.21.15.26:0/583939595 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2aa00b1b30 con 0x7f2a8c004d10 2023-10-14T11:12:50.854 INFO:teuthology.orchestra.run.smithi026.stdout:55834574857 2023-10-14T11:12:50.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.847+0000 7ff2978c9640 1 -- 172.21.15.26:0/2983796256 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff29015a940 con 0x7ff29015daf0 2023-10-14T11:12:50.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.847+0000 7fbbe1ffb640 1 -- 172.21.15.26:0/52265023 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbbcc066530 msgr2=0x7fbbcc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.847+0000 7f2a95ffb640 1 -- 172.21.15.26:0/583939595 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2a9c015020 con 0x7f2a8c004d10 2023-10-14T11:12:50.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.847+0000 7fbbe1ffb640 1 --2- 172.21.15.26:0/52265023 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbbcc066530 0x7fbbcc0689f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0af000 tx=0x7fbbdc009040 comp rx=0 tx=0).stop 2023-10-14T11:12:50.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.847+0000 7fbbe1ffb640 1 -- 172.21.15.26:0/52265023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbec0cdee0 msgr2=0x7fbbec0b3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.847+0000 7fbbe1ffb640 1 --2- 172.21.15.26:0/52265023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbec0cdee0 0x7fbbec0b3b00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400b3e0 tx=0x7fbbd400b8a0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.847+0000 7ff285ffb640 1 -- 172.21.15.26:0/2983796256 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff280085e60 con 0x7ff29015daf0 2023-10-14T11:12:50.858 INFO:teuthology.orchestra.run.smithi026.stdout:55834574856 2023-10-14T11:12:50.859 INFO:teuthology.orchestra.run.smithi026.stdout:55834574856 2023-10-14T11:12:50.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.851+0000 7fbbe1ffb640 1 -- 172.21.15.26:0/52265023 shutdown_connections 2023-10-14T11:12:50.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.851+0000 7fbbe1ffb640 1 --2- 172.21.15.26:0/52265023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbec15cf00 0x7fbbec0b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.851+0000 7fbbe1ffb640 1 --2- 172.21.15.26:0/52265023 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbbcc066530 0x7fbbcc0689f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.851+0000 7fbbe1ffb640 1 --2- 172.21.15.26:0/52265023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbec0d1240 0x7fbbec1526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.851+0000 7fbbe1ffb640 1 --2- 172.21.15.26:0/52265023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbec0cdee0 0x7fbbec0b3b00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.851+0000 7fbbe1ffb640 1 -- 172.21.15.26:0/52265023 >> 172.21.15.26:0/52265023 conn(0x7fbbec0b4470 msgr2=0x7fbbec0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.851+0000 7ff2978c9640 1 -- 172.21.15.26:0/2983796256 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff274066560 msgr2=0x7ff274068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.851+0000 7ff2978c9640 1 --2- 172.21.15.26:0/2983796256 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff274066560 0x7ff274068a20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff28c01ab40 tx=0x7ff28c0b5040 comp rx=0 tx=0).stop 2023-10-14T11:12:50.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.851+0000 7ff2978c9640 1 -- 172.21.15.26:0/2983796256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff29015daf0 msgr2=0x7ff29015b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.851+0000 7ff2978c9640 1 --2- 172.21.15.26:0/2983796256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff29015daf0 0x7ff29015b6d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff28000b3e0 tx=0x7ff28000b8a0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.851+0000 7ff2978c9640 1 -- 172.21.15.26:0/2983796256 shutdown_connections 2023-10-14T11:12:50.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.851+0000 7ff2978c9640 1 --2- 172.21.15.26:0/2983796256 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff274066560 0x7ff274068a20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.851+0000 7ff2978c9640 1 --2- 172.21.15.26:0/2983796256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff29015dfa0 0x7ff29015bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.851+0000 7ff2978c9640 1 --2- 172.21.15.26:0/2983796256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff29015daf0 0x7ff29015b6d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.851+0000 7ff2978c9640 1 --2- 172.21.15.26:0/2983796256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2901597c0 0x7ff2901f9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.851+0000 7ff2978c9640 1 -- 172.21.15.26:0/2983796256 >> 172.21.15.26:0/2983796256 conn(0x7ff29006c190 msgr2=0x7ff29014f170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.855+0000 7ff2978c9640 1 -- 172.21.15.26:0/2983796256 shutdown_connections 2023-10-14T11:12:50.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.855+0000 7ff2978c9640 1 -- 172.21.15.26:0/2983796256 wait complete. 2023-10-14T11:12:50.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.855+0000 7fbbe1ffb640 1 -- 172.21.15.26:0/52265023 shutdown_connections 2023-10-14T11:12:50.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.855+0000 7fbbe1ffb640 1 -- 172.21.15.26:0/52265023 wait complete. 2023-10-14T11:12:50.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.855+0000 7f2aa67a7640 1 -- 172.21.15.26:0/583939595 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2a84066570 msgr2=0x7f2a84068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.855+0000 7f2aa67a7640 1 --2- 172.21.15.26:0/583939595 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2a84066570 0x7f2a84068a30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0153610 tx=0x7f2a90019040 comp rx=0 tx=0).stop 2023-10-14T11:12:50.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.855+0000 7f2aa67a7640 1 -- 172.21.15.26:0/583939595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a8c004d10 msgr2=0x7f2aa0150120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.855+0000 7f2aa67a7640 1 --2- 172.21.15.26:0/583939595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a8c004d10 0x7f2aa0150120 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00b410 tx=0x7f2a9c00b8d0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.855+0000 7f2aa67a7640 1 -- 172.21.15.26:0/583939595 shutdown_connections 2023-10-14T11:12:50.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.855+0000 7f2aa67a7640 1 --2- 172.21.15.26:0/583939595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa00b2bc0 0x7f2aa00b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.855+0000 7f2aa67a7640 1 --2- 172.21.15.26:0/583939595 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2a84066570 0x7f2a84068a30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.855+0000 7f2aa67a7640 1 --2- 172.21.15.26:0/583939595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2aa006c070 0x7f2aa006c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.855+0000 7f2aa67a7640 1 --2- 172.21.15.26:0/583939595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a8c004d10 0x7f2aa0150120 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.855+0000 7f2aa67a7640 1 -- 172.21.15.26:0/583939595 >> 172.21.15.26:0/583939595 conn(0x7f2aa00cad90 msgr2=0x7f2aa00afd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.855+0000 7f2aa67a7640 1 -- 172.21.15.26:0/583939595 shutdown_connections 2023-10-14T11:12:50.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.855+0000 7f2aa67a7640 1 -- 172.21.15.26:0/583939595 wait complete. 2023-10-14T11:12:50.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.859+0000 7f6b93654640 1 -- 172.21.15.26:0/4262114864 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6b6c005510 con 0x7f6b8c0ad950 2023-10-14T11:12:50.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.859+0000 7f84f95c4640 1 -- 172.21.15.26:0/814560523 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f84f4072fa0 con 0x7f84f40d1240 2023-10-14T11:12:50.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.859+0000 7f6b81ffb640 1 -- 172.21.15.26:0/4262114864 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6b88054d40 con 0x7f6b8c0ad950 2023-10-14T11:12:50.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.859+0000 7f84ebfff640 1 -- 172.21.15.26:0/814560523 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f84e40eddd0 con 0x7f84f40d1240 2023-10-14T11:12:50.875 INFO:teuthology.orchestra.run.smithi026.stdout:55834574858 2023-10-14T11:12:50.876 INFO:teuthology.orchestra.run.smithi026.stdout:55834574857 2023-10-14T11:12:50.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.863+0000 7f6b93654640 1 -- 172.21.15.26:0/4262114864 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6b70066570 msgr2=0x7f6b70068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.863+0000 7f6b93654640 1 --2- 172.21.15.26:0/4262114864 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6b70066570 0x7f6b70068a30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0ae330 tx=0x7f6b7c009040 comp rx=0 tx=0).stop 2023-10-14T11:12:50.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.863+0000 7f6b93654640 1 -- 172.21.15.26:0/4262114864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b8c0ad950 msgr2=0x7f6b8c0b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.863+0000 7f6b93654640 1 --2- 172.21.15.26:0/4262114864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b8c0ad950 0x7f6b8c0b3220 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800d5f0 tx=0x7f6b8800dab0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.863+0000 7f6b93654640 1 -- 172.21.15.26:0/4262114864 shutdown_connections 2023-10-14T11:12:50.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.863+0000 7f6b93654640 1 --2- 172.21.15.26:0/4262114864 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6b70066570 0x7f6b70068a30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.863+0000 7f6b93654640 1 --2- 172.21.15.26:0/4262114864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b8c0c1e90 0x7f6b8c155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.863+0000 7f6b93654640 1 --2- 172.21.15.26:0/4262114864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b8c0ad950 0x7f6b8c0b3220 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.863+0000 7f6b93654640 1 --2- 172.21.15.26:0/4262114864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b8c06a5a0 0x7f6b8c14d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.863+0000 7f6b93654640 1 -- 172.21.15.26:0/4262114864 >> 172.21.15.26:0/4262114864 conn(0x7f6b8c0b0d30 msgr2=0x7f6b8c153230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.867+0000 7f6b93654640 1 -- 172.21.15.26:0/4262114864 shutdown_connections 2023-10-14T11:12:50.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.867+0000 7f6b93654640 1 -- 172.21.15.26:0/4262114864 wait complete. 2023-10-14T11:12:50.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.867+0000 7f84f95c4640 1 -- 172.21.15.26:0/814560523 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f84d40664d0 msgr2=0x7f84d4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.867+0000 7f84f95c4640 1 --2- 172.21.15.26:0/814560523 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f84d40664d0 0x7f84d4068990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0096b0 tx=0x7f84dc006b60 comp rx=0 tx=0).stop 2023-10-14T11:12:50.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.867+0000 7f84f95c4640 1 -- 172.21.15.26:0/814560523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84f40d1240 msgr2=0x7f84f415e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.867+0000 7f84f95c4640 1 --2- 172.21.15.26:0/814560523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84f40d1240 0x7f84f415e940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f84e40ac000 tx=0x7f84e40191d0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.867+0000 7f84f95c4640 1 -- 172.21.15.26:0/814560523 shutdown_connections 2023-10-14T11:12:50.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.867+0000 7f84f95c4640 1 --2- 172.21.15.26:0/814560523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84f415cf00 0x7f84f4157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.867+0000 7f84f95c4640 1 --2- 172.21.15.26:0/814560523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84f40d1240 0x7f84f415e940 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.867+0000 7f84f95c4640 1 --2- 172.21.15.26:0/814560523 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f84d40664d0 0x7f84d4068990 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.867+0000 7f84f95c4640 1 --2- 172.21.15.26:0/814560523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f40ce0b0 0x7f84f4167350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.867+0000 7f84f95c4640 1 -- 172.21.15.26:0/814560523 >> 172.21.15.26:0/814560523 conn(0x7f84f40b4470 msgr2=0x7f84f40ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.867+0000 7f84f95c4640 1 -- 172.21.15.26:0/814560523 shutdown_connections 2023-10-14T11:12:50.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.867+0000 7f84f95c4640 1 -- 172.21.15.26:0/814560523 wait complete. 2023-10-14T11:12:50.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.875+0000 7febd3817640 1 -- 172.21.15.26:0/3012112925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7febcc1f8d70 con 0x7febcc0d15d0 2023-10-14T11:12:50.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.875+0000 7febc1ffb640 1 -- 172.21.15.26:0/3012112925 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7febcc1f8d70 con 0x7febcc0d15d0 2023-10-14T11:12:50.885 INFO:teuthology.orchestra.run.smithi026.stdout:55834574857 2023-10-14T11:12:50.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574859 for osd.7 2023-10-14T11:12:50.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.879+0000 7febd3817640 1 -- 172.21.15.26:0/3012112925 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7febb0066530 msgr2=0x7febb00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.879+0000 7febd3817640 1 --2- 172.21.15.26:0/3012112925 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7febb0066530 0x7febb00689f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7febcc0cf4a0 tx=0x7febc80079c0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.883+0000 7febd3817640 1 -- 172.21.15.26:0/3012112925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febcc0d15d0 msgr2=0x7febcc145b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.883+0000 7febd3817640 1 --2- 172.21.15.26:0/3012112925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febcc0d15d0 0x7febcc145b60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7febc4007ef0 tx=0x7febc400e4b0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.883+0000 7febd3817640 1 -- 172.21.15.26:0/3012112925 shutdown_connections 2023-10-14T11:12:50.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.883+0000 7febd3817640 1 --2- 172.21.15.26:0/3012112925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc15cb90 0x7febcc158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.883+0000 7febd3817640 1 --2- 172.21.15.26:0/3012112925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febcc0d3010 0x7febcc1f8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.883+0000 7febd3817640 1 --2- 172.21.15.26:0/3012112925 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7febb0066530 0x7febb00689f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.883+0000 7febd3817640 1 --2- 172.21.15.26:0/3012112925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febcc0d15d0 0x7febcc145b60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.883+0000 7febd3817640 1 -- 172.21.15.26:0/3012112925 >> 172.21.15.26:0/3012112925 conn(0x7febcc09bc50 msgr2=0x7febcc0cdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.883+0000 7febd3817640 1 -- 172.21.15.26:0/3012112925 shutdown_connections 2023-10-14T11:12:50.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.883+0000 7febd3817640 1 -- 172.21.15.26:0/3012112925 wait complete. 2023-10-14T11:12:50.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.2 2023-10-14T11:12:50.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.4 2023-10-14T11:12:50.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.5 2023-10-14T11:12:50.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.899+0000 7f3506d65640 1 -- 172.21.15.26:0/759477651 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f35000cc300 con 0x7f35000ad960 2023-10-14T11:12:50.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.899+0000 7f34fd7fa640 1 -- 172.21.15.26:0/759477651 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f34f4017030 con 0x7f35000ad960 2023-10-14T11:12:50.906 INFO:teuthology.orchestra.run.smithi026.stdout:55834574857 2023-10-14T11:12:50.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.903+0000 7f3506d65640 1 -- 172.21.15.26:0/759477651 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f34e40664f0 msgr2=0x7f34e40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.903+0000 7f3506d65640 1 --2- 172.21.15.26:0/759477651 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f34e40664f0 0x7f34e40689b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0ae000 tx=0x7f34ec0a7000 comp rx=0 tx=0).stop 2023-10-14T11:12:50.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.903+0000 7f3506d65640 1 -- 172.21.15.26:0/759477651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35000ad960 msgr2=0x7f3500161f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:50.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.903+0000 7f3506d65640 1 --2- 172.21.15.26:0/759477651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35000ad960 0x7f3500161f20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f34f400c490 tx=0x7f34f4001e80 comp rx=0 tx=0).stop 2023-10-14T11:12:50.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.903+0000 7f3506d65640 1 -- 172.21.15.26:0/759477651 shutdown_connections 2023-10-14T11:12:50.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.903+0000 7f3506d65640 1 --2- 172.21.15.26:0/759477651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3500164520 0x7f35000b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.903+0000 7f3506d65640 1 --2- 172.21.15.26:0/759477651 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f34e40664f0 0x7f34e40689b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.903+0000 7f3506d65640 1 --2- 172.21.15.26:0/759477651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35000b07f0 0x7f35001543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.903+0000 7f3506d65640 1 --2- 172.21.15.26:0/759477651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35000ad960 0x7f3500161f20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:50.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.903+0000 7f3506d65640 1 -- 172.21.15.26:0/759477651 >> 172.21.15.26:0/759477651 conn(0x7f350006c190 msgr2=0x7f35001606d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:50.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.903+0000 7f3506d65640 1 -- 172.21.15.26:0/759477651 shutdown_connections 2023-10-14T11:12:50.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:50.903+0000 7f3506d65640 1 -- 172.21.15.26:0/759477651 wait complete. 2023-10-14T11:12:50.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.0 2023-10-14T11:12:50.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.6 2023-10-14T11:12:50.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.3 2023-10-14T11:12:50.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.1 2023-10-14T11:12:51.888 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-14T11:12:51.903 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T11:12:51.904 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-14T11:12:51.905 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-14T11:12:51.918 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T11:12:51.919 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-14T11:12:51.920 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-14T11:12:51.934 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T11:12:52.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.119+0000 7fd3e1005640 1 Processor -- start 2023-10-14T11:12:52.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.119+0000 7fd3e1005640 1 -- start start 2023-10-14T11:12:52.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.123+0000 7fd3e1005640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3dc0d03a0 0x7fd3dc0b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.123+0000 7fd3e1005640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd3dc06b620 0x7fd3dc0b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.123+0000 7fd3e1005640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3dc0d32f0 con 0x7fd3dc15feb0 2023-10-14T11:12:52.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.123+0000 7fd3e1005640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3dc06bae0 con 0x7fd3dc0d03a0 2023-10-14T11:12:52.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.123+0000 7fd3db59e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd3dc06b620 0x7fd3dc0b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.123+0000 7fd3e1005640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3dc06bdc0 con 0x7fd3dc06b620 2023-10-14T11:12:52.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.123+0000 7fd3da59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3dc0d03a0 0x7fd3dc0b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.123+0000 7fd3db59e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd3dc06b620 0x7fd3dc0b0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:37368/0 (socket says 172.21.15.26:37368) 2023-10-14T11:12:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.123+0000 7fd3db59e640 1 -- 172.21.15.26:0/3804357328 learned_addr learned my addr 172.21.15.26:0/3804357328 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:52.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.127+0000 7fd3db59e640 1 -- 172.21.15.26:0/3804357328 >> v2:172.21.15.26:3300/0 conn(0x7fd3dc0d03a0 msgr2=0x7fd3dc0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:52.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.127+0000 7fd3db59e640 1 --2- 172.21.15.26:0/3804357328 >> v2:172.21.15.26:3300/0 conn(0x7fd3dc0d03a0 0x7fd3dc0b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.127+0000 7fd3d9d9b640 1 -- 172.21.15.26:0/3804357328 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108057972 0 0) 0x7fd3dc0d32f0 con 0x7fd3dc15feb0 2023-10-14T11:12:52.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.127+0000 7fd3db59e640 1 -- 172.21.15.26:0/3804357328 >> v1:172.21.15.110:6789/0 conn(0x7fd3dc15feb0 legacy=0x7fd3dc06af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.127+0000 7fd3db59e640 1 -- 172.21.15.26:0/3804357328 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc06c0a0 con 0x7fd3dc06b620 2023-10-14T11:12:52.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.131+0000 7fd3da59c640 1 --2- 172.21.15.26:0/3804357328 >> v2:172.21.15.26:3300/0 conn(0x7fd3dc0d03a0 0x7fd3dc0b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:52.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.131+0000 7fd3db59e640 1 --2- 172.21.15.26:0/3804357328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3dc06b620 0x7fd3dc0b0910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0b2140 tx=0x7fd3d401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e6143d2edd3eafd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.131+0000 7fd3d9d9b640 1 -- 172.21.15.26:0/3804357328 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40a59e0 con 0x7fd3dc06b620 2023-10-14T11:12:52.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.131+0000 7fd3d9d9b640 1 -- 172.21.15.26:0/3804357328 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d40a5b40 con 0x7fd3dc06b620 2023-10-14T11:12:52.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.131+0000 7fd3d9d9b640 1 -- 172.21.15.26:0/3804357328 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40ad440 con 0x7fd3dc06b620 2023-10-14T11:12:52.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.135+0000 7fd3e1005640 1 -- 172.21.15.26:0/3804357328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3dc06b620 msgr2=0x7fd3dc0b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.135+0000 7fd3e1005640 1 --2- 172.21.15.26:0/3804357328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3dc06b620 0x7fd3dc0b0910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0b2140 tx=0x7fd3d401c920 comp rx=0 tx=0).stop 2023-10-14T11:12:52.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.135+0000 7fd3e1005640 1 -- 172.21.15.26:0/3804357328 shutdown_connections 2023-10-14T11:12:52.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.135+0000 7fd3e1005640 1 --2- 172.21.15.26:0/3804357328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3dc06b620 0x7fd3dc0b0910 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.135+0000 7fd3e1005640 1 --2- 172.21.15.26:0/3804357328 >> v2:172.21.15.26:3300/0 conn(0x7fd3dc0d03a0 0x7fd3dc0b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.135+0000 7fd3e1005640 1 -- 172.21.15.26:0/3804357328 >> 172.21.15.26:0/3804357328 conn(0x7fd3dc09b9f0 msgr2=0x7fd3dc0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:52.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.135+0000 7fd3e1005640 1 -- 172.21.15.26:0/3804357328 shutdown_connections 2023-10-14T11:12:52.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.135+0000 7fd3e1005640 1 -- 172.21.15.26:0/3804357328 wait complete. 2023-10-14T11:12:52.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.139+0000 7fd3e1005640 1 Processor -- start 2023-10-14T11:12:52.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.139+0000 7fd3e1005640 1 -- start start 2023-10-14T11:12:52.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.143+0000 7fd3e1005640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3dc06b620 0x7fd3dc153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.143+0000 7fd3e1005640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3dc0d03a0 0x7fd3dc201bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.143+0000 7fd3dad9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3dc06b620 0x7fd3dc153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.143+0000 7fd3dad9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3dc06b620 0x7fd3dc153a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:37378/0 (socket says 172.21.15.26:37378) 2023-10-14T11:12:52.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.143+0000 7fd3da59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3dc0d03a0 0x7fd3dc201bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.143+0000 7fd3da59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3dc0d03a0 0x7fd3dc201bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36436/0 (socket says 172.21.15.26:36436) 2023-10-14T11:12:52.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.143+0000 7fd3e1005640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3dc15feb0 0x7fd3dc0b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.143+0000 7fd3e1005640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc2020f0 con 0x7fd3dc0d03a0 2023-10-14T11:12:52.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.143+0000 7fd3e1005640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc15d5e0 con 0x7fd3dc06b620 2023-10-14T11:12:52.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.143+0000 7fd3e1005640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc15ccf0 con 0x7fd3dc15feb0 2023-10-14T11:12:52.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.143+0000 7fd3db59e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3dc15feb0 0x7fd3dc0b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.143+0000 7fd3db59e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3dc15feb0 0x7fd3dc0b29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58470/0 (socket says 172.21.15.26:58470) 2023-10-14T11:12:52.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.143+0000 7fd3db59e640 1 -- 172.21.15.26:0/551510662 learned_addr learned my addr 172.21.15.26:0/551510662 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:52.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.143+0000 7fd3db59e640 1 -- 172.21.15.26:0/551510662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3dc06b620 msgr2=0x7fd3dc153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.143+0000 7fd3db59e640 1 --2- 172.21.15.26:0/551510662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3dc06b620 0x7fd3dc153a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.143+0000 7fd3db59e640 1 -- 172.21.15.26:0/551510662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3dc0d03a0 msgr2=0x7fd3dc201bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.143+0000 7fd3db59e640 1 --2- 172.21.15.26:0/551510662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3dc0d03a0 0x7fd3dc201bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.143+0000 7fd3db59e640 1 -- 172.21.15.26:0/551510662 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d4009af0 con 0x7fd3dc15feb0 2023-10-14T11:12:52.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.143+0000 7fd3db59e640 1 --2- 172.21.15.26:0/551510662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3dc15feb0 0x7fd3dc0b29c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4019530 tx=0x7fd3d40196c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.143+0000 7fd3dad9d640 1 --2- 172.21.15.26:0/551510662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3dc06b620 0x7fd3dc153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-10-14T11:12:52.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.147+0000 7fd3c37fe640 1 -- 172.21.15.26:0/551510662 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40ade20 con 0x7fd3dc15feb0 2023-10-14T11:12:52.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.147+0000 7fd3e1005640 1 -- 172.21.15.26:0/551510662 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3dc0b32c0 con 0x7fd3dc15feb0 2023-10-14T11:12:52.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.147+0000 7fd3c37fe640 1 -- 172.21.15.26:0/551510662 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d40094d0 con 0x7fd3dc15feb0 2023-10-14T11:12:52.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.147+0000 7fd3c37fe640 1 -- 172.21.15.26:0/551510662 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40ade20 con 0x7fd3dc15feb0 2023-10-14T11:12:52.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.147+0000 7fd3e1005640 1 -- 172.21.15.26:0/551510662 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3dc15d270 con 0x7fd3dc15feb0 2023-10-14T11:12:52.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.147+0000 7fd3e1005640 1 -- 172.21.15.26:0/551510662 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3dc15d750 con 0x7fd3dc15feb0 2023-10-14T11:12:52.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.151+0000 7fd3c37fe640 1 -- 172.21.15.26:0/551510662 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd3dc1604a0 con 0x7fd3dc15feb0 2023-10-14T11:12:52.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.151+0000 7fd3c37fe640 1 --2- 172.21.15.26:0/551510662 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd3c8066560 0x7fd3c8068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.151+0000 7fd3c37fe640 1 -- 172.21.15.26:0/551510662 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd3d411f4a0 con 0x7fd3dc15feb0 2023-10-14T11:12:52.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.151+0000 7fd3dad9d640 1 --2- 172.21.15.26:0/551510662 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd3c8066560 0x7fd3c8068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.155+0000 7fd3dad9d640 1 --2- 172.21.15.26:0/551510662 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd3c8066560 0x7fd3c8068a20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc000f70 tx=0x7fd3cc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.155+0000 7fd3c37fe640 1 -- 172.21.15.26:0/551510662 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd3d40ec6d0 con 0x7fd3dc15feb0 2023-10-14T11:12:52.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.171+0000 7f6882f80640 1 Processor -- start 2023-10-14T11:12:52.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.171+0000 7f6882f80640 1 -- start start 2023-10-14T11:12:52.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.175+0000 7f6882f80640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f687c15cb90 0x7f687c0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.175+0000 7f6882f80640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c0d3010 0x7f687c0d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.175+0000 7f6882f80640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687c0ce770 con 0x7f687c0d1400 2023-10-14T11:12:52.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.175+0000 7f6882f80640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f687c0d1890 con 0x7f687c15cb90 2023-10-14T11:12:52.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.175+0000 7f6882f80640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687c0d0600 con 0x7f687c0d3010 2023-10-14T11:12:52.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.175+0000 7f687bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c0d3010 0x7f687c0d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.175+0000 7f687bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c0d3010 0x7f687c0d0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58476/0 (socket says 172.21.15.26:58476) 2023-10-14T11:12:52.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.175+0000 7f687bfff640 1 -- 172.21.15.26:0/3170594514 learned_addr learned my addr 172.21.15.26:0/3170594514 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:52.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.175+0000 7f6880d1c640 1 --2- 172.21.15.26:0/3170594514 >> v2:172.21.15.110:3300/0 conn(0x7f687c15cb90 0x7f687c0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.179+0000 7f687bfff640 1 -- 172.21.15.26:0/3170594514 >> v2:172.21.15.110:3300/0 conn(0x7f687c15cb90 msgr2=0x7f687c0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:52.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.179+0000 7f687bfff640 1 --2- 172.21.15.26:0/3170594514 >> v2:172.21.15.110:3300/0 conn(0x7f687c15cb90 0x7f687c0cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.179+0000 7f687bfff640 1 -- 172.21.15.26:0/3170594514 >> v1:172.21.15.26:6789/0 conn(0x7f687c0d1400 legacy=0x7f687c0cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:52.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.179+0000 7f687bfff640 1 -- 172.21.15.26:0/3170594514 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c0c6450 con 0x7f687c0d3010 2023-10-14T11:12:52.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.183+0000 7f687bfff640 1 --2- 172.21.15.26:0/3170594514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c0d3010 0x7f687c0d0ec0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6870009870 tx=0x7f687001c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=157dce2816dc6742 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.183+0000 7fe593aea640 1 Processor -- start 2023-10-14T11:12:52.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.183+0000 7fa642209640 1 Processor -- start 2023-10-14T11:12:52.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.183+0000 7fe593aea640 1 -- start start 2023-10-14T11:12:52.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.183+0000 7f687b7fe640 1 -- 172.21.15.26:0/3170594514 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68700ab600 con 0x7f687c0d3010 2023-10-14T11:12:52.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.183+0000 7f687b7fe640 1 -- 172.21.15.26:0/3170594514 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68700ab760 con 0x7f687c0d3010 2023-10-14T11:12:52.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.183+0000 7f6882f80640 1 -- 172.21.15.26:0/3170594514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c0d3010 msgr2=0x7f687c0d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7f687b7fe640 1 -- 172.21.15.26:0/3170594514 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68700ab600 con 0x7f687c0d3010 2023-10-14T11:12:52.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7f6882f80640 1 --2- 172.21.15.26:0/3170594514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c0d3010 0x7f687c0d0ec0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6870009870 tx=0x7f687001c440 comp rx=0 tx=0).stop 2023-10-14T11:12:52.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fe593aea640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe58c0b07f0 0x7fe58c15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fe593aea640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe58c15d690 0x7fe58c164490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fe593aea640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58c15be60 con 0x7fe58c070c40 2023-10-14T11:12:52.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fe593aea640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe58c15b3b0 con 0x7fe58c15d690 2023-10-14T11:12:52.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fe593aea640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe58c15c1f0 con 0x7fe58c0b07f0 2023-10-14T11:12:52.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fe591085640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe58c0b07f0 0x7fe58c15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fe591085640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe58c0b07f0 0x7fe58c15ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:37394/0 (socket says 172.21.15.26:37394) 2023-10-14T11:12:52.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fe591085640 1 -- 172.21.15.26:0/122554835 learned_addr learned my addr 172.21.15.26:0/122554835 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:52.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.183+0000 7fa642209640 1 -- start start 2023-10-14T11:12:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fa642209640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa63c071e30 0x7fa63c0ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fa642209640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa63c0c9a80 0x7fa63c0caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fa642209640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63c06d010 con 0x7fa63c06c2e0 2023-10-14T11:12:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fa642209640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa63c0cb470 con 0x7fa63c071e30 2023-10-14T11:12:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fa642209640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c0c8cc0 con 0x7fa63c0c9a80 2023-10-14T11:12:52.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fa641207640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa63c071e30 0x7fa63c0ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fe592087640 1 --2- 172.21.15.26:0/122554835 >> v2:172.21.15.26:3300/0 conn(0x7fe58c15d690 0x7fe58c164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fa641207640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa63c071e30 0x7fa63c0ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36452/0 (socket says 172.21.15.26:36452) 2023-10-14T11:12:52.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fa641207640 1 -- 172.21.15.26:0/3107396127 learned_addr learned my addr 172.21.15.26:0/3107396127 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:52.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fa640a06640 1 --2- 172.21.15.26:0/3107396127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa63c0c9a80 0x7fa63c0caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fe591085640 1 -- 172.21.15.26:0/122554835 >> v2:172.21.15.26:3300/0 conn(0x7fe58c15d690 msgr2=0x7fe58c164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:52.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fe591085640 1 --2- 172.21.15.26:0/122554835 >> v2:172.21.15.26:3300/0 conn(0x7fe58c15d690 0x7fe58c164490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fe591085640 1 -- 172.21.15.26:0/122554835 >> v1:172.21.15.110:6789/0 conn(0x7fe58c070c40 legacy=0x7fe58c0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fe591085640 1 -- 172.21.15.26:0/122554835 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58c071020 con 0x7fe58c0b07f0 2023-10-14T11:12:52.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fe592087640 1 --2- 172.21.15.26:0/122554835 >> v2:172.21.15.26:3300/0 conn(0x7fe58c15d690 0x7fe58c164490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:52.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fa640a06640 1 -- 172.21.15.26:0/3107396127 >> v2:172.21.15.26:3300/0 conn(0x7fa63c071e30 msgr2=0x7fa63c0ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:52.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fa640a06640 1 --2- 172.21.15.26:0/3107396127 >> v2:172.21.15.26:3300/0 conn(0x7fa63c071e30 0x7fa63c0ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fa640a06640 1 -- 172.21.15.26:0/3107396127 >> v1:172.21.15.26:6789/0 conn(0x7fa63c06c2e0 legacy=0x7fa63c06c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:52.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7fa640a06640 1 -- 172.21.15.26:0/3107396127 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c0c8fa0 con 0x7fa63c0c9a80 2023-10-14T11:12:52.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7f6882f80640 1 -- 172.21.15.26:0/3170594514 shutdown_connections 2023-10-14T11:12:52.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7f6882f80640 1 --2- 172.21.15.26:0/3170594514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c0d3010 0x7f687c0d0ec0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7f6882f80640 1 --2- 172.21.15.26:0/3170594514 >> v2:172.21.15.110:3300/0 conn(0x7f687c15cb90 0x7f687c0cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7f6882f80640 1 -- 172.21.15.26:0/3170594514 >> 172.21.15.26:0/3170594514 conn(0x7f687c09bc50 msgr2=0x7f687c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:52.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7f6882f80640 1 -- 172.21.15.26:0/3170594514 shutdown_connections 2023-10-14T11:12:52.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7f8f20ed6640 1 Processor -- start 2023-10-14T11:12:52.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7f8f20ed6640 1 -- start start 2023-10-14T11:12:52.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.191+0000 7f8f20ed6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8f1c06ccb0 0x7f8f1c15c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.191+0000 7f8f20ed6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8f1c0712f0 0x7f8f1c071730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.191+0000 7f8f1a59c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8f1c06ccb0 0x7f8f1c15c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.191+0000 7f8f20ed6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f1c15d4f0 con 0x7f8f1c15ccd0 2023-10-14T11:12:52.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.191+0000 7f8f20ed6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1c070af0 con 0x7f8f1c0712f0 2023-10-14T11:12:52.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.191+0000 7f8f20ed6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1c070dd0 con 0x7f8f1c06ccb0 2023-10-14T11:12:52.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.191+0000 7f8f1ad9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8f1c0712f0 0x7f8f1c071730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.191+0000 7f8f1ad9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8f1c0712f0 0x7f8f1c071730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36454/0 (socket says 172.21.15.26:36454) 2023-10-14T11:12:52.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.191+0000 7f8f1ad9d640 1 -- 172.21.15.26:0/2372068843 learned_addr learned my addr 172.21.15.26:0/2372068843 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:52.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.187+0000 7f6882f80640 1 -- 172.21.15.26:0/3170594514 wait complete. 2023-10-14T11:12:52.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.191+0000 7f6882f80640 1 Processor -- start 2023-10-14T11:12:52.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.191+0000 7f6882f80640 1 -- start start 2023-10-14T11:12:52.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.191+0000 7f8f1a59c640 1 -- 172.21.15.26:0/2372068843 >> v2:172.21.15.26:3300/0 conn(0x7f8f1c0712f0 msgr2=0x7f8f1c071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:52.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.191+0000 7f8f1a59c640 1 --2- 172.21.15.26:0/2372068843 >> v2:172.21.15.26:3300/0 conn(0x7f8f1c0712f0 0x7f8f1c071730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.191+0000 7fa640a06640 1 --2- 172.21.15.26:0/3107396127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa63c0c9a80 0x7fa63c0caf30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa62c0097c0 tx=0x7fa62c01c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12a321675d3ff330 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.191+0000 7f8f1a59c640 1 -- 172.21.15.26:0/2372068843 >> v1:172.21.15.26:6789/0 conn(0x7f8f1c15ccd0 legacy=0x7f8f1c0cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.191+0000 7fa633fff640 1 -- 172.21.15.26:0/3107396127 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c0ab600 con 0x7fa63c0c9a80 2023-10-14T11:12:52.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.191+0000 7fa633fff640 1 -- 172.21.15.26:0/3107396127 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62c0a7050 con 0x7fa63c0c9a80 2023-10-14T11:12:52.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.191+0000 7fa633fff640 1 -- 172.21.15.26:0/3107396127 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c0ab980 con 0x7fa63c0c9a80 2023-10-14T11:12:52.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7fe591085640 1 --2- 172.21.15.26:0/122554835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe58c0b07f0 0x7fe58c15ae70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe58c0cc1e0 tx=0x7fe580020880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a125114b8c9354cf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7f8f1a59c640 1 -- 172.21.15.26:0/2372068843 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c0c9130 con 0x7f8f1c06ccb0 2023-10-14T11:12:52.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7fa642209640 1 -- 172.21.15.26:0/3107396127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa63c0c9a80 msgr2=0x7fa63c0caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7fa642209640 1 --2- 172.21.15.26:0/3107396127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa63c0c9a80 0x7fa63c0caf30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa62c0097c0 tx=0x7fa62c01c320 comp rx=0 tx=0).stop 2023-10-14T11:12:52.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7fa642209640 1 -- 172.21.15.26:0/3107396127 shutdown_connections 2023-10-14T11:12:52.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7f6882f80640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f687c0d1400 0x7f687c0ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7fe590884640 1 -- 172.21.15.26:0/122554835 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5800a9640 con 0x7fe58c0b07f0 2023-10-14T11:12:52.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7fe590884640 1 -- 172.21.15.26:0/122554835 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5800a97a0 con 0x7fe58c0b07f0 2023-10-14T11:12:52.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7fe590884640 1 -- 172.21.15.26:0/122554835 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5800a9b30 con 0x7fe58c0b07f0 2023-10-14T11:12:52.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7fa642209640 1 --2- 172.21.15.26:0/3107396127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa63c0c9a80 0x7fa63c0caf30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7fa642209640 1 --2- 172.21.15.26:0/3107396127 >> v2:172.21.15.26:3300/0 conn(0x7fa63c071e30 0x7fa63c0ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7fa642209640 1 -- 172.21.15.26:0/3107396127 >> 172.21.15.26:0/3107396127 conn(0x7fa63c0afe60 msgr2=0x7fa63c0b0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:52.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7f6882f80640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c0d3010 0x7f687c0cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7fa642209640 1 -- 172.21.15.26:0/3107396127 shutdown_connections 2023-10-14T11:12:52.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7f6880d1c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f687c0d1400 0x7f687c0ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7f6880d1c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f687c0d1400 0x7f687c0ca0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:37408/0 (socket says 172.21.15.26:37408) 2023-10-14T11:12:52.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7fe593aea640 1 -- 172.21.15.26:0/122554835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe58c0b07f0 msgr2=0x7fe58c15ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7fe593aea640 1 --2- 172.21.15.26:0/122554835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe58c0b07f0 0x7fe58c15ae70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe58c0cc1e0 tx=0x7fe580020880 comp rx=0 tx=0).stop 2023-10-14T11:12:52.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7f687bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c0d3010 0x7f687c0cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7fe593aea640 1 -- 172.21.15.26:0/122554835 shutdown_connections 2023-10-14T11:12:52.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7fa642209640 1 -- 172.21.15.26:0/3107396127 wait complete. 2023-10-14T11:12:52.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7f6882f80640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f687c15cb90 0x7f687c155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7fe593aea640 1 --2- 172.21.15.26:0/122554835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe58c0b07f0 0x7fe58c15ae70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7fe593aea640 1 --2- 172.21.15.26:0/122554835 >> v2:172.21.15.26:3300/0 conn(0x7fe58c15d690 0x7fe58c164490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7fe593aea640 1 -- 172.21.15.26:0/122554835 >> 172.21.15.26:0/122554835 conn(0x7fe58c06c190 msgr2=0x7fe58c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:52.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7f0b00209640 1 Processor -- start 2023-10-14T11:12:52.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7f687bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c0d3010 0x7f687c0cba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58488/0 (socket says 172.21.15.26:58488) 2023-10-14T11:12:52.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7fe593aea640 1 -- 172.21.15.26:0/122554835 shutdown_connections 2023-10-14T11:12:52.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7f6882f80640 1 -- 172.21.15.26:0/1921367999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c1591c0 con 0x7f687c15cb90 2023-10-14T11:12:52.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7f6880d1c640 1 -- 172.21.15.26:0/1921367999 learned_addr learned my addr 172.21.15.26:0/1921367999 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:52.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7f6882f80640 1 -- 172.21.15.26:0/1921367999 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c0ca630 con 0x7f687c0d1400 2023-10-14T11:12:52.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7fe593aea640 1 -- 172.21.15.26:0/122554835 wait complete. 2023-10-14T11:12:52.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7f6882f80640 1 -- 172.21.15.26:0/1921367999 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687c0cc2e0 con 0x7f687c0d3010 2023-10-14T11:12:52.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.195+0000 7f0b00209640 1 -- start start 2023-10-14T11:12:52.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f688151d640 1 --2- 172.21.15.26:0/1921367999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f687c15cb90 0x7f687c155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f92f0e67640 1 Processor -- start 2023-10-14T11:12:52.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7fa642209640 1 Processor -- start 2023-10-14T11:12:52.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f92f0e67640 1 -- start start 2023-10-14T11:12:52.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7fa642209640 1 -- start start 2023-10-14T11:12:52.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f688151d640 1 -- 172.21.15.26:0/1921367999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c0d3010 msgr2=0x7f687c0cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f688151d640 1 --2- 172.21.15.26:0/1921367999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c0d3010 0x7f687c0cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f688151d640 1 -- 172.21.15.26:0/1921367999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f687c0d1400 msgr2=0x7f687c0ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f688151d640 1 --2- 172.21.15.26:0/1921367999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f687c0d1400 0x7f687c0ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f688151d640 1 -- 172.21.15.26:0/1921367999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68700094d0 con 0x7f687c15cb90 2023-10-14T11:12:52.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f8f1a59c640 1 --2- 172.21.15.26:0/2372068843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f1c06ccb0 0x7f8f1c15c790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0cf760 tx=0x7f8f1401f0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d28941a11845c3fc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f0b00209640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0af8164520 0x7f0af80ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f0b00209640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af80ad960 0x7f0af80b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f0b00209640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af80c96f0 con 0x7f0af80c9b80 2023-10-14T11:12:52.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f0b00209640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af8164900 con 0x7f0af8164520 2023-10-14T11:12:52.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f0b00209640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af80cb950 con 0x7f0af80ad960 2023-10-14T11:12:52.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f688151d640 1 --2- 172.21.15.26:0/1921367999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f687c15cb90 0x7f687c155c70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f687400be00 tx=0x7f687400bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f0afd7a4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af80ad960 0x7f0af80b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7fe593aea640 1 Processor -- start 2023-10-14T11:12:52.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7fe593aea640 1 -- start start 2023-10-14T11:12:52.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7fa642209640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa63c06c2e0 0x7fa63c152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f92f0e67640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f92ec15cd60 0x7f92ec06af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f92f0e67640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ec0d3510 con 0x7f92ec15c980 2023-10-14T11:12:52.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f92f0e67640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ec0d2f50 con 0x7f92ec0d1490 2023-10-14T11:12:52.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f92f0e67640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ec0cd2b0 con 0x7f92ec15cd60 2023-10-14T11:12:52.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f92eaffd640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f92ec0d1490 0x7f92ec0cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:48664/0 (socket says 172.21.15.26:48664) 2023-10-14T11:12:52.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f92eaffd640 1 -- 172.21.15.26:0/2056245374 learned_addr learned my addr 172.21.15.26:0/2056245374 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:52.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f8f1959a640 1 -- 172.21.15.26:0/2372068843 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f140b0440 con 0x7f8f1c06ccb0 2023-10-14T11:12:52.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f8f1959a640 1 -- 172.21.15.26:0/2372068843 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f140b05a0 con 0x7f8f1c06ccb0 2023-10-14T11:12:52.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f8f1959a640 1 -- 172.21.15.26:0/2372068843 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f140b0930 con 0x7f8f1c06ccb0 2023-10-14T11:12:52.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f8f20ed6640 1 -- 172.21.15.26:0/2372068843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f1c06ccb0 msgr2=0x7f8f1c15c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f8f20ed6640 1 --2- 172.21.15.26:0/2372068843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f1c06ccb0 0x7f8f1c15c790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0cf760 tx=0x7f8f1401f0f0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f0afd7a4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af80ad960 0x7f0af80b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58504/0 (socket says 172.21.15.26:58504) 2023-10-14T11:12:52.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f0afd7a4640 1 -- 172.21.15.26:0/3310396770 learned_addr learned my addr 172.21.15.26:0/3310396770 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:52.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f0afd7a4640 1 -- 172.21.15.26:0/3310396770 >> v2:172.21.15.26:3300/0 conn(0x7f0af8164520 msgr2=0x7f0af80ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:52.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f0afd7a4640 1 --2- 172.21.15.26:0/3310396770 >> v2:172.21.15.26:3300/0 conn(0x7f0af8164520 0x7f0af80ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f0afd7a4640 1 -- 172.21.15.26:0/3310396770 >> v1:172.21.15.110:6789/0 conn(0x7f0af80c9b80 legacy=0x7f0af8164ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T11:12:52.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7f0afd7a4640 1 -- 172.21.15.26:0/3310396770 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af80cbed0 con 0x7f0af80ad960 2023-10-14T11:12:52.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7fa642209640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa63c071e30 0x7fa63c0c14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7fe593aea640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe58c070c40 0x7fe58c0c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fe593aea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe58c0b07f0 0x7fe58c152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fe593aea640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe58c15d690 0x7fe58c14ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fe593aea640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c154290 con 0x7fe58c0b07f0 2023-10-14T11:12:52.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fe593aea640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c153680 con 0x7fe58c070c40 2023-10-14T11:12:52.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f8f20ed6640 1 -- 172.21.15.26:0/2372068843 shutdown_connections 2023-10-14T11:12:52.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f8f20ed6640 1 --2- 172.21.15.26:0/2372068843 >> v2:172.21.15.26:3300/0 conn(0x7f8f1c0712f0 0x7f8f1c071730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f8f20ed6640 1 --2- 172.21.15.26:0/2372068843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f1c06ccb0 0x7f8f1c15c790 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f8f20ed6640 1 -- 172.21.15.26:0/2372068843 >> 172.21.15.26:0/2372068843 conn(0x7f8f1c06c190 msgr2=0x7f8f1c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:52.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7fa642209640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa63c0c9a80 0x7fa63c0c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7fa642209640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c14e090 con 0x7fa63c06c2e0 2023-10-14T11:12:52.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7fa642209640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c151e10 con 0x7fa63c0c9a80 2023-10-14T11:12:52.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.199+0000 7fa642209640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c1520f0 con 0x7fa63c071e30 2023-10-14T11:12:52.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fa640a06640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa63c071e30 0x7fa63c0c14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fa641207640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa63c06c2e0 0x7fa63c152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fe593aea640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c153960 con 0x7fe58c15d690 2023-10-14T11:12:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92ea7fc640 1 -- 172.21.15.26:0/2056245374 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899029854 0 0) 0x7f92ec0d2f50 con 0x7f92ec0d1490 2023-10-14T11:12:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92ea7fc640 1 -- 172.21.15.26:0/2056245374 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92d4003530 con 0x7f92ec0d1490 2023-10-14T11:12:52.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fa640a06640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa63c071e30 0x7fa63c0c14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58518/0 (socket says 172.21.15.26:58518) 2023-10-14T11:12:52.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fa640a06640 1 -- 172.21.15.26:0/3617631235 learned_addr learned my addr 172.21.15.26:0/3617631235 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:52.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fe591886640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe58c070c40 0x7fe58c0c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fe592087640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe58c15d690 0x7fe58c14ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92ebfff640 1 --2- 172.21.15.26:0/2056245374 >> v2:172.21.15.110:3300/0 conn(0x7f92ec15cd60 0x7f92ec06af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fa641a08640 1 --2- 172.21.15.26:0/3617631235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa63c0c9a80 0x7fa63c0c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fa641207640 1 -- 172.21.15.26:0/3617631235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa63c071e30 msgr2=0x7fa63c0c14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fa641207640 1 --2- 172.21.15.26:0/3617631235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa63c071e30 0x7fa63c0c14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fa641207640 1 -- 172.21.15.26:0/3617631235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa63c0c9a80 msgr2=0x7fa63c0c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fa641207640 1 --2- 172.21.15.26:0/3617631235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa63c0c9a80 0x7fa63c0c38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fa641207640 1 -- 172.21.15.26:0/3617631235 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c009420 con 0x7fa63c06c2e0 2023-10-14T11:12:52.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fe592087640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe58c15d690 0x7fe58c14ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58534/0 (socket says 172.21.15.26:58534) 2023-10-14T11:12:52.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fe592087640 1 -- 172.21.15.26:0/2213370409 learned_addr learned my addr 172.21.15.26:0/2213370409 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:52.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f8f20ed6640 1 -- 172.21.15.26:0/2372068843 shutdown_connections 2023-10-14T11:12:52.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f68797fa640 1 -- 172.21.15.26:0/1921367999 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687400ce70 con 0x7f687c15cb90 2023-10-14T11:12:52.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f68797fa640 1 -- 172.21.15.26:0/1921367999 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6874003980 con 0x7f687c15cb90 2023-10-14T11:12:52.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f68797fa640 1 -- 172.21.15.26:0/1921367999 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874003d50 con 0x7f687c15cb90 2023-10-14T11:12:52.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f6882f80640 1 -- 172.21.15.26:0/1921367999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f687c0cc5c0 con 0x7f687c15cb90 2023-10-14T11:12:52.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f6882f80640 1 -- 172.21.15.26:0/1921367999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687c0ccb80 con 0x7f687c15cb90 2023-10-14T11:12:52.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fa641207640 1 --2- 172.21.15.26:0/3617631235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa63c06c2e0 0x7fa63c152eb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa63800b6e0 tx=0x7fa63800e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fe591085640 1 --2- 172.21.15.26:0/2213370409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe58c0b07f0 0x7fe58c152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f8f20ed6640 1 -- 172.21.15.26:0/2372068843 wait complete. 2023-10-14T11:12:52.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92ea7fc640 1 -- 172.21.15.26:0/2056245374 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1404372357 0 0) 0x7f92d4003530 con 0x7f92ec0d1490 2023-10-14T11:12:52.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92ea7fc640 1 -- 172.21.15.26:0/2056245374 >> v2:172.21.15.110:3300/0 conn(0x7f92ec15cd60 msgr2=0x7f92ec06af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:52.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92ea7fc640 1 --2- 172.21.15.26:0/2056245374 >> v2:172.21.15.110:3300/0 conn(0x7f92ec15cd60 0x7f92ec06af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92ea7fc640 1 -- 172.21.15.26:0/2056245374 >> v1:172.21.15.26:6789/0 conn(0x7f92ec15c980 legacy=0x7f92ec0d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92ea7fc640 1 -- 172.21.15.26:0/2056245374 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec0d3230 con 0x7f92ec0d1490 2023-10-14T11:12:52.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92ea7fc640 1 -- 172.21.15.26:0/2056245374 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f92e0001680 con 0x7f92ec0d1490 2023-10-14T11:12:52.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92ea7fc640 1 -- 172.21.15.26:0/2056245374 >> v1:172.21.15.110:6789/0 conn(0x7f92ec0d1490 legacy=0x7f92ec0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92ea7fc640 1 --2- 172.21.15.26:0/2056245374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92d4003a60 0x7f92d4003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92ea7fc640 1 --2- 172.21.15.26:0/2056245374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92d40047d0 0x7f92d4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92eaffd640 1 --2- 172.21.15.26:0/2056245374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92d40047d0 0x7f92d4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92ea7fc640 1 --2- 172.21.15.26:0/2056245374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92d4005390 0x7f92d40141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92ea7fc640 1 -- 172.21.15.26:0/2056245374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0cd2b0 con 0x7f92d4005390 2023-10-14T11:12:52.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92ea7fc640 1 -- 172.21.15.26:0/2056245374 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d4014a60 con 0x7f92d40047d0 2023-10-14T11:12:52.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92ea7fc640 1 -- 172.21.15.26:0/2056245374 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d4014c20 con 0x7f92d4003a60 2023-10-14T11:12:52.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fa631ffb640 1 -- 172.21.15.26:0/3617631235 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa638010040 con 0x7fa63c06c2e0 2023-10-14T11:12:52.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92eb7fe640 1 --2- 172.21.15.26:0/2056245374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92d4003a60 0x7f92d4003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92eaffd640 1 -- 172.21.15.26:0/2056245374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92d4003a60 msgr2=0x7f92d4003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:52.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92eaffd640 1 --2- 172.21.15.26:0/2056245374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92d4003a60 0x7f92d4003e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92eaffd640 1 -- 172.21.15.26:0/2056245374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92d4005390 msgr2=0x7f92d40141a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T11:12:52.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fa631ffb640 1 -- 172.21.15.26:0/3617631235 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63800ec40 con 0x7fa63c06c2e0 2023-10-14T11:12:52.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fa631ffb640 1 -- 172.21.15.26:0/3617631235 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa638016410 con 0x7fa63c06c2e0 2023-10-14T11:12:52.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fa642209640 1 -- 172.21.15.26:0/3617631235 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63c1523d0 con 0x7fa63c06c2e0 2023-10-14T11:12:52.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7fa642209640 1 -- 172.21.15.26:0/3617631235 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63c152990 con 0x7fa63c06c2e0 2023-10-14T11:12:52.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92eaffd640 1 --2- 172.21.15.26:0/2056245374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92d4005390 0x7f92d40141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92eaffd640 1 -- 172.21.15.26:0/2056245374 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec0d3230 con 0x7f92d40047d0 2023-10-14T11:12:52.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.203+0000 7f92ebfff640 1 -- 172.21.15.26:0/2056245374 reap_dead start 2023-10-14T11:12:52.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7fe591886640 1 -- 172.21.15.26:0/2213370409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe58c15d690 msgr2=0x7fe58c14ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7fe591886640 1 --2- 172.21.15.26:0/2213370409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe58c15d690 0x7fe58c14ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7fe591886640 1 -- 172.21.15.26:0/2213370409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe58c0b07f0 msgr2=0x7fe58c152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7fe591886640 1 --2- 172.21.15.26:0/2213370409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe58c0b07f0 0x7fe58c152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7fe591886640 1 -- 172.21.15.26:0/2213370409 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5800094d0 con 0x7fe58c070c40 2023-10-14T11:12:52.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7fa642209640 1 -- 172.21.15.26:0/3617631235 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63c15d3d0 con 0x7fa63c06c2e0 2023-10-14T11:12:52.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7f6882f80640 1 -- 172.21.15.26:0/1921367999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f687c074010 con 0x7f687c15cb90 2023-10-14T11:12:52.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7fe592087640 1 --2- 172.21.15.26:0/2213370409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe58c15d690 0x7fe58c14ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:12:52.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7fe591886640 1 --2- 172.21.15.26:0/2213370409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe58c070c40 0x7fe58c0c45a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00c770 tx=0x7fe57c00cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7fe58a7fc640 1 -- 172.21.15.26:0/2213370409 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c003b80 con 0x7fe58c070c40 2023-10-14T11:12:52.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7fe58a7fc640 1 -- 172.21.15.26:0/2213370409 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57c003ce0 con 0x7fe58c070c40 2023-10-14T11:12:52.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7fe58a7fc640 1 -- 172.21.15.26:0/2213370409 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c00aa70 con 0x7fe58c070c40 2023-10-14T11:12:52.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7fe593aea640 1 -- 172.21.15.26:0/2213370409 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58c153c40 con 0x7fe58c070c40 2023-10-14T11:12:52.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7fe593aea640 1 -- 172.21.15.26:0/2213370409 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58c15a3c0 con 0x7fe58c070c40 2023-10-14T11:12:52.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7f8f20ed6640 1 Processor -- start 2023-10-14T11:12:52.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7f8f20ed6640 1 -- start start 2023-10-14T11:12:52.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7f8f20ed6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f1c06ccb0 0x7f8f1c0b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7f8f20ed6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f1c0712f0 0x7f8f1c14a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7f8f20ed6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c15ccd0 0x7f8f1c0c2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7fa631ffb640 1 -- 172.21.15.26:0/3617631235 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa638016570 con 0x7fa63c06c2e0 2023-10-14T11:12:52.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7f8f20ed6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0c6bf0 con 0x7f8f1c15ccd0 2023-10-14T11:12:52.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7f8f20ed6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0b1280 con 0x7f8f1c06ccb0 2023-10-14T11:12:52.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7f8f20ed6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0b21d0 con 0x7f8f1c0712f0 2023-10-14T11:12:52.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.207+0000 7f8f19d9b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f1c0712f0 0x7f8f1c14a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7f8f19d9b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f1c0712f0 0x7f8f1c14a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58562/0 (socket says 172.21.15.26:58562) 2023-10-14T11:12:52.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7f8f19d9b640 1 -- 172.21.15.26:0/154954152 learned_addr learned my addr 172.21.15.26:0/154954152 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:52.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7f68797fa640 1 -- 172.21.15.26:0/1921367999 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6874004020 con 0x7f687c15cb90 2023-10-14T11:12:52.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7f8f19d9b640 1 -- 172.21.15.26:0/154954152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f1c06ccb0 msgr2=0x7f8f1c0b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7f8f19d9b640 1 --2- 172.21.15.26:0/154954152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f1c06ccb0 0x7f8f1c0b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7f8f19d9b640 1 -- 172.21.15.26:0/154954152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c15ccd0 msgr2=0x7f8f1c0c2cd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T11:12:52.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7f8f19d9b640 1 --2- 172.21.15.26:0/154954152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c15ccd0 0x7f8f1c0c2cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7f8f19d9b640 1 -- 172.21.15.26:0/154954152 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f14009a70 con 0x7f8f1c0712f0 2023-10-14T11:12:52.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7f68797fa640 1 --2- 172.21.15.26:0/1921367999 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6868066520 0x7f68680689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7fe593aea640 1 -- 172.21.15.26:0/2213370409 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe58c074010 con 0x7fe58c070c40 2023-10-14T11:12:52.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7fa631ffb640 1 --2- 172.21.15.26:0/3617631235 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa6200664f0 0x7fa6200689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7fa631ffb640 1 -- 172.21.15.26:0/3617631235 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa638084d10 con 0x7fa63c06c2e0 2023-10-14T11:12:52.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7f68797fa640 1 -- 172.21.15.26:0/1921367999 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f68740557c0 con 0x7f687c15cb90 2023-10-14T11:12:52.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7f8f19d9b640 1 --2- 172.21.15.26:0/154954152 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f1c0712f0 0x7f8f1c14a9a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00c390 tx=0x7f8f0c00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7f6880d1c640 1 --2- 172.21.15.26:0/1921367999 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6868066520 0x7f68680689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7fa640a06640 1 --2- 172.21.15.26:0/3617631235 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa6200664f0 0x7fa6200689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7f8f0affd640 1 -- 172.21.15.26:0/154954152 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c0052d0 con 0x7f8f1c0712f0 2023-10-14T11:12:52.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7f8f0affd640 1 -- 172.21.15.26:0/154954152 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0c005430 con 0x7f8f1c0712f0 2023-10-14T11:12:52.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7f8f0affd640 1 -- 172.21.15.26:0/154954152 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c003820 con 0x7f8f1c0712f0 2023-10-14T11:12:52.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7f8f20ed6640 1 -- 172.21.15.26:0/154954152 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f1c0cd210 con 0x7f8f1c0712f0 2023-10-14T11:12:52.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7f8f20ed6640 1 -- 172.21.15.26:0/154954152 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f1c0c6910 con 0x7f8f1c0712f0 2023-10-14T11:12:52.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7f0afd7a4640 1 --2- 172.21.15.26:0/3310396770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af80ad960 0x7f0af80b00e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009e50 tx=0x7f0af401c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55b87fe630c9091 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7f0afcfa3640 1 -- 172.21.15.26:0/3310396770 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af40a5800 con 0x7f0af80ad960 2023-10-14T11:12:52.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7fe58a7fc640 1 -- 172.21.15.26:0/2213370409 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe57c00abd0 con 0x7fe58c070c40 2023-10-14T11:12:52.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.215+0000 7f92eaffd640 1 --2- 172.21.15.26:0/2056245374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92d40047d0 0x7f92d4004c50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f92ec1605e0 tx=0x7f92e001f370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f6a33206cdccac5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.211+0000 7f0afcfa3640 1 -- 172.21.15.26:0/3310396770 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af40a5960 con 0x7f0af80ad960 2023-10-14T11:12:52.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.215+0000 7f0afcfa3640 1 -- 172.21.15.26:0/3310396770 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af40a5cf0 con 0x7f0af80ad960 2023-10-14T11:12:52.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.215+0000 7f8f20ed6640 1 -- 172.21.15.26:0/154954152 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f1c074010 con 0x7f8f1c0712f0 2023-10-14T11:12:52.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.215+0000 7f6880d1c640 1 --2- 172.21.15.26:0/1921367999 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6868066520 0x7f68680689e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f686c009c00 tx=0x7f686c006f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.215+0000 7fa640a06640 1 --2- 172.21.15.26:0/3617631235 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa6200664f0 0x7fa6200689b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa62c000c10 tx=0x7fa62c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.215+0000 7f0b00209640 1 -- 172.21.15.26:0/3310396770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af80ad960 msgr2=0x7f0af80b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.215+0000 7f0b00209640 1 --2- 172.21.15.26:0/3310396770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af80ad960 0x7f0af80b00e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009e50 tx=0x7f0af401c9a0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.215+0000 7fe58a7fc640 1 --2- 172.21.15.26:0/2213370409 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe578066570 0x7fe578068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.215+0000 7fe58a7fc640 1 -- 172.21.15.26:0/2213370409 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe57c083e90 con 0x7fe58c070c40 2023-10-14T11:12:52.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.215+0000 7fe591085640 1 --2- 172.21.15.26:0/2213370409 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe578066570 0x7fe578068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.215+0000 7f0b00209640 1 -- 172.21.15.26:0/3310396770 shutdown_connections 2023-10-14T11:12:52.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.215+0000 7f0b00209640 1 --2- 172.21.15.26:0/3310396770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af80ad960 0x7f0af80b00e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.215+0000 7f0b00209640 1 --2- 172.21.15.26:0/3310396770 >> v2:172.21.15.26:3300/0 conn(0x7f0af8164520 0x7f0af80ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.215+0000 7f0b00209640 1 -- 172.21.15.26:0/3310396770 >> 172.21.15.26:0/3310396770 conn(0x7f0af806c190 msgr2=0x7f0af806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:52.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.215+0000 7f8f0affd640 1 -- 172.21.15.26:0/154954152 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8f0c003980 con 0x7f8f1c0712f0 2023-10-14T11:12:52.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.215+0000 7f0b00209640 1 -- 172.21.15.26:0/3310396770 shutdown_connections 2023-10-14T11:12:52.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.215+0000 7f0b00209640 1 -- 172.21.15.26:0/3310396770 wait complete. 2023-10-14T11:12:52.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.219+0000 7fe591085640 1 --2- 172.21.15.26:0/2213370409 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe578066570 0x7fe578068a30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe5800b3000 tx=0x7fe5800ab070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.219+0000 7f68797fa640 1 -- 172.21.15.26:0/1921367999 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6874051b00 con 0x7f687c15cb90 2023-10-14T11:12:52.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.219+0000 7f8f0affd640 1 --2- 172.21.15.26:0/154954152 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8efc0664f0 0x7f8efc0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.219+0000 7f8f0affd640 1 -- 172.21.15.26:0/154954152 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8f0c083630 con 0x7f8f1c0712f0 2023-10-14T11:12:52.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.219+0000 7f8f1a59c640 1 --2- 172.21.15.26:0/154954152 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8efc0664f0 0x7f8efc0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.219+0000 7f92ea7fc640 1 -- 172.21.15.26:0/2056245374 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e0005ae0 con 0x7f92d40047d0 2023-10-14T11:12:52.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.219+0000 7f92ea7fc640 1 -- 172.21.15.26:0/2056245374 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e00ab070 con 0x7f92d40047d0 2023-10-14T11:12:52.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.219+0000 7f92ea7fc640 1 -- 172.21.15.26:0/2056245374 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e0007070 con 0x7f92d40047d0 2023-10-14T11:12:52.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.219+0000 7fe58a7fc640 1 -- 172.21.15.26:0/2213370409 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe57c051090 con 0x7fe58c070c40 2023-10-14T11:12:52.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.219+0000 7f92f0e67640 1 -- 172.21.15.26:0/2056245374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92d40047d0 msgr2=0x7f92d4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.219+0000 7f92f0e67640 1 --2- 172.21.15.26:0/2056245374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92d40047d0 0x7f92d4004c50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f92ec1605e0 tx=0x7f92e001f370 comp rx=0 tx=0).stop 2023-10-14T11:12:52.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.219+0000 7f8f1a59c640 1 --2- 172.21.15.26:0/154954152 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8efc0664f0 0x7f8efc0689b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8f140b2000 tx=0x7f8f14004ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.219+0000 7f92f0e67640 1 -- 172.21.15.26:0/2056245374 shutdown_connections 2023-10-14T11:12:52.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.219+0000 7f92f0e67640 1 --2- 172.21.15.26:0/2056245374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92d40047d0 0x7f92d4004c50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.219+0000 7f92f0e67640 1 -- 172.21.15.26:0/2056245374 >> 172.21.15.26:0/2056245374 conn(0x7f92ec09ba80 msgr2=0x7f92ec0d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:52.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.219+0000 7f0b00209640 1 Processor -- start 2023-10-14T11:12:52.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.223+0000 7f0b00209640 1 -- start start 2023-10-14T11:12:52.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.223+0000 7f0b00209640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af80ad960 0x7f0af8156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.223+0000 7f0b00209640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0af80c9b80 0x7f0af81639b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.223+0000 7f0b00209640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0af8164520 0x7f0af8154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.223+0000 7f0b00209640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af80c5a80 con 0x7f0af8164520 2023-10-14T11:12:52.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.223+0000 7f0b00209640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af80c5730 con 0x7f0af80c9b80 2023-10-14T11:12:52.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.223+0000 7f0b00209640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af8154cf0 con 0x7f0af80ad960 2023-10-14T11:12:52.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.223+0000 7f0afdfa5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af80ad960 0x7f0af8156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.223+0000 7f0afdfa5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af80ad960 0x7f0af8156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58570/0 (socket says 172.21.15.26:58570) 2023-10-14T11:12:52.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.223+0000 7f0afdfa5640 1 -- 172.21.15.26:0/3077760860 learned_addr learned my addr 172.21.15.26:0/3077760860 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:52.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.223+0000 7fa631ffb640 1 -- 172.21.15.26:0/3617631235 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa638051f10 con 0x7fa63c06c2e0 2023-10-14T11:12:52.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.223+0000 7f0afd7a4640 1 --2- 172.21.15.26:0/3077760860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0af80c9b80 0x7f0af81639b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.223+0000 7f92f0e67640 1 -- 172.21.15.26:0/2056245374 shutdown_connections 2023-10-14T11:12:52.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.223+0000 7f92f0e67640 1 -- 172.21.15.26:0/2056245374 wait complete. 2023-10-14T11:12:52.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.223+0000 7f92f0e67640 1 Processor -- start 2023-10-14T11:12:52.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.223+0000 7f0afdfa5640 1 -- 172.21.15.26:0/3077760860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0af80c9b80 msgr2=0x7f0af81639b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.223+0000 7f0afdfa5640 1 --2- 172.21.15.26:0/3077760860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0af80c9b80 0x7f0af81639b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.223+0000 7f0afdfa5640 1 -- 172.21.15.26:0/3077760860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0af8164520 msgr2=0x7f0af8154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.223+0000 7f0afdfa5640 1 --2- 172.21.15.26:0/3077760860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0af8164520 0x7f0af8154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.223+0000 7f0afdfa5640 1 -- 172.21.15.26:0/3077760860 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af4009b30 con 0x7f0af80ad960 2023-10-14T11:12:52.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.223+0000 7f0afdfa5640 1 --2- 172.21.15.26:0/3077760860 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af80ad960 0x7f0af8156c90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0af000b550 tx=0x7f0af000ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.227+0000 7f0aee7fc640 1 -- 172.21.15.26:0/3077760860 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0010870 con 0x7f0af80ad960 2023-10-14T11:12:52.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.227+0000 7f0aee7fc640 1 -- 172.21.15.26:0/3077760860 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af00109f0 con 0x7f0af80ad960 2023-10-14T11:12:52.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.227+0000 7f0aee7fc640 1 -- 172.21.15.26:0/3077760860 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0010da0 con 0x7f0af80ad960 2023-10-14T11:12:52.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.227+0000 7f8f0affd640 1 -- 172.21.15.26:0/154954152 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8f0c0508b0 con 0x7f8f1c0712f0 2023-10-14T11:12:52.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.227+0000 7f0b00209640 1 -- 172.21.15.26:0/3077760860 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af8157270 con 0x7f0af80ad960 2023-10-14T11:12:52.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.227+0000 7f0b00209640 1 -- 172.21.15.26:0/3077760860 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af8157830 con 0x7f0af80ad960 2023-10-14T11:12:52.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.227+0000 7f92f0e67640 1 -- start start 2023-10-14T11:12:52.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.227+0000 7f92f0e67640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92d40047d0 0x7f92ec15ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.227+0000 7f92f0e67640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92ec0cc630 0x7f92ec0c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.227+0000 7f92f0e67640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ec0c9fc0 0x7f92ec1fbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.227+0000 7f92f0e67640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0cafc0 con 0x7f92ec0c9fc0 2023-10-14T11:12:52.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.227+0000 7f92f0e67640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0ca440 con 0x7f92ec0cc630 2023-10-14T11:12:52.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.227+0000 7f92f0e67640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0ca720 con 0x7f92d40047d0 2023-10-14T11:12:52.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.227+0000 7f92eaffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92ec0cc630 0x7f92ec0c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.227+0000 7f92eaffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92ec0cc630 0x7f92ec0c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:37476/0 (socket says 172.21.15.26:37476) 2023-10-14T11:12:52.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.227+0000 7f92eaffd640 1 -- 172.21.15.26:0/94659675 learned_addr learned my addr 172.21.15.26:0/94659675 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:52.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.227+0000 7f92eaffd640 1 -- 172.21.15.26:0/94659675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92d40047d0 msgr2=0x7f92ec15ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.227+0000 7f92eaffd640 1 --2- 172.21.15.26:0/94659675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92d40047d0 0x7f92ec15ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.227+0000 7f92eaffd640 1 -- 172.21.15.26:0/94659675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ec0c9fc0 msgr2=0x7f92ec1fbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.227+0000 7f92eaffd640 1 --2- 172.21.15.26:0/94659675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ec0c9fc0 0x7f92ec1fbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.227+0000 7f92eaffd640 1 -- 172.21.15.26:0/94659675 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec0caa00 con 0x7f92ec0cc630 2023-10-14T11:12:52.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.227+0000 7f0b00209640 1 -- 172.21.15.26:0/3077760860 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae0005260 con 0x7f0af80ad960 2023-10-14T11:12:52.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.231+0000 7f92eaffd640 1 --2- 172.21.15.26:0/94659675 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92ec0cc630 0x7f92ec0c9a80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f92e001f1a0 tx=0x7f92d4005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.231+0000 7f92d3fff640 1 -- 172.21.15.26:0/94659675 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e00b4070 con 0x7f92ec0cc630 2023-10-14T11:12:52.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.231+0000 7f92d3fff640 1 -- 172.21.15.26:0/94659675 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e00b5040 con 0x7f92ec0cc630 2023-10-14T11:12:52.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.231+0000 7f92d3fff640 1 -- 172.21.15.26:0/94659675 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e0001680 con 0x7f92ec0cc630 2023-10-14T11:12:52.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.231+0000 7f92f0e67640 1 -- 172.21.15.26:0/94659675 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ec0cace0 con 0x7f92ec0cc630 2023-10-14T11:12:52.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.231+0000 7f92f0e67640 1 -- 172.21.15.26:0/94659675 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ec15b420 con 0x7f92ec0cc630 2023-10-14T11:12:52.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.231+0000 7f0aee7fc640 1 -- 172.21.15.26:0/3077760860 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0af000f3c0 con 0x7f0af80ad960 2023-10-14T11:12:52.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.231+0000 7f0aee7fc640 1 --2- 172.21.15.26:0/3077760860 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0adc066570 0x7f0adc068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.231+0000 7f0aee7fc640 1 -- 172.21.15.26:0/3077760860 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0af00841b0 con 0x7f0af80ad960 2023-10-14T11:12:52.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.235+0000 7f0afd7a4640 1 --2- 172.21.15.26:0/3077760860 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0adc066570 0x7f0adc068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.235+0000 7f0afd7a4640 1 --2- 172.21.15.26:0/3077760860 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0adc066570 0x7f0adc068a30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0af40ae000 tx=0x7f0af40a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.235+0000 7f0aee7fc640 1 -- 172.21.15.26:0/3077760860 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0af0051320 con 0x7f0af80ad960 2023-10-14T11:12:52.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.235+0000 7f92d3fff640 1 -- 172.21.15.26:0/94659675 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f92e0007290 con 0x7f92ec0cc630 2023-10-14T11:12:52.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.239+0000 7f92d3fff640 1 --2- 172.21.15.26:0/94659675 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f92d8066570 0x7f92d8068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.239+0000 7f92d3fff640 1 -- 172.21.15.26:0/94659675 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f92e01213c0 con 0x7f92ec0cc630 2023-10-14T11:12:52.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.239+0000 7f92f0e67640 1 -- 172.21.15.26:0/94659675 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ec04e9c0 con 0x7f92ec0cc630 2023-10-14T11:12:52.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.239+0000 7f92eb7fe640 1 --2- 172.21.15.26:0/94659675 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f92d8066570 0x7f92d8068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.239+0000 7f92eb7fe640 1 --2- 172.21.15.26:0/94659675 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f92d8066570 0x7f92d8068a30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f92dc007fd0 tx=0x7f92dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.243+0000 7f92d3fff640 1 -- 172.21.15.26:0/94659675 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f92e00ee5c0 con 0x7f92ec0cc630 2023-10-14T11:12:52.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.247+0000 7f8ba3365640 1 Processor -- start 2023-10-14T11:12:52.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.251+0000 7f8ba3365640 1 -- start start 2023-10-14T11:12:52.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.251+0000 7f8ba3365640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8b9c0c9920 0x7f8b9c15c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.251+0000 7f8ba3365640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b9c0c9d00 0x7f8b9c0712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.251+0000 7f8ba1101640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8b9c0c9920 0x7f8b9c15c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.251+0000 7f8ba1101640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8b9c0c9920 0x7f8b9c15c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:37486/0 (socket says 172.21.15.26:37486) 2023-10-14T11:12:52.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.251+0000 7f8ba1902640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b9c0c9d00 0x7f8b9c0712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.251+0000 7f8ba1902640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b9c0c9d00 0x7f8b9c0712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36528/0 (socket says 172.21.15.26:36528) 2023-10-14T11:12:52.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.251+0000 7f8ba0900640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8b9c15ccd0 0x7f8b9c0cc980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58020/0 (socket says 172.21.15.26:58020) 2023-10-14T11:12:52.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.251+0000 7f8ba1101640 1 -- 172.21.15.26:0/1936419193 learned_addr learned my addr 172.21.15.26:0/1936419193 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:52.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.251+0000 7f8ba3365640 1 -- 172.21.15.26:0/1936419193 --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9c15d210 con 0x7f8b9c15ccd0 2023-10-14T11:12:52.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.251+0000 7f8ba3365640 1 -- 172.21.15.26:0/1936419193 --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9c15d4f0 con 0x7f8b9c0c9d00 2023-10-14T11:12:52.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.251+0000 7f8ba3365640 1 -- 172.21.15.26:0/1936419193 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9c070af0 con 0x7f8b9c0c9920 2023-10-14T11:12:52.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.251+0000 7f8ba1902640 1 -- 172.21.15.26:0/1936419193 >> v2:172.21.15.110:3300/0 conn(0x7f8b9c0c9920 msgr2=0x7f8b9c15c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:52.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.255+0000 7f8ba1902640 1 --2- 172.21.15.26:0/1936419193 >> v2:172.21.15.110:3300/0 conn(0x7f8b9c0c9920 0x7f8b9c15c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.255+0000 7f8ba1902640 1 -- 172.21.15.26:0/1936419193 >> v1:172.21.15.26:6789/0 conn(0x7f8b9c15ccd0 legacy=0x7f8b9c0cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:52.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.255+0000 7f8ba1902640 1 -- 172.21.15.26:0/1936419193 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c070dd0 con 0x7f8b9c0c9d00 2023-10-14T11:12:52.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.259+0000 7f8ba1902640 1 --2- 172.21.15.26:0/1936419193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b9c0c9d00 0x7f8b9c0712f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0cf760 tx=0x7f8b9401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35b8d2611b3f3bd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.259+0000 7f8b9bfff640 1 -- 172.21.15.26:0/1936419193 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b940ad680 con 0x7f8b9c0c9d00 2023-10-14T11:12:52.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.259+0000 7f8b9bfff640 1 -- 172.21.15.26:0/1936419193 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b940ad7e0 con 0x7f8b9c0c9d00 2023-10-14T11:12:52.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.259+0000 7f8b9bfff640 1 -- 172.21.15.26:0/1936419193 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b940adb70 con 0x7f8b9c0c9d00 2023-10-14T11:12:52.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.259+0000 7f8ba3365640 1 -- 172.21.15.26:0/1936419193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b9c0c9d00 msgr2=0x7f8b9c0712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.259+0000 7f8ba3365640 1 --2- 172.21.15.26:0/1936419193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b9c0c9d00 0x7f8b9c0712f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0cf760 tx=0x7f8b9401c3e0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.259+0000 7f8ba3365640 1 -- 172.21.15.26:0/1936419193 shutdown_connections 2023-10-14T11:12:52.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.259+0000 7f8ba3365640 1 --2- 172.21.15.26:0/1936419193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b9c0c9d00 0x7f8b9c0712f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.259+0000 7f8ba3365640 1 --2- 172.21.15.26:0/1936419193 >> v2:172.21.15.110:3300/0 conn(0x7f8b9c0c9920 0x7f8b9c15c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.259+0000 7f8ba3365640 1 -- 172.21.15.26:0/1936419193 >> 172.21.15.26:0/1936419193 conn(0x7f8b9c06c190 msgr2=0x7f8b9c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:52.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.263+0000 7f8ba3365640 1 -- 172.21.15.26:0/1936419193 shutdown_connections 2023-10-14T11:12:52.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.263+0000 7f8ba3365640 1 -- 172.21.15.26:0/1936419193 wait complete. 2023-10-14T11:12:52.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.263+0000 7f8ba3365640 1 Processor -- start 2023-10-14T11:12:52.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.263+0000 7f8ba3365640 1 -- start start 2023-10-14T11:12:52.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.267+0000 7f8ba3365640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b9c0c9920 0x7f8b9c0b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.267+0000 7f8ba3365640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b9c0c9d00 0x7f8b9c0c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.267+0000 7f8ba3365640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b9c15ccd0 0x7f8b9c0c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.267+0000 7f8ba3365640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0b1c90 con 0x7f8b9c0c9d00 2023-10-14T11:12:52.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.267+0000 7f8ba3365640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0b40d0 con 0x7f8b9c15ccd0 2023-10-14T11:12:52.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.267+0000 7f8ba3365640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0b1ea0 con 0x7f8b9c0c9920 2023-10-14T11:12:52.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.267+0000 7f8ba1101640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b9c0c9920 0x7f8b9c0b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.267+0000 7f8ba1101640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b9c0c9920 0x7f8b9c0b3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58586/0 (socket says 172.21.15.26:58586) 2023-10-14T11:12:52.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.267+0000 7f8ba1101640 1 -- 172.21.15.26:0/1567467013 learned_addr learned my addr 172.21.15.26:0/1567467013 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:52.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.267+0000 7f8ba1902640 1 --2- 172.21.15.26:0/1567467013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b9c15ccd0 0x7f8b9c0c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.267+0000 7f8ba0900640 1 --2- 172.21.15.26:0/1567467013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b9c0c9d00 0x7f8b9c0c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.267+0000 7f8ba1101640 1 -- 172.21.15.26:0/1567467013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b9c15ccd0 msgr2=0x7f8b9c0c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.267+0000 7f8ba1101640 1 --2- 172.21.15.26:0/1567467013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b9c15ccd0 0x7f8b9c0c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.267+0000 7f8ba1101640 1 -- 172.21.15.26:0/1567467013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b9c0c9d00 msgr2=0x7f8b9c0c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.267+0000 7f8ba1101640 1 --2- 172.21.15.26:0/1567467013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b9c0c9d00 0x7f8b9c0c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.267+0000 7f8ba1101640 1 -- 172.21.15.26:0/1567467013 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b94009420 con 0x7f8b9c0c9920 2023-10-14T11:12:52.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.267+0000 7f8ba0900640 1 --2- 172.21.15.26:0/1567467013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b9c0c9d00 0x7f8b9c0c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:52.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.267+0000 7f8ba1101640 1 --2- 172.21.15.26:0/1567467013 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b9c0c9920 0x7f8b9c0b3b90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000d730 tx=0x7f8b9000dbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.267+0000 7f8b99ffb640 1 -- 172.21.15.26:0/1567467013 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9000f040 con 0x7f8b9c0c9920 2023-10-14T11:12:52.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.267+0000 7f8ba3365640 1 -- 172.21.15.26:0/1567467013 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9c0cd210 con 0x7f8b9c0c9920 2023-10-14T11:12:52.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.271+0000 7f8ba3365640 1 -- 172.21.15.26:0/1567467013 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9c0b2460 con 0x7f8b9c0c9920 2023-10-14T11:12:52.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.271+0000 7f8b99ffb640 1 -- 172.21.15.26:0/1567467013 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9000b820 con 0x7f8b9c0c9920 2023-10-14T11:12:52.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.271+0000 7f8b99ffb640 1 -- 172.21.15.26:0/1567467013 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9000f040 con 0x7f8b9c0c9920 2023-10-14T11:12:52.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.275+0000 7f8ba3365640 1 -- 172.21.15.26:0/1567467013 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b7c005260 con 0x7f8b9c0c9920 2023-10-14T11:12:52.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.275+0000 7f8b99ffb640 1 -- 172.21.15.26:0/1567467013 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8b9000b990 con 0x7f8b9c0c9920 2023-10-14T11:12:52.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.275+0000 7f8b99ffb640 1 --2- 172.21.15.26:0/1567467013 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8b88066500 0x7f8b880689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.275+0000 7f8b99ffb640 1 -- 172.21.15.26:0/1567467013 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8b90083eb0 con 0x7f8b9c0c9920 2023-10-14T11:12:52.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.279+0000 7f8ba0900640 1 --2- 172.21.15.26:0/1567467013 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8b88066500 0x7f8b880689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.279+0000 7f8ba0900640 1 --2- 172.21.15.26:0/1567467013 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8b88066500 0x7f8b880689c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0a79d0 tx=0x7f8b8c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.283+0000 7f8b99ffb640 1 -- 172.21.15.26:0/1567467013 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8b90051030 con 0x7f8b9c0c9920 2023-10-14T11:12:52.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.499+0000 7fd3e1005640 1 -- 172.21.15.26:0/551510662 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd3dc0674f0 con 0x7fd3dc15feb0 2023-10-14T11:12:52.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.499+0000 7fd3c37fe640 1 -- 172.21.15.26:0/551510662 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd3d40efcf0 con 0x7fd3dc15feb0 2023-10-14T11:12:52.505 INFO:teuthology.orchestra.run.smithi026.stdout:55834574861 2023-10-14T11:12:52.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.503+0000 7fd3e1005640 1 -- 172.21.15.26:0/551510662 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd3c8066560 msgr2=0x7fd3c8068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.503+0000 7fd3e1005640 1 --2- 172.21.15.26:0/551510662 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd3c8066560 0x7fd3c8068a20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc000f70 tx=0x7fd3cc009040 comp rx=0 tx=0).stop 2023-10-14T11:12:52.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.503+0000 7fd3e1005640 1 -- 172.21.15.26:0/551510662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3dc15feb0 msgr2=0x7fd3dc0b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.503+0000 7fd3e1005640 1 --2- 172.21.15.26:0/551510662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3dc15feb0 0x7fd3dc0b29c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4019530 tx=0x7fd3d40196c0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.511+0000 7fd3e1005640 1 -- 172.21.15.26:0/551510662 shutdown_connections 2023-10-14T11:12:52.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.511+0000 7fd3e1005640 1 --2- 172.21.15.26:0/551510662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3dc15feb0 0x7fd3dc0b29c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.511+0000 7fd3e1005640 1 --2- 172.21.15.26:0/551510662 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd3c8066560 0x7fd3c8068a20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.511+0000 7fd3e1005640 1 --2- 172.21.15.26:0/551510662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3dc0d03a0 0x7fd3dc201bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.511+0000 7fd3e1005640 1 --2- 172.21.15.26:0/551510662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3dc06b620 0x7fd3dc153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.511+0000 7fd3e1005640 1 -- 172.21.15.26:0/551510662 >> 172.21.15.26:0/551510662 conn(0x7fd3dc09b9f0 msgr2=0x7fd3dc06af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:52.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.511+0000 7fd3e1005640 1 -- 172.21.15.26:0/551510662 shutdown_connections 2023-10-14T11:12:52.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.511+0000 7fd3e1005640 1 -- 172.21.15.26:0/551510662 wait complete. 2023-10-14T11:12:52.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.7 2023-10-14T11:12:52.547 DEBUG:teuthology.parallel:result is None 2023-10-14T11:12:52.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.543+0000 7fa642209640 1 -- 172.21.15.26:0/3617631235 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa63c073fa0 con 0x7fa63c06c2e0 2023-10-14T11:12:52.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.547+0000 7fa631ffb640 1 -- 172.21.15.26:0/3617631235 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa638055530 con 0x7fa63c06c2e0 2023-10-14T11:12:52.551 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2023-10-14T11:12:52.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.547+0000 7fa642209640 1 -- 172.21.15.26:0/3617631235 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa6200664f0 msgr2=0x7fa6200689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.547+0000 7fa642209640 1 --2- 172.21.15.26:0/3617631235 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa6200664f0 0x7fa6200689b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa62c000c10 tx=0x7fa62c0a6000 comp rx=0 tx=0).stop 2023-10-14T11:12:52.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.547+0000 7fa642209640 1 -- 172.21.15.26:0/3617631235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa63c06c2e0 msgr2=0x7fa63c152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.547+0000 7fa642209640 1 --2- 172.21.15.26:0/3617631235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa63c06c2e0 0x7fa63c152eb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa63800b6e0 tx=0x7fa63800e0c0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.547+0000 7fa642209640 1 -- 172.21.15.26:0/3617631235 shutdown_connections 2023-10-14T11:12:52.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.547+0000 7fa642209640 1 --2- 172.21.15.26:0/3617631235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa63c0c9a80 0x7fa63c0c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.547+0000 7fa642209640 1 --2- 172.21.15.26:0/3617631235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa63c071e30 0x7fa63c0c14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.547+0000 7fa642209640 1 --2- 172.21.15.26:0/3617631235 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa6200664f0 0x7fa6200689b0 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa62c000c10 tx=0x7fa62c0a6000 comp rx=0 tx=0).stop 2023-10-14T11:12:52.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.547+0000 7fa642209640 1 --2- 172.21.15.26:0/3617631235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa63c06c2e0 0x7fa63c152eb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.547+0000 7fa642209640 1 -- 172.21.15.26:0/3617631235 >> 172.21.15.26:0/3617631235 conn(0x7fa63c0afe60 msgr2=0x7fa63c06c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:52.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.547+0000 7fa642209640 1 -- 172.21.15.26:0/3617631235 shutdown_connections 2023-10-14T11:12:52.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.547+0000 7fa642209640 1 -- 172.21.15.26:0/3617631235 wait complete. 2023-10-14T11:12:52.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.555+0000 7fe593aea640 1 -- 172.21.15.26:0/2213370409 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe58c14dd00 con 0x7fe58c070c40 2023-10-14T11:12:52.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.555+0000 7fe58a7fc640 1 -- 172.21.15.26:0/2213370409 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe57c0546b0 con 0x7fe58c070c40 2023-10-14T11:12:52.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.555+0000 7f8f20ed6640 1 -- 172.21.15.26:0/154954152 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8f1c0cc760 con 0x7f8f1c0712f0 2023-10-14T11:12:52.561 INFO:teuthology.orchestra.run.smithi026.stdout:55834574858 2023-10-14T11:12:52.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.555+0000 7f8f0affd640 1 -- 172.21.15.26:0/154954152 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8f0c053ed0 con 0x7f8f1c0712f0 2023-10-14T11:12:52.561 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2023-10-14T11:12:52.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.559+0000 7fe593aea640 1 -- 172.21.15.26:0/2213370409 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe578066570 msgr2=0x7fe578068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.559+0000 7fe593aea640 1 --2- 172.21.15.26:0/2213370409 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe578066570 0x7fe578068a30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe5800b3000 tx=0x7fe5800ab070 comp rx=0 tx=0).stop 2023-10-14T11:12:52.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.559+0000 7fe593aea640 1 -- 172.21.15.26:0/2213370409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe58c070c40 msgr2=0x7fe58c0c45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.559+0000 7fe593aea640 1 --2- 172.21.15.26:0/2213370409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe58c070c40 0x7fe58c0c45a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00c770 tx=0x7fe57c00cc30 comp rx=0 tx=0).stop 2023-10-14T11:12:52.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.559+0000 7fe593aea640 1 -- 172.21.15.26:0/2213370409 shutdown_connections 2023-10-14T11:12:52.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.559+0000 7fe593aea640 1 --2- 172.21.15.26:0/2213370409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe58c15d690 0x7fe58c14ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.559+0000 7fe593aea640 1 --2- 172.21.15.26:0/2213370409 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe578066570 0x7fe578068a30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.559+0000 7fe593aea640 1 --2- 172.21.15.26:0/2213370409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe58c0b07f0 0x7fe58c152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.559+0000 7fe593aea640 1 --2- 172.21.15.26:0/2213370409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe58c070c40 0x7fe58c0c45a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.559+0000 7fe593aea640 1 -- 172.21.15.26:0/2213370409 >> 172.21.15.26:0/2213370409 conn(0x7fe58c06c190 msgr2=0x7fe58c14e820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:52.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.559+0000 7fe593aea640 1 -- 172.21.15.26:0/2213370409 shutdown_connections 2023-10-14T11:12:52.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.559+0000 7fe593aea640 1 -- 172.21.15.26:0/2213370409 wait complete. 2023-10-14T11:12:52.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.559+0000 7f8f20ed6640 1 -- 172.21.15.26:0/154954152 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8efc0664f0 msgr2=0x7f8efc0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.559+0000 7f8f20ed6640 1 --2- 172.21.15.26:0/154954152 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8efc0664f0 0x7f8efc0689b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8f140b2000 tx=0x7f8f14004ac0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.559+0000 7f8f20ed6640 1 -- 172.21.15.26:0/154954152 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f1c0712f0 msgr2=0x7f8f1c14a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.559+0000 7f8f20ed6640 1 --2- 172.21.15.26:0/154954152 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f1c0712f0 0x7f8f1c14a9a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00c390 tx=0x7f8f0c00c850 comp rx=0 tx=0).stop 2023-10-14T11:12:52.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.563+0000 7f8f20ed6640 1 -- 172.21.15.26:0/154954152 shutdown_connections 2023-10-14T11:12:52.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.563+0000 7f8f20ed6640 1 --2- 172.21.15.26:0/154954152 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8efc0664f0 0x7f8efc0689b0 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8f140b2000 tx=0x7f8f14004ac0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.563+0000 7f8f20ed6640 1 --2- 172.21.15.26:0/154954152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c15ccd0 0x7f8f1c0c2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.563+0000 7f8f20ed6640 1 --2- 172.21.15.26:0/154954152 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f1c0712f0 0x7f8f1c14a9a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.563+0000 7f8f20ed6640 1 --2- 172.21.15.26:0/154954152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f1c06ccb0 0x7f8f1c0b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.563+0000 7f8f20ed6640 1 -- 172.21.15.26:0/154954152 >> 172.21.15.26:0/154954152 conn(0x7f8f1c06c190 msgr2=0x7f8f1c0c3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:52.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.567+0000 7f8f20ed6640 1 -- 172.21.15.26:0/154954152 shutdown_connections 2023-10-14T11:12:52.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.567+0000 7f8f20ed6640 1 -- 172.21.15.26:0/154954152 wait complete. 2023-10-14T11:12:52.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.567+0000 7f6882f80640 1 -- 172.21.15.26:0/1921367999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f687c06b320 con 0x7f687c15cb90 2023-10-14T11:12:52.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.571+0000 7f68797fa640 1 -- 172.21.15.26:0/1921367999 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6874022070 con 0x7f687c15cb90 2023-10-14T11:12:52.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.571+0000 7f92f0e67640 1 -- 172.21.15.26:0/94659675 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f92ec0d36b0 con 0x7f92ec0cc630 2023-10-14T11:12:52.576 INFO:teuthology.orchestra.run.smithi026.stdout:55834574858 2023-10-14T11:12:52.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.575+0000 7f92d3fff640 1 -- 172.21.15.26:0/94659675 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f92e00f1be0 con 0x7f92ec0cc630 2023-10-14T11:12:52.578 INFO:teuthology.orchestra.run.smithi026.stdout:55834574860 2023-10-14T11:12:52.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2023-10-14T11:12:52.580 DEBUG:teuthology.parallel:result is None 2023-10-14T11:12:52.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.575+0000 7f6882f80640 1 -- 172.21.15.26:0/1921367999 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6868066520 msgr2=0x7f68680689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.575+0000 7f6882f80640 1 --2- 172.21.15.26:0/1921367999 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6868066520 0x7f68680689e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f686c009c00 tx=0x7f686c006f90 comp rx=0 tx=0).stop 2023-10-14T11:12:52.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.575+0000 7f6882f80640 1 -- 172.21.15.26:0/1921367999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f687c15cb90 msgr2=0x7f687c155c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.575+0000 7f6882f80640 1 --2- 172.21.15.26:0/1921367999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f687c15cb90 0x7f687c155c70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f687400be00 tx=0x7f687400bef0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.575+0000 7f6882f80640 1 -- 172.21.15.26:0/1921367999 shutdown_connections 2023-10-14T11:12:52.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.575+0000 7f6882f80640 1 --2- 172.21.15.26:0/1921367999 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6868066520 0x7f68680689e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.575+0000 7f6882f80640 1 --2- 172.21.15.26:0/1921367999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f687c15cb90 0x7f687c155c70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.575+0000 7f6882f80640 1 --2- 172.21.15.26:0/1921367999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c0d3010 0x7f687c0cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.575+0000 7f6882f80640 1 --2- 172.21.15.26:0/1921367999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f687c0d1400 0x7f687c0ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.575+0000 7f6882f80640 1 -- 172.21.15.26:0/1921367999 >> 172.21.15.26:0/1921367999 conn(0x7f687c09bc50 msgr2=0x7f687c06b990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:52.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.575+0000 7f6882f80640 1 -- 172.21.15.26:0/1921367999 shutdown_connections 2023-10-14T11:12:52.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.575+0000 7f6882f80640 1 -- 172.21.15.26:0/1921367999 wait complete. 2023-10-14T11:12:52.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.579+0000 7f92f0e67640 1 -- 172.21.15.26:0/94659675 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f92d8066570 msgr2=0x7f92d8068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.579+0000 7f92f0e67640 1 --2- 172.21.15.26:0/94659675 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f92d8066570 0x7f92d8068a30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f92dc007fd0 tx=0x7f92dc009040 comp rx=0 tx=0).stop 2023-10-14T11:12:52.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.579+0000 7f92f0e67640 1 -- 172.21.15.26:0/94659675 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92ec0cc630 msgr2=0x7f92ec0c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.579+0000 7f92f0e67640 1 --2- 172.21.15.26:0/94659675 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92ec0cc630 0x7f92ec0c9a80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f92e001f1a0 tx=0x7f92d4005800 comp rx=0 tx=0).stop 2023-10-14T11:12:52.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.579+0000 7f92f0e67640 1 -- 172.21.15.26:0/94659675 shutdown_connections 2023-10-14T11:12:52.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.579+0000 7f92f0e67640 1 --2- 172.21.15.26:0/94659675 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f92d8066570 0x7f92d8068a30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.579+0000 7f92f0e67640 1 --2- 172.21.15.26:0/94659675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ec0c9fc0 0x7f92ec1fbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.579+0000 7f92f0e67640 1 --2- 172.21.15.26:0/94659675 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92ec0cc630 0x7f92ec0c9a80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.579+0000 7f92f0e67640 1 --2- 172.21.15.26:0/94659675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92d40047d0 0x7f92ec15ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.579+0000 7f92f0e67640 1 -- 172.21.15.26:0/94659675 >> 172.21.15.26:0/94659675 conn(0x7f92ec09ba80 msgr2=0x7f92ec0c8240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:52.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.579+0000 7f92f0e67640 1 -- 172.21.15.26:0/94659675 shutdown_connections 2023-10-14T11:12:52.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.579+0000 7f92f0e67640 1 -- 172.21.15.26:0/94659675 wait complete. 2023-10-14T11:12:52.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.579+0000 7f0b00209640 1 -- 172.21.15.26:0/3077760860 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0ae0005510 con 0x7f0af80ad960 2023-10-14T11:12:52.588 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2023-10-14T11:12:52.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.579+0000 7f0aee7fc640 1 -- 172.21.15.26:0/3077760860 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0af0054940 con 0x7f0af80ad960 2023-10-14T11:12:52.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.583+0000 7f0b00209640 1 -- 172.21.15.26:0/3077760860 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0adc066570 msgr2=0x7f0adc068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.583+0000 7f0b00209640 1 --2- 172.21.15.26:0/3077760860 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0adc066570 0x7f0adc068a30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0af40ae000 tx=0x7f0af40a7070 comp rx=0 tx=0).stop 2023-10-14T11:12:52.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.583+0000 7f0b00209640 1 -- 172.21.15.26:0/3077760860 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af80ad960 msgr2=0x7f0af8156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.583+0000 7f0b00209640 1 --2- 172.21.15.26:0/3077760860 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af80ad960 0x7f0af8156c90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0af000b550 tx=0x7f0af000ba10 comp rx=0 tx=0).stop 2023-10-14T11:12:52.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.583+0000 7f0b00209640 1 -- 172.21.15.26:0/3077760860 shutdown_connections 2023-10-14T11:12:52.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.583+0000 7f0b00209640 1 --2- 172.21.15.26:0/3077760860 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0adc066570 0x7f0adc068a30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.583+0000 7f0b00209640 1 --2- 172.21.15.26:0/3077760860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0af8164520 0x7f0af8154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.583+0000 7f0b00209640 1 --2- 172.21.15.26:0/3077760860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0af80c9b80 0x7f0af81639b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.583+0000 7f0b00209640 1 --2- 172.21.15.26:0/3077760860 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af80ad960 0x7f0af8156c90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.583+0000 7f0b00209640 1 -- 172.21.15.26:0/3077760860 >> 172.21.15.26:0/3077760860 conn(0x7f0af806c190 msgr2=0x7f0af80cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:52.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.583+0000 7f0b00209640 1 -- 172.21.15.26:0/3077760860 shutdown_connections 2023-10-14T11:12:52.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.583+0000 7f0b00209640 1 -- 172.21.15.26:0/3077760860 wait complete. 2023-10-14T11:12:52.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2023-10-14T11:12:52.594 DEBUG:teuthology.parallel:result is None 2023-10-14T11:12:52.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2023-10-14T11:12:52.601 DEBUG:teuthology.parallel:result is None 2023-10-14T11:12:52.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.0 2023-10-14T11:12:52.611 DEBUG:teuthology.parallel:result is None 2023-10-14T11:12:52.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2023-10-14T11:12:52.613 DEBUG:teuthology.parallel:result is None 2023-10-14T11:12:52.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.615+0000 7f8ba3365640 1 -- 172.21.15.26:0/1567467013 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8b7c005510 con 0x7f8b9c0c9920 2023-10-14T11:12:52.619 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2023-10-14T11:12:52.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.615+0000 7f8b99ffb640 1 -- 172.21.15.26:0/1567467013 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8b90054650 con 0x7f8b9c0c9920 2023-10-14T11:12:52.620 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2023-10-14T11:12:52.620 DEBUG:teuthology.parallel:result is None 2023-10-14T11:12:52.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.619+0000 7f8ba3365640 1 -- 172.21.15.26:0/1567467013 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8b88066500 msgr2=0x7f8b880689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.619+0000 7f8ba3365640 1 --2- 172.21.15.26:0/1567467013 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8b88066500 0x7f8b880689c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0a79d0 tx=0x7f8b8c009040 comp rx=0 tx=0).stop 2023-10-14T11:12:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.619+0000 7f8ba3365640 1 -- 172.21.15.26:0/1567467013 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b9c0c9920 msgr2=0x7f8b9c0b3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.619+0000 7f8ba3365640 1 --2- 172.21.15.26:0/1567467013 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b9c0c9920 0x7f8b9c0b3b90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000d730 tx=0x7f8b9000dbf0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.619+0000 7f8ba3365640 1 -- 172.21.15.26:0/1567467013 shutdown_connections 2023-10-14T11:12:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.619+0000 7f8ba3365640 1 --2- 172.21.15.26:0/1567467013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b9c15ccd0 0x7f8b9c0c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.619+0000 7f8ba3365640 1 --2- 172.21.15.26:0/1567467013 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8b88066500 0x7f8b880689c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.619+0000 7f8ba3365640 1 --2- 172.21.15.26:0/1567467013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b9c0c9d00 0x7f8b9c0c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.619+0000 7f8ba3365640 1 --2- 172.21.15.26:0/1567467013 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b9c0c9920 0x7f8b9c0b3b90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.619+0000 7f8ba3365640 1 -- 172.21.15.26:0/1567467013 >> 172.21.15.26:0/1567467013 conn(0x7f8b9c06c190 msgr2=0x7f8b9c06c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.619+0000 7f8ba3365640 1 -- 172.21.15.26:0/1567467013 shutdown_connections 2023-10-14T11:12:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.619+0000 7f8ba3365640 1 -- 172.21.15.26:0/1567467013 wait complete. 2023-10-14T11:12:52.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2023-10-14T11:12:52.641 DEBUG:teuthology.parallel:result is None 2023-10-14T11:12:52.641 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T11:12:52.641 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:12:52.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.827+0000 7fdf9ec46640 1 Processor -- start 2023-10-14T11:12:52.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.827+0000 7fdf9ec46640 1 -- start start 2023-10-14T11:12:52.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.827+0000 7fdf9ec46640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdf980d3010 0x7fdf980cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.827+0000 7fdf9ec46640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf980ce770 con 0x7fdf9815cb90 2023-10-14T11:12:52.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.827+0000 7fdf9ec46640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf980d0600 con 0x7fdf980d15d0 2023-10-14T11:12:52.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.827+0000 7fdf9ec46640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf980c6450 con 0x7fdf980d3010 2023-10-14T11:12:52.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.831+0000 7fdf9c9e2640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdf9815cb90 0x7fdf980d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38804/0 (socket says 172.21.15.26:38804) 2023-10-14T11:12:52.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.831+0000 7fdf9c9e2640 1 -- 172.21.15.26:0/2860694585 learned_addr learned my addr 172.21.15.26:0/2860694585 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:52.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.831+0000 7fdf9d1e3640 1 --2- 172.21.15.26:0/2860694585 >> v2:172.21.15.26:3300/0 conn(0x7fdf980d3010 0x7fdf980cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.831+0000 7fdf9d1e3640 1 -- 172.21.15.26:0/2860694585 >> v1:172.21.15.110:6789/0 conn(0x7fdf980d15d0 legacy=0x7fdf980c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.831+0000 7fdf9d1e3640 1 -- 172.21.15.26:0/2860694585 >> v1:172.21.15.26:6789/0 conn(0x7fdf9815cb90 legacy=0x7fdf980d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.831+0000 7fdf977fe640 1 -- 172.21.15.26:0/2860694585 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231825461 0 0) 0x7fdf980ce770 con 0x7fdf9815cb90 2023-10-14T11:12:52.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.831+0000 7fdf9d1e3640 1 -- 172.21.15.26:0/2860694585 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf980d08a0 con 0x7fdf980d3010 2023-10-14T11:12:52.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.831+0000 7fdf9d1e3640 1 --2- 172.21.15.26:0/2860694585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf980d3010 0x7fdf980cfb10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdf90009d90 tx=0x7fdf9001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee87ead280775f28 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.831+0000 7fdf977fe640 1 -- 172.21.15.26:0/2860694585 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf900a5950 con 0x7fdf980d3010 2023-10-14T11:12:52.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.831+0000 7fdf977fe640 1 -- 172.21.15.26:0/2860694585 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf900a5ab0 con 0x7fdf980d3010 2023-10-14T11:12:52.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.831+0000 7fdf977fe640 1 -- 172.21.15.26:0/2860694585 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf900a5e40 con 0x7fdf980d3010 2023-10-14T11:12:52.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.835+0000 7fdf9ec46640 1 -- 172.21.15.26:0/2860694585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf980d3010 msgr2=0x7fdf980cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.835+0000 7fdf9ec46640 1 --2- 172.21.15.26:0/2860694585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf980d3010 0x7fdf980cfb10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdf90009d90 tx=0x7fdf9001c890 comp rx=0 tx=0).stop 2023-10-14T11:12:52.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.835+0000 7fdf9ec46640 1 -- 172.21.15.26:0/2860694585 shutdown_connections 2023-10-14T11:12:52.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.835+0000 7fdf9ec46640 1 --2- 172.21.15.26:0/2860694585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf980d3010 0x7fdf980cfb10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.835+0000 7fdf9ec46640 1 -- 172.21.15.26:0/2860694585 >> 172.21.15.26:0/2860694585 conn(0x7fdf9809bc50 msgr2=0x7fdf980d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:52.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.835+0000 7fdf9ec46640 1 -- 172.21.15.26:0/2860694585 shutdown_connections 2023-10-14T11:12:52.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.835+0000 7fdf9ec46640 1 -- 172.21.15.26:0/2860694585 wait complete. 2023-10-14T11:12:52.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.835+0000 7fdf9ec46640 1 Processor -- start 2023-10-14T11:12:52.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.835+0000 7fdf9ec46640 1 -- start start 2023-10-14T11:12:52.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.835+0000 7fdf9ec46640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf980d15d0 0x7fdf9814df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.835+0000 7fdf9ec46640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf980d3010 0x7fdf98156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.835+0000 7fdf9ec46640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf9815cb90 0x7fdf981568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.835+0000 7fdf9ec46640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980b56c0 con 0x7fdf980d3010 2023-10-14T11:12:52.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.835+0000 7fdf9ec46640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf98158b10 con 0x7fdf980d15d0 2023-10-14T11:12:52.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.835+0000 7fdf9ec46640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9815aea0 con 0x7fdf9815cb90 2023-10-14T11:12:52.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.835+0000 7fdf97fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf980d3010 0x7fdf98156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.835+0000 7fdf97fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf980d3010 0x7fdf98156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37364/0 (socket says 172.21.15.26:37364) 2023-10-14T11:12:52.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.835+0000 7fdf97fff640 1 -- 172.21.15.26:0/579739618 learned_addr learned my addr 172.21.15.26:0/579739618 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:52.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.835+0000 7fdf9c9e2640 1 --2- 172.21.15.26:0/579739618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf980d15d0 0x7fdf9814df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.835+0000 7fdf9d1e3640 1 --2- 172.21.15.26:0/579739618 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf9815cb90 0x7fdf981568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.835+0000 7fdf97fff640 1 -- 172.21.15.26:0/579739618 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf9815cb90 msgr2=0x7fdf981568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.835+0000 7fdf97fff640 1 --2- 172.21.15.26:0/579739618 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf9815cb90 0x7fdf981568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.839+0000 7fdf97fff640 1 -- 172.21.15.26:0/579739618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf980d15d0 msgr2=0x7fdf9814df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:52.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.839+0000 7fdf97fff640 1 --2- 172.21.15.26:0/579739618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf980d15d0 0x7fdf9814df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:52.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.839+0000 7fdf97fff640 1 -- 172.21.15.26:0/579739618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf90009a70 con 0x7fdf980d3010 2023-10-14T11:12:52.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.839+0000 7fdf97fff640 1 --2- 172.21.15.26:0/579739618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf980d3010 0x7fdf98156380 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400c500 tx=0x7fdf8400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.839+0000 7fdf957fa640 1 -- 172.21.15.26:0/579739618 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84005220 con 0x7fdf980d3010 2023-10-14T11:12:52.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.839+0000 7fdf957fa640 1 -- 172.21.15.26:0/579739618 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf84005380 con 0x7fdf980d3010 2023-10-14T11:12:52.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.839+0000 7fdf9ec46640 1 -- 172.21.15.26:0/579739618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf9815b180 con 0x7fdf980d3010 2023-10-14T11:12:52.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.839+0000 7fdf957fa640 1 -- 172.21.15.26:0/579739618 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84007270 con 0x7fdf980d3010 2023-10-14T11:12:52.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.839+0000 7fdf9ec46640 1 -- 172.21.15.26:0/579739618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9815b740 con 0x7fdf980d3010 2023-10-14T11:12:52.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.839+0000 7fdf9ec46640 1 -- 172.21.15.26:0/579739618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf980d38a0 con 0x7fdf980d3010 2023-10-14T11:12:52.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.839+0000 7fdf957fa640 1 -- 172.21.15.26:0/579739618 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdf840073d0 con 0x7fdf980d3010 2023-10-14T11:12:52.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.839+0000 7fdf957fa640 1 --2- 172.21.15.26:0/579739618 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdf7c0664a0 0x7fdf7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:52.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.839+0000 7fdf957fa640 1 -- 172.21.15.26:0/579739618 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdf840839c0 con 0x7fdf980d3010 2023-10-14T11:12:52.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.839+0000 7fdf9c9e2640 1 --2- 172.21.15.26:0/579739618 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdf7c0664a0 0x7fdf7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:52.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.843+0000 7fdf9c9e2640 1 --2- 172.21.15.26:0/579739618 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdf7c0664a0 0x7fdf7c068960 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c006db0 tx=0x7fdf8c006d20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:52.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.843+0000 7fdf957fa640 1 -- 172.21.15.26:0/579739618 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdf84050b70 con 0x7fdf980d3010 2023-10-14T11:12:53.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:52.999+0000 7fdf9ec46640 1 -- 172.21.15.26:0/579739618 --> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdf9815cf70 con 0x7fdf7c0664a0 2023-10-14T11:12:53.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.007+0000 7fdf957fa640 1 -- 172.21.15.26:0/579739618 <== mgr.4101 v2:172.21.15.26:6832/4136446821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345290 (secure 0 0 0) 0x7fdf8c0095e0 con 0x7fdf7c0664a0 2023-10-14T11:12:53.013 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:53.018 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-14T11:12:53.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.011+0000 7fdf9ec46640 1 -- 172.21.15.26:0/579739618 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdf7c0664a0 msgr2=0x7fdf7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:53.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.011+0000 7fdf9ec46640 1 --2- 172.21.15.26:0/579739618 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdf7c0664a0 0x7fdf7c068960 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c006db0 tx=0x7fdf8c006d20 comp rx=0 tx=0).stop 2023-10-14T11:12:53.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.011+0000 7fdf9ec46640 1 -- 172.21.15.26:0/579739618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf980d3010 msgr2=0x7fdf98156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:53.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.011+0000 7fdf9ec46640 1 --2- 172.21.15.26:0/579739618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf980d3010 0x7fdf98156380 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400c500 tx=0x7fdf8400c9c0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.011+0000 7fdf9ec46640 1 -- 172.21.15.26:0/579739618 shutdown_connections 2023-10-14T11:12:53.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.011+0000 7fdf9ec46640 1 --2- 172.21.15.26:0/579739618 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf9815cb90 0x7fdf981568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.011+0000 7fdf9ec46640 1 --2- 172.21.15.26:0/579739618 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdf7c0664a0 0x7fdf7c068960 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.011+0000 7fdf9ec46640 1 --2- 172.21.15.26:0/579739618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf980d3010 0x7fdf98156380 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.011+0000 7fdf9ec46640 1 --2- 172.21.15.26:0/579739618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf980d15d0 0x7fdf9814df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.011+0000 7fdf9ec46640 1 -- 172.21.15.26:0/579739618 >> 172.21.15.26:0/579739618 conn(0x7fdf9809bc50 msgr2=0x7fdf980ce3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:53.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.011+0000 7fdf9ec46640 1 -- 172.21.15.26:0/579739618 shutdown_connections 2023-10-14T11:12:53.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.011+0000 7fdf9ec46640 1 -- 172.21.15.26:0/579739618 wait complete. 2023-10-14T11:12:53.036 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-10-14T11:12:52.166945+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227784,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754746936,"statfs":{"total":773094113280,"available":772860862464,"internally_reserved":0,"allocated":3383296,"data_stored":2025622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":229756472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004060"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.011921+0000","last_change":"2023-10-14T11:12:21.968131+0000","last_active":"2023-10-14T11:12:27.011921+0000","last_peered":"2023-10-14T11:12:27.011921+0000","last_clean":"2023-10-14T11:12:27.011921+0000","last_became_active":"2023-10-14T11:12:21.967795+0000","last_became_peered":"2023-10-14T11:12:21.967795+0000","last_unstale":"2023-10-14T11:12:27.011921+0000","last_undegraded":"2023-10-14T11:12:27.011921+0000","last_fullsized":"2023-10-14T11:12:27.011921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:40.617646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000703+0000","last_change":"2023-10-14T11:12:22.996026+0000","last_active":"2023-10-14T11:12:27.000703+0000","last_peered":"2023-10-14T11:12:27.000703+0000","last_clean":"2023-10-14T11:12:27.000703+0000","last_became_active":"2023-10-14T11:12:22.995661+0000","last_became_peered":"2023-10-14T11:12:22.995661+0000","last_unstale":"2023-10-14T11:12:27.000703+0000","last_undegraded":"2023-10-14T11:12:27.000703+0000","last_fullsized":"2023-10-14T11:12:27.000703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:38.252309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992306+0000","last_change":"2023-10-14T11:12:27.273682+0000","last_active":"2023-10-14T11:12:27.992306+0000","last_peered":"2023-10-14T11:12:27.992306+0000","last_clean":"2023-10-14T11:12:27.992306+0000","last_became_active":"2023-10-14T11:12:27.273214+0000","last_became_peered":"2023-10-14T11:12:27.273214+0000","last_unstale":"2023-10-14T11:12:27.992306+0000","last_undegraded":"2023-10-14T11:12:27.992306+0000","last_fullsized":"2023-10-14T11:12:27.992306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:47.514617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000801+0000","last_change":"2023-10-14T11:12:21.965767+0000","last_active":"2023-10-14T11:12:27.000801+0000","last_peered":"2023-10-14T11:12:27.000801+0000","last_clean":"2023-10-14T11:12:27.000801+0000","last_became_active":"2023-10-14T11:12:21.963959+0000","last_became_peered":"2023-10-14T11:12:21.963959+0000","last_unstale":"2023-10-14T11:12:27.000801+0000","last_undegraded":"2023-10-14T11:12:27.000801+0000","last_fullsized":"2023-10-14T11:12:27.000801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:40.617646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.011705+0000","last_change":"2023-10-14T11:12:22.985764+0000","last_active":"2023-10-14T11:12:27.011705+0000","last_peered":"2023-10-14T11:12:27.011705+0000","last_clean":"2023-10-14T11:12:27.011705+0000","last_became_active":"2023-10-14T11:12:22.984086+0000","last_became_peered":"2023-10-14T11:12:22.984086+0000","last_unstale":"2023-10-14T11:12:27.011705+0000","last_undegraded":"2023-10-14T11:12:27.011705+0000","last_fullsized":"2023-10-14T11:12:27.011705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:27.066313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.994145+0000","last_change":"2023-10-14T11:12:27.029908+0000","last_active":"2023-10-14T11:12:27.994145+0000","last_peered":"2023-10-14T11:12:27.994145+0000","last_clean":"2023-10-14T11:12:27.994145+0000","last_became_active":"2023-10-14T11:12:27.029420+0000","last_became_peered":"2023-10-14T11:12:27.029420+0000","last_unstale":"2023-10-14T11:12:27.994145+0000","last_undegraded":"2023-10-14T11:12:27.994145+0000","last_fullsized":"2023-10-14T11:12:27.994145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:07.549080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265378+0000","last_change":"2023-10-14T11:12:21.979625+0000","last_active":"2023-10-14T11:12:27.265378+0000","last_peered":"2023-10-14T11:12:27.265378+0000","last_clean":"2023-10-14T11:12:27.265378+0000","last_became_active":"2023-10-14T11:12:21.979220+0000","last_became_peered":"2023-10-14T11:12:21.979220+0000","last_unstale":"2023-10-14T11:12:27.265378+0000","last_undegraded":"2023-10-14T11:12:27.265378+0000","last_fullsized":"2023-10-14T11:12:27.265378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:18.236450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.989996+0000","last_change":"2023-10-14T11:12:22.980954+0000","last_active":"2023-10-14T11:12:26.989996+0000","last_peered":"2023-10-14T11:12:26.989996+0000","last_clean":"2023-10-14T11:12:26.989996+0000","last_became_active":"2023-10-14T11:12:22.980685+0000","last_became_peered":"2023-10-14T11:12:22.980685+0000","last_unstale":"2023-10-14T11:12:26.989996+0000","last_undegraded":"2023-10-14T11:12:26.989996+0000","last_fullsized":"2023-10-14T11:12:26.989996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:24.943192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992649+0000","last_change":"2023-10-14T11:12:27.018281+0000","last_active":"2023-10-14T11:12:27.992649+0000","last_peered":"2023-10-14T11:12:27.992649+0000","last_clean":"2023-10-14T11:12:27.992649+0000","last_became_active":"2023-10-14T11:12:27.017878+0000","last_became_peered":"2023-10-14T11:12:27.017878+0000","last_unstale":"2023-10-14T11:12:27.992649+0000","last_undegraded":"2023-10-14T11:12:27.992649+0000","last_fullsized":"2023-10-14T11:12:27.992649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:18:15.471120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265116+0000","last_change":"2023-10-14T11:12:21.976549+0000","last_active":"2023-10-14T11:12:27.265116+0000","last_peered":"2023-10-14T11:12:27.265116+0000","last_clean":"2023-10-14T11:12:27.265116+0000","last_became_active":"2023-10-14T11:12:21.976164+0000","last_became_peered":"2023-10-14T11:12:21.976164+0000","last_unstale":"2023-10-14T11:12:27.265116+0000","last_undegraded":"2023-10-14T11:12:27.265116+0000","last_fullsized":"2023-10-14T11:12:27.265116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:05.484874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990424+0000","last_change":"2023-10-14T11:12:22.970775+0000","last_active":"2023-10-14T11:12:26.990424+0000","last_peered":"2023-10-14T11:12:26.990424+0000","last_clean":"2023-10-14T11:12:26.990424+0000","last_became_active":"2023-10-14T11:12:22.970331+0000","last_became_peered":"2023-10-14T11:12:22.970331+0000","last_unstale":"2023-10-14T11:12:26.990424+0000","last_undegraded":"2023-10-14T11:12:26.990424+0000","last_fullsized":"2023-10-14T11:12:26.990424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:15.184385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992665+0000","last_change":"2023-10-14T11:12:27.011037+0000","last_active":"2023-10-14T11:12:27.992665+0000","last_peered":"2023-10-14T11:12:27.992665+0000","last_clean":"2023-10-14T11:12:27.992665+0000","last_became_active":"2023-10-14T11:12:27.010126+0000","last_became_peered":"2023-10-14T11:12:27.010126+0000","last_unstale":"2023-10-14T11:12:27.992665+0000","last_undegraded":"2023-10-14T11:12:27.992665+0000","last_fullsized":"2023-10-14T11:12:27.992665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:42.289011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.992180+0000","last_change":"2023-10-14T11:12:22.983577+0000","last_active":"2023-10-14T11:12:26.992180+0000","last_peered":"2023-10-14T11:12:26.992180+0000","last_clean":"2023-10-14T11:12:26.992180+0000","last_became_active":"2023-10-14T11:12:22.982026+0000","last_became_peered":"2023-10-14T11:12:22.982026+0000","last_unstale":"2023-10-14T11:12:26.992180+0000","last_undegraded":"2023-10-14T11:12:26.992180+0000","last_fullsized":"2023-10-14T11:12:26.992180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:06.491915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265315+0000","last_change":"2023-10-14T11:12:21.979924+0000","last_active":"2023-10-14T11:12:27.265315+0000","last_peered":"2023-10-14T11:12:27.265315+0000","last_clean":"2023-10-14T11:12:27.265315+0000","last_became_active":"2023-10-14T11:12:21.979434+0000","last_became_peered":"2023-10-14T11:12:21.979434+0000","last_unstale":"2023-10-14T11:12:27.265315+0000","last_undegraded":"2023-10-14T11:12:27.265315+0000","last_fullsized":"2023-10-14T11:12:27.265315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:31:07.362240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993464+0000","last_change":"2023-10-14T11:12:27.025486+0000","last_active":"2023-10-14T11:12:27.993464+0000","last_peered":"2023-10-14T11:12:27.993464+0000","last_clean":"2023-10-14T11:12:27.993464+0000","last_became_active":"2023-10-14T11:12:27.025086+0000","last_became_peered":"2023-10-14T11:12:27.025086+0000","last_unstale":"2023-10-14T11:12:27.993464+0000","last_undegraded":"2023-10-14T11:12:27.993464+0000","last_fullsized":"2023-10-14T11:12:27.993464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:19.221087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.994599+0000","last_change":"2023-10-14T11:12:22.975476+0000","last_active":"2023-10-14T11:12:26.994599+0000","last_peered":"2023-10-14T11:12:26.994599+0000","last_clean":"2023-10-14T11:12:26.994599+0000","last_became_active":"2023-10-14T11:12:22.975171+0000","last_became_peered":"2023-10-14T11:12:22.975171+0000","last_unstale":"2023-10-14T11:12:26.994599+0000","last_undegraded":"2023-10-14T11:12:26.994599+0000","last_fullsized":"2023-10-14T11:12:26.994599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:18:11.434418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.003734+0000","last_change":"2023-10-14T11:12:21.967707+0000","last_active":"2023-10-14T11:12:27.003734+0000","last_peered":"2023-10-14T11:12:27.003734+0000","last_clean":"2023-10-14T11:12:27.003734+0000","last_became_active":"2023-10-14T11:12:21.967412+0000","last_became_peered":"2023-10-14T11:12:21.967412+0000","last_unstale":"2023-10-14T11:12:27.003734+0000","last_undegraded":"2023-10-14T11:12:27.003734+0000","last_fullsized":"2023-10-14T11:12:27.003734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:11:08.840029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992628+0000","last_change":"2023-10-14T11:12:27.026337+0000","last_active":"2023-10-14T11:12:27.992628+0000","last_peered":"2023-10-14T11:12:27.992628+0000","last_clean":"2023-10-14T11:12:27.992628+0000","last_became_active":"2023-10-14T11:12:27.025956+0000","last_became_peered":"2023-10-14T11:12:27.025956+0000","last_unstale":"2023-10-14T11:12:27.992628+0000","last_undegraded":"2023-10-14T11:12:27.992628+0000","last_fullsized":"2023-10-14T11:12:27.992628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:52:42.055532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.996024+0000","last_change":"2023-10-14T11:12:22.968547+0000","last_active":"2023-10-14T11:12:26.996024+0000","last_peered":"2023-10-14T11:12:26.996024+0000","last_clean":"2023-10-14T11:12:26.996024+0000","last_became_active":"2023-10-14T11:12:22.968263+0000","last_became_peered":"2023-10-14T11:12:22.968263+0000","last_unstale":"2023-10-14T11:12:26.996024+0000","last_undegraded":"2023-10-14T11:12:26.996024+0000","last_fullsized":"2023-10-14T11:12:26.996024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:24:53.742274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000375+0000","last_change":"2023-10-14T11:12:21.975718+0000","last_active":"2023-10-14T11:12:27.000375+0000","last_peered":"2023-10-14T11:12:27.000375+0000","last_clean":"2023-10-14T11:12:27.000375+0000","last_became_active":"2023-10-14T11:12:21.975455+0000","last_became_peered":"2023-10-14T11:12:21.975455+0000","last_unstale":"2023-10-14T11:12:27.000375+0000","last_undegraded":"2023-10-14T11:12:27.000375+0000","last_fullsized":"2023-10-14T11:12:27.000375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:40:43.612359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.053490+0000","last_change":"2023-10-14T11:12:27.271875+0000","last_active":"2023-10-14T11:12:29.053490+0000","last_peered":"2023-10-14T11:12:29.053490+0000","last_clean":"2023-10-14T11:12:29.053490+0000","last_became_active":"2023-10-14T11:12:27.271472+0000","last_became_peered":"2023-10-14T11:12:27.271472+0000","last_unstale":"2023-10-14T11:12:29.053490+0000","last_undegraded":"2023-10-14T11:12:29.053490+0000","last_fullsized":"2023-10-14T11:12:29.053490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:28.979894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.997514+0000","last_change":"2023-10-14T11:12:22.980084+0000","last_active":"2023-10-14T11:12:26.997514+0000","last_peered":"2023-10-14T11:12:26.997514+0000","last_clean":"2023-10-14T11:12:26.997514+0000","last_became_active":"2023-10-14T11:12:22.979078+0000","last_became_peered":"2023-10-14T11:12:22.979078+0000","last_unstale":"2023-10-14T11:12:26.997514+0000","last_undegraded":"2023-10-14T11:12:26.997514+0000","last_fullsized":"2023-10-14T11:12:26.997514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:43:00.534216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264588+0000","last_change":"2023-10-14T11:12:21.975091+0000","last_active":"2023-10-14T11:12:27.264588+0000","last_peered":"2023-10-14T11:12:27.264588+0000","last_clean":"2023-10-14T11:12:27.264588+0000","last_became_active":"2023-10-14T11:12:21.974797+0000","last_became_peered":"2023-10-14T11:12:21.974797+0000","last_unstale":"2023-10-14T11:12:27.264588+0000","last_undegraded":"2023-10-14T11:12:27.264588+0000","last_fullsized":"2023-10-14T11:12:27.264588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:37.017137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993949+0000","last_change":"2023-10-14T11:12:27.025785+0000","last_active":"2023-10-14T11:12:27.993949+0000","last_peered":"2023-10-14T11:12:27.993949+0000","last_clean":"2023-10-14T11:12:27.993949+0000","last_became_active":"2023-10-14T11:12:27.025299+0000","last_became_peered":"2023-10-14T11:12:27.025299+0000","last_unstale":"2023-10-14T11:12:27.993949+0000","last_undegraded":"2023-10-14T11:12:27.993949+0000","last_fullsized":"2023-10-14T11:12:27.993949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:58.469102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.011387+0000","last_change":"2023-10-14T11:12:22.982412+0000","last_active":"2023-10-14T11:12:27.011387+0000","last_peered":"2023-10-14T11:12:27.011387+0000","last_clean":"2023-10-14T11:12:27.011387+0000","last_became_active":"2023-10-14T11:12:22.981232+0000","last_became_peered":"2023-10-14T11:12:22.981232+0000","last_unstale":"2023-10-14T11:12:27.011387+0000","last_undegraded":"2023-10-14T11:12:27.011387+0000","last_fullsized":"2023-10-14T11:12:27.011387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:19.243490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.992495+0000","last_change":"2023-10-14T11:12:21.979890+0000","last_active":"2023-10-14T11:12:26.992495+0000","last_peered":"2023-10-14T11:12:26.992495+0000","last_clean":"2023-10-14T11:12:26.992495+0000","last_became_active":"2023-10-14T11:12:21.979626+0000","last_became_peered":"2023-10-14T11:12:21.979626+0000","last_unstale":"2023-10-14T11:12:26.992495+0000","last_undegraded":"2023-10-14T11:12:26.992495+0000","last_fullsized":"2023-10-14T11:12:26.992495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:33.347794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993164+0000","last_change":"2023-10-14T11:12:27.274768+0000","last_active":"2023-10-14T11:12:27.993164+0000","last_peered":"2023-10-14T11:12:27.993164+0000","last_clean":"2023-10-14T11:12:27.993164+0000","last_became_active":"2023-10-14T11:12:27.274146+0000","last_became_peered":"2023-10-14T11:12:27.274146+0000","last_unstale":"2023-10-14T11:12:27.993164+0000","last_undegraded":"2023-10-14T11:12:27.993164+0000","last_fullsized":"2023-10-14T11:12:27.993164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:23.589522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000910+0000","last_change":"2023-10-14T11:12:22.985137+0000","last_active":"2023-10-14T11:12:27.000910+0000","last_peered":"2023-10-14T11:12:27.000910+0000","last_clean":"2023-10-14T11:12:27.000910+0000","last_became_active":"2023-10-14T11:12:22.984832+0000","last_became_peered":"2023-10-14T11:12:22.984832+0000","last_unstale":"2023-10-14T11:12:27.000910+0000","last_undegraded":"2023-10-14T11:12:27.000910+0000","last_fullsized":"2023-10-14T11:12:27.000910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:46.533477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.013073+0000","last_change":"2023-10-14T11:12:21.973653+0000","last_active":"2023-10-14T11:12:27.013073+0000","last_peered":"2023-10-14T11:12:27.013073+0000","last_clean":"2023-10-14T11:12:27.013073+0000","last_became_active":"2023-10-14T11:12:21.973384+0000","last_became_peered":"2023-10-14T11:12:21.973384+0000","last_unstale":"2023-10-14T11:12:27.013073+0000","last_undegraded":"2023-10-14T11:12:27.013073+0000","last_fullsized":"2023-10-14T11:12:27.013073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:31:07.362240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992214+0000","last_change":"2023-10-14T11:12:27.274360+0000","last_active":"2023-10-14T11:12:27.992214+0000","last_peered":"2023-10-14T11:12:27.992214+0000","last_clean":"2023-10-14T11:12:27.992214+0000","last_became_active":"2023-10-14T11:12:27.273104+0000","last_became_peered":"2023-10-14T11:12:27.273104+0000","last_unstale":"2023-10-14T11:12:27.992214+0000","last_undegraded":"2023-10-14T11:12:27.992214+0000","last_fullsized":"2023-10-14T11:12:27.992214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:23:51.698322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.013376+0000","last_change":"2023-10-14T11:12:22.973372+0000","last_active":"2023-10-14T11:12:27.013376+0000","last_peered":"2023-10-14T11:12:27.013376+0000","last_clean":"2023-10-14T11:12:27.013376+0000","last_became_active":"2023-10-14T11:12:22.973009+0000","last_became_peered":"2023-10-14T11:12:22.973009+0000","last_unstale":"2023-10-14T11:12:27.013376+0000","last_undegraded":"2023-10-14T11:12:27.013376+0000","last_fullsized":"2023-10-14T11:12:27.013376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:19.243490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265475+0000","last_change":"2023-10-14T11:12:21.975624+0000","last_active":"2023-10-14T11:12:27.265475+0000","last_peered":"2023-10-14T11:12:27.265475+0000","last_clean":"2023-10-14T11:12:27.265475+0000","last_became_active":"2023-10-14T11:12:21.975359+0000","last_became_peered":"2023-10-14T11:12:21.975359+0000","last_unstale":"2023-10-14T11:12:27.265475+0000","last_undegraded":"2023-10-14T11:12:27.265475+0000","last_fullsized":"2023-10-14T11:12:27.265475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:24:52.735234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.387618+0000","last_change":"2023-10-14T11:12:27.272156+0000","last_active":"2023-10-14T11:12:28.387618+0000","last_peered":"2023-10-14T11:12:28.387618+0000","last_clean":"2023-10-14T11:12:28.387618+0000","last_became_active":"2023-10-14T11:12:27.271460+0000","last_became_peered":"2023-10-14T11:12:27.271460+0000","last_unstale":"2023-10-14T11:12:28.387618+0000","last_undegraded":"2023-10-14T11:12:28.387618+0000","last_fullsized":"2023-10-14T11:12:28.387618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:23.589522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990518+0000","last_change":"2023-10-14T11:12:22.970602+0000","last_active":"2023-10-14T11:12:26.990518+0000","last_peered":"2023-10-14T11:12:26.990518+0000","last_clean":"2023-10-14T11:12:26.990518+0000","last_became_active":"2023-10-14T11:12:22.969961+0000","last_became_peered":"2023-10-14T11:12:22.969961+0000","last_unstale":"2023-10-14T11:12:26.990518+0000","last_undegraded":"2023-10-14T11:12:26.990518+0000","last_fullsized":"2023-10-14T11:12:26.990518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:03.512378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.013519+0000","last_change":"2023-10-14T11:12:21.972694+0000","last_active":"2023-10-14T11:12:27.013519+0000","last_peered":"2023-10-14T11:12:27.013519+0000","last_clean":"2023-10-14T11:12:27.013519+0000","last_became_active":"2023-10-14T11:12:21.972386+0000","last_became_peered":"2023-10-14T11:12:21.972386+0000","last_unstale":"2023-10-14T11:12:27.013519+0000","last_undegraded":"2023-10-14T11:12:27.013519+0000","last_fullsized":"2023-10-14T11:12:27.013519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:40.617646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.052804+0000","last_change":"2023-10-14T11:12:27.019652+0000","last_active":"2023-10-14T11:12:29.052804+0000","last_peered":"2023-10-14T11:12:29.052804+0000","last_clean":"2023-10-14T11:12:29.052804+0000","last_became_active":"2023-10-14T11:12:27.019232+0000","last_became_peered":"2023-10-14T11:12:27.019232+0000","last_unstale":"2023-10-14T11:12:29.052804+0000","last_undegraded":"2023-10-14T11:12:29.052804+0000","last_fullsized":"2023-10-14T11:12:29.052804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:23.589522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.999351+0000","last_change":"2023-10-14T11:12:22.973223+0000","last_active":"2023-10-14T11:12:26.999351+0000","last_peered":"2023-10-14T11:12:26.999351+0000","last_clean":"2023-10-14T11:12:26.999351+0000","last_became_active":"2023-10-14T11:12:22.972863+0000","last_became_peered":"2023-10-14T11:12:22.972863+0000","last_unstale":"2023-10-14T11:12:26.999351+0000","last_undegraded":"2023-10-14T11:12:26.999351+0000","last_fullsized":"2023-10-14T11:12:26.999351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:41.624687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.989010+0000","last_change":"2023-10-14T11:12:21.972184+0000","last_active":"2023-10-14T11:12:26.989010+0000","last_peered":"2023-10-14T11:12:26.989010+0000","last_clean":"2023-10-14T11:12:26.989010+0000","last_became_active":"2023-10-14T11:12:21.968811+0000","last_became_peered":"2023-10-14T11:12:21.968811+0000","last_unstale":"2023-10-14T11:12:26.989010+0000","last_undegraded":"2023-10-14T11:12:26.989010+0000","last_fullsized":"2023-10-14T11:12:26.989010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:24:52.735234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.053250+0000","last_change":"2023-10-14T11:12:27.018825+0000","last_active":"2023-10-14T11:12:29.053250+0000","last_peered":"2023-10-14T11:12:29.053250+0000","last_clean":"2023-10-14T11:12:29.053250+0000","last_became_active":"2023-10-14T11:12:27.018145+0000","last_became_peered":"2023-10-14T11:12:27.018145+0000","last_unstale":"2023-10-14T11:12:29.053250+0000","last_undegraded":"2023-10-14T11:12:29.053250+0000","last_fullsized":"2023-10-14T11:12:29.053250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:58.469102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.994330+0000","last_change":"2023-10-14T11:12:22.973626+0000","last_active":"2023-10-14T11:12:26.994330+0000","last_peered":"2023-10-14T11:12:26.994330+0000","last_clean":"2023-10-14T11:12:26.994330+0000","last_became_active":"2023-10-14T11:12:22.973107+0000","last_became_peered":"2023-10-14T11:12:22.973107+0000","last_unstale":"2023-10-14T11:12:26.994330+0000","last_undegraded":"2023-10-14T11:12:26.994330+0000","last_fullsized":"2023-10-14T11:12:26.994330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:07:23.864178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988809+0000","last_change":"2023-10-14T11:12:21.977761+0000","last_active":"2023-10-14T11:12:26.988809+0000","last_peered":"2023-10-14T11:12:26.988809+0000","last_clean":"2023-10-14T11:12:26.988809+0000","last_became_active":"2023-10-14T11:12:21.976298+0000","last_became_peered":"2023-10-14T11:12:21.976298+0000","last_unstale":"2023-10-14T11:12:26.988809+0000","last_undegraded":"2023-10-14T11:12:26.988809+0000","last_fullsized":"2023-10-14T11:12:26.988809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:44:17.928096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.053501+0000","last_change":"2023-10-14T11:12:27.024825+0000","last_active":"2023-10-14T11:12:29.053501+0000","last_peered":"2023-10-14T11:12:29.053501+0000","last_clean":"2023-10-14T11:12:29.053501+0000","last_became_active":"2023-10-14T11:12:27.024317+0000","last_became_peered":"2023-10-14T11:12:27.024317+0000","last_unstale":"2023-10-14T11:12:29.053501+0000","last_undegraded":"2023-10-14T11:12:29.053501+0000","last_fullsized":"2023-10-14T11:12:29.053501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:07.549080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.995557+0000","last_change":"2023-10-14T11:12:22.992830+0000","last_active":"2023-10-14T11:12:26.995557+0000","last_peered":"2023-10-14T11:12:26.995557+0000","last_clean":"2023-10-14T11:12:26.995557+0000","last_became_active":"2023-10-14T11:12:22.992514+0000","last_became_peered":"2023-10-14T11:12:22.992514+0000","last_unstale":"2023-10-14T11:12:26.995557+0000","last_undegraded":"2023-10-14T11:12:26.995557+0000","last_fullsized":"2023-10-14T11:12:26.995557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:02.330265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264602+0000","last_change":"2023-10-14T11:12:21.980791+0000","last_active":"2023-10-14T11:12:27.264602+0000","last_peered":"2023-10-14T11:12:27.264602+0000","last_clean":"2023-10-14T11:12:27.264602+0000","last_became_active":"2023-10-14T11:12:21.980499+0000","last_became_peered":"2023-10-14T11:12:21.980499+0000","last_unstale":"2023-10-14T11:12:27.264602+0000","last_undegraded":"2023-10-14T11:12:27.264602+0000","last_fullsized":"2023-10-14T11:12:27.264602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:01.323224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.387968+0000","last_change":"2023-10-14T11:12:27.273604+0000","last_active":"2023-10-14T11:12:28.387968+0000","last_peered":"2023-10-14T11:12:28.387968+0000","last_clean":"2023-10-14T11:12:28.387968+0000","last_became_active":"2023-10-14T11:12:27.273160+0000","last_became_peered":"2023-10-14T11:12:27.273160+0000","last_unstale":"2023-10-14T11:12:28.387968+0000","last_undegraded":"2023-10-14T11:12:28.387968+0000","last_fullsized":"2023-10-14T11:12:28.387968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:28.979894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.999882+0000","last_change":"2023-10-14T11:12:22.983334+0000","last_active":"2023-10-14T11:12:26.999882+0000","last_peered":"2023-10-14T11:12:26.999882+0000","last_clean":"2023-10-14T11:12:26.999882+0000","last_became_active":"2023-10-14T11:12:22.981836+0000","last_became_peered":"2023-10-14T11:12:22.981836+0000","last_unstale":"2023-10-14T11:12:26.999882+0000","last_undegraded":"2023-10-14T11:12:26.999882+0000","last_fullsized":"2023-10-14T11:12:26.999882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:17.701734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988703+0000","last_change":"2023-10-14T11:12:21.968246+0000","last_active":"2023-10-14T11:12:26.988703+0000","last_peered":"2023-10-14T11:12:26.988703+0000","last_clean":"2023-10-14T11:12:26.988703+0000","last_became_active":"2023-10-14T11:12:21.967758+0000","last_became_peered":"2023-10-14T11:12:21.967758+0000","last_unstale":"2023-10-14T11:12:26.988703+0000","last_undegraded":"2023-10-14T11:12:26.988703+0000","last_fullsized":"2023-10-14T11:12:26.988703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:23.226723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264683+0000","last_change":"2023-10-14T11:12:12.162289+0000","last_active":"2023-10-14T11:12:27.264683+0000","last_peered":"2023-10-14T11:12:27.264683+0000","last_clean":"2023-10-14T11:12:27.264683+0000","last_became_active":"2023-10-14T11:12:12.161055+0000","last_became_peered":"2023-10-14T11:12:12.161055+0000","last_unstale":"2023-10-14T11:12:27.264683+0000","last_undegraded":"2023-10-14T11:12:27.264683+0000","last_fullsized":"2023-10-14T11:12:27.264683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_clean_scrub_stamp":"2023-10-14T11:12:10.853576+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:52.154107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.051902+0000","last_change":"2023-10-14T11:12:27.270500+0000","last_active":"2023-10-14T11:12:29.051902+0000","last_peered":"2023-10-14T11:12:29.051902+0000","last_clean":"2023-10-14T11:12:29.051902+0000","last_became_active":"2023-10-14T11:12:27.270051+0000","last_became_peered":"2023-10-14T11:12:27.270051+0000","last_unstale":"2023-10-14T11:12:29.051902+0000","last_undegraded":"2023-10-14T11:12:29.051902+0000","last_fullsized":"2023-10-14T11:12:29.051902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:19.221087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265306+0000","last_change":"2023-10-14T11:12:22.987192+0000","last_active":"2023-10-14T11:12:27.265306+0000","last_peered":"2023-10-14T11:12:27.265306+0000","last_clean":"2023-10-14T11:12:27.265306+0000","last_became_active":"2023-10-14T11:12:22.986270+0000","last_became_peered":"2023-10-14T11:12:22.986270+0000","last_unstale":"2023-10-14T11:12:27.265306+0000","last_undegraded":"2023-10-14T11:12:27.265306+0000","last_fullsized":"2023-10-14T11:12:27.265306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:03.512378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988910+0000","last_change":"2023-10-14T11:12:21.977756+0000","last_active":"2023-10-14T11:12:26.988910+0000","last_peered":"2023-10-14T11:12:26.988910+0000","last_clean":"2023-10-14T11:12:26.988910+0000","last_became_active":"2023-10-14T11:12:21.976702+0000","last_became_peered":"2023-10-14T11:12:21.976702+0000","last_unstale":"2023-10-14T11:12:26.988910+0000","last_undegraded":"2023-10-14T11:12:26.988910+0000","last_fullsized":"2023-10-14T11:12:26.988910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:51.562205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.051590+0000","last_change":"2023-10-14T11:12:27.266768+0000","last_active":"2023-10-14T11:12:29.051590+0000","last_peered":"2023-10-14T11:12:29.051590+0000","last_clean":"2023-10-14T11:12:29.051590+0000","last_became_active":"2023-10-14T11:12:27.266293+0000","last_became_peered":"2023-10-14T11:12:27.266293+0000","last_unstale":"2023-10-14T11:12:29.051590+0000","last_undegraded":"2023-10-14T11:12:29.051590+0000","last_fullsized":"2023-10-14T11:12:29.051590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:23.589522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990099+0000","last_change":"2023-10-14T11:12:22.971787+0000","last_active":"2023-10-14T11:12:26.990099+0000","last_peered":"2023-10-14T11:12:26.990099+0000","last_clean":"2023-10-14T11:12:26.990099+0000","last_became_active":"2023-10-14T11:12:22.971485+0000","last_became_peered":"2023-10-14T11:12:22.971485+0000","last_unstale":"2023-10-14T11:12:26.990099+0000","last_undegraded":"2023-10-14T11:12:26.990099+0000","last_fullsized":"2023-10-14T11:12:26.990099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:32.409154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010620+0000","last_change":"2023-10-14T11:12:21.980821+0000","last_active":"2023-10-14T11:12:27.010620+0000","last_peered":"2023-10-14T11:12:27.010620+0000","last_clean":"2023-10-14T11:12:27.010620+0000","last_became_active":"2023-10-14T11:12:21.980483+0000","last_became_peered":"2023-10-14T11:12:21.980483+0000","last_unstale":"2023-10-14T11:12:27.010620+0000","last_undegraded":"2023-10-14T11:12:27.010620+0000","last_fullsized":"2023-10-14T11:12:27.010620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:37.017137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.387892+0000","last_change":"2023-10-14T11:12:27.026598+0000","last_active":"2023-10-14T11:12:28.387892+0000","last_peered":"2023-10-14T11:12:28.387892+0000","last_clean":"2023-10-14T11:12:28.387892+0000","last_became_active":"2023-10-14T11:12:27.026041+0000","last_became_peered":"2023-10-14T11:12:27.026041+0000","last_unstale":"2023-10-14T11:12:28.387892+0000","last_undegraded":"2023-10-14T11:12:28.387892+0000","last_fullsized":"2023-10-14T11:12:28.387892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:07.549080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265979+0000","last_change":"2023-10-14T11:12:22.999134+0000","last_active":"2023-10-14T11:12:27.265979+0000","last_peered":"2023-10-14T11:12:27.265979+0000","last_clean":"2023-10-14T11:12:27.265979+0000","last_became_active":"2023-10-14T11:12:22.998882+0000","last_became_peered":"2023-10-14T11:12:22.998882+0000","last_unstale":"2023-10-14T11:12:27.265979+0000","last_undegraded":"2023-10-14T11:12:27.265979+0000","last_fullsized":"2023-10-14T11:12:27.265979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:48:29.403505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988956+0000","last_change":"2023-10-14T11:12:21.975400+0000","last_active":"2023-10-14T11:12:26.988956+0000","last_peered":"2023-10-14T11:12:26.988956+0000","last_clean":"2023-10-14T11:12:26.988956+0000","last_became_active":"2023-10-14T11:12:21.974763+0000","last_became_peered":"2023-10-14T11:12:21.974763+0000","last_unstale":"2023-10-14T11:12:26.988956+0000","last_undegraded":"2023-10-14T11:12:26.988956+0000","last_fullsized":"2023-10-14T11:12:26.988956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:10:00.086669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.991862+0000","last_change":"2023-10-14T11:12:27.270370+0000","last_active":"2023-10-14T11:12:27.991862+0000","last_peered":"2023-10-14T11:12:27.991862+0000","last_clean":"2023-10-14T11:12:27.991862+0000","last_became_active":"2023-10-14T11:12:27.269897+0000","last_became_peered":"2023-10-14T11:12:27.269897+0000","last_unstale":"2023-10-14T11:12:27.991862+0000","last_undegraded":"2023-10-14T11:12:27.991862+0000","last_fullsized":"2023-10-14T11:12:27.991862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:47.514617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265595+0000","last_change":"2023-10-14T11:12:22.999066+0000","last_active":"2023-10-14T11:12:27.265595+0000","last_peered":"2023-10-14T11:12:27.265595+0000","last_clean":"2023-10-14T11:12:27.265595+0000","last_became_active":"2023-10-14T11:12:22.998776+0000","last_became_peered":"2023-10-14T11:12:22.998776+0000","last_unstale":"2023-10-14T11:12:27.265595+0000","last_undegraded":"2023-10-14T11:12:27.265595+0000","last_fullsized":"2023-10-14T11:12:27.265595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:24.943192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.001153+0000","last_change":"2023-10-14T11:12:21.964558+0000","last_active":"2023-10-14T11:12:27.001153+0000","last_peered":"2023-10-14T11:12:27.001153+0000","last_clean":"2023-10-14T11:12:27.001153+0000","last_became_active":"2023-10-14T11:12:21.964064+0000","last_became_peered":"2023-10-14T11:12:21.964064+0000","last_unstale":"2023-10-14T11:12:27.001153+0000","last_undegraded":"2023-10-14T11:12:27.001153+0000","last_fullsized":"2023-10-14T11:12:27.001153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:10:00.086669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992867+0000","last_change":"2023-10-14T11:12:27.018556+0000","last_active":"2023-10-14T11:12:27.992867+0000","last_peered":"2023-10-14T11:12:27.992867+0000","last_clean":"2023-10-14T11:12:27.992867+0000","last_became_active":"2023-10-14T11:12:27.017714+0000","last_became_peered":"2023-10-14T11:12:27.017714+0000","last_unstale":"2023-10-14T11:12:27.992867+0000","last_undegraded":"2023-10-14T11:12:27.992867+0000","last_fullsized":"2023-10-14T11:12:27.992867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:23.718575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264735+0000","last_change":"2023-10-14T11:12:22.994290+0000","last_active":"2023-10-14T11:12:27.264735+0000","last_peered":"2023-10-14T11:12:27.264735+0000","last_clean":"2023-10-14T11:12:27.264735+0000","last_became_active":"2023-10-14T11:12:22.993935+0000","last_became_peered":"2023-10-14T11:12:22.993935+0000","last_unstale":"2023-10-14T11:12:27.264735+0000","last_undegraded":"2023-10-14T11:12:27.264735+0000","last_fullsized":"2023-10-14T11:12:27.264735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:54.432400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988665+0000","last_change":"2023-10-14T11:12:21.976195+0000","last_active":"2023-10-14T11:12:26.988665+0000","last_peered":"2023-10-14T11:12:26.988665+0000","last_clean":"2023-10-14T11:12:26.988665+0000","last_became_active":"2023-10-14T11:12:21.975885+0000","last_became_peered":"2023-10-14T11:12:21.975885+0000","last_unstale":"2023-10-14T11:12:26.988665+0000","last_undegraded":"2023-10-14T11:12:26.988665+0000","last_fullsized":"2023-10-14T11:12:26.988665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:11:08.840029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.387881+0000","last_change":"2023-10-14T11:12:27.016759+0000","last_active":"2023-10-14T11:12:28.387881+0000","last_peered":"2023-10-14T11:12:28.387881+0000","last_clean":"2023-10-14T11:12:28.387881+0000","last_became_active":"2023-10-14T11:12:27.016334+0000","last_became_peered":"2023-10-14T11:12:27.016334+0000","last_unstale":"2023-10-14T11:12:28.387881+0000","last_undegraded":"2023-10-14T11:12:28.387881+0000","last_fullsized":"2023-10-14T11:12:28.387881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:58.469102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990942+0000","last_change":"2023-10-14T11:12:22.972397+0000","last_active":"2023-10-14T11:12:26.990942+0000","last_peered":"2023-10-14T11:12:26.990942+0000","last_clean":"2023-10-14T11:12:26.990942+0000","last_became_active":"2023-10-14T11:12:22.972093+0000","last_became_peered":"2023-10-14T11:12:22.972093+0000","last_unstale":"2023-10-14T11:12:26.990942+0000","last_undegraded":"2023-10-14T11:12:26.990942+0000","last_fullsized":"2023-10-14T11:12:26.990942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:27.066313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.991065+0000","last_change":"2023-10-14T11:12:21.976321+0000","last_active":"2023-10-14T11:12:26.991065+0000","last_peered":"2023-10-14T11:12:26.991065+0000","last_clean":"2023-10-14T11:12:26.991065+0000","last_became_active":"2023-10-14T11:12:21.975848+0000","last_became_peered":"2023-10-14T11:12:21.975848+0000","last_unstale":"2023-10-14T11:12:26.991065+0000","last_undegraded":"2023-10-14T11:12:26.991065+0000","last_fullsized":"2023-10-14T11:12:26.991065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:31:07.362240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993559+0000","last_change":"2023-10-14T11:12:27.271736+0000","last_active":"2023-10-14T11:12:27.993559+0000","last_peered":"2023-10-14T11:12:27.993559+0000","last_clean":"2023-10-14T11:12:27.993559+0000","last_became_active":"2023-10-14T11:12:27.271274+0000","last_became_peered":"2023-10-14T11:12:27.271274+0000","last_unstale":"2023-10-14T11:12:27.993559+0000","last_undegraded":"2023-10-14T11:12:27.993559+0000","last_fullsized":"2023-10-14T11:12:27.993559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:34.380738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265050+0000","last_change":"2023-10-14T11:12:22.995743+0000","last_active":"2023-10-14T11:12:27.265050+0000","last_peered":"2023-10-14T11:12:27.265050+0000","last_clean":"2023-10-14T11:12:27.265050+0000","last_became_active":"2023-10-14T11:12:22.995464+0000","last_became_peered":"2023-10-14T11:12:22.995464+0000","last_unstale":"2023-10-14T11:12:27.265050+0000","last_undegraded":"2023-10-14T11:12:27.265050+0000","last_fullsized":"2023-10-14T11:12:27.265050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:19.552820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988900+0000","last_change":"2023-10-14T11:12:21.976206+0000","last_active":"2023-10-14T11:12:26.988900+0000","last_peered":"2023-10-14T11:12:26.988900+0000","last_clean":"2023-10-14T11:12:26.988900+0000","last_became_active":"2023-10-14T11:12:21.975934+0000","last_became_peered":"2023-10-14T11:12:21.975934+0000","last_unstale":"2023-10-14T11:12:26.988900+0000","last_undegraded":"2023-10-14T11:12:26.988900+0000","last_fullsized":"2023-10-14T11:12:26.988900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:16.694694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993189+0000","last_change":"2023-10-14T11:12:27.268251+0000","last_active":"2023-10-14T11:12:27.993189+0000","last_peered":"2023-10-14T11:12:27.993189+0000","last_clean":"2023-10-14T11:12:27.993189+0000","last_became_active":"2023-10-14T11:12:27.267788+0000","last_became_peered":"2023-10-14T11:12:27.267788+0000","last_unstale":"2023-10-14T11:12:27.993189+0000","last_undegraded":"2023-10-14T11:12:27.993189+0000","last_fullsized":"2023-10-14T11:12:27.993189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:00:07.198517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.007533+0000","last_change":"2023-10-14T11:12:22.987370+0000","last_active":"2023-10-14T11:12:27.007533+0000","last_peered":"2023-10-14T11:12:27.007533+0000","last_clean":"2023-10-14T11:12:27.007533+0000","last_became_active":"2023-10-14T11:12:22.987096+0000","last_became_peered":"2023-10-14T11:12:22.987096+0000","last_unstale":"2023-10-14T11:12:27.007533+0000","last_undegraded":"2023-10-14T11:12:27.007533+0000","last_fullsized":"2023-10-14T11:12:27.007533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:34.354835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010769+0000","last_change":"2023-10-14T11:12:21.964329+0000","last_active":"2023-10-14T11:12:27.010769+0000","last_peered":"2023-10-14T11:12:27.010769+0000","last_clean":"2023-10-14T11:12:27.010769+0000","last_became_active":"2023-10-14T11:12:21.963491+0000","last_became_peered":"2023-10-14T11:12:21.963491+0000","last_unstale":"2023-10-14T11:12:27.010769+0000","last_undegraded":"2023-10-14T11:12:27.010769+0000","last_fullsized":"2023-10-14T11:12:27.010769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:37.017137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993765+0000","last_change":"2023-10-14T11:12:27.267716+0000","last_active":"2023-10-14T11:12:27.993765+0000","last_peered":"2023-10-14T11:12:27.993765+0000","last_clean":"2023-10-14T11:12:27.993765+0000","last_became_active":"2023-10-14T11:12:27.267311+0000","last_became_peered":"2023-10-14T11:12:27.267311+0000","last_unstale":"2023-10-14T11:12:27.993765+0000","last_undegraded":"2023-10-14T11:12:27.993765+0000","last_fullsized":"2023-10-14T11:12:27.993765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:19:12.033636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265215+0000","last_change":"2023-10-14T11:12:22.987373+0000","last_active":"2023-10-14T11:12:27.265215+0000","last_peered":"2023-10-14T11:12:27.265215+0000","last_clean":"2023-10-14T11:12:27.265215+0000","last_became_active":"2023-10-14T11:12:22.986837+0000","last_became_peered":"2023-10-14T11:12:22.986837+0000","last_unstale":"2023-10-14T11:12:27.265215+0000","last_undegraded":"2023-10-14T11:12:27.265215+0000","last_fullsized":"2023-10-14T11:12:27.265215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:15.184385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:38.498227+0000","last_change":"2023-10-14T11:12:21.976712+0000","last_active":"2023-10-14T11:12:38.498227+0000","last_peered":"2023-10-14T11:12:38.498227+0000","last_clean":"2023-10-14T11:12:38.498227+0000","last_became_active":"2023-10-14T11:12:21.975439+0000","last_became_peered":"2023-10-14T11:12:21.975439+0000","last_unstale":"2023-10-14T11:12:38.498227+0000","last_undegraded":"2023-10-14T11:12:38.498227+0000","last_fullsized":"2023-10-14T11:12:38.498227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:37.017137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.052976+0000","last_change":"2023-10-14T11:12:27.018600+0000","last_active":"2023-10-14T11:12:29.052976+0000","last_peered":"2023-10-14T11:12:29.052976+0000","last_clean":"2023-10-14T11:12:29.052976+0000","last_became_active":"2023-10-14T11:12:27.018091+0000","last_became_peered":"2023-10-14T11:12:27.018091+0000","last_unstale":"2023-10-14T11:12:29.052976+0000","last_undegraded":"2023-10-14T11:12:29.052976+0000","last_fullsized":"2023-10-14T11:12:29.052976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:19.221087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.999245+0000","last_change":"2023-10-14T11:12:22.989506+0000","last_active":"2023-10-14T11:12:26.999245+0000","last_peered":"2023-10-14T11:12:26.999245+0000","last_clean":"2023-10-14T11:12:26.999245+0000","last_became_active":"2023-10-14T11:12:22.989177+0000","last_became_peered":"2023-10-14T11:12:22.989177+0000","last_unstale":"2023-10-14T11:12:26.999245+0000","last_undegraded":"2023-10-14T11:12:26.999245+0000","last_fullsized":"2023-10-14T11:12:26.999245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:02.330265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010526+0000","last_change":"2023-10-14T11:12:21.980802+0000","last_active":"2023-10-14T11:12:27.010526+0000","last_peered":"2023-10-14T11:12:27.010526+0000","last_clean":"2023-10-14T11:12:27.010526+0000","last_became_active":"2023-10-14T11:12:21.980604+0000","last_became_peered":"2023-10-14T11:12:21.980604+0000","last_unstale":"2023-10-14T11:12:27.010526+0000","last_undegraded":"2023-10-14T11:12:27.010526+0000","last_fullsized":"2023-10-14T11:12:27.010526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:01.323224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992999+0000","last_change":"2023-10-14T11:12:27.018243+0000","last_active":"2023-10-14T11:12:27.992999+0000","last_peered":"2023-10-14T11:12:27.992999+0000","last_clean":"2023-10-14T11:12:27.992999+0000","last_became_active":"2023-10-14T11:12:27.017731+0000","last_became_peered":"2023-10-14T11:12:27.017731+0000","last_unstale":"2023-10-14T11:12:27.992999+0000","last_undegraded":"2023-10-14T11:12:27.992999+0000","last_fullsized":"2023-10-14T11:12:27.992999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:50.570179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.011824+0000","last_change":"2023-10-14T11:12:22.985657+0000","last_active":"2023-10-14T11:12:27.011824+0000","last_peered":"2023-10-14T11:12:27.011824+0000","last_clean":"2023-10-14T11:12:27.011824+0000","last_became_active":"2023-10-14T11:12:22.984323+0000","last_became_peered":"2023-10-14T11:12:22.984323+0000","last_unstale":"2023-10-14T11:12:27.011824+0000","last_undegraded":"2023-10-14T11:12:27.011824+0000","last_fullsized":"2023-10-14T11:12:27.011824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:17.701734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990340+0000","last_change":"2023-10-14T11:12:21.973531+0000","last_active":"2023-10-14T11:12:26.990340+0000","last_peered":"2023-10-14T11:12:26.990340+0000","last_clean":"2023-10-14T11:12:26.990340+0000","last_became_active":"2023-10-14T11:12:21.973256+0000","last_became_peered":"2023-10-14T11:12:21.973256+0000","last_unstale":"2023-10-14T11:12:26.990340+0000","last_undegraded":"2023-10-14T11:12:26.990340+0000","last_fullsized":"2023-10-14T11:12:26.990340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:18.236450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992367+0000","last_change":"2023-10-14T11:12:27.027134+0000","last_active":"2023-10-14T11:12:27.992367+0000","last_peered":"2023-10-14T11:12:27.992367+0000","last_clean":"2023-10-14T11:12:27.992367+0000","last_became_active":"2023-10-14T11:12:27.026437+0000","last_became_peered":"2023-10-14T11:12:27.026437+0000","last_unstale":"2023-10-14T11:12:27.992367+0000","last_undegraded":"2023-10-14T11:12:27.992367+0000","last_fullsized":"2023-10-14T11:12:27.992367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:19:12.033636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990233+0000","last_change":"2023-10-14T11:12:22.993432+0000","last_active":"2023-10-14T11:12:26.990233+0000","last_peered":"2023-10-14T11:12:26.990233+0000","last_clean":"2023-10-14T11:12:26.990233+0000","last_became_active":"2023-10-14T11:12:22.993082+0000","last_became_peered":"2023-10-14T11:12:22.993082+0000","last_unstale":"2023-10-14T11:12:26.990233+0000","last_undegraded":"2023-10-14T11:12:26.990233+0000","last_fullsized":"2023-10-14T11:12:26.990233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:19.552820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.992391+0000","last_change":"2023-10-14T11:12:21.982821+0000","last_active":"2023-10-14T11:12:26.992391+0000","last_peered":"2023-10-14T11:12:26.992391+0000","last_clean":"2023-10-14T11:12:26.992391+0000","last_became_active":"2023-10-14T11:12:21.982328+0000","last_became_peered":"2023-10-14T11:12:21.982328+0000","last_unstale":"2023-10-14T11:12:26.992391+0000","last_undegraded":"2023-10-14T11:12:26.992391+0000","last_fullsized":"2023-10-14T11:12:26.992391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:40:43.612359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992497+0000","last_change":"2023-10-14T11:12:27.268498+0000","last_active":"2023-10-14T11:12:27.992497+0000","last_peered":"2023-10-14T11:12:27.992497+0000","last_clean":"2023-10-14T11:12:27.992497+0000","last_became_active":"2023-10-14T11:12:27.267751+0000","last_became_peered":"2023-10-14T11:12:27.267751+0000","last_unstale":"2023-10-14T11:12:27.992497+0000","last_undegraded":"2023-10-14T11:12:27.992497+0000","last_fullsized":"2023-10-14T11:12:27.992497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:53.991279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.387797+0000","last_change":"2023-10-14T11:12:27.274997+0000","last_active":"2023-10-14T11:12:28.387797+0000","last_peered":"2023-10-14T11:12:28.387797+0000","last_clean":"2023-10-14T11:12:28.387797+0000","last_became_active":"2023-10-14T11:12:27.273447+0000","last_became_peered":"2023-10-14T11:12:27.273447+0000","last_unstale":"2023-10-14T11:12:28.387797+0000","last_undegraded":"2023-10-14T11:12:28.387797+0000","last_fullsized":"2023-10-14T11:12:28.387797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:19.221087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000217+0000","last_change":"2023-10-14T11:12:22.965644+0000","last_active":"2023-10-14T11:12:27.000217+0000","last_peered":"2023-10-14T11:12:27.000217+0000","last_clean":"2023-10-14T11:12:27.000217+0000","last_became_active":"2023-10-14T11:12:22.965113+0000","last_became_peered":"2023-10-14T11:12:22.965113+0000","last_unstale":"2023-10-14T11:12:27.000217+0000","last_undegraded":"2023-10-14T11:12:27.000217+0000","last_fullsized":"2023-10-14T11:12:27.000217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:02:49.769267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.989018+0000","last_change":"2023-10-14T11:12:21.972862+0000","last_active":"2023-10-14T11:12:26.989018+0000","last_peered":"2023-10-14T11:12:26.989018+0000","last_clean":"2023-10-14T11:12:26.989018+0000","last_became_active":"2023-10-14T11:12:21.971652+0000","last_became_peered":"2023-10-14T11:12:21.971652+0000","last_unstale":"2023-10-14T11:12:26.989018+0000","last_undegraded":"2023-10-14T11:12:26.989018+0000","last_fullsized":"2023-10-14T11:12:26.989018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:37.017137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.051905+0000","last_change":"2023-10-14T11:12:27.024091+0000","last_active":"2023-10-14T11:12:29.051905+0000","last_peered":"2023-10-14T11:12:29.051905+0000","last_clean":"2023-10-14T11:12:29.051905+0000","last_became_active":"2023-10-14T11:12:27.023591+0000","last_became_peered":"2023-10-14T11:12:27.023591+0000","last_unstale":"2023-10-14T11:12:29.051905+0000","last_undegraded":"2023-10-14T11:12:29.051905+0000","last_fullsized":"2023-10-14T11:12:29.051905+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:58.469102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.995932+0000","last_change":"2023-10-14T11:12:22.976553+0000","last_active":"2023-10-14T11:12:26.995932+0000","last_peered":"2023-10-14T11:12:26.995932+0000","last_clean":"2023-10-14T11:12:26.995932+0000","last_became_active":"2023-10-14T11:12:22.976280+0000","last_became_peered":"2023-10-14T11:12:22.976280+0000","last_unstale":"2023-10-14T11:12:26.995932+0000","last_undegraded":"2023-10-14T11:12:26.995932+0000","last_fullsized":"2023-10-14T11:12:26.995932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:02:49.769267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.995666+0000","last_change":"2023-10-14T11:12:21.971386+0000","last_active":"2023-10-14T11:12:26.995666+0000","last_peered":"2023-10-14T11:12:26.995666+0000","last_clean":"2023-10-14T11:12:26.995666+0000","last_became_active":"2023-10-14T11:12:21.971087+0000","last_became_peered":"2023-10-14T11:12:21.971087+0000","last_unstale":"2023-10-14T11:12:26.995666+0000","last_undegraded":"2023-10-14T11:12:26.995666+0000","last_fullsized":"2023-10-14T11:12:26.995666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:40:43.612359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.992534+0000","last_change":"2023-10-14T11:12:21.975576+0000","last_active":"2023-10-14T11:12:26.992534+0000","last_peered":"2023-10-14T11:12:26.992534+0000","last_clean":"2023-10-14T11:12:26.992534+0000","last_became_active":"2023-10-14T11:12:21.975207+0000","last_became_peered":"2023-10-14T11:12:21.975207+0000","last_unstale":"2023-10-14T11:12:26.992534+0000","last_undegraded":"2023-10-14T11:12:26.992534+0000","last_fullsized":"2023-10-14T11:12:26.992534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:01.323224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010668+0000","last_change":"2023-10-14T11:12:22.992785+0000","last_active":"2023-10-14T11:12:27.010668+0000","last_peered":"2023-10-14T11:12:27.010668+0000","last_clean":"2023-10-14T11:12:27.010668+0000","last_became_active":"2023-10-14T11:12:22.992508+0000","last_became_peered":"2023-10-14T11:12:22.992508+0000","last_unstale":"2023-10-14T11:12:27.010668+0000","last_undegraded":"2023-10-14T11:12:27.010668+0000","last_fullsized":"2023-10-14T11:12:27.010668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:07:23.864178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.702964+0000","last_change":"2023-10-14T11:12:27.023027+0000","last_active":"2023-10-14T11:12:28.702964+0000","last_peered":"2023-10-14T11:12:28.702964+0000","last_clean":"2023-10-14T11:12:28.702964+0000","last_became_active":"2023-10-14T11:12:27.020646+0000","last_became_peered":"2023-10-14T11:12:27.020646+0000","last_unstale":"2023-10-14T11:12:28.702964+0000","last_undegraded":"2023-10-14T11:12:28.702964+0000","last_fullsized":"2023-10-14T11:12:28.702964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:40:48.656102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.998432+0000","last_change":"2023-10-14T11:12:21.976762+0000","last_active":"2023-10-14T11:12:26.998432+0000","last_peered":"2023-10-14T11:12:26.998432+0000","last_clean":"2023-10-14T11:12:26.998432+0000","last_became_active":"2023-10-14T11:12:21.976437+0000","last_became_peered":"2023-10-14T11:12:21.976437+0000","last_unstale":"2023-10-14T11:12:26.998432+0000","last_undegraded":"2023-10-14T11:12:26.998432+0000","last_fullsized":"2023-10-14T11:12:26.998432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:31:07.362240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.997365+0000","last_change":"2023-10-14T11:12:22.960803+0000","last_active":"2023-10-14T11:12:26.997365+0000","last_peered":"2023-10-14T11:12:26.997365+0000","last_clean":"2023-10-14T11:12:26.997365+0000","last_became_active":"2023-10-14T11:12:22.960504+0000","last_became_peered":"2023-10-14T11:12:22.960504+0000","last_unstale":"2023-10-14T11:12:26.997365+0000","last_undegraded":"2023-10-14T11:12:26.997365+0000","last_fullsized":"2023-10-14T11:12:26.997365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:24.233763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993298+0000","last_change":"2023-10-14T11:12:27.016102+0000","last_active":"2023-10-14T11:12:27.993298+0000","last_peered":"2023-10-14T11:12:27.993298+0000","last_clean":"2023-10-14T11:12:27.993298+0000","last_became_active":"2023-10-14T11:12:27.015599+0000","last_became_peered":"2023-10-14T11:12:27.015599+0000","last_unstale":"2023-10-14T11:12:27.993298+0000","last_undegraded":"2023-10-14T11:12:27.993298+0000","last_fullsized":"2023-10-14T11:12:27.993298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:04:28.117008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988221+0000","last_change":"2023-10-14T11:12:22.974947+0000","last_active":"2023-10-14T11:12:26.988221+0000","last_peered":"2023-10-14T11:12:26.988221+0000","last_clean":"2023-10-14T11:12:26.988221+0000","last_became_active":"2023-10-14T11:12:22.974647+0000","last_became_peered":"2023-10-14T11:12:22.974647+0000","last_unstale":"2023-10-14T11:12:26.988221+0000","last_undegraded":"2023-10-14T11:12:26.988221+0000","last_fullsized":"2023-10-14T11:12:26.988221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:02:49.769267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988737+0000","last_change":"2023-10-14T11:12:22.987590+0000","last_active":"2023-10-14T11:12:26.988737+0000","last_peered":"2023-10-14T11:12:26.988737+0000","last_clean":"2023-10-14T11:12:26.988737+0000","last_became_active":"2023-10-14T11:12:22.985815+0000","last_became_peered":"2023-10-14T11:12:22.985815+0000","last_unstale":"2023-10-14T11:12:26.988737+0000","last_undegraded":"2023-10-14T11:12:26.988737+0000","last_fullsized":"2023-10-14T11:12:26.988737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:24.233763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988803+0000","last_change":"2023-10-14T11:12:22.971785+0000","last_active":"2023-10-14T11:12:26.988803+0000","last_peered":"2023-10-14T11:12:26.988803+0000","last_clean":"2023-10-14T11:12:26.988803+0000","last_became_active":"2023-10-14T11:12:22.971415+0000","last_became_peered":"2023-10-14T11:12:22.971415+0000","last_unstale":"2023-10-14T11:12:26.988803+0000","last_undegraded":"2023-10-14T11:12:26.988803+0000","last_fullsized":"2023-10-14T11:12:26.988803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:54.432400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010852+0000","last_change":"2023-10-14T11:12:22.981024+0000","last_active":"2023-10-14T11:12:27.010852+0000","last_peered":"2023-10-14T11:12:27.010852+0000","last_clean":"2023-10-14T11:12:27.010852+0000","last_became_active":"2023-10-14T11:12:22.977993+0000","last_became_peered":"2023-10-14T11:12:22.977993+0000","last_unstale":"2023-10-14T11:12:27.010852+0000","last_undegraded":"2023-10-14T11:12:27.010852+0000","last_fullsized":"2023-10-14T11:12:27.010852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:31:08.369281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.999570+0000","last_change":"2023-10-14T11:12:22.969832+0000","last_active":"2023-10-14T11:12:26.999570+0000","last_peered":"2023-10-14T11:12:26.999570+0000","last_clean":"2023-10-14T11:12:26.999570+0000","last_became_active":"2023-10-14T11:12:22.969627+0000","last_became_peered":"2023-10-14T11:12:22.969627+0000","last_unstale":"2023-10-14T11:12:26.999570+0000","last_undegraded":"2023-10-14T11:12:26.999570+0000","last_fullsized":"2023-10-14T11:12:26.999570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:52:38.018829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010439+0000","last_change":"2023-10-14T11:12:22.966311+0000","last_active":"2023-10-14T11:12:27.010439+0000","last_peered":"2023-10-14T11:12:27.010439+0000","last_clean":"2023-10-14T11:12:27.010439+0000","last_became_active":"2023-10-14T11:12:22.965987+0000","last_became_peered":"2023-10-14T11:12:22.965987+0000","last_unstale":"2023-10-14T11:12:27.010439+0000","last_undegraded":"2023-10-14T11:12:27.010439+0000","last_fullsized":"2023-10-14T11:12:27.010439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:27.066313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.991696+0000","last_change":"2023-10-14T11:12:22.992696+0000","last_active":"2023-10-14T11:12:26.991696+0000","last_peered":"2023-10-14T11:12:26.991696+0000","last_clean":"2023-10-14T11:12:26.991696+0000","last_became_active":"2023-10-14T11:12:22.991959+0000","last_became_peered":"2023-10-14T11:12:22.991959+0000","last_unstale":"2023-10-14T11:12:26.991696+0000","last_undegraded":"2023-10-14T11:12:26.991696+0000","last_fullsized":"2023-10-14T11:12:26.991696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:52:38.018829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000914+0000","last_change":"2023-10-14T11:12:22.984405+0000","last_active":"2023-10-14T11:12:27.000914+0000","last_peered":"2023-10-14T11:12:27.000914+0000","last_clean":"2023-10-14T11:12:27.000914+0000","last_became_active":"2023-10-14T11:12:22.978369+0000","last_became_peered":"2023-10-14T11:12:22.978369+0000","last_unstale":"2023-10-14T11:12:27.000914+0000","last_undegraded":"2023-10-14T11:12:27.000914+0000","last_fullsized":"2023-10-14T11:12:27.000914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:19.681873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988858+0000","last_change":"2023-10-14T11:12:22.969040+0000","last_active":"2023-10-14T11:12:26.988858+0000","last_peered":"2023-10-14T11:12:26.988858+0000","last_clean":"2023-10-14T11:12:26.988858+0000","last_became_active":"2023-10-14T11:12:22.968583+0000","last_became_peered":"2023-10-14T11:12:22.968583+0000","last_unstale":"2023-10-14T11:12:26.988858+0000","last_undegraded":"2023-10-14T11:12:26.988858+0000","last_fullsized":"2023-10-14T11:12:26.988858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:38.252309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.995566+0000","last_change":"2023-10-14T11:12:22.966174+0000","last_active":"2023-10-14T11:12:26.995566+0000","last_peered":"2023-10-14T11:12:26.995566+0000","last_clean":"2023-10-14T11:12:26.995566+0000","last_became_active":"2023-10-14T11:12:22.965570+0000","last_became_peered":"2023-10-14T11:12:22.965570+0000","last_unstale":"2023-10-14T11:12:26.995566+0000","last_undegraded":"2023-10-14T11:12:26.995566+0000","last_fullsized":"2023-10-14T11:12:26.995566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:19.243490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988714+0000","last_change":"2023-10-14T11:12:22.982352+0000","last_active":"2023-10-14T11:12:26.988714+0000","last_peered":"2023-10-14T11:12:26.988714+0000","last_clean":"2023-10-14T11:12:26.988714+0000","last_became_active":"2023-10-14T11:12:22.982026+0000","last_became_peered":"2023-10-14T11:12:22.982026+0000","last_unstale":"2023-10-14T11:12:26.988714+0000","last_undegraded":"2023-10-14T11:12:26.988714+0000","last_fullsized":"2023-10-14T11:12:26.988714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:19.681873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010463+0000","last_change":"2023-10-14T11:12:22.989236+0000","last_active":"2023-10-14T11:12:27.010463+0000","last_peered":"2023-10-14T11:12:27.010463+0000","last_clean":"2023-10-14T11:12:27.010463+0000","last_became_active":"2023-10-14T11:12:22.988644+0000","last_became_peered":"2023-10-14T11:12:22.988644+0000","last_unstale":"2023-10-14T11:12:27.010463+0000","last_undegraded":"2023-10-14T11:12:27.010463+0000","last_fullsized":"2023-10-14T11:12:27.010463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:40:44.619400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.991230+0000","last_change":"2023-10-14T11:12:22.983434+0000","last_active":"2023-10-14T11:12:26.991230+0000","last_peered":"2023-10-14T11:12:26.991230+0000","last_clean":"2023-10-14T11:12:26.991230+0000","last_became_active":"2023-10-14T11:12:22.982702+0000","last_became_peered":"2023-10-14T11:12:22.982702+0000","last_unstale":"2023-10-14T11:12:26.991230+0000","last_undegraded":"2023-10-14T11:12:26.991230+0000","last_fullsized":"2023-10-14T11:12:26.991230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:19.243490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265404+0000","last_change":"2023-10-14T11:12:22.985280+0000","last_active":"2023-10-14T11:12:27.265404+0000","last_peered":"2023-10-14T11:12:27.265404+0000","last_clean":"2023-10-14T11:12:27.265404+0000","last_became_active":"2023-10-14T11:12:22.984745+0000","last_became_peered":"2023-10-14T11:12:22.984745+0000","last_unstale":"2023-10-14T11:12:27.265404+0000","last_undegraded":"2023-10-14T11:12:27.265404+0000","last_fullsized":"2023-10-14T11:12:27.265404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:32.409154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988912+0000","last_change":"2023-10-14T11:12:22.996375+0000","last_active":"2023-10-14T11:12:26.988912+0000","last_peered":"2023-10-14T11:12:26.988912+0000","last_clean":"2023-10-14T11:12:26.988912+0000","last_became_active":"2023-10-14T11:12:22.995986+0000","last_became_peered":"2023-10-14T11:12:22.995986+0000","last_unstale":"2023-10-14T11:12:26.988912+0000","last_undegraded":"2023-10-14T11:12:26.988912+0000","last_fullsized":"2023-10-14T11:12:26.988912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:41.624687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990653+0000","last_change":"2023-10-14T11:12:22.982260+0000","last_active":"2023-10-14T11:12:26.990653+0000","last_peered":"2023-10-14T11:12:26.990653+0000","last_clean":"2023-10-14T11:12:26.990653+0000","last_became_active":"2023-10-14T11:12:22.981981+0000","last_became_peered":"2023-10-14T11:12:22.981981+0000","last_unstale":"2023-10-14T11:12:26.990653+0000","last_undegraded":"2023-10-14T11:12:26.990653+0000","last_fullsized":"2023-10-14T11:12:26.990653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:08.508676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988763+0000","last_change":"2023-10-14T11:12:22.972200+0000","last_active":"2023-10-14T11:12:26.988763+0000","last_peered":"2023-10-14T11:12:26.988763+0000","last_clean":"2023-10-14T11:12:26.988763+0000","last_became_active":"2023-10-14T11:12:22.971852+0000","last_became_peered":"2023-10-14T11:12:22.971852+0000","last_unstale":"2023-10-14T11:12:26.988763+0000","last_undegraded":"2023-10-14T11:12:26.988763+0000","last_fullsized":"2023-10-14T11:12:26.988763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:52:38.018829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000298+0000","last_change":"2023-10-14T11:12:22.964369+0000","last_active":"2023-10-14T11:12:27.000298+0000","last_peered":"2023-10-14T11:12:27.000298+0000","last_clean":"2023-10-14T11:12:27.000298+0000","last_became_active":"2023-10-14T11:12:22.963993+0000","last_became_peered":"2023-10-14T11:12:22.963993+0000","last_unstale":"2023-10-14T11:12:27.000298+0000","last_undegraded":"2023-10-14T11:12:27.000298+0000","last_fullsized":"2023-10-14T11:12:27.000298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:06.491915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.007442+0000","last_change":"2023-10-14T11:12:22.982867+0000","last_active":"2023-10-14T11:12:27.007442+0000","last_peered":"2023-10-14T11:12:27.007442+0000","last_clean":"2023-10-14T11:12:27.007442+0000","last_became_active":"2023-10-14T11:12:22.981049+0000","last_became_peered":"2023-10-14T11:12:22.981049+0000","last_unstale":"2023-10-14T11:12:27.007442+0000","last_undegraded":"2023-10-14T11:12:27.007442+0000","last_fullsized":"2023-10-14T11:12:27.007442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:06.491915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.994506+0000","last_change":"2023-10-14T11:12:22.968823+0000","last_active":"2023-10-14T11:12:26.994506+0000","last_peered":"2023-10-14T11:12:26.994506+0000","last_clean":"2023-10-14T11:12:26.994506+0000","last_became_active":"2023-10-14T11:12:22.968557+0000","last_became_peered":"2023-10-14T11:12:22.968557+0000","last_unstale":"2023-10-14T11:12:26.994506+0000","last_undegraded":"2023-10-14T11:12:26.994506+0000","last_fullsized":"2023-10-14T11:12:26.994506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:27.066313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.999040+0000","last_change":"2023-10-14T11:12:22.970768+0000","last_active":"2023-10-14T11:12:26.999040+0000","last_peered":"2023-10-14T11:12:26.999040+0000","last_clean":"2023-10-14T11:12:26.999040+0000","last_became_active":"2023-10-14T11:12:22.970449+0000","last_became_peered":"2023-10-14T11:12:22.970449+0000","last_unstale":"2023-10-14T11:12:26.999040+0000","last_undegraded":"2023-10-14T11:12:26.999040+0000","last_fullsized":"2023-10-14T11:12:26.999040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:38.024178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.991296+0000","last_change":"2023-10-14T11:12:22.984404+0000","last_active":"2023-10-14T11:12:26.991296+0000","last_peered":"2023-10-14T11:12:26.991296+0000","last_clean":"2023-10-14T11:12:26.991296+0000","last_became_active":"2023-10-14T11:12:22.984162+0000","last_became_peered":"2023-10-14T11:12:22.984162+0000","last_unstale":"2023-10-14T11:12:26.991296+0000","last_undegraded":"2023-10-14T11:12:26.991296+0000","last_fullsized":"2023-10-14T11:12:26.991296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:17.701734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.991597+0000","last_change":"2023-10-14T11:12:22.992927+0000","last_active":"2023-10-14T11:12:26.991597+0000","last_peered":"2023-10-14T11:12:26.991597+0000","last_clean":"2023-10-14T11:12:26.991597+0000","last_became_active":"2023-10-14T11:12:22.992333+0000","last_became_peered":"2023-10-14T11:12:22.992333+0000","last_unstale":"2023-10-14T11:12:26.991597+0000","last_undegraded":"2023-10-14T11:12:26.991597+0000","last_fullsized":"2023-10-14T11:12:26.991597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:24:53.742274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265899+0000","last_change":"2023-10-14T11:12:22.986073+0000","last_active":"2023-10-14T11:12:27.265899+0000","last_peered":"2023-10-14T11:12:27.265899+0000","last_clean":"2023-10-14T11:12:27.265899+0000","last_became_active":"2023-10-14T11:12:22.985686+0000","last_became_peered":"2023-10-14T11:12:22.985686+0000","last_unstale":"2023-10-14T11:12:27.265899+0000","last_undegraded":"2023-10-14T11:12:27.265899+0000","last_fullsized":"2023-10-14T11:12:27.265899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:15:12.849455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.995735+0000","last_change":"2023-10-14T11:12:22.982684+0000","last_active":"2023-10-14T11:12:26.995735+0000","last_peered":"2023-10-14T11:12:26.995735+0000","last_clean":"2023-10-14T11:12:26.995735+0000","last_became_active":"2023-10-14T11:12:22.982328+0000","last_became_peered":"2023-10-14T11:12:22.982328+0000","last_unstale":"2023-10-14T11:12:26.995735+0000","last_undegraded":"2023-10-14T11:12:26.995735+0000","last_fullsized":"2023-10-14T11:12:26.995735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:06.491915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264743+0000","last_change":"2023-10-14T11:12:22.989563+0000","last_active":"2023-10-14T11:12:27.264743+0000","last_peered":"2023-10-14T11:12:27.264743+0000","last_clean":"2023-10-14T11:12:27.264743+0000","last_became_active":"2023-10-14T11:12:22.989283+0000","last_became_peered":"2023-10-14T11:12:22.989283+0000","last_unstale":"2023-10-14T11:12:27.264743+0000","last_undegraded":"2023-10-14T11:12:27.264743+0000","last_fullsized":"2023-10-14T11:12:27.264743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:19.681873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988614+0000","last_change":"2023-10-14T11:12:22.973627+0000","last_active":"2023-10-14T11:12:26.988614+0000","last_peered":"2023-10-14T11:12:26.988614+0000","last_clean":"2023-10-14T11:12:26.988614+0000","last_became_active":"2023-10-14T11:12:22.973284+0000","last_became_peered":"2023-10-14T11:12:22.973284+0000","last_unstale":"2023-10-14T11:12:26.988614+0000","last_undegraded":"2023-10-14T11:12:26.988614+0000","last_fullsized":"2023-10-14T11:12:26.988614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:18:11.434418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264837+0000","last_change":"2023-10-14T11:12:22.981086+0000","last_active":"2023-10-14T11:12:27.264837+0000","last_peered":"2023-10-14T11:12:27.264837+0000","last_clean":"2023-10-14T11:12:27.264837+0000","last_became_active":"2023-10-14T11:12:22.980768+0000","last_became_peered":"2023-10-14T11:12:22.980768+0000","last_unstale":"2023-10-14T11:12:27.264837+0000","last_undegraded":"2023-10-14T11:12:27.264837+0000","last_fullsized":"2023-10-14T11:12:27.264837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:46.533477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.989398+0000","last_change":"2023-10-14T11:12:22.972884+0000","last_active":"2023-10-14T11:12:26.989398+0000","last_peered":"2023-10-14T11:12:26.989398+0000","last_clean":"2023-10-14T11:12:26.989398+0000","last_became_active":"2023-10-14T11:12:22.972548+0000","last_became_peered":"2023-10-14T11:12:22.972548+0000","last_unstale":"2023-10-14T11:12:26.989398+0000","last_undegraded":"2023-10-14T11:12:26.989398+0000","last_fullsized":"2023-10-14T11:12:26.989398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:46.533477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010562+0000","last_change":"2023-10-14T11:12:22.975055+0000","last_active":"2023-10-14T11:12:27.010562+0000","last_peered":"2023-10-14T11:12:27.010562+0000","last_clean":"2023-10-14T11:12:27.010562+0000","last_became_active":"2023-10-14T11:12:22.974759+0000","last_became_peered":"2023-10-14T11:12:22.974759+0000","last_unstale":"2023-10-14T11:12:27.010562+0000","last_undegraded":"2023-10-14T11:12:27.010562+0000","last_fullsized":"2023-10-14T11:12:27.010562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:02:49.769267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.012397+0000","last_change":"2023-10-14T11:12:22.973923+0000","last_active":"2023-10-14T11:12:27.012397+0000","last_peered":"2023-10-14T11:12:27.012397+0000","last_clean":"2023-10-14T11:12:27.012397+0000","last_became_active":"2023-10-14T11:12:22.973626+0000","last_became_peered":"2023-10-14T11:12:22.973626+0000","last_unstale":"2023-10-14T11:12:27.012397+0000","last_undegraded":"2023-10-14T11:12:27.012397+0000","last_fullsized":"2023-10-14T11:12:27.012397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:17.701734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265807+0000","last_change":"2023-10-14T11:12:22.987825+0000","last_active":"2023-10-14T11:12:27.265807+0000","last_peered":"2023-10-14T11:12:27.265807+0000","last_clean":"2023-10-14T11:12:27.265807+0000","last_became_active":"2023-10-14T11:12:22.987045+0000","last_became_peered":"2023-10-14T11:12:22.987045+0000","last_unstale":"2023-10-14T11:12:27.265807+0000","last_undegraded":"2023-10-14T11:12:27.265807+0000","last_fullsized":"2023-10-14T11:12:27.265807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:08.508676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":864256,"data_stored":695401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":104541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":278528,"data_stored":104577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":104451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":104611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":695457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:12:53.044 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:12:53.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.223+0000 7f8d98301640 1 Processor -- start 2023-10-14T11:12:53.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.223+0000 7f8d98301640 1 -- start start 2023-10-14T11:12:53.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.223+0000 7f8d98301640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8d9015cb90 0x7f8d900cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:53.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.223+0000 7f8d98301640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d900d15d0 0x7f8d900c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:53.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.223+0000 7f8d98301640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d900ce770 con 0x7f8d900d3010 2023-10-14T11:12:53.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.223+0000 7f8d98301640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d900d0600 con 0x7f8d9015cb90 2023-10-14T11:12:53.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.223+0000 7f8d98301640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d900c6450 con 0x7f8d900d15d0 2023-10-14T11:12:53.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.223+0000 7f8d9609d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8d9015cb90 0x7f8d900cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:53.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.223+0000 7f8d9609d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8d9015cb90 0x7f8d900cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37376/0 (socket says 172.21.15.26:37376) 2023-10-14T11:12:53.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.223+0000 7f8d9609d640 1 -- 172.21.15.26:0/652425199 learned_addr learned my addr 172.21.15.26:0/652425199 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:53.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.223+0000 7f8d9589c640 1 --1- 172.21.15.26:0/652425199 >> v1:172.21.15.26:6789/0 conn(0x7f8d900d3010 0x7f8d900d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38808/0 (socket says 172.21.15.26:38808) 2023-10-14T11:12:53.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.223+0000 7f8d9689e640 1 --2- 172.21.15.26:0/652425199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d900d15d0 0x7f8d900c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:53.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.223+0000 7f8d9609d640 1 -- 172.21.15.26:0/652425199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d900d15d0 msgr2=0x7f8d900c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:53.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.223+0000 7f8d9609d640 1 --2- 172.21.15.26:0/652425199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d900d15d0 0x7f8d900c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.223+0000 7f8d9609d640 1 -- 172.21.15.26:0/652425199 >> v1:172.21.15.26:6789/0 conn(0x7f8d900d3010 legacy=0x7f8d900d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:53.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.223+0000 7f8d9609d640 1 -- 172.21.15.26:0/652425199 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d900d08a0 con 0x7f8d9015cb90 2023-10-14T11:12:53.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.223+0000 7f8d9689e640 1 --2- 172.21.15.26:0/652425199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d900d15d0 0x7f8d900c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:53.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.227+0000 7f8d9609d640 1 --2- 172.21.15.26:0/652425199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d9015cb90 0x7f8d900cfb10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c006fd0 tx=0x7f8d8c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34e0817c2b66aa5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:53.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.227+0000 7f8d9509b640 1 -- 172.21.15.26:0/652425199 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c0ab660 con 0x7f8d9015cb90 2023-10-14T11:12:53.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.227+0000 7f8d9509b640 1 -- 172.21.15.26:0/652425199 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8c0ab7c0 con 0x7f8d9015cb90 2023-10-14T11:12:53.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.227+0000 7f8d9509b640 1 -- 172.21.15.26:0/652425199 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c0abb50 con 0x7f8d9015cb90 2023-10-14T11:12:53.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.227+0000 7f8d98301640 1 -- 172.21.15.26:0/652425199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d9015cb90 msgr2=0x7f8d900cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:53.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.227+0000 7f8d98301640 1 --2- 172.21.15.26:0/652425199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d9015cb90 0x7f8d900cfb10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c006fd0 tx=0x7f8d8c01c460 comp rx=0 tx=0).stop 2023-10-14T11:12:53.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.227+0000 7f8d98301640 1 -- 172.21.15.26:0/652425199 shutdown_connections 2023-10-14T11:12:53.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.227+0000 7f8d98301640 1 --2- 172.21.15.26:0/652425199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d900d15d0 0x7f8d900c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.227+0000 7f8d98301640 1 --2- 172.21.15.26:0/652425199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d9015cb90 0x7f8d900cfb10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.227+0000 7f8d98301640 1 -- 172.21.15.26:0/652425199 >> 172.21.15.26:0/652425199 conn(0x7f8d9009bc50 msgr2=0x7f8d900d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:53.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.227+0000 7f8d98301640 1 -- 172.21.15.26:0/652425199 shutdown_connections 2023-10-14T11:12:53.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.227+0000 7f8d98301640 1 -- 172.21.15.26:0/652425199 wait complete. 2023-10-14T11:12:53.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d98301640 1 Processor -- start 2023-10-14T11:12:53.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d98301640 1 -- start start 2023-10-14T11:12:53.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d98301640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d900d15d0 0x7f8d900ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:53.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d98301640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d900d3010 0x7f8d9014fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:53.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d98301640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d9015cb90 0x7f8d9006bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:53.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d98301640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d900c99d0 con 0x7f8d900d15d0 2023-10-14T11:12:53.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d98301640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d900c9f00 con 0x7f8d900d3010 2023-10-14T11:12:53.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d98301640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d901502f0 con 0x7f8d9015cb90 2023-10-14T11:12:53.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d9609d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d900d15d0 0x7f8d900ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:53.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d9609d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d900d15d0 0x7f8d900ca5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37378/0 (socket says 172.21.15.26:37378) 2023-10-14T11:12:53.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d9609d640 1 -- 172.21.15.26:0/2405351689 learned_addr learned my addr 172.21.15.26:0/2405351689 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:53.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d9589c640 1 --2- 172.21.15.26:0/2405351689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d900d3010 0x7f8d9014fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:53.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d9689e640 1 --2- 172.21.15.26:0/2405351689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d9015cb90 0x7f8d9006bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:53.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d9609d640 1 -- 172.21.15.26:0/2405351689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d9015cb90 msgr2=0x7f8d9006bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:53.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d9609d640 1 --2- 172.21.15.26:0/2405351689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d9015cb90 0x7f8d9006bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d9609d640 1 -- 172.21.15.26:0/2405351689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d900d3010 msgr2=0x7f8d9014fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:53.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d9609d640 1 --2- 172.21.15.26:0/2405351689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d900d3010 0x7f8d9014fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d9609d640 1 -- 172.21.15.26:0/2405351689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c009480 con 0x7f8d900d15d0 2023-10-14T11:12:53.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d9689e640 1 --2- 172.21.15.26:0/2405351689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d9015cb90 0x7f8d9006bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:53.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d9609d640 1 --2- 172.21.15.26:0/2405351689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d900d15d0 0x7f8d900ca5c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c01cd00 tx=0x7f8d8c019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:53.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d86ffd640 1 -- 172.21.15.26:0/2405351689 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c0abb30 con 0x7f8d900d15d0 2023-10-14T11:12:53.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d86ffd640 1 -- 172.21.15.26:0/2405351689 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8c0abcb0 con 0x7f8d900d15d0 2023-10-14T11:12:53.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d86ffd640 1 -- 172.21.15.26:0/2405351689 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c003860 con 0x7f8d900d15d0 2023-10-14T11:12:53.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d98301640 1 -- 172.21.15.26:0/2405351689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d901581a0 con 0x7f8d900d15d0 2023-10-14T11:12:53.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.231+0000 7f8d98301640 1 -- 172.21.15.26:0/2405351689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d900c9c20 con 0x7f8d900d15d0 2023-10-14T11:12:53.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.235+0000 7f8d98301640 1 -- 172.21.15.26:0/2405351689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d900ca2e0 con 0x7f8d900d15d0 2023-10-14T11:12:53.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.235+0000 7f8d86ffd640 1 -- 172.21.15.26:0/2405351689 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8d8c0a9070 con 0x7f8d900d15d0 2023-10-14T11:12:53.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.235+0000 7f8d86ffd640 1 --2- 172.21.15.26:0/2405351689 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8d740664a0 0x7f8d74068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:53.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.235+0000 7f8d86ffd640 1 -- 172.21.15.26:0/2405351689 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8d8c11ebc0 con 0x7f8d900d15d0 2023-10-14T11:12:53.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.235+0000 7f8d9589c640 1 --2- 172.21.15.26:0/2405351689 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8d740664a0 0x7f8d74068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:53.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.235+0000 7f8d9589c640 1 --2- 172.21.15.26:0/2405351689 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8d740664a0 0x7f8d74068960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8d90152490 tx=0x7f8d80007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:53.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.239+0000 7f8d86ffd640 1 -- 172.21.15.26:0/2405351689 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8d900ca2e0 con 0x7f8d900d15d0 2023-10-14T11:12:53.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.395+0000 7f8d98301640 1 -- 172.21.15.26:0/2405351689 --> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8d9015cf70 con 0x7f8d740664a0 2023-10-14T11:12:53.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.403+0000 7f8d86ffd640 1 -- 172.21.15.26:0/2405351689 <== mgr.4101 v2:172.21.15.26:6832/4136446821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345290 (secure 0 0 0) 0x7f8d800072c0 con 0x7f8d740664a0 2023-10-14T11:12:53.410 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:53.412 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-14T11:12:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.407+0000 7f8d98301640 1 -- 172.21.15.26:0/2405351689 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8d740664a0 msgr2=0x7f8d74068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.407+0000 7f8d98301640 1 --2- 172.21.15.26:0/2405351689 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8d740664a0 0x7f8d74068960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8d90152490 tx=0x7f8d80007e30 comp rx=0 tx=0).stop 2023-10-14T11:12:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.407+0000 7f8d98301640 1 -- 172.21.15.26:0/2405351689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d900d15d0 msgr2=0x7f8d900ca5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.407+0000 7f8d98301640 1 --2- 172.21.15.26:0/2405351689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d900d15d0 0x7f8d900ca5c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c01cd00 tx=0x7f8d8c019200 comp rx=0 tx=0).stop 2023-10-14T11:12:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.407+0000 7f8d98301640 1 -- 172.21.15.26:0/2405351689 shutdown_connections 2023-10-14T11:12:53.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.407+0000 7f8d98301640 1 --2- 172.21.15.26:0/2405351689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d9015cb90 0x7f8d9006bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.407+0000 7f8d98301640 1 --2- 172.21.15.26:0/2405351689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d900d3010 0x7f8d9014fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.407+0000 7f8d98301640 1 --2- 172.21.15.26:0/2405351689 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8d740664a0 0x7f8d74068960 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.407+0000 7f8d98301640 1 --2- 172.21.15.26:0/2405351689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d900d15d0 0x7f8d900ca5c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.407+0000 7f8d98301640 1 -- 172.21.15.26:0/2405351689 >> 172.21.15.26:0/2405351689 conn(0x7f8d9009bc50 msgr2=0x7f8d900ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:53.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.407+0000 7f8d98301640 1 -- 172.21.15.26:0/2405351689 shutdown_connections 2023-10-14T11:12:53.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.407+0000 7f8d98301640 1 -- 172.21.15.26:0/2405351689 wait complete. 2023-10-14T11:12:53.430 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-10-14T11:12:52.166945+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227784,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754746936,"statfs":{"total":773094113280,"available":772860862464,"internally_reserved":0,"allocated":3383296,"data_stored":2025622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":229756472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004060"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.011921+0000","last_change":"2023-10-14T11:12:21.968131+0000","last_active":"2023-10-14T11:12:27.011921+0000","last_peered":"2023-10-14T11:12:27.011921+0000","last_clean":"2023-10-14T11:12:27.011921+0000","last_became_active":"2023-10-14T11:12:21.967795+0000","last_became_peered":"2023-10-14T11:12:21.967795+0000","last_unstale":"2023-10-14T11:12:27.011921+0000","last_undegraded":"2023-10-14T11:12:27.011921+0000","last_fullsized":"2023-10-14T11:12:27.011921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:40.617646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000703+0000","last_change":"2023-10-14T11:12:22.996026+0000","last_active":"2023-10-14T11:12:27.000703+0000","last_peered":"2023-10-14T11:12:27.000703+0000","last_clean":"2023-10-14T11:12:27.000703+0000","last_became_active":"2023-10-14T11:12:22.995661+0000","last_became_peered":"2023-10-14T11:12:22.995661+0000","last_unstale":"2023-10-14T11:12:27.000703+0000","last_undegraded":"2023-10-14T11:12:27.000703+0000","last_fullsized":"2023-10-14T11:12:27.000703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:38.252309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992306+0000","last_change":"2023-10-14T11:12:27.273682+0000","last_active":"2023-10-14T11:12:27.992306+0000","last_peered":"2023-10-14T11:12:27.992306+0000","last_clean":"2023-10-14T11:12:27.992306+0000","last_became_active":"2023-10-14T11:12:27.273214+0000","last_became_peered":"2023-10-14T11:12:27.273214+0000","last_unstale":"2023-10-14T11:12:27.992306+0000","last_undegraded":"2023-10-14T11:12:27.992306+0000","last_fullsized":"2023-10-14T11:12:27.992306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:47.514617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000801+0000","last_change":"2023-10-14T11:12:21.965767+0000","last_active":"2023-10-14T11:12:27.000801+0000","last_peered":"2023-10-14T11:12:27.000801+0000","last_clean":"2023-10-14T11:12:27.000801+0000","last_became_active":"2023-10-14T11:12:21.963959+0000","last_became_peered":"2023-10-14T11:12:21.963959+0000","last_unstale":"2023-10-14T11:12:27.000801+0000","last_undegraded":"2023-10-14T11:12:27.000801+0000","last_fullsized":"2023-10-14T11:12:27.000801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:40.617646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.011705+0000","last_change":"2023-10-14T11:12:22.985764+0000","last_active":"2023-10-14T11:12:27.011705+0000","last_peered":"2023-10-14T11:12:27.011705+0000","last_clean":"2023-10-14T11:12:27.011705+0000","last_became_active":"2023-10-14T11:12:22.984086+0000","last_became_peered":"2023-10-14T11:12:22.984086+0000","last_unstale":"2023-10-14T11:12:27.011705+0000","last_undegraded":"2023-10-14T11:12:27.011705+0000","last_fullsized":"2023-10-14T11:12:27.011705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:27.066313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.994145+0000","last_change":"2023-10-14T11:12:27.029908+0000","last_active":"2023-10-14T11:12:27.994145+0000","last_peered":"2023-10-14T11:12:27.994145+0000","last_clean":"2023-10-14T11:12:27.994145+0000","last_became_active":"2023-10-14T11:12:27.029420+0000","last_became_peered":"2023-10-14T11:12:27.029420+0000","last_unstale":"2023-10-14T11:12:27.994145+0000","last_undegraded":"2023-10-14T11:12:27.994145+0000","last_fullsized":"2023-10-14T11:12:27.994145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:07.549080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265378+0000","last_change":"2023-10-14T11:12:21.979625+0000","last_active":"2023-10-14T11:12:27.265378+0000","last_peered":"2023-10-14T11:12:27.265378+0000","last_clean":"2023-10-14T11:12:27.265378+0000","last_became_active":"2023-10-14T11:12:21.979220+0000","last_became_peered":"2023-10-14T11:12:21.979220+0000","last_unstale":"2023-10-14T11:12:27.265378+0000","last_undegraded":"2023-10-14T11:12:27.265378+0000","last_fullsized":"2023-10-14T11:12:27.265378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:18.236450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.989996+0000","last_change":"2023-10-14T11:12:22.980954+0000","last_active":"2023-10-14T11:12:26.989996+0000","last_peered":"2023-10-14T11:12:26.989996+0000","last_clean":"2023-10-14T11:12:26.989996+0000","last_became_active":"2023-10-14T11:12:22.980685+0000","last_became_peered":"2023-10-14T11:12:22.980685+0000","last_unstale":"2023-10-14T11:12:26.989996+0000","last_undegraded":"2023-10-14T11:12:26.989996+0000","last_fullsized":"2023-10-14T11:12:26.989996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:24.943192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992649+0000","last_change":"2023-10-14T11:12:27.018281+0000","last_active":"2023-10-14T11:12:27.992649+0000","last_peered":"2023-10-14T11:12:27.992649+0000","last_clean":"2023-10-14T11:12:27.992649+0000","last_became_active":"2023-10-14T11:12:27.017878+0000","last_became_peered":"2023-10-14T11:12:27.017878+0000","last_unstale":"2023-10-14T11:12:27.992649+0000","last_undegraded":"2023-10-14T11:12:27.992649+0000","last_fullsized":"2023-10-14T11:12:27.992649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:18:15.471120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265116+0000","last_change":"2023-10-14T11:12:21.976549+0000","last_active":"2023-10-14T11:12:27.265116+0000","last_peered":"2023-10-14T11:12:27.265116+0000","last_clean":"2023-10-14T11:12:27.265116+0000","last_became_active":"2023-10-14T11:12:21.976164+0000","last_became_peered":"2023-10-14T11:12:21.976164+0000","last_unstale":"2023-10-14T11:12:27.265116+0000","last_undegraded":"2023-10-14T11:12:27.265116+0000","last_fullsized":"2023-10-14T11:12:27.265116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:05.484874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990424+0000","last_change":"2023-10-14T11:12:22.970775+0000","last_active":"2023-10-14T11:12:26.990424+0000","last_peered":"2023-10-14T11:12:26.990424+0000","last_clean":"2023-10-14T11:12:26.990424+0000","last_became_active":"2023-10-14T11:12:22.970331+0000","last_became_peered":"2023-10-14T11:12:22.970331+0000","last_unstale":"2023-10-14T11:12:26.990424+0000","last_undegraded":"2023-10-14T11:12:26.990424+0000","last_fullsized":"2023-10-14T11:12:26.990424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:15.184385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992665+0000","last_change":"2023-10-14T11:12:27.011037+0000","last_active":"2023-10-14T11:12:27.992665+0000","last_peered":"2023-10-14T11:12:27.992665+0000","last_clean":"2023-10-14T11:12:27.992665+0000","last_became_active":"2023-10-14T11:12:27.010126+0000","last_became_peered":"2023-10-14T11:12:27.010126+0000","last_unstale":"2023-10-14T11:12:27.992665+0000","last_undegraded":"2023-10-14T11:12:27.992665+0000","last_fullsized":"2023-10-14T11:12:27.992665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:42.289011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.992180+0000","last_change":"2023-10-14T11:12:22.983577+0000","last_active":"2023-10-14T11:12:26.992180+0000","last_peered":"2023-10-14T11:12:26.992180+0000","last_clean":"2023-10-14T11:12:26.992180+0000","last_became_active":"2023-10-14T11:12:22.982026+0000","last_became_peered":"2023-10-14T11:12:22.982026+0000","last_unstale":"2023-10-14T11:12:26.992180+0000","last_undegraded":"2023-10-14T11:12:26.992180+0000","last_fullsized":"2023-10-14T11:12:26.992180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:06.491915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265315+0000","last_change":"2023-10-14T11:12:21.979924+0000","last_active":"2023-10-14T11:12:27.265315+0000","last_peered":"2023-10-14T11:12:27.265315+0000","last_clean":"2023-10-14T11:12:27.265315+0000","last_became_active":"2023-10-14T11:12:21.979434+0000","last_became_peered":"2023-10-14T11:12:21.979434+0000","last_unstale":"2023-10-14T11:12:27.265315+0000","last_undegraded":"2023-10-14T11:12:27.265315+0000","last_fullsized":"2023-10-14T11:12:27.265315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:31:07.362240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993464+0000","last_change":"2023-10-14T11:12:27.025486+0000","last_active":"2023-10-14T11:12:27.993464+0000","last_peered":"2023-10-14T11:12:27.993464+0000","last_clean":"2023-10-14T11:12:27.993464+0000","last_became_active":"2023-10-14T11:12:27.025086+0000","last_became_peered":"2023-10-14T11:12:27.025086+0000","last_unstale":"2023-10-14T11:12:27.993464+0000","last_undegraded":"2023-10-14T11:12:27.993464+0000","last_fullsized":"2023-10-14T11:12:27.993464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:19.221087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.994599+0000","last_change":"2023-10-14T11:12:22.975476+0000","last_active":"2023-10-14T11:12:26.994599+0000","last_peered":"2023-10-14T11:12:26.994599+0000","last_clean":"2023-10-14T11:12:26.994599+0000","last_became_active":"2023-10-14T11:12:22.975171+0000","last_became_peered":"2023-10-14T11:12:22.975171+0000","last_unstale":"2023-10-14T11:12:26.994599+0000","last_undegraded":"2023-10-14T11:12:26.994599+0000","last_fullsized":"2023-10-14T11:12:26.994599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:18:11.434418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.003734+0000","last_change":"2023-10-14T11:12:21.967707+0000","last_active":"2023-10-14T11:12:27.003734+0000","last_peered":"2023-10-14T11:12:27.003734+0000","last_clean":"2023-10-14T11:12:27.003734+0000","last_became_active":"2023-10-14T11:12:21.967412+0000","last_became_peered":"2023-10-14T11:12:21.967412+0000","last_unstale":"2023-10-14T11:12:27.003734+0000","last_undegraded":"2023-10-14T11:12:27.003734+0000","last_fullsized":"2023-10-14T11:12:27.003734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:11:08.840029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992628+0000","last_change":"2023-10-14T11:12:27.026337+0000","last_active":"2023-10-14T11:12:27.992628+0000","last_peered":"2023-10-14T11:12:27.992628+0000","last_clean":"2023-10-14T11:12:27.992628+0000","last_became_active":"2023-10-14T11:12:27.025956+0000","last_became_peered":"2023-10-14T11:12:27.025956+0000","last_unstale":"2023-10-14T11:12:27.992628+0000","last_undegraded":"2023-10-14T11:12:27.992628+0000","last_fullsized":"2023-10-14T11:12:27.992628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:52:42.055532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.996024+0000","last_change":"2023-10-14T11:12:22.968547+0000","last_active":"2023-10-14T11:12:26.996024+0000","last_peered":"2023-10-14T11:12:26.996024+0000","last_clean":"2023-10-14T11:12:26.996024+0000","last_became_active":"2023-10-14T11:12:22.968263+0000","last_became_peered":"2023-10-14T11:12:22.968263+0000","last_unstale":"2023-10-14T11:12:26.996024+0000","last_undegraded":"2023-10-14T11:12:26.996024+0000","last_fullsized":"2023-10-14T11:12:26.996024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:24:53.742274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000375+0000","last_change":"2023-10-14T11:12:21.975718+0000","last_active":"2023-10-14T11:12:27.000375+0000","last_peered":"2023-10-14T11:12:27.000375+0000","last_clean":"2023-10-14T11:12:27.000375+0000","last_became_active":"2023-10-14T11:12:21.975455+0000","last_became_peered":"2023-10-14T11:12:21.975455+0000","last_unstale":"2023-10-14T11:12:27.000375+0000","last_undegraded":"2023-10-14T11:12:27.000375+0000","last_fullsized":"2023-10-14T11:12:27.000375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:40:43.612359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.053490+0000","last_change":"2023-10-14T11:12:27.271875+0000","last_active":"2023-10-14T11:12:29.053490+0000","last_peered":"2023-10-14T11:12:29.053490+0000","last_clean":"2023-10-14T11:12:29.053490+0000","last_became_active":"2023-10-14T11:12:27.271472+0000","last_became_peered":"2023-10-14T11:12:27.271472+0000","last_unstale":"2023-10-14T11:12:29.053490+0000","last_undegraded":"2023-10-14T11:12:29.053490+0000","last_fullsized":"2023-10-14T11:12:29.053490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:28.979894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.997514+0000","last_change":"2023-10-14T11:12:22.980084+0000","last_active":"2023-10-14T11:12:26.997514+0000","last_peered":"2023-10-14T11:12:26.997514+0000","last_clean":"2023-10-14T11:12:26.997514+0000","last_became_active":"2023-10-14T11:12:22.979078+0000","last_became_peered":"2023-10-14T11:12:22.979078+0000","last_unstale":"2023-10-14T11:12:26.997514+0000","last_undegraded":"2023-10-14T11:12:26.997514+0000","last_fullsized":"2023-10-14T11:12:26.997514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:43:00.534216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264588+0000","last_change":"2023-10-14T11:12:21.975091+0000","last_active":"2023-10-14T11:12:27.264588+0000","last_peered":"2023-10-14T11:12:27.264588+0000","last_clean":"2023-10-14T11:12:27.264588+0000","last_became_active":"2023-10-14T11:12:21.974797+0000","last_became_peered":"2023-10-14T11:12:21.974797+0000","last_unstale":"2023-10-14T11:12:27.264588+0000","last_undegraded":"2023-10-14T11:12:27.264588+0000","last_fullsized":"2023-10-14T11:12:27.264588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:37.017137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993949+0000","last_change":"2023-10-14T11:12:27.025785+0000","last_active":"2023-10-14T11:12:27.993949+0000","last_peered":"2023-10-14T11:12:27.993949+0000","last_clean":"2023-10-14T11:12:27.993949+0000","last_became_active":"2023-10-14T11:12:27.025299+0000","last_became_peered":"2023-10-14T11:12:27.025299+0000","last_unstale":"2023-10-14T11:12:27.993949+0000","last_undegraded":"2023-10-14T11:12:27.993949+0000","last_fullsized":"2023-10-14T11:12:27.993949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:58.469102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.011387+0000","last_change":"2023-10-14T11:12:22.982412+0000","last_active":"2023-10-14T11:12:27.011387+0000","last_peered":"2023-10-14T11:12:27.011387+0000","last_clean":"2023-10-14T11:12:27.011387+0000","last_became_active":"2023-10-14T11:12:22.981232+0000","last_became_peered":"2023-10-14T11:12:22.981232+0000","last_unstale":"2023-10-14T11:12:27.011387+0000","last_undegraded":"2023-10-14T11:12:27.011387+0000","last_fullsized":"2023-10-14T11:12:27.011387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:19.243490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.992495+0000","last_change":"2023-10-14T11:12:21.979890+0000","last_active":"2023-10-14T11:12:26.992495+0000","last_peered":"2023-10-14T11:12:26.992495+0000","last_clean":"2023-10-14T11:12:26.992495+0000","last_became_active":"2023-10-14T11:12:21.979626+0000","last_became_peered":"2023-10-14T11:12:21.979626+0000","last_unstale":"2023-10-14T11:12:26.992495+0000","last_undegraded":"2023-10-14T11:12:26.992495+0000","last_fullsized":"2023-10-14T11:12:26.992495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:33.347794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993164+0000","last_change":"2023-10-14T11:12:27.274768+0000","last_active":"2023-10-14T11:12:27.993164+0000","last_peered":"2023-10-14T11:12:27.993164+0000","last_clean":"2023-10-14T11:12:27.993164+0000","last_became_active":"2023-10-14T11:12:27.274146+0000","last_became_peered":"2023-10-14T11:12:27.274146+0000","last_unstale":"2023-10-14T11:12:27.993164+0000","last_undegraded":"2023-10-14T11:12:27.993164+0000","last_fullsized":"2023-10-14T11:12:27.993164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:23.589522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000910+0000","last_change":"2023-10-14T11:12:22.985137+0000","last_active":"2023-10-14T11:12:27.000910+0000","last_peered":"2023-10-14T11:12:27.000910+0000","last_clean":"2023-10-14T11:12:27.000910+0000","last_became_active":"2023-10-14T11:12:22.984832+0000","last_became_peered":"2023-10-14T11:12:22.984832+0000","last_unstale":"2023-10-14T11:12:27.000910+0000","last_undegraded":"2023-10-14T11:12:27.000910+0000","last_fullsized":"2023-10-14T11:12:27.000910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:46.533477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.013073+0000","last_change":"2023-10-14T11:12:21.973653+0000","last_active":"2023-10-14T11:12:27.013073+0000","last_peered":"2023-10-14T11:12:27.013073+0000","last_clean":"2023-10-14T11:12:27.013073+0000","last_became_active":"2023-10-14T11:12:21.973384+0000","last_became_peered":"2023-10-14T11:12:21.973384+0000","last_unstale":"2023-10-14T11:12:27.013073+0000","last_undegraded":"2023-10-14T11:12:27.013073+0000","last_fullsized":"2023-10-14T11:12:27.013073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:31:07.362240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992214+0000","last_change":"2023-10-14T11:12:27.274360+0000","last_active":"2023-10-14T11:12:27.992214+0000","last_peered":"2023-10-14T11:12:27.992214+0000","last_clean":"2023-10-14T11:12:27.992214+0000","last_became_active":"2023-10-14T11:12:27.273104+0000","last_became_peered":"2023-10-14T11:12:27.273104+0000","last_unstale":"2023-10-14T11:12:27.992214+0000","last_undegraded":"2023-10-14T11:12:27.992214+0000","last_fullsized":"2023-10-14T11:12:27.992214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:23:51.698322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.013376+0000","last_change":"2023-10-14T11:12:22.973372+0000","last_active":"2023-10-14T11:12:27.013376+0000","last_peered":"2023-10-14T11:12:27.013376+0000","last_clean":"2023-10-14T11:12:27.013376+0000","last_became_active":"2023-10-14T11:12:22.973009+0000","last_became_peered":"2023-10-14T11:12:22.973009+0000","last_unstale":"2023-10-14T11:12:27.013376+0000","last_undegraded":"2023-10-14T11:12:27.013376+0000","last_fullsized":"2023-10-14T11:12:27.013376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:19.243490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265475+0000","last_change":"2023-10-14T11:12:21.975624+0000","last_active":"2023-10-14T11:12:27.265475+0000","last_peered":"2023-10-14T11:12:27.265475+0000","last_clean":"2023-10-14T11:12:27.265475+0000","last_became_active":"2023-10-14T11:12:21.975359+0000","last_became_peered":"2023-10-14T11:12:21.975359+0000","last_unstale":"2023-10-14T11:12:27.265475+0000","last_undegraded":"2023-10-14T11:12:27.265475+0000","last_fullsized":"2023-10-14T11:12:27.265475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:24:52.735234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.387618+0000","last_change":"2023-10-14T11:12:27.272156+0000","last_active":"2023-10-14T11:12:28.387618+0000","last_peered":"2023-10-14T11:12:28.387618+0000","last_clean":"2023-10-14T11:12:28.387618+0000","last_became_active":"2023-10-14T11:12:27.271460+0000","last_became_peered":"2023-10-14T11:12:27.271460+0000","last_unstale":"2023-10-14T11:12:28.387618+0000","last_undegraded":"2023-10-14T11:12:28.387618+0000","last_fullsized":"2023-10-14T11:12:28.387618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:23.589522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990518+0000","last_change":"2023-10-14T11:12:22.970602+0000","last_active":"2023-10-14T11:12:26.990518+0000","last_peered":"2023-10-14T11:12:26.990518+0000","last_clean":"2023-10-14T11:12:26.990518+0000","last_became_active":"2023-10-14T11:12:22.969961+0000","last_became_peered":"2023-10-14T11:12:22.969961+0000","last_unstale":"2023-10-14T11:12:26.990518+0000","last_undegraded":"2023-10-14T11:12:26.990518+0000","last_fullsized":"2023-10-14T11:12:26.990518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:03.512378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.013519+0000","last_change":"2023-10-14T11:12:21.972694+0000","last_active":"2023-10-14T11:12:27.013519+0000","last_peered":"2023-10-14T11:12:27.013519+0000","last_clean":"2023-10-14T11:12:27.013519+0000","last_became_active":"2023-10-14T11:12:21.972386+0000","last_became_peered":"2023-10-14T11:12:21.972386+0000","last_unstale":"2023-10-14T11:12:27.013519+0000","last_undegraded":"2023-10-14T11:12:27.013519+0000","last_fullsized":"2023-10-14T11:12:27.013519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:40.617646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.052804+0000","last_change":"2023-10-14T11:12:27.019652+0000","last_active":"2023-10-14T11:12:29.052804+0000","last_peered":"2023-10-14T11:12:29.052804+0000","last_clean":"2023-10-14T11:12:29.052804+0000","last_became_active":"2023-10-14T11:12:27.019232+0000","last_became_peered":"2023-10-14T11:12:27.019232+0000","last_unstale":"2023-10-14T11:12:29.052804+0000","last_undegraded":"2023-10-14T11:12:29.052804+0000","last_fullsized":"2023-10-14T11:12:29.052804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:23.589522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.999351+0000","last_change":"2023-10-14T11:12:22.973223+0000","last_active":"2023-10-14T11:12:26.999351+0000","last_peered":"2023-10-14T11:12:26.999351+0000","last_clean":"2023-10-14T11:12:26.999351+0000","last_became_active":"2023-10-14T11:12:22.972863+0000","last_became_peered":"2023-10-14T11:12:22.972863+0000","last_unstale":"2023-10-14T11:12:26.999351+0000","last_undegraded":"2023-10-14T11:12:26.999351+0000","last_fullsized":"2023-10-14T11:12:26.999351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:41.624687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.989010+0000","last_change":"2023-10-14T11:12:21.972184+0000","last_active":"2023-10-14T11:12:26.989010+0000","last_peered":"2023-10-14T11:12:26.989010+0000","last_clean":"2023-10-14T11:12:26.989010+0000","last_became_active":"2023-10-14T11:12:21.968811+0000","last_became_peered":"2023-10-14T11:12:21.968811+0000","last_unstale":"2023-10-14T11:12:26.989010+0000","last_undegraded":"2023-10-14T11:12:26.989010+0000","last_fullsized":"2023-10-14T11:12:26.989010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:24:52.735234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.053250+0000","last_change":"2023-10-14T11:12:27.018825+0000","last_active":"2023-10-14T11:12:29.053250+0000","last_peered":"2023-10-14T11:12:29.053250+0000","last_clean":"2023-10-14T11:12:29.053250+0000","last_became_active":"2023-10-14T11:12:27.018145+0000","last_became_peered":"2023-10-14T11:12:27.018145+0000","last_unstale":"2023-10-14T11:12:29.053250+0000","last_undegraded":"2023-10-14T11:12:29.053250+0000","last_fullsized":"2023-10-14T11:12:29.053250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:58.469102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.994330+0000","last_change":"2023-10-14T11:12:22.973626+0000","last_active":"2023-10-14T11:12:26.994330+0000","last_peered":"2023-10-14T11:12:26.994330+0000","last_clean":"2023-10-14T11:12:26.994330+0000","last_became_active":"2023-10-14T11:12:22.973107+0000","last_became_peered":"2023-10-14T11:12:22.973107+0000","last_unstale":"2023-10-14T11:12:26.994330+0000","last_undegraded":"2023-10-14T11:12:26.994330+0000","last_fullsized":"2023-10-14T11:12:26.994330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:07:23.864178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988809+0000","last_change":"2023-10-14T11:12:21.977761+0000","last_active":"2023-10-14T11:12:26.988809+0000","last_peered":"2023-10-14T11:12:26.988809+0000","last_clean":"2023-10-14T11:12:26.988809+0000","last_became_active":"2023-10-14T11:12:21.976298+0000","last_became_peered":"2023-10-14T11:12:21.976298+0000","last_unstale":"2023-10-14T11:12:26.988809+0000","last_undegraded":"2023-10-14T11:12:26.988809+0000","last_fullsized":"2023-10-14T11:12:26.988809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:44:17.928096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.053501+0000","last_change":"2023-10-14T11:12:27.024825+0000","last_active":"2023-10-14T11:12:29.053501+0000","last_peered":"2023-10-14T11:12:29.053501+0000","last_clean":"2023-10-14T11:12:29.053501+0000","last_became_active":"2023-10-14T11:12:27.024317+0000","last_became_peered":"2023-10-14T11:12:27.024317+0000","last_unstale":"2023-10-14T11:12:29.053501+0000","last_undegraded":"2023-10-14T11:12:29.053501+0000","last_fullsized":"2023-10-14T11:12:29.053501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:07.549080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.995557+0000","last_change":"2023-10-14T11:12:22.992830+0000","last_active":"2023-10-14T11:12:26.995557+0000","last_peered":"2023-10-14T11:12:26.995557+0000","last_clean":"2023-10-14T11:12:26.995557+0000","last_became_active":"2023-10-14T11:12:22.992514+0000","last_became_peered":"2023-10-14T11:12:22.992514+0000","last_unstale":"2023-10-14T11:12:26.995557+0000","last_undegraded":"2023-10-14T11:12:26.995557+0000","last_fullsized":"2023-10-14T11:12:26.995557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:02.330265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264602+0000","last_change":"2023-10-14T11:12:21.980791+0000","last_active":"2023-10-14T11:12:27.264602+0000","last_peered":"2023-10-14T11:12:27.264602+0000","last_clean":"2023-10-14T11:12:27.264602+0000","last_became_active":"2023-10-14T11:12:21.980499+0000","last_became_peered":"2023-10-14T11:12:21.980499+0000","last_unstale":"2023-10-14T11:12:27.264602+0000","last_undegraded":"2023-10-14T11:12:27.264602+0000","last_fullsized":"2023-10-14T11:12:27.264602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:01.323224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.387968+0000","last_change":"2023-10-14T11:12:27.273604+0000","last_active":"2023-10-14T11:12:28.387968+0000","last_peered":"2023-10-14T11:12:28.387968+0000","last_clean":"2023-10-14T11:12:28.387968+0000","last_became_active":"2023-10-14T11:12:27.273160+0000","last_became_peered":"2023-10-14T11:12:27.273160+0000","last_unstale":"2023-10-14T11:12:28.387968+0000","last_undegraded":"2023-10-14T11:12:28.387968+0000","last_fullsized":"2023-10-14T11:12:28.387968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:28.979894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.999882+0000","last_change":"2023-10-14T11:12:22.983334+0000","last_active":"2023-10-14T11:12:26.999882+0000","last_peered":"2023-10-14T11:12:26.999882+0000","last_clean":"2023-10-14T11:12:26.999882+0000","last_became_active":"2023-10-14T11:12:22.981836+0000","last_became_peered":"2023-10-14T11:12:22.981836+0000","last_unstale":"2023-10-14T11:12:26.999882+0000","last_undegraded":"2023-10-14T11:12:26.999882+0000","last_fullsized":"2023-10-14T11:12:26.999882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:17.701734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988703+0000","last_change":"2023-10-14T11:12:21.968246+0000","last_active":"2023-10-14T11:12:26.988703+0000","last_peered":"2023-10-14T11:12:26.988703+0000","last_clean":"2023-10-14T11:12:26.988703+0000","last_became_active":"2023-10-14T11:12:21.967758+0000","last_became_peered":"2023-10-14T11:12:21.967758+0000","last_unstale":"2023-10-14T11:12:26.988703+0000","last_undegraded":"2023-10-14T11:12:26.988703+0000","last_fullsized":"2023-10-14T11:12:26.988703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:23.226723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264683+0000","last_change":"2023-10-14T11:12:12.162289+0000","last_active":"2023-10-14T11:12:27.264683+0000","last_peered":"2023-10-14T11:12:27.264683+0000","last_clean":"2023-10-14T11:12:27.264683+0000","last_became_active":"2023-10-14T11:12:12.161055+0000","last_became_peered":"2023-10-14T11:12:12.161055+0000","last_unstale":"2023-10-14T11:12:27.264683+0000","last_undegraded":"2023-10-14T11:12:27.264683+0000","last_fullsized":"2023-10-14T11:12:27.264683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_clean_scrub_stamp":"2023-10-14T11:12:10.853576+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:52.154107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.051902+0000","last_change":"2023-10-14T11:12:27.270500+0000","last_active":"2023-10-14T11:12:29.051902+0000","last_peered":"2023-10-14T11:12:29.051902+0000","last_clean":"2023-10-14T11:12:29.051902+0000","last_became_active":"2023-10-14T11:12:27.270051+0000","last_became_peered":"2023-10-14T11:12:27.270051+0000","last_unstale":"2023-10-14T11:12:29.051902+0000","last_undegraded":"2023-10-14T11:12:29.051902+0000","last_fullsized":"2023-10-14T11:12:29.051902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:19.221087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265306+0000","last_change":"2023-10-14T11:12:22.987192+0000","last_active":"2023-10-14T11:12:27.265306+0000","last_peered":"2023-10-14T11:12:27.265306+0000","last_clean":"2023-10-14T11:12:27.265306+0000","last_became_active":"2023-10-14T11:12:22.986270+0000","last_became_peered":"2023-10-14T11:12:22.986270+0000","last_unstale":"2023-10-14T11:12:27.265306+0000","last_undegraded":"2023-10-14T11:12:27.265306+0000","last_fullsized":"2023-10-14T11:12:27.265306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:03.512378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988910+0000","last_change":"2023-10-14T11:12:21.977756+0000","last_active":"2023-10-14T11:12:26.988910+0000","last_peered":"2023-10-14T11:12:26.988910+0000","last_clean":"2023-10-14T11:12:26.988910+0000","last_became_active":"2023-10-14T11:12:21.976702+0000","last_became_peered":"2023-10-14T11:12:21.976702+0000","last_unstale":"2023-10-14T11:12:26.988910+0000","last_undegraded":"2023-10-14T11:12:26.988910+0000","last_fullsized":"2023-10-14T11:12:26.988910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:51.562205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.051590+0000","last_change":"2023-10-14T11:12:27.266768+0000","last_active":"2023-10-14T11:12:29.051590+0000","last_peered":"2023-10-14T11:12:29.051590+0000","last_clean":"2023-10-14T11:12:29.051590+0000","last_became_active":"2023-10-14T11:12:27.266293+0000","last_became_peered":"2023-10-14T11:12:27.266293+0000","last_unstale":"2023-10-14T11:12:29.051590+0000","last_undegraded":"2023-10-14T11:12:29.051590+0000","last_fullsized":"2023-10-14T11:12:29.051590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:23.589522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990099+0000","last_change":"2023-10-14T11:12:22.971787+0000","last_active":"2023-10-14T11:12:26.990099+0000","last_peered":"2023-10-14T11:12:26.990099+0000","last_clean":"2023-10-14T11:12:26.990099+0000","last_became_active":"2023-10-14T11:12:22.971485+0000","last_became_peered":"2023-10-14T11:12:22.971485+0000","last_unstale":"2023-10-14T11:12:26.990099+0000","last_undegraded":"2023-10-14T11:12:26.990099+0000","last_fullsized":"2023-10-14T11:12:26.990099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:32.409154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010620+0000","last_change":"2023-10-14T11:12:21.980821+0000","last_active":"2023-10-14T11:12:27.010620+0000","last_peered":"2023-10-14T11:12:27.010620+0000","last_clean":"2023-10-14T11:12:27.010620+0000","last_became_active":"2023-10-14T11:12:21.980483+0000","last_became_peered":"2023-10-14T11:12:21.980483+0000","last_unstale":"2023-10-14T11:12:27.010620+0000","last_undegraded":"2023-10-14T11:12:27.010620+0000","last_fullsized":"2023-10-14T11:12:27.010620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:37.017137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.387892+0000","last_change":"2023-10-14T11:12:27.026598+0000","last_active":"2023-10-14T11:12:28.387892+0000","last_peered":"2023-10-14T11:12:28.387892+0000","last_clean":"2023-10-14T11:12:28.387892+0000","last_became_active":"2023-10-14T11:12:27.026041+0000","last_became_peered":"2023-10-14T11:12:27.026041+0000","last_unstale":"2023-10-14T11:12:28.387892+0000","last_undegraded":"2023-10-14T11:12:28.387892+0000","last_fullsized":"2023-10-14T11:12:28.387892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:07.549080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265979+0000","last_change":"2023-10-14T11:12:22.999134+0000","last_active":"2023-10-14T11:12:27.265979+0000","last_peered":"2023-10-14T11:12:27.265979+0000","last_clean":"2023-10-14T11:12:27.265979+0000","last_became_active":"2023-10-14T11:12:22.998882+0000","last_became_peered":"2023-10-14T11:12:22.998882+0000","last_unstale":"2023-10-14T11:12:27.265979+0000","last_undegraded":"2023-10-14T11:12:27.265979+0000","last_fullsized":"2023-10-14T11:12:27.265979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:48:29.403505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988956+0000","last_change":"2023-10-14T11:12:21.975400+0000","last_active":"2023-10-14T11:12:26.988956+0000","last_peered":"2023-10-14T11:12:26.988956+0000","last_clean":"2023-10-14T11:12:26.988956+0000","last_became_active":"2023-10-14T11:12:21.974763+0000","last_became_peered":"2023-10-14T11:12:21.974763+0000","last_unstale":"2023-10-14T11:12:26.988956+0000","last_undegraded":"2023-10-14T11:12:26.988956+0000","last_fullsized":"2023-10-14T11:12:26.988956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:10:00.086669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.991862+0000","last_change":"2023-10-14T11:12:27.270370+0000","last_active":"2023-10-14T11:12:27.991862+0000","last_peered":"2023-10-14T11:12:27.991862+0000","last_clean":"2023-10-14T11:12:27.991862+0000","last_became_active":"2023-10-14T11:12:27.269897+0000","last_became_peered":"2023-10-14T11:12:27.269897+0000","last_unstale":"2023-10-14T11:12:27.991862+0000","last_undegraded":"2023-10-14T11:12:27.991862+0000","last_fullsized":"2023-10-14T11:12:27.991862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:47.514617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265595+0000","last_change":"2023-10-14T11:12:22.999066+0000","last_active":"2023-10-14T11:12:27.265595+0000","last_peered":"2023-10-14T11:12:27.265595+0000","last_clean":"2023-10-14T11:12:27.265595+0000","last_became_active":"2023-10-14T11:12:22.998776+0000","last_became_peered":"2023-10-14T11:12:22.998776+0000","last_unstale":"2023-10-14T11:12:27.265595+0000","last_undegraded":"2023-10-14T11:12:27.265595+0000","last_fullsized":"2023-10-14T11:12:27.265595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:24.943192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.001153+0000","last_change":"2023-10-14T11:12:21.964558+0000","last_active":"2023-10-14T11:12:27.001153+0000","last_peered":"2023-10-14T11:12:27.001153+0000","last_clean":"2023-10-14T11:12:27.001153+0000","last_became_active":"2023-10-14T11:12:21.964064+0000","last_became_peered":"2023-10-14T11:12:21.964064+0000","last_unstale":"2023-10-14T11:12:27.001153+0000","last_undegraded":"2023-10-14T11:12:27.001153+0000","last_fullsized":"2023-10-14T11:12:27.001153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:10:00.086669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992867+0000","last_change":"2023-10-14T11:12:27.018556+0000","last_active":"2023-10-14T11:12:27.992867+0000","last_peered":"2023-10-14T11:12:27.992867+0000","last_clean":"2023-10-14T11:12:27.992867+0000","last_became_active":"2023-10-14T11:12:27.017714+0000","last_became_peered":"2023-10-14T11:12:27.017714+0000","last_unstale":"2023-10-14T11:12:27.992867+0000","last_undegraded":"2023-10-14T11:12:27.992867+0000","last_fullsized":"2023-10-14T11:12:27.992867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:23.718575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264735+0000","last_change":"2023-10-14T11:12:22.994290+0000","last_active":"2023-10-14T11:12:27.264735+0000","last_peered":"2023-10-14T11:12:27.264735+0000","last_clean":"2023-10-14T11:12:27.264735+0000","last_became_active":"2023-10-14T11:12:22.993935+0000","last_became_peered":"2023-10-14T11:12:22.993935+0000","last_unstale":"2023-10-14T11:12:27.264735+0000","last_undegraded":"2023-10-14T11:12:27.264735+0000","last_fullsized":"2023-10-14T11:12:27.264735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:54.432400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988665+0000","last_change":"2023-10-14T11:12:21.976195+0000","last_active":"2023-10-14T11:12:26.988665+0000","last_peered":"2023-10-14T11:12:26.988665+0000","last_clean":"2023-10-14T11:12:26.988665+0000","last_became_active":"2023-10-14T11:12:21.975885+0000","last_became_peered":"2023-10-14T11:12:21.975885+0000","last_unstale":"2023-10-14T11:12:26.988665+0000","last_undegraded":"2023-10-14T11:12:26.988665+0000","last_fullsized":"2023-10-14T11:12:26.988665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:11:08.840029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.387881+0000","last_change":"2023-10-14T11:12:27.016759+0000","last_active":"2023-10-14T11:12:28.387881+0000","last_peered":"2023-10-14T11:12:28.387881+0000","last_clean":"2023-10-14T11:12:28.387881+0000","last_became_active":"2023-10-14T11:12:27.016334+0000","last_became_peered":"2023-10-14T11:12:27.016334+0000","last_unstale":"2023-10-14T11:12:28.387881+0000","last_undegraded":"2023-10-14T11:12:28.387881+0000","last_fullsized":"2023-10-14T11:12:28.387881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:58.469102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990942+0000","last_change":"2023-10-14T11:12:22.972397+0000","last_active":"2023-10-14T11:12:26.990942+0000","last_peered":"2023-10-14T11:12:26.990942+0000","last_clean":"2023-10-14T11:12:26.990942+0000","last_became_active":"2023-10-14T11:12:22.972093+0000","last_became_peered":"2023-10-14T11:12:22.972093+0000","last_unstale":"2023-10-14T11:12:26.990942+0000","last_undegraded":"2023-10-14T11:12:26.990942+0000","last_fullsized":"2023-10-14T11:12:26.990942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:27.066313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.991065+0000","last_change":"2023-10-14T11:12:21.976321+0000","last_active":"2023-10-14T11:12:26.991065+0000","last_peered":"2023-10-14T11:12:26.991065+0000","last_clean":"2023-10-14T11:12:26.991065+0000","last_became_active":"2023-10-14T11:12:21.975848+0000","last_became_peered":"2023-10-14T11:12:21.975848+0000","last_unstale":"2023-10-14T11:12:26.991065+0000","last_undegraded":"2023-10-14T11:12:26.991065+0000","last_fullsized":"2023-10-14T11:12:26.991065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:31:07.362240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993559+0000","last_change":"2023-10-14T11:12:27.271736+0000","last_active":"2023-10-14T11:12:27.993559+0000","last_peered":"2023-10-14T11:12:27.993559+0000","last_clean":"2023-10-14T11:12:27.993559+0000","last_became_active":"2023-10-14T11:12:27.271274+0000","last_became_peered":"2023-10-14T11:12:27.271274+0000","last_unstale":"2023-10-14T11:12:27.993559+0000","last_undegraded":"2023-10-14T11:12:27.993559+0000","last_fullsized":"2023-10-14T11:12:27.993559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:34.380738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265050+0000","last_change":"2023-10-14T11:12:22.995743+0000","last_active":"2023-10-14T11:12:27.265050+0000","last_peered":"2023-10-14T11:12:27.265050+0000","last_clean":"2023-10-14T11:12:27.265050+0000","last_became_active":"2023-10-14T11:12:22.995464+0000","last_became_peered":"2023-10-14T11:12:22.995464+0000","last_unstale":"2023-10-14T11:12:27.265050+0000","last_undegraded":"2023-10-14T11:12:27.265050+0000","last_fullsized":"2023-10-14T11:12:27.265050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:19.552820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988900+0000","last_change":"2023-10-14T11:12:21.976206+0000","last_active":"2023-10-14T11:12:26.988900+0000","last_peered":"2023-10-14T11:12:26.988900+0000","last_clean":"2023-10-14T11:12:26.988900+0000","last_became_active":"2023-10-14T11:12:21.975934+0000","last_became_peered":"2023-10-14T11:12:21.975934+0000","last_unstale":"2023-10-14T11:12:26.988900+0000","last_undegraded":"2023-10-14T11:12:26.988900+0000","last_fullsized":"2023-10-14T11:12:26.988900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:16.694694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993189+0000","last_change":"2023-10-14T11:12:27.268251+0000","last_active":"2023-10-14T11:12:27.993189+0000","last_peered":"2023-10-14T11:12:27.993189+0000","last_clean":"2023-10-14T11:12:27.993189+0000","last_became_active":"2023-10-14T11:12:27.267788+0000","last_became_peered":"2023-10-14T11:12:27.267788+0000","last_unstale":"2023-10-14T11:12:27.993189+0000","last_undegraded":"2023-10-14T11:12:27.993189+0000","last_fullsized":"2023-10-14T11:12:27.993189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:00:07.198517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.007533+0000","last_change":"2023-10-14T11:12:22.987370+0000","last_active":"2023-10-14T11:12:27.007533+0000","last_peered":"2023-10-14T11:12:27.007533+0000","last_clean":"2023-10-14T11:12:27.007533+0000","last_became_active":"2023-10-14T11:12:22.987096+0000","last_became_peered":"2023-10-14T11:12:22.987096+0000","last_unstale":"2023-10-14T11:12:27.007533+0000","last_undegraded":"2023-10-14T11:12:27.007533+0000","last_fullsized":"2023-10-14T11:12:27.007533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:34.354835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010769+0000","last_change":"2023-10-14T11:12:21.964329+0000","last_active":"2023-10-14T11:12:27.010769+0000","last_peered":"2023-10-14T11:12:27.010769+0000","last_clean":"2023-10-14T11:12:27.010769+0000","last_became_active":"2023-10-14T11:12:21.963491+0000","last_became_peered":"2023-10-14T11:12:21.963491+0000","last_unstale":"2023-10-14T11:12:27.010769+0000","last_undegraded":"2023-10-14T11:12:27.010769+0000","last_fullsized":"2023-10-14T11:12:27.010769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:37.017137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993765+0000","last_change":"2023-10-14T11:12:27.267716+0000","last_active":"2023-10-14T11:12:27.993765+0000","last_peered":"2023-10-14T11:12:27.993765+0000","last_clean":"2023-10-14T11:12:27.993765+0000","last_became_active":"2023-10-14T11:12:27.267311+0000","last_became_peered":"2023-10-14T11:12:27.267311+0000","last_unstale":"2023-10-14T11:12:27.993765+0000","last_undegraded":"2023-10-14T11:12:27.993765+0000","last_fullsized":"2023-10-14T11:12:27.993765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:19:12.033636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265215+0000","last_change":"2023-10-14T11:12:22.987373+0000","last_active":"2023-10-14T11:12:27.265215+0000","last_peered":"2023-10-14T11:12:27.265215+0000","last_clean":"2023-10-14T11:12:27.265215+0000","last_became_active":"2023-10-14T11:12:22.986837+0000","last_became_peered":"2023-10-14T11:12:22.986837+0000","last_unstale":"2023-10-14T11:12:27.265215+0000","last_undegraded":"2023-10-14T11:12:27.265215+0000","last_fullsized":"2023-10-14T11:12:27.265215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:15.184385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:38.498227+0000","last_change":"2023-10-14T11:12:21.976712+0000","last_active":"2023-10-14T11:12:38.498227+0000","last_peered":"2023-10-14T11:12:38.498227+0000","last_clean":"2023-10-14T11:12:38.498227+0000","last_became_active":"2023-10-14T11:12:21.975439+0000","last_became_peered":"2023-10-14T11:12:21.975439+0000","last_unstale":"2023-10-14T11:12:38.498227+0000","last_undegraded":"2023-10-14T11:12:38.498227+0000","last_fullsized":"2023-10-14T11:12:38.498227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:37.017137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.052976+0000","last_change":"2023-10-14T11:12:27.018600+0000","last_active":"2023-10-14T11:12:29.052976+0000","last_peered":"2023-10-14T11:12:29.052976+0000","last_clean":"2023-10-14T11:12:29.052976+0000","last_became_active":"2023-10-14T11:12:27.018091+0000","last_became_peered":"2023-10-14T11:12:27.018091+0000","last_unstale":"2023-10-14T11:12:29.052976+0000","last_undegraded":"2023-10-14T11:12:29.052976+0000","last_fullsized":"2023-10-14T11:12:29.052976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:19.221087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.999245+0000","last_change":"2023-10-14T11:12:22.989506+0000","last_active":"2023-10-14T11:12:26.999245+0000","last_peered":"2023-10-14T11:12:26.999245+0000","last_clean":"2023-10-14T11:12:26.999245+0000","last_became_active":"2023-10-14T11:12:22.989177+0000","last_became_peered":"2023-10-14T11:12:22.989177+0000","last_unstale":"2023-10-14T11:12:26.999245+0000","last_undegraded":"2023-10-14T11:12:26.999245+0000","last_fullsized":"2023-10-14T11:12:26.999245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:02.330265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010526+0000","last_change":"2023-10-14T11:12:21.980802+0000","last_active":"2023-10-14T11:12:27.010526+0000","last_peered":"2023-10-14T11:12:27.010526+0000","last_clean":"2023-10-14T11:12:27.010526+0000","last_became_active":"2023-10-14T11:12:21.980604+0000","last_became_peered":"2023-10-14T11:12:21.980604+0000","last_unstale":"2023-10-14T11:12:27.010526+0000","last_undegraded":"2023-10-14T11:12:27.010526+0000","last_fullsized":"2023-10-14T11:12:27.010526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:01.323224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992999+0000","last_change":"2023-10-14T11:12:27.018243+0000","last_active":"2023-10-14T11:12:27.992999+0000","last_peered":"2023-10-14T11:12:27.992999+0000","last_clean":"2023-10-14T11:12:27.992999+0000","last_became_active":"2023-10-14T11:12:27.017731+0000","last_became_peered":"2023-10-14T11:12:27.017731+0000","last_unstale":"2023-10-14T11:12:27.992999+0000","last_undegraded":"2023-10-14T11:12:27.992999+0000","last_fullsized":"2023-10-14T11:12:27.992999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:50.570179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.011824+0000","last_change":"2023-10-14T11:12:22.985657+0000","last_active":"2023-10-14T11:12:27.011824+0000","last_peered":"2023-10-14T11:12:27.011824+0000","last_clean":"2023-10-14T11:12:27.011824+0000","last_became_active":"2023-10-14T11:12:22.984323+0000","last_became_peered":"2023-10-14T11:12:22.984323+0000","last_unstale":"2023-10-14T11:12:27.011824+0000","last_undegraded":"2023-10-14T11:12:27.011824+0000","last_fullsized":"2023-10-14T11:12:27.011824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:17.701734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990340+0000","last_change":"2023-10-14T11:12:21.973531+0000","last_active":"2023-10-14T11:12:26.990340+0000","last_peered":"2023-10-14T11:12:26.990340+0000","last_clean":"2023-10-14T11:12:26.990340+0000","last_became_active":"2023-10-14T11:12:21.973256+0000","last_became_peered":"2023-10-14T11:12:21.973256+0000","last_unstale":"2023-10-14T11:12:26.990340+0000","last_undegraded":"2023-10-14T11:12:26.990340+0000","last_fullsized":"2023-10-14T11:12:26.990340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:18.236450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992367+0000","last_change":"2023-10-14T11:12:27.027134+0000","last_active":"2023-10-14T11:12:27.992367+0000","last_peered":"2023-10-14T11:12:27.992367+0000","last_clean":"2023-10-14T11:12:27.992367+0000","last_became_active":"2023-10-14T11:12:27.026437+0000","last_became_peered":"2023-10-14T11:12:27.026437+0000","last_unstale":"2023-10-14T11:12:27.992367+0000","last_undegraded":"2023-10-14T11:12:27.992367+0000","last_fullsized":"2023-10-14T11:12:27.992367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:19:12.033636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990233+0000","last_change":"2023-10-14T11:12:22.993432+0000","last_active":"2023-10-14T11:12:26.990233+0000","last_peered":"2023-10-14T11:12:26.990233+0000","last_clean":"2023-10-14T11:12:26.990233+0000","last_became_active":"2023-10-14T11:12:22.993082+0000","last_became_peered":"2023-10-14T11:12:22.993082+0000","last_unstale":"2023-10-14T11:12:26.990233+0000","last_undegraded":"2023-10-14T11:12:26.990233+0000","last_fullsized":"2023-10-14T11:12:26.990233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:42:19.552820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.992391+0000","last_change":"2023-10-14T11:12:21.982821+0000","last_active":"2023-10-14T11:12:26.992391+0000","last_peered":"2023-10-14T11:12:26.992391+0000","last_clean":"2023-10-14T11:12:26.992391+0000","last_became_active":"2023-10-14T11:12:21.982328+0000","last_became_peered":"2023-10-14T11:12:21.982328+0000","last_unstale":"2023-10-14T11:12:26.992391+0000","last_undegraded":"2023-10-14T11:12:26.992391+0000","last_fullsized":"2023-10-14T11:12:26.992391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:40:43.612359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.992497+0000","last_change":"2023-10-14T11:12:27.268498+0000","last_active":"2023-10-14T11:12:27.992497+0000","last_peered":"2023-10-14T11:12:27.992497+0000","last_clean":"2023-10-14T11:12:27.992497+0000","last_became_active":"2023-10-14T11:12:27.267751+0000","last_became_peered":"2023-10-14T11:12:27.267751+0000","last_unstale":"2023-10-14T11:12:27.992497+0000","last_undegraded":"2023-10-14T11:12:27.992497+0000","last_fullsized":"2023-10-14T11:12:27.992497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:53.991279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.387797+0000","last_change":"2023-10-14T11:12:27.274997+0000","last_active":"2023-10-14T11:12:28.387797+0000","last_peered":"2023-10-14T11:12:28.387797+0000","last_clean":"2023-10-14T11:12:28.387797+0000","last_became_active":"2023-10-14T11:12:27.273447+0000","last_became_peered":"2023-10-14T11:12:27.273447+0000","last_unstale":"2023-10-14T11:12:28.387797+0000","last_undegraded":"2023-10-14T11:12:28.387797+0000","last_fullsized":"2023-10-14T11:12:28.387797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:19.221087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000217+0000","last_change":"2023-10-14T11:12:22.965644+0000","last_active":"2023-10-14T11:12:27.000217+0000","last_peered":"2023-10-14T11:12:27.000217+0000","last_clean":"2023-10-14T11:12:27.000217+0000","last_became_active":"2023-10-14T11:12:22.965113+0000","last_became_peered":"2023-10-14T11:12:22.965113+0000","last_unstale":"2023-10-14T11:12:27.000217+0000","last_undegraded":"2023-10-14T11:12:27.000217+0000","last_fullsized":"2023-10-14T11:12:27.000217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:02:49.769267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.989018+0000","last_change":"2023-10-14T11:12:21.972862+0000","last_active":"2023-10-14T11:12:26.989018+0000","last_peered":"2023-10-14T11:12:26.989018+0000","last_clean":"2023-10-14T11:12:26.989018+0000","last_became_active":"2023-10-14T11:12:21.971652+0000","last_became_peered":"2023-10-14T11:12:21.971652+0000","last_unstale":"2023-10-14T11:12:26.989018+0000","last_undegraded":"2023-10-14T11:12:26.989018+0000","last_fullsized":"2023-10-14T11:12:26.989018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:37.017137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:29.051905+0000","last_change":"2023-10-14T11:12:27.024091+0000","last_active":"2023-10-14T11:12:29.051905+0000","last_peered":"2023-10-14T11:12:29.051905+0000","last_clean":"2023-10-14T11:12:29.051905+0000","last_became_active":"2023-10-14T11:12:27.023591+0000","last_became_peered":"2023-10-14T11:12:27.023591+0000","last_unstale":"2023-10-14T11:12:29.051905+0000","last_undegraded":"2023-10-14T11:12:29.051905+0000","last_fullsized":"2023-10-14T11:12:29.051905+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:58.469102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.995932+0000","last_change":"2023-10-14T11:12:22.976553+0000","last_active":"2023-10-14T11:12:26.995932+0000","last_peered":"2023-10-14T11:12:26.995932+0000","last_clean":"2023-10-14T11:12:26.995932+0000","last_became_active":"2023-10-14T11:12:22.976280+0000","last_became_peered":"2023-10-14T11:12:22.976280+0000","last_unstale":"2023-10-14T11:12:26.995932+0000","last_undegraded":"2023-10-14T11:12:26.995932+0000","last_fullsized":"2023-10-14T11:12:26.995932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:02:49.769267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.995666+0000","last_change":"2023-10-14T11:12:21.971386+0000","last_active":"2023-10-14T11:12:26.995666+0000","last_peered":"2023-10-14T11:12:26.995666+0000","last_clean":"2023-10-14T11:12:26.995666+0000","last_became_active":"2023-10-14T11:12:21.971087+0000","last_became_peered":"2023-10-14T11:12:21.971087+0000","last_unstale":"2023-10-14T11:12:26.995666+0000","last_undegraded":"2023-10-14T11:12:26.995666+0000","last_fullsized":"2023-10-14T11:12:26.995666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:40:43.612359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.992534+0000","last_change":"2023-10-14T11:12:21.975576+0000","last_active":"2023-10-14T11:12:26.992534+0000","last_peered":"2023-10-14T11:12:26.992534+0000","last_clean":"2023-10-14T11:12:26.992534+0000","last_became_active":"2023-10-14T11:12:21.975207+0000","last_became_peered":"2023-10-14T11:12:21.975207+0000","last_unstale":"2023-10-14T11:12:26.992534+0000","last_undegraded":"2023-10-14T11:12:26.992534+0000","last_fullsized":"2023-10-14T11:12:26.992534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:01.323224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010668+0000","last_change":"2023-10-14T11:12:22.992785+0000","last_active":"2023-10-14T11:12:27.010668+0000","last_peered":"2023-10-14T11:12:27.010668+0000","last_clean":"2023-10-14T11:12:27.010668+0000","last_became_active":"2023-10-14T11:12:22.992508+0000","last_became_peered":"2023-10-14T11:12:22.992508+0000","last_unstale":"2023-10-14T11:12:27.010668+0000","last_undegraded":"2023-10-14T11:12:27.010668+0000","last_fullsized":"2023-10-14T11:12:27.010668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:07:23.864178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:28.702964+0000","last_change":"2023-10-14T11:12:27.023027+0000","last_active":"2023-10-14T11:12:28.702964+0000","last_peered":"2023-10-14T11:12:28.702964+0000","last_clean":"2023-10-14T11:12:28.702964+0000","last_became_active":"2023-10-14T11:12:27.020646+0000","last_became_peered":"2023-10-14T11:12:27.020646+0000","last_unstale":"2023-10-14T11:12:28.702964+0000","last_undegraded":"2023-10-14T11:12:28.702964+0000","last_fullsized":"2023-10-14T11:12:28.702964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:40:48.656102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.998432+0000","last_change":"2023-10-14T11:12:21.976762+0000","last_active":"2023-10-14T11:12:26.998432+0000","last_peered":"2023-10-14T11:12:26.998432+0000","last_clean":"2023-10-14T11:12:26.998432+0000","last_became_active":"2023-10-14T11:12:21.976437+0000","last_became_peered":"2023-10-14T11:12:21.976437+0000","last_unstale":"2023-10-14T11:12:26.998432+0000","last_undegraded":"2023-10-14T11:12:26.998432+0000","last_fullsized":"2023-10-14T11:12:26.998432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:20.933746+0000","last_clean_scrub_stamp":"2023-10-14T11:12:20.933746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:31:07.362240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.997365+0000","last_change":"2023-10-14T11:12:22.960803+0000","last_active":"2023-10-14T11:12:26.997365+0000","last_peered":"2023-10-14T11:12:26.997365+0000","last_clean":"2023-10-14T11:12:26.997365+0000","last_became_active":"2023-10-14T11:12:22.960504+0000","last_became_peered":"2023-10-14T11:12:22.960504+0000","last_unstale":"2023-10-14T11:12:26.997365+0000","last_undegraded":"2023-10-14T11:12:26.997365+0000","last_fullsized":"2023-10-14T11:12:26.997365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:24.233763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.993298+0000","last_change":"2023-10-14T11:12:27.016102+0000","last_active":"2023-10-14T11:12:27.993298+0000","last_peered":"2023-10-14T11:12:27.993298+0000","last_clean":"2023-10-14T11:12:27.993298+0000","last_became_active":"2023-10-14T11:12:27.015599+0000","last_became_peered":"2023-10-14T11:12:27.015599+0000","last_unstale":"2023-10-14T11:12:27.993298+0000","last_undegraded":"2023-10-14T11:12:27.993298+0000","last_fullsized":"2023-10-14T11:12:27.993298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:25.977488+0000","last_clean_scrub_stamp":"2023-10-14T11:12:25.977488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:04:28.117008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988221+0000","last_change":"2023-10-14T11:12:22.974947+0000","last_active":"2023-10-14T11:12:26.988221+0000","last_peered":"2023-10-14T11:12:26.988221+0000","last_clean":"2023-10-14T11:12:26.988221+0000","last_became_active":"2023-10-14T11:12:22.974647+0000","last_became_peered":"2023-10-14T11:12:22.974647+0000","last_unstale":"2023-10-14T11:12:26.988221+0000","last_undegraded":"2023-10-14T11:12:26.988221+0000","last_fullsized":"2023-10-14T11:12:26.988221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:02:49.769267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988737+0000","last_change":"2023-10-14T11:12:22.987590+0000","last_active":"2023-10-14T11:12:26.988737+0000","last_peered":"2023-10-14T11:12:26.988737+0000","last_clean":"2023-10-14T11:12:26.988737+0000","last_became_active":"2023-10-14T11:12:22.985815+0000","last_became_peered":"2023-10-14T11:12:22.985815+0000","last_unstale":"2023-10-14T11:12:26.988737+0000","last_undegraded":"2023-10-14T11:12:26.988737+0000","last_fullsized":"2023-10-14T11:12:26.988737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:24.233763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988803+0000","last_change":"2023-10-14T11:12:22.971785+0000","last_active":"2023-10-14T11:12:26.988803+0000","last_peered":"2023-10-14T11:12:26.988803+0000","last_clean":"2023-10-14T11:12:26.988803+0000","last_became_active":"2023-10-14T11:12:22.971415+0000","last_became_peered":"2023-10-14T11:12:22.971415+0000","last_unstale":"2023-10-14T11:12:26.988803+0000","last_undegraded":"2023-10-14T11:12:26.988803+0000","last_fullsized":"2023-10-14T11:12:26.988803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:54.432400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010852+0000","last_change":"2023-10-14T11:12:22.981024+0000","last_active":"2023-10-14T11:12:27.010852+0000","last_peered":"2023-10-14T11:12:27.010852+0000","last_clean":"2023-10-14T11:12:27.010852+0000","last_became_active":"2023-10-14T11:12:22.977993+0000","last_became_peered":"2023-10-14T11:12:22.977993+0000","last_unstale":"2023-10-14T11:12:27.010852+0000","last_undegraded":"2023-10-14T11:12:27.010852+0000","last_fullsized":"2023-10-14T11:12:27.010852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:31:08.369281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.999570+0000","last_change":"2023-10-14T11:12:22.969832+0000","last_active":"2023-10-14T11:12:26.999570+0000","last_peered":"2023-10-14T11:12:26.999570+0000","last_clean":"2023-10-14T11:12:26.999570+0000","last_became_active":"2023-10-14T11:12:22.969627+0000","last_became_peered":"2023-10-14T11:12:22.969627+0000","last_unstale":"2023-10-14T11:12:26.999570+0000","last_undegraded":"2023-10-14T11:12:26.999570+0000","last_fullsized":"2023-10-14T11:12:26.999570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:52:38.018829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010439+0000","last_change":"2023-10-14T11:12:22.966311+0000","last_active":"2023-10-14T11:12:27.010439+0000","last_peered":"2023-10-14T11:12:27.010439+0000","last_clean":"2023-10-14T11:12:27.010439+0000","last_became_active":"2023-10-14T11:12:22.965987+0000","last_became_peered":"2023-10-14T11:12:22.965987+0000","last_unstale":"2023-10-14T11:12:27.010439+0000","last_undegraded":"2023-10-14T11:12:27.010439+0000","last_fullsized":"2023-10-14T11:12:27.010439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:27.066313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.991696+0000","last_change":"2023-10-14T11:12:22.992696+0000","last_active":"2023-10-14T11:12:26.991696+0000","last_peered":"2023-10-14T11:12:26.991696+0000","last_clean":"2023-10-14T11:12:26.991696+0000","last_became_active":"2023-10-14T11:12:22.991959+0000","last_became_peered":"2023-10-14T11:12:22.991959+0000","last_unstale":"2023-10-14T11:12:26.991696+0000","last_undegraded":"2023-10-14T11:12:26.991696+0000","last_fullsized":"2023-10-14T11:12:26.991696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:52:38.018829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000914+0000","last_change":"2023-10-14T11:12:22.984405+0000","last_active":"2023-10-14T11:12:27.000914+0000","last_peered":"2023-10-14T11:12:27.000914+0000","last_clean":"2023-10-14T11:12:27.000914+0000","last_became_active":"2023-10-14T11:12:22.978369+0000","last_became_peered":"2023-10-14T11:12:22.978369+0000","last_unstale":"2023-10-14T11:12:27.000914+0000","last_undegraded":"2023-10-14T11:12:27.000914+0000","last_fullsized":"2023-10-14T11:12:27.000914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:19.681873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988858+0000","last_change":"2023-10-14T11:12:22.969040+0000","last_active":"2023-10-14T11:12:26.988858+0000","last_peered":"2023-10-14T11:12:26.988858+0000","last_clean":"2023-10-14T11:12:26.988858+0000","last_became_active":"2023-10-14T11:12:22.968583+0000","last_became_peered":"2023-10-14T11:12:22.968583+0000","last_unstale":"2023-10-14T11:12:26.988858+0000","last_undegraded":"2023-10-14T11:12:26.988858+0000","last_fullsized":"2023-10-14T11:12:26.988858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:38.252309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.995566+0000","last_change":"2023-10-14T11:12:22.966174+0000","last_active":"2023-10-14T11:12:26.995566+0000","last_peered":"2023-10-14T11:12:26.995566+0000","last_clean":"2023-10-14T11:12:26.995566+0000","last_became_active":"2023-10-14T11:12:22.965570+0000","last_became_peered":"2023-10-14T11:12:22.965570+0000","last_unstale":"2023-10-14T11:12:26.995566+0000","last_undegraded":"2023-10-14T11:12:26.995566+0000","last_fullsized":"2023-10-14T11:12:26.995566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:19.243490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988714+0000","last_change":"2023-10-14T11:12:22.982352+0000","last_active":"2023-10-14T11:12:26.988714+0000","last_peered":"2023-10-14T11:12:26.988714+0000","last_clean":"2023-10-14T11:12:26.988714+0000","last_became_active":"2023-10-14T11:12:22.982026+0000","last_became_peered":"2023-10-14T11:12:22.982026+0000","last_unstale":"2023-10-14T11:12:26.988714+0000","last_undegraded":"2023-10-14T11:12:26.988714+0000","last_fullsized":"2023-10-14T11:12:26.988714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:19.681873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010463+0000","last_change":"2023-10-14T11:12:22.989236+0000","last_active":"2023-10-14T11:12:27.010463+0000","last_peered":"2023-10-14T11:12:27.010463+0000","last_clean":"2023-10-14T11:12:27.010463+0000","last_became_active":"2023-10-14T11:12:22.988644+0000","last_became_peered":"2023-10-14T11:12:22.988644+0000","last_unstale":"2023-10-14T11:12:27.010463+0000","last_undegraded":"2023-10-14T11:12:27.010463+0000","last_fullsized":"2023-10-14T11:12:27.010463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:40:44.619400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.991230+0000","last_change":"2023-10-14T11:12:22.983434+0000","last_active":"2023-10-14T11:12:26.991230+0000","last_peered":"2023-10-14T11:12:26.991230+0000","last_clean":"2023-10-14T11:12:26.991230+0000","last_became_active":"2023-10-14T11:12:22.982702+0000","last_became_peered":"2023-10-14T11:12:22.982702+0000","last_unstale":"2023-10-14T11:12:26.991230+0000","last_undegraded":"2023-10-14T11:12:26.991230+0000","last_fullsized":"2023-10-14T11:12:26.991230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:19.243490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265404+0000","last_change":"2023-10-14T11:12:22.985280+0000","last_active":"2023-10-14T11:12:27.265404+0000","last_peered":"2023-10-14T11:12:27.265404+0000","last_clean":"2023-10-14T11:12:27.265404+0000","last_became_active":"2023-10-14T11:12:22.984745+0000","last_became_peered":"2023-10-14T11:12:22.984745+0000","last_unstale":"2023-10-14T11:12:27.265404+0000","last_undegraded":"2023-10-14T11:12:27.265404+0000","last_fullsized":"2023-10-14T11:12:27.265404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:32.409154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988912+0000","last_change":"2023-10-14T11:12:22.996375+0000","last_active":"2023-10-14T11:12:26.988912+0000","last_peered":"2023-10-14T11:12:26.988912+0000","last_clean":"2023-10-14T11:12:26.988912+0000","last_became_active":"2023-10-14T11:12:22.995986+0000","last_became_peered":"2023-10-14T11:12:22.995986+0000","last_unstale":"2023-10-14T11:12:26.988912+0000","last_undegraded":"2023-10-14T11:12:26.988912+0000","last_fullsized":"2023-10-14T11:12:26.988912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:41.624687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.990653+0000","last_change":"2023-10-14T11:12:22.982260+0000","last_active":"2023-10-14T11:12:26.990653+0000","last_peered":"2023-10-14T11:12:26.990653+0000","last_clean":"2023-10-14T11:12:26.990653+0000","last_became_active":"2023-10-14T11:12:22.981981+0000","last_became_peered":"2023-10-14T11:12:22.981981+0000","last_unstale":"2023-10-14T11:12:26.990653+0000","last_undegraded":"2023-10-14T11:12:26.990653+0000","last_fullsized":"2023-10-14T11:12:26.990653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:08.508676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988763+0000","last_change":"2023-10-14T11:12:22.972200+0000","last_active":"2023-10-14T11:12:26.988763+0000","last_peered":"2023-10-14T11:12:26.988763+0000","last_clean":"2023-10-14T11:12:26.988763+0000","last_became_active":"2023-10-14T11:12:22.971852+0000","last_became_peered":"2023-10-14T11:12:22.971852+0000","last_unstale":"2023-10-14T11:12:26.988763+0000","last_undegraded":"2023-10-14T11:12:26.988763+0000","last_fullsized":"2023-10-14T11:12:26.988763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:52:38.018829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.000298+0000","last_change":"2023-10-14T11:12:22.964369+0000","last_active":"2023-10-14T11:12:27.000298+0000","last_peered":"2023-10-14T11:12:27.000298+0000","last_clean":"2023-10-14T11:12:27.000298+0000","last_became_active":"2023-10-14T11:12:22.963993+0000","last_became_peered":"2023-10-14T11:12:22.963993+0000","last_unstale":"2023-10-14T11:12:27.000298+0000","last_undegraded":"2023-10-14T11:12:27.000298+0000","last_fullsized":"2023-10-14T11:12:27.000298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:06.491915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.007442+0000","last_change":"2023-10-14T11:12:22.982867+0000","last_active":"2023-10-14T11:12:27.007442+0000","last_peered":"2023-10-14T11:12:27.007442+0000","last_clean":"2023-10-14T11:12:27.007442+0000","last_became_active":"2023-10-14T11:12:22.981049+0000","last_became_peered":"2023-10-14T11:12:22.981049+0000","last_unstale":"2023-10-14T11:12:27.007442+0000","last_undegraded":"2023-10-14T11:12:27.007442+0000","last_fullsized":"2023-10-14T11:12:27.007442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:06.491915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.994506+0000","last_change":"2023-10-14T11:12:22.968823+0000","last_active":"2023-10-14T11:12:26.994506+0000","last_peered":"2023-10-14T11:12:26.994506+0000","last_clean":"2023-10-14T11:12:26.994506+0000","last_became_active":"2023-10-14T11:12:22.968557+0000","last_became_peered":"2023-10-14T11:12:22.968557+0000","last_unstale":"2023-10-14T11:12:26.994506+0000","last_undegraded":"2023-10-14T11:12:26.994506+0000","last_fullsized":"2023-10-14T11:12:26.994506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:27.066313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.999040+0000","last_change":"2023-10-14T11:12:22.970768+0000","last_active":"2023-10-14T11:12:26.999040+0000","last_peered":"2023-10-14T11:12:26.999040+0000","last_clean":"2023-10-14T11:12:26.999040+0000","last_became_active":"2023-10-14T11:12:22.970449+0000","last_became_peered":"2023-10-14T11:12:22.970449+0000","last_unstale":"2023-10-14T11:12:26.999040+0000","last_undegraded":"2023-10-14T11:12:26.999040+0000","last_fullsized":"2023-10-14T11:12:26.999040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:38.024178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.991296+0000","last_change":"2023-10-14T11:12:22.984404+0000","last_active":"2023-10-14T11:12:26.991296+0000","last_peered":"2023-10-14T11:12:26.991296+0000","last_clean":"2023-10-14T11:12:26.991296+0000","last_became_active":"2023-10-14T11:12:22.984162+0000","last_became_peered":"2023-10-14T11:12:22.984162+0000","last_unstale":"2023-10-14T11:12:26.991296+0000","last_undegraded":"2023-10-14T11:12:26.991296+0000","last_fullsized":"2023-10-14T11:12:26.991296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:17.701734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.991597+0000","last_change":"2023-10-14T11:12:22.992927+0000","last_active":"2023-10-14T11:12:26.991597+0000","last_peered":"2023-10-14T11:12:26.991597+0000","last_clean":"2023-10-14T11:12:26.991597+0000","last_became_active":"2023-10-14T11:12:22.992333+0000","last_became_peered":"2023-10-14T11:12:22.992333+0000","last_unstale":"2023-10-14T11:12:26.991597+0000","last_undegraded":"2023-10-14T11:12:26.991597+0000","last_fullsized":"2023-10-14T11:12:26.991597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:24:53.742274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265899+0000","last_change":"2023-10-14T11:12:22.986073+0000","last_active":"2023-10-14T11:12:27.265899+0000","last_peered":"2023-10-14T11:12:27.265899+0000","last_clean":"2023-10-14T11:12:27.265899+0000","last_became_active":"2023-10-14T11:12:22.985686+0000","last_became_peered":"2023-10-14T11:12:22.985686+0000","last_unstale":"2023-10-14T11:12:27.265899+0000","last_undegraded":"2023-10-14T11:12:27.265899+0000","last_fullsized":"2023-10-14T11:12:27.265899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:15:12.849455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.995735+0000","last_change":"2023-10-14T11:12:22.982684+0000","last_active":"2023-10-14T11:12:26.995735+0000","last_peered":"2023-10-14T11:12:26.995735+0000","last_clean":"2023-10-14T11:12:26.995735+0000","last_became_active":"2023-10-14T11:12:22.982328+0000","last_became_peered":"2023-10-14T11:12:22.982328+0000","last_unstale":"2023-10-14T11:12:26.995735+0000","last_undegraded":"2023-10-14T11:12:26.995735+0000","last_fullsized":"2023-10-14T11:12:26.995735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:06.491915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264743+0000","last_change":"2023-10-14T11:12:22.989563+0000","last_active":"2023-10-14T11:12:27.264743+0000","last_peered":"2023-10-14T11:12:27.264743+0000","last_clean":"2023-10-14T11:12:27.264743+0000","last_became_active":"2023-10-14T11:12:22.989283+0000","last_became_peered":"2023-10-14T11:12:22.989283+0000","last_unstale":"2023-10-14T11:12:27.264743+0000","last_undegraded":"2023-10-14T11:12:27.264743+0000","last_fullsized":"2023-10-14T11:12:27.264743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:19.681873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.988614+0000","last_change":"2023-10-14T11:12:22.973627+0000","last_active":"2023-10-14T11:12:26.988614+0000","last_peered":"2023-10-14T11:12:26.988614+0000","last_clean":"2023-10-14T11:12:26.988614+0000","last_became_active":"2023-10-14T11:12:22.973284+0000","last_became_peered":"2023-10-14T11:12:22.973284+0000","last_unstale":"2023-10-14T11:12:26.988614+0000","last_undegraded":"2023-10-14T11:12:26.988614+0000","last_fullsized":"2023-10-14T11:12:26.988614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:18:11.434418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.264837+0000","last_change":"2023-10-14T11:12:22.981086+0000","last_active":"2023-10-14T11:12:27.264837+0000","last_peered":"2023-10-14T11:12:27.264837+0000","last_clean":"2023-10-14T11:12:27.264837+0000","last_became_active":"2023-10-14T11:12:22.980768+0000","last_became_peered":"2023-10-14T11:12:22.980768+0000","last_unstale":"2023-10-14T11:12:27.264837+0000","last_undegraded":"2023-10-14T11:12:27.264837+0000","last_fullsized":"2023-10-14T11:12:27.264837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:46.533477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:26.989398+0000","last_change":"2023-10-14T11:12:22.972884+0000","last_active":"2023-10-14T11:12:26.989398+0000","last_peered":"2023-10-14T11:12:26.989398+0000","last_clean":"2023-10-14T11:12:26.989398+0000","last_became_active":"2023-10-14T11:12:22.972548+0000","last_became_peered":"2023-10-14T11:12:22.972548+0000","last_unstale":"2023-10-14T11:12:26.989398+0000","last_undegraded":"2023-10-14T11:12:26.989398+0000","last_fullsized":"2023-10-14T11:12:26.989398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:46.533477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.010562+0000","last_change":"2023-10-14T11:12:22.975055+0000","last_active":"2023-10-14T11:12:27.010562+0000","last_peered":"2023-10-14T11:12:27.010562+0000","last_clean":"2023-10-14T11:12:27.010562+0000","last_became_active":"2023-10-14T11:12:22.974759+0000","last_became_peered":"2023-10-14T11:12:22.974759+0000","last_unstale":"2023-10-14T11:12:27.010562+0000","last_undegraded":"2023-10-14T11:12:27.010562+0000","last_fullsized":"2023-10-14T11:12:27.010562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:02:49.769267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.012397+0000","last_change":"2023-10-14T11:12:22.973923+0000","last_active":"2023-10-14T11:12:27.012397+0000","last_peered":"2023-10-14T11:12:27.012397+0000","last_clean":"2023-10-14T11:12:27.012397+0000","last_became_active":"2023-10-14T11:12:22.973626+0000","last_became_peered":"2023-10-14T11:12:22.973626+0000","last_unstale":"2023-10-14T11:12:27.012397+0000","last_undegraded":"2023-10-14T11:12:27.012397+0000","last_fullsized":"2023-10-14T11:12:27.012397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:17.701734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T11:12:27.265807+0000","last_change":"2023-10-14T11:12:22.987825+0000","last_active":"2023-10-14T11:12:27.265807+0000","last_peered":"2023-10-14T11:12:27.265807+0000","last_clean":"2023-10-14T11:12:27.265807+0000","last_became_active":"2023-10-14T11:12:22.987045+0000","last_became_peered":"2023-10-14T11:12:22.987045+0000","last_unstale":"2023-10-14T11:12:27.265807+0000","last_undegraded":"2023-10-14T11:12:27.265807+0000","last_fullsized":"2023-10-14T11:12:27.265807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:21.940786+0000","last_clean_scrub_stamp":"2023-10-14T11:12:21.940786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:08.508676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":864256,"data_stored":695401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":104541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":278528,"data_stored":104577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":104451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":104611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":695457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:12:53.437 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T11:12:53.438 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-14T11:12:53.438 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-14T11:12:53.438 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-14T11:12:53.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.611+0000 7fbd43b01640 1 Processor -- start 2023-10-14T11:12:53.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.611+0000 7fbd43b01640 1 -- start start 2023-10-14T11:12:53.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.611+0000 7fbd43b01640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd3c164520 0x7fbd3c0ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:53.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.611+0000 7fbd43b01640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbd3c0b07f0 0x7fbd3c0cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:53.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.611+0000 7fbd43b01640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd3c0c96f0 con 0x7fbd3c0ad960 2023-10-14T11:12:53.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.611+0000 7fbd43b01640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd3c164900 con 0x7fbd3c0b07f0 2023-10-14T11:12:53.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.611+0000 7fbd43b01640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c0cb950 con 0x7fbd3c164520 2023-10-14T11:12:53.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.611+0000 7fbd4189d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd3c164520 0x7fbd3c0ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:53.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.611+0000 7fbd4209e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbd3c0b07f0 0x7fbd3c0cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:53.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.611+0000 7fbd4209e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbd3c0b07f0 0x7fbd3c0cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:45848/0 (socket says 172.21.15.26:45848) 2023-10-14T11:12:53.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.611+0000 7fbd4209e640 1 -- 172.21.15.26:0/3595531816 learned_addr learned my addr 172.21.15.26:0/3595531816 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:53.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.611+0000 7fbd4189d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd3c164520 0x7fbd3c0ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:57924/0 (socket says 172.21.15.26:57924) 2023-10-14T11:12:53.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.615+0000 7fbd4209e640 1 -- 172.21.15.26:0/3595531816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd3c164520 msgr2=0x7fbd3c0ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:53.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.615+0000 7fbd4209e640 1 --2- 172.21.15.26:0/3595531816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd3c164520 0x7fbd3c0ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.615+0000 7fbd4209e640 1 -- 172.21.15.26:0/3595531816 >> v1:172.21.15.110:6789/0 conn(0x7fbd3c0ad960 legacy=0x7fbd3c0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:53.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.615+0000 7fbd4209e640 1 -- 172.21.15.26:0/3595531816 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3c0cbed0 con 0x7fbd3c0b07f0 2023-10-14T11:12:53.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.615+0000 7fbd4209e640 1 --2- 172.21.15.26:0/3595531816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd3c0b07f0 0x7fbd3c0cc870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbd34009e50 tx=0x7fbd3401c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5a6c201b77d900a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:53.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.615+0000 7fbd4089b640 1 -- 172.21.15.26:0/3595531816 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd340a58d0 con 0x7fbd3c0b07f0 2023-10-14T11:12:53.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.615+0000 7fbd4089b640 1 -- 172.21.15.26:0/3595531816 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd340a5a30 con 0x7fbd3c0b07f0 2023-10-14T11:12:53.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.615+0000 7fbd4089b640 1 -- 172.21.15.26:0/3595531816 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd340a5dc0 con 0x7fbd3c0b07f0 2023-10-14T11:12:53.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd43b01640 1 -- 172.21.15.26:0/3595531816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd3c0b07f0 msgr2=0x7fbd3c0cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:53.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd43b01640 1 --2- 172.21.15.26:0/3595531816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd3c0b07f0 0x7fbd3c0cc870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbd34009e50 tx=0x7fbd3401c9e0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd43b01640 1 -- 172.21.15.26:0/3595531816 shutdown_connections 2023-10-14T11:12:53.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd43b01640 1 --2- 172.21.15.26:0/3595531816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd3c0b07f0 0x7fbd3c0cc870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd43b01640 1 --2- 172.21.15.26:0/3595531816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd3c164520 0x7fbd3c0ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd43b01640 1 -- 172.21.15.26:0/3595531816 >> 172.21.15.26:0/3595531816 conn(0x7fbd3c06c190 msgr2=0x7fbd3c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:53.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd43b01640 1 -- 172.21.15.26:0/3595531816 shutdown_connections 2023-10-14T11:12:53.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd43b01640 1 -- 172.21.15.26:0/3595531816 wait complete. 2023-10-14T11:12:53.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd43b01640 1 Processor -- start 2023-10-14T11:12:53.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd43b01640 1 -- start start 2023-10-14T11:12:53.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd43b01640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd3c0ad960 0x7fbd3c1484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:53.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd43b01640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd3c0b07f0 0x7fbd3c15eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:53.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd43b01640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd3c164520 0x7fbd3c15d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:53.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd43b01640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c0c3870 con 0x7fbd3c164520 2023-10-14T11:12:53.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd43b01640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c0c3b50 con 0x7fbd3c0b07f0 2023-10-14T11:12:53.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd43b01640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c0c3e30 con 0x7fbd3c0ad960 2023-10-14T11:12:53.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd4209e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd3c164520 0x7fbd3c15d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:53.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd4209e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd3c164520 0x7fbd3c15d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37382/0 (socket says 172.21.15.26:37382) 2023-10-14T11:12:53.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd4209e640 1 -- 172.21.15.26:0/2151640469 learned_addr learned my addr 172.21.15.26:0/2151640469 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:53.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd4189d640 1 --2- 172.21.15.26:0/2151640469 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd3c0ad960 0x7fbd3c1484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:53.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd4109c640 1 --2- 172.21.15.26:0/2151640469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd3c0b07f0 0x7fbd3c15eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:53.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd4209e640 1 -- 172.21.15.26:0/2151640469 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd3c0ad960 msgr2=0x7fbd3c1484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:53.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd4209e640 1 --2- 172.21.15.26:0/2151640469 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd3c0ad960 0x7fbd3c1484e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd4209e640 1 -- 172.21.15.26:0/2151640469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd3c0b07f0 msgr2=0x7fbd3c15eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:53.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd4209e640 1 --2- 172.21.15.26:0/2151640469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd3c0b07f0 0x7fbd3c15eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.619+0000 7fbd4209e640 1 -- 172.21.15.26:0/2151640469 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd34009b30 con 0x7fbd3c164520 2023-10-14T11:12:53.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.623+0000 7fbd4209e640 1 --2- 172.21.15.26:0/2151640469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd3c164520 0x7fbd3c15d120 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbd340af040 tx=0x7fbd34019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:53.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.623+0000 7fbd327fc640 1 -- 172.21.15.26:0/2151640469 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd340b8670 con 0x7fbd3c164520 2023-10-14T11:12:53.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.623+0000 7fbd327fc640 1 -- 172.21.15.26:0/2151640469 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd340b87d0 con 0x7fbd3c164520 2023-10-14T11:12:53.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.623+0000 7fbd327fc640 1 -- 172.21.15.26:0/2151640469 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd340b8b60 con 0x7fbd3c164520 2023-10-14T11:12:53.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.623+0000 7fbd43b01640 1 -- 172.21.15.26:0/2151640469 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd3c0c4110 con 0x7fbd3c164520 2023-10-14T11:12:53.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.623+0000 7fbd43b01640 1 -- 172.21.15.26:0/2151640469 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd3c148a20 con 0x7fbd3c164520 2023-10-14T11:12:53.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.623+0000 7fbd43b01640 1 -- 172.21.15.26:0/2151640469 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd3c074010 con 0x7fbd3c164520 2023-10-14T11:12:53.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.623+0000 7fbd327fc640 1 -- 172.21.15.26:0/2151640469 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbd340b8cc0 con 0x7fbd3c164520 2023-10-14T11:12:53.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.623+0000 7fbd327fc640 1 --2- 172.21.15.26:0/2151640469 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd200664a0 0x7fbd20068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:53.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.623+0000 7fbd327fc640 1 -- 172.21.15.26:0/2151640469 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbd3411f660 con 0x7fbd3c164520 2023-10-14T11:12:53.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.623+0000 7fbd4189d640 1 --2- 172.21.15.26:0/2151640469 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd200664a0 0x7fbd20068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:53.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.627+0000 7fbd4189d640 1 --2- 172.21.15.26:0/2151640469 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd200664a0 0x7fbd20068960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbd38009b60 tx=0x7fbd38009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:53.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.627+0000 7fbd327fc640 1 -- 172.21.15.26:0/2151640469 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbd340ec800 con 0x7fbd3c164520 2023-10-14T11:12:53.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.823+0000 7fbd43b01640 1 -- 172.21.15.26:0/2151640469 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbd3c0c45c0 con 0x7fbd3c164520 2023-10-14T11:12:53.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.827+0000 7fbd327fc640 1 -- 172.21.15.26:0/2151640469 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fbd340efe20 con 0x7fbd3c164520 2023-10-14T11:12:53.832 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:53.832 INFO:teuthology.orchestra.run.smithi026.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-14T11:12:53.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.831+0000 7fbd43b01640 1 -- 172.21.15.26:0/2151640469 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd200664a0 msgr2=0x7fbd20068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:53.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.831+0000 7fbd43b01640 1 --2- 172.21.15.26:0/2151640469 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd200664a0 0x7fbd20068960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbd38009b60 tx=0x7fbd38009190 comp rx=0 tx=0).stop 2023-10-14T11:12:53.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.831+0000 7fbd43b01640 1 -- 172.21.15.26:0/2151640469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd3c164520 msgr2=0x7fbd3c15d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:53.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.831+0000 7fbd43b01640 1 --2- 172.21.15.26:0/2151640469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd3c164520 0x7fbd3c15d120 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbd340af040 tx=0x7fbd34019780 comp rx=0 tx=0).stop 2023-10-14T11:12:53.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.831+0000 7fbd43b01640 1 -- 172.21.15.26:0/2151640469 shutdown_connections 2023-10-14T11:12:53.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.831+0000 7fbd43b01640 1 --2- 172.21.15.26:0/2151640469 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd200664a0 0x7fbd20068960 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.831+0000 7fbd43b01640 1 --2- 172.21.15.26:0/2151640469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd3c164520 0x7fbd3c15d120 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.831+0000 7fbd43b01640 1 --2- 172.21.15.26:0/2151640469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd3c0b07f0 0x7fbd3c15eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.831+0000 7fbd43b01640 1 --2- 172.21.15.26:0/2151640469 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd3c0ad960 0x7fbd3c1484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:53.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.831+0000 7fbd43b01640 1 -- 172.21.15.26:0/2151640469 >> 172.21.15.26:0/2151640469 conn(0x7fbd3c06c190 msgr2=0x7fbd3c0ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:53.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.831+0000 7fbd43b01640 1 -- 172.21.15.26:0/2151640469 shutdown_connections 2023-10-14T11:12:53.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.831+0000 7fbd43b01640 1 -- 172.21.15.26:0/2151640469 wait complete. 2023-10-14T11:12:53.854 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-14T11:12:53.854 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:12:53.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.995+0000 7f993ffd9640 1 Processor -- start 2023-10-14T11:12:53.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.995+0000 7f993ffd9640 1 -- start start 2023-10-14T11:12:54.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.995+0000 7f993ffd9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f993815cb90 0x7f99380cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:54.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.995+0000 7f993ffd9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99380d3010 0x7f99380d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:54.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.995+0000 7f993ffd9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99380ce770 con 0x7f99380d1400 2023-10-14T11:12:54.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.995+0000 7f993ffd9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99380d1890 con 0x7f993815cb90 2023-10-14T11:12:54.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.995+0000 7f993ffd9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99380d0600 con 0x7f99380d3010 2023-10-14T11:12:54.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.995+0000 7f993dd75640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f993815cb90 0x7f99380cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:54.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.995+0000 7f993dd75640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f993815cb90 0x7f99380cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37394/0 (socket says 172.21.15.26:37394) 2023-10-14T11:12:54.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.995+0000 7f993dd75640 1 -- 172.21.15.26:0/1392241576 learned_addr learned my addr 172.21.15.26:0/1392241576 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:54.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.995+0000 7f993d574640 1 --2- 172.21.15.26:0/1392241576 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99380d3010 0x7f99380d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:54.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.995+0000 7f993dd75640 1 -- 172.21.15.26:0/1392241576 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99380d3010 msgr2=0x7f99380d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:54.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.995+0000 7f993dd75640 1 --2- 172.21.15.26:0/1392241576 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99380d3010 0x7f99380d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.995+0000 7f993dd75640 1 -- 172.21.15.26:0/1392241576 >> v1:172.21.15.110:6789/0 conn(0x7f99380d1400 legacy=0x7f99380cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:54.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.995+0000 7f993dd75640 1 -- 172.21.15.26:0/1392241576 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99380c6450 con 0x7f993815cb90 2023-10-14T11:12:54.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.999+0000 7f993dd75640 1 --2- 172.21.15.26:0/1392241576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f993815cb90 0x7f99380cfb10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9934009860 tx=0x7f993401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a58d54e52fbc90 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:54.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.999+0000 7f993cd73640 1 -- 172.21.15.26:0/1392241576 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99340ab660 con 0x7f993815cb90 2023-10-14T11:12:54.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.999+0000 7f993cd73640 1 -- 172.21.15.26:0/1392241576 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99340ab7c0 con 0x7f993815cb90 2023-10-14T11:12:54.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.999+0000 7f993cd73640 1 -- 172.21.15.26:0/1392241576 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99340abb50 con 0x7f993815cb90 2023-10-14T11:12:54.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.999+0000 7f993ffd9640 1 -- 172.21.15.26:0/1392241576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f993815cb90 msgr2=0x7f99380cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.999+0000 7f993ffd9640 1 --2- 172.21.15.26:0/1392241576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f993815cb90 0x7f99380cfb10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9934009860 tx=0x7f993401c460 comp rx=0 tx=0).stop 2023-10-14T11:12:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.999+0000 7f993ffd9640 1 -- 172.21.15.26:0/1392241576 shutdown_connections 2023-10-14T11:12:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.999+0000 7f993ffd9640 1 --2- 172.21.15.26:0/1392241576 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99380d3010 0x7f99380d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.999+0000 7f993ffd9640 1 --2- 172.21.15.26:0/1392241576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f993815cb90 0x7f99380cfb10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.999+0000 7f993ffd9640 1 -- 172.21.15.26:0/1392241576 >> 172.21.15.26:0/1392241576 conn(0x7f993809bc50 msgr2=0x7f99380d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.999+0000 7f993ffd9640 1 -- 172.21.15.26:0/1392241576 shutdown_connections 2023-10-14T11:12:54.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:53.999+0000 7f993ffd9640 1 -- 172.21.15.26:0/1392241576 wait complete. 2023-10-14T11:12:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f993ffd9640 1 Processor -- start 2023-10-14T11:12:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f993ffd9640 1 -- start start 2023-10-14T11:12:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f993ffd9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99380d1400 0x7f99380cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f993ffd9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99380d3010 0x7f9938154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f993ffd9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f993815cb90 0x7f9938155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f993ffd9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99380cbc00 con 0x7f993815cb90 2023-10-14T11:12:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f993ffd9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99380cc6b0 con 0x7f99380d3010 2023-10-14T11:12:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f993ffd9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99380cbe10 con 0x7f99380d1400 2023-10-14T11:12:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f993e576640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f993815cb90 0x7f9938155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f993e576640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f993815cb90 0x7f9938155430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37402/0 (socket says 172.21.15.26:37402) 2023-10-14T11:12:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f993dd75640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99380d1400 0x7f99380cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f993e576640 1 -- 172.21.15.26:0/2352762031 learned_addr learned my addr 172.21.15.26:0/2352762031 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:54.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f993d574640 1 --2- 172.21.15.26:0/2352762031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99380d3010 0x7f9938154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:54.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f993e576640 1 -- 172.21.15.26:0/2352762031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99380d1400 msgr2=0x7f99380cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:54.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f993e576640 1 --2- 172.21.15.26:0/2352762031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99380d1400 0x7f99380cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f993e576640 1 -- 172.21.15.26:0/2352762031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99380d3010 msgr2=0x7f9938154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:54.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f993e576640 1 --2- 172.21.15.26:0/2352762031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99380d3010 0x7f9938154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f993e576640 1 -- 172.21.15.26:0/2352762031 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9934009470 con 0x7f993815cb90 2023-10-14T11:12:54.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f993e576640 1 --2- 172.21.15.26:0/2352762031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f993815cb90 0x7f9938155430 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f993000c730 tx=0x7f993000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:54.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f992e7fc640 1 -- 172.21.15.26:0/2352762031 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9930003b80 con 0x7f993815cb90 2023-10-14T11:12:54.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f992e7fc640 1 -- 172.21.15.26:0/2352762031 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9930003ce0 con 0x7f993815cb90 2023-10-14T11:12:54.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f992e7fc640 1 -- 172.21.15.26:0/2352762031 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993000aa30 con 0x7f993815cb90 2023-10-14T11:12:54.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f993ffd9640 1 -- 172.21.15.26:0/2352762031 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99380cc0f0 con 0x7f993815cb90 2023-10-14T11:12:54.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f993ffd9640 1 -- 172.21.15.26:0/2352762031 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99380b67f0 con 0x7f993815cb90 2023-10-14T11:12:54.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.003+0000 7f993ffd9640 1 -- 172.21.15.26:0/2352762031 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9938074010 con 0x7f993815cb90 2023-10-14T11:12:54.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.007+0000 7f992e7fc640 1 -- 172.21.15.26:0/2352762031 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f993000ab90 con 0x7f993815cb90 2023-10-14T11:12:54.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.007+0000 7f992e7fc640 1 --2- 172.21.15.26:0/2352762031 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f991c0664a0 0x7f991c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:54.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.007+0000 7f992e7fc640 1 -- 172.21.15.26:0/2352762031 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9930083f10 con 0x7f993815cb90 2023-10-14T11:12:54.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.007+0000 7f993dd75640 1 --2- 172.21.15.26:0/2352762031 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f991c0664a0 0x7f991c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:54.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.007+0000 7f993dd75640 1 --2- 172.21.15.26:0/2352762031 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f991c0664a0 0x7f991c068960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f99340af000 tx=0x7f99340b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:54.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.011+0000 7f992e7fc640 1 -- 172.21.15.26:0/2352762031 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9930051020 con 0x7f993815cb90 2023-10-14T11:12:54.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.171+0000 7f993ffd9640 1 -- 172.21.15.26:0/2352762031 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99381590a0 con 0x7f993815cb90 2023-10-14T11:12:54.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.171+0000 7f992e7fc640 1 -- 172.21.15.26:0/2352762031 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f9930054640 con 0x7f993815cb90 2023-10-14T11:12:54.175 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:54.175 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":25,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:12:27.398936+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:12:54.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.171+0000 7f993ffd9640 1 -- 172.21.15.26:0/2352762031 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f991c0664a0 msgr2=0x7f991c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:54.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.171+0000 7f993ffd9640 1 --2- 172.21.15.26:0/2352762031 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f991c0664a0 0x7f991c068960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f99340af000 tx=0x7f99340b6040 comp rx=0 tx=0).stop 2023-10-14T11:12:54.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.171+0000 7f993ffd9640 1 -- 172.21.15.26:0/2352762031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f993815cb90 msgr2=0x7f9938155430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:54.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.171+0000 7f993ffd9640 1 --2- 172.21.15.26:0/2352762031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f993815cb90 0x7f9938155430 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f993000c730 tx=0x7f993000cbf0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.171+0000 7f993ffd9640 1 -- 172.21.15.26:0/2352762031 shutdown_connections 2023-10-14T11:12:54.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.171+0000 7f993ffd9640 1 --2- 172.21.15.26:0/2352762031 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f991c0664a0 0x7f991c068960 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.171+0000 7f993ffd9640 1 --2- 172.21.15.26:0/2352762031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f993815cb90 0x7f9938155430 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.171+0000 7f993ffd9640 1 --2- 172.21.15.26:0/2352762031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99380d3010 0x7f9938154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.171+0000 7f993ffd9640 1 --2- 172.21.15.26:0/2352762031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99380d1400 0x7f99380cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.171+0000 7f993ffd9640 1 -- 172.21.15.26:0/2352762031 >> 172.21.15.26:0/2352762031 conn(0x7f993809bc50 msgr2=0x7f99380b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:54.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.171+0000 7f993ffd9640 1 -- 172.21.15.26:0/2352762031 shutdown_connections 2023-10-14T11:12:54.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.171+0000 7f993ffd9640 1 -- 172.21.15.26:0/2352762031 wait complete. 2023-10-14T11:12:54.197 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:12:20.179562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:12:21.346111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T11:12:25.025159+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T11:12:54.197 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:12:54.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.339+0000 7f9d09454640 1 Processor -- start 2023-10-14T11:12:54.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.339+0000 7f9d09454640 1 -- start start 2023-10-14T11:12:54.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.339+0000 7f9d09454640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0415cc30 0x7f9d040b8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:54.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.339+0000 7f9d09454640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d040cd840 0x7f9d040cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:54.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.339+0000 7f9d09454640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9d040d0f90 0x7f9d040d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:54.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.339+0000 7f9d09454640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d0415d010 con 0x7f9d040cd840 2023-10-14T11:12:54.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.339+0000 7f9d09454640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d040b74d0 con 0x7f9d040d0f90 2023-10-14T11:12:54.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.339+0000 7f9d09454640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d040b77b0 con 0x7f9d0415cc30 2023-10-14T11:12:54.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.339+0000 7f9d027fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d040cd840 0x7f9d040cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:54.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.339+0000 7f9d027fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d040cd840 0x7f9d040cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37406/0 (socket says 172.21.15.26:37406) 2023-10-14T11:12:54.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.339+0000 7f9d027fc640 1 -- 172.21.15.26:0/3599995162 learned_addr learned my addr 172.21.15.26:0/3599995162 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:54.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.339+0000 7f9d02ffd640 1 --2- 172.21.15.26:0/3599995162 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0415cc30 0x7f9d040b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:54.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.339+0000 7f9d037fe640 1 --2- 172.21.15.26:0/3599995162 >> v2:172.21.15.110:3300/0 conn(0x7f9d040d0f90 0x7f9d040d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:54.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.339+0000 7f9d027fc640 1 -- 172.21.15.26:0/3599995162 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0415cc30 msgr2=0x7f9d040b8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:54.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.339+0000 7f9d027fc640 1 --2- 172.21.15.26:0/3599995162 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0415cc30 0x7f9d040b8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.339+0000 7f9d027fc640 1 -- 172.21.15.26:0/3599995162 >> v2:172.21.15.110:3300/0 conn(0x7f9d040d0f90 msgr2=0x7f9d040d13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:54.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.339+0000 7f9d027fc640 1 --2- 172.21.15.26:0/3599995162 >> v2:172.21.15.110:3300/0 conn(0x7f9d040d0f90 0x7f9d040d13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.339+0000 7f9d027fc640 1 -- 172.21.15.26:0/3599995162 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d040b7a90 con 0x7f9d040cd840 2023-10-14T11:12:54.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.343+0000 7f9d027fc640 1 --2- 172.21.15.26:0/3599995162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d040cd840 0x7f9d040cdc80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9d040c9bf0 tx=0x7f9cf801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7460a0db16b26e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:54.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.343+0000 7f9d01ffb640 1 -- 172.21.15.26:0/3599995162 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf80a89b0 con 0x7f9d040cd840 2023-10-14T11:12:54.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.343+0000 7f9d01ffb640 1 -- 172.21.15.26:0/3599995162 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf80a8b10 con 0x7f9d040cd840 2023-10-14T11:12:54.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.343+0000 7f9d01ffb640 1 -- 172.21.15.26:0/3599995162 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf80a8ea0 con 0x7f9d040cd840 2023-10-14T11:12:54.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.343+0000 7f9d09454640 1 -- 172.21.15.26:0/3599995162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d040cd840 msgr2=0x7f9d040cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:54.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.343+0000 7f9d09454640 1 --2- 172.21.15.26:0/3599995162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d040cd840 0x7f9d040cdc80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9d040c9bf0 tx=0x7f9cf801ecf0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.343+0000 7f9d09454640 1 -- 172.21.15.26:0/3599995162 shutdown_connections 2023-10-14T11:12:54.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.343+0000 7f9d09454640 1 --2- 172.21.15.26:0/3599995162 >> v2:172.21.15.110:3300/0 conn(0x7f9d040d0f90 0x7f9d040d13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.343+0000 7f9d09454640 1 --2- 172.21.15.26:0/3599995162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d040cd840 0x7f9d040cdc80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.343+0000 7f9d09454640 1 --2- 172.21.15.26:0/3599995162 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0415cc30 0x7f9d040b8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.343+0000 7f9d09454640 1 -- 172.21.15.26:0/3599995162 >> 172.21.15.26:0/3599995162 conn(0x7f9d0406b750 msgr2=0x7f9d0406bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:54.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.343+0000 7f9d09454640 1 -- 172.21.15.26:0/3599995162 shutdown_connections 2023-10-14T11:12:54.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.343+0000 7f9d09454640 1 -- 172.21.15.26:0/3599995162 wait complete. 2023-10-14T11:12:54.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9d09454640 1 Processor -- start 2023-10-14T11:12:54.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9d09454640 1 -- start start 2023-10-14T11:12:54.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9d09454640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d040cd840 0x7f9d040c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:54.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9d09454640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d040d0f90 0x7f9d040cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:54.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9d09454640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0415cc30 0x7f9d04147340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:54.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9d09454640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d040cb800 con 0x7f9d040d0f90 2023-10-14T11:12:54.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9d09454640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d040ca220 con 0x7f9d040cd840 2023-10-14T11:12:54.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9d09454640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d040ca500 con 0x7f9d0415cc30 2023-10-14T11:12:54.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9d027fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d040d0f90 0x7f9d040cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:54.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9d027fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d040d0f90 0x7f9d040cb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37422/0 (socket says 172.21.15.26:37422) 2023-10-14T11:12:54.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9d027fc640 1 -- 172.21.15.26:0/2563849992 learned_addr learned my addr 172.21.15.26:0/2563849992 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:54.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9d037fe640 1 --2- 172.21.15.26:0/2563849992 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0415cc30 0x7f9d04147340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:54.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9d02ffd640 1 --2- 172.21.15.26:0/2563849992 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d040cd840 0x7f9d040c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:54.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9d027fc640 1 -- 172.21.15.26:0/2563849992 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0415cc30 msgr2=0x7f9d04147340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:54.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9d027fc640 1 --2- 172.21.15.26:0/2563849992 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0415cc30 0x7f9d04147340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9d027fc640 1 -- 172.21.15.26:0/2563849992 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d040cd840 msgr2=0x7f9d040c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:54.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9d027fc640 1 --2- 172.21.15.26:0/2563849992 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d040cd840 0x7f9d040c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9d027fc640 1 -- 172.21.15.26:0/2563849992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf80094d0 con 0x7f9d040d0f90 2023-10-14T11:12:54.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9d027fc640 1 --2- 172.21.15.26:0/2563849992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d040d0f90 0x7f9d040cb2c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9cf80b3040 tx=0x7f9cf801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:54.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9ceb7fe640 1 -- 172.21.15.26:0/2563849992 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf80b0d60 con 0x7f9d040d0f90 2023-10-14T11:12:54.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9ceb7fe640 1 -- 172.21.15.26:0/2563849992 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf80bb460 con 0x7f9d040d0f90 2023-10-14T11:12:54.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9ceb7fe640 1 -- 172.21.15.26:0/2563849992 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf80bb810 con 0x7f9d040d0f90 2023-10-14T11:12:54.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.347+0000 7f9d09454640 1 -- 172.21.15.26:0/2563849992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d040ca7e0 con 0x7f9d040d0f90 2023-10-14T11:12:54.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.351+0000 7f9d09454640 1 -- 172.21.15.26:0/2563849992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d040cada0 con 0x7f9d040d0f90 2023-10-14T11:12:54.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.351+0000 7f9d09454640 1 -- 172.21.15.26:0/2563849992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d040b7260 con 0x7f9d040d0f90 2023-10-14T11:12:54.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.351+0000 7f9ceb7fe640 1 -- 172.21.15.26:0/2563849992 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9cf80b83f0 con 0x7f9d040d0f90 2023-10-14T11:12:54.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.351+0000 7f9ceb7fe640 1 --2- 172.21.15.26:0/2563849992 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9cf00664a0 0x7f9cf0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:54.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.351+0000 7f9ceb7fe640 1 -- 172.21.15.26:0/2563849992 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9cf81219a0 con 0x7f9d040d0f90 2023-10-14T11:12:54.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.351+0000 7f9d02ffd640 1 --2- 172.21.15.26:0/2563849992 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9cf00664a0 0x7f9cf0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:54.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.351+0000 7f9d02ffd640 1 --2- 172.21.15.26:0/2563849992 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9cf00664a0 0x7f9cf0068960 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4009a40 tx=0x7f9cf4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:54.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.355+0000 7f9ceb7fe640 1 -- 172.21.15.26:0/2563849992 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9cf80eeb40 con 0x7f9d040d0f90 2023-10-14T11:12:54.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.511+0000 7f9d09454640 1 -- 172.21.15.26:0/2563849992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9d040caf90 con 0x7f9d040d0f90 2023-10-14T11:12:54.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.511+0000 7f9ceb7fe640 1 -- 172.21.15.26:0/2563849992 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9cf80b5020 con 0x7f9d040d0f90 2023-10-14T11:12:54.516 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:12:54.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.515+0000 7f9d09454640 1 -- 172.21.15.26:0/2563849992 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9cf00664a0 msgr2=0x7f9cf0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:54.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.515+0000 7f9d09454640 1 --2- 172.21.15.26:0/2563849992 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9cf00664a0 0x7f9cf0068960 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4009a40 tx=0x7f9cf4009190 comp rx=0 tx=0).stop 2023-10-14T11:12:54.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.515+0000 7f9d09454640 1 -- 172.21.15.26:0/2563849992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d040d0f90 msgr2=0x7f9d040cb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:54.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.515+0000 7f9d09454640 1 --2- 172.21.15.26:0/2563849992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d040d0f90 0x7f9d040cb2c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9cf80b3040 tx=0x7f9cf801ba90 comp rx=0 tx=0).stop 2023-10-14T11:12:54.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.515+0000 7f9d09454640 1 -- 172.21.15.26:0/2563849992 shutdown_connections 2023-10-14T11:12:54.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.515+0000 7f9d09454640 1 --2- 172.21.15.26:0/2563849992 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0415cc30 0x7f9d04147340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.515+0000 7f9d09454640 1 --2- 172.21.15.26:0/2563849992 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9cf00664a0 0x7f9cf0068960 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.515+0000 7f9d09454640 1 --2- 172.21.15.26:0/2563849992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d040d0f90 0x7f9d040cb2c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.515+0000 7f9d09454640 1 --2- 172.21.15.26:0/2563849992 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d040cd840 0x7f9d040c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.515+0000 7f9d09454640 1 -- 172.21.15.26:0/2563849992 >> 172.21.15.26:0/2563849992 conn(0x7f9d0406b750 msgr2=0x7f9d040d1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.515+0000 7f9d09454640 1 -- 172.21.15.26:0/2563849992 shutdown_connections 2023-10-14T11:12:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.515+0000 7f9d09454640 1 -- 172.21.15.26:0/2563849992 wait complete. 2023-10-14T11:12:54.537 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:12:54.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.679+0000 7ff79013e640 1 Processor -- start 2023-10-14T11:12:54.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.679+0000 7ff79013e640 1 -- start start 2023-10-14T11:12:54.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.679+0000 7ff79013e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff78806a4d0 0x7ff7880c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:54.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.679+0000 7ff79013e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78806c6d0 con 0x7ff7880ade00 2023-10-14T11:12:54.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.679+0000 7ff79013e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78806c950 con 0x7ff78806a0f0 2023-10-14T11:12:54.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.679+0000 7ff79013e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7881654f0 con 0x7ff78806a4d0 2023-10-14T11:12:54.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.679+0000 7ff78d6d9640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff7880ade00 0x7ff78806ce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38820/0 (socket says 172.21.15.26:38820) 2023-10-14T11:12:54.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.679+0000 7ff78d6d9640 1 -- 172.21.15.26:0/44138865 learned_addr learned my addr 172.21.15.26:0/44138865 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:54.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.679+0000 7ff78e6db640 1 --2- 172.21.15.26:0/44138865 >> v2:172.21.15.110:3300/0 conn(0x7ff78806a4d0 0x7ff7880c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:54.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.679+0000 7ff78ced8640 1 -- 172.21.15.26:0/44138865 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437385827 0 0) 0x7ff78806c6d0 con 0x7ff7880ade00 2023-10-14T11:12:54.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.679+0000 7ff78ced8640 1 -- 172.21.15.26:0/44138865 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff774003530 con 0x7ff7880ade00 2023-10-14T11:12:54.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.683+0000 7ff78e6db640 1 -- 172.21.15.26:0/44138865 >> v1:172.21.15.110:6789/0 conn(0x7ff78806a0f0 legacy=0x7ff7880ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:54.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.683+0000 7ff78e6db640 1 -- 172.21.15.26:0/44138865 >> v1:172.21.15.26:6789/0 conn(0x7ff7880ade00 legacy=0x7ff78806ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:54.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.683+0000 7ff78ced8640 1 -- 172.21.15.26:0/44138865 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2090878150 0 0) 0x7ff774003530 con 0x7ff7880ade00 2023-10-14T11:12:54.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.683+0000 7ff78e6db640 1 -- 172.21.15.26:0/44138865 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7881657d0 con 0x7ff78806a4d0 2023-10-14T11:12:54.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.683+0000 7ff78e6db640 1 --2- 172.21.15.26:0/44138865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff78806a4d0 0x7ff7880c8dd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff780009d90 tx=0x7ff78001c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6e698b6fed12669 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:54.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.683+0000 7ff78ced8640 1 -- 172.21.15.26:0/44138865 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff778001680 con 0x7ff78806a4d0 2023-10-14T11:12:54.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.683+0000 7ff78ced8640 1 -- 172.21.15.26:0/44138865 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7800a56d0 con 0x7ff78806a4d0 2023-10-14T11:12:54.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.683+0000 7ff78ced8640 1 -- 172.21.15.26:0/44138865 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7800a5a60 con 0x7ff78806a4d0 2023-10-14T11:12:54.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.683+0000 7ff79013e640 1 -- 172.21.15.26:0/44138865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff78806a4d0 msgr2=0x7ff7880c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:54.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.683+0000 7ff79013e640 1 --2- 172.21.15.26:0/44138865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff78806a4d0 0x7ff7880c8dd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff780009d90 tx=0x7ff78001c870 comp rx=0 tx=0).stop 2023-10-14T11:12:54.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.683+0000 7ff79013e640 1 -- 172.21.15.26:0/44138865 shutdown_connections 2023-10-14T11:12:54.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.683+0000 7ff79013e640 1 --2- 172.21.15.26:0/44138865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff78806a4d0 0x7ff7880c8dd0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.683+0000 7ff79013e640 1 -- 172.21.15.26:0/44138865 >> 172.21.15.26:0/44138865 conn(0x7ff7880b0da0 msgr2=0x7ff7880ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:54.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.687+0000 7ff79013e640 1 -- 172.21.15.26:0/44138865 shutdown_connections 2023-10-14T11:12:54.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.687+0000 7ff79013e640 1 -- 172.21.15.26:0/44138865 wait complete. 2023-10-14T11:12:54.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.687+0000 7ff79013e640 1 Processor -- start 2023-10-14T11:12:54.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.687+0000 7ff79013e640 1 -- start start 2023-10-14T11:12:54.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.687+0000 7ff79013e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff78806a0f0 0x7ff7880b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:54.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.687+0000 7ff79013e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff78806a4d0 0x7ff788162e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:54.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.687+0000 7ff79013e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7880ade00 0x7ff78815c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:54.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.687+0000 7ff79013e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7881644f0 con 0x7ff78806a0f0 2023-10-14T11:12:54.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.687+0000 7ff79013e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff788163870 con 0x7ff78806a4d0 2023-10-14T11:12:54.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.687+0000 7ff79013e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff788163b50 con 0x7ff7880ade00 2023-10-14T11:12:54.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.687+0000 7ff78deda640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff78806a0f0 0x7ff7880b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:54.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.687+0000 7ff78deda640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff78806a0f0 0x7ff7880b3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37434/0 (socket says 172.21.15.26:37434) 2023-10-14T11:12:54.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.687+0000 7ff78deda640 1 -- 172.21.15.26:0/1805789608 learned_addr learned my addr 172.21.15.26:0/1805789608 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:54.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.687+0000 7ff78e6db640 1 --2- 172.21.15.26:0/1805789608 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7880ade00 0x7ff78815c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:54.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.687+0000 7ff78d6d9640 1 --2- 172.21.15.26:0/1805789608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff78806a4d0 0x7ff788162e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:54.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.687+0000 7ff78deda640 1 -- 172.21.15.26:0/1805789608 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7880ade00 msgr2=0x7ff78815c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:54.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.687+0000 7ff78deda640 1 --2- 172.21.15.26:0/1805789608 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7880ade00 0x7ff78815c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.687+0000 7ff78deda640 1 -- 172.21.15.26:0/1805789608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff78806a4d0 msgr2=0x7ff788162e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:54.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.687+0000 7ff78deda640 1 --2- 172.21.15.26:0/1805789608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff78806a4d0 0x7ff788162e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.687+0000 7ff78deda640 1 -- 172.21.15.26:0/1805789608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff780009a70 con 0x7ff78806a0f0 2023-10-14T11:12:54.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.687+0000 7ff78deda640 1 --2- 172.21.15.26:0/1805789608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff78806a0f0 0x7ff7880b3a80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff78400c500 tx=0x7ff78400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:54.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.691+0000 7ff77e7fc640 1 -- 172.21.15.26:0/1805789608 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff784005220 con 0x7ff78806a0f0 2023-10-14T11:12:54.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.691+0000 7ff77e7fc640 1 -- 172.21.15.26:0/1805789608 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff784005380 con 0x7ff78806a0f0 2023-10-14T11:12:54.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.691+0000 7ff77e7fc640 1 -- 172.21.15.26:0/1805789608 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff784007270 con 0x7ff78806a0f0 2023-10-14T11:12:54.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.691+0000 7ff79013e640 1 -- 172.21.15.26:0/1805789608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff788163e30 con 0x7ff78806a0f0 2023-10-14T11:12:54.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.691+0000 7ff79013e640 1 -- 172.21.15.26:0/1805789608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78815d530 con 0x7ff78806a0f0 2023-10-14T11:12:54.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.691+0000 7ff79013e640 1 -- 172.21.15.26:0/1805789608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78804e170 con 0x7ff78806a0f0 2023-10-14T11:12:54.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.691+0000 7ff77e7fc640 1 -- 172.21.15.26:0/1805789608 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff7840073d0 con 0x7ff78806a0f0 2023-10-14T11:12:54.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.691+0000 7ff77e7fc640 1 --2- 172.21.15.26:0/1805789608 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff76c0664a0 0x7ff76c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:54.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.691+0000 7ff77e7fc640 1 -- 172.21.15.26:0/1805789608 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff784083af0 con 0x7ff78806a0f0 2023-10-14T11:12:54.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.691+0000 7ff78d6d9640 1 --2- 172.21.15.26:0/1805789608 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff76c0664a0 0x7ff76c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.691+0000 7ff78d6d9640 1 --2- 172.21.15.26:0/1805789608 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff76c0664a0 0x7ff76c068960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff7880addd0 tx=0x7ff778009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.695+0000 7ff77e7fc640 1 -- 172.21.15.26:0/1805789608 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff784050bf0 con 0x7ff78806a0f0 2023-10-14T11:12:54.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.855+0000 7ff79013e640 1 -- 172.21.15.26:0/1805789608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff788070e50 con 0x7ff78806a0f0 2023-10-14T11:12:54.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.855+0000 7ff77e7fc640 1 -- 172.21.15.26:0/1805789608 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff784054210 con 0x7ff78806a0f0 2023-10-14T11:12:54.860 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:12:54.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.859+0000 7ff79013e640 1 -- 172.21.15.26:0/1805789608 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff76c0664a0 msgr2=0x7ff76c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:54.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.859+0000 7ff79013e640 1 --2- 172.21.15.26:0/1805789608 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff76c0664a0 0x7ff76c068960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff7880addd0 tx=0x7ff778009040 comp rx=0 tx=0).stop 2023-10-14T11:12:54.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.859+0000 7ff79013e640 1 -- 172.21.15.26:0/1805789608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff78806a0f0 msgr2=0x7ff7880b3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:54.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.859+0000 7ff79013e640 1 --2- 172.21.15.26:0/1805789608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff78806a0f0 0x7ff7880b3a80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff78400c500 tx=0x7ff78400c9c0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.859+0000 7ff79013e640 1 -- 172.21.15.26:0/1805789608 shutdown_connections 2023-10-14T11:12:54.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.859+0000 7ff79013e640 1 --2- 172.21.15.26:0/1805789608 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7880ade00 0x7ff78815c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.859+0000 7ff79013e640 1 --2- 172.21.15.26:0/1805789608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff78806a4d0 0x7ff788162e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.859+0000 7ff79013e640 1 --2- 172.21.15.26:0/1805789608 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff76c0664a0 0x7ff76c068960 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.859+0000 7ff79013e640 1 --2- 172.21.15.26:0/1805789608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff78806a0f0 0x7ff7880b3a80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:54.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.859+0000 7ff79013e640 1 -- 172.21.15.26:0/1805789608 >> 172.21.15.26:0/1805789608 conn(0x7ff7880b0da0 msgr2=0x7ff7880701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:54.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.859+0000 7ff79013e640 1 -- 172.21.15.26:0/1805789608 shutdown_connections 2023-10-14T11:12:54.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:54.859+0000 7ff79013e640 1 -- 172.21.15.26:0/1805789608 wait complete. 2023-10-14T11:12:54.880 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:12:55.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.027+0000 7f51a14d6640 1 Processor -- start 2023-10-14T11:12:55.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.027+0000 7f51a14d6640 1 -- start start 2023-10-14T11:12:55.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.027+0000 7f51a14d6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f519c159900 0x7f519c06e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:55.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.027+0000 7f51a14d6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f519c06a5a0 0x7f519c0c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:55.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.027+0000 7f51a14d6640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519c0b4390 con 0x7f519c0b3f00 2023-10-14T11:12:55.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.027+0000 7f51a14d6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519c0cd740 con 0x7f519c159900 2023-10-14T11:12:55.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.027+0000 7f51a14d6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519c0b4600 con 0x7f519c06a5a0 2023-10-14T11:12:55.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.027+0000 7f5193fff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f519c0b3f00 0x7f519c069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:43400/0 (socket says 172.21.15.26:43400) 2023-10-14T11:12:55.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.027+0000 7f5193fff640 1 -- 172.21.15.26:0/381470259 learned_addr learned my addr 172.21.15.26:0/381470259 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:55.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.027+0000 7f519b7fe640 1 --2- 172.21.15.26:0/381470259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f519c06a5a0 0x7f519c0c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:55.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.027+0000 7f519affd640 1 --2- 172.21.15.26:0/381470259 >> v2:172.21.15.110:3300/0 conn(0x7f519c159900 0x7f519c06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:55.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.027+0000 7f519a7fc640 1 -- 172.21.15.26:0/381470259 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249537027 0 0) 0x7f519c0b4390 con 0x7f519c0b3f00 2023-10-14T11:12:55.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.027+0000 7f519a7fc640 1 -- 172.21.15.26:0/381470259 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5188003530 con 0x7f519c0b3f00 2023-10-14T11:12:55.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.027+0000 7f519affd640 1 -- 172.21.15.26:0/381470259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f519c06a5a0 msgr2=0x7f519c0c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:55.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.027+0000 7f519affd640 1 --2- 172.21.15.26:0/381470259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f519c06a5a0 0x7f519c0c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.027+0000 7f519affd640 1 -- 172.21.15.26:0/381470259 >> v1:172.21.15.110:6789/0 conn(0x7f519c0b3f00 legacy=0x7f519c069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:55.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.027+0000 7f519affd640 1 -- 172.21.15.26:0/381470259 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c0c8dd0 con 0x7f519c159900 2023-10-14T11:12:55.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.027+0000 7f519b7fe640 1 --2- 172.21.15.26:0/381470259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f519c06a5a0 0x7f519c0c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:12:55.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.031+0000 7f519affd640 1 --2- 172.21.15.26:0/381470259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f519c159900 0x7f519c06e260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f518c0097c0 tx=0x7f518c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dabfec50f16b3349 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:55.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.031+0000 7f519a7fc640 1 -- 172.21.15.26:0/381470259 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c0ab650 con 0x7f519c159900 2023-10-14T11:12:55.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.031+0000 7f519a7fc640 1 -- 172.21.15.26:0/381470259 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518c0ab7b0 con 0x7f519c159900 2023-10-14T11:12:55.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.031+0000 7f519a7fc640 1 -- 172.21.15.26:0/381470259 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c0abb40 con 0x7f519c159900 2023-10-14T11:12:55.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.031+0000 7f51a14d6640 1 -- 172.21.15.26:0/381470259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f519c159900 msgr2=0x7f519c06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:55.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.031+0000 7f51a14d6640 1 --2- 172.21.15.26:0/381470259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f519c159900 0x7f519c06e260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f518c0097c0 tx=0x7f518c01c450 comp rx=0 tx=0).stop 2023-10-14T11:12:55.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.031+0000 7f51a14d6640 1 -- 172.21.15.26:0/381470259 shutdown_connections 2023-10-14T11:12:55.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.031+0000 7f51a14d6640 1 --2- 172.21.15.26:0/381470259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f519c06a5a0 0x7f519c0c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.031+0000 7f51a14d6640 1 --2- 172.21.15.26:0/381470259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f519c159900 0x7f519c06e260 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.031+0000 7f51a14d6640 1 -- 172.21.15.26:0/381470259 >> 172.21.15.26:0/381470259 conn(0x7f519c0b0da0 msgr2=0x7f519c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:55.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.031+0000 7f51a14d6640 1 -- 172.21.15.26:0/381470259 shutdown_connections 2023-10-14T11:12:55.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.031+0000 7f51a14d6640 1 -- 172.21.15.26:0/381470259 wait complete. 2023-10-14T11:12:55.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f51a14d6640 1 Processor -- start 2023-10-14T11:12:55.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f51a14d6640 1 -- start start 2023-10-14T11:12:55.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f51a14d6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f519c06a5a0 0x7f519c0aec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:55.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f51a14d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519c0b3f00 0x7f519c0c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:55.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f51a14d6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f519c159900 0x7f519c1548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:55.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f51a14d6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c1665c0 con 0x7f519c0b3f00 2023-10-14T11:12:55.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f51a14d6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c0c84e0 con 0x7f519c06a5a0 2023-10-14T11:12:55.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f51a14d6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519c166810 con 0x7f519c159900 2023-10-14T11:12:55.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f5193fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519c0b3f00 0x7f519c0c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:55.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f5193fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519c0b3f00 0x7f519c0c7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37442/0 (socket says 172.21.15.26:37442) 2023-10-14T11:12:55.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f5193fff640 1 -- 172.21.15.26:0/3110215880 learned_addr learned my addr 172.21.15.26:0/3110215880 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:55.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f519b7fe640 1 --2- 172.21.15.26:0/3110215880 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f519c159900 0x7f519c1548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:55.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f519affd640 1 --2- 172.21.15.26:0/3110215880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f519c06a5a0 0x7f519c0aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:55.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f5193fff640 1 -- 172.21.15.26:0/3110215880 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f519c159900 msgr2=0x7f519c1548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:55.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f5193fff640 1 --2- 172.21.15.26:0/3110215880 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f519c159900 0x7f519c1548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f5193fff640 1 -- 172.21.15.26:0/3110215880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f519c06a5a0 msgr2=0x7f519c0aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:55.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f5193fff640 1 --2- 172.21.15.26:0/3110215880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f519c06a5a0 0x7f519c0aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f5193fff640 1 -- 172.21.15.26:0/3110215880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5194009a70 con 0x7f519c0b3f00 2023-10-14T11:12:55.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f519b7fe640 1 --2- 172.21.15.26:0/3110215880 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f519c159900 0x7f519c1548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:55.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f5193fff640 1 --2- 172.21.15.26:0/3110215880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519c0b3f00 0x7f519c0c7ab0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f518400c4d0 tx=0x7f518400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:55.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f51937fe640 1 -- 172.21.15.26:0/3110215880 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5184005cf0 con 0x7f519c0b3f00 2023-10-14T11:12:55.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f51937fe640 1 -- 172.21.15.26:0/3110215880 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5184005e50 con 0x7f519c0b3f00 2023-10-14T11:12:55.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f51a14d6640 1 -- 172.21.15.26:0/3110215880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f518c009420 con 0x7f519c0b3f00 2023-10-14T11:12:55.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f51937fe640 1 -- 172.21.15.26:0/3110215880 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5184007270 con 0x7f519c0b3f00 2023-10-14T11:12:55.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.035+0000 7f51a14d6640 1 -- 172.21.15.26:0/3110215880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519c166dd0 con 0x7f519c0b3f00 2023-10-14T11:12:55.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.039+0000 7f51a14d6640 1 -- 172.21.15.26:0/3110215880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519c166fc0 con 0x7f519c0b3f00 2023-10-14T11:12:55.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.039+0000 7f51937fe640 1 -- 172.21.15.26:0/3110215880 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f51840073d0 con 0x7f519c0b3f00 2023-10-14T11:12:55.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.039+0000 7f51937fe640 1 --2- 172.21.15.26:0/3110215880 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f517c0664a0 0x7f517c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:55.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.039+0000 7f51937fe640 1 -- 172.21.15.26:0/3110215880 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5184083760 con 0x7f519c0b3f00 2023-10-14T11:12:55.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.039+0000 7f519affd640 1 --2- 172.21.15.26:0/3110215880 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f517c0664a0 0x7f517c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:55.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.039+0000 7f519affd640 1 --2- 172.21.15.26:0/3110215880 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f517c0664a0 0x7f517c068960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f518c0af000 tx=0x7f518c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:55.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.043+0000 7f51937fe640 1 -- 172.21.15.26:0/3110215880 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5184050880 con 0x7f519c0b3f00 2023-10-14T11:12:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.199+0000 7f51a14d6640 1 -- 172.21.15.26:0/3110215880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f519c04e170 con 0x7f519c0b3f00 2023-10-14T11:12:55.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.199+0000 7f51937fe640 1 -- 172.21.15.26:0/3110215880 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5184053ea0 con 0x7f519c0b3f00 2023-10-14T11:12:55.205 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:12:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.203+0000 7f51a14d6640 1 -- 172.21.15.26:0/3110215880 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f517c0664a0 msgr2=0x7f517c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.203+0000 7f51a14d6640 1 --2- 172.21.15.26:0/3110215880 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f517c0664a0 0x7f517c068960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f518c0af000 tx=0x7f518c0a7000 comp rx=0 tx=0).stop 2023-10-14T11:12:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.203+0000 7f51a14d6640 1 -- 172.21.15.26:0/3110215880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519c0b3f00 msgr2=0x7f519c0c7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.203+0000 7f51a14d6640 1 --2- 172.21.15.26:0/3110215880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519c0b3f00 0x7f519c0c7ab0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f518400c4d0 tx=0x7f518400c990 comp rx=0 tx=0).stop 2023-10-14T11:12:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.203+0000 7f51a14d6640 1 -- 172.21.15.26:0/3110215880 shutdown_connections 2023-10-14T11:12:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.203+0000 7f51a14d6640 1 --2- 172.21.15.26:0/3110215880 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f519c159900 0x7f519c1548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.203+0000 7f51a14d6640 1 --2- 172.21.15.26:0/3110215880 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f517c0664a0 0x7f517c068960 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.203+0000 7f51a14d6640 1 --2- 172.21.15.26:0/3110215880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519c0b3f00 0x7f519c0c7ab0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.203+0000 7f51a14d6640 1 --2- 172.21.15.26:0/3110215880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f519c06a5a0 0x7f519c0aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.203+0000 7f51a14d6640 1 -- 172.21.15.26:0/3110215880 >> 172.21.15.26:0/3110215880 conn(0x7f519c0b0da0 msgr2=0x7f519c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:55.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.203+0000 7f51a14d6640 1 -- 172.21.15.26:0/3110215880 shutdown_connections 2023-10-14T11:12:55.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.203+0000 7f51a14d6640 1 -- 172.21.15.26:0/3110215880 wait complete. 2023-10-14T11:12:55.226 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T11:12:55.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.371+0000 7f1db0d65640 1 Processor -- start 2023-10-14T11:12:55.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.371+0000 7f1db0d65640 1 -- start start 2023-10-14T11:12:55.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.375+0000 7f1db0d65640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dac069e90 0x7f1dac06d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:55.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.375+0000 7f1db0d65640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1dac0c26b0 0x7f1dac0c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:55.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.375+0000 7f1db0d65640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dac15ae30 con 0x7f1dac06a270 2023-10-14T11:12:55.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.375+0000 7f1db0d65640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dac0cb090 con 0x7f1dac0c26b0 2023-10-14T11:12:55.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.375+0000 7f1db0d65640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac0ca510 con 0x7f1dac069e90 2023-10-14T11:12:55.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.375+0000 7f1daad9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1dac0c26b0 0x7f1dac0c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:55.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.375+0000 7f1daad9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1dac0c26b0 0x7f1dac0c2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37456/0 (socket says 172.21.15.26:37456) 2023-10-14T11:12:55.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.375+0000 7f1daad9d640 1 -- 172.21.15.26:0/2223711433 learned_addr learned my addr 172.21.15.26:0/2223711433 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:55.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.375+0000 7f1daa59c640 1 --2- 172.21.15.26:0/2223711433 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dac069e90 0x7f1dac06d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:55.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.375+0000 7f1daad9d640 1 -- 172.21.15.26:0/2223711433 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dac069e90 msgr2=0x7f1dac06d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:55.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.375+0000 7f1daad9d640 1 --2- 172.21.15.26:0/2223711433 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dac069e90 0x7f1dac06d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.375+0000 7f1daad9d640 1 -- 172.21.15.26:0/2223711433 >> v1:172.21.15.110:6789/0 conn(0x7f1dac06a270 legacy=0x7f1dac0c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:55.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.375+0000 7f1daad9d640 1 -- 172.21.15.26:0/2223711433 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac0ca7f0 con 0x7f1dac0c26b0 2023-10-14T11:12:55.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.375+0000 7f1daa59c640 1 --2- 172.21.15.26:0/2223711433 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dac069e90 0x7f1dac06d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:55.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.375+0000 7f1daad9d640 1 --2- 172.21.15.26:0/2223711433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dac0c26b0 0x7f1dac0c2b40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009e50 tx=0x7f1da401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c48df9d577f90e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:55.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.379+0000 7f1da9d9b640 1 -- 172.21.15.26:0/2223711433 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da40a5820 con 0x7f1dac0c26b0 2023-10-14T11:12:55.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.379+0000 7f1da9d9b640 1 -- 172.21.15.26:0/2223711433 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da40a5980 con 0x7f1dac0c26b0 2023-10-14T11:12:55.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.379+0000 7f1da9d9b640 1 -- 172.21.15.26:0/2223711433 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da40a5d10 con 0x7f1dac0c26b0 2023-10-14T11:12:55.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.379+0000 7f1db0d65640 1 -- 172.21.15.26:0/2223711433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dac0c26b0 msgr2=0x7f1dac0c2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:55.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.379+0000 7f1db0d65640 1 --2- 172.21.15.26:0/2223711433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dac0c26b0 0x7f1dac0c2b40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009e50 tx=0x7f1da401c9a0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.379+0000 7f1db0d65640 1 -- 172.21.15.26:0/2223711433 shutdown_connections 2023-10-14T11:12:55.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.379+0000 7f1db0d65640 1 --2- 172.21.15.26:0/2223711433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dac0c26b0 0x7f1dac0c2b40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.379+0000 7f1db0d65640 1 --2- 172.21.15.26:0/2223711433 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dac069e90 0x7f1dac06d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.379+0000 7f1db0d65640 1 -- 172.21.15.26:0/2223711433 >> 172.21.15.26:0/2223711433 conn(0x7f1dac0b0da0 msgr2=0x7f1dac0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:55.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.379+0000 7f1db0d65640 1 -- 172.21.15.26:0/2223711433 shutdown_connections 2023-10-14T11:12:55.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.379+0000 7f1db0d65640 1 -- 172.21.15.26:0/2223711433 wait complete. 2023-10-14T11:12:55.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.379+0000 7f1db0d65640 1 Processor -- start 2023-10-14T11:12:55.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.379+0000 7f1db0d65640 1 -- start start 2023-10-14T11:12:55.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.379+0000 7f1db0d65640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dac069e90 0x7f1dac15b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:55.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.379+0000 7f1db0d65640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dac06a270 0x7f1dac153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:55.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.379+0000 7f1db0d65640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dac0c26b0 0x7f1dac155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:55.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.379+0000 7f1db0d65640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac13ec60 con 0x7f1dac069e90 2023-10-14T11:12:55.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.379+0000 7f1db0d65640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac153a90 con 0x7f1dac06a270 2023-10-14T11:12:55.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.379+0000 7f1db0d65640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac15be20 con 0x7f1dac0c26b0 2023-10-14T11:12:55.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.379+0000 7f1daa59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dac069e90 0x7f1dac15b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:55.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.379+0000 7f1daa59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dac069e90 0x7f1dac15b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37458/0 (socket says 172.21.15.26:37458) 2023-10-14T11:12:55.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.379+0000 7f1daa59c640 1 -- 172.21.15.26:0/3294085470 learned_addr learned my addr 172.21.15.26:0/3294085470 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:55.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.383+0000 7f1daad9d640 1 --2- 172.21.15.26:0/3294085470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dac0c26b0 0x7f1dac155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:55.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.383+0000 7f1da3fff640 1 --2- 172.21.15.26:0/3294085470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dac06a270 0x7f1dac153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:55.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.383+0000 7f1daa59c640 1 -- 172.21.15.26:0/3294085470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dac0c26b0 msgr2=0x7f1dac155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:55.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.383+0000 7f1daa59c640 1 --2- 172.21.15.26:0/3294085470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dac0c26b0 0x7f1dac155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.383+0000 7f1daa59c640 1 -- 172.21.15.26:0/3294085470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dac06a270 msgr2=0x7f1dac153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:55.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.383+0000 7f1daa59c640 1 --2- 172.21.15.26:0/3294085470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dac06a270 0x7f1dac153eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.383+0000 7f1daa59c640 1 -- 172.21.15.26:0/3294085470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da4009b30 con 0x7f1dac069e90 2023-10-14T11:12:55.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.383+0000 7f1daad9d640 1 --2- 172.21.15.26:0/3294085470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dac0c26b0 0x7f1dac155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:55.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.383+0000 7f1da3fff640 1 --2- 172.21.15.26:0/3294085470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dac06a270 0x7f1dac153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:55.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.383+0000 7f1daa59c640 1 --2- 172.21.15.26:0/3294085470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dac069e90 0x7f1dac15b010 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00c7f0 tx=0x7f1d9c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:55.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.383+0000 7f1da2ffd640 1 -- 172.21.15.26:0/3294085470 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c00cea0 con 0x7f1dac069e90 2023-10-14T11:12:55.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.383+0000 7f1da2ffd640 1 -- 172.21.15.26:0/3294085470 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9c007a30 con 0x7f1dac069e90 2023-10-14T11:12:55.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.383+0000 7f1db0d65640 1 -- 172.21.15.26:0/3294085470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dac15b860 con 0x7f1dac069e90 2023-10-14T11:12:55.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.383+0000 7f1da2ffd640 1 -- 172.21.15.26:0/3294085470 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c007de0 con 0x7f1dac069e90 2023-10-14T11:12:55.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.383+0000 7f1db0d65640 1 -- 172.21.15.26:0/3294085470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dac1536b0 con 0x7f1dac069e90 2023-10-14T11:12:55.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.383+0000 7f1db0d65640 1 -- 172.21.15.26:0/3294085470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dac153510 con 0x7f1dac069e90 2023-10-14T11:12:55.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.383+0000 7f1da2ffd640 1 -- 172.21.15.26:0/3294085470 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1d9c0113f0 con 0x7f1dac069e90 2023-10-14T11:12:55.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.383+0000 7f1da2ffd640 1 --2- 172.21.15.26:0/3294085470 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d8c0664a0 0x7f1d8c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:55.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.383+0000 7f1da2ffd640 1 -- 172.21.15.26:0/3294085470 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1d9c084160 con 0x7f1dac069e90 2023-10-14T11:12:55.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.387+0000 7f1da3fff640 1 --2- 172.21.15.26:0/3294085470 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d8c0664a0 0x7f1d8c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:55.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.387+0000 7f1da3fff640 1 --2- 172.21.15.26:0/3294085470 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d8c0664a0 0x7f1d8c068960 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1dac154f20 tx=0x7f1d94009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:55.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.387+0000 7f1da2ffd640 1 -- 172.21.15.26:0/3294085470 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1dac153510 con 0x7f1dac069e90 2023-10-14T11:12:55.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.543+0000 7f1db0d65640 1 -- 172.21.15.26:0/3294085470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1dac06a6b0 con 0x7f1dac069e90 2023-10-14T11:12:55.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.543+0000 7f1da2ffd640 1 -- 172.21.15.26:0/3294085470 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1dac06a6b0 con 0x7f1dac069e90 2023-10-14T11:12:55.549 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:12:55.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.547+0000 7f1db0d65640 1 -- 172.21.15.26:0/3294085470 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d8c0664a0 msgr2=0x7f1d8c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:55.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.547+0000 7f1db0d65640 1 --2- 172.21.15.26:0/3294085470 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d8c0664a0 0x7f1d8c068960 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1dac154f20 tx=0x7f1d94009040 comp rx=0 tx=0).stop 2023-10-14T11:12:55.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.547+0000 7f1db0d65640 1 -- 172.21.15.26:0/3294085470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dac069e90 msgr2=0x7f1dac15b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:55.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.547+0000 7f1db0d65640 1 --2- 172.21.15.26:0/3294085470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dac069e90 0x7f1dac15b010 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00c7f0 tx=0x7f1d9c00ccb0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.547+0000 7f1db0d65640 1 -- 172.21.15.26:0/3294085470 shutdown_connections 2023-10-14T11:12:55.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.547+0000 7f1db0d65640 1 --2- 172.21.15.26:0/3294085470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dac0c26b0 0x7f1dac155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.547+0000 7f1db0d65640 1 --2- 172.21.15.26:0/3294085470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dac06a270 0x7f1dac153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.547+0000 7f1db0d65640 1 --2- 172.21.15.26:0/3294085470 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d8c0664a0 0x7f1d8c068960 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.547+0000 7f1db0d65640 1 --2- 172.21.15.26:0/3294085470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dac069e90 0x7f1dac15b010 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.547+0000 7f1db0d65640 1 -- 172.21.15.26:0/3294085470 >> 172.21.15.26:0/3294085470 conn(0x7f1dac0b0da0 msgr2=0x7f1dac15a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:55.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.547+0000 7f1db0d65640 1 -- 172.21.15.26:0/3294085470 shutdown_connections 2023-10-14T11:12:55.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.547+0000 7f1db0d65640 1 -- 172.21.15.26:0/3294085470 wait complete. 2023-10-14T11:12:55.571 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:12:55.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.707+0000 7f8172cc9640 1 Processor -- start 2023-10-14T11:12:55.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.707+0000 7f8172cc9640 1 -- start start 2023-10-14T11:12:55.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.711+0000 7f8172cc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f816c0cf520 0x7f816c0c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:55.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.711+0000 7f8172cc9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f816c0c65f0 con 0x7f816c0cf090 2023-10-14T11:12:55.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.711+0000 7f8172cc9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f816c0cdf80 con 0x7f816c15ca70 2023-10-14T11:12:55.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.711+0000 7f8172cc9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f816c0ce820 con 0x7f816c0cf520 2023-10-14T11:12:55.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.711+0000 7f8171266640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f816c0cf520 0x7f816c0c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:55.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.711+0000 7f816bfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f816c0cf090 0x7f816c0c6ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38824/0 (socket says 172.21.15.26:38824) 2023-10-14T11:12:55.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.711+0000 7f816bfff640 1 -- 172.21.15.26:0/1432318440 learned_addr learned my addr 172.21.15.26:0/1432318440 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:55.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.711+0000 7f8171266640 1 -- 172.21.15.26:0/1432318440 >> v1:172.21.15.110:6789/0 conn(0x7f816c15ca70 legacy=0x7f816c0d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:55.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.711+0000 7f8171266640 1 -- 172.21.15.26:0/1432318440 >> v1:172.21.15.26:6789/0 conn(0x7f816c0cf090 legacy=0x7f816c0c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:55.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.711+0000 7f8171266640 1 -- 172.21.15.26:0/1432318440 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816c0ce260 con 0x7f816c0cf520 2023-10-14T11:12:55.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.711+0000 7f816b7fe640 1 -- 172.21.15.26:0/1432318440 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329813777 0 0) 0x7f816c0c65f0 con 0x7f816c0cf090 2023-10-14T11:12:55.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.715+0000 7f8171266640 1 --2- 172.21.15.26:0/1432318440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f816c0cf520 0x7f816c0c71e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8164009d90 tx=0x7f816401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc481c91d38b785 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:55.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.715+0000 7f816b7fe640 1 -- 172.21.15.26:0/1432318440 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81640a59a0 con 0x7f816c0cf520 2023-10-14T11:12:55.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.715+0000 7f816b7fe640 1 -- 172.21.15.26:0/1432318440 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81640a5b00 con 0x7f816c0cf520 2023-10-14T11:12:55.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.715+0000 7f816b7fe640 1 -- 172.21.15.26:0/1432318440 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81640a5e90 con 0x7f816c0cf520 2023-10-14T11:12:55.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.715+0000 7f8172cc9640 1 -- 172.21.15.26:0/1432318440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f816c0cf520 msgr2=0x7f816c0c71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:55.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.715+0000 7f8172cc9640 1 --2- 172.21.15.26:0/1432318440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f816c0cf520 0x7f816c0c71e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8164009d90 tx=0x7f816401c920 comp rx=0 tx=0).stop 2023-10-14T11:12:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.715+0000 7f8172cc9640 1 -- 172.21.15.26:0/1432318440 shutdown_connections 2023-10-14T11:12:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.715+0000 7f8172cc9640 1 --2- 172.21.15.26:0/1432318440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f816c0cf520 0x7f816c0c71e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.715+0000 7f8172cc9640 1 -- 172.21.15.26:0/1432318440 >> 172.21.15.26:0/1432318440 conn(0x7f816c09bc50 msgr2=0x7f816c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.715+0000 7f8172cc9640 1 -- 172.21.15.26:0/1432318440 shutdown_connections 2023-10-14T11:12:55.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.715+0000 7f8172cc9640 1 -- 172.21.15.26:0/1432318440 wait complete. 2023-10-14T11:12:55.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.715+0000 7f8172cc9640 1 Processor -- start 2023-10-14T11:12:55.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.715+0000 7f8172cc9640 1 -- start start 2023-10-14T11:12:55.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f8172cc9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f816c0cf090 0x7f816c1568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:55.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f8172cc9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f816c0cf520 0x7f816c153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:55.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f8172cc9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f816c15ca70 0x7f816c0c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:55.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f8172cc9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816c06b440 con 0x7f816c0cf090 2023-10-14T11:12:55.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f8172cc9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816c0cc760 con 0x7f816c15ca70 2023-10-14T11:12:55.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f8172cc9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f816c0ccc90 con 0x7f816c0cf520 2023-10-14T11:12:55.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f8170a65640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f816c0cf090 0x7f816c1568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:55.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f8170a65640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f816c0cf090 0x7f816c1568b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37480/0 (socket says 172.21.15.26:37480) 2023-10-14T11:12:55.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f8170a65640 1 -- 172.21.15.26:0/3931777829 learned_addr learned my addr 172.21.15.26:0/3931777829 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:55.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f8171266640 1 --2- 172.21.15.26:0/3931777829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f816c15ca70 0x7f816c0c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:55.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f816bfff640 1 --2- 172.21.15.26:0/3931777829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f816c0cf520 0x7f816c153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:55.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f8170a65640 1 -- 172.21.15.26:0/3931777829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f816c0cf520 msgr2=0x7f816c153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:55.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f8170a65640 1 --2- 172.21.15.26:0/3931777829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f816c0cf520 0x7f816c153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f8170a65640 1 -- 172.21.15.26:0/3931777829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f816c15ca70 msgr2=0x7f816c0c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:55.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f8170a65640 1 --2- 172.21.15.26:0/3931777829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f816c15ca70 0x7f816c0c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f8170a65640 1 -- 172.21.15.26:0/3931777829 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8164009a70 con 0x7f816c0cf090 2023-10-14T11:12:55.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f8170a65640 1 --2- 172.21.15.26:0/3931777829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f816c0cf090 0x7f816c1568b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f816000c430 tx=0x7f816000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:55.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f81697fa640 1 -- 172.21.15.26:0/3931777829 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81600052d0 con 0x7f816c0cf090 2023-10-14T11:12:55.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f81697fa640 1 -- 172.21.15.26:0/3931777829 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8160005430 con 0x7f816c0cf090 2023-10-14T11:12:55.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f81697fa640 1 -- 172.21.15.26:0/3931777829 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160003890 con 0x7f816c0cf090 2023-10-14T11:12:55.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f8172cc9640 1 -- 172.21.15.26:0/3931777829 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f816c0d38a0 con 0x7f816c0cf090 2023-10-14T11:12:55.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f8172cc9640 1 -- 172.21.15.26:0/3931777829 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f816c06b690 con 0x7f816c0cf090 2023-10-14T11:12:55.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f8172cc9640 1 -- 172.21.15.26:0/3931777829 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f816c074010 con 0x7f816c0cf090 2023-10-14T11:12:55.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.719+0000 7f81697fa640 1 -- 172.21.15.26:0/3931777829 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f81600039f0 con 0x7f816c0cf090 2023-10-14T11:12:55.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.723+0000 7f81697fa640 1 --2- 172.21.15.26:0/3931777829 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f81500664a0 0x7f8150068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:55.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.723+0000 7f81697fa640 1 -- 172.21.15.26:0/3931777829 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f81600836d0 con 0x7f816c0cf090 2023-10-14T11:12:55.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.723+0000 7f816bfff640 1 --2- 172.21.15.26:0/3931777829 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f81500664a0 0x7f8150068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:55.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.723+0000 7f816bfff640 1 --2- 172.21.15.26:0/3931777829 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f81500664a0 0x7f8150068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8158007fd0 tx=0x7f8158007ba0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:55.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.723+0000 7f81697fa640 1 -- 172.21.15.26:0/3931777829 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8160050900 con 0x7f816c0cf090 2023-10-14T11:12:55.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.915+0000 7f8172cc9640 1 -- 172.21.15.26:0/3931777829 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f816c160100 con 0x7f816c0cf090 2023-10-14T11:12:55.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.915+0000 7f81697fa640 1 -- 172.21.15.26:0/3931777829 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f8160053f20 con 0x7f816c0cf090 2023-10-14T11:12:55.920 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:55.920 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/2685368784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2685368784},{"type":"v1","addr":"172.21.15.110:6834","nonce":2685368784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6836/4242453713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":4242453713},{"type":"v1","addr":"172.21.15.26:6836","nonce":4242453713}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3507761146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":3507761146},{"type":"v1","addr":"172.21.15.26:6837","nonce":3507761146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:12:22.355867+0000","modified":"2023-10-14T11:12:46.435346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3522025152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3522025152},{"type":"v1","addr":"172.21.15.110:6835","nonce":3522025152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T11:12:55.920 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 9 2023-10-14T11:12:55.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.915+0000 7f8172cc9640 1 -- 172.21.15.26:0/3931777829 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f81500664a0 msgr2=0x7f8150068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:55.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.915+0000 7f8172cc9640 1 --2- 172.21.15.26:0/3931777829 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f81500664a0 0x7f8150068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8158007fd0 tx=0x7f8158007ba0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.915+0000 7f8172cc9640 1 -- 172.21.15.26:0/3931777829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f816c0cf090 msgr2=0x7f816c1568b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:55.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.915+0000 7f8172cc9640 1 --2- 172.21.15.26:0/3931777829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f816c0cf090 0x7f816c1568b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f816000c430 tx=0x7f816000c8f0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.919+0000 7f8172cc9640 1 -- 172.21.15.26:0/3931777829 shutdown_connections 2023-10-14T11:12:55.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.919+0000 7f8172cc9640 1 --2- 172.21.15.26:0/3931777829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f816c15ca70 0x7f816c0c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.919+0000 7f8172cc9640 1 --2- 172.21.15.26:0/3931777829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f816c0cf520 0x7f816c153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.919+0000 7f8172cc9640 1 --2- 172.21.15.26:0/3931777829 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f81500664a0 0x7f8150068960 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.919+0000 7f8172cc9640 1 --2- 172.21.15.26:0/3931777829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f816c0cf090 0x7f816c1568b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:55.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.919+0000 7f8172cc9640 1 -- 172.21.15.26:0/3931777829 >> 172.21.15.26:0/3931777829 conn(0x7f816c09bc50 msgr2=0x7f816c0ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:55.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.919+0000 7f8172cc9640 1 -- 172.21.15.26:0/3931777829 shutdown_connections 2023-10-14T11:12:55.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:55.919+0000 7f8172cc9640 1 -- 172.21.15.26:0/3931777829 wait complete. 2023-10-14T11:12:55.941 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:12:56.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.079+0000 7f463246b640 1 Processor -- start 2023-10-14T11:12:56.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.079+0000 7f463246b640 1 -- start start 2023-10-14T11:12:56.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.083+0000 7f463246b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f462c15ce30 0x7f462c0cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:56.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.083+0000 7f463246b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f462c0b21c0 0x7f462c0b2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:56.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.083+0000 7f463246b640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f462c0b2b50 con 0x7f462c15ca50 2023-10-14T11:12:56.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.083+0000 7f463246b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f462c1607e0 con 0x7f462c0b21c0 2023-10-14T11:12:56.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.083+0000 7f463246b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462c0cf060 con 0x7f462c15ce30 2023-10-14T11:12:56.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.083+0000 7f4630a08640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f462c0b21c0 0x7f462c0b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:56.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.083+0000 7f4630a08640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f462c0b21c0 0x7f462c0b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37492/0 (socket says 172.21.15.26:37492) 2023-10-14T11:12:56.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.083+0000 7f4630a08640 1 -- 172.21.15.26:0/3346243996 learned_addr learned my addr 172.21.15.26:0/3346243996 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:56.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.083+0000 7f462bfff640 1 --1- 172.21.15.26:0/3346243996 >> v1:172.21.15.26:6789/0 conn(0x7f462c15ca50 0x7f462c06c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38840/0 (socket says 172.21.15.26:38840) 2023-10-14T11:12:56.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.083+0000 7f462b7fe640 1 --2- 172.21.15.26:0/3346243996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f462c15ce30 0x7f462c0cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:56.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.083+0000 7f4630a08640 1 -- 172.21.15.26:0/3346243996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f462c15ce30 msgr2=0x7f462c0cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:56.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.083+0000 7f4630a08640 1 --2- 172.21.15.26:0/3346243996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f462c15ce30 0x7f462c0cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.083+0000 7f4630a08640 1 -- 172.21.15.26:0/3346243996 >> v1:172.21.15.26:6789/0 conn(0x7f462c15ca50 legacy=0x7f462c06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:56.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.083+0000 7f4630a08640 1 -- 172.21.15.26:0/3346243996 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c070210 con 0x7f462c0b21c0 2023-10-14T11:12:56.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.087+0000 7f4630a08640 1 --2- 172.21.15.26:0/3346243996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f462c0b21c0 0x7f462c0b2610 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4624009e50 tx=0x7f462401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdddc0ed7bd6b0cf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:56.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.087+0000 7f462affd640 1 -- 172.21.15.26:0/3346243996 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46240a58e0 con 0x7f462c0b21c0 2023-10-14T11:12:56.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.087+0000 7f462affd640 1 -- 172.21.15.26:0/3346243996 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46240a5a40 con 0x7f462c0b21c0 2023-10-14T11:12:56.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.087+0000 7f462affd640 1 -- 172.21.15.26:0/3346243996 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46240a5dd0 con 0x7f462c0b21c0 2023-10-14T11:12:56.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.087+0000 7f463246b640 1 -- 172.21.15.26:0/3346243996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f462c0b21c0 msgr2=0x7f462c0b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:56.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.087+0000 7f463246b640 1 --2- 172.21.15.26:0/3346243996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f462c0b21c0 0x7f462c0b2610 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4624009e50 tx=0x7f462401ca10 comp rx=0 tx=0).stop 2023-10-14T11:12:56.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.087+0000 7f463246b640 1 -- 172.21.15.26:0/3346243996 shutdown_connections 2023-10-14T11:12:56.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.087+0000 7f463246b640 1 --2- 172.21.15.26:0/3346243996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f462c0b21c0 0x7f462c0b2610 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.087+0000 7f463246b640 1 --2- 172.21.15.26:0/3346243996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f462c15ce30 0x7f462c0cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.087+0000 7f463246b640 1 -- 172.21.15.26:0/3346243996 >> 172.21.15.26:0/3346243996 conn(0x7f462c0cd1c0 msgr2=0x7f462c0cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:56.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.087+0000 7f463246b640 1 -- 172.21.15.26:0/3346243996 shutdown_connections 2023-10-14T11:12:56.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.087+0000 7f463246b640 1 -- 172.21.15.26:0/3346243996 wait complete. 2023-10-14T11:12:56.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.087+0000 7f463246b640 1 Processor -- start 2023-10-14T11:12:56.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.087+0000 7f463246b640 1 -- start start 2023-10-14T11:12:56.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f463246b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f462c0b21c0 0x7f462c15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:56.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f463246b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f462c15ca50 0x7f462c0c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:56.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f463246b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f462c15ce30 0x7f462c0c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:56.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f463246b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c0c4ad0 con 0x7f462c0b21c0 2023-10-14T11:12:56.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f463246b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c15c5f0 con 0x7f462c15ce30 2023-10-14T11:12:56.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f463246b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462c0c61d0 con 0x7f462c15ca50 2023-10-14T11:12:56.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f462bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f462c0b21c0 0x7f462c15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:56.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f462bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f462c0b21c0 0x7f462c15c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37504/0 (socket says 172.21.15.26:37504) 2023-10-14T11:12:56.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f462bfff640 1 -- 172.21.15.26:0/3690137523 learned_addr learned my addr 172.21.15.26:0/3690137523 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:56.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f462b7fe640 1 --2- 172.21.15.26:0/3690137523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f462c15ca50 0x7f462c0c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:56.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f4630a08640 1 --2- 172.21.15.26:0/3690137523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f462c15ce30 0x7f462c0c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:56.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f462bfff640 1 -- 172.21.15.26:0/3690137523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f462c15ca50 msgr2=0x7f462c0c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:56.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f462bfff640 1 --2- 172.21.15.26:0/3690137523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f462c15ca50 0x7f462c0c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f462bfff640 1 -- 172.21.15.26:0/3690137523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f462c15ce30 msgr2=0x7f462c0c4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:56.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f462bfff640 1 --2- 172.21.15.26:0/3690137523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f462c15ce30 0x7f462c0c4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f462bfff640 1 -- 172.21.15.26:0/3690137523 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4624009b30 con 0x7f462c0b21c0 2023-10-14T11:12:56.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f4630a08640 1 --2- 172.21.15.26:0/3690137523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f462c15ce30 0x7f462c0c4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:56.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f462bfff640 1 --2- 172.21.15.26:0/3690137523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f462c0b21c0 0x7f462c15c0b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f461c00c420 tx=0x7f461c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:56.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f4628ff9640 1 -- 172.21.15.26:0/3690137523 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c0074e0 con 0x7f462c0b21c0 2023-10-14T11:12:56.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f4628ff9640 1 -- 172.21.15.26:0/3690137523 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461c007640 con 0x7f462c0b21c0 2023-10-14T11:12:56.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f4628ff9640 1 -- 172.21.15.26:0/3690137523 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c004a30 con 0x7f462c0b21c0 2023-10-14T11:12:56.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f463246b640 1 -- 172.21.15.26:0/3690137523 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462c0c4410 con 0x7f462c0b21c0 2023-10-14T11:12:56.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f463246b640 1 -- 172.21.15.26:0/3690137523 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f462c0c5e10 con 0x7f462c0b21c0 2023-10-14T11:12:56.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f463246b640 1 -- 172.21.15.26:0/3690137523 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f462c0c4270 con 0x7f462c0b21c0 2023-10-14T11:12:56.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.091+0000 7f4628ff9640 1 -- 172.21.15.26:0/3690137523 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f461c004b90 con 0x7f462c0b21c0 2023-10-14T11:12:56.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.095+0000 7f4628ff9640 1 --2- 172.21.15.26:0/3690137523 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f46180664f0 0x7f46180689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:56.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.095+0000 7f4628ff9640 1 -- 172.21.15.26:0/3690137523 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f461c083970 con 0x7f462c0b21c0 2023-10-14T11:12:56.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.095+0000 7f462b7fe640 1 --2- 172.21.15.26:0/3690137523 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f46180664f0 0x7f46180689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:56.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.095+0000 7f462b7fe640 1 --2- 172.21.15.26:0/3690137523 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f46180664f0 0x7f46180689b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f462c0c77c0 tx=0x7f4620008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:56.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.099+0000 7f4628ff9640 1 -- 172.21.15.26:0/3690137523 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f462c0c4270 con 0x7f462c0b21c0 2023-10-14T11:12:56.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.255+0000 7f463246b640 1 -- 172.21.15.26:0/3690137523 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f462c0b2b50 con 0x7f462c0b21c0 2023-10-14T11:12:56.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.259+0000 7f4628ff9640 1 -- 172.21.15.26:0/3690137523 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f462c0b2b50 con 0x7f462c0b21c0 2023-10-14T11:12:56.262 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:56.262 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":25,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:12:27.398936+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:12:56.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.259+0000 7f463246b640 1 -- 172.21.15.26:0/3690137523 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f46180664f0 msgr2=0x7f46180689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:56.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.259+0000 7f463246b640 1 --2- 172.21.15.26:0/3690137523 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f46180664f0 0x7f46180689b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f462c0c77c0 tx=0x7f4620008040 comp rx=0 tx=0).stop 2023-10-14T11:12:56.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.259+0000 7f463246b640 1 -- 172.21.15.26:0/3690137523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f462c0b21c0 msgr2=0x7f462c15c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:56.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.259+0000 7f463246b640 1 --2- 172.21.15.26:0/3690137523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f462c0b21c0 0x7f462c15c0b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f461c00c420 tx=0x7f461c00c8e0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.259+0000 7f463246b640 1 -- 172.21.15.26:0/3690137523 shutdown_connections 2023-10-14T11:12:56.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.259+0000 7f463246b640 1 --2- 172.21.15.26:0/3690137523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f462c15ce30 0x7f462c0c4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.259+0000 7f463246b640 1 --2- 172.21.15.26:0/3690137523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f462c15ca50 0x7f462c0c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.259+0000 7f463246b640 1 --2- 172.21.15.26:0/3690137523 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f46180664f0 0x7f46180689b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.259+0000 7f463246b640 1 --2- 172.21.15.26:0/3690137523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f462c0b21c0 0x7f462c15c0b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.259+0000 7f463246b640 1 -- 172.21.15.26:0/3690137523 >> 172.21.15.26:0/3690137523 conn(0x7f462c0cd1c0 msgr2=0x7f462c15d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:56.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.259+0000 7f463246b640 1 -- 172.21.15.26:0/3690137523 shutdown_connections 2023-10-14T11:12:56.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.259+0000 7f463246b640 1 -- 172.21.15.26:0/3690137523 wait complete. 2023-10-14T11:12:56.284 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:12:20.179562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:12:21.346111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T11:12:25.025159+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T11:12:56.285 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:12:56.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.427+0000 7f39c30a9640 1 Processor -- start 2023-10-14T11:12:56.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.427+0000 7f39c30a9640 1 -- start start 2023-10-14T11:12:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.427+0000 7f39c30a9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f39bc15cba0 0x7f39bc0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.427+0000 7f39c30a9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f39bc0b84e0 0x7f39bc0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:56.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.427+0000 7f39c30a9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39bc0d1670 con 0x7f39bc0d0040 2023-10-14T11:12:56.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.427+0000 7f39c30a9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39bc0d1460 con 0x7f39bc15cba0 2023-10-14T11:12:56.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.427+0000 7f39c30a9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39bc0d04b0 con 0x7f39bc0b84e0 2023-10-14T11:12:56.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.427+0000 7f39c0e45640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f39bc15cba0 0x7f39bc0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:56.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.427+0000 7f39c0e45640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f39bc15cba0 0x7f39bc0d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37520/0 (socket says 172.21.15.26:37520) 2023-10-14T11:12:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.427+0000 7f39c0e45640 1 -- 172.21.15.26:0/889515975 learned_addr learned my addr 172.21.15.26:0/889515975 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.427+0000 7f39bbfff640 1 --2- 172.21.15.26:0/889515975 >> v2:172.21.15.110:3300/0 conn(0x7f39bc0b84e0 0x7f39bc0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.427+0000 7f39c0e45640 1 -- 172.21.15.26:0/889515975 >> v2:172.21.15.110:3300/0 conn(0x7f39bc0b84e0 msgr2=0x7f39bc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.427+0000 7f39c0e45640 1 --2- 172.21.15.26:0/889515975 >> v2:172.21.15.110:3300/0 conn(0x7f39bc0b84e0 0x7f39bc0cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.427+0000 7f39c0e45640 1 -- 172.21.15.26:0/889515975 >> v1:172.21.15.110:6789/0 conn(0x7f39bc0d0040 legacy=0x7f39bc0d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.427+0000 7f39c0e45640 1 -- 172.21.15.26:0/889515975 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc0d1950 con 0x7f39bc15cba0 2023-10-14T11:12:56.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.431+0000 7f39c0e45640 1 --2- 172.21.15.26:0/889515975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39bc15cba0 0x7f39bc0d0f20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0cf2f0 tx=0x7f39b001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf51afc95acb84c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:56.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.431+0000 7f39bb7fe640 1 -- 172.21.15.26:0/889515975 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b00a8050 con 0x7f39bc15cba0 2023-10-14T11:12:56.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.431+0000 7f39bb7fe640 1 -- 172.21.15.26:0/889515975 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b00ac5f0 con 0x7f39bc15cba0 2023-10-14T11:12:56.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.431+0000 7f39bb7fe640 1 -- 172.21.15.26:0/889515975 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b00ac980 con 0x7f39bc15cba0 2023-10-14T11:12:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.431+0000 7f39c30a9640 1 -- 172.21.15.26:0/889515975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39bc15cba0 msgr2=0x7f39bc0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.431+0000 7f39c30a9640 1 --2- 172.21.15.26:0/889515975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39bc15cba0 0x7f39bc0d0f20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0cf2f0 tx=0x7f39b001c470 comp rx=0 tx=0).stop 2023-10-14T11:12:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.431+0000 7f39c30a9640 1 -- 172.21.15.26:0/889515975 shutdown_connections 2023-10-14T11:12:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.431+0000 7f39c30a9640 1 --2- 172.21.15.26:0/889515975 >> v2:172.21.15.110:3300/0 conn(0x7f39bc0b84e0 0x7f39bc0cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.431+0000 7f39c30a9640 1 --2- 172.21.15.26:0/889515975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39bc15cba0 0x7f39bc0d0f20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.431+0000 7f39c30a9640 1 -- 172.21.15.26:0/889515975 >> 172.21.15.26:0/889515975 conn(0x7f39bc0719c0 msgr2=0x7f39bc071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:56.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.431+0000 7f39c30a9640 1 -- 172.21.15.26:0/889515975 shutdown_connections 2023-10-14T11:12:56.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.431+0000 7f39c30a9640 1 -- 172.21.15.26:0/889515975 wait complete. 2023-10-14T11:12:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39c30a9640 1 Processor -- start 2023-10-14T11:12:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39c30a9640 1 -- start start 2023-10-14T11:12:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39c30a9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39bc0b84e0 0x7f39bc0cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:56.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39c30a9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39bc0d0040 0x7f39bc14dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:56.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39c30a9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39bc15cba0 0x7f39bc15f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:56.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39c30a9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc14e180 con 0x7f39bc15cba0 2023-10-14T11:12:56.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39c30a9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc0c9cc0 con 0x7f39bc0d0040 2023-10-14T11:12:56.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39c30a9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc0c9fa0 con 0x7f39bc0b84e0 2023-10-14T11:12:56.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39c1646640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39bc15cba0 0x7f39bc15f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:56.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39c0e45640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39bc0b84e0 0x7f39bc0cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:56.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39bbfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39bc0d0040 0x7f39bc14dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:56.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39c1646640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39bc15cba0 0x7f39bc15f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37532/0 (socket says 172.21.15.26:37532) 2023-10-14T11:12:56.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39c1646640 1 -- 172.21.15.26:0/2334435473 learned_addr learned my addr 172.21.15.26:0/2334435473 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:56.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39c1646640 1 -- 172.21.15.26:0/2334435473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39bc0b84e0 msgr2=0x7f39bc0cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:56.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39c1646640 1 --2- 172.21.15.26:0/2334435473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39bc0b84e0 0x7f39bc0cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39c1646640 1 -- 172.21.15.26:0/2334435473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39bc0d0040 msgr2=0x7f39bc14dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:56.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39c1646640 1 --2- 172.21.15.26:0/2334435473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39bc0d0040 0x7f39bc14dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39c1646640 1 -- 172.21.15.26:0/2334435473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b00094d0 con 0x7f39bc15cba0 2023-10-14T11:12:56.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39c1646640 1 --2- 172.21.15.26:0/2334435473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39bc15cba0 0x7f39bc15f5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f39b400c770 tx=0x7f39b400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:56.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39b97fa640 1 -- 172.21.15.26:0/2334435473 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4003b80 con 0x7f39bc15cba0 2023-10-14T11:12:56.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39b97fa640 1 -- 172.21.15.26:0/2334435473 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b4003ce0 con 0x7f39bc15cba0 2023-10-14T11:12:56.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39c30a9640 1 -- 172.21.15.26:0/2334435473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39bc0ca280 con 0x7f39bc15cba0 2023-10-14T11:12:56.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39b97fa640 1 -- 172.21.15.26:0/2334435473 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b400aa90 con 0x7f39bc15cba0 2023-10-14T11:12:56.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.435+0000 7f39c30a9640 1 -- 172.21.15.26:0/2334435473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39bc0ca840 con 0x7f39bc15cba0 2023-10-14T11:12:56.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.439+0000 7f39c30a9640 1 -- 172.21.15.26:0/2334435473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39bc04e170 con 0x7f39bc15cba0 2023-10-14T11:12:56.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.439+0000 7f39b97fa640 1 -- 172.21.15.26:0/2334435473 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f39b400abf0 con 0x7f39bc15cba0 2023-10-14T11:12:56.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.439+0000 7f39b97fa640 1 --2- 172.21.15.26:0/2334435473 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f39a00664a0 0x7f39a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:56.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.439+0000 7f39b97fa640 1 -- 172.21.15.26:0/2334435473 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f39b4083e60 con 0x7f39bc15cba0 2023-10-14T11:12:56.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.439+0000 7f39c0e45640 1 --2- 172.21.15.26:0/2334435473 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f39a00664a0 0x7f39a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:56.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.439+0000 7f39c0e45640 1 --2- 172.21.15.26:0/2334435473 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f39a00664a0 0x7f39a0068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f39b00ae000 tx=0x7f39b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:56.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.443+0000 7f39b97fa640 1 -- 172.21.15.26:0/2334435473 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f39b40510a0 con 0x7f39bc15cba0 2023-10-14T11:12:56.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.603+0000 7f39c30a9640 1 -- 172.21.15.26:0/2334435473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39bc0caa00 con 0x7f39bc15cba0 2023-10-14T11:12:56.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.603+0000 7f39b97fa640 1 -- 172.21.15.26:0/2334435473 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39b40546c0 con 0x7f39bc15cba0 2023-10-14T11:12:56.608 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:12:56.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.607+0000 7f39c30a9640 1 -- 172.21.15.26:0/2334435473 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f39a00664a0 msgr2=0x7f39a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:56.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.607+0000 7f39c30a9640 1 --2- 172.21.15.26:0/2334435473 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f39a00664a0 0x7f39a0068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f39b00ae000 tx=0x7f39b0008040 comp rx=0 tx=0).stop 2023-10-14T11:12:56.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.607+0000 7f39c30a9640 1 -- 172.21.15.26:0/2334435473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39bc15cba0 msgr2=0x7f39bc15f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:56.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.607+0000 7f39c30a9640 1 --2- 172.21.15.26:0/2334435473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39bc15cba0 0x7f39bc15f5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f39b400c770 tx=0x7f39b400cc30 comp rx=0 tx=0).stop 2023-10-14T11:12:56.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.607+0000 7f39c30a9640 1 -- 172.21.15.26:0/2334435473 shutdown_connections 2023-10-14T11:12:56.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.607+0000 7f39c30a9640 1 --2- 172.21.15.26:0/2334435473 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f39a00664a0 0x7f39a0068960 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.607+0000 7f39c30a9640 1 --2- 172.21.15.26:0/2334435473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39bc15cba0 0x7f39bc15f5a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.607+0000 7f39c30a9640 1 --2- 172.21.15.26:0/2334435473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39bc0d0040 0x7f39bc14dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.607+0000 7f39c30a9640 1 --2- 172.21.15.26:0/2334435473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39bc0b84e0 0x7f39bc0cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.607+0000 7f39c30a9640 1 -- 172.21.15.26:0/2334435473 >> 172.21.15.26:0/2334435473 conn(0x7f39bc0719c0 msgr2=0x7f39bc15add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:56.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.607+0000 7f39c30a9640 1 -- 172.21.15.26:0/2334435473 shutdown_connections 2023-10-14T11:12:56.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.607+0000 7f39c30a9640 1 -- 172.21.15.26:0/2334435473 wait complete. 2023-10-14T11:12:56.630 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:12:56.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.775+0000 7f701b29e640 1 Processor -- start 2023-10-14T11:12:56.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.775+0000 7f701b29e640 1 -- start start 2023-10-14T11:12:56.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.775+0000 7f701b29e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f701406a0f0 0x7f70140c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:56.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.775+0000 7f701b29e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f701406a4d0 0x7f70140ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:56.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.775+0000 7f701b29e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7014164dc0 0x7f70140ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:56.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.775+0000 7f701b29e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701406c6d0 con 0x7f701406a4d0 2023-10-14T11:12:56.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.775+0000 7f701b29e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701406c950 con 0x7f701406a0f0 2023-10-14T11:12:56.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.775+0000 7f701b29e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70141654f0 con 0x7f7014164dc0 2023-10-14T11:12:56.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.775+0000 7f7018839640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f701406a4d0 0x7f70140ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:56.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.775+0000 7f7018839640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f701406a4d0 0x7f70140ccd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37534/0 (socket says 172.21.15.26:37534) 2023-10-14T11:12:56.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.775+0000 7f7018839640 1 -- 172.21.15.26:0/606222988 learned_addr learned my addr 172.21.15.26:0/606222988 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:56.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.775+0000 7f701983b640 1 --2- 172.21.15.26:0/606222988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7014164dc0 0x7f70140ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:56.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.775+0000 7f701903a640 1 --2- 172.21.15.26:0/606222988 >> v2:172.21.15.110:3300/0 conn(0x7f701406a0f0 0x7f70140c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:56.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.775+0000 7f7018839640 1 -- 172.21.15.26:0/606222988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7014164dc0 msgr2=0x7f70140ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:56.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.775+0000 7f7018839640 1 --2- 172.21.15.26:0/606222988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7014164dc0 0x7f70140ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.775+0000 7f7018839640 1 -- 172.21.15.26:0/606222988 >> v2:172.21.15.110:3300/0 conn(0x7f701406a0f0 msgr2=0x7f70140c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:56.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.775+0000 7f7018839640 1 --2- 172.21.15.26:0/606222988 >> v2:172.21.15.110:3300/0 conn(0x7f701406a0f0 0x7f70140c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.775+0000 7f7018839640 1 -- 172.21.15.26:0/606222988 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70141657d0 con 0x7f701406a4d0 2023-10-14T11:12:56.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.779+0000 7f7018839640 1 --2- 172.21.15.26:0/606222988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f701406a4d0 0x7f70140ccd00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f70140713e0 tx=0x7f700401cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6797b0dc915ba7be server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:56.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.779+0000 7f700bfff640 1 -- 172.21.15.26:0/606222988 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70040aa640 con 0x7f701406a4d0 2023-10-14T11:12:56.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.779+0000 7f700bfff640 1 -- 172.21.15.26:0/606222988 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70040aa7a0 con 0x7f701406a4d0 2023-10-14T11:12:56.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.779+0000 7f700bfff640 1 -- 172.21.15.26:0/606222988 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70040aab30 con 0x7f701406a4d0 2023-10-14T11:12:56.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.779+0000 7f701b29e640 1 -- 172.21.15.26:0/606222988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f701406a4d0 msgr2=0x7f70140ccd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:56.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.779+0000 7f701b29e640 1 --2- 172.21.15.26:0/606222988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f701406a4d0 0x7f70140ccd00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f70140713e0 tx=0x7f700401cf60 comp rx=0 tx=0).stop 2023-10-14T11:12:56.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.779+0000 7f701b29e640 1 -- 172.21.15.26:0/606222988 shutdown_connections 2023-10-14T11:12:56.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.779+0000 7f701b29e640 1 --2- 172.21.15.26:0/606222988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7014164dc0 0x7f70140ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.779+0000 7f701b29e640 1 --2- 172.21.15.26:0/606222988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f701406a4d0 0x7f70140ccd00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.779+0000 7f701b29e640 1 --2- 172.21.15.26:0/606222988 >> v2:172.21.15.110:3300/0 conn(0x7f701406a0f0 0x7f70140c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.779+0000 7f701b29e640 1 -- 172.21.15.26:0/606222988 >> 172.21.15.26:0/606222988 conn(0x7f70140b0da0 msgr2=0x7f70140ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:56.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.779+0000 7f701b29e640 1 -- 172.21.15.26:0/606222988 shutdown_connections 2023-10-14T11:12:56.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.779+0000 7f701b29e640 1 -- 172.21.15.26:0/606222988 wait complete. 2023-10-14T11:12:56.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f701b29e640 1 Processor -- start 2023-10-14T11:12:56.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f701b29e640 1 -- start start 2023-10-14T11:12:56.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f701b29e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f701406a0f0 0x7f701415a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:56.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f701b29e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f701406a4d0 0x7f70140b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:56.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f701b29e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7014164dc0 0x7f7014158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:56.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f701b29e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70140c2510 con 0x7f701406a4d0 2023-10-14T11:12:56.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f701b29e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701415d680 con 0x7f7014164dc0 2023-10-14T11:12:56.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f701b29e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7014159ad0 con 0x7f701406a0f0 2023-10-14T11:12:56.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f7018839640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f701406a4d0 0x7f70140b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:56.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f7018839640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f701406a4d0 0x7f70140b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37538/0 (socket says 172.21.15.26:37538) 2023-10-14T11:12:56.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f7018839640 1 -- 172.21.15.26:0/3561741481 learned_addr learned my addr 172.21.15.26:0/3561741481 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:56.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f701983b640 1 --2- 172.21.15.26:0/3561741481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7014164dc0 0x7f7014158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:56.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f701903a640 1 --2- 172.21.15.26:0/3561741481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f701406a0f0 0x7f701415a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:56.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f7018839640 1 -- 172.21.15.26:0/3561741481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f701406a0f0 msgr2=0x7f701415a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:56.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f7018839640 1 --2- 172.21.15.26:0/3561741481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f701406a0f0 0x7f701415a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f7018839640 1 -- 172.21.15.26:0/3561741481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7014164dc0 msgr2=0x7f7014158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:56.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f7018839640 1 --2- 172.21.15.26:0/3561741481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7014164dc0 0x7f7014158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f7018839640 1 -- 172.21.15.26:0/3561741481 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70040094d0 con 0x7f701406a4d0 2023-10-14T11:12:56.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f7018839640 1 --2- 172.21.15.26:0/3561741481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f701406a4d0 0x7f70140b1e30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7004097fb0 tx=0x7f700401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:56.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f7009ffb640 1 -- 172.21.15.26:0/3561741481 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70040aa640 con 0x7f701406a4d0 2023-10-14T11:12:56.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f7009ffb640 1 -- 172.21.15.26:0/3561741481 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70040bd5f0 con 0x7f701406a4d0 2023-10-14T11:12:56.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f701b29e640 1 -- 172.21.15.26:0/3561741481 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701415d3a0 con 0x7f701406a4d0 2023-10-14T11:12:56.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f7009ffb640 1 -- 172.21.15.26:0/3561741481 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70040bd9a0 con 0x7f701406a4d0 2023-10-14T11:12:56.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f701b29e640 1 -- 172.21.15.26:0/3561741481 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70140c21a0 con 0x7f701406a4d0 2023-10-14T11:12:56.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.783+0000 7f701b29e640 1 -- 172.21.15.26:0/3561741481 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70140c26c0 con 0x7f701406a4d0 2023-10-14T11:12:56.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.787+0000 7f7009ffb640 1 -- 172.21.15.26:0/3561741481 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f70040a8050 con 0x7f701406a4d0 2023-10-14T11:12:56.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.787+0000 7f7009ffb640 1 --2- 172.21.15.26:0/3561741481 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6ff80664a0 0x7f6ff8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:56.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.787+0000 7f7009ffb640 1 -- 172.21.15.26:0/3561741481 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f700411daf0 con 0x7f701406a4d0 2023-10-14T11:12:56.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.787+0000 7f701903a640 1 --2- 172.21.15.26:0/3561741481 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6ff80664a0 0x7f6ff8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:56.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.787+0000 7f701903a640 1 --2- 172.21.15.26:0/3561741481 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6ff80664a0 0x7f6ff8068960 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f70100045f0 tx=0x7f7010008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:56.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.791+0000 7f7009ffb640 1 -- 172.21.15.26:0/3561741481 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f70140c26c0 con 0x7f701406a4d0 2023-10-14T11:12:56.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.951+0000 7f701b29e640 1 -- 172.21.15.26:0/3561741481 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f70140c26c0 con 0x7f701406a4d0 2023-10-14T11:12:56.955 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:12:56.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.951+0000 7f7009ffb640 1 -- 172.21.15.26:0/3561741481 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f70140c26c0 con 0x7f701406a4d0 2023-10-14T11:12:56.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.951+0000 7f701b29e640 1 -- 172.21.15.26:0/3561741481 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6ff80664a0 msgr2=0x7f6ff8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:56.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.951+0000 7f701b29e640 1 --2- 172.21.15.26:0/3561741481 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6ff80664a0 0x7f6ff8068960 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f70100045f0 tx=0x7f7010008040 comp rx=0 tx=0).stop 2023-10-14T11:12:56.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.951+0000 7f701b29e640 1 -- 172.21.15.26:0/3561741481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f701406a4d0 msgr2=0x7f70140b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:56.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.951+0000 7f701b29e640 1 --2- 172.21.15.26:0/3561741481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f701406a4d0 0x7f70140b1e30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7004097fb0 tx=0x7f700401ad40 comp rx=0 tx=0).stop 2023-10-14T11:12:56.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.951+0000 7f701b29e640 1 -- 172.21.15.26:0/3561741481 shutdown_connections 2023-10-14T11:12:56.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.951+0000 7f701b29e640 1 --2- 172.21.15.26:0/3561741481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7014164dc0 0x7f7014158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.951+0000 7f701b29e640 1 --2- 172.21.15.26:0/3561741481 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6ff80664a0 0x7f6ff8068960 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.951+0000 7f701b29e640 1 --2- 172.21.15.26:0/3561741481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f701406a4d0 0x7f70140b1e30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.951+0000 7f701b29e640 1 --2- 172.21.15.26:0/3561741481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f701406a0f0 0x7f701415a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:56.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.951+0000 7f701b29e640 1 -- 172.21.15.26:0/3561741481 >> 172.21.15.26:0/3561741481 conn(0x7f70140b0da0 msgr2=0x7f7014160c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:56.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.951+0000 7f701b29e640 1 -- 172.21.15.26:0/3561741481 shutdown_connections 2023-10-14T11:12:56.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:56.951+0000 7f701b29e640 1 -- 172.21.15.26:0/3561741481 wait complete. 2023-10-14T11:12:56.975 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:12:57.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.119+0000 7fab65cd6640 1 Processor -- start 2023-10-14T11:12:57.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.119+0000 7fab65cd6640 1 -- start start 2023-10-14T11:12:57.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.119+0000 7fab65cd6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab6015cba0 0x7fab600d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:57.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.119+0000 7fab65cd6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fab600b84e0 0x7fab600cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:57.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.119+0000 7fab65cd6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab600d0040 0x7fab600d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:57.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.119+0000 7fab65cd6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab600d1460 con 0x7fab6015cba0 2023-10-14T11:12:57.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.119+0000 7fab65cd6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab600d04b0 con 0x7fab600b84e0 2023-10-14T11:12:57.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.119+0000 7fab65cd6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab600d1670 con 0x7fab600d0040 2023-10-14T11:12:57.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.119+0000 7fab5f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab6015cba0 0x7fab600d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:57.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.119+0000 7fab5f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab6015cba0 0x7fab600d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37554/0 (socket says 172.21.15.26:37554) 2023-10-14T11:12:57.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.119+0000 7fab5f7fe640 1 -- 172.21.15.26:0/1118286933 learned_addr learned my addr 172.21.15.26:0/1118286933 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:57.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.119+0000 7fab5effd640 1 --2- 172.21.15.26:0/1118286933 >> v2:172.21.15.110:3300/0 conn(0x7fab600b84e0 0x7fab600cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:57.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.119+0000 7fab5ffff640 1 --2- 172.21.15.26:0/1118286933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab600d0040 0x7fab600d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:57.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.119+0000 7fab5f7fe640 1 -- 172.21.15.26:0/1118286933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab600d0040 msgr2=0x7fab600d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:57.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.119+0000 7fab5f7fe640 1 --2- 172.21.15.26:0/1118286933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab600d0040 0x7fab600d2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.119+0000 7fab5f7fe640 1 -- 172.21.15.26:0/1118286933 >> v2:172.21.15.110:3300/0 conn(0x7fab600b84e0 msgr2=0x7fab600cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:57.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.119+0000 7fab5f7fe640 1 --2- 172.21.15.26:0/1118286933 >> v2:172.21.15.110:3300/0 conn(0x7fab600b84e0 0x7fab600cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.119+0000 7fab5f7fe640 1 -- 172.21.15.26:0/1118286933 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab600d1950 con 0x7fab6015cba0 2023-10-14T11:12:57.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.119+0000 7fab5effd640 1 --2- 172.21.15.26:0/1118286933 >> v2:172.21.15.110:3300/0 conn(0x7fab600b84e0 0x7fab600cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:57.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.119+0000 7fab5ffff640 1 --2- 172.21.15.26:0/1118286933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab600d0040 0x7fab600d2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:57.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.123+0000 7fab5f7fe640 1 --2- 172.21.15.26:0/1118286933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab6015cba0 0x7fab600d0f20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fab600cf2f0 tx=0x7fab5001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d199526c0b8d43f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:57.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.123+0000 7fab5e7fc640 1 -- 172.21.15.26:0/1118286933 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab500ab600 con 0x7fab6015cba0 2023-10-14T11:12:57.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.123+0000 7fab5e7fc640 1 -- 172.21.15.26:0/1118286933 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab500a7050 con 0x7fab6015cba0 2023-10-14T11:12:57.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.123+0000 7fab5e7fc640 1 -- 172.21.15.26:0/1118286933 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab500ab980 con 0x7fab6015cba0 2023-10-14T11:12:57.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.123+0000 7fab65cd6640 1 -- 172.21.15.26:0/1118286933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab6015cba0 msgr2=0x7fab600d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:57.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.123+0000 7fab65cd6640 1 --2- 172.21.15.26:0/1118286933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab6015cba0 0x7fab600d0f20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fab600cf2f0 tx=0x7fab5001c240 comp rx=0 tx=0).stop 2023-10-14T11:12:57.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.123+0000 7fab65cd6640 1 -- 172.21.15.26:0/1118286933 shutdown_connections 2023-10-14T11:12:57.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.123+0000 7fab65cd6640 1 --2- 172.21.15.26:0/1118286933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab600d0040 0x7fab600d2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.123+0000 7fab65cd6640 1 --2- 172.21.15.26:0/1118286933 >> v2:172.21.15.110:3300/0 conn(0x7fab600b84e0 0x7fab600cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.123+0000 7fab65cd6640 1 --2- 172.21.15.26:0/1118286933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab6015cba0 0x7fab600d0f20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.123+0000 7fab65cd6640 1 -- 172.21.15.26:0/1118286933 >> 172.21.15.26:0/1118286933 conn(0x7fab600719c0 msgr2=0x7fab60071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:57.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.123+0000 7fab65cd6640 1 -- 172.21.15.26:0/1118286933 shutdown_connections 2023-10-14T11:12:57.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.123+0000 7fab65cd6640 1 -- 172.21.15.26:0/1118286933 wait complete. 2023-10-14T11:12:57.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab65cd6640 1 Processor -- start 2023-10-14T11:12:57.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab65cd6640 1 -- start start 2023-10-14T11:12:57.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab65cd6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab600b84e0 0x7fab60150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:57.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab65cd6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab600d0040 0x7fab600c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:57.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab65cd6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab6015cba0 0x7fab601554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:57.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab65cd6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab600c8f30 con 0x7fab600d0040 2023-10-14T11:12:57.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab65cd6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab600c8c50 con 0x7fab600b84e0 2023-10-14T11:12:57.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab65cd6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab600c67b0 con 0x7fab6015cba0 2023-10-14T11:12:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab5effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab600d0040 0x7fab600c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab5effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab600d0040 0x7fab600c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37570/0 (socket says 172.21.15.26:37570) 2023-10-14T11:12:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab5effd640 1 -- 172.21.15.26:0/3827521542 learned_addr learned my addr 172.21.15.26:0/3827521542 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab5ffff640 1 --2- 172.21.15.26:0/3827521542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab6015cba0 0x7fab601554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab5f7fe640 1 --2- 172.21.15.26:0/3827521542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab600b84e0 0x7fab60150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab5effd640 1 -- 172.21.15.26:0/3827521542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab6015cba0 msgr2=0x7fab601554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:57.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab5effd640 1 --2- 172.21.15.26:0/3827521542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab6015cba0 0x7fab601554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab5effd640 1 -- 172.21.15.26:0/3827521542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab600b84e0 msgr2=0x7fab60150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:57.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab5effd640 1 --2- 172.21.15.26:0/3827521542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab600b84e0 0x7fab60150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab5effd640 1 -- 172.21.15.26:0/3827521542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab500094d0 con 0x7fab600d0040 2023-10-14T11:12:57.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab5ffff640 1 --2- 172.21.15.26:0/3827521542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab6015cba0 0x7fab601554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:57.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab5f7fe640 1 --2- 172.21.15.26:0/3827521542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab600b84e0 0x7fab60150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:57.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab5effd640 1 --2- 172.21.15.26:0/3827521542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab600d0040 0x7fab600c8170 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fab5400c7c0 tx=0x7fab5400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:57.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab47fff640 1 -- 172.21.15.26:0/3827521542 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab54007a30 con 0x7fab600d0040 2023-10-14T11:12:57.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab47fff640 1 -- 172.21.15.26:0/3827521542 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab54007b90 con 0x7fab600d0040 2023-10-14T11:12:57.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab65cd6640 1 -- 172.21.15.26:0/3827521542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab600c6a90 con 0x7fab600d0040 2023-10-14T11:12:57.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab47fff640 1 -- 172.21.15.26:0/3827521542 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5400ce70 con 0x7fab600d0040 2023-10-14T11:12:57.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab65cd6640 1 -- 172.21.15.26:0/3827521542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab601603a0 con 0x7fab600d0040 2023-10-14T11:12:57.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.127+0000 7fab65cd6640 1 -- 172.21.15.26:0/3827521542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab600c6fb0 con 0x7fab600d0040 2023-10-14T11:12:57.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.131+0000 7fab47fff640 1 -- 172.21.15.26:0/3827521542 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fab540113f0 con 0x7fab600d0040 2023-10-14T11:12:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.131+0000 7fab47fff640 1 --2- 172.21.15.26:0/3827521542 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fab4c0664a0 0x7fab4c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.131+0000 7fab47fff640 1 -- 172.21.15.26:0/3827521542 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fab54084220 con 0x7fab600d0040 2023-10-14T11:12:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.131+0000 7fab5f7fe640 1 --2- 172.21.15.26:0/3827521542 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fab4c0664a0 0x7fab4c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:57.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.131+0000 7fab5f7fe640 1 --2- 172.21.15.26:0/3827521542 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fab4c0664a0 0x7fab4c068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fab500ad000 tx=0x7fab50008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:57.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.135+0000 7fab47fff640 1 -- 172.21.15.26:0/3827521542 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fab600c6fb0 con 0x7fab600d0040 2023-10-14T11:12:57.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.291+0000 7fab65cd6640 1 -- 172.21.15.26:0/3827521542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fab600c6fb0 con 0x7fab600d0040 2023-10-14T11:12:57.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.291+0000 7fab47fff640 1 -- 172.21.15.26:0/3827521542 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fab600c6fb0 con 0x7fab600d0040 2023-10-14T11:12:57.297 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:12:57.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.295+0000 7fab65cd6640 1 -- 172.21.15.26:0/3827521542 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fab4c0664a0 msgr2=0x7fab4c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:57.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.295+0000 7fab65cd6640 1 --2- 172.21.15.26:0/3827521542 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fab4c0664a0 0x7fab4c068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fab500ad000 tx=0x7fab50008040 comp rx=0 tx=0).stop 2023-10-14T11:12:57.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.295+0000 7fab65cd6640 1 -- 172.21.15.26:0/3827521542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab600d0040 msgr2=0x7fab600c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:57.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.295+0000 7fab65cd6640 1 --2- 172.21.15.26:0/3827521542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab600d0040 0x7fab600c8170 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fab5400c7c0 tx=0x7fab5400cc80 comp rx=0 tx=0).stop 2023-10-14T11:12:57.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.295+0000 7fab65cd6640 1 -- 172.21.15.26:0/3827521542 shutdown_connections 2023-10-14T11:12:57.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.295+0000 7fab65cd6640 1 --2- 172.21.15.26:0/3827521542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab6015cba0 0x7fab601554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.295+0000 7fab65cd6640 1 --2- 172.21.15.26:0/3827521542 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fab4c0664a0 0x7fab4c068960 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.295+0000 7fab65cd6640 1 --2- 172.21.15.26:0/3827521542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab600d0040 0x7fab600c8170 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.295+0000 7fab65cd6640 1 --2- 172.21.15.26:0/3827521542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab600b84e0 0x7fab60150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.295+0000 7fab65cd6640 1 -- 172.21.15.26:0/3827521542 >> 172.21.15.26:0/3827521542 conn(0x7fab600719c0 msgr2=0x7fab600b77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:57.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.295+0000 7fab65cd6640 1 -- 172.21.15.26:0/3827521542 shutdown_connections 2023-10-14T11:12:57.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.295+0000 7fab65cd6640 1 -- 172.21.15.26:0/3827521542 wait complete. 2023-10-14T11:12:57.318 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T11:12:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.463+0000 7fe96759e640 1 Processor -- start 2023-10-14T11:12:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.463+0000 7fe96759e640 1 -- start start 2023-10-14T11:12:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.463+0000 7fe96759e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe9680cf210 0x7fe9680cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.463+0000 7fe96759e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe96815cdc0 0x7fe9680b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.463+0000 7fe96759e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9680cfb30 con 0x7fe9680d3320 2023-10-14T11:12:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.463+0000 7fe96759e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9680d0880 con 0x7fe9680cf210 2023-10-14T11:12:57.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.463+0000 7fe96759e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9680b1c00 con 0x7fe96815cdc0 2023-10-14T11:12:57.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.463+0000 7fe96659c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe9680cf210 0x7fe9680cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:57.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.463+0000 7fe966d9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe9680d3320 0x7fe9680b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38842/0 (socket says 172.21.15.26:38842) 2023-10-14T11:12:57.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.463+0000 7fe966d9d640 1 -- 172.21.15.26:0/3768544587 learned_addr learned my addr 172.21.15.26:0/3768544587 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:57.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.463+0000 7fe95ffff640 1 --2- 172.21.15.26:0/3768544587 >> v2:172.21.15.110:3300/0 conn(0x7fe96815cdc0 0x7fe9680b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:57.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.463+0000 7fe96659c640 1 -- 172.21.15.26:0/3768544587 >> v2:172.21.15.110:3300/0 conn(0x7fe96815cdc0 msgr2=0x7fe9680b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:57.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.463+0000 7fe96659c640 1 --2- 172.21.15.26:0/3768544587 >> v2:172.21.15.110:3300/0 conn(0x7fe96815cdc0 0x7fe9680b2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.463+0000 7fe96659c640 1 -- 172.21.15.26:0/3768544587 >> v1:172.21.15.26:6789/0 conn(0x7fe9680d3320 legacy=0x7fe9680b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:57.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.463+0000 7fe96659c640 1 -- 172.21.15.26:0/3768544587 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9680b1ee0 con 0x7fe9680cf210 2023-10-14T11:12:57.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.463+0000 7fe95ffff640 1 --2- 172.21.15.26:0/3768544587 >> v2:172.21.15.110:3300/0 conn(0x7fe96815cdc0 0x7fe9680b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:57.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.463+0000 7fe965d9b640 1 -- 172.21.15.26:0/3768544587 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139405254 0 0) 0x7fe9680cfb30 con 0x7fe9680d3320 2023-10-14T11:12:57.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.467+0000 7fe96659c640 1 --2- 172.21.15.26:0/3768544587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9680cf210 0x7fe9680cf5f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe9680b88b0 tx=0x7fe9680b4100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51fea5f302b6516 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:57.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.467+0000 7fe965d9b640 1 -- 172.21.15.26:0/3768544587 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9580ad680 con 0x7fe9680cf210 2023-10-14T11:12:57.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.467+0000 7fe965d9b640 1 -- 172.21.15.26:0/3768544587 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9580ad7e0 con 0x7fe9680cf210 2023-10-14T11:12:57.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.467+0000 7fe965d9b640 1 -- 172.21.15.26:0/3768544587 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9580adb70 con 0x7fe9680cf210 2023-10-14T11:12:57.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.467+0000 7fe96759e640 1 -- 172.21.15.26:0/3768544587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9680cf210 msgr2=0x7fe9680cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:57.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.467+0000 7fe96759e640 1 --2- 172.21.15.26:0/3768544587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9680cf210 0x7fe9680cf5f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe9680b88b0 tx=0x7fe9680b4100 comp rx=0 tx=0).stop 2023-10-14T11:12:57.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.467+0000 7fe96759e640 1 -- 172.21.15.26:0/3768544587 shutdown_connections 2023-10-14T11:12:57.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.467+0000 7fe96759e640 1 --2- 172.21.15.26:0/3768544587 >> v2:172.21.15.110:3300/0 conn(0x7fe96815cdc0 0x7fe9680b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.467+0000 7fe96759e640 1 --2- 172.21.15.26:0/3768544587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9680cf210 0x7fe9680cf5f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.467+0000 7fe96759e640 1 -- 172.21.15.26:0/3768544587 >> 172.21.15.26:0/3768544587 conn(0x7fe9680d2800 msgr2=0x7fe9680d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:57.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.467+0000 7fe96759e640 1 -- 172.21.15.26:0/3768544587 shutdown_connections 2023-10-14T11:12:57.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.467+0000 7fe96759e640 1 -- 172.21.15.26:0/3768544587 wait complete. 2023-10-14T11:12:57.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe96759e640 1 Processor -- start 2023-10-14T11:12:57.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe96759e640 1 -- start start 2023-10-14T11:12:57.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe96759e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9680cf210 0x7fe9680c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:57.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe96759e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9680d3320 0x7fe96815fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:57.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe96759e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe96815cdc0 0x7fe9681545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:57.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe96759e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96815f2b0 con 0x7fe9680d3320 2023-10-14T11:12:57.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe96759e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9680c8fe0 con 0x7fe96815cdc0 2023-10-14T11:12:57.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe96759e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9680b1560 con 0x7fe9680cf210 2023-10-14T11:12:57.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe95ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9680d3320 0x7fe96815fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:57.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe95ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9680d3320 0x7fe96815fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37588/0 (socket says 172.21.15.26:37588) 2023-10-14T11:12:57.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe95ffff640 1 -- 172.21.15.26:0/3960093297 learned_addr learned my addr 172.21.15.26:0/3960093297 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:57.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe966d9d640 1 --2- 172.21.15.26:0/3960093297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe96815cdc0 0x7fe9681545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:57.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe96659c640 1 --2- 172.21.15.26:0/3960093297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9680cf210 0x7fe9680c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:57.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe95ffff640 1 -- 172.21.15.26:0/3960093297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9680cf210 msgr2=0x7fe9680c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:57.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe95ffff640 1 --2- 172.21.15.26:0/3960093297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9680cf210 0x7fe9680c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe95ffff640 1 -- 172.21.15.26:0/3960093297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe96815cdc0 msgr2=0x7fe9681545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:57.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe95ffff640 1 --2- 172.21.15.26:0/3960093297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe96815cdc0 0x7fe9681545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe95ffff640 1 -- 172.21.15.26:0/3960093297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9580093b0 con 0x7fe9680d3320 2023-10-14T11:12:57.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe966d9d640 1 --2- 172.21.15.26:0/3960093297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe96815cdc0 0x7fe9681545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:57.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe95ffff640 1 --2- 172.21.15.26:0/3960093297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9680d3320 0x7fe96815fa00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe95000d800 tx=0x7fe95000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:57.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe95effd640 1 -- 172.21.15.26:0/3960093297 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9500096c0 con 0x7fe9680d3320 2023-10-14T11:12:57.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe95effd640 1 -- 172.21.15.26:0/3960093297 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe950009820 con 0x7fe9680d3320 2023-10-14T11:12:57.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe96759e640 1 -- 172.21.15.26:0/3960093297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9680b0fa0 con 0x7fe9680d3320 2023-10-14T11:12:57.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe95effd640 1 -- 172.21.15.26:0/3960093297 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe950009bd0 con 0x7fe9680d3320 2023-10-14T11:12:57.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.471+0000 7fe96759e640 1 -- 172.21.15.26:0/3960093297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96815f4e0 con 0x7fe9680d3320 2023-10-14T11:12:57.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.475+0000 7fe96759e640 1 -- 172.21.15.26:0/3960093297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9681599a0 con 0x7fe9680d3320 2023-10-14T11:12:57.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.475+0000 7fe95effd640 1 -- 172.21.15.26:0/3960093297 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe950009d30 con 0x7fe9680d3320 2023-10-14T11:12:57.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.475+0000 7fe95effd640 1 --2- 172.21.15.26:0/3960093297 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe9480664a0 0x7fe948068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:57.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.475+0000 7fe95effd640 1 -- 172.21.15.26:0/3960093297 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe950084880 con 0x7fe9680d3320 2023-10-14T11:12:57.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.475+0000 7fe96659c640 1 --2- 172.21.15.26:0/3960093297 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe9480664a0 0x7fe948068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:57.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.475+0000 7fe96659c640 1 --2- 172.21.15.26:0/3960093297 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe9480664a0 0x7fe948068960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe9580af000 tx=0x7fe958008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:57.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.479+0000 7fe95effd640 1 -- 172.21.15.26:0/3960093297 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe950051a00 con 0x7fe9680d3320 2023-10-14T11:12:57.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.635+0000 7fe96759e640 1 -- 172.21.15.26:0/3960093297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe96804e9c0 con 0x7fe9680d3320 2023-10-14T11:12:57.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.635+0000 7fe95effd640 1 -- 172.21.15.26:0/3960093297 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe950055020 con 0x7fe9680d3320 2023-10-14T11:12:57.639 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:12:57.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.635+0000 7fe96759e640 1 -- 172.21.15.26:0/3960093297 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe9480664a0 msgr2=0x7fe948068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:57.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.635+0000 7fe96759e640 1 --2- 172.21.15.26:0/3960093297 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe9480664a0 0x7fe948068960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe9580af000 tx=0x7fe958008040 comp rx=0 tx=0).stop 2023-10-14T11:12:57.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.635+0000 7fe96759e640 1 -- 172.21.15.26:0/3960093297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9680d3320 msgr2=0x7fe96815fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:57.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.635+0000 7fe96759e640 1 --2- 172.21.15.26:0/3960093297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9680d3320 0x7fe96815fa00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe95000d800 tx=0x7fe95000dcc0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.635+0000 7fe96759e640 1 -- 172.21.15.26:0/3960093297 shutdown_connections 2023-10-14T11:12:57.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.635+0000 7fe96759e640 1 --2- 172.21.15.26:0/3960093297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe96815cdc0 0x7fe9681545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.635+0000 7fe96759e640 1 --2- 172.21.15.26:0/3960093297 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe9480664a0 0x7fe948068960 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.635+0000 7fe96759e640 1 --2- 172.21.15.26:0/3960093297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9680d3320 0x7fe96815fa00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.635+0000 7fe96759e640 1 --2- 172.21.15.26:0/3960093297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9680cf210 0x7fe9680c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.635+0000 7fe96759e640 1 -- 172.21.15.26:0/3960093297 >> 172.21.15.26:0/3960093297 conn(0x7fe9680d2800 msgr2=0x7fe9680af370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:57.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.635+0000 7fe96759e640 1 -- 172.21.15.26:0/3960093297 shutdown_connections 2023-10-14T11:12:57.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.635+0000 7fe96759e640 1 -- 172.21.15.26:0/3960093297 wait complete. 2023-10-14T11:12:57.660 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:12:57.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.799+0000 7f9f379d0640 1 Processor -- start 2023-10-14T11:12:57.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.799+0000 7f9f379d0640 1 -- start start 2023-10-14T11:12:57.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.799+0000 7f9f379d0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9f30164520 0x7f9f300ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:57.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.799+0000 7f9f379d0640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f300c96f0 con 0x7f9f300b07f0 2023-10-14T11:12:57.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.799+0000 7f9f379d0640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f300cb950 con 0x7f9f300ad960 2023-10-14T11:12:57.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.799+0000 7f9f379d0640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f30164900 con 0x7f9f30164520 2023-10-14T11:12:57.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.799+0000 7f9f3576c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9f30164520 0x7f9f300ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:57.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.799+0000 7f9f35f6d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9f300b07f0 0x7f9f300cc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38848/0 (socket says 172.21.15.26:38848) 2023-10-14T11:12:57.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.799+0000 7f9f35f6d640 1 -- 172.21.15.26:0/1293932547 learned_addr learned my addr 172.21.15.26:0/1293932547 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:12:57.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.803+0000 7f9f3576c640 1 -- 172.21.15.26:0/1293932547 >> v1:172.21.15.110:6789/0 conn(0x7f9f300ad960 legacy=0x7f9f300b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:57.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.803+0000 7f9f3576c640 1 -- 172.21.15.26:0/1293932547 >> v1:172.21.15.26:6789/0 conn(0x7f9f300b07f0 legacy=0x7f9f300cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:57.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.803+0000 7f9f3576c640 1 -- 172.21.15.26:0/1293932547 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f300cbed0 con 0x7f9f30164520 2023-10-14T11:12:57.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.803+0000 7f9f27fff640 1 -- 172.21.15.26:0/1293932547 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581628558 0 0) 0x7f9f300c96f0 con 0x7f9f300b07f0 2023-10-14T11:12:57.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.803+0000 7f9f3576c640 1 --2- 172.21.15.26:0/1293932547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f30164520 0x7f9f300ce010 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0097c0 tx=0x7f9f2c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28de537e94fe8b49 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:57.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.803+0000 7f9f27fff640 1 -- 172.21.15.26:0/1293932547 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c0ab670 con 0x7f9f30164520 2023-10-14T11:12:57.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.803+0000 7f9f27fff640 1 -- 172.21.15.26:0/1293932547 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2c0ab7d0 con 0x7f9f30164520 2023-10-14T11:12:57.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.803+0000 7f9f27fff640 1 -- 172.21.15.26:0/1293932547 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c0abb60 con 0x7f9f30164520 2023-10-14T11:12:57.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.803+0000 7f9f379d0640 1 -- 172.21.15.26:0/1293932547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f30164520 msgr2=0x7f9f300ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:57.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.803+0000 7f9f379d0640 1 --2- 172.21.15.26:0/1293932547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f30164520 0x7f9f300ce010 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0097c0 tx=0x7f9f2c01c450 comp rx=0 tx=0).stop 2023-10-14T11:12:57.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f379d0640 1 -- 172.21.15.26:0/1293932547 shutdown_connections 2023-10-14T11:12:57.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f379d0640 1 --2- 172.21.15.26:0/1293932547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f30164520 0x7f9f300ce010 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f379d0640 1 -- 172.21.15.26:0/1293932547 >> 172.21.15.26:0/1293932547 conn(0x7f9f3006c190 msgr2=0x7f9f3006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:57.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f379d0640 1 -- 172.21.15.26:0/1293932547 shutdown_connections 2023-10-14T11:12:57.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f379d0640 1 -- 172.21.15.26:0/1293932547 wait complete. 2023-10-14T11:12:57.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f379d0640 1 Processor -- start 2023-10-14T11:12:57.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f379d0640 1 -- start start 2023-10-14T11:12:57.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f379d0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f300ad960 0x7f9f300c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:57.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f379d0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f300b07f0 0x7f9f300c2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:57.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f379d0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f30164520 0x7f9f300c2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:57.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f379d0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3015d1c0 con 0x7f9f300ad960 2023-10-14T11:12:57.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f379d0640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f300c2d10 con 0x7f9f300b07f0 2023-10-14T11:12:57.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f379d0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f300c2ff0 con 0x7f9f30164520 2023-10-14T11:12:57.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f3576c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f300ad960 0x7f9f300c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:57.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f3576c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f300ad960 0x7f9f300c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37602/0 (socket says 172.21.15.26:37602) 2023-10-14T11:12:57.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f3576c640 1 -- 172.21.15.26:0/3833983564 learned_addr learned my addr 172.21.15.26:0/3833983564 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:57.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f34f6b640 1 --2- 172.21.15.26:0/3833983564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f300b07f0 0x7f9f300c2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:57.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f35f6d640 1 --2- 172.21.15.26:0/3833983564 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f30164520 0x7f9f300c2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:57.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f3576c640 1 -- 172.21.15.26:0/3833983564 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f30164520 msgr2=0x7f9f300c2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:57.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f3576c640 1 --2- 172.21.15.26:0/3833983564 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f30164520 0x7f9f300c2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f3576c640 1 -- 172.21.15.26:0/3833983564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f300b07f0 msgr2=0x7f9f300c2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:57.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f3576c640 1 --2- 172.21.15.26:0/3833983564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f300b07f0 0x7f9f300c2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:57.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f3576c640 1 -- 172.21.15.26:0/3833983564 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c009420 con 0x7f9f300ad960 2023-10-14T11:12:57.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.807+0000 7f9f3576c640 1 --2- 172.21.15.26:0/3833983564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f300ad960 0x7f9f300c7850 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c019060 tx=0x7f9f2c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:57.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.811+0000 7f9f25ffb640 1 -- 172.21.15.26:0/3833983564 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c0b5810 con 0x7f9f300ad960 2023-10-14T11:12:57.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.811+0000 7f9f25ffb640 1 -- 172.21.15.26:0/3833983564 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2c0b5990 con 0x7f9f300ad960 2023-10-14T11:12:57.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.811+0000 7f9f25ffb640 1 -- 172.21.15.26:0/3833983564 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c0b5d40 con 0x7f9f300ad960 2023-10-14T11:12:57.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.811+0000 7f9f379d0640 1 -- 172.21.15.26:0/3833983564 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f300c32d0 con 0x7f9f300ad960 2023-10-14T11:12:57.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.811+0000 7f9f379d0640 1 -- 172.21.15.26:0/3833983564 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f300c3890 con 0x7f9f300ad960 2023-10-14T11:12:57.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.811+0000 7f9f379d0640 1 -- 172.21.15.26:0/3833983564 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f30074010 con 0x7f9f300ad960 2023-10-14T11:12:57.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.811+0000 7f9f25ffb640 1 -- 172.21.15.26:0/3833983564 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9f2c0bf410 con 0x7f9f300ad960 2023-10-14T11:12:57.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.811+0000 7f9f25ffb640 1 --2- 172.21.15.26:0/3833983564 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9f140664a0 0x7f9f14068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:57.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.811+0000 7f9f25ffb640 1 -- 172.21.15.26:0/3833983564 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9f2c11ece0 con 0x7f9f300ad960 2023-10-14T11:12:57.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.811+0000 7f9f34f6b640 1 --2- 172.21.15.26:0/3833983564 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9f140664a0 0x7f9f14068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:57.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.815+0000 7f9f34f6b640 1 --2- 172.21.15.26:0/3833983564 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9f140664a0 0x7f9f14068960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9f301fd490 tx=0x7f9f20009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:57.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:57.815+0000 7f9f25ffb640 1 -- 172.21.15.26:0/3833983564 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9f2c0ebdd0 con 0x7f9f300ad960 2023-10-14T11:12:58.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.011+0000 7f9f379d0640 1 -- 172.21.15.26:0/3833983564 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f300c1260 con 0x7f9f300ad960 2023-10-14T11:12:58.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.011+0000 7f9f25ffb640 1 -- 172.21.15.26:0/3833983564 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f9f2c0ef3f0 con 0x7f9f300ad960 2023-10-14T11:12:58.016 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:58.016 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/2685368784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2685368784},{"type":"v1","addr":"172.21.15.110:6834","nonce":2685368784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6836/4242453713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":4242453713},{"type":"v1","addr":"172.21.15.26:6836","nonce":4242453713}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3507761146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":3507761146},{"type":"v1","addr":"172.21.15.26:6837","nonce":3507761146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:12:22.355867+0000","modified":"2023-10-14T11:12:46.435346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3522025152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3522025152},{"type":"v1","addr":"172.21.15.110:6835","nonce":3522025152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T11:12:58.017 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 9 2023-10-14T11:12:58.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.015+0000 7f9f379d0640 1 -- 172.21.15.26:0/3833983564 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9f140664a0 msgr2=0x7f9f14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:58.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.015+0000 7f9f379d0640 1 --2- 172.21.15.26:0/3833983564 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9f140664a0 0x7f9f14068960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9f301fd490 tx=0x7f9f20009040 comp rx=0 tx=0).stop 2023-10-14T11:12:58.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.015+0000 7f9f379d0640 1 -- 172.21.15.26:0/3833983564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f300ad960 msgr2=0x7f9f300c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:58.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.015+0000 7f9f379d0640 1 --2- 172.21.15.26:0/3833983564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f300ad960 0x7f9f300c7850 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c019060 tx=0x7f9f2c01ac90 comp rx=0 tx=0).stop 2023-10-14T11:12:58.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.015+0000 7f9f379d0640 1 -- 172.21.15.26:0/3833983564 shutdown_connections 2023-10-14T11:12:58.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.015+0000 7f9f379d0640 1 --2- 172.21.15.26:0/3833983564 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f30164520 0x7f9f300c2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.015+0000 7f9f379d0640 1 --2- 172.21.15.26:0/3833983564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f300b07f0 0x7f9f300c2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.015+0000 7f9f379d0640 1 --2- 172.21.15.26:0/3833983564 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9f140664a0 0x7f9f14068960 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.015+0000 7f9f379d0640 1 --2- 172.21.15.26:0/3833983564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f300ad960 0x7f9f300c7850 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.015+0000 7f9f379d0640 1 -- 172.21.15.26:0/3833983564 >> 172.21.15.26:0/3833983564 conn(0x7f9f3006c190 msgr2=0x7f9f300cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:58.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.015+0000 7f9f379d0640 1 -- 172.21.15.26:0/3833983564 shutdown_connections 2023-10-14T11:12:58.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.015+0000 7f9f379d0640 1 -- 172.21.15.26:0/3833983564 wait complete. 2023-10-14T11:12:58.037 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:12:58.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.175+0000 7f74c98ea640 1 Processor -- start 2023-10-14T11:12:58.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.175+0000 7f74c98ea640 1 -- start start 2023-10-14T11:12:58.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.175+0000 7f74c98ea640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74c415ca70 0x7f74c40d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:58.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.175+0000 7f74c98ea640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f74c40cf7a0 0x7f74c40c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:58.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.175+0000 7f74c98ea640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c40c65f0 con 0x7f74c40d3550 2023-10-14T11:12:58.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.175+0000 7f74c98ea640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c40ce820 con 0x7f74c40cf7a0 2023-10-14T11:12:58.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.175+0000 7f74c98ea640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c40cdf80 con 0x7f74c415ca70 2023-10-14T11:12:58.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.179+0000 7f74c37fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f74c40cf7a0 0x7f74c40c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:58.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.179+0000 7f74c37fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f74c40cf7a0 0x7f74c40c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37614/0 (socket says 172.21.15.26:37614) 2023-10-14T11:12:58.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.179+0000 7f74c37fe640 1 -- 172.21.15.26:0/3217312144 learned_addr learned my addr 172.21.15.26:0/3217312144 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:58.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.179+0000 7f74c2ffd640 1 --2- 172.21.15.26:0/3217312144 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74c415ca70 0x7f74c40d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:58.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.179+0000 7f74c37fe640 1 -- 172.21.15.26:0/3217312144 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74c415ca70 msgr2=0x7f74c40d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:58.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.179+0000 7f74c37fe640 1 --2- 172.21.15.26:0/3217312144 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74c415ca70 0x7f74c40d3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.179+0000 7f74c37fe640 1 -- 172.21.15.26:0/3217312144 >> v1:172.21.15.110:6789/0 conn(0x7f74c40d3550 legacy=0x7f74c40cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:58.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.179+0000 7f74c37fe640 1 -- 172.21.15.26:0/3217312144 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c40ce260 con 0x7f74c40cf7a0 2023-10-14T11:12:58.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.179+0000 7f74c37fe640 1 --2- 172.21.15.26:0/3217312144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74c40cf7a0 0x7f74c40c6ad0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009e50 tx=0x7f74bc01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf373a3308c1feb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:58.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.179+0000 7f74c27fc640 1 -- 172.21.15.26:0/3217312144 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc0a5810 con 0x7f74c40cf7a0 2023-10-14T11:12:58.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.179+0000 7f74c27fc640 1 -- 172.21.15.26:0/3217312144 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74bc0a5970 con 0x7f74c40cf7a0 2023-10-14T11:12:58.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.179+0000 7f74c27fc640 1 -- 172.21.15.26:0/3217312144 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc0a5d00 con 0x7f74c40cf7a0 2023-10-14T11:12:58.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c98ea640 1 -- 172.21.15.26:0/3217312144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74c40cf7a0 msgr2=0x7f74c40c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:58.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c98ea640 1 --2- 172.21.15.26:0/3217312144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74c40cf7a0 0x7f74c40c6ad0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009e50 tx=0x7f74bc01c9e0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c98ea640 1 -- 172.21.15.26:0/3217312144 shutdown_connections 2023-10-14T11:12:58.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c98ea640 1 --2- 172.21.15.26:0/3217312144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74c40cf7a0 0x7f74c40c6ad0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c98ea640 1 --2- 172.21.15.26:0/3217312144 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74c415ca70 0x7f74c40d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c98ea640 1 -- 172.21.15.26:0/3217312144 >> 172.21.15.26:0/3217312144 conn(0x7f74c409bc50 msgr2=0x7f74c40d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:58.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c98ea640 1 -- 172.21.15.26:0/3217312144 shutdown_connections 2023-10-14T11:12:58.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c98ea640 1 -- 172.21.15.26:0/3217312144 wait complete. 2023-10-14T11:12:58.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c98ea640 1 Processor -- start 2023-10-14T11:12:58.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c98ea640 1 -- start start 2023-10-14T11:12:58.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c98ea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74c40cf7a0 0x7f74c414f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:58.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c98ea640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74c40d3550 0x7f74c414ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:58.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c98ea640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74c415ca70 0x7f74c40b7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:58.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c98ea640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c40b56b0 con 0x7f74c40cf7a0 2023-10-14T11:12:58.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c98ea640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c414fd70 con 0x7f74c40d3550 2023-10-14T11:12:58.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c98ea640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c414e310 con 0x7f74c415ca70 2023-10-14T11:12:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74c40cf7a0 0x7f74c414f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74c40cf7a0 0x7f74c414f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37630/0 (socket says 172.21.15.26:37630) 2023-10-14T11:12:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c2ffd640 1 -- 172.21.15.26:0/3988853370 learned_addr learned my addr 172.21.15.26:0/3988853370 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74bbfff640 1 --2- 172.21.15.26:0/3988853370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74c40d3550 0x7f74c414ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c37fe640 1 --2- 172.21.15.26:0/3988853370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74c415ca70 0x7f74c40b7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:58.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c2ffd640 1 -- 172.21.15.26:0/3988853370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74c415ca70 msgr2=0x7f74c40b7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:58.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c2ffd640 1 --2- 172.21.15.26:0/3988853370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74c415ca70 0x7f74c40b7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c2ffd640 1 -- 172.21.15.26:0/3988853370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74c40d3550 msgr2=0x7f74c414ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:58.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.183+0000 7f74c2ffd640 1 --2- 172.21.15.26:0/3988853370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74c40d3550 0x7f74c414ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.187+0000 7f74c2ffd640 1 -- 172.21.15.26:0/3988853370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc009b30 con 0x7f74c40cf7a0 2023-10-14T11:12:58.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.187+0000 7f74c2ffd640 1 --2- 172.21.15.26:0/3988853370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74c40cf7a0 0x7f74c414f830 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f74b400d800 tx=0x7f74b400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:58.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.187+0000 7f74c0ff9640 1 -- 172.21.15.26:0/3988853370 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b400b6c0 con 0x7f74c40cf7a0 2023-10-14T11:12:58.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.187+0000 7f74c0ff9640 1 -- 172.21.15.26:0/3988853370 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b400b820 con 0x7f74c40cf7a0 2023-10-14T11:12:58.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.187+0000 7f74c0ff9640 1 -- 172.21.15.26:0/3988853370 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b400bbd0 con 0x7f74c40cf7a0 2023-10-14T11:12:58.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.187+0000 7f74c98ea640 1 -- 172.21.15.26:0/3988853370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c414ef90 con 0x7f74c40cf7a0 2023-10-14T11:12:58.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.187+0000 7f74c98ea640 1 -- 172.21.15.26:0/3988853370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c414f550 con 0x7f74c40cf7a0 2023-10-14T11:12:58.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.187+0000 7f74c98ea640 1 -- 172.21.15.26:0/3988853370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c4074010 con 0x7f74c40cf7a0 2023-10-14T11:12:58.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.187+0000 7f74c0ff9640 1 -- 172.21.15.26:0/3988853370 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f74b400bd30 con 0x7f74c40cf7a0 2023-10-14T11:12:58.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.187+0000 7f74c0ff9640 1 --2- 172.21.15.26:0/3988853370 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f74a40664a0 0x7f74a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:58.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.187+0000 7f74c0ff9640 1 -- 172.21.15.26:0/3988853370 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f74b4084530 con 0x7f74c40cf7a0 2023-10-14T11:12:58.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.187+0000 7f74bbfff640 1 --2- 172.21.15.26:0/3988853370 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f74a40664a0 0x7f74a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:58.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.191+0000 7f74bbfff640 1 --2- 172.21.15.26:0/3988853370 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f74a40664a0 0x7f74a4068960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f74c406cb30 tx=0x7f74ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:58.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.191+0000 7f74c0ff9640 1 -- 172.21.15.26:0/3988853370 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f74b4051760 con 0x7f74c40cf7a0 2023-10-14T11:12:58.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.351+0000 7f74c98ea640 1 -- 172.21.15.26:0/3988853370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74c406cb60 con 0x7f74c40cf7a0 2023-10-14T11:12:58.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.351+0000 7f74c0ff9640 1 -- 172.21.15.26:0/3988853370 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f74b4054d80 con 0x7f74c40cf7a0 2023-10-14T11:12:58.356 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:58.357 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":25,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:12:27.398936+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:12:58.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.355+0000 7f74c98ea640 1 -- 172.21.15.26:0/3988853370 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f74a40664a0 msgr2=0x7f74a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:58.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.355+0000 7f74c98ea640 1 --2- 172.21.15.26:0/3988853370 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f74a40664a0 0x7f74a4068960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f74c406cb30 tx=0x7f74ac009040 comp rx=0 tx=0).stop 2023-10-14T11:12:58.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.355+0000 7f74c98ea640 1 -- 172.21.15.26:0/3988853370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74c40cf7a0 msgr2=0x7f74c414f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:58.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.355+0000 7f74c98ea640 1 --2- 172.21.15.26:0/3988853370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74c40cf7a0 0x7f74c414f830 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f74b400d800 tx=0x7f74b400dcc0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.355+0000 7f74c98ea640 1 -- 172.21.15.26:0/3988853370 shutdown_connections 2023-10-14T11:12:58.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.355+0000 7f74c98ea640 1 --2- 172.21.15.26:0/3988853370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74c415ca70 0x7f74c40b7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.355+0000 7f74c98ea640 1 --2- 172.21.15.26:0/3988853370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74c40d3550 0x7f74c414ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.355+0000 7f74c98ea640 1 --2- 172.21.15.26:0/3988853370 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f74a40664a0 0x7f74a4068960 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.355+0000 7f74c98ea640 1 --2- 172.21.15.26:0/3988853370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74c40cf7a0 0x7f74c414f830 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.355+0000 7f74c98ea640 1 -- 172.21.15.26:0/3988853370 >> 172.21.15.26:0/3988853370 conn(0x7f74c409bc50 msgr2=0x7f74c40ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:58.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.355+0000 7f74c98ea640 1 -- 172.21.15.26:0/3988853370 shutdown_connections 2023-10-14T11:12:58.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.355+0000 7f74c98ea640 1 -- 172.21.15.26:0/3988853370 wait complete. 2023-10-14T11:12:58.378 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:12:58.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.519+0000 7f6fdb91d640 1 Processor -- start 2023-10-14T11:12:58.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.519+0000 7f6fdb91d640 1 -- start start 2023-10-14T11:12:58.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.519+0000 7f6fdb91d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd4164520 0x7f6fd40ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:58.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.519+0000 7f6fdb91d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6fd40ad960 0x7f6fd40b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:58.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.519+0000 7f6fdb91d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6fd40c9b80 0x7f6fd40b0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:58.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.519+0000 7f6fdb91d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd4164900 con 0x7f6fd40ad960 2023-10-14T11:12:58.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.519+0000 7f6fdb91d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd40c96f0 con 0x7f6fd40c9b80 2023-10-14T11:12:58.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.519+0000 7f6fdb91d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd40cb950 con 0x7f6fd4164520 2023-10-14T11:12:58.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.519+0000 7f6fd8eb8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6fd40ad960 0x7f6fd40b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:58.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.519+0000 7f6fd8eb8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6fd40ad960 0x7f6fd40b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37646/0 (socket says 172.21.15.26:37646) 2023-10-14T11:12:58.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.519+0000 7f6fd8eb8640 1 -- 172.21.15.26:0/735134805 learned_addr learned my addr 172.21.15.26:0/735134805 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:58.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.519+0000 7f6fd96b9640 1 --2- 172.21.15.26:0/735134805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd4164520 0x7f6fd40ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:58.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.519+0000 7f6fd9eba640 1 --2- 172.21.15.26:0/735134805 >> v2:172.21.15.110:3300/0 conn(0x7f6fd40c9b80 0x7f6fd40b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:58.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.519+0000 7f6fd8eb8640 1 -- 172.21.15.26:0/735134805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd4164520 msgr2=0x7f6fd40ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:58.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.519+0000 7f6fd8eb8640 1 --2- 172.21.15.26:0/735134805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd4164520 0x7f6fd40ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.519+0000 7f6fd8eb8640 1 -- 172.21.15.26:0/735134805 >> v2:172.21.15.110:3300/0 conn(0x7f6fd40c9b80 msgr2=0x7f6fd40b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:58.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.519+0000 7f6fd8eb8640 1 --2- 172.21.15.26:0/735134805 >> v2:172.21.15.110:3300/0 conn(0x7f6fd40c9b80 0x7f6fd40b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.519+0000 7f6fd8eb8640 1 -- 172.21.15.26:0/735134805 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd40cbed0 con 0x7f6fd40ad960 2023-10-14T11:12:58.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.519+0000 7f6fd96b9640 1 --2- 172.21.15.26:0/735134805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd4164520 0x7f6fd40ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:12:58.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.523+0000 7f6fd8eb8640 1 --2- 172.21.15.26:0/735134805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fd40ad960 0x7f6fd40b00e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40c9360 tx=0x7f6fc401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce6a97023656192 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:58.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.523+0000 7f6fcbfff640 1 -- 172.21.15.26:0/735134805 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc40aa640 con 0x7f6fd40ad960 2023-10-14T11:12:58.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.523+0000 7f6fcbfff640 1 -- 172.21.15.26:0/735134805 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc40aa7a0 con 0x7f6fd40ad960 2023-10-14T11:12:58.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.523+0000 7f6fcbfff640 1 -- 172.21.15.26:0/735134805 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc40aab30 con 0x7f6fd40ad960 2023-10-14T11:12:58.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.523+0000 7f6fdb91d640 1 -- 172.21.15.26:0/735134805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fd40ad960 msgr2=0x7f6fd40b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:58.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.523+0000 7f6fdb91d640 1 --2- 172.21.15.26:0/735134805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fd40ad960 0x7f6fd40b00e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40c9360 tx=0x7f6fc401c500 comp rx=0 tx=0).stop 2023-10-14T11:12:58.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.523+0000 7f6fdb91d640 1 -- 172.21.15.26:0/735134805 shutdown_connections 2023-10-14T11:12:58.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.523+0000 7f6fdb91d640 1 --2- 172.21.15.26:0/735134805 >> v2:172.21.15.110:3300/0 conn(0x7f6fd40c9b80 0x7f6fd40b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.523+0000 7f6fdb91d640 1 --2- 172.21.15.26:0/735134805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fd40ad960 0x7f6fd40b00e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.523+0000 7f6fdb91d640 1 --2- 172.21.15.26:0/735134805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd4164520 0x7f6fd40ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.523+0000 7f6fdb91d640 1 -- 172.21.15.26:0/735134805 >> 172.21.15.26:0/735134805 conn(0x7f6fd406c190 msgr2=0x7f6fd406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:58.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.523+0000 7f6fdb91d640 1 -- 172.21.15.26:0/735134805 shutdown_connections 2023-10-14T11:12:58.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.523+0000 7f6fdb91d640 1 -- 172.21.15.26:0/735134805 wait complete. 2023-10-14T11:12:58.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fdb91d640 1 Processor -- start 2023-10-14T11:12:58.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fdb91d640 1 -- start start 2023-10-14T11:12:58.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fdb91d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd40ad960 0x7f6fd4153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:58.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fdb91d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fd40c9b80 0x7f6fd40aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:58.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fdb91d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd4164520 0x7f6fd4156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:58.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fdb91d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd40af180 con 0x7f6fd40c9b80 2023-10-14T11:12:58.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fdb91d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd4159700 con 0x7f6fd40ad960 2023-10-14T11:12:58.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fdb91d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd40ae160 con 0x7f6fd4164520 2023-10-14T11:12:58.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fd8eb8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fd40c9b80 0x7f6fd40aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:58.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fd8eb8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fd40c9b80 0x7f6fd40aec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37662/0 (socket says 172.21.15.26:37662) 2023-10-14T11:12:58.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fd8eb8640 1 -- 172.21.15.26:0/3602612726 learned_addr learned my addr 172.21.15.26:0/3602612726 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:58.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fd96b9640 1 --2- 172.21.15.26:0/3602612726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd40ad960 0x7f6fd4153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:58.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fd9eba640 1 --2- 172.21.15.26:0/3602612726 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd4164520 0x7f6fd4156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:58.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fd8eb8640 1 -- 172.21.15.26:0/3602612726 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd4164520 msgr2=0x7f6fd4156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:58.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fd8eb8640 1 --2- 172.21.15.26:0/3602612726 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd4164520 0x7f6fd4156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fd8eb8640 1 -- 172.21.15.26:0/3602612726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd40ad960 msgr2=0x7f6fd4153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:58.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fd8eb8640 1 --2- 172.21.15.26:0/3602612726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd40ad960 0x7f6fd4153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fd8eb8640 1 -- 172.21.15.26:0/3602612726 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc40094d0 con 0x7f6fd40c9b80 2023-10-14T11:12:58.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fd96b9640 1 --2- 172.21.15.26:0/3602612726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd40ad960 0x7f6fd4153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:12:58.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fd8eb8640 1 --2- 172.21.15.26:0/3602612726 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fd40c9b80 0x7f6fd40aec40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6fc401abb0 tx=0x7f6fc401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:58.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fc9ffb640 1 -- 172.21.15.26:0/3602612726 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc40bd5f0 con 0x7f6fd40c9b80 2023-10-14T11:12:58.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fc9ffb640 1 -- 172.21.15.26:0/3602612726 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc40bd750 con 0x7f6fd40c9b80 2023-10-14T11:12:58.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fc9ffb640 1 -- 172.21.15.26:0/3602612726 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc40bdb00 con 0x7f6fd40c9b80 2023-10-14T11:12:58.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fdb91d640 1 -- 172.21.15.26:0/3602612726 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd40ae440 con 0x7f6fd40c9b80 2023-10-14T11:12:58.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.527+0000 7f6fdb91d640 1 -- 172.21.15.26:0/3602612726 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd41577f0 con 0x7f6fd40c9b80 2023-10-14T11:12:58.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.531+0000 7f6fdb91d640 1 -- 172.21.15.26:0/3602612726 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd40ae2a0 con 0x7f6fd40c9b80 2023-10-14T11:12:58.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.531+0000 7f6fc9ffb640 1 -- 172.21.15.26:0/3602612726 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6fc40a8050 con 0x7f6fd40c9b80 2023-10-14T11:12:58.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.531+0000 7f6fc9ffb640 1 --2- 172.21.15.26:0/3602612726 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6fb80664a0 0x7f6fb8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:58.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.531+0000 7f6fc9ffb640 1 -- 172.21.15.26:0/3602612726 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6fc411e8f0 con 0x7f6fd40c9b80 2023-10-14T11:12:58.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.531+0000 7f6fd96b9640 1 --2- 172.21.15.26:0/3602612726 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6fb80664a0 0x7f6fb8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:58.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.531+0000 7f6fd96b9640 1 --2- 172.21.15.26:0/3602612726 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6fb80664a0 0x7f6fb8068960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6fd000a9b0 tx=0x7f6fd0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:58.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.535+0000 7f6fc9ffb640 1 -- 172.21.15.26:0/3602612726 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6fd40ae2a0 con 0x7f6fd40c9b80 2023-10-14T11:12:58.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.735+0000 7f6fdb91d640 1 -- 172.21.15.26:0/3602612726 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6fd40ae2a0 con 0x7f6fd40c9b80 2023-10-14T11:12:58.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.735+0000 7f6fc9ffb640 1 -- 172.21.15.26:0/3602612726 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f6fd40ae2a0 con 0x7f6fd40c9b80 2023-10-14T11:12:58.739 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:12:58.740 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/2685368784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2685368784},{"type":"v1","addr":"172.21.15.110:6834","nonce":2685368784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6836/4242453713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":4242453713},{"type":"v1","addr":"172.21.15.26:6836","nonce":4242453713}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3507761146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":3507761146},{"type":"v1","addr":"172.21.15.26:6837","nonce":3507761146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:12:22.355867+0000","modified":"2023-10-14T11:12:46.435346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3522025152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3522025152},{"type":"v1","addr":"172.21.15.110:6835","nonce":3522025152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T11:12:58.740 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 9 2023-10-14T11:12:58.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.739+0000 7f6fdb91d640 1 -- 172.21.15.26:0/3602612726 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6fb80664a0 msgr2=0x7f6fb8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:58.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.739+0000 7f6fdb91d640 1 --2- 172.21.15.26:0/3602612726 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6fb80664a0 0x7f6fb8068960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6fd000a9b0 tx=0x7f6fd0008040 comp rx=0 tx=0).stop 2023-10-14T11:12:58.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.739+0000 7f6fdb91d640 1 -- 172.21.15.26:0/3602612726 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fd40c9b80 msgr2=0x7f6fd40aec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:58.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.739+0000 7f6fdb91d640 1 --2- 172.21.15.26:0/3602612726 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fd40c9b80 0x7f6fd40aec40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6fc401abb0 tx=0x7f6fc401ad40 comp rx=0 tx=0).stop 2023-10-14T11:12:58.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.739+0000 7f6fdb91d640 1 -- 172.21.15.26:0/3602612726 shutdown_connections 2023-10-14T11:12:58.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.739+0000 7f6fdb91d640 1 --2- 172.21.15.26:0/3602612726 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd4164520 0x7f6fd4156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.739+0000 7f6fdb91d640 1 --2- 172.21.15.26:0/3602612726 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6fb80664a0 0x7f6fb8068960 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.739+0000 7f6fdb91d640 1 --2- 172.21.15.26:0/3602612726 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fd40c9b80 0x7f6fd40aec40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.739+0000 7f6fdb91d640 1 --2- 172.21.15.26:0/3602612726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd40ad960 0x7f6fd4153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:58.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.739+0000 7f6fdb91d640 1 -- 172.21.15.26:0/3602612726 >> 172.21.15.26:0/3602612726 conn(0x7f6fd406c190 msgr2=0x7f6fd40cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:58.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.739+0000 7f6fdb91d640 1 -- 172.21.15.26:0/3602612726 shutdown_connections 2023-10-14T11:12:58.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:58.739+0000 7f6fdb91d640 1 -- 172.21.15.26:0/3602612726 wait complete. 2023-10-14T11:12:59.163 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T11:12:22.355867+0000', 'modified': '2023-10-14T11:12:46.435346+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.110:6835/3522025152', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6833', 'nonce': 3522025152}, {'type': 'v1', 'addr': '172.21.15.110:6835', 'nonce': 3522025152}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T11:12:59.163 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T11:12:59.164 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-14T11:12:59.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.307+0000 7f5d7639d640 1 Processor -- start 2023-10-14T11:12:59.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.307+0000 7f5d7639d640 1 -- start start 2023-10-14T11:12:59.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.307+0000 7f5d7639d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d7015cb90 0x7f5d700cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.307+0000 7f5d7639d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5d700d3010 0x7f5d700d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.307+0000 7f5d7639d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d700d1400 0x7f5d700cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.307+0000 7f5d7639d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d700d1890 con 0x7f5d7015cb90 2023-10-14T11:12:59.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.307+0000 7f5d7639d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d700ce770 con 0x7f5d700d3010 2023-10-14T11:12:59.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.307+0000 7f5d7639d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d700d0600 con 0x7f5d700d1400 2023-10-14T11:12:59.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.307+0000 7f5d6ffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d7015cb90 0x7f5d700cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.307+0000 7f5d6ffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d7015cb90 0x7f5d700cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37678/0 (socket says 172.21.15.26:37678) 2023-10-14T11:12:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.307+0000 7f5d6ffff640 1 -- 172.21.15.26:0/3034918757 learned_addr learned my addr 172.21.15.26:0/3034918757 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.307+0000 7f5d7493a640 1 --2- 172.21.15.26:0/3034918757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d700d1400 0x7f5d700cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.307+0000 7f5d6f7fe640 1 --2- 172.21.15.26:0/3034918757 >> v2:172.21.15.110:3300/0 conn(0x7f5d700d3010 0x7f5d700d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.307+0000 7f5d6ffff640 1 -- 172.21.15.26:0/3034918757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d700d1400 msgr2=0x7f5d700cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:59.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.307+0000 7f5d6ffff640 1 --2- 172.21.15.26:0/3034918757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d700d1400 0x7f5d700cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.307+0000 7f5d6ffff640 1 -- 172.21.15.26:0/3034918757 >> v2:172.21.15.110:3300/0 conn(0x7f5d700d3010 msgr2=0x7f5d700d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:59.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.307+0000 7f5d6ffff640 1 --2- 172.21.15.26:0/3034918757 >> v2:172.21.15.110:3300/0 conn(0x7f5d700d3010 0x7f5d700d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.307+0000 7f5d6ffff640 1 -- 172.21.15.26:0/3034918757 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d700c6450 con 0x7f5d7015cb90 2023-10-14T11:12:59.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.311+0000 7f5d6ffff640 1 --2- 172.21.15.26:0/3034918757 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d7015cb90 0x7f5d700cfb10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5d7008a880 tx=0x7f5d6001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2a2104b315862d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:59.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.311+0000 7f5d6effd640 1 -- 172.21.15.26:0/3034918757 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d600ab600 con 0x7f5d7015cb90 2023-10-14T11:12:59.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.311+0000 7f5d6effd640 1 -- 172.21.15.26:0/3034918757 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d600ab760 con 0x7f5d7015cb90 2023-10-14T11:12:59.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.311+0000 7f5d6effd640 1 -- 172.21.15.26:0/3034918757 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d600abaf0 con 0x7f5d7015cb90 2023-10-14T11:12:59.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.311+0000 7f5d7639d640 1 -- 172.21.15.26:0/3034918757 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d7015cb90 msgr2=0x7f5d700cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:59.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.311+0000 7f5d7639d640 1 --2- 172.21.15.26:0/3034918757 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d7015cb90 0x7f5d700cfb10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5d7008a880 tx=0x7f5d6001c440 comp rx=0 tx=0).stop 2023-10-14T11:12:59.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.311+0000 7f5d7639d640 1 -- 172.21.15.26:0/3034918757 shutdown_connections 2023-10-14T11:12:59.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.311+0000 7f5d7639d640 1 --2- 172.21.15.26:0/3034918757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d700d1400 0x7f5d700cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.311+0000 7f5d7639d640 1 --2- 172.21.15.26:0/3034918757 >> v2:172.21.15.110:3300/0 conn(0x7f5d700d3010 0x7f5d700d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.311+0000 7f5d7639d640 1 --2- 172.21.15.26:0/3034918757 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d7015cb90 0x7f5d700cfb10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.311+0000 7f5d7639d640 1 -- 172.21.15.26:0/3034918757 >> 172.21.15.26:0/3034918757 conn(0x7f5d7009bc50 msgr2=0x7f5d700d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:59.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.311+0000 7f5d7639d640 1 -- 172.21.15.26:0/3034918757 shutdown_connections 2023-10-14T11:12:59.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.311+0000 7f5d7639d640 1 -- 172.21.15.26:0/3034918757 wait complete. 2023-10-14T11:12:59.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d7639d640 1 Processor -- start 2023-10-14T11:12:59.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d7639d640 1 -- start start 2023-10-14T11:12:59.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d7639d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d700d1400 0x7f5d700b7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d7639d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d700d3010 0x7f5d7014ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d7639d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d7015cb90 0x7f5d7006c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d7639d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d70150520 con 0x7f5d7015cb90 2023-10-14T11:12:59.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d7639d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7014d5d0 con 0x7f5d700d3010 2023-10-14T11:12:59.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d7639d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7014d8b0 con 0x7f5d700d1400 2023-10-14T11:12:59.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d7493a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d7015cb90 0x7f5d7006c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d7493a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d7015cb90 0x7f5d7006c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37690/0 (socket says 172.21.15.26:37690) 2023-10-14T11:12:59.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d7493a640 1 -- 172.21.15.26:0/1899781986 learned_addr learned my addr 172.21.15.26:0/1899781986 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:59.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d6f7fe640 1 --2- 172.21.15.26:0/1899781986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d700d3010 0x7f5d7014ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d6ffff640 1 --2- 172.21.15.26:0/1899781986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d700d1400 0x7f5d700b7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d7493a640 1 -- 172.21.15.26:0/1899781986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d700d1400 msgr2=0x7f5d700b7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:59.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d7493a640 1 --2- 172.21.15.26:0/1899781986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d700d1400 0x7f5d700b7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d7493a640 1 -- 172.21.15.26:0/1899781986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d700d3010 msgr2=0x7f5d7014ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:59.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d7493a640 1 --2- 172.21.15.26:0/1899781986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d700d3010 0x7f5d7014ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d7493a640 1 -- 172.21.15.26:0/1899781986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d60009480 con 0x7f5d7015cb90 2023-10-14T11:12:59.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d7493a640 1 --2- 172.21.15.26:0/1899781986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d7015cb90 0x7f5d7006c470 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5d68007e40 tx=0x7f5d6800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:59.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d6cff9640 1 -- 172.21.15.26:0/1899781986 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68014620 con 0x7f5d7015cb90 2023-10-14T11:12:59.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d6cff9640 1 -- 172.21.15.26:0/1899781986 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6800ee90 con 0x7f5d7015cb90 2023-10-14T11:12:59.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d6cff9640 1 -- 172.21.15.26:0/1899781986 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d680149e0 con 0x7f5d7015cb90 2023-10-14T11:12:59.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d7639d640 1 -- 172.21.15.26:0/1899781986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d7014db90 con 0x7f5d7015cb90 2023-10-14T11:12:59.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.315+0000 7f5d7639d640 1 -- 172.21.15.26:0/1899781986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7014e150 con 0x7f5d7015cb90 2023-10-14T11:12:59.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.319+0000 7f5d6cff9640 1 -- 172.21.15.26:0/1899781986 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5d68014b40 con 0x7f5d7015cb90 2023-10-14T11:12:59.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.319+0000 7f5d6cff9640 1 --2- 172.21.15.26:0/1899781986 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5d5c0664a0 0x7f5d5c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.319+0000 7f5d6cff9640 1 -- 172.21.15.26:0/1899781986 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5d680849f0 con 0x7f5d7015cb90 2023-10-14T11:12:59.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.319+0000 7f5d6ffff640 1 --2- 172.21.15.26:0/1899781986 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5d5c0664a0 0x7f5d5c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.319+0000 7f5d79720000 1 Processor -- start 2023-10-14T11:12:59.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.319+0000 7f5d79720000 1 -- start start 2023-10-14T11:12:59.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.319+0000 7f5d6ffff640 1 --2- 172.21.15.26:0/1899781986 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5d5c0664a0 0x7f5d5c068960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5d600af000 tx=0x7f5d600a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:59.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.319+0000 7f5d79720000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e69df418a0 0x55e69df41c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.319+0000 7f5d79720000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e69df421c0 0x55e69def7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.319+0000 7f5d79720000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69def7c50 0x55e69def8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.319+0000 7f5d79720000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69dceccc0 con 0x55e69def7c50 2023-10-14T11:12:59.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.319+0000 7f5d79720000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69dd4f920 con 0x55e69df418a0 2023-10-14T11:12:59.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.319+0000 7f5d79720000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e69dd4ce50 con 0x55e69df421c0 2023-10-14T11:12:59.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.319+0000 7f5d7493a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69def7c50 0x55e69def8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.319+0000 7f5d7493a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69def7c50 0x55e69def8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37700/0 (socket says 172.21.15.26:37700) 2023-10-14T11:12:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.319+0000 7f5d7493a640 1 -- 172.21.15.26:0/1404090205 learned_addr learned my addr 172.21.15.26:0/1404090205 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.319+0000 7f5d6f7fe640 1 --2- 172.21.15.26:0/1404090205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e69df421c0 0x55e69def7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.319+0000 7f5d6ffff640 1 --2- 172.21.15.26:0/1404090205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e69df418a0 0x55e69df41c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d7493a640 1 -- 172.21.15.26:0/1404090205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e69df421c0 msgr2=0x55e69def7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:59.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d7493a640 1 --2- 172.21.15.26:0/1404090205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e69df421c0 0x55e69def7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d7493a640 1 -- 172.21.15.26:0/1404090205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e69df418a0 msgr2=0x55e69df41c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:59.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d7493a640 1 --2- 172.21.15.26:0/1404090205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e69df418a0 0x55e69df41c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d7493a640 1 -- 172.21.15.26:0/1404090205 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e69da41890 con 0x55e69def7c50 2023-10-14T11:12:59.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d7493a640 1 --2- 172.21.15.26:0/1404090205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69def7c50 0x55e69def8030 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5d680555e0 tx=0x7f5d68055a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f9976fa0a52e63 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:59.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d55ffb640 1 -- 172.21.15.26:0/1404090205 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6806d170 con 0x55e69def7c50 2023-10-14T11:12:59.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d55ffb640 1 -- 172.21.15.26:0/1404090205 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d68053a20 con 0x55e69def7c50 2023-10-14T11:12:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d55ffb640 1 -- 172.21.15.26:0/1404090205 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68051ff0 con 0x55e69def7c50 2023-10-14T11:12:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d79720000 1 -- 172.21.15.26:0/1404090205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69def7c50 msgr2=0x55e69def8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d79720000 1 --2- 172.21.15.26:0/1404090205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69def7c50 0x55e69def8030 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5d680555e0 tx=0x7f5d68055a20 comp rx=0 tx=0).stop 2023-10-14T11:12:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d79720000 1 -- 172.21.15.26:0/1404090205 shutdown_connections 2023-10-14T11:12:59.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d79720000 1 --2- 172.21.15.26:0/1404090205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69def7c50 0x55e69def8030 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d79720000 1 --2- 172.21.15.26:0/1404090205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e69df421c0 0x55e69def7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d79720000 1 --2- 172.21.15.26:0/1404090205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e69df418a0 0x55e69df41c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d79720000 1 -- 172.21.15.26:0/1404090205 >> 172.21.15.26:0/1404090205 conn(0x55e69deeefc0 msgr2=0x55e69def5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:59.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d79720000 1 -- 172.21.15.26:0/1404090205 shutdown_connections 2023-10-14T11:12:59.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d79720000 1 -- 172.21.15.26:0/1404090205 wait complete. 2023-10-14T11:12:59.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d79720000 1 -- start start 2023-10-14T11:12:59.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d79720000 1 Processor -- start 2023-10-14T11:12:59.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d79720000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e69def7c50 0x55e69defcee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d79720000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e69df418a0 0x55e69defd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d79720000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69df421c0 0x55e69df2fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d79720000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69dd48740 con 0x55e69df421c0 2023-10-14T11:12:59.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d79720000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69dd07d10 con 0x55e69def7c50 2023-10-14T11:12:59.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d79720000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e69dd079b0 con 0x55e69df418a0 2023-10-14T11:12:59.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d79720000 10 client.0 _ll_register_callbacks cb 0x55e69dee3390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T11:12:59.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d7493a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69df421c0 0x55e69df2fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d7493a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69df421c0 0x55e69df2fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37714/0 (socket says 172.21.15.26:37714) 2023-10-14T11:12:59.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d7493a640 1 -- 172.21.15.26:0/346691357 learned_addr learned my addr 172.21.15.26:0/346691357 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:59.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d6ffff640 1 --2- 172.21.15.26:0/346691357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e69def7c50 0x55e69defcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d6f7fe640 1 --2- 172.21.15.26:0/346691357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e69df418a0 0x55e69defd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d7493a640 1 -- 172.21.15.26:0/346691357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e69df418a0 msgr2=0x55e69defd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:59.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.323+0000 7f5d7493a640 1 --2- 172.21.15.26:0/346691357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e69df418a0 0x55e69defd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d7493a640 1 -- 172.21.15.26:0/346691357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e69def7c50 msgr2=0x55e69defcee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:59.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d7493a640 1 --2- 172.21.15.26:0/346691357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e69def7c50 0x55e69defcee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d7493a640 1 -- 172.21.15.26:0/346691357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7014e150 con 0x55e69df421c0 2023-10-14T11:12:59.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d7493a640 1 --2- 172.21.15.26:0/346691357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69df421c0 0x55e69df2fd80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5d68059b40 tx=0x7f5d68016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5658e6e4f3db4c5d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d4effd640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-14T11:12:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d4effd640 1 -- 172.21.15.26:0/346691357 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68051ff0 con 0x55e69df421c0 2023-10-14T11:12:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d4effd640 1 -- 172.21.15.26:0/346691357 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5d68082030 con 0x55e69df421c0 2023-10-14T11:12:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d79720000 1 -- 172.21.15.26:0/346691357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e69dcfc370 con 0x55e69df421c0 2023-10-14T11:12:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d4effd640 1 -- 172.21.15.26:0/346691357 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d68052150 con 0x55e69df421c0 2023-10-14T11:12:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d79720000 10 client.4809 fetch_fsmap learned FSMap version 9 2023-10-14T11:12:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d79720000 1 -- 172.21.15.26:0/346691357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55e69dd0a460 con 0x55e69df421c0 2023-10-14T11:12:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d4effd640 1 -- 172.21.15.26:0/346691357 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e69dcfc370 con 0x55e69df421c0 2023-10-14T11:12:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d4effd640 1 -- 172.21.15.26:0/346691357 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f5d68005d20 con 0x55e69df421c0 2023-10-14T11:12:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d79720000 10 client.4809 fetch_fsmap finished waiting for FSMap version 9 2023-10-14T11:12:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d79720000 10 client.4809 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-14T11:12:59.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d79720000 20 client.4809 populate_metadata read hostname 'smithi026' 2023-10-14T11:12:59.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d79720000 1 --2- 172.21.15.26:0/346691357 >> [v2:172.21.15.110:6833/3522025152,v1:172.21.15.110:6835/3522025152] conn(0x55e69df51940 0x55e69df53d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d79720000 4 client.4809 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T11:12:59.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d79720000 1 -- 172.21.15.26:0/346691357 --> [v2:172.21.15.110:6833/3522025152,v1:172.21.15.110:6835/3522025152] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e69dce22d0 con 0x55e69df51940 2023-10-14T11:12:59.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d6ffff640 1 --2- 172.21.15.26:0/346691357 >> [v2:172.21.15.110:6833/3522025152,v1:172.21.15.110:6835/3522025152] conn(0x55e69df51940 0x55e69df53d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d6ffff640 1 --2- 172.21.15.26:0/346691357 >> [v2:172.21.15.110:6833/3522025152,v1:172.21.15.110:6835/3522025152] conn(0x55e69df51940 0x55e69df53d30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be6f8fd322db9e2b server_cookie=c3d7f8c2a0bcc919 in_seq=0 out_seq=0 2023-10-14T11:12:59.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d4effd640 10 client.4809 ms_handle_connect on v2:172.21.15.110:6833/3522025152 2023-10-14T11:12:59.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d4effd640 1 -- 172.21.15.26:0/346691357 <== mds.0 v2:172.21.15.110:6833/3522025152 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e69dce22d0 con 0x55e69df51940 2023-10-14T11:12:59.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d4effd640 10 client.4809 handle_command_reply: tid=0 2023-10-14T11:12:59.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d79720000 1 client.4809 shutdown 2023-10-14T11:12:59.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d79720000 1 -- 172.21.15.26:0/346691357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69df421c0 msgr2=0x55e69df2fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:59.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d79720000 1 --2- 172.21.15.26:0/346691357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69df421c0 0x55e69df2fd80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5d68059b40 tx=0x7f5d68016000 comp rx=0 tx=0).stop 2023-10-14T11:12:59.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d79720000 1 -- 172.21.15.26:0/346691357 shutdown_connections 2023-10-14T11:12:59.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d79720000 1 --2- 172.21.15.26:0/346691357 >> [v2:172.21.15.110:6833/3522025152,v1:172.21.15.110:6835/3522025152] conn(0x55e69df51940 0x55e69df53d30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d79720000 1 --2- 172.21.15.26:0/346691357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69df421c0 0x55e69df2fd80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d79720000 1 --2- 172.21.15.26:0/346691357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e69df418a0 0x55e69defd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d4effd640 0 client.4809 ms_handle_reset on v2:172.21.15.110:6833/3522025152 2023-10-14T11:12:59.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d79720000 1 --2- 172.21.15.26:0/346691357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e69def7c50 0x55e69defcee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d79720000 1 -- 172.21.15.26:0/346691357 >> 172.21.15.26:0/346691357 conn(0x55e69deeefc0 msgr2=0x55e69def66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:59.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d79720000 1 -- 172.21.15.26:0/346691357 shutdown_connections 2023-10-14T11:12:59.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d79720000 1 -- 172.21.15.26:0/346691357 wait complete. 2023-10-14T11:12:59.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.327+0000 7f5d79720000 20 client.4809 trim_cache size 0 max 16384 2023-10-14T11:12:59.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.343+0000 7f5d79720000 1 Processor -- start 2023-10-14T11:12:59.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.343+0000 7f5d79720000 1 -- start start 2023-10-14T11:12:59.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.343+0000 7f5d79720000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e69def7c50 0x55e69df55450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.343+0000 7f5d79720000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69df418a0 0x55e69df55990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.343+0000 7f5d79720000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e69df421c0 0x55e69df2a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.343+0000 7f5d79720000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69da02940 con 0x55e69df418a0 2023-10-14T11:12:59.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.343+0000 7f5d79720000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69da421b0 con 0x55e69def7c50 2023-10-14T11:12:59.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.343+0000 7f5d79720000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e69defc6a0 con 0x55e69df421c0 2023-10-14T11:12:59.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.343+0000 7f5d6f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69df418a0 0x55e69df55990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.343+0000 7f5d6f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69df418a0 0x55e69df55990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37726/0 (socket says 172.21.15.26:37726) 2023-10-14T11:12:59.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.343+0000 7f5d6f7fe640 1 -- 172.21.15.26:0/3763707692 learned_addr learned my addr 172.21.15.26:0/3763707692 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:59.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.343+0000 7f5d6ffff640 1 --2- 172.21.15.26:0/3763707692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e69def7c50 0x55e69df55450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.343+0000 7f5d7493a640 1 --2- 172.21.15.26:0/3763707692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e69df421c0 0x55e69df2a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d6f7fe640 1 -- 172.21.15.26:0/3763707692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e69df421c0 msgr2=0x55e69df2a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:59.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d6f7fe640 1 --2- 172.21.15.26:0/3763707692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e69df421c0 0x55e69df2a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d6f7fe640 1 -- 172.21.15.26:0/3763707692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e69def7c50 msgr2=0x55e69df55450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:59.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d6f7fe640 1 --2- 172.21.15.26:0/3763707692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e69def7c50 0x55e69df55450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d6f7fe640 1 -- 172.21.15.26:0/3763707692 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e69dcf0760 con 0x55e69df418a0 2023-10-14T11:12:59.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d6f7fe640 1 --2- 172.21.15.26:0/3763707692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69df418a0 0x55e69df55990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5d64007a90 tx=0x7f5d64007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318e9886cb45e228 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:59.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d567fc640 1 -- 172.21.15.26:0/3763707692 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d64016d80 con 0x55e69df418a0 2023-10-14T11:12:59.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d567fc640 1 -- 172.21.15.26:0/3763707692 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d64004030 con 0x55e69df418a0 2023-10-14T11:12:59.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d567fc640 1 -- 172.21.15.26:0/3763707692 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d640043a0 con 0x55e69df418a0 2023-10-14T11:12:59.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d79720000 1 -- 172.21.15.26:0/3763707692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69df418a0 msgr2=0x55e69df55990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:59.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d79720000 1 --2- 172.21.15.26:0/3763707692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69df418a0 0x55e69df55990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5d64007a90 tx=0x7f5d64007f50 comp rx=0 tx=0).stop 2023-10-14T11:12:59.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d79720000 1 -- 172.21.15.26:0/3763707692 shutdown_connections 2023-10-14T11:12:59.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d79720000 1 --2- 172.21.15.26:0/3763707692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e69df421c0 0x55e69df2a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d79720000 1 --2- 172.21.15.26:0/3763707692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69df418a0 0x55e69df55990 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d79720000 1 --2- 172.21.15.26:0/3763707692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e69def7c50 0x55e69df55450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d79720000 1 -- 172.21.15.26:0/3763707692 >> 172.21.15.26:0/3763707692 conn(0x55e69deeefc0 msgr2=0x55e69df53d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:59.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d79720000 1 -- 172.21.15.26:0/3763707692 shutdown_connections 2023-10-14T11:12:59.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d79720000 1 -- 172.21.15.26:0/3763707692 wait complete. 2023-10-14T11:12:59.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d79720000 1 -- start start 2023-10-14T11:12:59.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d79720000 1 Processor -- start 2023-10-14T11:12:59.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d79720000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e69def7c50 0x55e69df2e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d79720000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69df418a0 0x55e69df5d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d79720000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e69df421c0 0x55e69df5d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d79720000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69dd45b40 con 0x55e69df418a0 2023-10-14T11:12:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d79720000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69df2f9f0 con 0x55e69df421c0 2023-10-14T11:12:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d79720000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e69dd42a40 con 0x55e69def7c50 2023-10-14T11:12:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d79720000 10 client.0 _ll_register_callbacks cb 0x7f5d68051ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T11:12:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d6f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69df418a0 0x55e69df5d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d6ffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e69def7c50 0x55e69df2e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d6f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69df418a0 0x55e69df5d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37730/0 (socket says 172.21.15.26:37730) 2023-10-14T11:12:59.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d6f7fe640 1 -- 172.21.15.26:0/2612934215 learned_addr learned my addr 172.21.15.26:0/2612934215 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:59.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.347+0000 7f5d7493a640 1 --2- 172.21.15.26:0/2612934215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e69df421c0 0x55e69df5d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d6ffff640 1 -- 172.21.15.26:0/2612934215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e69df421c0 msgr2=0x55e69df5d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d6ffff640 1 --2- 172.21.15.26:0/2612934215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e69df421c0 0x55e69df5d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d6ffff640 1 -- 172.21.15.26:0/2612934215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69df418a0 msgr2=0x55e69df5d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d6ffff640 1 --2- 172.21.15.26:0/2612934215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69df418a0 0x55e69df5d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d6ffff640 1 -- 172.21.15.26:0/2612934215 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6400e040 con 0x55e69def7c50 2023-10-14T11:12:59.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d6f7fe640 1 --2- 172.21.15.26:0/2612934215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69df418a0 0x55e69df5d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:12:59.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d6ffff640 1 --2- 172.21.15.26:0/2612934215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e69def7c50 0x55e69df2e050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5d600ac000 tx=0x7f5d6001ac80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c28678a18a9cdb35 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:59.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d4effd640 10 client.0 ms_handle_connect on v2:172.21.15.110:3301/0 2023-10-14T11:12:59.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d4effd640 1 -- 172.21.15.26:0/2612934215 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d600ca4d0 con 0x55e69def7c50 2023-10-14T11:12:59.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d4effd640 1 -- 172.21.15.26:0/2612934215 <== mon.2 v2:172.21.15.110:3301/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5d600cab70 con 0x55e69def7c50 2023-10-14T11:12:59.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d79720000 1 -- 172.21.15.26:0/2612934215 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e69defa3b0 con 0x55e69def7c50 2023-10-14T11:12:59.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d4effd640 1 -- 172.21.15.26:0/2612934215 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d600cad30 con 0x55e69def7c50 2023-10-14T11:12:59.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d79720000 10 client.4601 fetch_fsmap learned FSMap version 9 2023-10-14T11:12:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d79720000 1 -- 172.21.15.26:0/2612934215 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55e69da41cc0 con 0x55e69def7c50 2023-10-14T11:12:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d4effd640 1 -- 172.21.15.26:0/2612934215 <== mon.2 v2:172.21.15.110:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e69defa3b0 con 0x55e69def7c50 2023-10-14T11:12:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d4effd640 1 -- 172.21.15.26:0/2612934215 <== mon.2 v2:172.21.15.110:3301/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f5d60003620 con 0x55e69def7c50 2023-10-14T11:12:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d79720000 10 client.4601 fetch_fsmap finished waiting for FSMap version 9 2023-10-14T11:12:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d79720000 10 client.4601 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-14T11:12:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d79720000 20 client.4601 populate_metadata read hostname 'smithi026' 2023-10-14T11:12:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d79720000 1 --2- 172.21.15.26:0/2612934215 >> [v2:172.21.15.110:6833/3522025152,v1:172.21.15.110:6835/3522025152] conn(0x55e69dfa6550 0x55e69dfa8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d79720000 4 client.4601 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T11:12:59.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d79720000 1 -- 172.21.15.26:0/2612934215 --> [v2:172.21.15.110:6833/3522025152,v1:172.21.15.110:6835/3522025152] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e69dce06f0 con 0x55e69dfa6550 2023-10-14T11:12:59.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d6f7fe640 1 --2- 172.21.15.26:0/2612934215 >> [v2:172.21.15.110:6833/3522025152,v1:172.21.15.110:6835/3522025152] conn(0x55e69dfa6550 0x55e69dfa8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d6f7fe640 1 --2- 172.21.15.26:0/2612934215 >> [v2:172.21.15.110:6833/3522025152,v1:172.21.15.110:6835/3522025152] conn(0x55e69dfa6550 0x55e69dfa8940 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72249a6339974897 server_cookie=57cf6ceb86b35f3e in_seq=0 out_seq=0 2023-10-14T11:12:59.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d4effd640 10 client.4601 ms_handle_connect on v2:172.21.15.110:6833/3522025152 2023-10-14T11:12:59.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d4effd640 1 -- 172.21.15.26:0/2612934215 <== mds.0 v2:172.21.15.110:6833/3522025152 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55e69dce06f0 con 0x55e69dfa6550 2023-10-14T11:12:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d4effd640 10 client.4601 handle_command_reply: tid=0 2023-10-14T11:12:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d79720000 1 client.4601 shutdown 2023-10-14T11:12:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d79720000 1 -- 172.21.15.26:0/2612934215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e69def7c50 msgr2=0x55e69df2e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d79720000 1 --2- 172.21.15.26:0/2612934215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e69def7c50 0x55e69df2e050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5d600ac000 tx=0x7f5d6001ac80 comp rx=0 tx=0).stop 2023-10-14T11:12:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d79720000 1 -- 172.21.15.26:0/2612934215 shutdown_connections 2023-10-14T11:12:59.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d79720000 1 --2- 172.21.15.26:0/2612934215 >> [v2:172.21.15.110:6833/3522025152,v1:172.21.15.110:6835/3522025152] conn(0x55e69dfa6550 0x55e69dfa8940 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d79720000 1 --2- 172.21.15.26:0/2612934215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e69df421c0 0x55e69df5d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d79720000 1 --2- 172.21.15.26:0/2612934215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e69df418a0 0x55e69df5d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d79720000 1 --2- 172.21.15.26:0/2612934215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e69def7c50 0x55e69df2e050 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d79720000 1 -- 172.21.15.26:0/2612934215 >> 172.21.15.26:0/2612934215 conn(0x55e69deeefc0 msgr2=0x55e69df53d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:59.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d4effd640 0 client.4601 ms_handle_reset on v2:172.21.15.110:6833/3522025152 2023-10-14T11:12:59.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d79720000 1 -- 172.21.15.26:0/2612934215 shutdown_connections 2023-10-14T11:12:59.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d79720000 1 -- 172.21.15.26:0/2612934215 wait complete. 2023-10-14T11:12:59.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.351+0000 7f5d79720000 20 client.4601 trim_cache size 0 max 16384 2023-10-14T11:12:59.384 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:12:59.384 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "9730719c-9713-4147-aaa1-ca8aabbbe5ad", 2023-10-14T11:12:59.384 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-10-14T11:12:59.384 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4282, 2023-10-14T11:12:59.384 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-10-14T11:12:59.385 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-10-14T11:12:59.385 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-10-14T11:12:59.385 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 36.393288914999999, 2023-10-14T11:12:59.385 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 9, 2023-10-14T11:12:59.385 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 25, 2023-10-14T11:12:59.386 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 25, 2023-10-14T11:12:59.386 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 43.952821640000003 2023-10-14T11:12:59.386 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:12:59.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.355+0000 7f5d7639d640 1 -- 172.21.15.26:0/1899781986 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5d5c0664a0 msgr2=0x7f5d5c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:59.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.355+0000 7f5d7639d640 1 --2- 172.21.15.26:0/1899781986 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5d5c0664a0 0x7f5d5c068960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5d600af000 tx=0x7f5d600a7000 comp rx=0 tx=0).stop 2023-10-14T11:12:59.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.355+0000 7f5d7639d640 1 -- 172.21.15.26:0/1899781986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d7015cb90 msgr2=0x7f5d7006c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:59.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.355+0000 7f5d7639d640 1 --2- 172.21.15.26:0/1899781986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d7015cb90 0x7f5d7006c470 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5d68007e40 tx=0x7f5d6800e4b0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.355+0000 7f5d7639d640 1 -- 172.21.15.26:0/1899781986 shutdown_connections 2023-10-14T11:12:59.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.355+0000 7f5d7639d640 1 --2- 172.21.15.26:0/1899781986 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5d5c0664a0 0x7f5d5c068960 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.355+0000 7f5d7639d640 1 --2- 172.21.15.26:0/1899781986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d7015cb90 0x7f5d7006c470 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.355+0000 7f5d7639d640 1 --2- 172.21.15.26:0/1899781986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d700d3010 0x7f5d7014ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.355+0000 7f5d7639d640 1 --2- 172.21.15.26:0/1899781986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d700d1400 0x7f5d700b7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.355+0000 7f5d7639d640 1 -- 172.21.15.26:0/1899781986 >> 172.21.15.26:0/1899781986 conn(0x7f5d7009bc50 msgr2=0x7f5d70158820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:59.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.355+0000 7f5d7639d640 1 -- 172.21.15.26:0/1899781986 shutdown_connections 2023-10-14T11:12:59.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.355+0000 7f5d7639d640 1 -- 172.21.15.26:0/1899781986 wait complete. 2023-10-14T11:12:59.391 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-14T11:12:59.404 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-14T11:12:59.404 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-14T11:12:59.405 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-14T11:12:59.405 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T11:12:59.405 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T11:12:59.406 INFO:tasks.ceph_fuse:client.2 config is {} 2023-10-14T11:12:59.406 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T11:12:59.406 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-14T11:12:59.406 INFO:tasks.ceph_fuse:client.1 config is {} 2023-10-14T11:12:59.407 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T11:12:59.407 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T11:12:59.407 INFO:tasks.ceph_fuse:client.3 config is {} 2023-10-14T11:12:59.407 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T11:12:59.408 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-14T11:12:59.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:59.408 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-14T11:12:59.419 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-14T11:12:59.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:59.420 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-14T11:12:59.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:59.484 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2023-10-14T11:12:59.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:59.712 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2023-10-14T11:12:59.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:12:59.723 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2023-10-14T11:12:59.791 INFO:teuthology.orchestra.run.smithi110.stderr:Cannot find device "ceph-brx" 2023-10-14T11:12:59.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:12:59.795 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-14T11:12:59.795 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T11:12:59.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.935+0000 7fe61ac91640 1 Processor -- start 2023-10-14T11:12:59.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.935+0000 7fe61ac91640 1 -- start start 2023-10-14T11:12:59.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.935+0000 7fe61ac91640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe61415cb90 0x7fe6140cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.935+0000 7fe61ac91640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe6140d3010 0x7fe6140d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.935+0000 7fe61ac91640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6140ce770 con 0x7fe6140d1400 2023-10-14T11:12:59.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.935+0000 7fe61ac91640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6140d1890 con 0x7fe6140d3010 2023-10-14T11:12:59.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.935+0000 7fe61ac91640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6140d0600 con 0x7fe61415cb90 2023-10-14T11:12:59.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.935+0000 7fe618a2d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe61415cb90 0x7fe6140cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.935+0000 7fe613fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe6140d3010 0x7fe6140d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.935+0000 7fe613fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe6140d3010 0x7fe6140d0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:46122/0 (socket says 172.21.15.26:46122) 2023-10-14T11:12:59.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.935+0000 7fe613fff640 1 -- 172.21.15.26:0/1325043471 learned_addr learned my addr 172.21.15.26:0/1325043471 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:59.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.935+0000 7fe618a2d640 1 --2- 172.21.15.26:0/1325043471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe61415cb90 0x7fe6140cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:58226/0 (socket says 172.21.15.26:58226) 2023-10-14T11:12:59.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.935+0000 7fe61922e640 1 --1- 172.21.15.26:0/1325043471 >> v1:172.21.15.110:6789/0 conn(0x7fe6140d1400 0x7fe6140cd3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:43456/0 (socket says 172.21.15.26:43456) 2023-10-14T11:12:59.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.935+0000 7fe613fff640 1 -- 172.21.15.26:0/1325043471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe61415cb90 msgr2=0x7fe6140cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:12:59.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.935+0000 7fe613fff640 1 --2- 172.21.15.26:0/1325043471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe61415cb90 0x7fe6140cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.935+0000 7fe613fff640 1 -- 172.21.15.26:0/1325043471 >> v1:172.21.15.110:6789/0 conn(0x7fe6140d1400 legacy=0x7fe6140cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:59.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.935+0000 7fe613fff640 1 -- 172.21.15.26:0/1325043471 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6140c6450 con 0x7fe6140d3010 2023-10-14T11:12:59.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.935+0000 7fe618a2d640 1 --2- 172.21.15.26:0/1325043471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe61415cb90 0x7fe6140cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:12:59.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.939+0000 7fe613fff640 1 --2- 172.21.15.26:0/1325043471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6140d3010 0x7fe6140d0ec0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe600009870 tx=0x7fe60001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd297dcf8964bb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:59.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.939+0000 7fe6137fe640 1 -- 172.21.15.26:0/1325043471 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6000ab680 con 0x7fe6140d3010 2023-10-14T11:12:59.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.939+0000 7fe6137fe640 1 -- 172.21.15.26:0/1325043471 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6000ab7e0 con 0x7fe6140d3010 2023-10-14T11:12:59.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.939+0000 7fe6137fe640 1 -- 172.21.15.26:0/1325043471 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6000abb70 con 0x7fe6140d3010 2023-10-14T11:12:59.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.939+0000 7fe61ac91640 1 -- 172.21.15.26:0/1325043471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6140d3010 msgr2=0x7fe6140d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:59.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.939+0000 7fe61ac91640 1 --2- 172.21.15.26:0/1325043471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6140d3010 0x7fe6140d0ec0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe600009870 tx=0x7fe60001c480 comp rx=0 tx=0).stop 2023-10-14T11:12:59.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.939+0000 7fe61ac91640 1 -- 172.21.15.26:0/1325043471 shutdown_connections 2023-10-14T11:12:59.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.939+0000 7fe61ac91640 1 --2- 172.21.15.26:0/1325043471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6140d3010 0x7fe6140d0ec0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.939+0000 7fe61ac91640 1 --2- 172.21.15.26:0/1325043471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe61415cb90 0x7fe6140cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.939+0000 7fe61ac91640 1 -- 172.21.15.26:0/1325043471 >> 172.21.15.26:0/1325043471 conn(0x7fe61409bc50 msgr2=0x7fe6140d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:12:59.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.939+0000 7fe61ac91640 1 -- 172.21.15.26:0/1325043471 shutdown_connections 2023-10-14T11:12:59.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.939+0000 7fe61ac91640 1 -- 172.21.15.26:0/1325043471 wait complete. 2023-10-14T11:12:59.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe61ac91640 1 Processor -- start 2023-10-14T11:12:59.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe61ac91640 1 -- start start 2023-10-14T11:12:59.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe61ac91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6140d1400 0x7fe614159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe61ac91640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6140d3010 0x7fe61415a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe61ac91640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe61415cb90 0x7fe61415a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe61ac91640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe614157fc0 con 0x7fe61415cb90 2023-10-14T11:12:59.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe61ac91640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe614155880 con 0x7fe6140d1400 2023-10-14T11:12:59.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe61ac91640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe614156090 con 0x7fe6140d3010 2023-10-14T11:12:59.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe61922e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe61415cb90 0x7fe61415a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe61922e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe61415cb90 0x7fe61415a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37734/0 (socket says 172.21.15.26:37734) 2023-10-14T11:12:59.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe61922e640 1 -- 172.21.15.26:0/582670187 learned_addr learned my addr 172.21.15.26:0/582670187 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:12:59.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe618a2d640 1 --2- 172.21.15.26:0/582670187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6140d1400 0x7fe614159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe613fff640 1 --2- 172.21.15.26:0/582670187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6140d3010 0x7fe61415a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe61922e640 1 -- 172.21.15.26:0/582670187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6140d3010 msgr2=0x7fe61415a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:59.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe61922e640 1 --2- 172.21.15.26:0/582670187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6140d3010 0x7fe61415a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe61922e640 1 -- 172.21.15.26:0/582670187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6140d1400 msgr2=0x7fe614159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:12:59.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe61922e640 1 --2- 172.21.15.26:0/582670187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6140d1400 0x7fe614159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:12:59.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe61922e640 1 -- 172.21.15.26:0/582670187 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6080093b0 con 0x7fe61415cb90 2023-10-14T11:12:59.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe61922e640 1 --2- 172.21.15.26:0/582670187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe61415cb90 0x7fe61415a9b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe60c00c700 tx=0x7fe60c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:59.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe6117fa640 1 -- 172.21.15.26:0/582670187 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c00ce10 con 0x7fe61415cb90 2023-10-14T11:12:59.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe6117fa640 1 -- 172.21.15.26:0/582670187 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c00a640 con 0x7fe61415cb90 2023-10-14T11:12:59.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe6117fa640 1 -- 172.21.15.26:0/582670187 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c00a9b0 con 0x7fe61415cb90 2023-10-14T11:12:59.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe61ac91640 1 -- 172.21.15.26:0/582670187 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6000094d0 con 0x7fe61415cb90 2023-10-14T11:12:59.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.943+0000 7fe61ac91640 1 -- 172.21.15.26:0/582670187 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe614155db0 con 0x7fe61415cb90 2023-10-14T11:12:59.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.947+0000 7fe61ac91640 1 -- 172.21.15.26:0/582670187 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe614074010 con 0x7fe61415cb90 2023-10-14T11:12:59.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.947+0000 7fe6117fa640 1 -- 172.21.15.26:0/582670187 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe60c00ab10 con 0x7fe61415cb90 2023-10-14T11:12:59.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.947+0000 7fe6117fa640 1 --2- 172.21.15.26:0/582670187 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe5f80664a0 0x7fe5f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:12:59.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.947+0000 7fe6117fa640 1 -- 172.21.15.26:0/582670187 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe60c0838a0 con 0x7fe61415cb90 2023-10-14T11:12:59.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.947+0000 7fe618a2d640 1 --2- 172.21.15.26:0/582670187 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe5f80664a0 0x7fe5f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:12:59.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.947+0000 7fe618a2d640 1 --2- 172.21.15.26:0/582670187 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe5f80664a0 0x7fe5f8068960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe608009cd0 tx=0x7fe608006f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:12:59.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:12:59.951+0000 7fe6117fa640 1 -- 172.21.15.26:0/582670187 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe60c050ac0 con 0x7fe61415cb90 2023-10-14T11:13:00.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:00.147+0000 7fe61ac91640 1 -- 172.21.15.26:0/582670187 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe6140c66c0 con 0x7fe61415cb90 2023-10-14T11:13:00.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:00.147+0000 7fe6117fa640 1 -- 172.21.15.26:0/582670187 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe60c017070 con 0x7fe61415cb90 2023-10-14T11:13:00.150 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-14T11:13:00.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:00.147+0000 7fe61ac91640 1 -- 172.21.15.26:0/582670187 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe5f80664a0 msgr2=0x7fe5f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:00.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:00.147+0000 7fe61ac91640 1 --2- 172.21.15.26:0/582670187 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe5f80664a0 0x7fe5f8068960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe608009cd0 tx=0x7fe608006f90 comp rx=0 tx=0).stop 2023-10-14T11:13:00.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:00.147+0000 7fe61ac91640 1 -- 172.21.15.26:0/582670187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe61415cb90 msgr2=0x7fe61415a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:00.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:00.147+0000 7fe61ac91640 1 --2- 172.21.15.26:0/582670187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe61415cb90 0x7fe61415a9b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe60c00c700 tx=0x7fe60c00cbc0 comp rx=0 tx=0).stop 2023-10-14T11:13:00.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:00.147+0000 7fe61ac91640 1 -- 172.21.15.26:0/582670187 shutdown_connections 2023-10-14T11:13:00.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:00.147+0000 7fe61ac91640 1 --2- 172.21.15.26:0/582670187 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe5f80664a0 0x7fe5f8068960 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:00.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:00.147+0000 7fe61ac91640 1 --2- 172.21.15.26:0/582670187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe61415cb90 0x7fe61415a9b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:00.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:00.147+0000 7fe61ac91640 1 --2- 172.21.15.26:0/582670187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6140d3010 0x7fe61415a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:00.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:00.147+0000 7fe61ac91640 1 --2- 172.21.15.26:0/582670187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6140d1400 0x7fe614159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:00.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:00.147+0000 7fe61ac91640 1 -- 172.21.15.26:0/582670187 >> 172.21.15.26:0/582670187 conn(0x7fe61409bc50 msgr2=0x7fe614072820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:00.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:00.147+0000 7fe61ac91640 1 -- 172.21.15.26:0/582670187 shutdown_connections 2023-10-14T11:13:00.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:00.147+0000 7fe61ac91640 1 -- 172.21.15.26:0/582670187 wait complete. 2023-10-14T11:13:00.172 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T11:13:00.172 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T11:13:00.172 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-14T11:13:00.173 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T11:13:00.173 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T11:13:00.173 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T11:13:00.173 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T11:13:00.174 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T11:13:00.174 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:13:00.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:00.175 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-14T11:13:00.184 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:13:00.184 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:13:00.186 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:13:00.186 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:00.186 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-14T11:13:00.186 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:00.187 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:13:00.187 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:00.187 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-14T11:13:00.187 INFO:teuthology.orchestra.run.smithi026.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T11:13:00.188 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:00.188 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-14T11:13:00.188 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-14T11:13:00.188 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42397sec preferred_lft 42397sec 2023-10-14T11:13:00.189 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-14T11:13:00.189 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:00.189 INFO:teuthology.orchestra.run.smithi026.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:13:00.189 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:00.189 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-14T11:13:00.190 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:13:00.190 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:00.190 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-14T11:13:00.190 INFO:teuthology.orchestra.run.smithi026.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-14T11:13:00.191 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 02:42:e1:29:12:f0 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:00.191 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-14T11:13:00.191 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:00.192 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T11:13:00.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:00.193 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-14T11:13:00.194 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-14T11:13:00.194 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add name ceph-brx type bridge 2023-10-14T11:13:00.194 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr flush dev ceph-brx 2023-10-14T11:13:00.195 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set ceph-brx up 2023-10-14T11:13:00.195 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T11:13:00.195 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-14T11:13:00.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:00.308 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T11:13:00.328 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-14T11:13:00.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:00.331 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-14T11:13:00.387 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-14T11:13:00.387 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T11:13:00.388 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-14T11:13:00.388 INFO:teuthology.orchestra.run.smithi026.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-14T11:13:00.388 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-14T11:13:00.388 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T11:13:00.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:00.389 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-14T11:13:00.389 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-14T11:13:00.390 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T11:13:00.390 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T11:13:00.390 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T11:13:00.391 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-14T11:13:00.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:00.486 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-14T11:13:00.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:00.496 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list-id 2023-10-14T11:13:00.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:00.547 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-14T11:13:00.547 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-14T11:13:00.547 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:13:00.548 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-14T11:13:00.548 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-14T11:13:00.629 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-14T11:13:00.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:00.630 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-14T11:13:00.630 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-14T11:13:00.630 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-14T11:13:00.630 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T11:13:00.631 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-14T11:13:00.631 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-14T11:13:00.631 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-14T11:13:00.632 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-14T11:13:00.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:00.772 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-14T11:13:00.772 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-14T11:13:00.772 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-10-14T11:13:00.773 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T11:13:00.773 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-14T11:13:00.815 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-14T11:13:00.815 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:13:00.815 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T11:13:00.866 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:13:00.866 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:13:00.867 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T11:13:00.921 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-10-14T11:13:00.990 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:13:01.048 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2023-10-14T11:13:01.049 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2023-10-14T11:13:01.049 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2023-10-14T11:13:01.049 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2023-10-14T11:13:01.049 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2023-10-14T11:13:01.049 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2023-10-14T11:13:01.050 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2023-10-14T11:13:01.050 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2023-10-14T11:13:01.050 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2023-10-14T11:13:01.051 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2023-10-14T11:13:01.051 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2023-10-14T11:13:01.051 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2023-10-14T11:13:01.051 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:13:01.052 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2023-10-14T11:13:01.052 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2023-10-14T11:13:01.052 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2023-10-14T11:13:01.052 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2023-10-14T11:13:01.052 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2023-10-14T11:13:01.053 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2023-10-14T11:13:01.053 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2023-10-14T11:13:01.053 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:13:01.054 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2023-10-14T11:13:01.054 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2023-10-14T11:13:01.054 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2023-10-14T11:13:01.054 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T11:13:01.055 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T11:13:01.055 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T11:13:01.055 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T11:13:01.055 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2023-10-14T11:13:01.055 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:13:01.055 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:13:01.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:01.056 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-10-14T11:13:01.102 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-14T11:13:01.103 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-14T11:13:01.153 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-10-14T11:13:01.177 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:13:01.238 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2023-10-14T11:13:01.238 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2023-10-14T11:13:01.238 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2023-10-14T11:13:01.238 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2023-10-14T11:13:01.239 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2023-10-14T11:13:01.239 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2023-10-14T11:13:01.239 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2023-10-14T11:13:01.239 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2023-10-14T11:13:01.240 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2023-10-14T11:13:01.240 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2023-10-14T11:13:01.240 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2023-10-14T11:13:01.240 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2023-10-14T11:13:01.241 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:13:01.241 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2023-10-14T11:13:01.241 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2023-10-14T11:13:01.241 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2023-10-14T11:13:01.242 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2023-10-14T11:13:01.242 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2023-10-14T11:13:01.242 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2023-10-14T11:13:01.242 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2023-10-14T11:13:01.242 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:13:01.243 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2023-10-14T11:13:01.243 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2023-10-14T11:13:01.243 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2023-10-14T11:13:01.243 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T11:13:01.244 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T11:13:01.244 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T11:13:01.244 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T11:13:01.244 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2023-10-14T11:13:01.244 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:13:01.245 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:13:01.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:01.246 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-10-14T11:13:01.254 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:2023-10-14T11:13:01.251+0000 7fb39c266580 -1 init, newargv = 0x55d05f55d8f0 newargc=15 2023-10-14T11:13:01.254 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[44840]: starting ceph client 2023-10-14T11:13:01.266 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[44840]: starting fuse 2023-10-14T11:13:01.269 INFO:teuthology.orchestra.run.smithi026.stdout:43 2023-10-14T11:13:01.270 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-10-14T11:13:01.270 DEBUG:teuthology.orchestra.run.smithi026:> sudo stdin-killer -- python3 -c ' 2023-10-14T11:13:01.271 DEBUG:teuthology.orchestra.run.smithi026:> import glob 2023-10-14T11:13:01.271 DEBUG:teuthology.orchestra.run.smithi026:> import re 2023-10-14T11:13:01.271 DEBUG:teuthology.orchestra.run.smithi026:> import os 2023-10-14T11:13:01.272 DEBUG:teuthology.orchestra.run.smithi026:> import subprocess 2023-10-14T11:13:01.272 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:13:01.272 DEBUG:teuthology.orchestra.run.smithi026:> def _find_admin_socket(client_name): 2023-10-14T11:13:01.273 DEBUG:teuthology.orchestra.run.smithi026:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-14T11:13:01.273 DEBUG:teuthology.orchestra.run.smithi026:> files = glob.glob(asok_path) 2023-10-14T11:13:01.273 DEBUG:teuthology.orchestra.run.smithi026:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-14T11:13:01.274 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:13:01.274 DEBUG:teuthology.orchestra.run.smithi026:> # Given a non-glob path, it better be there 2023-10-14T11:13:01.274 DEBUG:teuthology.orchestra.run.smithi026:> if "*" not in asok_path: 2023-10-14T11:13:01.275 DEBUG:teuthology.orchestra.run.smithi026:> assert(len(files) == 1) 2023-10-14T11:13:01.275 DEBUG:teuthology.orchestra.run.smithi026:> return files[0] 2023-10-14T11:13:01.275 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:13:01.276 DEBUG:teuthology.orchestra.run.smithi026:> for f in files: 2023-10-14T11:13:01.276 DEBUG:teuthology.orchestra.run.smithi026:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-14T11:13:01.276 DEBUG:teuthology.orchestra.run.smithi026:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-14T11:13:01.277 DEBUG:teuthology.orchestra.run.smithi026:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-14T11:13:01.277 DEBUG:teuthology.orchestra.run.smithi026:> contents = proc_f.read() 2023-10-14T11:13:01.278 DEBUG:teuthology.orchestra.run.smithi026:> if mountpoint in contents: 2023-10-14T11:13:01.278 DEBUG:teuthology.orchestra.run.smithi026:> return f 2023-10-14T11:13:01.279 DEBUG:teuthology.orchestra.run.smithi026:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-14T11:13:01.279 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:13:01.279 DEBUG:teuthology.orchestra.run.smithi026:> print(_find_admin_socket("client.0")) 2023-10-14T11:13:01.279 DEBUG:teuthology.orchestra.run.smithi026:> ' 2023-10-14T11:13:01.402 INFO:teuthology.orchestra.run.smithi026.stdout:/var/run/ceph/ceph-client.0.44840.asok 2023-10-14T11:13:01.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-14T11:13:01.413 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44840.asok 2023-10-14T11:13:01.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:01.414 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44840.asok status 2023-10-14T11:13:01.590 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:13:01.590 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": { 2023-10-14T11:13:01.591 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-14T11:13:01.591 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T11:13:01.591 INFO:teuthology.orchestra.run.smithi026.stdout: "entity_id": "0", 2023-10-14T11:13:01.591 INFO:teuthology.orchestra.run.smithi026.stdout: "hostname": "smithi026", 2023-10-14T11:13:01.591 INFO:teuthology.orchestra.run.smithi026.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-14T11:13:01.592 INFO:teuthology.orchestra.run.smithi026.stdout: "pid": "44840", 2023-10-14T11:13:01.592 INFO:teuthology.orchestra.run.smithi026.stdout: "root": "/" 2023-10-14T11:13:01.592 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:01.592 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_count": 0, 2023-10-14T11:13:01.592 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_pinned_count": 0, 2023-10-14T11:13:01.592 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4824, 2023-10-14T11:13:01.593 INFO:teuthology.orchestra.run.smithi026.stdout: "inst": { 2023-10-14T11:13:01.593 INFO:teuthology.orchestra.run.smithi026.stdout: "name": { 2023-10-14T11:13:01.593 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "client", 2023-10-14T11:13:01.593 INFO:teuthology.orchestra.run.smithi026.stdout: "num": 4824 2023-10-14T11:13:01.593 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:01.594 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-10-14T11:13:01.594 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-14T11:13:01.594 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2023-10-14T11:13:01.594 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 2736637073 2023-10-14T11:13:01.594 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:01.594 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:01.595 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-10-14T11:13:01.595 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-14T11:13:01.595 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2023-10-14T11:13:01.595 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 2736637073 2023-10-14T11:13:01.595 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:01.596 INFO:teuthology.orchestra.run.smithi026.stdout: "inst_str": "client.4824 192.168.0.1:0/2736637073", 2023-10-14T11:13:01.596 INFO:teuthology.orchestra.run.smithi026.stdout: "addr_str": "192.168.0.1:0/2736637073", 2023-10-14T11:13:01.596 INFO:teuthology.orchestra.run.smithi026.stdout: "inode_count": 1, 2023-10-14T11:13:01.596 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_epoch": 9, 2023-10-14T11:13:01.596 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch": 25, 2023-10-14T11:13:01.597 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch_barrier": 0, 2023-10-14T11:13:01.597 INFO:teuthology.orchestra.run.smithi026.stdout: "blocklisted": false, 2023-10-14T11:13:01.597 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs" 2023-10-14T11:13:01.597 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:13:01.605 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T11:13:01.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.743+0000 7f95d0846640 1 Processor -- start 2023-10-14T11:13:01.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.743+0000 7f95d0846640 1 -- start start 2023-10-14T11:13:01.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.743+0000 7f95d0846640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f95cc070c40 0x7f95cc15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:01.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.743+0000 7f95d0846640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f95cc0b07f0 0x7f95cc164490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:01.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.743+0000 7f95d0846640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95cc15be60 con 0x7f95cc0b4020 2023-10-14T11:13:01.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.743+0000 7f95d0846640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95cc15b3b0 con 0x7f95cc070c40 2023-10-14T11:13:01.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.743+0000 7f95d0846640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95cc15c1f0 con 0x7f95cc0b07f0 2023-10-14T11:13:01.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.747+0000 7f95ca59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f95cc070c40 0x7f95cc15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:01.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.747+0000 7f95ca59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f95cc070c40 0x7f95cc15ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37746/0 (socket says 172.21.15.26:37746) 2023-10-14T11:13:01.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.747+0000 7f95ca59c640 1 -- 172.21.15.26:0/560801508 learned_addr learned my addr 172.21.15.26:0/560801508 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:01.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.747+0000 7f95cad9d640 1 --2- 172.21.15.26:0/560801508 >> v2:172.21.15.110:3300/0 conn(0x7f95cc0b07f0 0x7f95cc164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:01.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.747+0000 7f95ca59c640 1 -- 172.21.15.26:0/560801508 >> v2:172.21.15.110:3300/0 conn(0x7f95cc0b07f0 msgr2=0x7f95cc164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:01.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.747+0000 7f95ca59c640 1 --2- 172.21.15.26:0/560801508 >> v2:172.21.15.110:3300/0 conn(0x7f95cc0b07f0 0x7f95cc164490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:01.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.747+0000 7f95ca59c640 1 -- 172.21.15.26:0/560801508 >> v1:172.21.15.110:6789/0 conn(0x7f95cc0b4020 legacy=0x7f95cc0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:01.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.747+0000 7f95ca59c640 1 -- 172.21.15.26:0/560801508 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc071020 con 0x7f95cc070c40 2023-10-14T11:13:01.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.747+0000 7f95cad9d640 1 --2- 172.21.15.26:0/560801508 >> v2:172.21.15.110:3300/0 conn(0x7f95cc0b07f0 0x7f95cc164490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:01.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.747+0000 7f95ca59c640 1 --2- 172.21.15.26:0/560801508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc070c40 0x7f95cc15ae70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f95cc06e590 tx=0x7f95bc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e74a8fe803375f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:01.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.751+0000 7f95c9d9b640 1 -- 172.21.15.26:0/560801508 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc0a7070 con 0x7f95cc070c40 2023-10-14T11:13:01.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.751+0000 7f95c9d9b640 1 -- 172.21.15.26:0/560801508 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc0ab430 con 0x7f95cc070c40 2023-10-14T11:13:01.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.751+0000 7f95c9d9b640 1 -- 172.21.15.26:0/560801508 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc0ab7c0 con 0x7f95cc070c40 2023-10-14T11:13:01.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.751+0000 7f95d0846640 1 -- 172.21.15.26:0/560801508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc070c40 msgr2=0x7f95cc15ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:01.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.751+0000 7f95d0846640 1 --2- 172.21.15.26:0/560801508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc070c40 0x7f95cc15ae70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f95cc06e590 tx=0x7f95bc01c430 comp rx=0 tx=0).stop 2023-10-14T11:13:01.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.751+0000 7f95d0846640 1 -- 172.21.15.26:0/560801508 shutdown_connections 2023-10-14T11:13:01.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.751+0000 7f95d0846640 1 --2- 172.21.15.26:0/560801508 >> v2:172.21.15.110:3300/0 conn(0x7f95cc0b07f0 0x7f95cc164490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:01.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.751+0000 7f95d0846640 1 --2- 172.21.15.26:0/560801508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc070c40 0x7f95cc15ae70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:01.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.751+0000 7f95d0846640 1 -- 172.21.15.26:0/560801508 >> 172.21.15.26:0/560801508 conn(0x7f95cc06c190 msgr2=0x7f95cc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:01.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.751+0000 7f95d0846640 1 -- 172.21.15.26:0/560801508 shutdown_connections 2023-10-14T11:13:01.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.751+0000 7f95d0846640 1 -- 172.21.15.26:0/560801508 wait complete. 2023-10-14T11:13:01.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.751+0000 7f95d0846640 1 Processor -- start 2023-10-14T11:13:01.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.751+0000 7f95d0846640 1 -- start start 2023-10-14T11:13:01.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.751+0000 7f95d0846640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95cc070c40 0x7f95cc0c2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:01.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.751+0000 7f95d0846640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc0b07f0 0x7f95cc1f4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:01.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.751+0000 7f95d0846640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95cc0b4020 0x7f95cc152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:01.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.751+0000 7f95d0846640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc153490 con 0x7f95cc0b07f0 2023-10-14T11:13:01.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.751+0000 7f95d0846640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc0c30e0 con 0x7f95cc0b4020 2023-10-14T11:13:01.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.751+0000 7f95d0846640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc0c33b0 con 0x7f95cc070c40 2023-10-14T11:13:01.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.751+0000 7f95c3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc0b07f0 0x7f95cc1f4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:01.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.751+0000 7f95c3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc0b07f0 0x7f95cc1f4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37748/0 (socket says 172.21.15.26:37748) 2023-10-14T11:13:01.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.751+0000 7f95c3fff640 1 -- 172.21.15.26:0/528106838 learned_addr learned my addr 172.21.15.26:0/528106838 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:01.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.755+0000 7f95cad9d640 1 --2- 172.21.15.26:0/528106838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95cc0b4020 0x7f95cc152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:01.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.755+0000 7f95ca59c640 1 --2- 172.21.15.26:0/528106838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95cc070c40 0x7f95cc0c2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:01.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.755+0000 7f95c3fff640 1 -- 172.21.15.26:0/528106838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95cc070c40 msgr2=0x7f95cc0c2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:01.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.755+0000 7f95c3fff640 1 --2- 172.21.15.26:0/528106838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95cc070c40 0x7f95cc0c2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:01.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.755+0000 7f95c3fff640 1 -- 172.21.15.26:0/528106838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95cc0b4020 msgr2=0x7f95cc152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:01.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.755+0000 7f95c3fff640 1 --2- 172.21.15.26:0/528106838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95cc0b4020 0x7f95cc152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:01.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.755+0000 7f95c3fff640 1 -- 172.21.15.26:0/528106838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc0094d0 con 0x7f95cc0b07f0 2023-10-14T11:13:01.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.755+0000 7f95ca59c640 1 --2- 172.21.15.26:0/528106838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95cc070c40 0x7f95cc0c2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:01.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.755+0000 7f95c3fff640 1 --2- 172.21.15.26:0/528106838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc0b07f0 0x7f95cc1f4810 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f95b400c450 tx=0x7f95b400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:01.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.755+0000 7f95c2ffd640 1 -- 172.21.15.26:0/528106838 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b4012830 con 0x7f95cc0b07f0 2023-10-14T11:13:01.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.755+0000 7f95c2ffd640 1 -- 172.21.15.26:0/528106838 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b40129b0 con 0x7f95cc0b07f0 2023-10-14T11:13:01.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.755+0000 7f95d0846640 1 -- 172.21.15.26:0/528106838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95cc0c3690 con 0x7f95cc0b07f0 2023-10-14T11:13:01.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.755+0000 7f95c2ffd640 1 -- 172.21.15.26:0/528106838 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b4012d60 con 0x7f95cc0b07f0 2023-10-14T11:13:01.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.755+0000 7f95d0846640 1 -- 172.21.15.26:0/528106838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95cc0c3c50 con 0x7f95cc0b07f0 2023-10-14T11:13:01.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.755+0000 7f95d0846640 1 -- 172.21.15.26:0/528106838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95cc074010 con 0x7f95cc0b07f0 2023-10-14T11:13:01.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.755+0000 7f95c2ffd640 1 -- 172.21.15.26:0/528106838 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f95b401c460 con 0x7f95cc0b07f0 2023-10-14T11:13:01.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.755+0000 7f95c2ffd640 1 --2- 172.21.15.26:0/528106838 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f95ac0664a0 0x7f95ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:01.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.755+0000 7f95c2ffd640 1 -- 172.21.15.26:0/528106838 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f95b4083fc0 con 0x7f95cc0b07f0 2023-10-14T11:13:01.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.755+0000 7f95ca59c640 1 --2- 172.21.15.26:0/528106838 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f95ac0664a0 0x7f95ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:01.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.759+0000 7f95ca59c640 1 --2- 172.21.15.26:0/528106838 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f95ac0664a0 0x7f95ac068960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0af000 tx=0x7f95bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:01.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.759+0000 7f95c2ffd640 1 -- 172.21.15.26:0/528106838 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f95b40b5090 con 0x7f95cc0b07f0 2023-10-14T11:13:01.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.955+0000 7f95d0846640 1 -- 172.21.15.26:0/528106838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f95cc0afb50 con 0x7f95cc0b07f0 2023-10-14T11:13:01.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.955+0000 7f95c2ffd640 1 -- 172.21.15.26:0/528106838 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f95b40511e0 con 0x7f95cc0b07f0 2023-10-14T11:13:01.959 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-14T11:13:01.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.955+0000 7f95d0846640 1 -- 172.21.15.26:0/528106838 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f95ac0664a0 msgr2=0x7f95ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:01.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.955+0000 7f95d0846640 1 --2- 172.21.15.26:0/528106838 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f95ac0664a0 0x7f95ac068960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0af000 tx=0x7f95bc008040 comp rx=0 tx=0).stop 2023-10-14T11:13:01.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.955+0000 7f95d0846640 1 -- 172.21.15.26:0/528106838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc0b07f0 msgr2=0x7f95cc1f4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:01.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.955+0000 7f95d0846640 1 --2- 172.21.15.26:0/528106838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc0b07f0 0x7f95cc1f4810 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f95b400c450 tx=0x7f95b400c910 comp rx=0 tx=0).stop 2023-10-14T11:13:01.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.955+0000 7f95d0846640 1 -- 172.21.15.26:0/528106838 shutdown_connections 2023-10-14T11:13:01.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.955+0000 7f95d0846640 1 --2- 172.21.15.26:0/528106838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95cc0b4020 0x7f95cc152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:01.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.955+0000 7f95d0846640 1 --2- 172.21.15.26:0/528106838 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f95ac0664a0 0x7f95ac068960 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:01.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.955+0000 7f95d0846640 1 --2- 172.21.15.26:0/528106838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc0b07f0 0x7f95cc1f4810 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:01.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.955+0000 7f95d0846640 1 --2- 172.21.15.26:0/528106838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95cc070c40 0x7f95cc0c2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:01.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.955+0000 7f95d0846640 1 -- 172.21.15.26:0/528106838 >> 172.21.15.26:0/528106838 conn(0x7f95cc06c190 msgr2=0x7f95cc153bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:01.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.955+0000 7f95d0846640 1 -- 172.21.15.26:0/528106838 shutdown_connections 2023-10-14T11:13:01.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:01.955+0000 7f95d0846640 1 -- 172.21.15.26:0/528106838 wait complete. 2023-10-14T11:13:01.981 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T11:13:01.982 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T11:13:01.982 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-14T11:13:01.982 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-14T11:13:01.983 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-14T11:13:01.983 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T11:13:01.983 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T11:13:01.983 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T11:13:01.984 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-14T11:13:01.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:01.984 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-14T11:13:01.995 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:13:01.995 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:13:01.996 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:13:01.996 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:01.996 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-14T11:13:01.997 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:01.997 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:13:01.997 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:01.997 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-14T11:13:01.998 INFO:teuthology.orchestra.run.smithi026.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T11:13:01.998 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:01.998 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-14T11:13:01.999 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-14T11:13:01.999 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42395sec preferred_lft 42395sec 2023-10-14T11:13:01.999 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-14T11:13:02.000 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:02.000 INFO:teuthology.orchestra.run.smithi026.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:13:02.000 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:02.001 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-14T11:13:02.001 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:13:02.001 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:02.002 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-14T11:13:02.002 INFO:teuthology.orchestra.run.smithi026.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-14T11:13:02.004 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 02:42:e1:29:12:f0 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:02.004 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-14T11:13:02.004 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:02.005 INFO:teuthology.orchestra.run.smithi026.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T11:13:02.005 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:02.005 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T11:13:02.006 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:02.006 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-10-14T11:13:02.007 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:02.007 INFO:teuthology.orchestra.run.smithi026.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T11:13:02.007 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:13:02.008 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-10-14T11:13:02.008 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:02.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:02.009 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T11:13:02.056 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-14T11:13:02.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:02.059 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-14T11:13:02.111 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-14T11:13:02.111 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T11:13:02.111 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-14T11:13:02.111 INFO:teuthology.orchestra.run.smithi026.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-14T11:13:02.112 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-14T11:13:02.112 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T11:13:02.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:02.112 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-14T11:13:02.113 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-14T11:13:02.113 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T11:13:02.113 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T11:13:02.114 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T11:13:02.114 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-14T11:13:02.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:02.207 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-14T11:13:02.217 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T11:13:02.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:02.218 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list-id 2023-10-14T11:13:02.273 INFO:teuthology.orchestra.run.smithi026.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-14T11:13:02.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:02.275 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-14T11:13:02.275 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-14T11:13:02.275 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:13:02.276 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-14T11:13:02.276 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-14T11:13:02.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:02.357 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-14T11:13:02.423 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:13:02.423 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:13:02.423 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:13:02.423 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:02.424 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-14T11:13:02.424 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:02.424 INFO:teuthology.orchestra.run.smithi026.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T11:13:02.424 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 92:51:d0:4b:8e:eb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T11:13:02.424 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T11:13:02.424 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:02.425 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::9051:d0ff:fe4b:8eeb/64 scope link 2023-10-14T11:13:02.425 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:02.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:02.426 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-14T11:13:02.490 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:13:02.490 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:13:02.490 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:13:02.491 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:02.491 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-14T11:13:02.491 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:02.491 INFO:teuthology.orchestra.run.smithi026.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T11:13:02.491 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 92:51:d0:4b:8e:eb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T11:13:02.492 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T11:13:02.492 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:02.492 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::9051:d0ff:fe4b:8eeb/64 scope link 2023-10-14T11:13:02.492 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:02.493 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-14T11:13:02.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:02.494 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-14T11:13:02.494 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-14T11:13:02.495 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-14T11:13:02.495 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-14T11:13:02.495 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-14T11:13:02.496 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-14T11:13:02.496 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-14T11:13:02.496 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-14T11:13:02.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:02.637 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-14T11:13:02.637 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-14T11:13:02.637 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.1 up 2023-10-14T11:13:02.638 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set dev brx.1 master ceph-brx 2023-10-14T11:13:02.638 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-14T11:13:02.678 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-10-14T11:13:02.679 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:13:02.679 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-14T11:13:02.734 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-14T11:13:02.735 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:13:02.735 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-14T11:13:02.784 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-10-14T11:13:02.847 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:13:02.899 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2023-10-14T11:13:02.900 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2023-10-14T11:13:02.900 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2023-10-14T11:13:02.900 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2023-10-14T11:13:02.900 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2023-10-14T11:13:02.900 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2023-10-14T11:13:02.901 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2023-10-14T11:13:02.901 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2023-10-14T11:13:02.901 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2023-10-14T11:13:02.901 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2023-10-14T11:13:02.901 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2023-10-14T11:13:02.902 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2023-10-14T11:13:02.902 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:13:02.902 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2023-10-14T11:13:02.902 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2023-10-14T11:13:02.902 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2023-10-14T11:13:02.903 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2023-10-14T11:13:02.903 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2023-10-14T11:13:02.903 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2023-10-14T11:13:02.903 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2023-10-14T11:13:02.903 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:13:02.903 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2023-10-14T11:13:02.904 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2023-10-14T11:13:02.904 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2023-10-14T11:13:02.904 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T11:13:02.904 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T11:13:02.904 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T11:13:02.905 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T11:13:02.905 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2023-10-14T11:13:02.905 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:13:02.905 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:13:02.905 INFO:teuthology.orchestra.run.smithi026.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-14T11:13:02.906 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:13:02.907 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:13:02.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:02.908 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-10-14T11:13:02.962 INFO:teuthology.orchestra.run.smithi026.stdout:43 2023-10-14T11:13:02.962 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-10-14T11:13:02.963 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-10-14T11:13:03.008 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-10-14T11:13:03.030 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:13:03.083 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2023-10-14T11:13:03.083 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2023-10-14T11:13:03.083 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2023-10-14T11:13:03.083 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2023-10-14T11:13:03.084 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2023-10-14T11:13:03.084 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2023-10-14T11:13:03.084 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2023-10-14T11:13:03.084 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2023-10-14T11:13:03.084 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2023-10-14T11:13:03.085 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2023-10-14T11:13:03.085 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2023-10-14T11:13:03.085 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2023-10-14T11:13:03.085 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:13:03.085 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2023-10-14T11:13:03.086 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2023-10-14T11:13:03.086 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2023-10-14T11:13:03.086 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2023-10-14T11:13:03.086 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2023-10-14T11:13:03.086 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2023-10-14T11:13:03.087 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2023-10-14T11:13:03.087 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:13:03.087 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2023-10-14T11:13:03.087 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2023-10-14T11:13:03.087 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2023-10-14T11:13:03.088 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T11:13:03.088 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T11:13:03.088 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T11:13:03.088 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T11:13:03.088 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2023-10-14T11:13:03.088 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:13:03.089 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:13:03.089 INFO:teuthology.orchestra.run.smithi026.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-14T11:13:03.089 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:13:03.089 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:13:03.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:03.091 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-10-14T11:13:03.107 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi026.stderr:2023-10-14T11:13:03.103+0000 7fa4ac447580 -1 init, newargv = 0x55c51c6a4e50 newargc=15 2023-10-14T11:13:03.107 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi026.stderr:ceph-fuse[44975]: starting ceph client 2023-10-14T11:13:03.114 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi026.stderr:ceph-fuse[44975]: starting fuse 2023-10-14T11:13:03.116 INFO:teuthology.orchestra.run.smithi026.stdout:43 2023-10-14T11:13:03.117 INFO:teuthology.orchestra.run.smithi026.stdout:44 2023-10-14T11:13:03.117 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-10-14T11:13:03.117 DEBUG:teuthology.orchestra.run.smithi026:> sudo stdin-killer -- python3 -c ' 2023-10-14T11:13:03.118 DEBUG:teuthology.orchestra.run.smithi026:> import glob 2023-10-14T11:13:03.118 DEBUG:teuthology.orchestra.run.smithi026:> import re 2023-10-14T11:13:03.118 DEBUG:teuthology.orchestra.run.smithi026:> import os 2023-10-14T11:13:03.119 DEBUG:teuthology.orchestra.run.smithi026:> import subprocess 2023-10-14T11:13:03.119 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:13:03.119 DEBUG:teuthology.orchestra.run.smithi026:> def _find_admin_socket(client_name): 2023-10-14T11:13:03.119 DEBUG:teuthology.orchestra.run.smithi026:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-10-14T11:13:03.120 DEBUG:teuthology.orchestra.run.smithi026:> files = glob.glob(asok_path) 2023-10-14T11:13:03.120 DEBUG:teuthology.orchestra.run.smithi026:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-10-14T11:13:03.120 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:13:03.121 DEBUG:teuthology.orchestra.run.smithi026:> # Given a non-glob path, it better be there 2023-10-14T11:13:03.121 DEBUG:teuthology.orchestra.run.smithi026:> if "*" not in asok_path: 2023-10-14T11:13:03.121 DEBUG:teuthology.orchestra.run.smithi026:> assert(len(files) == 1) 2023-10-14T11:13:03.121 DEBUG:teuthology.orchestra.run.smithi026:> return files[0] 2023-10-14T11:13:03.122 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:13:03.122 DEBUG:teuthology.orchestra.run.smithi026:> for f in files: 2023-10-14T11:13:03.122 DEBUG:teuthology.orchestra.run.smithi026:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-14T11:13:03.123 DEBUG:teuthology.orchestra.run.smithi026:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-14T11:13:03.123 DEBUG:teuthology.orchestra.run.smithi026:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-14T11:13:03.123 DEBUG:teuthology.orchestra.run.smithi026:> contents = proc_f.read() 2023-10-14T11:13:03.124 DEBUG:teuthology.orchestra.run.smithi026:> if mountpoint in contents: 2023-10-14T11:13:03.124 DEBUG:teuthology.orchestra.run.smithi026:> return f 2023-10-14T11:13:03.124 DEBUG:teuthology.orchestra.run.smithi026:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-14T11:13:03.124 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:13:03.125 DEBUG:teuthology.orchestra.run.smithi026:> print(_find_admin_socket("client.2")) 2023-10-14T11:13:03.125 DEBUG:teuthology.orchestra.run.smithi026:> ' 2023-10-14T11:13:03.240 INFO:teuthology.orchestra.run.smithi026.stdout:/var/run/ceph/ceph-client.2.44975.asok 2023-10-14T11:13:03.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-14T11:13:03.251 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.44975.asok 2023-10-14T11:13:03.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:03.252 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.44975.asok status 2023-10-14T11:13:03.427 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:13:03.427 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": { 2023-10-14T11:13:03.427 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-14T11:13:03.427 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T11:13:03.428 INFO:teuthology.orchestra.run.smithi026.stdout: "entity_id": "2", 2023-10-14T11:13:03.428 INFO:teuthology.orchestra.run.smithi026.stdout: "hostname": "smithi026", 2023-10-14T11:13:03.428 INFO:teuthology.orchestra.run.smithi026.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-10-14T11:13:03.428 INFO:teuthology.orchestra.run.smithi026.stdout: "pid": "44975", 2023-10-14T11:13:03.429 INFO:teuthology.orchestra.run.smithi026.stdout: "root": "/" 2023-10-14T11:13:03.429 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:03.429 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_count": 0, 2023-10-14T11:13:03.429 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_pinned_count": 0, 2023-10-14T11:13:03.429 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4836, 2023-10-14T11:13:03.429 INFO:teuthology.orchestra.run.smithi026.stdout: "inst": { 2023-10-14T11:13:03.430 INFO:teuthology.orchestra.run.smithi026.stdout: "name": { 2023-10-14T11:13:03.430 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "client", 2023-10-14T11:13:03.430 INFO:teuthology.orchestra.run.smithi026.stdout: "num": 4836 2023-10-14T11:13:03.430 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:03.430 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-10-14T11:13:03.431 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-14T11:13:03.431 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.2:0", 2023-10-14T11:13:03.431 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 692243521 2023-10-14T11:13:03.431 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:03.431 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:03.432 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-10-14T11:13:03.432 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-14T11:13:03.432 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.2:0", 2023-10-14T11:13:03.432 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 692243521 2023-10-14T11:13:03.432 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:03.432 INFO:teuthology.orchestra.run.smithi026.stdout: "inst_str": "client.4836 192.168.0.2:0/692243521", 2023-10-14T11:13:03.433 INFO:teuthology.orchestra.run.smithi026.stdout: "addr_str": "192.168.0.2:0/692243521", 2023-10-14T11:13:03.433 INFO:teuthology.orchestra.run.smithi026.stdout: "inode_count": 1, 2023-10-14T11:13:03.433 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_epoch": 9, 2023-10-14T11:13:03.433 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch": 26, 2023-10-14T11:13:03.433 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch_barrier": 0, 2023-10-14T11:13:03.434 INFO:teuthology.orchestra.run.smithi026.stdout: "blocklisted": false, 2023-10-14T11:13:03.434 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs" 2023-10-14T11:13:03.434 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:13:03.442 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T11:13:03.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.579+0000 7ff3a89aa640 1 Processor -- start 2023-10-14T11:13:03.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.579+0000 7ff3a89aa640 1 -- start start 2023-10-14T11:13:03.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.583+0000 7ff3a89aa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff3a4070c40 0x7ff3a415ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:03.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.583+0000 7ff3a89aa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3a40b4020 0x7ff3a40b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:03.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.583+0000 7ff3a89aa640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a415be60 con 0x7ff3a40b0620 2023-10-14T11:13:03.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.583+0000 7ff3a89aa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a415b3b0 con 0x7ff3a4070c40 2023-10-14T11:13:03.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.583+0000 7ff3a89aa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a40b0a90 con 0x7ff3a40b4020 2023-10-14T11:13:03.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.583+0000 7ff39bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3a40b4020 0x7ff3a40b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:03.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.583+0000 7ff3a259c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff3a4070c40 0x7ff3a415ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:03.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.583+0000 7ff39bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3a40b4020 0x7ff3a40b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:44190/0 (socket says 172.21.15.26:44190) 2023-10-14T11:13:03.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.583+0000 7ff39bfff640 1 -- 172.21.15.26:0/1367381850 learned_addr learned my addr 172.21.15.26:0/1367381850 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:03.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.583+0000 7ff3a259c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff3a4070c40 0x7ff3a415ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:33176/0 (socket says 172.21.15.26:33176) 2023-10-14T11:13:03.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.583+0000 7ff3a2d9d640 1 --1- 172.21.15.26:0/1367381850 >> v1:172.21.15.110:6789/0 conn(0x7ff3a40b0620 0x7ff3a415c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:33898/0 (socket says 172.21.15.26:33898) 2023-10-14T11:13:03.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.583+0000 7ff3a1d9b640 1 -- 172.21.15.26:0/1367381850 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372677779 0 0) 0x7ff3a415be60 con 0x7ff3a40b0620 2023-10-14T11:13:03.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.583+0000 7ff3a1d9b640 1 -- 172.21.15.26:0/1367381850 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff390003530 con 0x7ff3a40b0620 2023-10-14T11:13:03.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.583+0000 7ff3a259c640 1 -- 172.21.15.26:0/1367381850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3a40b4020 msgr2=0x7ff3a40b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:03.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.583+0000 7ff3a259c640 1 --2- 172.21.15.26:0/1367381850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3a40b4020 0x7ff3a40b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:03.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.583+0000 7ff3a259c640 1 -- 172.21.15.26:0/1367381850 >> v1:172.21.15.110:6789/0 conn(0x7ff3a40b0620 legacy=0x7ff3a415c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:03.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.583+0000 7ff3a259c640 1 -- 172.21.15.26:0/1367381850 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a415c1f0 con 0x7ff3a4070c40 2023-10-14T11:13:03.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.583+0000 7ff39bfff640 1 --2- 172.21.15.26:0/1367381850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3a40b4020 0x7ff3a40b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:13:03.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.587+0000 7ff3a259c640 1 --2- 172.21.15.26:0/1367381850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3a4070c40 0x7ff3a415ae70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff3940097c0 tx=0x7ff39401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ece1583f494f8453 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:03.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.587+0000 7ff3a1d9b640 1 -- 172.21.15.26:0/1367381850 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3940ab5f0 con 0x7ff3a4070c40 2023-10-14T11:13:03.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.587+0000 7ff3a1d9b640 1 -- 172.21.15.26:0/1367381850 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3940ab750 con 0x7ff3a4070c40 2023-10-14T11:13:03.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.587+0000 7ff3a1d9b640 1 -- 172.21.15.26:0/1367381850 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3940abae0 con 0x7ff3a4070c40 2023-10-14T11:13:03.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.587+0000 7ff3a89aa640 1 -- 172.21.15.26:0/1367381850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3a4070c40 msgr2=0x7ff3a415ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:03.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.587+0000 7ff3a89aa640 1 --2- 172.21.15.26:0/1367381850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3a4070c40 0x7ff3a415ae70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff3940097c0 tx=0x7ff39401c3f0 comp rx=0 tx=0).stop 2023-10-14T11:13:03.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.587+0000 7ff3a89aa640 1 -- 172.21.15.26:0/1367381850 shutdown_connections 2023-10-14T11:13:03.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.587+0000 7ff3a89aa640 1 --2- 172.21.15.26:0/1367381850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3a40b4020 0x7ff3a40b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:03.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.587+0000 7ff3a89aa640 1 --2- 172.21.15.26:0/1367381850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3a4070c40 0x7ff3a415ae70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:03.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.587+0000 7ff3a89aa640 1 -- 172.21.15.26:0/1367381850 >> 172.21.15.26:0/1367381850 conn(0x7ff3a406c190 msgr2=0x7ff3a406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:03.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.587+0000 7ff3a89aa640 1 -- 172.21.15.26:0/1367381850 shutdown_connections 2023-10-14T11:13:03.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.587+0000 7ff3a89aa640 1 -- 172.21.15.26:0/1367381850 wait complete. 2023-10-14T11:13:03.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.587+0000 7ff3a89aa640 1 Processor -- start 2023-10-14T11:13:03.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.587+0000 7ff3a89aa640 1 -- start start 2023-10-14T11:13:03.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff3a89aa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3a4070c40 0x7ff3a41f59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:03.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff3a89aa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3a40b0620 0x7ff3a41f4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:03.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff3a89aa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3a40b4020 0x7ff3a40c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:03.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff3a89aa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a413c850 con 0x7ff3a4070c40 2023-10-14T11:13:03.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff3a89aa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a413cb30 con 0x7ff3a40b4020 2023-10-14T11:13:03.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff3a89aa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a413ce10 con 0x7ff3a40b0620 2023-10-14T11:13:03.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff3a259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3a4070c40 0x7ff3a41f59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:03.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff3a259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3a4070c40 0x7ff3a41f59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49158/0 (socket says 172.21.15.26:49158) 2023-10-14T11:13:03.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff3a259c640 1 -- 172.21.15.26:0/1620096209 learned_addr learned my addr 172.21.15.26:0/1620096209 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:03.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff3a2d9d640 1 --2- 172.21.15.26:0/1620096209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3a40b4020 0x7ff3a40c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:03.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff39bfff640 1 --2- 172.21.15.26:0/1620096209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3a40b0620 0x7ff3a41f4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:03.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff3a259c640 1 -- 172.21.15.26:0/1620096209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3a40b0620 msgr2=0x7ff3a41f4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:03.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff3a259c640 1 --2- 172.21.15.26:0/1620096209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3a40b0620 0x7ff3a41f4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:03.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff3a259c640 1 -- 172.21.15.26:0/1620096209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3a40b4020 msgr2=0x7ff3a40c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:03.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff3a259c640 1 --2- 172.21.15.26:0/1620096209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3a40b4020 0x7ff3a40c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:03.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff3a259c640 1 -- 172.21.15.26:0/1620096209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38c0094d0 con 0x7ff3a4070c40 2023-10-14T11:13:03.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff39bfff640 1 --2- 172.21.15.26:0/1620096209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3a40b0620 0x7ff3a41f4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:03.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff3a259c640 1 --2- 172.21.15.26:0/1620096209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3a4070c40 0x7ff3a41f59c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff39401a020 tx=0x7ff39401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:03.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff39affd640 1 -- 172.21.15.26:0/1620096209 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3940bf610 con 0x7ff3a4070c40 2023-10-14T11:13:03.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff39affd640 1 -- 172.21.15.26:0/1620096209 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3940bf770 con 0x7ff3a4070c40 2023-10-14T11:13:03.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff39affd640 1 -- 172.21.15.26:0/1620096209 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3940bfb20 con 0x7ff3a4070c40 2023-10-14T11:13:03.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff3a89aa640 1 -- 172.21.15.26:0/1620096209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff394009420 con 0x7ff3a4070c40 2023-10-14T11:13:03.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff3a89aa640 1 -- 172.21.15.26:0/1620096209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a41f50f0 con 0x7ff3a4070c40 2023-10-14T11:13:03.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff3a89aa640 1 -- 172.21.15.26:0/1620096209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a413d330 con 0x7ff3a4070c40 2023-10-14T11:13:03.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.591+0000 7ff39affd640 1 -- 172.21.15.26:0/1620096209 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff3940bfc80 con 0x7ff3a4070c40 2023-10-14T11:13:03.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.595+0000 7ff39affd640 1 --2- 172.21.15.26:0/1620096209 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff3840664d0 0x7ff384068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:03.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.595+0000 7ff39affd640 1 -- 172.21.15.26:0/1620096209 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff3940a8050 con 0x7ff3a4070c40 2023-10-14T11:13:03.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.595+0000 7ff39bfff640 1 --2- 172.21.15.26:0/1620096209 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff3840664d0 0x7ff384068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:03.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.595+0000 7ff39bfff640 1 --2- 172.21.15.26:0/1620096209 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff3840664d0 0x7ff384068990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4151020 tx=0x7ff38c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:03.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.599+0000 7ff39affd640 1 -- 172.21.15.26:0/1620096209 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff3940eb9d0 con 0x7ff3a4070c40 2023-10-14T11:13:03.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.787+0000 7ff3a89aa640 1 -- 172.21.15.26:0/1620096209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff3a4074010 con 0x7ff3a4070c40 2023-10-14T11:13:03.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.791+0000 7ff39affd640 1 -- 172.21.15.26:0/1620096209 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7ff3940eeff0 con 0x7ff3a4070c40 2023-10-14T11:13:03.794 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-14T11:13:03.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.791+0000 7ff3a89aa640 1 -- 172.21.15.26:0/1620096209 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff3840664d0 msgr2=0x7ff384068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:03.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.791+0000 7ff3a89aa640 1 --2- 172.21.15.26:0/1620096209 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff3840664d0 0x7ff384068990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4151020 tx=0x7ff38c008040 comp rx=0 tx=0).stop 2023-10-14T11:13:03.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.791+0000 7ff3a89aa640 1 -- 172.21.15.26:0/1620096209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3a4070c40 msgr2=0x7ff3a41f59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.791+0000 7ff3a89aa640 1 --2- 172.21.15.26:0/1620096209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3a4070c40 0x7ff3a41f59c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff39401a020 tx=0x7ff39401ac30 comp rx=0 tx=0).stop 2023-10-14T11:13:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.791+0000 7ff3a89aa640 1 -- 172.21.15.26:0/1620096209 shutdown_connections 2023-10-14T11:13:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.791+0000 7ff3a89aa640 1 --2- 172.21.15.26:0/1620096209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3a40b4020 0x7ff3a40c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.791+0000 7ff3a89aa640 1 --2- 172.21.15.26:0/1620096209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3a40b0620 0x7ff3a41f4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:03.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.791+0000 7ff3a89aa640 1 --2- 172.21.15.26:0/1620096209 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff3840664d0 0x7ff384068990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:03.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.791+0000 7ff3a89aa640 1 --2- 172.21.15.26:0/1620096209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3a4070c40 0x7ff3a41f59c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:03.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.791+0000 7ff3a89aa640 1 -- 172.21.15.26:0/1620096209 >> 172.21.15.26:0/1620096209 conn(0x7ff3a406c190 msgr2=0x7ff3a40712c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:03.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.791+0000 7ff3a89aa640 1 -- 172.21.15.26:0/1620096209 shutdown_connections 2023-10-14T11:13:03.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:03.791+0000 7ff3a89aa640 1 -- 172.21.15.26:0/1620096209 wait complete. 2023-10-14T11:13:03.814 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T11:13:03.815 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T11:13:03.815 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2023-10-14T11:13:03.815 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T11:13:03.816 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T11:13:03.816 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T11:13:03.816 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T11:13:03.816 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T11:13:03.817 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T11:13:03.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:03.817 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2023-10-14T11:13:03.830 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:13:03.831 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:13:03.831 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:13:03.831 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:03.831 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2023-10-14T11:13:03.832 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:03.832 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:13:03.832 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:03.832 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2023-10-14T11:13:03.832 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:13:03.833 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:03.833 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2023-10-14T11:13:03.833 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:13:03.833 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:03.834 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T11:13:03.834 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:03.834 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-14T11:13:03.834 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42394sec preferred_lft 42394sec 2023-10-14T11:13:03.834 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2023-10-14T11:13:03.835 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:03.835 INFO:teuthology.orchestra.run.smithi110.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-14T11:13:03.835 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 02:42:4f:1d:0c:64 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:03.835 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-14T11:13:03.836 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:03.836 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T11:13:03.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:03.837 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2023-10-14T11:13:03.837 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2023-10-14T11:13:03.837 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add name ceph-brx type bridge 2023-10-14T11:13:03.838 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr flush dev ceph-brx 2023-10-14T11:13:03.838 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set ceph-brx up 2023-10-14T11:13:03.838 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T11:13:03.838 DEBUG:teuthology.orchestra.run.smithi110:> ') 2023-10-14T11:13:03.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:03.951 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T11:13:03.970 INFO:teuthology.orchestra.run.smithi110.stdout:1 2023-10-14T11:13:03.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:03.973 DEBUG:teuthology.orchestra.run.smithi110:> route 2023-10-14T11:13:04.050 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2023-10-14T11:13:04.050 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T11:13:04.050 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-14T11:13:04.051 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T11:13:04.051 INFO:teuthology.orchestra.run.smithi110.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-14T11:13:04.051 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T11:13:04.051 INFO:teuthology.orchestra.run.smithi110.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-14T11:13:04.051 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-14T11:13:04.052 INFO:teuthology.orchestra.run.smithi110.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-14T11:13:04.052 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T11:13:04.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:04.053 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2023-10-14T11:13:04.053 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2023-10-14T11:13:04.053 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T11:13:04.053 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T11:13:04.054 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T11:13:04.054 DEBUG:teuthology.orchestra.run.smithi110:> ') 2023-10-14T11:13:04.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:04.151 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2023-10-14T11:13:04.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:04.161 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list-id 2023-10-14T11:13:04.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:04.211 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2023-10-14T11:13:04.212 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2023-10-14T11:13:04.212 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T11:13:04.212 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-14T11:13:04.213 DEBUG:teuthology.orchestra.run.smithi110:> ') 2023-10-14T11:13:04.293 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-14T11:13:04.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:04.293 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2023-10-14T11:13:04.294 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2023-10-14T11:13:04.294 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-14T11:13:04.294 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T11:13:04.295 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-14T11:13:04.295 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-14T11:13:04.295 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-14T11:13:04.295 DEBUG:teuthology.orchestra.run.smithi110:> ') 2023-10-14T11:13:04.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:04.462 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2023-10-14T11:13:04.462 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2023-10-14T11:13:04.463 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2023-10-14T11:13:04.463 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T11:13:04.463 DEBUG:teuthology.orchestra.run.smithi110:> ') 2023-10-14T11:13:04.504 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-14T11:13:04.504 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:13:04.505 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T11:13:04.554 INFO:teuthology.orchestra.run.smithi110.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T11:13:04.555 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:13:04.555 DEBUG:teuthology.orchestra.run.smithi110:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T11:13:04.606 DEBUG:teuthology.orchestra.run.smithi110:> sudo modprobe fuse 2023-10-14T11:13:04.676 DEBUG:teuthology.orchestra.run.smithi110:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:13:04.728 INFO:teuthology.orchestra.run.smithi110.stdout:/sys 2023-10-14T11:13:04.728 INFO:teuthology.orchestra.run.smithi110.stdout:/proc 2023-10-14T11:13:04.728 INFO:teuthology.orchestra.run.smithi110.stdout:/dev 2023-10-14T11:13:04.729 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/pts 2023-10-14T11:13:04.729 INFO:teuthology.orchestra.run.smithi110.stdout:/run 2023-10-14T11:13:04.729 INFO:teuthology.orchestra.run.smithi110.stdout:/ 2023-10-14T11:13:04.729 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/security 2023-10-14T11:13:04.729 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/shm 2023-10-14T11:13:04.730 INFO:teuthology.orchestra.run.smithi110.stdout:/run/lock 2023-10-14T11:13:04.730 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/cgroup 2023-10-14T11:13:04.730 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/pstore 2023-10-14T11:13:04.730 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/bpf 2023-10-14T11:13:04.730 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:13:04.731 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/hugepages 2023-10-14T11:13:04.731 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/mqueue 2023-10-14T11:13:04.731 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/debug 2023-10-14T11:13:04.731 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/tracing 2023-10-14T11:13:04.731 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/fs/nfsd 2023-10-14T11:13:04.731 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/fuse/connections 2023-10-14T11:13:04.732 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/config 2023-10-14T11:13:04.732 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:13:04.732 INFO:teuthology.orchestra.run.smithi110.stdout:/run/rpc_pipefs 2023-10-14T11:13:04.732 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/1000 2023-10-14T11:13:04.732 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph 2023-10-14T11:13:04.733 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-4 2023-10-14T11:13:04.733 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-5 2023-10-14T11:13:04.733 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-6 2023-10-14T11:13:04.733 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-7 2023-10-14T11:13:04.733 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns 2023-10-14T11:13:04.733 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T11:13:04.734 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T11:13:04.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:04.735 DEBUG:teuthology.orchestra.run.smithi110:> ls /sys/fs/fuse/connections 2023-10-14T11:13:04.786 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-14T11:13:04.787 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-14T11:13:04.834 DEBUG:teuthology.orchestra.run.smithi110:> sudo modprobe fuse 2023-10-14T11:13:04.855 DEBUG:teuthology.orchestra.run.smithi110:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:13:04.912 INFO:teuthology.orchestra.run.smithi110.stdout:/sys 2023-10-14T11:13:04.912 INFO:teuthology.orchestra.run.smithi110.stdout:/proc 2023-10-14T11:13:04.912 INFO:teuthology.orchestra.run.smithi110.stdout:/dev 2023-10-14T11:13:04.913 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/pts 2023-10-14T11:13:04.913 INFO:teuthology.orchestra.run.smithi110.stdout:/run 2023-10-14T11:13:04.913 INFO:teuthology.orchestra.run.smithi110.stdout:/ 2023-10-14T11:13:04.913 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/security 2023-10-14T11:13:04.914 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/shm 2023-10-14T11:13:04.914 INFO:teuthology.orchestra.run.smithi110.stdout:/run/lock 2023-10-14T11:13:04.914 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/cgroup 2023-10-14T11:13:04.914 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/pstore 2023-10-14T11:13:04.914 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/bpf 2023-10-14T11:13:04.915 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:13:04.915 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/hugepages 2023-10-14T11:13:04.915 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/mqueue 2023-10-14T11:13:04.915 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/debug 2023-10-14T11:13:04.915 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/tracing 2023-10-14T11:13:04.915 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/fs/nfsd 2023-10-14T11:13:04.916 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/fuse/connections 2023-10-14T11:13:04.916 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/config 2023-10-14T11:13:04.916 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:13:04.916 INFO:teuthology.orchestra.run.smithi110.stdout:/run/rpc_pipefs 2023-10-14T11:13:04.916 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/1000 2023-10-14T11:13:04.917 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph 2023-10-14T11:13:04.917 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-4 2023-10-14T11:13:04.917 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-5 2023-10-14T11:13:04.917 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-6 2023-10-14T11:13:04.918 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-7 2023-10-14T11:13:04.918 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns 2023-10-14T11:13:04.918 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T11:13:04.918 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T11:13:04.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:04.920 DEBUG:teuthology.orchestra.run.smithi110:> ls /sys/fs/fuse/connections 2023-10-14T11:13:04.951 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi110.stderr:2023-10-14T11:13:04.944+0000 7f4e30449580 -1 init, newargv = 0x559f7dc2a9c0 newargc=15 2023-10-14T11:13:04.951 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi110.stderr:ceph-fuse[42681]: starting ceph client 2023-10-14T11:13:04.958 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi110.stderr:ceph-fuse[42681]: starting fuse 2023-10-14T11:13:04.960 INFO:teuthology.orchestra.run.smithi110.stdout:43 2023-10-14T11:13:04.960 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-10-14T11:13:04.961 DEBUG:teuthology.orchestra.run.smithi110:> sudo stdin-killer -- python3 -c ' 2023-10-14T11:13:04.961 DEBUG:teuthology.orchestra.run.smithi110:> import glob 2023-10-14T11:13:04.962 DEBUG:teuthology.orchestra.run.smithi110:> import re 2023-10-14T11:13:04.962 DEBUG:teuthology.orchestra.run.smithi110:> import os 2023-10-14T11:13:04.962 DEBUG:teuthology.orchestra.run.smithi110:> import subprocess 2023-10-14T11:13:04.963 DEBUG:teuthology.orchestra.run.smithi110:> 2023-10-14T11:13:04.963 DEBUG:teuthology.orchestra.run.smithi110:> def _find_admin_socket(client_name): 2023-10-14T11:13:04.963 DEBUG:teuthology.orchestra.run.smithi110:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-14T11:13:04.963 DEBUG:teuthology.orchestra.run.smithi110:> files = glob.glob(asok_path) 2023-10-14T11:13:04.964 DEBUG:teuthology.orchestra.run.smithi110:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-14T11:13:04.964 DEBUG:teuthology.orchestra.run.smithi110:> 2023-10-14T11:13:04.964 DEBUG:teuthology.orchestra.run.smithi110:> # Given a non-glob path, it better be there 2023-10-14T11:13:04.965 DEBUG:teuthology.orchestra.run.smithi110:> if "*" not in asok_path: 2023-10-14T11:13:04.965 DEBUG:teuthology.orchestra.run.smithi110:> assert(len(files) == 1) 2023-10-14T11:13:04.965 DEBUG:teuthology.orchestra.run.smithi110:> return files[0] 2023-10-14T11:13:04.965 DEBUG:teuthology.orchestra.run.smithi110:> 2023-10-14T11:13:04.966 DEBUG:teuthology.orchestra.run.smithi110:> for f in files: 2023-10-14T11:13:04.966 DEBUG:teuthology.orchestra.run.smithi110:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-14T11:13:04.966 DEBUG:teuthology.orchestra.run.smithi110:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-14T11:13:04.967 DEBUG:teuthology.orchestra.run.smithi110:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-14T11:13:04.967 DEBUG:teuthology.orchestra.run.smithi110:> contents = proc_f.read() 2023-10-14T11:13:04.967 DEBUG:teuthology.orchestra.run.smithi110:> if mountpoint in contents: 2023-10-14T11:13:04.967 DEBUG:teuthology.orchestra.run.smithi110:> return f 2023-10-14T11:13:04.968 DEBUG:teuthology.orchestra.run.smithi110:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-14T11:13:04.968 DEBUG:teuthology.orchestra.run.smithi110:> 2023-10-14T11:13:04.968 DEBUG:teuthology.orchestra.run.smithi110:> print(_find_admin_socket("client.1")) 2023-10-14T11:13:04.969 DEBUG:teuthology.orchestra.run.smithi110:> ' 2023-10-14T11:13:05.083 INFO:teuthology.orchestra.run.smithi110.stdout:/var/run/ceph/ceph-client.1.42681.asok 2023-10-14T11:13:05.086 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:13:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-14T11:13:05.094 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.42681.asok 2023-10-14T11:13:05.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:05.095 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.42681.asok status 2023-10-14T11:13:05.265 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2023-10-14T11:13:05.265 INFO:teuthology.orchestra.run.smithi110.stdout: "metadata": { 2023-10-14T11:13:05.266 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-14T11:13:05.266 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T11:13:05.266 INFO:teuthology.orchestra.run.smithi110.stdout: "entity_id": "1", 2023-10-14T11:13:05.266 INFO:teuthology.orchestra.run.smithi110.stdout: "hostname": "smithi110", 2023-10-14T11:13:05.266 INFO:teuthology.orchestra.run.smithi110.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-14T11:13:05.267 INFO:teuthology.orchestra.run.smithi110.stdout: "pid": "42681", 2023-10-14T11:13:05.267 INFO:teuthology.orchestra.run.smithi110.stdout: "root": "/" 2023-10-14T11:13:05.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2023-10-14T11:13:05.267 INFO:teuthology.orchestra.run.smithi110.stdout: "dentry_count": 0, 2023-10-14T11:13:05.267 INFO:teuthology.orchestra.run.smithi110.stdout: "dentry_pinned_count": 0, 2023-10-14T11:13:05.268 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 4628, 2023-10-14T11:13:05.268 INFO:teuthology.orchestra.run.smithi110.stdout: "inst": { 2023-10-14T11:13:05.268 INFO:teuthology.orchestra.run.smithi110.stdout: "name": { 2023-10-14T11:13:05.268 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "client", 2023-10-14T11:13:05.268 INFO:teuthology.orchestra.run.smithi110.stdout: "num": 4628 2023-10-14T11:13:05.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2023-10-14T11:13:05.269 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": { 2023-10-14T11:13:05.269 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "v1", 2023-10-14T11:13:05.269 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": "192.168.0.1:0", 2023-10-14T11:13:05.269 INFO:teuthology.orchestra.run.smithi110.stdout: "nonce": 3345413270 2023-10-14T11:13:05.269 INFO:teuthology.orchestra.run.smithi110.stdout: } 2023-10-14T11:13:05.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2023-10-14T11:13:05.270 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": { 2023-10-14T11:13:05.270 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "v1", 2023-10-14T11:13:05.270 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": "192.168.0.1:0", 2023-10-14T11:13:05.270 INFO:teuthology.orchestra.run.smithi110.stdout: "nonce": 3345413270 2023-10-14T11:13:05.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2023-10-14T11:13:05.271 INFO:teuthology.orchestra.run.smithi110.stdout: "inst_str": "client.4628 192.168.0.1:0/3345413270", 2023-10-14T11:13:05.271 INFO:teuthology.orchestra.run.smithi110.stdout: "addr_str": "192.168.0.1:0/3345413270", 2023-10-14T11:13:05.271 INFO:teuthology.orchestra.run.smithi110.stdout: "inode_count": 1, 2023-10-14T11:13:05.272 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_epoch": 9, 2023-10-14T11:13:05.272 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_epoch": 27, 2023-10-14T11:13:05.272 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_epoch_barrier": 0, 2023-10-14T11:13:05.272 INFO:teuthology.orchestra.run.smithi110.stdout: "blocklisted": false, 2023-10-14T11:13:05.272 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs" 2023-10-14T11:13:05.273 INFO:teuthology.orchestra.run.smithi110.stdout:} 2023-10-14T11:13:05.280 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T11:13:05.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.431+0000 7fd8ddb3e640 1 Processor -- start 2023-10-14T11:13:05.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.431+0000 7fd8ddb3e640 1 -- start start 2023-10-14T11:13:05.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.431+0000 7fd8ddb3e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd8d8070c40 0x7fd8d815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:05.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.431+0000 7fd8ddb3e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d815be60 con 0x7fd8d80b4020 2023-10-14T11:13:05.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.431+0000 7fd8ddb3e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d815c1f0 con 0x7fd8d80b07f0 2023-10-14T11:13:05.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.431+0000 7fd8ddb3e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d815b3b0 con 0x7fd8d8070c40 2023-10-14T11:13:05.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.431+0000 7fd8d6ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd8d80b4020 0x7fd8d80b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53066/0 (socket says 172.21.15.26:53066) 2023-10-14T11:13:05.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.431+0000 7fd8d6ffd640 1 -- 172.21.15.26:0/1746264991 learned_addr learned my addr 172.21.15.26:0/1746264991 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:05.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.431+0000 7fd8d77fe640 1 --2- 172.21.15.26:0/1746264991 >> v2:172.21.15.110:3300/0 conn(0x7fd8d8070c40 0x7fd8d815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:05.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.431+0000 7fd8d67fc640 1 -- 172.21.15.26:0/1746264991 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508132405 0 0) 0x7fd8d815be60 con 0x7fd8d80b4020 2023-10-14T11:13:05.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.431+0000 7fd8d67fc640 1 -- 172.21.15.26:0/1746264991 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8c0003530 con 0x7fd8d80b4020 2023-10-14T11:13:05.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.435+0000 7fd8d67fc640 1 -- 172.21.15.26:0/1746264991 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1847683232 0 0) 0x7fd8c0003530 con 0x7fd8d80b4020 2023-10-14T11:13:05.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.435+0000 7fd8d77fe640 1 -- 172.21.15.26:0/1746264991 >> v1:172.21.15.110:6789/0 conn(0x7fd8d80b07f0 legacy=0x7fd8d8164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:05.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.435+0000 7fd8d77fe640 1 -- 172.21.15.26:0/1746264991 >> v1:172.21.15.26:6789/0 conn(0x7fd8d80b4020 legacy=0x7fd8d80b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:05.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.435+0000 7fd8d77fe640 1 -- 172.21.15.26:0/1746264991 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d8071020 con 0x7fd8d8070c40 2023-10-14T11:13:05.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.435+0000 7fd8d77fe640 1 --2- 172.21.15.26:0/1746264991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8d8070c40 0x7fd8d815ae70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80097c0 tx=0x7fd8c801c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b52d782b23a58476 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:05.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.435+0000 7fd8d67fc640 1 -- 172.21.15.26:0/1746264991 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc001680 con 0x7fd8d8070c40 2023-10-14T11:13:05.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.435+0000 7fd8d67fc640 1 -- 172.21.15.26:0/1746264991 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c80a7050 con 0x7fd8d8070c40 2023-10-14T11:13:05.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.435+0000 7fd8d67fc640 1 -- 172.21.15.26:0/1746264991 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c80ab620 con 0x7fd8d8070c40 2023-10-14T11:13:05.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8ddb3e640 1 -- 172.21.15.26:0/1746264991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8d8070c40 msgr2=0x7fd8d815ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:05.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8ddb3e640 1 --2- 172.21.15.26:0/1746264991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8d8070c40 0x7fd8d815ae70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80097c0 tx=0x7fd8c801c310 comp rx=0 tx=0).stop 2023-10-14T11:13:05.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8ddb3e640 1 -- 172.21.15.26:0/1746264991 shutdown_connections 2023-10-14T11:13:05.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8ddb3e640 1 --2- 172.21.15.26:0/1746264991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8d8070c40 0x7fd8d815ae70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:05.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8ddb3e640 1 -- 172.21.15.26:0/1746264991 >> 172.21.15.26:0/1746264991 conn(0x7fd8d806c190 msgr2=0x7fd8d806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:05.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8ddb3e640 1 -- 172.21.15.26:0/1746264991 shutdown_connections 2023-10-14T11:13:05.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8ddb3e640 1 -- 172.21.15.26:0/1746264991 wait complete. 2023-10-14T11:13:05.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8ddb3e640 1 Processor -- start 2023-10-14T11:13:05.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8ddb3e640 1 -- start start 2023-10-14T11:13:05.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8ddb3e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8d8070c40 0x7fd8d814acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:05.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8ddb3e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8d80b07f0 0x7fd8d80c4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:05.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8ddb3e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8d80b4020 0x7fd8d80c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:05.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8ddb3e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d8151790 con 0x7fd8d80b07f0 2023-10-14T11:13:05.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8ddb3e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d814f3f0 con 0x7fd8d8070c40 2023-10-14T11:13:05.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8ddb3e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d814f6d0 con 0x7fd8d80b4020 2023-10-14T11:13:05.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8d6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8d80b07f0 0x7fd8d80c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:05.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8d6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8d80b07f0 0x7fd8d80c4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49170/0 (socket says 172.21.15.26:49170) 2023-10-14T11:13:05.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8d6ffd640 1 -- 172.21.15.26:0/3926420380 learned_addr learned my addr 172.21.15.26:0/3926420380 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:05.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8d77fe640 1 --2- 172.21.15.26:0/3926420380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8d8070c40 0x7fd8d814acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:05.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8d7fff640 1 --2- 172.21.15.26:0/3926420380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8d80b4020 0x7fd8d80c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:05.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8d6ffd640 1 -- 172.21.15.26:0/3926420380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8d80b4020 msgr2=0x7fd8d80c3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:05.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8d6ffd640 1 --2- 172.21.15.26:0/3926420380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8d80b4020 0x7fd8d80c3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:05.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8d6ffd640 1 -- 172.21.15.26:0/3926420380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8d8070c40 msgr2=0x7fd8d814acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:05.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8d6ffd640 1 --2- 172.21.15.26:0/3926420380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8d8070c40 0x7fd8d814acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:05.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.439+0000 7fd8d6ffd640 1 -- 172.21.15.26:0/3926420380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c8009420 con 0x7fd8d80b07f0 2023-10-14T11:13:05.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.443+0000 7fd8d6ffd640 1 --2- 172.21.15.26:0/3926420380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8d80b07f0 0x7fd8d80c4400 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00c750 tx=0x7fd8cc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:05.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.443+0000 7fd8bffff640 1 -- 172.21.15.26:0/3926420380 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc005ae0 con 0x7fd8d80b07f0 2023-10-14T11:13:05.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.443+0000 7fd8bffff640 1 -- 172.21.15.26:0/3926420380 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8cc005c40 con 0x7fd8d80b07f0 2023-10-14T11:13:05.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.443+0000 7fd8ddb3e640 1 -- 172.21.15.26:0/3926420380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d814f9b0 con 0x7fd8d80b07f0 2023-10-14T11:13:05.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.443+0000 7fd8bffff640 1 -- 172.21.15.26:0/3926420380 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc0072b0 con 0x7fd8d80b07f0 2023-10-14T11:13:05.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.443+0000 7fd8ddb3e640 1 -- 172.21.15.26:0/3926420380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d80c4940 con 0x7fd8d80b07f0 2023-10-14T11:13:05.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.443+0000 7fd8ddb3e640 1 -- 172.21.15.26:0/3926420380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d8074010 con 0x7fd8d80b07f0 2023-10-14T11:13:05.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.443+0000 7fd8bffff640 1 -- 172.21.15.26:0/3926420380 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd8cc007410 con 0x7fd8d80b07f0 2023-10-14T11:13:05.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.443+0000 7fd8bffff640 1 --2- 172.21.15.26:0/3926420380 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd8c40664a0 0x7fd8c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:05.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.443+0000 7fd8bffff640 1 -- 172.21.15.26:0/3926420380 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd8cc0838e0 con 0x7fd8d80b07f0 2023-10-14T11:13:05.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.443+0000 7fd8d77fe640 1 --2- 172.21.15.26:0/3926420380 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd8c40664a0 0x7fd8c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:05.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.447+0000 7fd8d77fe640 1 --2- 172.21.15.26:0/3926420380 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd8c40664a0 0x7fd8c4068960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80ad000 tx=0x7fd8c80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:05.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.447+0000 7fd8bffff640 1 -- 172.21.15.26:0/3926420380 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd8cc050a80 con 0x7fd8d80b07f0 2023-10-14T11:13:05.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.639+0000 7fd8ddb3e640 1 -- 172.21.15.26:0/3926420380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd8d80b1830 con 0x7fd8d80b07f0 2023-10-14T11:13:05.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.639+0000 7fd8bffff640 1 -- 172.21.15.26:0/3926420380 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fd8cc017070 con 0x7fd8d80b07f0 2023-10-14T11:13:05.645 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-14T11:13:05.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.643+0000 7fd8ddb3e640 1 -- 172.21.15.26:0/3926420380 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd8c40664a0 msgr2=0x7fd8c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:05.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.643+0000 7fd8ddb3e640 1 --2- 172.21.15.26:0/3926420380 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd8c40664a0 0x7fd8c4068960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80ad000 tx=0x7fd8c80a6000 comp rx=0 tx=0).stop 2023-10-14T11:13:05.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.643+0000 7fd8ddb3e640 1 -- 172.21.15.26:0/3926420380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8d80b07f0 msgr2=0x7fd8d80c4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:05.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.643+0000 7fd8ddb3e640 1 --2- 172.21.15.26:0/3926420380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8d80b07f0 0x7fd8d80c4400 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00c750 tx=0x7fd8cc00cc10 comp rx=0 tx=0).stop 2023-10-14T11:13:05.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.643+0000 7fd8ddb3e640 1 -- 172.21.15.26:0/3926420380 shutdown_connections 2023-10-14T11:13:05.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.643+0000 7fd8ddb3e640 1 --2- 172.21.15.26:0/3926420380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8d80b4020 0x7fd8d80c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:05.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.643+0000 7fd8ddb3e640 1 --2- 172.21.15.26:0/3926420380 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd8c40664a0 0x7fd8c4068960 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:05.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.643+0000 7fd8ddb3e640 1 --2- 172.21.15.26:0/3926420380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8d80b07f0 0x7fd8d80c4400 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:05.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.643+0000 7fd8ddb3e640 1 --2- 172.21.15.26:0/3926420380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8d8070c40 0x7fd8d814acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:05.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.643+0000 7fd8ddb3e640 1 -- 172.21.15.26:0/3926420380 >> 172.21.15.26:0/3926420380 conn(0x7fd8d806c190 msgr2=0x7fd8d80ce5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:05.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.643+0000 7fd8ddb3e640 1 -- 172.21.15.26:0/3926420380 shutdown_connections 2023-10-14T11:13:05.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:05.643+0000 7fd8ddb3e640 1 -- 172.21.15.26:0/3926420380 wait complete. 2023-10-14T11:13:05.667 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T11:13:05.667 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T11:13:05.667 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2023-10-14T11:13:05.669 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-14T11:13:05.669 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-14T11:13:05.669 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T11:13:05.670 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T11:13:05.670 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T11:13:05.670 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-14T11:13:05.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:05.671 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2023-10-14T11:13:05.680 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:13:05.681 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:13:05.681 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:13:05.681 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:05.681 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2023-10-14T11:13:05.681 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:05.682 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:13:05.682 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:05.682 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2023-10-14T11:13:05.682 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:13:05.682 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:05.683 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2023-10-14T11:13:05.683 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:13:05.683 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:05.683 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T11:13:05.683 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:05.684 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-14T11:13:05.684 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42393sec preferred_lft 42393sec 2023-10-14T11:13:05.684 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2023-10-14T11:13:05.684 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:05.684 INFO:teuthology.orchestra.run.smithi110.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-14T11:13:05.685 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 02:42:4f:1d:0c:64 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:05.685 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-14T11:13:05.685 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:05.686 INFO:teuthology.orchestra.run.smithi110.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T11:13:05.686 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:05.686 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T11:13:05.686 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:05.686 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-10-14T11:13:05.687 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:05.687 INFO:teuthology.orchestra.run.smithi110.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T11:13:05.687 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T11:13:05.688 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-10-14T11:13:05.688 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:05.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:05.689 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T11:13:05.748 INFO:teuthology.orchestra.run.smithi110.stdout:1 2023-10-14T11:13:05.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:05.751 DEBUG:teuthology.orchestra.run.smithi110:> route 2023-10-14T11:13:05.805 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2023-10-14T11:13:05.805 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T11:13:05.806 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-14T11:13:05.806 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T11:13:05.806 INFO:teuthology.orchestra.run.smithi110.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-14T11:13:05.806 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T11:13:05.806 INFO:teuthology.orchestra.run.smithi110.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-14T11:13:05.807 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-14T11:13:05.807 INFO:teuthology.orchestra.run.smithi110.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-14T11:13:05.807 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T11:13:05.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:05.808 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2023-10-14T11:13:05.808 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2023-10-14T11:13:05.808 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T11:13:05.809 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T11:13:05.809 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T11:13:05.809 DEBUG:teuthology.orchestra.run.smithi110:> ') 2023-10-14T11:13:05.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:05.900 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2023-10-14T11:13:05.909 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T11:13:05.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:05.910 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list-id 2023-10-14T11:13:05.958 INFO:teuthology.orchestra.run.smithi110.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-14T11:13:05.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:05.959 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2023-10-14T11:13:05.960 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2023-10-14T11:13:05.960 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T11:13:05.960 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-14T11:13:05.960 DEBUG:teuthology.orchestra.run.smithi110:> ') 2023-10-14T11:13:06.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:06.042 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-14T11:13:06.107 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:13:06.107 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:13:06.107 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:13:06.107 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:06.108 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2023-10-14T11:13:06.108 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:06.108 INFO:teuthology.orchestra.run.smithi110.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T11:13:06.108 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 86:fa:41:81:aa:e7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T11:13:06.108 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T11:13:06.108 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:06.109 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::84fa:41ff:fe81:aae7/64 scope link 2023-10-14T11:13:06.109 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:06.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:06.110 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-14T11:13:06.174 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:13:06.174 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:13:06.175 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:13:06.175 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:06.175 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2023-10-14T11:13:06.175 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:06.175 INFO:teuthology.orchestra.run.smithi110.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T11:13:06.176 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 86:fa:41:81:aa:e7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T11:13:06.176 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T11:13:06.176 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:06.176 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::84fa:41ff:fe81:aae7/64 scope link 2023-10-14T11:13:06.176 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:06.177 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-14T11:13:06.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:06.178 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2023-10-14T11:13:06.178 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2023-10-14T11:13:06.179 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-14T11:13:06.179 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-14T11:13:06.179 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-14T11:13:06.180 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-14T11:13:06.180 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-14T11:13:06.181 DEBUG:teuthology.orchestra.run.smithi110:> ') 2023-10-14T11:13:06.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:06.316 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2023-10-14T11:13:06.316 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2023-10-14T11:13:06.316 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.1 up 2023-10-14T11:13:06.317 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set dev brx.1 master ceph-brx 2023-10-14T11:13:06.317 DEBUG:teuthology.orchestra.run.smithi110:> ') 2023-10-14T11:13:06.357 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-10-14T11:13:06.358 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:13:06.358 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-14T11:13:06.411 INFO:teuthology.orchestra.run.smithi110.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-14T11:13:06.411 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:13:06.411 DEBUG:teuthology.orchestra.run.smithi110:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-14T11:13:06.468 DEBUG:teuthology.orchestra.run.smithi110:> sudo modprobe fuse 2023-10-14T11:13:06.540 DEBUG:teuthology.orchestra.run.smithi110:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:13:06.599 INFO:teuthology.orchestra.run.smithi110.stdout:/sys 2023-10-14T11:13:06.599 INFO:teuthology.orchestra.run.smithi110.stdout:/proc 2023-10-14T11:13:06.600 INFO:teuthology.orchestra.run.smithi110.stdout:/dev 2023-10-14T11:13:06.600 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/pts 2023-10-14T11:13:06.600 INFO:teuthology.orchestra.run.smithi110.stdout:/run 2023-10-14T11:13:06.600 INFO:teuthology.orchestra.run.smithi110.stdout:/ 2023-10-14T11:13:06.600 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/security 2023-10-14T11:13:06.601 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/shm 2023-10-14T11:13:06.601 INFO:teuthology.orchestra.run.smithi110.stdout:/run/lock 2023-10-14T11:13:06.601 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/cgroup 2023-10-14T11:13:06.601 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/pstore 2023-10-14T11:13:06.601 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/bpf 2023-10-14T11:13:06.602 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:13:06.602 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/hugepages 2023-10-14T11:13:06.602 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/mqueue 2023-10-14T11:13:06.602 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/debug 2023-10-14T11:13:06.602 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/tracing 2023-10-14T11:13:06.603 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/fs/nfsd 2023-10-14T11:13:06.603 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/fuse/connections 2023-10-14T11:13:06.603 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/config 2023-10-14T11:13:06.603 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:13:06.603 INFO:teuthology.orchestra.run.smithi110.stdout:/run/rpc_pipefs 2023-10-14T11:13:06.603 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/1000 2023-10-14T11:13:06.604 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph 2023-10-14T11:13:06.604 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-4 2023-10-14T11:13:06.604 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-5 2023-10-14T11:13:06.605 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-6 2023-10-14T11:13:06.605 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-7 2023-10-14T11:13:06.605 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns 2023-10-14T11:13:06.605 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T11:13:06.605 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T11:13:06.606 INFO:teuthology.orchestra.run.smithi110.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-14T11:13:06.606 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T11:13:06.606 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T11:13:06.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:06.607 DEBUG:teuthology.orchestra.run.smithi110:> ls /sys/fs/fuse/connections 2023-10-14T11:13:06.660 INFO:teuthology.orchestra.run.smithi110.stdout:43 2023-10-14T11:13:06.661 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-10-14T11:13:06.661 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-10-14T11:13:06.705 DEBUG:teuthology.orchestra.run.smithi110:> sudo modprobe fuse 2023-10-14T11:13:06.728 DEBUG:teuthology.orchestra.run.smithi110:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:13:06.780 INFO:teuthology.orchestra.run.smithi110.stdout:/sys 2023-10-14T11:13:06.780 INFO:teuthology.orchestra.run.smithi110.stdout:/proc 2023-10-14T11:13:06.780 INFO:teuthology.orchestra.run.smithi110.stdout:/dev 2023-10-14T11:13:06.780 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/pts 2023-10-14T11:13:06.781 INFO:teuthology.orchestra.run.smithi110.stdout:/run 2023-10-14T11:13:06.781 INFO:teuthology.orchestra.run.smithi110.stdout:/ 2023-10-14T11:13:06.781 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/security 2023-10-14T11:13:06.781 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/shm 2023-10-14T11:13:06.781 INFO:teuthology.orchestra.run.smithi110.stdout:/run/lock 2023-10-14T11:13:06.782 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/cgroup 2023-10-14T11:13:06.782 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/pstore 2023-10-14T11:13:06.782 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/bpf 2023-10-14T11:13:06.782 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:13:06.782 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/hugepages 2023-10-14T11:13:06.783 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/mqueue 2023-10-14T11:13:06.783 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/debug 2023-10-14T11:13:06.783 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/tracing 2023-10-14T11:13:06.783 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/fs/nfsd 2023-10-14T11:13:06.783 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/fuse/connections 2023-10-14T11:13:06.783 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/config 2023-10-14T11:13:06.784 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:13:06.784 INFO:teuthology.orchestra.run.smithi110.stdout:/run/rpc_pipefs 2023-10-14T11:13:06.784 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/1000 2023-10-14T11:13:06.784 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph 2023-10-14T11:13:06.784 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-4 2023-10-14T11:13:06.785 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-5 2023-10-14T11:13:06.785 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-6 2023-10-14T11:13:06.785 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-7 2023-10-14T11:13:06.785 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns 2023-10-14T11:13:06.785 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T11:13:06.786 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T11:13:06.786 INFO:teuthology.orchestra.run.smithi110.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-14T11:13:06.786 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T11:13:06.786 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T11:13:06.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:06.787 DEBUG:teuthology.orchestra.run.smithi110:> ls /sys/fs/fuse/connections 2023-10-14T11:13:06.801 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi110.stderr:2023-10-14T11:13:06.796+0000 7ffa2a42b580 -1 init, newargv = 0x5622acbdfc90 newargc=15 2023-10-14T11:13:06.801 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi110.stderr:ceph-fuse[42787]: starting ceph client 2023-10-14T11:13:06.808 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi110.stderr:ceph-fuse[42787]: starting fuse 2023-10-14T11:13:06.810 INFO:teuthology.orchestra.run.smithi110.stdout:43 2023-10-14T11:13:06.810 INFO:teuthology.orchestra.run.smithi110.stdout:44 2023-10-14T11:13:06.810 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-10-14T11:13:06.810 DEBUG:teuthology.orchestra.run.smithi110:> sudo stdin-killer -- python3 -c ' 2023-10-14T11:13:06.811 DEBUG:teuthology.orchestra.run.smithi110:> import glob 2023-10-14T11:13:06.811 DEBUG:teuthology.orchestra.run.smithi110:> import re 2023-10-14T11:13:06.812 DEBUG:teuthology.orchestra.run.smithi110:> import os 2023-10-14T11:13:06.812 DEBUG:teuthology.orchestra.run.smithi110:> import subprocess 2023-10-14T11:13:06.812 DEBUG:teuthology.orchestra.run.smithi110:> 2023-10-14T11:13:06.812 DEBUG:teuthology.orchestra.run.smithi110:> def _find_admin_socket(client_name): 2023-10-14T11:13:06.813 DEBUG:teuthology.orchestra.run.smithi110:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-10-14T11:13:06.813 DEBUG:teuthology.orchestra.run.smithi110:> files = glob.glob(asok_path) 2023-10-14T11:13:06.813 DEBUG:teuthology.orchestra.run.smithi110:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-10-14T11:13:06.814 DEBUG:teuthology.orchestra.run.smithi110:> 2023-10-14T11:13:06.814 DEBUG:teuthology.orchestra.run.smithi110:> # Given a non-glob path, it better be there 2023-10-14T11:13:06.814 DEBUG:teuthology.orchestra.run.smithi110:> if "*" not in asok_path: 2023-10-14T11:13:06.814 DEBUG:teuthology.orchestra.run.smithi110:> assert(len(files) == 1) 2023-10-14T11:13:06.815 DEBUG:teuthology.orchestra.run.smithi110:> return files[0] 2023-10-14T11:13:06.815 DEBUG:teuthology.orchestra.run.smithi110:> 2023-10-14T11:13:06.815 DEBUG:teuthology.orchestra.run.smithi110:> for f in files: 2023-10-14T11:13:06.816 DEBUG:teuthology.orchestra.run.smithi110:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-14T11:13:06.816 DEBUG:teuthology.orchestra.run.smithi110:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-14T11:13:06.816 DEBUG:teuthology.orchestra.run.smithi110:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-14T11:13:06.816 DEBUG:teuthology.orchestra.run.smithi110:> contents = proc_f.read() 2023-10-14T11:13:06.817 DEBUG:teuthology.orchestra.run.smithi110:> if mountpoint in contents: 2023-10-14T11:13:06.817 DEBUG:teuthology.orchestra.run.smithi110:> return f 2023-10-14T11:13:06.817 DEBUG:teuthology.orchestra.run.smithi110:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-14T11:13:06.817 DEBUG:teuthology.orchestra.run.smithi110:> 2023-10-14T11:13:06.818 DEBUG:teuthology.orchestra.run.smithi110:> print(_find_admin_socket("client.3")) 2023-10-14T11:13:06.818 DEBUG:teuthology.orchestra.run.smithi110:> ' 2023-10-14T11:13:06.937 INFO:teuthology.orchestra.run.smithi110.stdout:/var/run/ceph/ceph-client.3.42787.asok 2023-10-14T11:13:06.939 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-14T11:13:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-14T11:13:06.947 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.42787.asok 2023-10-14T11:13:06.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:06.948 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.42787.asok status 2023-10-14T11:13:07.120 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2023-10-14T11:13:07.121 INFO:teuthology.orchestra.run.smithi110.stdout: "metadata": { 2023-10-14T11:13:07.121 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-14T11:13:07.121 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T11:13:07.122 INFO:teuthology.orchestra.run.smithi110.stdout: "entity_id": "3", 2023-10-14T11:13:07.122 INFO:teuthology.orchestra.run.smithi110.stdout: "hostname": "smithi110", 2023-10-14T11:13:07.122 INFO:teuthology.orchestra.run.smithi110.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-10-14T11:13:07.123 INFO:teuthology.orchestra.run.smithi110.stdout: "pid": "42787", 2023-10-14T11:13:07.123 INFO:teuthology.orchestra.run.smithi110.stdout: "root": "/" 2023-10-14T11:13:07.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2023-10-14T11:13:07.123 INFO:teuthology.orchestra.run.smithi110.stdout: "dentry_count": 0, 2023-10-14T11:13:07.124 INFO:teuthology.orchestra.run.smithi110.stdout: "dentry_pinned_count": 0, 2023-10-14T11:13:07.125 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 4637, 2023-10-14T11:13:07.125 INFO:teuthology.orchestra.run.smithi110.stdout: "inst": { 2023-10-14T11:13:07.125 INFO:teuthology.orchestra.run.smithi110.stdout: "name": { 2023-10-14T11:13:07.126 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "client", 2023-10-14T11:13:07.126 INFO:teuthology.orchestra.run.smithi110.stdout: "num": 4637 2023-10-14T11:13:07.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2023-10-14T11:13:07.127 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": { 2023-10-14T11:13:07.127 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "v1", 2023-10-14T11:13:07.127 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": "192.168.0.2:0", 2023-10-14T11:13:07.128 INFO:teuthology.orchestra.run.smithi110.stdout: "nonce": 1440362047 2023-10-14T11:13:07.128 INFO:teuthology.orchestra.run.smithi110.stdout: } 2023-10-14T11:13:07.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2023-10-14T11:13:07.129 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": { 2023-10-14T11:13:07.129 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "v1", 2023-10-14T11:13:07.130 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": "192.168.0.2:0", 2023-10-14T11:13:07.130 INFO:teuthology.orchestra.run.smithi110.stdout: "nonce": 1440362047 2023-10-14T11:13:07.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2023-10-14T11:13:07.131 INFO:teuthology.orchestra.run.smithi110.stdout: "inst_str": "client.4637 192.168.0.2:0/1440362047", 2023-10-14T11:13:07.131 INFO:teuthology.orchestra.run.smithi110.stdout: "addr_str": "192.168.0.2:0/1440362047", 2023-10-14T11:13:07.132 INFO:teuthology.orchestra.run.smithi110.stdout: "inode_count": 1, 2023-10-14T11:13:07.132 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_epoch": 9, 2023-10-14T11:13:07.132 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_epoch": 27, 2023-10-14T11:13:07.133 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_epoch_barrier": 0, 2023-10-14T11:13:07.133 INFO:teuthology.orchestra.run.smithi110.stdout: "blocklisted": false, 2023-10-14T11:13:07.133 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs" 2023-10-14T11:13:07.134 INFO:teuthology.orchestra.run.smithi110.stdout:} 2023-10-14T11:13:07.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:07.137 DEBUG:teuthology.orchestra.run.smithi026:> stat --file-system '--printf=%T 2023-10-14T11:13:07.137 DEBUG:teuthology.orchestra.run.smithi026:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-14T11:13:07.149 INFO:teuthology.orchestra.run.smithi026.stdout:fuseblk 2023-10-14T11:13:07.149 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-14T11:13:07.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:07.150 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T11:13:07.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:07.217 DEBUG:teuthology.orchestra.run.smithi026:> stat --file-system '--printf=%T 2023-10-14T11:13:07.217 DEBUG:teuthology.orchestra.run.smithi026:> ' -- /home/ubuntu/cephtest/mnt.2 2023-10-14T11:13:07.277 INFO:teuthology.orchestra.run.smithi026.stdout:fuseblk 2023-10-14T11:13:07.278 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-10-14T11:13:07.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:07.279 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-14T11:13:07.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:07.349 DEBUG:teuthology.orchestra.run.smithi110:> stat --file-system '--printf=%T 2023-10-14T11:13:07.349 DEBUG:teuthology.orchestra.run.smithi110:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-14T11:13:07.359 INFO:teuthology.orchestra.run.smithi110.stdout:fuseblk 2023-10-14T11:13:07.359 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-14T11:13:07.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:07.360 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T11:13:07.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:07.423 DEBUG:teuthology.orchestra.run.smithi110:> stat --file-system '--printf=%T 2023-10-14T11:13:07.423 DEBUG:teuthology.orchestra.run.smithi110:> ' -- /home/ubuntu/cephtest/mnt.3 2023-10-14T11:13:07.475 INFO:teuthology.orchestra.run.smithi110.stdout:fuseblk 2023-10-14T11:13:07.475 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-10-14T11:13:07.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:07.476 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-14T11:13:07.539 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-14T11:13:07.556 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:13:07.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.707+0000 7f4a5bff8640 1 Processor -- start 2023-10-14T11:13:07.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.707+0000 7f4a5bff8640 1 -- start start 2023-10-14T11:13:07.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.707+0000 7f4a5bff8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a540d15d0 0x7f4a540cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:07.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.707+0000 7f4a5bff8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a540ce770 con 0x7f4a5415cb90 2023-10-14T11:13:07.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.707+0000 7f4a5bff8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a540d0600 con 0x7f4a540d3010 2023-10-14T11:13:07.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.707+0000 7f4a5bff8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a540c6450 con 0x7f4a540d15d0 2023-10-14T11:13:07.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.707+0000 7f4a59d94640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4a5415cb90 0x7f4a540d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53074/0 (socket says 172.21.15.26:53074) 2023-10-14T11:13:07.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.707+0000 7f4a59d94640 1 -- 172.21.15.26:0/755125668 learned_addr learned my addr 172.21.15.26:0/755125668 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:07.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.707+0000 7f4a59593640 1 --2- 172.21.15.26:0/755125668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a540d15d0 0x7f4a540cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:07.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.707+0000 7f4a58d92640 1 -- 172.21.15.26:0/755125668 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858570623 0 0) 0x7f4a540ce770 con 0x7f4a5415cb90 2023-10-14T11:13:07.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.707+0000 7f4a58d92640 1 -- 172.21.15.26:0/755125668 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a40003530 con 0x7f4a5415cb90 2023-10-14T11:13:07.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.707+0000 7f4a58d92640 1 -- 172.21.15.26:0/755125668 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203973617 0 0) 0x7f4a540d0600 con 0x7f4a540d3010 2023-10-14T11:13:07.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.707+0000 7f4a58d92640 1 -- 172.21.15.26:0/755125668 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a540ce770 con 0x7f4a540d3010 2023-10-14T11:13:07.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.707+0000 7f4a58d92640 1 -- 172.21.15.26:0/755125668 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2110067887 0 0) 0x7f4a40003530 con 0x7f4a5415cb90 2023-10-14T11:13:07.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.707+0000 7f4a58d92640 1 -- 172.21.15.26:0/755125668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a540d15d0 msgr2=0x7f4a540cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:07.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.707+0000 7f4a58d92640 1 --2- 172.21.15.26:0/755125668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a540d15d0 0x7f4a540cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:07.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.707+0000 7f4a58d92640 1 -- 172.21.15.26:0/755125668 >> v1:172.21.15.110:6789/0 conn(0x7f4a540d3010 legacy=0x7f4a540c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:07.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.707+0000 7f4a58d92640 1 -- 172.21.15.26:0/755125668 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a540d08a0 con 0x7f4a5415cb90 2023-10-14T11:13:07.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.707+0000 7f4a58d92640 1 -- 172.21.15.26:0/755125668 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f4a50001800 con 0x7f4a5415cb90 2023-10-14T11:13:07.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.707+0000 7f4a58d92640 1 -- 172.21.15.26:0/755125668 >> v1:172.21.15.26:6789/0 conn(0x7f4a5415cb90 legacy=0x7f4a540d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:07.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.711+0000 7f4a58d92640 1 --2- 172.21.15.26:0/755125668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a40003b40 0x7f4a40003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:07.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.711+0000 7f4a58d92640 1 --2- 172.21.15.26:0/755125668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a400047d0 0x7f4a40004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:07.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.711+0000 7f4a58d92640 1 --2- 172.21.15.26:0/755125668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a40005190 0x7f4a4000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:07.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.711+0000 7f4a58d92640 1 -- 172.21.15.26:0/755125668 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a540c6450 con 0x7f4a40005190 2023-10-14T11:13:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.711+0000 7f4a58d92640 1 -- 172.21.15.26:0/755125668 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4000c000 con 0x7f4a400047d0 2023-10-14T11:13:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.711+0000 7f4a58d92640 1 -- 172.21.15.26:0/755125668 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4000c1c0 con 0x7f4a40003b40 2023-10-14T11:13:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.711+0000 7f4a59593640 1 --2- 172.21.15.26:0/755125668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a540d15d0 0x7f4a540cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:13:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.711+0000 7f4a5a595640 1 --2- 172.21.15.26:0/755125668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a40005190 0x7f4a4000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.711+0000 7f4a59d94640 1 --2- 172.21.15.26:0/755125668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a40003b40 0x7f4a40003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:07.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.711+0000 7f4a59593640 1 --2- 172.21.15.26:0/755125668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a400047d0 0x7f4a40004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:07.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.711+0000 7f4a5a595640 1 -- 172.21.15.26:0/755125668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a40003b40 msgr2=0x7f4a40003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:07.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.711+0000 7f4a5a595640 1 --2- 172.21.15.26:0/755125668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a40003b40 0x7f4a40003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:07.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.711+0000 7f4a5a595640 1 -- 172.21.15.26:0/755125668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a400047d0 msgr2=0x7f4a40004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:07.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.711+0000 7f4a5a595640 1 --2- 172.21.15.26:0/755125668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a400047d0 0x7f4a40004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:07.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.711+0000 7f4a5a595640 1 -- 172.21.15.26:0/755125668 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a40003530 con 0x7f4a40005190 2023-10-14T11:13:07.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.711+0000 7f4a5a595640 1 --2- 172.21.15.26:0/755125668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a40005190 0x7f4a4000b990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4a540d34c0 tx=0x7f4a4c01f030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc2a58428f9c9c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:07.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.711+0000 7f4a58d92640 1 -- 172.21.15.26:0/755125668 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c0a8c50 con 0x7f4a40005190 2023-10-14T11:13:07.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.711+0000 7f4a58d92640 1 -- 172.21.15.26:0/755125668 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4c0a8dd0 con 0x7f4a40005190 2023-10-14T11:13:07.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.711+0000 7f4a58d92640 1 -- 172.21.15.26:0/755125668 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c003bc0 con 0x7f4a40005190 2023-10-14T11:13:07.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.715+0000 7f4a5bff8640 1 -- 172.21.15.26:0/755125668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a40005190 msgr2=0x7f4a4000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:07.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.715+0000 7f4a5bff8640 1 --2- 172.21.15.26:0/755125668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a40005190 0x7f4a4000b990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4a540d34c0 tx=0x7f4a4c01f030 comp rx=0 tx=0).stop 2023-10-14T11:13:07.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.715+0000 7f4a5a595640 1 -- 172.21.15.26:0/755125668 reap_dead start 2023-10-14T11:13:07.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.715+0000 7f4a5bff8640 1 -- 172.21.15.26:0/755125668 shutdown_connections 2023-10-14T11:13:07.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.715+0000 7f4a5bff8640 1 -- 172.21.15.26:0/755125668 >> 172.21.15.26:0/755125668 conn(0x7f4a5409bc50 msgr2=0x7f4a540d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:07.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.715+0000 7f4a5bff8640 1 -- 172.21.15.26:0/755125668 shutdown_connections 2023-10-14T11:13:07.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.715+0000 7f4a5bff8640 1 -- 172.21.15.26:0/755125668 wait complete. 2023-10-14T11:13:07.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.715+0000 7f4a5bff8640 1 Processor -- start 2023-10-14T11:13:07.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.715+0000 7f4a5bff8640 1 -- start start 2023-10-14T11:13:07.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.715+0000 7f4a5bff8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a541f1470 0x7f4a541f5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:07.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.715+0000 7f4a5bff8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a541575b0 0x7f4a540cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:07.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.715+0000 7f4a5bff8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a540cc6d0 0x7f4a541544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:07.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.715+0000 7f4a5bff8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a541f60f0 con 0x7f4a541f1470 2023-10-14T11:13:07.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.715+0000 7f4a5bff8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a540ccb50 con 0x7f4a540cc6d0 2023-10-14T11:13:07.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.715+0000 7f4a5bff8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a54158910 con 0x7f4a541575b0 2023-10-14T11:13:07.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.715+0000 7f4a59d94640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a541f1470 0x7f4a541f5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:07.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.715+0000 7f4a59d94640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a541f1470 0x7f4a541f5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49188/0 (socket says 172.21.15.26:49188) 2023-10-14T11:13:07.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.715+0000 7f4a59d94640 1 -- 172.21.15.26:0/189848690 learned_addr learned my addr 172.21.15.26:0/189848690 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:07.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.715+0000 7f4a5a595640 1 --2- 172.21.15.26:0/189848690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a540cc6d0 0x7f4a541544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:07.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.715+0000 7f4a59593640 1 --2- 172.21.15.26:0/189848690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a541575b0 0x7f4a540cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:07.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.719+0000 7f4a59d94640 1 -- 172.21.15.26:0/189848690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a541575b0 msgr2=0x7f4a540cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:07.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.719+0000 7f4a59d94640 1 --2- 172.21.15.26:0/189848690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a541575b0 0x7f4a540cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:07.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.719+0000 7f4a59d94640 1 -- 172.21.15.26:0/189848690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a540cc6d0 msgr2=0x7f4a541544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:07.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.719+0000 7f4a59d94640 1 --2- 172.21.15.26:0/189848690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a540cc6d0 0x7f4a541544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:07.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.719+0000 7f4a59d94640 1 -- 172.21.15.26:0/189848690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a54157d00 con 0x7f4a541f1470 2023-10-14T11:13:07.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.719+0000 7f4a59d94640 1 --2- 172.21.15.26:0/189848690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a541f1470 0x7f4a541f5bb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000f890 tx=0x7f4a5000fd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:07.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.719+0000 7f4a4a7fc640 1 -- 172.21.15.26:0/189848690 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500072e0 con 0x7f4a541f1470 2023-10-14T11:13:07.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.719+0000 7f4a4a7fc640 1 -- 172.21.15.26:0/189848690 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50007460 con 0x7f4a541f1470 2023-10-14T11:13:07.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.719+0000 7f4a4a7fc640 1 -- 172.21.15.26:0/189848690 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500057b0 con 0x7f4a541f1470 2023-10-14T11:13:07.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.719+0000 7f4a5bff8640 1 -- 172.21.15.26:0/189848690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a54157fe0 con 0x7f4a541f1470 2023-10-14T11:13:07.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.719+0000 7f4a5bff8640 1 -- 172.21.15.26:0/189848690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a541585a0 con 0x7f4a541f1470 2023-10-14T11:13:07.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.719+0000 7f4a5bff8640 1 -- 172.21.15.26:0/189848690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a54158730 con 0x7f4a541f1470 2023-10-14T11:13:07.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.719+0000 7f4a4a7fc640 1 -- 172.21.15.26:0/189848690 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4a50005910 con 0x7f4a541f1470 2023-10-14T11:13:07.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.719+0000 7f4a4a7fc640 1 --2- 172.21.15.26:0/189848690 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4a38066520 0x7f4a380689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:07.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.719+0000 7f4a4a7fc640 1 -- 172.21.15.26:0/189848690 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4a50084280 con 0x7f4a541f1470 2023-10-14T11:13:07.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.719+0000 7f4a59593640 1 --2- 172.21.15.26:0/189848690 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4a38066520 0x7f4a380689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:07.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.723+0000 7f4a59593640 1 --2- 172.21.15.26:0/189848690 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4a38066520 0x7f4a380689e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4a540d2cc0 tx=0x7f4a44009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:07.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.723+0000 7f4a4a7fc640 1 -- 172.21.15.26:0/189848690 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4a50051490 con 0x7f4a541f1470 2023-10-14T11:13:07.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.883+0000 7f4a5bff8640 1 -- 172.21.15.26:0/189848690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a54074010 con 0x7f4a541f1470 2023-10-14T11:13:07.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.887+0000 7f4a4a7fc640 1 -- 172.21.15.26:0/189848690 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18679 (secure 0 0 0) 0x7f4a50054ab0 con 0x7f4a541f1470 2023-10-14T11:13:07.890 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:07.891 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":27,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:13:03.866737+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:13:07.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.887+0000 7f4a5bff8640 1 -- 172.21.15.26:0/189848690 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4a38066520 msgr2=0x7f4a380689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:07.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.887+0000 7f4a5bff8640 1 --2- 172.21.15.26:0/189848690 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4a38066520 0x7f4a380689e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4a540d2cc0 tx=0x7f4a44009190 comp rx=0 tx=0).stop 2023-10-14T11:13:07.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.887+0000 7f4a5bff8640 1 -- 172.21.15.26:0/189848690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a541f1470 msgr2=0x7f4a541f5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:07.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.887+0000 7f4a5bff8640 1 --2- 172.21.15.26:0/189848690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a541f1470 0x7f4a541f5bb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000f890 tx=0x7f4a5000fd50 comp rx=0 tx=0).stop 2023-10-14T11:13:07.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.887+0000 7f4a5bff8640 1 -- 172.21.15.26:0/189848690 shutdown_connections 2023-10-14T11:13:07.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.887+0000 7f4a5bff8640 1 --2- 172.21.15.26:0/189848690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a540cc6d0 0x7f4a541544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:07.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.887+0000 7f4a5bff8640 1 --2- 172.21.15.26:0/189848690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a541575b0 0x7f4a540cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:07.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.887+0000 7f4a5bff8640 1 --2- 172.21.15.26:0/189848690 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4a38066520 0x7f4a380689e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:07.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.887+0000 7f4a5bff8640 1 --2- 172.21.15.26:0/189848690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a541f1470 0x7f4a541f5bb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:07.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.887+0000 7f4a5bff8640 1 -- 172.21.15.26:0/189848690 >> 172.21.15.26:0/189848690 conn(0x7f4a5409bc50 msgr2=0x7f4a540c6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:07.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.887+0000 7f4a5bff8640 1 -- 172.21.15.26:0/189848690 shutdown_connections 2023-10-14T11:13:07.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:07.887+0000 7f4a5bff8640 1 -- 172.21.15.26:0/189848690 wait complete. 2023-10-14T11:13:07.912 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:12:20.179562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:12:21.346111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T11:12:25.025159+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T11:13:07.913 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:13:08.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.055+0000 7f38878ea640 1 Processor -- start 2023-10-14T11:13:08.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.055+0000 7f38878ea640 1 -- start start 2023-10-14T11:13:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.055+0000 7f38878ea640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f38800d0210 0x7f38800d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:08.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.055+0000 7f38878ea640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f38800b84e0 0x7f38800b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:08.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.055+0000 7f38878ea640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38800d1670 con 0x7f388015cba0 2023-10-14T11:13:08.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.055+0000 7f38878ea640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38800d1460 con 0x7f38800d0210 2023-10-14T11:13:08.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.055+0000 7f38878ea640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38800d1950 con 0x7f38800b84e0 2023-10-14T11:13:08.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.055+0000 7f3884e85640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f38800d0210 0x7f38800d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:08.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.055+0000 7f3884e85640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f38800d0210 0x7f38800d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49200/0 (socket says 172.21.15.26:49200) 2023-10-14T11:13:08.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.055+0000 7f3884e85640 1 -- 172.21.15.26:0/1174683622 learned_addr learned my addr 172.21.15.26:0/1174683622 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:08.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.055+0000 7f3885e87640 1 --2- 172.21.15.26:0/1174683622 >> v2:172.21.15.110:3300/0 conn(0x7f38800b84e0 0x7f38800b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:08.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.055+0000 7f3884e85640 1 -- 172.21.15.26:0/1174683622 >> v2:172.21.15.110:3300/0 conn(0x7f38800b84e0 msgr2=0x7f38800b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:08.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.055+0000 7f3884e85640 1 --2- 172.21.15.26:0/1174683622 >> v2:172.21.15.110:3300/0 conn(0x7f38800b84e0 0x7f38800b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.055+0000 7f3884e85640 1 -- 172.21.15.26:0/1174683622 >> v1:172.21.15.110:6789/0 conn(0x7f388015cba0 legacy=0x7f38800cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:08.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.055+0000 7f3884e85640 1 -- 172.21.15.26:0/1174683622 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38800d1c30 con 0x7f38800d0210 2023-10-14T11:13:08.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.059+0000 7f3884e85640 1 --2- 172.21.15.26:0/1174683622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38800d0210 0x7f38800d0f20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f38800ce450 tx=0x7f387001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377b56ffa72ce236 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:08.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.059+0000 7f3877fff640 1 -- 172.21.15.26:0/1174683622 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38700ab670 con 0x7f38800d0210 2023-10-14T11:13:08.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.059+0000 7f3877fff640 1 -- 172.21.15.26:0/1174683622 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38700ab7d0 con 0x7f38800d0210 2023-10-14T11:13:08.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.059+0000 7f3877fff640 1 -- 172.21.15.26:0/1174683622 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38700abb60 con 0x7f38800d0210 2023-10-14T11:13:08.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.059+0000 7f38878ea640 1 -- 172.21.15.26:0/1174683622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38800d0210 msgr2=0x7f38800d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:08.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.059+0000 7f38878ea640 1 --2- 172.21.15.26:0/1174683622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38800d0210 0x7f38800d0f20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f38800ce450 tx=0x7f387001c470 comp rx=0 tx=0).stop 2023-10-14T11:13:08.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.059+0000 7f38878ea640 1 -- 172.21.15.26:0/1174683622 shutdown_connections 2023-10-14T11:13:08.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.059+0000 7f38878ea640 1 --2- 172.21.15.26:0/1174683622 >> v2:172.21.15.110:3300/0 conn(0x7f38800b84e0 0x7f38800b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.059+0000 7f38878ea640 1 --2- 172.21.15.26:0/1174683622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38800d0210 0x7f38800d0f20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.059+0000 7f38878ea640 1 -- 172.21.15.26:0/1174683622 >> 172.21.15.26:0/1174683622 conn(0x7f38800719c0 msgr2=0x7f3880071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:08.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.059+0000 7f38878ea640 1 -- 172.21.15.26:0/1174683622 shutdown_connections 2023-10-14T11:13:08.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.059+0000 7f38878ea640 1 -- 172.21.15.26:0/1174683622 wait complete. 2023-10-14T11:13:08.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f38878ea640 1 Processor -- start 2023-10-14T11:13:08.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f38878ea640 1 -- start start 2023-10-14T11:13:08.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f38878ea640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38800b84e0 0x7f3880150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:08.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f38878ea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38800d0210 0x7f3880154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:08.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f38878ea640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f388015cba0 0x7f3880154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:08.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f38878ea640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3880157c30 con 0x7f38800d0210 2023-10-14T11:13:08.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f38878ea640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3880157f10 con 0x7f388015cba0 2023-10-14T11:13:08.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f38878ea640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38801581f0 con 0x7f38800b84e0 2023-10-14T11:13:08.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f3884e85640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38800d0210 0x7f3880154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:08.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f3884e85640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38800d0210 0x7f3880154050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49206/0 (socket says 172.21.15.26:49206) 2023-10-14T11:13:08.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f3884e85640 1 -- 172.21.15.26:0/1933834820 learned_addr learned my addr 172.21.15.26:0/1933834820 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:08.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f3885686640 1 --2- 172.21.15.26:0/1933834820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38800b84e0 0x7f3880150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:08.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f3885e87640 1 --2- 172.21.15.26:0/1933834820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f388015cba0 0x7f3880154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:08.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f3884e85640 1 -- 172.21.15.26:0/1933834820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38800b84e0 msgr2=0x7f3880150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:08.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f3884e85640 1 --2- 172.21.15.26:0/1933834820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38800b84e0 0x7f3880150340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f3884e85640 1 -- 172.21.15.26:0/1933834820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f388015cba0 msgr2=0x7f3880154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:08.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f3884e85640 1 --2- 172.21.15.26:0/1933834820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f388015cba0 0x7f3880154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f3884e85640 1 -- 172.21.15.26:0/1933834820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38700094d0 con 0x7f38800d0210 2023-10-14T11:13:08.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f3884e85640 1 --2- 172.21.15.26:0/1933834820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38800d0210 0x7f3880154050 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3870019080 tx=0x7f387001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:08.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f3875ffb640 1 -- 172.21.15.26:0/1933834820 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38700b4800 con 0x7f38800d0210 2023-10-14T11:13:08.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f3875ffb640 1 -- 172.21.15.26:0/1933834820 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38700b4960 con 0x7f38800d0210 2023-10-14T11:13:08.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f38878ea640 1 -- 172.21.15.26:0/1933834820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38801584d0 con 0x7f38800d0210 2023-10-14T11:13:08.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f3875ffb640 1 -- 172.21.15.26:0/1933834820 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38700b4cf0 con 0x7f38800d0210 2023-10-14T11:13:08.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.063+0000 7f38878ea640 1 -- 172.21.15.26:0/1933834820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38800c9db0 con 0x7f38800d0210 2023-10-14T11:13:08.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.067+0000 7f38878ea640 1 -- 172.21.15.26:0/1933834820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f388004e170 con 0x7f38800d0210 2023-10-14T11:13:08.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.067+0000 7f3875ffb640 1 -- 172.21.15.26:0/1933834820 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f38700c7390 con 0x7f38800d0210 2023-10-14T11:13:08.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.067+0000 7f3875ffb640 1 --2- 172.21.15.26:0/1933834820 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f38640664d0 0x7f3864068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:08.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.067+0000 7f3875ffb640 1 -- 172.21.15.26:0/1933834820 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f387011ed10 con 0x7f38800d0210 2023-10-14T11:13:08.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.067+0000 7f3885686640 1 --2- 172.21.15.26:0/1933834820 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f38640664d0 0x7f3864068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:08.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.067+0000 7f3885686640 1 --2- 172.21.15.26:0/1933834820 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f38640664d0 0x7f3864068990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f387c007fd0 tx=0x7f387c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:08.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.071+0000 7f3875ffb640 1 -- 172.21.15.26:0/1933834820 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f38700ebf00 con 0x7f38800d0210 2023-10-14T11:13:08.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.231+0000 7f38878ea640 1 -- 172.21.15.26:0/1933834820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3880158980 con 0x7f38800d0210 2023-10-14T11:13:08.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.231+0000 7f3875ffb640 1 -- 172.21.15.26:0/1933834820 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f38700ef520 con 0x7f38800d0210 2023-10-14T11:13:08.237 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:13:08.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.235+0000 7f38878ea640 1 -- 172.21.15.26:0/1933834820 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f38640664d0 msgr2=0x7f3864068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:08.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.235+0000 7f38878ea640 1 --2- 172.21.15.26:0/1933834820 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f38640664d0 0x7f3864068990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f387c007fd0 tx=0x7f387c009040 comp rx=0 tx=0).stop 2023-10-14T11:13:08.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.235+0000 7f38878ea640 1 -- 172.21.15.26:0/1933834820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38800d0210 msgr2=0x7f3880154050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:08.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.235+0000 7f38878ea640 1 --2- 172.21.15.26:0/1933834820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38800d0210 0x7f3880154050 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3870019080 tx=0x7f387001acb0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.235+0000 7f38878ea640 1 -- 172.21.15.26:0/1933834820 shutdown_connections 2023-10-14T11:13:08.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.235+0000 7f38878ea640 1 --2- 172.21.15.26:0/1933834820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f388015cba0 0x7f3880154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.235+0000 7f38878ea640 1 --2- 172.21.15.26:0/1933834820 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f38640664d0 0x7f3864068990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.235+0000 7f38878ea640 1 --2- 172.21.15.26:0/1933834820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38800d0210 0x7f3880154050 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.235+0000 7f38878ea640 1 --2- 172.21.15.26:0/1933834820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38800b84e0 0x7f3880150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.235+0000 7f38878ea640 1 -- 172.21.15.26:0/1933834820 >> 172.21.15.26:0/1933834820 conn(0x7f38800719c0 msgr2=0x7f38800b7890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:08.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.235+0000 7f38878ea640 1 -- 172.21.15.26:0/1933834820 shutdown_connections 2023-10-14T11:13:08.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.235+0000 7f38878ea640 1 -- 172.21.15.26:0/1933834820 wait complete. 2023-10-14T11:13:08.258 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:13:08.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.399+0000 7fecb9a09640 1 Processor -- start 2023-10-14T11:13:08.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.399+0000 7fecb9a09640 1 -- start start 2023-10-14T11:13:08.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.403+0000 7fecb9a09640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fecb415cba0 0x7fecb40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:08.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.403+0000 7fecb9a09640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecb40d0210 0x7fecb40b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:08.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.403+0000 7fecb9a09640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb40d1670 con 0x7fecb40b84e0 2023-10-14T11:13:08.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.403+0000 7fecb9a09640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb40d1460 con 0x7fecb415cba0 2023-10-14T11:13:08.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.403+0000 7fecb9a09640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40d1950 con 0x7fecb40d0210 2023-10-14T11:13:08.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.403+0000 7fecb2ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fecb415cba0 0x7fecb40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:08.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.403+0000 7fecb2ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fecb415cba0 0x7fecb40d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49212/0 (socket says 172.21.15.26:49212) 2023-10-14T11:13:08.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.403+0000 7fecb2ffd640 1 -- 172.21.15.26:0/172521977 learned_addr learned my addr 172.21.15.26:0/172521977 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:08.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.403+0000 7fecb37fe640 1 --2- 172.21.15.26:0/172521977 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecb40d0210 0x7fecb40b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:08.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.403+0000 7fecb2ffd640 1 -- 172.21.15.26:0/172521977 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecb40d0210 msgr2=0x7fecb40b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:08.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.403+0000 7fecb2ffd640 1 --2- 172.21.15.26:0/172521977 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecb40d0210 0x7fecb40b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.403+0000 7fecb2ffd640 1 -- 172.21.15.26:0/172521977 >> v1:172.21.15.26:6789/0 conn(0x7fecb40b84e0 legacy=0x7fecb40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:08.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.403+0000 7fecb2ffd640 1 -- 172.21.15.26:0/172521977 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb40d1c30 con 0x7fecb415cba0 2023-10-14T11:13:08.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.403+0000 7fecb2ffd640 1 --2- 172.21.15.26:0/172521977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecb415cba0 0x7fecb40d0f20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7feca4009870 tx=0x7feca401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f988f82b389e6ee server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:08.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.403+0000 7fecb27fc640 1 -- 172.21.15.26:0/172521977 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca40a9400 con 0x7fecb415cba0 2023-10-14T11:13:08.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.403+0000 7fecb27fc640 1 -- 172.21.15.26:0/172521977 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca40a9560 con 0x7fecb415cba0 2023-10-14T11:13:08.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.403+0000 7fecb27fc640 1 -- 172.21.15.26:0/172521977 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca40a98f0 con 0x7fecb415cba0 2023-10-14T11:13:08.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.407+0000 7fecb9a09640 1 -- 172.21.15.26:0/172521977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecb415cba0 msgr2=0x7fecb40d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:08.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.407+0000 7fecb9a09640 1 --2- 172.21.15.26:0/172521977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecb415cba0 0x7fecb40d0f20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7feca4009870 tx=0x7feca401c540 comp rx=0 tx=0).stop 2023-10-14T11:13:08.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.407+0000 7fecb9a09640 1 -- 172.21.15.26:0/172521977 shutdown_connections 2023-10-14T11:13:08.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.407+0000 7fecb9a09640 1 --2- 172.21.15.26:0/172521977 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecb40d0210 0x7fecb40b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.407+0000 7fecb9a09640 1 --2- 172.21.15.26:0/172521977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecb415cba0 0x7fecb40d0f20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.407+0000 7fecb9a09640 1 -- 172.21.15.26:0/172521977 >> 172.21.15.26:0/172521977 conn(0x7fecb40719c0 msgr2=0x7fecb4071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:08.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.407+0000 7fecb9a09640 1 -- 172.21.15.26:0/172521977 shutdown_connections 2023-10-14T11:13:08.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.407+0000 7fecb9a09640 1 -- 172.21.15.26:0/172521977 wait complete. 2023-10-14T11:13:08.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.407+0000 7fecb9a09640 1 Processor -- start 2023-10-14T11:13:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.407+0000 7fecb9a09640 1 -- start start 2023-10-14T11:13:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.407+0000 7fecb9a09640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecb40b84e0 0x7fecb40c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.407+0000 7fecb9a09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecb40d0210 0x7fecb415ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.407+0000 7fecb9a09640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecb415cba0 0x7fecb415d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:08.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.407+0000 7fecb9a09640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb414aad0 con 0x7fecb40d0210 2023-10-14T11:13:08.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.407+0000 7fecb9a09640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb415e830 con 0x7fecb40b84e0 2023-10-14T11:13:08.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.407+0000 7fecb9a09640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb415dc20 con 0x7fecb415cba0 2023-10-14T11:13:08.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.407+0000 7fecabfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecb40d0210 0x7fecb415ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:08.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.407+0000 7fecabfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecb40d0210 0x7fecb415ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49222/0 (socket says 172.21.15.26:49222) 2023-10-14T11:13:08.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.407+0000 7fecabfff640 1 -- 172.21.15.26:0/3185098743 learned_addr learned my addr 172.21.15.26:0/3185098743 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:08.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.407+0000 7fecb2ffd640 1 --2- 172.21.15.26:0/3185098743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecb40b84e0 0x7fecb40c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:08.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.407+0000 7fecb37fe640 1 --2- 172.21.15.26:0/3185098743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecb415cba0 0x7fecb415d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:08.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.411+0000 7fecabfff640 1 -- 172.21.15.26:0/3185098743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecb415cba0 msgr2=0x7fecb415d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:08.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.411+0000 7fecabfff640 1 --2- 172.21.15.26:0/3185098743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecb415cba0 0x7fecb415d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.411+0000 7fecabfff640 1 -- 172.21.15.26:0/3185098743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecb40b84e0 msgr2=0x7fecb40c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.411+0000 7fecabfff640 1 --2- 172.21.15.26:0/3185098743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecb40b84e0 0x7fecb40c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.411+0000 7fecabfff640 1 -- 172.21.15.26:0/3185098743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca40094d0 con 0x7fecb40d0210 2023-10-14T11:13:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.411+0000 7fecb37fe640 1 --2- 172.21.15.26:0/3185098743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecb415cba0 0x7fecb415d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.411+0000 7fecabfff640 1 --2- 172.21.15.26:0/3185098743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecb40d0210 0x7fecb415ecc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00c3c0 tx=0x7fec9c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.411+0000 7fecb0ff9640 1 -- 172.21.15.26:0/3185098743 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c0052d0 con 0x7fecb40d0210 2023-10-14T11:13:08.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.411+0000 7fecb0ff9640 1 -- 172.21.15.26:0/3185098743 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c005430 con 0x7fecb40d0210 2023-10-14T11:13:08.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.411+0000 7fecb9a09640 1 -- 172.21.15.26:0/3185098743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb415df00 con 0x7fecb40d0210 2023-10-14T11:13:08.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.411+0000 7fecb0ff9640 1 -- 172.21.15.26:0/3185098743 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c003840 con 0x7fecb40d0210 2023-10-14T11:13:08.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.411+0000 7fecb9a09640 1 -- 172.21.15.26:0/3185098743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb415e4c0 con 0x7fecb40d0210 2023-10-14T11:13:08.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.411+0000 7fecb9a09640 1 -- 172.21.15.26:0/3185098743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb415e9c0 con 0x7fecb40d0210 2023-10-14T11:13:08.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.411+0000 7fecb0ff9640 1 -- 172.21.15.26:0/3185098743 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fec9c0039a0 con 0x7fecb40d0210 2023-10-14T11:13:08.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.411+0000 7fecb0ff9640 1 --2- 172.21.15.26:0/3185098743 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fec940664a0 0x7fec94068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:08.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.415+0000 7fecb0ff9640 1 -- 172.21.15.26:0/3185098743 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fec9c0836c0 con 0x7fecb40d0210 2023-10-14T11:13:08.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.415+0000 7fecb2ffd640 1 --2- 172.21.15.26:0/3185098743 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fec940664a0 0x7fec94068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.415+0000 7fecb2ffd640 1 --2- 172.21.15.26:0/3185098743 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fec940664a0 0x7fec94068960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feca40ae000 tx=0x7feca40b3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.419+0000 7fecb0ff9640 1 -- 172.21.15.26:0/3185098743 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fec9c050820 con 0x7fecb40d0210 2023-10-14T11:13:08.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.571+0000 7fecb9a09640 1 -- 172.21.15.26:0/3185098743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fecb404e170 con 0x7fecb40d0210 2023-10-14T11:13:08.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.575+0000 7fecb0ff9640 1 -- 172.21.15.26:0/3185098743 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fec9c053e40 con 0x7fecb40d0210 2023-10-14T11:13:08.578 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:08.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.575+0000 7fecb9a09640 1 -- 172.21.15.26:0/3185098743 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fec940664a0 msgr2=0x7fec94068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:08.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.575+0000 7fecb9a09640 1 --2- 172.21.15.26:0/3185098743 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fec940664a0 0x7fec94068960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feca40ae000 tx=0x7feca40b3040 comp rx=0 tx=0).stop 2023-10-14T11:13:08.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.575+0000 7fecb9a09640 1 -- 172.21.15.26:0/3185098743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecb40d0210 msgr2=0x7fecb415ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:08.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.575+0000 7fecb9a09640 1 --2- 172.21.15.26:0/3185098743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecb40d0210 0x7fecb415ecc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00c3c0 tx=0x7fec9c00c880 comp rx=0 tx=0).stop 2023-10-14T11:13:08.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.575+0000 7fecb9a09640 1 -- 172.21.15.26:0/3185098743 shutdown_connections 2023-10-14T11:13:08.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.575+0000 7fecb9a09640 1 --2- 172.21.15.26:0/3185098743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecb415cba0 0x7fecb415d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.575+0000 7fecb9a09640 1 --2- 172.21.15.26:0/3185098743 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fec940664a0 0x7fec94068960 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.575+0000 7fecb9a09640 1 --2- 172.21.15.26:0/3185098743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecb40d0210 0x7fecb415ecc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.575+0000 7fecb9a09640 1 --2- 172.21.15.26:0/3185098743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecb40b84e0 0x7fecb40c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.575+0000 7fecb9a09640 1 -- 172.21.15.26:0/3185098743 >> 172.21.15.26:0/3185098743 conn(0x7fecb40719c0 msgr2=0x7fecb406b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.575+0000 7fecb9a09640 1 -- 172.21.15.26:0/3185098743 shutdown_connections 2023-10-14T11:13:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.575+0000 7fecb9a09640 1 -- 172.21.15.26:0/3185098743 wait complete. 2023-10-14T11:13:08.599 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:13:08.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.743+0000 7fdf8d66b640 1 Processor -- start 2023-10-14T11:13:08.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.743+0000 7fdf8d66b640 1 -- start start 2023-10-14T11:13:08.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.743+0000 7fdf8d66b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdf88161390 0x7fdf880ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:08.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.743+0000 7fdf8d66b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdf8806e2f0 0x7fdf8806e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:08.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.743+0000 7fdf8d66b640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf880cdc30 con 0x7fdf8815ce10 2023-10-14T11:13:08.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.743+0000 7fdf8d66b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf881617f0 con 0x7fdf88161390 2023-10-14T11:13:08.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.743+0000 7fdf8d66b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8806ec60 con 0x7fdf8806e2f0 2023-10-14T11:13:08.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.743+0000 7fdf7ffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdf88161390 0x7fdf880ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:08.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.743+0000 7fdf86ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdf8815ce10 0x7fdf880cd3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53080/0 (socket says 172.21.15.26:53080) 2023-10-14T11:13:08.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.743+0000 7fdf86ffd640 1 -- 172.21.15.26:0/3142423227 learned_addr learned my addr 172.21.15.26:0/3142423227 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:08.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.743+0000 7fdf877fe640 1 --2- 172.21.15.26:0/3142423227 >> v2:172.21.15.110:3300/0 conn(0x7fdf8806e2f0 0x7fdf8806e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:08.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.743+0000 7fdf7ffff640 1 -- 172.21.15.26:0/3142423227 >> v2:172.21.15.110:3300/0 conn(0x7fdf8806e2f0 msgr2=0x7fdf8806e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:08.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.743+0000 7fdf7ffff640 1 --2- 172.21.15.26:0/3142423227 >> v2:172.21.15.110:3300/0 conn(0x7fdf8806e2f0 0x7fdf8806e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.743+0000 7fdf7ffff640 1 -- 172.21.15.26:0/3142423227 >> v1:172.21.15.26:6789/0 conn(0x7fdf8815ce10 legacy=0x7fdf880cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:08.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.743+0000 7fdf867fc640 1 -- 172.21.15.26:0/3142423227 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3419439425 0 0) 0x7fdf880cdc30 con 0x7fdf8815ce10 2023-10-14T11:13:08.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.743+0000 7fdf7ffff640 1 -- 172.21.15.26:0/3142423227 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf880c9750 con 0x7fdf88161390 2023-10-14T11:13:08.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.747+0000 7fdf7ffff640 1 --2- 172.21.15.26:0/3142423227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf88161390 0x7fdf880ca7b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdf880ccbf0 tx=0x7fdf7001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ed4b59622858a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:08.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.747+0000 7fdf867fc640 1 -- 172.21.15.26:0/3142423227 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf700ab660 con 0x7fdf88161390 2023-10-14T11:13:08.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.747+0000 7fdf867fc640 1 -- 172.21.15.26:0/3142423227 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf700ab7c0 con 0x7fdf88161390 2023-10-14T11:13:08.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.747+0000 7fdf867fc640 1 -- 172.21.15.26:0/3142423227 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf700abb50 con 0x7fdf88161390 2023-10-14T11:13:08.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.747+0000 7fdf8d66b640 1 -- 172.21.15.26:0/3142423227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf88161390 msgr2=0x7fdf880ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:08.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.747+0000 7fdf8d66b640 1 --2- 172.21.15.26:0/3142423227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf88161390 0x7fdf880ca7b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdf880ccbf0 tx=0x7fdf7001c460 comp rx=0 tx=0).stop 2023-10-14T11:13:08.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.747+0000 7fdf8d66b640 1 -- 172.21.15.26:0/3142423227 shutdown_connections 2023-10-14T11:13:08.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.747+0000 7fdf8d66b640 1 --2- 172.21.15.26:0/3142423227 >> v2:172.21.15.110:3300/0 conn(0x7fdf8806e2f0 0x7fdf8806e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.747+0000 7fdf8d66b640 1 --2- 172.21.15.26:0/3142423227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf88161390 0x7fdf880ca7b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.747+0000 7fdf8d66b640 1 -- 172.21.15.26:0/3142423227 >> 172.21.15.26:0/3142423227 conn(0x7fdf880cef20 msgr2=0x7fdf880cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:08.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.747+0000 7fdf8d66b640 1 -- 172.21.15.26:0/3142423227 shutdown_connections 2023-10-14T11:13:08.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.747+0000 7fdf8d66b640 1 -- 172.21.15.26:0/3142423227 wait complete. 2023-10-14T11:13:08.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.747+0000 7fdf8d66b640 1 Processor -- start 2023-10-14T11:13:08.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.747+0000 7fdf8d66b640 1 -- start start 2023-10-14T11:13:08.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf8d66b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf8806e2f0 0x7fdf880c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:08.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf8d66b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf88161390 0x7fdf88154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:08.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf8d66b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf88155260 0x7fdf8815b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:08.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf8d66b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf880c4cc0 con 0x7fdf88155260 2023-10-14T11:13:08.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf8d66b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf880c4fa0 con 0x7fdf88161390 2023-10-14T11:13:08.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf8d66b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf880c5280 con 0x7fdf8806e2f0 2023-10-14T11:13:08.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf877fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf88155260 0x7fdf8815b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:08.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf877fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf88155260 0x7fdf8815b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49238/0 (socket says 172.21.15.26:49238) 2023-10-14T11:13:08.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf877fe640 1 -- 172.21.15.26:0/4006449565 learned_addr learned my addr 172.21.15.26:0/4006449565 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:08.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf7ffff640 1 --2- 172.21.15.26:0/4006449565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf88161390 0x7fdf88154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:08.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf86ffd640 1 --2- 172.21.15.26:0/4006449565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf8806e2f0 0x7fdf880c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:08.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf877fe640 1 -- 172.21.15.26:0/4006449565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf8806e2f0 msgr2=0x7fdf880c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:08.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf877fe640 1 --2- 172.21.15.26:0/4006449565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf8806e2f0 0x7fdf880c2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf877fe640 1 -- 172.21.15.26:0/4006449565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf88161390 msgr2=0x7fdf88154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:08.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf877fe640 1 --2- 172.21.15.26:0/4006449565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf88161390 0x7fdf88154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf877fe640 1 -- 172.21.15.26:0/4006449565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf70009420 con 0x7fdf88155260 2023-10-14T11:13:08.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf86ffd640 1 --2- 172.21.15.26:0/4006449565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf8806e2f0 0x7fdf880c2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:08.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf877fe640 1 --2- 172.21.15.26:0/4006449565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf88155260 0x7fdf8815b2b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdf80007e40 tx=0x7fdf8000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:08.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf7f7fe640 1 -- 172.21.15.26:0/4006449565 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80014620 con 0x7fdf88155260 2023-10-14T11:13:08.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf7f7fe640 1 -- 172.21.15.26:0/4006449565 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8000ee90 con 0x7fdf88155260 2023-10-14T11:13:08.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf7f7fe640 1 -- 172.21.15.26:0/4006449565 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf800149e0 con 0x7fdf88155260 2023-10-14T11:13:08.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf8d66b640 1 -- 172.21.15.26:0/4006449565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf880c5560 con 0x7fdf88155260 2023-10-14T11:13:08.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf8d66b640 1 -- 172.21.15.26:0/4006449565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf880c5d60 con 0x7fdf88155260 2023-10-14T11:13:08.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.751+0000 7fdf8d66b640 1 -- 172.21.15.26:0/4006449565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf880c5a80 con 0x7fdf88155260 2023-10-14T11:13:08.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.755+0000 7fdf7f7fe640 1 -- 172.21.15.26:0/4006449565 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdf80014b40 con 0x7fdf88155260 2023-10-14T11:13:08.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.755+0000 7fdf7f7fe640 1 --2- 172.21.15.26:0/4006449565 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdf680664a0 0x7fdf68068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:08.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.755+0000 7fdf7f7fe640 1 -- 172.21.15.26:0/4006449565 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdf80084b30 con 0x7fdf88155260 2023-10-14T11:13:08.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.755+0000 7fdf86ffd640 1 --2- 172.21.15.26:0/4006449565 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdf680664a0 0x7fdf68068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:08.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.755+0000 7fdf86ffd640 1 --2- 172.21.15.26:0/4006449565 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdf680664a0 0x7fdf68068960 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdf78007fd0 tx=0x7fdf78007c20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:08.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.759+0000 7fdf7f7fe640 1 -- 172.21.15.26:0/4006449565 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdf880c5a80 con 0x7fdf88155260 2023-10-14T11:13:08.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.915+0000 7fdf8d66b640 1 -- 172.21.15.26:0/4006449565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdf880c5a80 con 0x7fdf88155260 2023-10-14T11:13:08.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.915+0000 7fdf7f7fe640 1 -- 172.21.15.26:0/4006449565 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdf880c5a80 con 0x7fdf88155260 2023-10-14T11:13:08.921 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:13:08.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.919+0000 7fdf8d66b640 1 -- 172.21.15.26:0/4006449565 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdf680664a0 msgr2=0x7fdf68068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:08.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.919+0000 7fdf8d66b640 1 --2- 172.21.15.26:0/4006449565 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdf680664a0 0x7fdf68068960 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdf78007fd0 tx=0x7fdf78007c20 comp rx=0 tx=0).stop 2023-10-14T11:13:08.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.919+0000 7fdf8d66b640 1 -- 172.21.15.26:0/4006449565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf88155260 msgr2=0x7fdf8815b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:08.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.919+0000 7fdf8d66b640 1 --2- 172.21.15.26:0/4006449565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf88155260 0x7fdf8815b2b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdf80007e40 tx=0x7fdf8000e4b0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.919+0000 7fdf8d66b640 1 -- 172.21.15.26:0/4006449565 shutdown_connections 2023-10-14T11:13:08.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.919+0000 7fdf8d66b640 1 --2- 172.21.15.26:0/4006449565 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdf680664a0 0x7fdf68068960 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.919+0000 7fdf8d66b640 1 --2- 172.21.15.26:0/4006449565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf88155260 0x7fdf8815b2b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.919+0000 7fdf8d66b640 1 --2- 172.21.15.26:0/4006449565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf88161390 0x7fdf88154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.919+0000 7fdf8d66b640 1 --2- 172.21.15.26:0/4006449565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf8806e2f0 0x7fdf880c2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:08.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.919+0000 7fdf8d66b640 1 -- 172.21.15.26:0/4006449565 >> 172.21.15.26:0/4006449565 conn(0x7fdf880cef20 msgr2=0x7fdf880cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:08.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.919+0000 7fdf8d66b640 1 -- 172.21.15.26:0/4006449565 shutdown_connections 2023-10-14T11:13:08.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:08.919+0000 7fdf8d66b640 1 -- 172.21.15.26:0/4006449565 wait complete. 2023-10-14T11:13:08.941 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T11:13:09.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b4394640 1 Processor -- start 2023-10-14T11:13:09.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b4394640 1 -- start start 2023-10-14T11:13:09.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b4394640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f91ac0b84e0 0x7f91ac0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b4394640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91ac0d1670 con 0x7f91ac15cba0 2023-10-14T11:13:09.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b4394640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91ac0d1950 con 0x7f91ac0d0210 2023-10-14T11:13:09.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b4394640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91ac0d1460 con 0x7f91ac0b84e0 2023-10-14T11:13:09.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b2130640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f91ac15cba0 0x7f91ac0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53086/0 (socket says 172.21.15.26:53086) 2023-10-14T11:13:09.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b2130640 1 -- 172.21.15.26:0/1775401954 learned_addr learned my addr 172.21.15.26:0/1775401954 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:09.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b112e640 1 -- 172.21.15.26:0/1775401954 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438729477 0 0) 0x7f91ac0d1670 con 0x7f91ac15cba0 2023-10-14T11:13:09.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b2931640 1 --2- 172.21.15.26:0/1775401954 >> v2:172.21.15.110:3300/0 conn(0x7f91ac0b84e0 0x7f91ac0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b112e640 1 -- 172.21.15.26:0/1775401954 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9198003530 con 0x7f91ac15cba0 2023-10-14T11:13:09.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b112e640 1 -- 172.21.15.26:0/1775401954 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3332081670 0 0) 0x7f9198003530 con 0x7f91ac15cba0 2023-10-14T11:13:09.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b112e640 1 -- 172.21.15.26:0/1775401954 >> v2:172.21.15.110:3300/0 conn(0x7f91ac0b84e0 msgr2=0x7f91ac0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:09.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b112e640 1 --2- 172.21.15.26:0/1775401954 >> v2:172.21.15.110:3300/0 conn(0x7f91ac0b84e0 0x7f91ac0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b112e640 1 -- 172.21.15.26:0/1775401954 >> v1:172.21.15.110:6789/0 conn(0x7f91ac0d0210 legacy=0x7f91ac0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:09.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b112e640 1 -- 172.21.15.26:0/1775401954 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac0d1c30 con 0x7f91ac15cba0 2023-10-14T11:13:09.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b112e640 1 -- 172.21.15.26:0/1775401954 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f91a8001a00 con 0x7f91ac15cba0 2023-10-14T11:13:09.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b112e640 1 -- 172.21.15.26:0/1775401954 >> v1:172.21.15.26:6789/0 conn(0x7f91ac15cba0 legacy=0x7f91ac0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:09.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b112e640 1 --2- 172.21.15.26:0/1775401954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9198003980 0x7f9198003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b112e640 1 --2- 172.21.15.26:0/1775401954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91980047d0 0x7f9198004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b112e640 1 --2- 172.21.15.26:0/1775401954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9198005190 0x7f919800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b112e640 1 -- 172.21.15.26:0/1775401954 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac0d1460 con 0x7f9198003980 2023-10-14T11:13:09.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b112e640 1 -- 172.21.15.26:0/1775401954 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919800c130 con 0x7f91980047d0 2023-10-14T11:13:09.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.083+0000 7f91b112e640 1 -- 172.21.15.26:0/1775401954 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919800c2f0 con 0x7f9198005190 2023-10-14T11:13:09.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.087+0000 7f91b2130640 1 --2- 172.21.15.26:0/1775401954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9198003980 0x7f9198003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.087+0000 7f91b2931640 1 --2- 172.21.15.26:0/1775401954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9198005190 0x7f919800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.087+0000 7f91b192f640 1 --2- 172.21.15.26:0/1775401954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91980047d0 0x7f9198004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.087+0000 7f91b2130640 1 -- 172.21.15.26:0/1775401954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9198005190 msgr2=0x7f919800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:09.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.087+0000 7f91b2130640 1 --2- 172.21.15.26:0/1775401954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9198005190 0x7f919800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.087+0000 7f91b2130640 1 -- 172.21.15.26:0/1775401954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91980047d0 msgr2=0x7f9198004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:09.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.087+0000 7f91b2130640 1 --2- 172.21.15.26:0/1775401954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91980047d0 0x7f9198004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.087+0000 7f91b2130640 1 -- 172.21.15.26:0/1775401954 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9198003530 con 0x7f9198003980 2023-10-14T11:13:09.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.087+0000 7f91b2931640 1 -- 172.21.15.26:0/1775401954 reap_dead start 2023-10-14T11:13:09.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.087+0000 7f91b2130640 1 --2- 172.21.15.26:0/1775401954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9198003980 0x7f9198003da0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f91a800a830 tx=0x7f91a801d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc94c345e2fa75a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:09.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.087+0000 7f91b112e640 1 -- 172.21.15.26:0/1775401954 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a80072d0 con 0x7f9198003980 2023-10-14T11:13:09.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.087+0000 7f91b112e640 1 -- 172.21.15.26:0/1775401954 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a80a8070 con 0x7f9198003980 2023-10-14T11:13:09.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.087+0000 7f91b112e640 1 -- 172.21.15.26:0/1775401954 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a8007690 con 0x7f9198003980 2023-10-14T11:13:09.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.087+0000 7f91b4394640 1 -- 172.21.15.26:0/1775401954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9198003980 msgr2=0x7f9198003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:09.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.087+0000 7f91b4394640 1 --2- 172.21.15.26:0/1775401954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9198003980 0x7f9198003da0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f91a800a830 tx=0x7f91a801d2c0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b4394640 1 -- 172.21.15.26:0/1775401954 shutdown_connections 2023-10-14T11:13:09.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b4394640 1 --2- 172.21.15.26:0/1775401954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9198003980 0x7f9198003da0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b4394640 1 -- 172.21.15.26:0/1775401954 >> 172.21.15.26:0/1775401954 conn(0x7f91ac0719c0 msgr2=0x7f91ac071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:09.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b4394640 1 -- 172.21.15.26:0/1775401954 shutdown_connections 2023-10-14T11:13:09.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b4394640 1 -- 172.21.15.26:0/1775401954 wait complete. 2023-10-14T11:13:09.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b4394640 1 Processor -- start 2023-10-14T11:13:09.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b4394640 1 -- start start 2023-10-14T11:13:09.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b4394640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9198003980 0x7f91ac0c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b4394640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac0c8f50 0x7f91ac1f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b4394640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91ac1522d0 0x7f91ac157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b4394640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac0c8220 con 0x7f91ac0c8f50 2023-10-14T11:13:09.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b4394640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac1f5fd0 con 0x7f9198003980 2023-10-14T11:13:09.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b4394640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac0c7ea0 con 0x7f91ac1522d0 2023-10-14T11:13:09.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b192f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac0c8f50 0x7f91ac1f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b192f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac0c8f50 0x7f91ac1f5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49256/0 (socket says 172.21.15.26:49256) 2023-10-14T11:13:09.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b192f640 1 -- 172.21.15.26:0/3232680441 learned_addr learned my addr 172.21.15.26:0/3232680441 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:09.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b2130640 1 --2- 172.21.15.26:0/3232680441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9198003980 0x7f91ac0c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b2931640 1 --2- 172.21.15.26:0/3232680441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91ac1522d0 0x7f91ac157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b192f640 1 -- 172.21.15.26:0/3232680441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91ac1522d0 msgr2=0x7f91ac157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:09.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b192f640 1 --2- 172.21.15.26:0/3232680441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91ac1522d0 0x7f91ac157990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b192f640 1 -- 172.21.15.26:0/3232680441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9198003980 msgr2=0x7f91ac0c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:09.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b192f640 1 --2- 172.21.15.26:0/3232680441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9198003980 0x7f91ac0c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b192f640 1 -- 172.21.15.26:0/3232680441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac0c8470 con 0x7f91ac0c8f50 2023-10-14T11:13:09.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b2931640 1 --2- 172.21.15.26:0/3232680441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91ac1522d0 0x7f91ac157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:09.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.091+0000 7f91b192f640 1 --2- 172.21.15.26:0/3232680441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac0c8f50 0x7f91ac1f5a90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f919c007820 tx=0x7f919c00e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:09.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.095+0000 7f91a2ffd640 1 -- 172.21.15.26:0/3232680441 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c0052e0 con 0x7f91ac0c8f50 2023-10-14T11:13:09.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.095+0000 7f91a2ffd640 1 -- 172.21.15.26:0/3232680441 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919c005440 con 0x7f91ac0c8f50 2023-10-14T11:13:09.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.095+0000 7f91b4394640 1 -- 172.21.15.26:0/3232680441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ac0c8750 con 0x7f91ac0c8f50 2023-10-14T11:13:09.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.095+0000 7f91a2ffd640 1 -- 172.21.15.26:0/3232680441 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c003840 con 0x7f91ac0c8f50 2023-10-14T11:13:09.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.095+0000 7f91b4394640 1 -- 172.21.15.26:0/3232680441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ac0c93d0 con 0x7f91ac0c8f50 2023-10-14T11:13:09.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.095+0000 7f91b4394640 1 -- 172.21.15.26:0/3232680441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ac04e170 con 0x7f91ac0c8f50 2023-10-14T11:13:09.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.095+0000 7f91a2ffd640 1 -- 172.21.15.26:0/3232680441 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f919c0039a0 con 0x7f91ac0c8f50 2023-10-14T11:13:09.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.095+0000 7f91a2ffd640 1 --2- 172.21.15.26:0/3232680441 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f91900664a0 0x7f9190068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.095+0000 7f91a2ffd640 1 -- 172.21.15.26:0/3232680441 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f919c083a10 con 0x7f91ac0c8f50 2023-10-14T11:13:09.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.095+0000 7f91b2130640 1 --2- 172.21.15.26:0/3232680441 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f91900664a0 0x7f9190068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.095+0000 7f91b2130640 1 --2- 172.21.15.26:0/3232680441 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f91900664a0 0x7f9190068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f91a80ad000 tx=0x7f91a8009050 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:09.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.099+0000 7f91a2ffd640 1 -- 172.21.15.26:0/3232680441 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f919c050ae0 con 0x7f91ac0c8f50 2023-10-14T11:13:09.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.255+0000 7f91b4394640 1 -- 172.21.15.26:0/3232680441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f91ac1598f0 con 0x7f91ac0c8f50 2023-10-14T11:13:09.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.255+0000 7f91a2ffd640 1 -- 172.21.15.26:0/3232680441 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f919c0190a0 con 0x7f91ac0c8f50 2023-10-14T11:13:09.261 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:09.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.259+0000 7f91b4394640 1 -- 172.21.15.26:0/3232680441 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f91900664a0 msgr2=0x7f9190068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:09.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.259+0000 7f91b4394640 1 --2- 172.21.15.26:0/3232680441 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f91900664a0 0x7f9190068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f91a80ad000 tx=0x7f91a8009050 comp rx=0 tx=0).stop 2023-10-14T11:13:09.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.259+0000 7f91b4394640 1 -- 172.21.15.26:0/3232680441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac0c8f50 msgr2=0x7f91ac1f5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:09.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.259+0000 7f91b4394640 1 --2- 172.21.15.26:0/3232680441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac0c8f50 0x7f91ac1f5a90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f919c007820 tx=0x7f919c00e910 comp rx=0 tx=0).stop 2023-10-14T11:13:09.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.259+0000 7f91b4394640 1 -- 172.21.15.26:0/3232680441 shutdown_connections 2023-10-14T11:13:09.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.259+0000 7f91b4394640 1 --2- 172.21.15.26:0/3232680441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91ac1522d0 0x7f91ac157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.259+0000 7f91b4394640 1 --2- 172.21.15.26:0/3232680441 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f91900664a0 0x7f9190068960 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.259+0000 7f91b4394640 1 --2- 172.21.15.26:0/3232680441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac0c8f50 0x7f91ac1f5a90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.259+0000 7f91b4394640 1 --2- 172.21.15.26:0/3232680441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9198003980 0x7f91ac0c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.259+0000 7f91b4394640 1 -- 172.21.15.26:0/3232680441 >> 172.21.15.26:0/3232680441 conn(0x7f91ac0719c0 msgr2=0x7f91ac0b78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:09.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.259+0000 7f91b4394640 1 -- 172.21.15.26:0/3232680441 shutdown_connections 2023-10-14T11:13:09.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.259+0000 7f91b4394640 1 -- 172.21.15.26:0/3232680441 wait complete. 2023-10-14T11:13:09.282 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:13:09.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.419+0000 7f4127432640 1 Processor -- start 2023-10-14T11:13:09.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.419+0000 7f4127432640 1 -- start start 2023-10-14T11:13:09.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f4127432640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f412015d690 0x7f412015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f4127432640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f412015be60 con 0x7f41200b07f0 2023-10-14T11:13:09.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f4127432640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f412015c1f0 con 0x7f4120070c40 2023-10-14T11:13:09.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f4127432640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412015b3b0 con 0x7f412015d690 2023-10-14T11:13:09.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f41249cd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f41200b07f0 0x7f4120162480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53096/0 (socket says 172.21.15.26:53096) 2023-10-14T11:13:09.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f41249cd640 1 -- 172.21.15.26:0/3228052209 learned_addr learned my addr 172.21.15.26:0/3228052209 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:09.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f41259cf640 1 --2- 172.21.15.26:0/3228052209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f412015d690 0x7f412015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f4117fff640 1 -- 172.21.15.26:0/3228052209 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846938328 0 0) 0x7f412015be60 con 0x7f41200b07f0 2023-10-14T11:13:09.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f4117fff640 1 -- 172.21.15.26:0/3228052209 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f410c003530 con 0x7f41200b07f0 2023-10-14T11:13:09.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f4117fff640 1 -- 172.21.15.26:0/3228052209 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3000326683 0 0) 0x7f412015c1f0 con 0x7f4120070c40 2023-10-14T11:13:09.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f4117fff640 1 -- 172.21.15.26:0/3228052209 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f412015be60 con 0x7f4120070c40 2023-10-14T11:13:09.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f4117fff640 1 -- 172.21.15.26:0/3228052209 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 284894547 0 0) 0x7f410c003530 con 0x7f41200b07f0 2023-10-14T11:13:09.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f4117fff640 1 -- 172.21.15.26:0/3228052209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f412015d690 msgr2=0x7f412015ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:09.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f4117fff640 1 --2- 172.21.15.26:0/3228052209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f412015d690 0x7f412015ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f4117fff640 1 -- 172.21.15.26:0/3228052209 >> v1:172.21.15.110:6789/0 conn(0x7f4120070c40 legacy=0x7f41200b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:09.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f4117fff640 1 -- 172.21.15.26:0/3228052209 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4120071020 con 0x7f41200b07f0 2023-10-14T11:13:09.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f4117fff640 1 -- 172.21.15.26:0/3228052209 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f4110001680 con 0x7f41200b07f0 2023-10-14T11:13:09.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f4117fff640 1 -- 172.21.15.26:0/3228052209 >> v1:172.21.15.26:6789/0 conn(0x7f41200b07f0 legacy=0x7f4120162480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:09.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f4117fff640 1 --2- 172.21.15.26:0/3228052209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f412015d690 0x7f410c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f4117fff640 1 --2- 172.21.15.26:0/3228052209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f410c0040a0 0x7f410c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f4117fff640 1 --2- 172.21.15.26:0/3228052209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f410c004d10 0x7f410c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f4117fff640 1 -- 172.21.15.26:0/3228052209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412015b3b0 con 0x7f410c004d10 2023-10-14T11:13:09.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f4117fff640 1 -- 172.21.15.26:0/3228052209 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c00bba0 con 0x7f410c0040a0 2023-10-14T11:13:09.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f4117fff640 1 -- 172.21.15.26:0/3228052209 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410c00bd60 con 0x7f412015d690 2023-10-14T11:13:09.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f41259cf640 1 --2- 172.21.15.26:0/3228052209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f410c004d10 0x7f410c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f41251ce640 1 --2- 172.21.15.26:0/3228052209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f412015d690 0x7f410c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f41249cd640 1 --2- 172.21.15.26:0/3228052209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f410c0040a0 0x7f410c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f41259cf640 1 -- 172.21.15.26:0/3228052209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f412015d690 msgr2=0x7f410c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:09.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f41259cf640 1 --2- 172.21.15.26:0/3228052209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f412015d690 0x7f410c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f41259cf640 1 -- 172.21.15.26:0/3228052209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f410c0040a0 msgr2=0x7f410c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:09.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f41259cf640 1 --2- 172.21.15.26:0/3228052209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f410c0040a0 0x7f410c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.423+0000 7f41259cf640 1 -- 172.21.15.26:0/3228052209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c003530 con 0x7f410c004d10 2023-10-14T11:13:09.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.427+0000 7f41259cf640 1 --2- 172.21.15.26:0/3228052209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f410c004d10 0x7f410c005190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4118009fc0 tx=0x7f411801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae55efea5ec5d24 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:09.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.427+0000 7f4117fff640 1 -- 172.21.15.26:0/3228052209 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41180a5c50 con 0x7f410c004d10 2023-10-14T11:13:09.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.427+0000 7f4117fff640 1 -- 172.21.15.26:0/3228052209 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411800f040 con 0x7f410c004d10 2023-10-14T11:13:09.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.427+0000 7f4117fff640 1 -- 172.21.15.26:0/3228052209 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41180ad440 con 0x7f410c004d10 2023-10-14T11:13:09.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.427+0000 7f4127432640 1 -- 172.21.15.26:0/3228052209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f410c004d10 msgr2=0x7f410c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:09.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.427+0000 7f4127432640 1 --2- 172.21.15.26:0/3228052209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f410c004d10 0x7f410c005190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4118009fc0 tx=0x7f411801cc60 comp rx=0 tx=0).stop 2023-10-14T11:13:09.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.427+0000 7f41259cf640 1 -- 172.21.15.26:0/3228052209 reap_dead start 2023-10-14T11:13:09.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.427+0000 7f4127432640 1 -- 172.21.15.26:0/3228052209 shutdown_connections 2023-10-14T11:13:09.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.427+0000 7f4127432640 1 -- 172.21.15.26:0/3228052209 >> 172.21.15.26:0/3228052209 conn(0x7f412006c190 msgr2=0x7f412006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:09.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.427+0000 7f4127432640 1 -- 172.21.15.26:0/3228052209 shutdown_connections 2023-10-14T11:13:09.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.427+0000 7f4127432640 1 -- 172.21.15.26:0/3228052209 wait complete. 2023-10-14T11:13:09.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f4127432640 1 Processor -- start 2023-10-14T11:13:09.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f4127432640 1 -- start start 2023-10-14T11:13:09.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f4127432640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f410c004d10 0x7f412013c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f4127432640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4120149450 0x7f412014c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f4127432640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41201f5940 0x7f41200b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f4127432640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412014c830 con 0x7f410c004d10 2023-10-14T11:13:09.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f4127432640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4120149950 con 0x7f4120149450 2023-10-14T11:13:09.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f4127432640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4120152c30 con 0x7f41201f5940 2023-10-14T11:13:09.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f41251ce640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f410c004d10 0x7f412013c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f41251ce640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f410c004d10 0x7f412013c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49268/0 (socket says 172.21.15.26:49268) 2023-10-14T11:13:09.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f41251ce640 1 -- 172.21.15.26:0/331993423 learned_addr learned my addr 172.21.15.26:0/331993423 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:09.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f41249cd640 1 --2- 172.21.15.26:0/331993423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4120149450 0x7f412014c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f41259cf640 1 --2- 172.21.15.26:0/331993423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41201f5940 0x7f41200b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f41251ce640 1 -- 172.21.15.26:0/331993423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41201f5940 msgr2=0x7f41200b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:09.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f41251ce640 1 --2- 172.21.15.26:0/331993423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41201f5940 0x7f41200b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f41251ce640 1 -- 172.21.15.26:0/331993423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4120149450 msgr2=0x7f412014c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:09.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f41251ce640 1 --2- 172.21.15.26:0/331993423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4120149450 0x7f412014c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f41251ce640 1 -- 172.21.15.26:0/331993423 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4120152ed0 con 0x7f410c004d10 2023-10-14T11:13:09.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f41249cd640 1 --2- 172.21.15.26:0/331993423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4120149450 0x7f412014c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:09.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f41251ce640 1 --2- 172.21.15.26:0/331993423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f410c004d10 0x7f412013c9d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f411c00f7a0 tx=0x7f411c00fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:09.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f4115ffb640 1 -- 172.21.15.26:0/331993423 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c0050d0 con 0x7f410c004d10 2023-10-14T11:13:09.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f4115ffb640 1 -- 172.21.15.26:0/331993423 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411c005230 con 0x7f410c004d10 2023-10-14T11:13:09.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f4127432640 1 -- 172.21.15.26:0/331993423 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41201531b0 con 0x7f410c004d10 2023-10-14T11:13:09.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f4115ffb640 1 -- 172.21.15.26:0/331993423 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c00d730 con 0x7f410c004d10 2023-10-14T11:13:09.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.431+0000 7f4127432640 1 -- 172.21.15.26:0/331993423 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4120148d00 con 0x7f410c004d10 2023-10-14T11:13:09.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.435+0000 7f4127432640 1 -- 172.21.15.26:0/331993423 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4120074010 con 0x7f410c004d10 2023-10-14T11:13:09.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.435+0000 7f4115ffb640 1 -- 172.21.15.26:0/331993423 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f411c00d890 con 0x7f410c004d10 2023-10-14T11:13:09.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.435+0000 7f4115ffb640 1 --2- 172.21.15.26:0/331993423 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41040664a0 0x7f4104068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.435+0000 7f4115ffb640 1 -- 172.21.15.26:0/331993423 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f411c084220 con 0x7f410c004d10 2023-10-14T11:13:09.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.435+0000 7f41249cd640 1 --2- 172.21.15.26:0/331993423 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41040664a0 0x7f4104068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.435+0000 7f41249cd640 1 --2- 172.21.15.26:0/331993423 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41040664a0 0x7f4104068960 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f41200b3460 tx=0x7f4110009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:09.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.439+0000 7f4115ffb640 1 -- 172.21.15.26:0/331993423 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f411c0512d0 con 0x7f410c004d10 2023-10-14T11:13:09.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.595+0000 7f4127432640 1 -- 172.21.15.26:0/331993423 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4120153660 con 0x7f410c004d10 2023-10-14T11:13:09.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.599+0000 7f4115ffb640 1 -- 172.21.15.26:0/331993423 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18679 (secure 0 0 0) 0x7f411c0548f0 con 0x7f410c004d10 2023-10-14T11:13:09.602 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:09.602 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":27,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:13:03.866737+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:13:09.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.599+0000 7f4127432640 1 -- 172.21.15.26:0/331993423 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41040664a0 msgr2=0x7f4104068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:09.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.599+0000 7f4127432640 1 --2- 172.21.15.26:0/331993423 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41040664a0 0x7f4104068960 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f41200b3460 tx=0x7f4110009040 comp rx=0 tx=0).stop 2023-10-14T11:13:09.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.599+0000 7f4127432640 1 -- 172.21.15.26:0/331993423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f410c004d10 msgr2=0x7f412013c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:09.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.599+0000 7f4127432640 1 --2- 172.21.15.26:0/331993423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f410c004d10 0x7f412013c9d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f411c00f7a0 tx=0x7f411c00fc60 comp rx=0 tx=0).stop 2023-10-14T11:13:09.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.599+0000 7f4127432640 1 -- 172.21.15.26:0/331993423 shutdown_connections 2023-10-14T11:13:09.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.599+0000 7f4127432640 1 --2- 172.21.15.26:0/331993423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41201f5940 0x7f41200b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.599+0000 7f4127432640 1 --2- 172.21.15.26:0/331993423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4120149450 0x7f412014c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.599+0000 7f4127432640 1 --2- 172.21.15.26:0/331993423 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41040664a0 0x7f4104068960 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.599+0000 7f4127432640 1 --2- 172.21.15.26:0/331993423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f410c004d10 0x7f412013c9d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.599+0000 7f4127432640 1 -- 172.21.15.26:0/331993423 >> 172.21.15.26:0/331993423 conn(0x7f412006c190 msgr2=0x7f41200b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:09.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.599+0000 7f4127432640 1 -- 172.21.15.26:0/331993423 shutdown_connections 2023-10-14T11:13:09.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.599+0000 7f4127432640 1 -- 172.21.15.26:0/331993423 wait complete. 2023-10-14T11:13:09.623 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:12:20.179562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:12:21.346111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T11:12:25.025159+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T11:13:09.624 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:13:09.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4124217640 1 Processor -- start 2023-10-14T11:13:09.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4124217640 1 -- start start 2023-10-14T11:13:09.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4124217640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f411c15cbc0 0x7f411c0ab870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4124217640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f411c161390 con 0x7f411c06a5a0 2023-10-14T11:13:09.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4124217640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f411c0ccda0 con 0x7f411c160860 2023-10-14T11:13:09.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4124217640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411c0cd080 con 0x7f411c15cbc0 2023-10-14T11:13:09.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f41227b4640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f411c06a5a0 0x7f411c0cd880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53100/0 (socket says 172.21.15.26:53100) 2023-10-14T11:13:09.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f41227b4640 1 -- 172.21.15.26:0/864204871 learned_addr learned my addr 172.21.15.26:0/864204871 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:09.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4121fb3640 1 --2- 172.21.15.26:0/864204871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f411c15cbc0 0x7f411c0ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4120fb1640 1 -- 172.21.15.26:0/864204871 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723029671 0 0) 0x7f411c161390 con 0x7f411c06a5a0 2023-10-14T11:13:09.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4120fb1640 1 -- 172.21.15.26:0/864204871 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4108003530 con 0x7f411c06a5a0 2023-10-14T11:13:09.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4120fb1640 1 -- 172.21.15.26:0/864204871 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1926433604 0 0) 0x7f4108003530 con 0x7f411c06a5a0 2023-10-14T11:13:09.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4120fb1640 1 -- 172.21.15.26:0/864204871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f411c15cbc0 msgr2=0x7f411c0ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:09.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4120fb1640 1 --2- 172.21.15.26:0/864204871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f411c15cbc0 0x7f411c0ab870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4120fb1640 1 -- 172.21.15.26:0/864204871 >> v1:172.21.15.110:6789/0 conn(0x7f411c160860 legacy=0x7f411c069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:09.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4120fb1640 1 -- 172.21.15.26:0/864204871 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c0cd360 con 0x7f411c06a5a0 2023-10-14T11:13:09.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4120fb1640 1 -- 172.21.15.26:0/864204871 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f4114001a00 con 0x7f411c06a5a0 2023-10-14T11:13:09.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4120fb1640 1 -- 172.21.15.26:0/864204871 >> v1:172.21.15.26:6789/0 conn(0x7f411c06a5a0 legacy=0x7f411c0cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:09.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4120fb1640 1 --2- 172.21.15.26:0/864204871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41080039b0 0x7f4108003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4120fb1640 1 --2- 172.21.15.26:0/864204871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f411c15cbc0 0x7f41080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4120fb1640 1 --2- 172.21.15.26:0/864204871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4108004d10 0x7f4108005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4120fb1640 1 -- 172.21.15.26:0/864204871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c0cd080 con 0x7f4108004d10 2023-10-14T11:13:09.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4120fb1640 1 -- 172.21.15.26:0/864204871 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410800ba40 con 0x7f41080039b0 2023-10-14T11:13:09.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4120fb1640 1 -- 172.21.15.26:0/864204871 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410800bc00 con 0x7f411c15cbc0 2023-10-14T11:13:09.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f41227b4640 1 --2- 172.21.15.26:0/864204871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4108004d10 0x7f4108005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f41217b2640 1 --2- 172.21.15.26:0/864204871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f411c15cbc0 0x7f41080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.767+0000 7f4121fb3640 1 --2- 172.21.15.26:0/864204871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41080039b0 0x7f4108003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.771+0000 7f41227b4640 1 -- 172.21.15.26:0/864204871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f411c15cbc0 msgr2=0x7f41080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:09.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.771+0000 7f41227b4640 1 --2- 172.21.15.26:0/864204871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f411c15cbc0 0x7f41080047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.771+0000 7f41227b4640 1 -- 172.21.15.26:0/864204871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41080039b0 msgr2=0x7f4108003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:09.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.771+0000 7f41227b4640 1 --2- 172.21.15.26:0/864204871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41080039b0 0x7f4108003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.771+0000 7f41227b4640 1 -- 172.21.15.26:0/864204871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4108003530 con 0x7f4108004d10 2023-10-14T11:13:09.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.771+0000 7f41227b4640 1 --2- 172.21.15.26:0/864204871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4108004d10 0x7f4108005190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f411c0702a0 tx=0x7f411401d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6564e60170def12f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:09.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.771+0000 7f4120fb1640 1 -- 172.21.15.26:0/864204871 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41140a5ea0 con 0x7f4108004d10 2023-10-14T11:13:09.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.771+0000 7f4120fb1640 1 -- 172.21.15.26:0/864204871 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41140a8070 con 0x7f4108004d10 2023-10-14T11:13:09.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.771+0000 7f4120fb1640 1 -- 172.21.15.26:0/864204871 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41140ad890 con 0x7f4108004d10 2023-10-14T11:13:09.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.771+0000 7f4124217640 1 -- 172.21.15.26:0/864204871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4108004d10 msgr2=0x7f4108005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:09.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.771+0000 7f4124217640 1 --2- 172.21.15.26:0/864204871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4108004d10 0x7f4108005190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f411c0702a0 tx=0x7f411401d2c0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.771+0000 7f41227b4640 1 -- 172.21.15.26:0/864204871 reap_dead start 2023-10-14T11:13:09.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.771+0000 7f4124217640 1 -- 172.21.15.26:0/864204871 shutdown_connections 2023-10-14T11:13:09.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.771+0000 7f4124217640 1 -- 172.21.15.26:0/864204871 >> 172.21.15.26:0/864204871 conn(0x7f411c0b0da0 msgr2=0x7f411c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:09.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.771+0000 7f4124217640 1 -- 172.21.15.26:0/864204871 shutdown_connections 2023-10-14T11:13:09.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.771+0000 7f4124217640 1 -- 172.21.15.26:0/864204871 wait complete. 2023-10-14T11:13:09.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f4124217640 1 Processor -- start 2023-10-14T11:13:09.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f4124217640 1 -- start start 2023-10-14T11:13:09.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f4124217640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4108004d10 0x7f411c0c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f4124217640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f411c0c8660 0x7f411c0c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f4124217640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f411c155c80 0x7f411c156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f4124217640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c156640 con 0x7f411c155c80 2023-10-14T11:13:09.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f4124217640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c0c5620 con 0x7f4108004d10 2023-10-14T11:13:09.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f4124217640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411c15d790 con 0x7f411c0c8660 2023-10-14T11:13:09.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f41227b4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f411c155c80 0x7f411c156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f41227b4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f411c155c80 0x7f411c156100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49298/0 (socket says 172.21.15.26:49298) 2023-10-14T11:13:09.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f41227b4640 1 -- 172.21.15.26:0/476889025 learned_addr learned my addr 172.21.15.26:0/476889025 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:09.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f41217b2640 1 --2- 172.21.15.26:0/476889025 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f411c0c8660 0x7f411c0c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f4121fb3640 1 --2- 172.21.15.26:0/476889025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4108004d10 0x7f411c0c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f41227b4640 1 -- 172.21.15.26:0/476889025 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f411c0c8660 msgr2=0x7f411c0c50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:09.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f41227b4640 1 --2- 172.21.15.26:0/476889025 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f411c0c8660 0x7f411c0c50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f41227b4640 1 -- 172.21.15.26:0/476889025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4108004d10 msgr2=0x7f411c0c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:09.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f41227b4640 1 --2- 172.21.15.26:0/476889025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4108004d10 0x7f411c0c5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f41227b4640 1 -- 172.21.15.26:0/476889025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c15a840 con 0x7f411c155c80 2023-10-14T11:13:09.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f41227b4640 1 --2- 172.21.15.26:0/476889025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f411c155c80 0x7f411c156100 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f411401d0f0 tx=0x7f4108005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:09.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f41127fc640 1 -- 172.21.15.26:0/476889025 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41140019c0 con 0x7f411c155c80 2023-10-14T11:13:09.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f41127fc640 1 -- 172.21.15.26:0/476889025 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41140a5ea0 con 0x7f411c155c80 2023-10-14T11:13:09.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f4124217640 1 -- 172.21.15.26:0/476889025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411c15d9e0 con 0x7f411c155c80 2023-10-14T11:13:09.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.775+0000 7f41127fc640 1 -- 172.21.15.26:0/476889025 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41140ad630 con 0x7f411c155c80 2023-10-14T11:13:09.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.779+0000 7f4124217640 1 -- 172.21.15.26:0/476889025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411c15dfa0 con 0x7f411c155c80 2023-10-14T11:13:09.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.779+0000 7f4124217640 1 -- 172.21.15.26:0/476889025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411c04e170 con 0x7f411c155c80 2023-10-14T11:13:09.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.779+0000 7f41127fc640 1 -- 172.21.15.26:0/476889025 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f41140aa030 con 0x7f411c155c80 2023-10-14T11:13:09.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.779+0000 7f41127fc640 1 --2- 172.21.15.26:0/476889025 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41000664a0 0x7f4100068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:09.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.779+0000 7f41127fc640 1 -- 172.21.15.26:0/476889025 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f411411deb0 con 0x7f411c155c80 2023-10-14T11:13:09.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.779+0000 7f4121fb3640 1 --2- 172.21.15.26:0/476889025 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41000664a0 0x7f4100068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:09.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.783+0000 7f4121fb3640 1 --2- 172.21.15.26:0/476889025 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41000664a0 0x7f4100068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4118009b20 tx=0x7f4118008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:09.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.783+0000 7f41127fc640 1 -- 172.21.15.26:0/476889025 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f41140eb000 con 0x7f411c155c80 2023-10-14T11:13:09.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.943+0000 7f4124217640 1 -- 172.21.15.26:0/476889025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f411c0cc5d0 con 0x7f411c155c80 2023-10-14T11:13:09.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.943+0000 7f41127fc640 1 -- 172.21.15.26:0/476889025 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f41140011d0 con 0x7f411c155c80 2023-10-14T11:13:09.947 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:13:09.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.943+0000 7f4124217640 1 -- 172.21.15.26:0/476889025 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41000664a0 msgr2=0x7f4100068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:09.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.943+0000 7f4124217640 1 --2- 172.21.15.26:0/476889025 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41000664a0 0x7f4100068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4118009b20 tx=0x7f4118008040 comp rx=0 tx=0).stop 2023-10-14T11:13:09.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.943+0000 7f4124217640 1 -- 172.21.15.26:0/476889025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f411c155c80 msgr2=0x7f411c156100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:09.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.943+0000 7f4124217640 1 --2- 172.21.15.26:0/476889025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f411c155c80 0x7f411c156100 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f411401d0f0 tx=0x7f4108005800 comp rx=0 tx=0).stop 2023-10-14T11:13:09.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.943+0000 7f4124217640 1 -- 172.21.15.26:0/476889025 shutdown_connections 2023-10-14T11:13:09.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.943+0000 7f4124217640 1 --2- 172.21.15.26:0/476889025 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41000664a0 0x7f4100068960 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.943+0000 7f4124217640 1 --2- 172.21.15.26:0/476889025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f411c155c80 0x7f411c156100 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.943+0000 7f4124217640 1 --2- 172.21.15.26:0/476889025 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f411c0c8660 0x7f411c0c50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.943+0000 7f4124217640 1 --2- 172.21.15.26:0/476889025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4108004d10 0x7f411c0c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:09.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.943+0000 7f4124217640 1 -- 172.21.15.26:0/476889025 >> 172.21.15.26:0/476889025 conn(0x7f411c0b0da0 msgr2=0x7f411c069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:09.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.943+0000 7f4124217640 1 -- 172.21.15.26:0/476889025 shutdown_connections 2023-10-14T11:13:09.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:09.943+0000 7f4124217640 1 -- 172.21.15.26:0/476889025 wait complete. 2023-10-14T11:13:09.969 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:13:10.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.115+0000 7f6c43577640 1 Processor -- start 2023-10-14T11:13:10.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.115+0000 7f6c43577640 1 -- start start 2023-10-14T11:13:10.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.115+0000 7f6c43577640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6c3c0cf210 0x7f6c3c0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:10.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.115+0000 7f6c43577640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6c3c15cdc0 0x7f6c3c0b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:10.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.115+0000 7f6c43577640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c3c0cfb30 con 0x7f6c3c0d3320 2023-10-14T11:13:10.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.115+0000 7f6c43577640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c3c0d0880 con 0x7f6c3c15cdc0 2023-10-14T11:13:10.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.115+0000 7f6c43577640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c3c0b1c00 con 0x7f6c3c0cf210 2023-10-14T11:13:10.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.115+0000 7f6c41d74640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6c3c15cdc0 0x7f6c3c0b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:10.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.115+0000 7f6c41d74640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6c3c15cdc0 0x7f6c3c0b2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49300/0 (socket says 172.21.15.26:49300) 2023-10-14T11:13:10.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.115+0000 7f6c42d76640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6c3c0d3320 0x7f6c3c0b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53102/0 (socket says 172.21.15.26:53102) 2023-10-14T11:13:10.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.115+0000 7f6c41d74640 1 -- 172.21.15.26:0/3359807745 learned_addr learned my addr 172.21.15.26:0/3359807745 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:10.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.115+0000 7f6c42575640 1 --2- 172.21.15.26:0/3359807745 >> v2:172.21.15.110:3300/0 conn(0x7f6c3c0cf210 0x7f6c3c0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:10.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.115+0000 7f6c41d74640 1 -- 172.21.15.26:0/3359807745 >> v2:172.21.15.110:3300/0 conn(0x7f6c3c0cf210 msgr2=0x7f6c3c0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:10.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.115+0000 7f6c41d74640 1 --2- 172.21.15.26:0/3359807745 >> v2:172.21.15.110:3300/0 conn(0x7f6c3c0cf210 0x7f6c3c0cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.115+0000 7f6c41d74640 1 -- 172.21.15.26:0/3359807745 >> v1:172.21.15.26:6789/0 conn(0x7f6c3c0d3320 legacy=0x7f6c3c0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:10.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.115+0000 7f6c41d74640 1 -- 172.21.15.26:0/3359807745 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3c0b1ee0 con 0x7f6c3c15cdc0 2023-10-14T11:13:10.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.115+0000 7f6c42575640 1 --2- 172.21.15.26:0/3359807745 >> v2:172.21.15.110:3300/0 conn(0x7f6c3c0cf210 0x7f6c3c0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:10.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.115+0000 7f6c41573640 1 -- 172.21.15.26:0/3359807745 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052333086 0 0) 0x7f6c3c0cfb30 con 0x7f6c3c0d3320 2023-10-14T11:13:10.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.119+0000 7f6c41d74640 1 --2- 172.21.15.26:0/3359807745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c3c15cdc0 0x7f6c3c0b2ca0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c08b880 tx=0x7f6c3c0b4100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69be5ef5fba109d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:10.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.119+0000 7f6c41573640 1 -- 172.21.15.26:0/3359807745 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0ab640 con 0x7f6c3c15cdc0 2023-10-14T11:13:10.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.119+0000 7f6c41573640 1 -- 172.21.15.26:0/3359807745 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c0a7070 con 0x7f6c3c15cdc0 2023-10-14T11:13:10.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.119+0000 7f6c41573640 1 -- 172.21.15.26:0/3359807745 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0ab9c0 con 0x7f6c3c15cdc0 2023-10-14T11:13:10.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.119+0000 7f6c43577640 1 -- 172.21.15.26:0/3359807745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c3c15cdc0 msgr2=0x7f6c3c0b2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:10.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.119+0000 7f6c43577640 1 --2- 172.21.15.26:0/3359807745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c3c15cdc0 0x7f6c3c0b2ca0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c08b880 tx=0x7f6c3c0b4100 comp rx=0 tx=0).stop 2023-10-14T11:13:10.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.119+0000 7f6c43577640 1 -- 172.21.15.26:0/3359807745 shutdown_connections 2023-10-14T11:13:10.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.119+0000 7f6c43577640 1 --2- 172.21.15.26:0/3359807745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c3c15cdc0 0x7f6c3c0b2ca0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.119+0000 7f6c43577640 1 --2- 172.21.15.26:0/3359807745 >> v2:172.21.15.110:3300/0 conn(0x7f6c3c0cf210 0x7f6c3c0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.119+0000 7f6c43577640 1 -- 172.21.15.26:0/3359807745 >> 172.21.15.26:0/3359807745 conn(0x7f6c3c0d2800 msgr2=0x7f6c3c0d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:10.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.119+0000 7f6c43577640 1 -- 172.21.15.26:0/3359807745 shutdown_connections 2023-10-14T11:13:10.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.119+0000 7f6c43577640 1 -- 172.21.15.26:0/3359807745 wait complete. 2023-10-14T11:13:10.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c43577640 1 Processor -- start 2023-10-14T11:13:10.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c43577640 1 -- start start 2023-10-14T11:13:10.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c43577640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c3c0cf210 0x7f6c3c15e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:10.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c43577640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c3c0d3320 0x7f6c3c154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:10.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c43577640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c3c15cdc0 0x7f6c3c15d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:10.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c43577640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c1f4f10 con 0x7f6c3c15cdc0 2023-10-14T11:13:10.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c43577640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c15ee10 con 0x7f6c3c0d3320 2023-10-14T11:13:10.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c43577640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c1f5180 con 0x7f6c3c0cf210 2023-10-14T11:13:10.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c42d76640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c3c15cdc0 0x7f6c3c15d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:10.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c42d76640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c3c15cdc0 0x7f6c3c15d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49316/0 (socket says 172.21.15.26:49316) 2023-10-14T11:13:10.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c42d76640 1 -- 172.21.15.26:0/2877656446 learned_addr learned my addr 172.21.15.26:0/2877656446 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:10.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c41d74640 1 --2- 172.21.15.26:0/2877656446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c3c0d3320 0x7f6c3c154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:10.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c42575640 1 --2- 172.21.15.26:0/2877656446 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c3c0cf210 0x7f6c3c15e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:10.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c42d76640 1 -- 172.21.15.26:0/2877656446 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c3c0cf210 msgr2=0x7f6c3c15e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:10.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c42d76640 1 --2- 172.21.15.26:0/2877656446 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c3c0cf210 0x7f6c3c15e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c42d76640 1 -- 172.21.15.26:0/2877656446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c3c0d3320 msgr2=0x7f6c3c154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:10.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c42d76640 1 --2- 172.21.15.26:0/2877656446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c3c0d3320 0x7f6c3c154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c42d76640 1 -- 172.21.15.26:0/2877656446 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c0094d0 con 0x7f6c3c15cdc0 2023-10-14T11:13:10.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c42d76640 1 --2- 172.21.15.26:0/2877656446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c3c15cdc0 0x7f6c3c15d680 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6c34001570 tx=0x7f6c3400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:10.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c32ffd640 1 -- 172.21.15.26:0/2877656446 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3400a640 con 0x7f6c3c15cdc0 2023-10-14T11:13:10.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c32ffd640 1 -- 172.21.15.26:0/2877656446 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3400a7c0 con 0x7f6c3c15cdc0 2023-10-14T11:13:10.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c32ffd640 1 -- 172.21.15.26:0/2877656446 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3400ab70 con 0x7f6c3c15cdc0 2023-10-14T11:13:10.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c43577640 1 -- 172.21.15.26:0/2877656446 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3c1569d0 con 0x7f6c3c15cdc0 2023-10-14T11:13:10.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c43577640 1 -- 172.21.15.26:0/2877656446 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3c15c500 con 0x7f6c3c15cdc0 2023-10-14T11:13:10.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.123+0000 7f6c43577640 1 -- 172.21.15.26:0/2877656446 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c3c15fdb0 con 0x7f6c3c15cdc0 2023-10-14T11:13:10.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.127+0000 7f6c32ffd640 1 -- 172.21.15.26:0/2877656446 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6c3400acd0 con 0x7f6c3c15cdc0 2023-10-14T11:13:10.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.127+0000 7f6c32ffd640 1 --2- 172.21.15.26:0/2877656446 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6c200664a0 0x7f6c20068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:10.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.127+0000 7f6c32ffd640 1 -- 172.21.15.26:0/2877656446 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6c34083630 con 0x7f6c3c15cdc0 2023-10-14T11:13:10.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.127+0000 7f6c42575640 1 --2- 172.21.15.26:0/2877656446 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6c200664a0 0x7f6c20068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:10.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.127+0000 7f6c42575640 1 --2- 172.21.15.26:0/2877656446 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6c200664a0 0x7f6c20068960 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0c9f40 tx=0x7f6c38008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:10.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.131+0000 7f6c32ffd640 1 -- 172.21.15.26:0/2877656446 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6c34050790 con 0x7f6c3c15cdc0 2023-10-14T11:13:10.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.287+0000 7f6c43577640 1 -- 172.21.15.26:0/2877656446 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c3c04e9c0 con 0x7f6c3c15cdc0 2023-10-14T11:13:10.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.287+0000 7f6c32ffd640 1 -- 172.21.15.26:0/2877656446 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c34053db0 con 0x7f6c3c15cdc0 2023-10-14T11:13:10.293 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:10.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.291+0000 7f6c43577640 1 -- 172.21.15.26:0/2877656446 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6c200664a0 msgr2=0x7f6c20068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:10.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.291+0000 7f6c43577640 1 --2- 172.21.15.26:0/2877656446 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6c200664a0 0x7f6c20068960 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0c9f40 tx=0x7f6c38008040 comp rx=0 tx=0).stop 2023-10-14T11:13:10.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.291+0000 7f6c43577640 1 -- 172.21.15.26:0/2877656446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c3c15cdc0 msgr2=0x7f6c3c15d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:10.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.291+0000 7f6c43577640 1 --2- 172.21.15.26:0/2877656446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c3c15cdc0 0x7f6c3c15d680 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6c34001570 tx=0x7f6c3400cca0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.291+0000 7f6c43577640 1 -- 172.21.15.26:0/2877656446 shutdown_connections 2023-10-14T11:13:10.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.291+0000 7f6c43577640 1 --2- 172.21.15.26:0/2877656446 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6c200664a0 0x7f6c20068960 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.291+0000 7f6c43577640 1 --2- 172.21.15.26:0/2877656446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c3c15cdc0 0x7f6c3c15d680 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.291+0000 7f6c43577640 1 --2- 172.21.15.26:0/2877656446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c3c0d3320 0x7f6c3c154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.291+0000 7f6c43577640 1 --2- 172.21.15.26:0/2877656446 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c3c0cf210 0x7f6c3c15e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.291+0000 7f6c43577640 1 -- 172.21.15.26:0/2877656446 >> 172.21.15.26:0/2877656446 conn(0x7f6c3c0d2800 msgr2=0x7f6c3c06c810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:10.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.291+0000 7f6c43577640 1 -- 172.21.15.26:0/2877656446 shutdown_connections 2023-10-14T11:13:10.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.291+0000 7f6c43577640 1 -- 172.21.15.26:0/2877656446 wait complete. 2023-10-14T11:13:10.314 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:13:10.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.459+0000 7f2ff43f1640 1 Processor -- start 2023-10-14T11:13:10.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.459+0000 7f2ff43f1640 1 -- start start 2023-10-14T11:13:10.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.459+0000 7f2ff43f1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fec069e90 0x7f2fec06d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:10.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.459+0000 7f2ff43f1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2fec0c26b0 0x7f2fec0c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:10.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.459+0000 7f2ff43f1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fec15ae30 con 0x7f2fec06a270 2023-10-14T11:13:10.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.459+0000 7f2ff43f1640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fec0cb090 con 0x7f2fec0c26b0 2023-10-14T11:13:10.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.459+0000 7f2ff43f1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec0ca510 con 0x7f2fec069e90 2023-10-14T11:13:10.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.459+0000 7f2ff298e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2fec0c26b0 0x7f2fec0c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:10.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.459+0000 7f2ff298e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2fec0c26b0 0x7f2fec0c2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49326/0 (socket says 172.21.15.26:49326) 2023-10-14T11:13:10.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.459+0000 7f2ff298e640 1 -- 172.21.15.26:0/3702163394 learned_addr learned my addr 172.21.15.26:0/3702163394 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:10.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.459+0000 7f2ff218d640 1 --2- 172.21.15.26:0/3702163394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fec069e90 0x7f2fec06d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:10.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.463+0000 7f2ff298e640 1 -- 172.21.15.26:0/3702163394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fec069e90 msgr2=0x7f2fec06d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:10.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.463+0000 7f2ff298e640 1 --2- 172.21.15.26:0/3702163394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fec069e90 0x7f2fec06d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.463+0000 7f2ff298e640 1 -- 172.21.15.26:0/3702163394 >> v1:172.21.15.110:6789/0 conn(0x7f2fec06a270 legacy=0x7f2fec0c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:10.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.463+0000 7f2ff298e640 1 -- 172.21.15.26:0/3702163394 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec0ca7f0 con 0x7f2fec0c26b0 2023-10-14T11:13:10.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.463+0000 7f2ff298e640 1 --2- 172.21.15.26:0/3702163394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0c26b0 0x7f2fec0c2b40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009e50 tx=0x7f2fe401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a2d1a18a57e994 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:10.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.463+0000 7f2ff118b640 1 -- 172.21.15.26:0/3702163394 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe40a58a0 con 0x7f2fec0c26b0 2023-10-14T11:13:10.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.463+0000 7f2ff118b640 1 -- 172.21.15.26:0/3702163394 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe40a5a00 con 0x7f2fec0c26b0 2023-10-14T11:13:10.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.463+0000 7f2ff118b640 1 -- 172.21.15.26:0/3702163394 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe40a5d90 con 0x7f2fec0c26b0 2023-10-14T11:13:10.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.463+0000 7f2ff43f1640 1 -- 172.21.15.26:0/3702163394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0c26b0 msgr2=0x7f2fec0c2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:10.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.463+0000 7f2ff43f1640 1 --2- 172.21.15.26:0/3702163394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0c26b0 0x7f2fec0c2b40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009e50 tx=0x7f2fe401c9e0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.463+0000 7f2ff43f1640 1 -- 172.21.15.26:0/3702163394 shutdown_connections 2023-10-14T11:13:10.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.463+0000 7f2ff43f1640 1 --2- 172.21.15.26:0/3702163394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0c26b0 0x7f2fec0c2b40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.463+0000 7f2ff43f1640 1 --2- 172.21.15.26:0/3702163394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fec069e90 0x7f2fec06d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.463+0000 7f2ff43f1640 1 -- 172.21.15.26:0/3702163394 >> 172.21.15.26:0/3702163394 conn(0x7f2fec0b0da0 msgr2=0x7f2fec0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:10.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.463+0000 7f2ff43f1640 1 -- 172.21.15.26:0/3702163394 shutdown_connections 2023-10-14T11:13:10.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2ff43f1640 1 -- 172.21.15.26:0/3702163394 wait complete. 2023-10-14T11:13:10.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2ff43f1640 1 Processor -- start 2023-10-14T11:13:10.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2ff43f1640 1 -- start start 2023-10-14T11:13:10.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2ff43f1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fec069e90 0x7f2fec14d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:10.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2ff43f1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fec06a270 0x7f2fec0abe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:10.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2ff43f1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0c26b0 0x7f2fec0c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:10.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2ff43f1640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec15ced0 con 0x7f2fec0c26b0 2023-10-14T11:13:10.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2ff43f1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec15d1b0 con 0x7f2fec06a270 2023-10-14T11:13:10.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2ff43f1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec15d490 con 0x7f2fec069e90 2023-10-14T11:13:10.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2ff298e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0c26b0 0x7f2fec0c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:10.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2ff298e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0c26b0 0x7f2fec0c93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49336/0 (socket says 172.21.15.26:49336) 2023-10-14T11:13:10.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2ff298e640 1 -- 172.21.15.26:0/1735054930 learned_addr learned my addr 172.21.15.26:0/1735054930 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:10.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2ff218d640 1 --2- 172.21.15.26:0/1735054930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fec069e90 0x7f2fec14d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:10.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2ff198c640 1 --2- 172.21.15.26:0/1735054930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fec06a270 0x7f2fec0abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:10.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2ff298e640 1 -- 172.21.15.26:0/1735054930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fec069e90 msgr2=0x7f2fec14d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:10.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2ff298e640 1 --2- 172.21.15.26:0/1735054930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fec069e90 0x7f2fec14d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2ff298e640 1 -- 172.21.15.26:0/1735054930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fec06a270 msgr2=0x7f2fec0abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:10.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2ff298e640 1 --2- 172.21.15.26:0/1735054930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fec06a270 0x7f2fec0abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2ff298e640 1 -- 172.21.15.26:0/1735054930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe4009b30 con 0x7f2fec0c26b0 2023-10-14T11:13:10.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2ff298e640 1 --2- 172.21.15.26:0/1735054930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0c26b0 0x7f2fec0c93f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40af040 tx=0x7f2fe4019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:10.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2fe2ffd640 1 -- 172.21.15.26:0/1735054930 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe40b8670 con 0x7f2fec0c26b0 2023-10-14T11:13:10.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2fe2ffd640 1 -- 172.21.15.26:0/1735054930 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe40b8810 con 0x7f2fec0c26b0 2023-10-14T11:13:10.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.467+0000 7f2fe2ffd640 1 -- 172.21.15.26:0/1735054930 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe40b8bc0 con 0x7f2fec0c26b0 2023-10-14T11:13:10.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.471+0000 7f2ff43f1640 1 -- 172.21.15.26:0/1735054930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fec0cc3f0 con 0x7f2fec0c26b0 2023-10-14T11:13:10.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.471+0000 7f2ff43f1640 1 -- 172.21.15.26:0/1735054930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fec0ac3c0 con 0x7f2fec0c26b0 2023-10-14T11:13:10.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.471+0000 7f2ff43f1640 1 -- 172.21.15.26:0/1735054930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fec04e170 con 0x7f2fec0c26b0 2023-10-14T11:13:10.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.471+0000 7f2fe2ffd640 1 -- 172.21.15.26:0/1735054930 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2fe40b8d20 con 0x7f2fec0c26b0 2023-10-14T11:13:10.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.471+0000 7f2fe2ffd640 1 --2- 172.21.15.26:0/1735054930 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2fd00664a0 0x7f2fd0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:10.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.471+0000 7f2fe2ffd640 1 -- 172.21.15.26:0/1735054930 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2fe411f7f0 con 0x7f2fec0c26b0 2023-10-14T11:13:10.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.471+0000 7f2ff218d640 1 --2- 172.21.15.26:0/1735054930 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2fd00664a0 0x7f2fd0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:10.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.471+0000 7f2ff218d640 1 --2- 172.21.15.26:0/1735054930 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2fd00664a0 0x7f2fd0068960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8006aa0 tx=0x7f2fe8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:10.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.475+0000 7f2fe2ffd640 1 -- 172.21.15.26:0/1735054930 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2fe40eca80 con 0x7f2fec0c26b0 2023-10-14T11:13:10.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.635+0000 7f2ff43f1640 1 -- 172.21.15.26:0/1735054930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2fec0cc8a0 con 0x7f2fec0c26b0 2023-10-14T11:13:10.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.635+0000 7f2fe2ffd640 1 -- 172.21.15.26:0/1735054930 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2fe40f00a0 con 0x7f2fec0c26b0 2023-10-14T11:13:10.642 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:13:10.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.639+0000 7f2ff43f1640 1 -- 172.21.15.26:0/1735054930 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2fd00664a0 msgr2=0x7f2fd0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:10.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.639+0000 7f2ff43f1640 1 --2- 172.21.15.26:0/1735054930 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2fd00664a0 0x7f2fd0068960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8006aa0 tx=0x7f2fe8008040 comp rx=0 tx=0).stop 2023-10-14T11:13:10.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.639+0000 7f2ff43f1640 1 -- 172.21.15.26:0/1735054930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0c26b0 msgr2=0x7f2fec0c93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:10.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.639+0000 7f2ff43f1640 1 --2- 172.21.15.26:0/1735054930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0c26b0 0x7f2fec0c93f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40af040 tx=0x7f2fe4019780 comp rx=0 tx=0).stop 2023-10-14T11:13:10.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.639+0000 7f2ff43f1640 1 -- 172.21.15.26:0/1735054930 shutdown_connections 2023-10-14T11:13:10.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.639+0000 7f2ff43f1640 1 --2- 172.21.15.26:0/1735054930 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2fd00664a0 0x7f2fd0068960 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.639+0000 7f2ff43f1640 1 --2- 172.21.15.26:0/1735054930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0c26b0 0x7f2fec0c93f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.639+0000 7f2ff43f1640 1 --2- 172.21.15.26:0/1735054930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fec06a270 0x7f2fec0abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.639+0000 7f2ff43f1640 1 --2- 172.21.15.26:0/1735054930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fec069e90 0x7f2fec14d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.639+0000 7f2ff43f1640 1 -- 172.21.15.26:0/1735054930 >> 172.21.15.26:0/1735054930 conn(0x7f2fec0b0da0 msgr2=0x7f2fec0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:10.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.639+0000 7f2ff43f1640 1 -- 172.21.15.26:0/1735054930 shutdown_connections 2023-10-14T11:13:10.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.639+0000 7f2ff43f1640 1 -- 172.21.15.26:0/1735054930 wait complete. 2023-10-14T11:13:10.662 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T11:13:10.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.803+0000 7f631b06b640 1 Processor -- start 2023-10-14T11:13:10.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.803+0000 7f631b06b640 1 -- start start 2023-10-14T11:13:10.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.807+0000 7f631b06b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f63140ab870 0x7f6314069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:10.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.807+0000 7f631b06b640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f631406a800 con 0x7f631406a3d0 2023-10-14T11:13:10.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.807+0000 7f631b06b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63140abd00 con 0x7f631415cbc0 2023-10-14T11:13:10.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.807+0000 7f631b06b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6314161390 con 0x7f63140ab870 2023-10-14T11:13:10.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.807+0000 7f6313fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f63140ab870 0x7f6314069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:10.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.807+0000 7f6313fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f63140ab870 0x7f6314069e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49350/0 (socket says 172.21.15.26:49350) 2023-10-14T11:13:10.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.807+0000 7f6313fff640 1 -- 172.21.15.26:0/1022432461 learned_addr learned my addr 172.21.15.26:0/1022432461 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:10.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.807+0000 7f6313fff640 1 -- 172.21.15.26:0/1022432461 >> v1:172.21.15.110:6789/0 conn(0x7f631415cbc0 legacy=0x7f6314160860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:10.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.807+0000 7f6313fff640 1 -- 172.21.15.26:0/1022432461 >> v1:172.21.15.26:6789/0 conn(0x7f631406a3d0 legacy=0x7f63140cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:10.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.807+0000 7f6313fff640 1 -- 172.21.15.26:0/1022432461 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63140ccda0 con 0x7f63140ab870 2023-10-14T11:13:10.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.807+0000 7f63137fe640 1 -- 172.21.15.26:0/1022432461 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1210067858 0 0) 0x7f631406a800 con 0x7f631406a3d0 2023-10-14T11:13:10.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.807+0000 7f6313fff640 1 --2- 172.21.15.26:0/1022432461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63140ab870 0x7f6314069e90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6300009870 tx=0x7f630001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f1d86b37aa5c79 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:10.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.811+0000 7f63137fe640 1 -- 172.21.15.26:0/1022432461 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63000ab680 con 0x7f63140ab870 2023-10-14T11:13:10.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.811+0000 7f63137fe640 1 -- 172.21.15.26:0/1022432461 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63000ab7e0 con 0x7f63140ab870 2023-10-14T11:13:10.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.811+0000 7f63137fe640 1 -- 172.21.15.26:0/1022432461 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63000abb70 con 0x7f63140ab870 2023-10-14T11:13:10.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.811+0000 7f631b06b640 1 -- 172.21.15.26:0/1022432461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63140ab870 msgr2=0x7f6314069e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:10.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.811+0000 7f631b06b640 1 --2- 172.21.15.26:0/1022432461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63140ab870 0x7f6314069e90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6300009870 tx=0x7f630001c480 comp rx=0 tx=0).stop 2023-10-14T11:13:10.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.811+0000 7f631b06b640 1 -- 172.21.15.26:0/1022432461 shutdown_connections 2023-10-14T11:13:10.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.811+0000 7f631b06b640 1 --2- 172.21.15.26:0/1022432461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63140ab870 0x7f6314069e90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.811+0000 7f631b06b640 1 -- 172.21.15.26:0/1022432461 >> 172.21.15.26:0/1022432461 conn(0x7f63140b0da0 msgr2=0x7f63140ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:10.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.811+0000 7f631b06b640 1 -- 172.21.15.26:0/1022432461 shutdown_connections 2023-10-14T11:13:10.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.811+0000 7f631b06b640 1 -- 172.21.15.26:0/1022432461 wait complete. 2023-10-14T11:13:10.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.811+0000 7f631b06b640 1 Processor -- start 2023-10-14T11:13:10.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.811+0000 7f631b06b640 1 -- start start 2023-10-14T11:13:10.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.811+0000 7f631b06b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f631406a3d0 0x7f63140b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:10.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.811+0000 7f631b06b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63140ab870 0x7f6314152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:10.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.811+0000 7f631b06b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f631415cbc0 0x7f6314150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:10.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.811+0000 7f631b06b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63140afa70 con 0x7f631406a3d0 2023-10-14T11:13:10.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.811+0000 7f631b06b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63140aedf0 con 0x7f631415cbc0 2023-10-14T11:13:10.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.811+0000 7f631b06b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63140af0d0 con 0x7f63140ab870 2023-10-14T11:13:10.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.815+0000 7f6318e07640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f631406a3d0 0x7f63140b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:10.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.815+0000 7f6318e07640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f631406a3d0 0x7f63140b2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49358/0 (socket says 172.21.15.26:49358) 2023-10-14T11:13:10.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.815+0000 7f6318e07640 1 -- 172.21.15.26:0/1776674411 learned_addr learned my addr 172.21.15.26:0/1776674411 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:10.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.815+0000 7f6319608640 1 --2- 172.21.15.26:0/1776674411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f631415cbc0 0x7f6314150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:10.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.815+0000 7f6313fff640 1 --2- 172.21.15.26:0/1776674411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63140ab870 0x7f6314152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:10.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.815+0000 7f6318e07640 1 -- 172.21.15.26:0/1776674411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63140ab870 msgr2=0x7f6314152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:10.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.815+0000 7f6318e07640 1 --2- 172.21.15.26:0/1776674411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63140ab870 0x7f6314152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.815+0000 7f6318e07640 1 -- 172.21.15.26:0/1776674411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f631415cbc0 msgr2=0x7f6314150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:10.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.815+0000 7f6318e07640 1 --2- 172.21.15.26:0/1776674411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f631415cbc0 0x7f6314150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.815+0000 7f6318e07640 1 -- 172.21.15.26:0/1776674411 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63000094d0 con 0x7f631406a3d0 2023-10-14T11:13:10.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.815+0000 7f6318e07640 1 --2- 172.21.15.26:0/1776674411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f631406a3d0 0x7f63140b2f40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f630800c3c0 tx=0x7f630800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:10.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.815+0000 7f63117fa640 1 -- 172.21.15.26:0/1776674411 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63080052d0 con 0x7f631406a3d0 2023-10-14T11:13:10.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.815+0000 7f63117fa640 1 -- 172.21.15.26:0/1776674411 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6308005430 con 0x7f631406a3d0 2023-10-14T11:13:10.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.815+0000 7f63117fa640 1 -- 172.21.15.26:0/1776674411 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308003840 con 0x7f631406a3d0 2023-10-14T11:13:10.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.815+0000 7f631b06b640 1 -- 172.21.15.26:0/1776674411 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63140af3b0 con 0x7f631406a3d0 2023-10-14T11:13:10.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.815+0000 7f631b06b640 1 -- 172.21.15.26:0/1776674411 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63140b3480 con 0x7f631406a3d0 2023-10-14T11:13:10.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.815+0000 7f631b06b640 1 -- 172.21.15.26:0/1776674411 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63140afbb0 con 0x7f631406a3d0 2023-10-14T11:13:10.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.815+0000 7f63117fa640 1 -- 172.21.15.26:0/1776674411 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f63080039a0 con 0x7f631406a3d0 2023-10-14T11:13:10.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.815+0000 7f63117fa640 1 --2- 172.21.15.26:0/1776674411 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62f8066520 0x7f62f80689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:10.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.819+0000 7f63117fa640 1 -- 172.21.15.26:0/1776674411 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6308083650 con 0x7f631406a3d0 2023-10-14T11:13:10.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.819+0000 7f6313fff640 1 --2- 172.21.15.26:0/1776674411 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62f8066520 0x7f62f80689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:10.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.819+0000 7f6313fff640 1 --2- 172.21.15.26:0/1776674411 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62f8066520 0x7f62f80689e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f63000af000 tx=0x7f63000b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:10.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.823+0000 7f63117fa640 1 -- 172.21.15.26:0/1776674411 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f63140afbb0 con 0x7f631406a3d0 2023-10-14T11:13:10.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.983+0000 7f631b06b640 1 -- 172.21.15.26:0/1776674411 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f631404e170 con 0x7f631406a3d0 2023-10-14T11:13:10.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.983+0000 7f63117fa640 1 -- 172.21.15.26:0/1776674411 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6308050830 con 0x7f631406a3d0 2023-10-14T11:13:10.987 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:10.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.983+0000 7f631b06b640 1 -- 172.21.15.26:0/1776674411 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62f8066520 msgr2=0x7f62f80689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:10.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.983+0000 7f631b06b640 1 --2- 172.21.15.26:0/1776674411 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62f8066520 0x7f62f80689e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f63000af000 tx=0x7f63000b6040 comp rx=0 tx=0).stop 2023-10-14T11:13:10.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.983+0000 7f631b06b640 1 -- 172.21.15.26:0/1776674411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f631406a3d0 msgr2=0x7f63140b2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:10.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.983+0000 7f631b06b640 1 --2- 172.21.15.26:0/1776674411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f631406a3d0 0x7f63140b2f40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f630800c3c0 tx=0x7f630800c880 comp rx=0 tx=0).stop 2023-10-14T11:13:10.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.983+0000 7f631b06b640 1 -- 172.21.15.26:0/1776674411 shutdown_connections 2023-10-14T11:13:10.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.983+0000 7f631b06b640 1 --2- 172.21.15.26:0/1776674411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f631415cbc0 0x7f6314150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.983+0000 7f631b06b640 1 --2- 172.21.15.26:0/1776674411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63140ab870 0x7f6314152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.983+0000 7f631b06b640 1 --2- 172.21.15.26:0/1776674411 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62f8066520 0x7f62f80689e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.983+0000 7f631b06b640 1 --2- 172.21.15.26:0/1776674411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f631406a3d0 0x7f63140b2f40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:10.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.983+0000 7f631b06b640 1 -- 172.21.15.26:0/1776674411 >> 172.21.15.26:0/1776674411 conn(0x7f63140b0da0 msgr2=0x7f6314153c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:10.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.983+0000 7f631b06b640 1 -- 172.21.15.26:0/1776674411 shutdown_connections 2023-10-14T11:13:10.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:10.983+0000 7f631b06b640 1 -- 172.21.15.26:0/1776674411 wait complete. 2023-10-14T11:13:11.009 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:13:11.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.147+0000 7f021c0d6640 1 Processor -- start 2023-10-14T11:13:11.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.147+0000 7f021c0d6640 1 -- start start 2023-10-14T11:13:11.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.147+0000 7f021c0d6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0214070c40 0x7f021415ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:11.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.147+0000 7f021c0d6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021415be60 con 0x7f02140b07f0 2023-10-14T11:13:11.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.147+0000 7f021c0d6640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021415c1f0 con 0x7f02140b4020 2023-10-14T11:13:11.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.147+0000 7f021c0d6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021415b3b0 con 0x7f0214070c40 2023-10-14T11:13:11.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.147+0000 7f021a673640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f02140b07f0 0x7f0214164490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53114/0 (socket says 172.21.15.26:53114) 2023-10-14T11:13:11.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.147+0000 7f021a673640 1 -- 172.21.15.26:0/4042934659 learned_addr learned my addr 172.21.15.26:0/4042934659 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:11.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.151+0000 7f0219e72640 1 --2- 172.21.15.26:0/4042934659 >> v2:172.21.15.110:3300/0 conn(0x7f0214070c40 0x7f021415ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:11.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.151+0000 7f0218e70640 1 -- 172.21.15.26:0/4042934659 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679139980 0 0) 0x7f021415be60 con 0x7f02140b07f0 2023-10-14T11:13:11.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.151+0000 7f0218e70640 1 -- 172.21.15.26:0/4042934659 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0200003530 con 0x7f02140b07f0 2023-10-14T11:13:11.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.151+0000 7f0219e72640 1 -- 172.21.15.26:0/4042934659 >> v1:172.21.15.110:6789/0 conn(0x7f02140b4020 legacy=0x7f02140b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:11.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.151+0000 7f0219e72640 1 -- 172.21.15.26:0/4042934659 >> v1:172.21.15.26:6789/0 conn(0x7f02140b07f0 legacy=0x7f0214164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:11.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.151+0000 7f0219e72640 1 -- 172.21.15.26:0/4042934659 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0214071020 con 0x7f0214070c40 2023-10-14T11:13:11.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.151+0000 7f0219e72640 1 --2- 172.21.15.26:0/4042934659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0214070c40 0x7f021415ae70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f02100097c0 tx=0x7f021001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9548b689dc6fc690 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:11.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.151+0000 7f0218e70640 1 -- 172.21.15.26:0/4042934659 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02100ab5f0 con 0x7f0214070c40 2023-10-14T11:13:11.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.151+0000 7f0218e70640 1 -- 172.21.15.26:0/4042934659 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02100ab750 con 0x7f0214070c40 2023-10-14T11:13:11.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.155+0000 7f0218e70640 1 -- 172.21.15.26:0/4042934659 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02100abae0 con 0x7f0214070c40 2023-10-14T11:13:11.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.155+0000 7f021c0d6640 1 -- 172.21.15.26:0/4042934659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0214070c40 msgr2=0x7f021415ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:11.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.155+0000 7f021c0d6640 1 --2- 172.21.15.26:0/4042934659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0214070c40 0x7f021415ae70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f02100097c0 tx=0x7f021001c3f0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.155+0000 7f021c0d6640 1 -- 172.21.15.26:0/4042934659 shutdown_connections 2023-10-14T11:13:11.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.155+0000 7f021c0d6640 1 --2- 172.21.15.26:0/4042934659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0214070c40 0x7f021415ae70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.155+0000 7f021c0d6640 1 -- 172.21.15.26:0/4042934659 >> 172.21.15.26:0/4042934659 conn(0x7f021406c190 msgr2=0x7f021406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:11.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.155+0000 7f021c0d6640 1 -- 172.21.15.26:0/4042934659 shutdown_connections 2023-10-14T11:13:11.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.155+0000 7f021c0d6640 1 -- 172.21.15.26:0/4042934659 wait complete. 2023-10-14T11:13:11.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.155+0000 7f021c0d6640 1 Processor -- start 2023-10-14T11:13:11.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.155+0000 7f021c0d6640 1 -- start start 2023-10-14T11:13:11.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.155+0000 7f021c0d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0214070c40 0x7f02140c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:11.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.155+0000 7f021c0d6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02140b07f0 0x7f021413f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:11.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.155+0000 7f021c0d6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02140b4020 0x7f02140c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:11.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.155+0000 7f021c0d6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021413d4b0 con 0x7f0214070c40 2023-10-14T11:13:11.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.155+0000 7f021c0d6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021413d790 con 0x7f02140b4020 2023-10-14T11:13:11.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.155+0000 7f021c0d6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021413da70 con 0x7f02140b07f0 2023-10-14T11:13:11.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.155+0000 7f0219e72640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0214070c40 0x7f02140c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:11.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.155+0000 7f0219e72640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0214070c40 0x7f02140c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49374/0 (socket says 172.21.15.26:49374) 2023-10-14T11:13:11.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.155+0000 7f0219e72640 1 -- 172.21.15.26:0/2825021722 learned_addr learned my addr 172.21.15.26:0/2825021722 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:11.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.159+0000 7f0219671640 1 --2- 172.21.15.26:0/2825021722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02140b07f0 0x7f021413f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:11.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.159+0000 7f021a673640 1 --2- 172.21.15.26:0/2825021722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02140b4020 0x7f02140c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:11.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.159+0000 7f0219e72640 1 -- 172.21.15.26:0/2825021722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02140b07f0 msgr2=0x7f021413f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:11.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.159+0000 7f0219e72640 1 --2- 172.21.15.26:0/2825021722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02140b07f0 0x7f021413f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.159+0000 7f0219e72640 1 -- 172.21.15.26:0/2825021722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02140b4020 msgr2=0x7f02140c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:11.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.159+0000 7f0219e72640 1 --2- 172.21.15.26:0/2825021722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02140b4020 0x7f02140c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.159+0000 7f0219e72640 1 -- 172.21.15.26:0/2825021722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0210009420 con 0x7f0214070c40 2023-10-14T11:13:11.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.159+0000 7f0219e72640 1 --2- 172.21.15.26:0/2825021722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0214070c40 0x7f02140c24d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f02100ad040 tx=0x7f021001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:11.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.159+0000 7f020a7fc640 1 -- 172.21.15.26:0/2825021722 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02100bf610 con 0x7f0214070c40 2023-10-14T11:13:11.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.159+0000 7f020a7fc640 1 -- 172.21.15.26:0/2825021722 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02100bf770 con 0x7f0214070c40 2023-10-14T11:13:11.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.159+0000 7f020a7fc640 1 -- 172.21.15.26:0/2825021722 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02100bfb20 con 0x7f0214070c40 2023-10-14T11:13:11.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.159+0000 7f021c0d6640 1 -- 172.21.15.26:0/2825021722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021413dd50 con 0x7f0214070c40 2023-10-14T11:13:11.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.159+0000 7f021c0d6640 1 -- 172.21.15.26:0/2825021722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0214151c30 con 0x7f0214070c40 2023-10-14T11:13:11.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.159+0000 7f021c0d6640 1 -- 172.21.15.26:0/2825021722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0214074010 con 0x7f0214070c40 2023-10-14T11:13:11.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.159+0000 7f020a7fc640 1 -- 172.21.15.26:0/2825021722 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f02100bfc80 con 0x7f0214070c40 2023-10-14T11:13:11.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.159+0000 7f020a7fc640 1 --2- 172.21.15.26:0/2825021722 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f01f80664a0 0x7f01f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:11.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.159+0000 7f020a7fc640 1 -- 172.21.15.26:0/2825021722 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f02100a8050 con 0x7f0214070c40 2023-10-14T11:13:11.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.159+0000 7f0219671640 1 --2- 172.21.15.26:0/2825021722 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f01f80664a0 0x7f01f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:11.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.163+0000 7f0219671640 1 --2- 172.21.15.26:0/2825021722 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f01f80664a0 0x7f01f8068960 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f02140cdf10 tx=0x7f0204009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:11.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.163+0000 7f020a7fc640 1 -- 172.21.15.26:0/2825021722 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f02100ebaa0 con 0x7f0214070c40 2023-10-14T11:13:11.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.323+0000 7f021c0d6640 1 -- 172.21.15.26:0/2825021722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f021413e200 con 0x7f0214070c40 2023-10-14T11:13:11.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.327+0000 7f020a7fc640 1 -- 172.21.15.26:0/2825021722 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18679 (secure 0 0 0) 0x7f02100ef0c0 con 0x7f0214070c40 2023-10-14T11:13:11.330 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:11.330 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":27,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:13:03.866737+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:13:11.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.327+0000 7f021c0d6640 1 -- 172.21.15.26:0/2825021722 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f01f80664a0 msgr2=0x7f01f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:11.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.327+0000 7f021c0d6640 1 --2- 172.21.15.26:0/2825021722 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f01f80664a0 0x7f01f8068960 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f02140cdf10 tx=0x7f0204009040 comp rx=0 tx=0).stop 2023-10-14T11:13:11.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.327+0000 7f021c0d6640 1 -- 172.21.15.26:0/2825021722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0214070c40 msgr2=0x7f02140c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:11.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.327+0000 7f021c0d6640 1 --2- 172.21.15.26:0/2825021722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0214070c40 0x7f02140c24d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f02100ad040 tx=0x7f021001ac30 comp rx=0 tx=0).stop 2023-10-14T11:13:11.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.327+0000 7f021c0d6640 1 -- 172.21.15.26:0/2825021722 shutdown_connections 2023-10-14T11:13:11.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.327+0000 7f021c0d6640 1 --2- 172.21.15.26:0/2825021722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02140b4020 0x7f02140c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.327+0000 7f021c0d6640 1 --2- 172.21.15.26:0/2825021722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02140b07f0 0x7f021413f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.327+0000 7f021c0d6640 1 --2- 172.21.15.26:0/2825021722 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f01f80664a0 0x7f01f8068960 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.327+0000 7f021c0d6640 1 --2- 172.21.15.26:0/2825021722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0214070c40 0x7f02140c24d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.327+0000 7f021c0d6640 1 -- 172.21.15.26:0/2825021722 >> 172.21.15.26:0/2825021722 conn(0x7f021406c190 msgr2=0x7f02140afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:11.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.327+0000 7f021c0d6640 1 -- 172.21.15.26:0/2825021722 shutdown_connections 2023-10-14T11:13:11.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.327+0000 7f021c0d6640 1 -- 172.21.15.26:0/2825021722 wait complete. 2023-10-14T11:13:11.352 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:12:20.179562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:12:21.346111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T11:12:25.025159+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T11:13:11.353 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:13:11.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.495+0000 7f07e8f3e640 1 Processor -- start 2023-10-14T11:13:11.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.495+0000 7f07e8f3e640 1 -- start start 2023-10-14T11:13:11.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.495+0000 7f07e8f3e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f07e415cba0 0x7f07e40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:11.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.495+0000 7f07e8f3e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e40d1670 con 0x7f07e40b84e0 2023-10-14T11:13:11.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.495+0000 7f07e8f3e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e40d1950 con 0x7f07e40d0210 2023-10-14T11:13:11.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.495+0000 7f07e8f3e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e40d1460 con 0x7f07e415cba0 2023-10-14T11:13:11.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.495+0000 7f07e1d9b640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f07e40b84e0 0x7f07e40cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53122/0 (socket says 172.21.15.26:53122) 2023-10-14T11:13:11.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.495+0000 7f07e1d9b640 1 -- 172.21.15.26:0/2615433962 learned_addr learned my addr 172.21.15.26:0/2615433962 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:11.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.495+0000 7f07e259c640 1 --2- 172.21.15.26:0/2615433962 >> v2:172.21.15.110:3300/0 conn(0x7f07e415cba0 0x7f07e40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:11.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.495+0000 7f07e159a640 1 -- 172.21.15.26:0/2615433962 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164350233 0 0) 0x7f07e40d1670 con 0x7f07e40b84e0 2023-10-14T11:13:11.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.495+0000 7f07e159a640 1 -- 172.21.15.26:0/2615433962 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07cc003530 con 0x7f07e40b84e0 2023-10-14T11:13:11.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.495+0000 7f07e159a640 1 -- 172.21.15.26:0/2615433962 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2302727449 0 0) 0x7f07cc003530 con 0x7f07e40b84e0 2023-10-14T11:13:11.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.495+0000 7f07e159a640 1 -- 172.21.15.26:0/2615433962 >> v2:172.21.15.110:3300/0 conn(0x7f07e415cba0 msgr2=0x7f07e40d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:11.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.495+0000 7f07e159a640 1 --2- 172.21.15.26:0/2615433962 >> v2:172.21.15.110:3300/0 conn(0x7f07e415cba0 0x7f07e40d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.495+0000 7f07e159a640 1 -- 172.21.15.26:0/2615433962 >> v1:172.21.15.110:6789/0 conn(0x7f07e40d0210 legacy=0x7f07e40b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:11.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.495+0000 7f07e159a640 1 -- 172.21.15.26:0/2615433962 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e40d1c30 con 0x7f07e40b84e0 2023-10-14T11:13:11.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.495+0000 7f07e159a640 1 -- 172.21.15.26:0/2615433962 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f07d8001680 con 0x7f07e40b84e0 2023-10-14T11:13:11.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.495+0000 7f07e259c640 1 --2- 172.21.15.26:0/2615433962 >> v2:172.21.15.110:3300/0 conn(0x7f07e415cba0 0x7f07e40d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:13:11.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.499+0000 7f07e159a640 1 -- 172.21.15.26:0/2615433962 >> v1:172.21.15.26:6789/0 conn(0x7f07e40b84e0 legacy=0x7f07e40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:11.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.499+0000 7f07e159a640 1 --2- 172.21.15.26:0/2615433962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07cc003980 0x7f07cc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:11.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.499+0000 7f07e159a640 1 --2- 172.21.15.26:0/2615433962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07cc0047d0 0x7f07cc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:11.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.499+0000 7f07e159a640 1 --2- 172.21.15.26:0/2615433962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07cc005190 0x7f07cc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:11.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.499+0000 7f07e159a640 1 -- 172.21.15.26:0/2615433962 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e40d1460 con 0x7f07cc005190 2023-10-14T11:13:11.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.499+0000 7f07e159a640 1 -- 172.21.15.26:0/2615433962 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc00c130 con 0x7f07cc003980 2023-10-14T11:13:11.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.499+0000 7f07e159a640 1 -- 172.21.15.26:0/2615433962 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc00c2f0 con 0x7f07cc0047d0 2023-10-14T11:13:11.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.499+0000 7f07e2d9d640 1 --2- 172.21.15.26:0/2615433962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07cc005190 0x7f07cc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:11.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.499+0000 7f07e1d9b640 1 --2- 172.21.15.26:0/2615433962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07cc0047d0 0x7f07cc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:11.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.499+0000 7f07e259c640 1 --2- 172.21.15.26:0/2615433962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07cc003980 0x7f07cc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:11.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.499+0000 7f07e2d9d640 1 -- 172.21.15.26:0/2615433962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07cc0047d0 msgr2=0x7f07cc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:11.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.499+0000 7f07e2d9d640 1 --2- 172.21.15.26:0/2615433962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07cc0047d0 0x7f07cc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.499+0000 7f07e2d9d640 1 -- 172.21.15.26:0/2615433962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07cc003980 msgr2=0x7f07cc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:11.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.499+0000 7f07e2d9d640 1 --2- 172.21.15.26:0/2615433962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07cc003980 0x7f07cc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.499+0000 7f07e2d9d640 1 -- 172.21.15.26:0/2615433962 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07cc003530 con 0x7f07cc005190 2023-10-14T11:13:11.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.499+0000 7f07e2d9d640 1 -- 172.21.15.26:0/2615433962 reap_dead start 2023-10-14T11:13:11.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.499+0000 7f07e2d9d640 1 --2- 172.21.15.26:0/2615433962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07cc005190 0x7f07cc00b990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f07dc001e70 tx=0x7f07dc01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd7f087e082e8a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:11.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.499+0000 7f07e159a640 1 -- 172.21.15.26:0/2615433962 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc003b80 con 0x7f07cc005190 2023-10-14T11:13:11.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.499+0000 7f07e159a640 1 -- 172.21.15.26:0/2615433962 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07dc003d20 con 0x7f07cc005190 2023-10-14T11:13:11.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.499+0000 7f07e159a640 1 -- 172.21.15.26:0/2615433962 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc005310 con 0x7f07cc005190 2023-10-14T11:13:11.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.503+0000 7f07e8f3e640 1 -- 172.21.15.26:0/2615433962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07cc005190 msgr2=0x7f07cc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:11.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.503+0000 7f07e8f3e640 1 --2- 172.21.15.26:0/2615433962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07cc005190 0x7f07cc00b990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f07dc001e70 tx=0x7f07dc01c760 comp rx=0 tx=0).stop 2023-10-14T11:13:11.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.503+0000 7f07e8f3e640 1 -- 172.21.15.26:0/2615433962 shutdown_connections 2023-10-14T11:13:11.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.503+0000 7f07e8f3e640 1 --2- 172.21.15.26:0/2615433962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07cc005190 0x7f07cc00b990 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.503+0000 7f07e8f3e640 1 -- 172.21.15.26:0/2615433962 >> 172.21.15.26:0/2615433962 conn(0x7f07e40719c0 msgr2=0x7f07e4071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:11.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.503+0000 7f07e8f3e640 1 -- 172.21.15.26:0/2615433962 shutdown_connections 2023-10-14T11:13:11.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.503+0000 7f07e8f3e640 1 -- 172.21.15.26:0/2615433962 wait complete. 2023-10-14T11:13:11.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.503+0000 7f07e8f3e640 1 Processor -- start 2023-10-14T11:13:11.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.503+0000 7f07e8f3e640 1 -- start start 2023-10-14T11:13:11.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.503+0000 7f07e8f3e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07cc005190 0x7f07e41f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:11.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.503+0000 7f07e8f3e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07e415cf80 0x7f07e40c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:11.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.503+0000 7f07e8f3e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e41589f0 0x7f07e40c7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:11.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.503+0000 7f07e8f3e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e415e020 con 0x7f07cc005190 2023-10-14T11:13:11.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.503+0000 7f07e8f3e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e415d410 con 0x7f07e415cf80 2023-10-14T11:13:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.503+0000 7f07e8f3e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e415d6f0 con 0x7f07e41589f0 2023-10-14T11:13:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.503+0000 7f07e259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07cc005190 0x7f07e41f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.503+0000 7f07e259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07cc005190 0x7f07e41f4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49394/0 (socket says 172.21.15.26:49394) 2023-10-14T11:13:11.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.503+0000 7f07e259c640 1 -- 172.21.15.26:0/4205562785 learned_addr learned my addr 172.21.15.26:0/4205562785 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:11.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.503+0000 7f07e2d9d640 1 --2- 172.21.15.26:0/4205562785 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e41589f0 0x7f07e40c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:11.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.503+0000 7f07e1d9b640 1 --2- 172.21.15.26:0/4205562785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07e415cf80 0x7f07e40c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:11.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.507+0000 7f07e259c640 1 -- 172.21.15.26:0/4205562785 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e41589f0 msgr2=0x7f07e40c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:11.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.507+0000 7f07e259c640 1 --2- 172.21.15.26:0/4205562785 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e41589f0 0x7f07e40c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.507+0000 7f07e259c640 1 -- 172.21.15.26:0/4205562785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07e415cf80 msgr2=0x7f07e40c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:11.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.507+0000 7f07e259c640 1 --2- 172.21.15.26:0/4205562785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07e415cf80 0x7f07e40c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.507+0000 7f07e259c640 1 -- 172.21.15.26:0/4205562785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e415d9d0 con 0x7f07cc005190 2023-10-14T11:13:11.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.507+0000 7f07e2d9d640 1 --2- 172.21.15.26:0/4205562785 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e41589f0 0x7f07e40c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:11.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.507+0000 7f07e259c640 1 --2- 172.21.15.26:0/4205562785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07cc005190 0x7f07e41f4ab0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f07d4011ca0 tx=0x7f07d400f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:11.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.507+0000 7f07d2ffd640 1 -- 172.21.15.26:0/4205562785 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d400fd20 con 0x7f07cc005190 2023-10-14T11:13:11.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.507+0000 7f07d2ffd640 1 -- 172.21.15.26:0/4205562785 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d400fe80 con 0x7f07cc005190 2023-10-14T11:13:11.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.507+0000 7f07e8f3e640 1 -- 172.21.15.26:0/4205562785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e415dcb0 con 0x7f07cc005190 2023-10-14T11:13:11.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.507+0000 7f07d2ffd640 1 -- 172.21.15.26:0/4205562785 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d4004240 con 0x7f07cc005190 2023-10-14T11:13:11.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.507+0000 7f07e8f3e640 1 -- 172.21.15.26:0/4205562785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e4157ff0 con 0x7f07cc005190 2023-10-14T11:13:11.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.507+0000 7f07e8f3e640 1 -- 172.21.15.26:0/4205562785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e404e170 con 0x7f07cc005190 2023-10-14T11:13:11.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.507+0000 7f07d2ffd640 1 -- 172.21.15.26:0/4205562785 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f07d40043a0 con 0x7f07cc005190 2023-10-14T11:13:11.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.507+0000 7f07d2ffd640 1 --2- 172.21.15.26:0/4205562785 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f07c40664a0 0x7f07c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:11.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.507+0000 7f07d2ffd640 1 -- 172.21.15.26:0/4205562785 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f07d40849f0 con 0x7f07cc005190 2023-10-14T11:13:11.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.507+0000 7f07e1d9b640 1 --2- 172.21.15.26:0/4205562785 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f07c40664a0 0x7f07c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:11.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.511+0000 7f07e1d9b640 1 --2- 172.21.15.26:0/4205562785 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f07c40664a0 0x7f07c4068960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f07e40ce450 tx=0x7f07d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:11.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.511+0000 7f07d2ffd640 1 -- 172.21.15.26:0/4205562785 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f07d4051a10 con 0x7f07cc005190 2023-10-14T11:13:11.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.671+0000 7f07e8f3e640 1 -- 172.21.15.26:0/4205562785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07e40c61e0 con 0x7f07cc005190 2023-10-14T11:13:11.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.671+0000 7f07d2ffd640 1 -- 172.21.15.26:0/4205562785 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f07d4022020 con 0x7f07cc005190 2023-10-14T11:13:11.676 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:13:11.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.671+0000 7f07e8f3e640 1 -- 172.21.15.26:0/4205562785 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f07c40664a0 msgr2=0x7f07c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:11.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.671+0000 7f07e8f3e640 1 --2- 172.21.15.26:0/4205562785 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f07c40664a0 0x7f07c4068960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f07e40ce450 tx=0x7f07d8009040 comp rx=0 tx=0).stop 2023-10-14T11:13:11.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.671+0000 7f07e8f3e640 1 -- 172.21.15.26:0/4205562785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07cc005190 msgr2=0x7f07e41f4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:11.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.671+0000 7f07e8f3e640 1 --2- 172.21.15.26:0/4205562785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07cc005190 0x7f07e41f4ab0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f07d4011ca0 tx=0x7f07d400f610 comp rx=0 tx=0).stop 2023-10-14T11:13:11.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.671+0000 7f07e8f3e640 1 -- 172.21.15.26:0/4205562785 shutdown_connections 2023-10-14T11:13:11.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.671+0000 7f07e8f3e640 1 --2- 172.21.15.26:0/4205562785 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e41589f0 0x7f07e40c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.671+0000 7f07e8f3e640 1 --2- 172.21.15.26:0/4205562785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07e415cf80 0x7f07e40c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.671+0000 7f07e8f3e640 1 --2- 172.21.15.26:0/4205562785 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f07c40664a0 0x7f07c4068960 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.671+0000 7f07e8f3e640 1 --2- 172.21.15.26:0/4205562785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07cc005190 0x7f07e41f4ab0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.671+0000 7f07e8f3e640 1 -- 172.21.15.26:0/4205562785 >> 172.21.15.26:0/4205562785 conn(0x7f07e40719c0 msgr2=0x7f07e40d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:11.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.671+0000 7f07e8f3e640 1 -- 172.21.15.26:0/4205562785 shutdown_connections 2023-10-14T11:13:11.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.671+0000 7f07e8f3e640 1 -- 172.21.15.26:0/4205562785 wait complete. 2023-10-14T11:13:11.700 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:13:11.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.843+0000 7fa281d0e640 1 Processor -- start 2023-10-14T11:13:11.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.843+0000 7fa281d0e640 1 -- start start 2023-10-14T11:13:11.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.843+0000 7fa281d0e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa27c069e90 0x7fa27c06d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:11.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.843+0000 7fa281d0e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa27c06a270 0x7fa27c0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:11.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.843+0000 7fa281d0e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa27c0702f0 0x7fa27c070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:11.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.843+0000 7fa281d0e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa27c0cb090 con 0x7fa27c06a270 2023-10-14T11:13:11.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.843+0000 7fa281d0e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa27c15ae30 con 0x7fa27c0702f0 2023-10-14T11:13:11.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.843+0000 7fa281d0e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0ca510 con 0x7fa27c069e90 2023-10-14T11:13:11.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.843+0000 7fa273fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa27c06a270 0x7fa27c0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:11.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.847+0000 7fa273fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa27c06a270 0x7fa27c0c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49398/0 (socket says 172.21.15.26:49398) 2023-10-14T11:13:11.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.847+0000 7fa273fff640 1 -- 172.21.15.26:0/962718183 learned_addr learned my addr 172.21.15.26:0/962718183 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:11.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.847+0000 7fa27bfff640 1 --2- 172.21.15.26:0/962718183 >> v2:172.21.15.110:3300/0 conn(0x7fa27c0702f0 0x7fa27c070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:11.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.847+0000 7fa27b7fe640 1 --2- 172.21.15.26:0/962718183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa27c069e90 0x7fa27c06d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:11.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.847+0000 7fa273fff640 1 -- 172.21.15.26:0/962718183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa27c069e90 msgr2=0x7fa27c06d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:11.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.847+0000 7fa273fff640 1 --2- 172.21.15.26:0/962718183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa27c069e90 0x7fa27c06d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.847+0000 7fa273fff640 1 -- 172.21.15.26:0/962718183 >> v2:172.21.15.110:3300/0 conn(0x7fa27c0702f0 msgr2=0x7fa27c070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:11.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.847+0000 7fa273fff640 1 --2- 172.21.15.26:0/962718183 >> v2:172.21.15.110:3300/0 conn(0x7fa27c0702f0 0x7fa27c070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.847+0000 7fa273fff640 1 -- 172.21.15.26:0/962718183 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27c0ca7f0 con 0x7fa27c06a270 2023-10-14T11:13:11.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.847+0000 7fa27b7fe640 1 --2- 172.21.15.26:0/962718183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa27c069e90 0x7fa27c06d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:11.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.847+0000 7fa27bfff640 1 --2- 172.21.15.26:0/962718183 >> v2:172.21.15.110:3300/0 conn(0x7fa27c0702f0 0x7fa27c070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:11.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.847+0000 7fa273fff640 1 --2- 172.21.15.26:0/962718183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa27c06a270 0x7fa27c0c9ce0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0b16e0 tx=0x7fa26401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299343ebe054142a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:11.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.847+0000 7fa27affd640 1 -- 172.21.15.26:0/962718183 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2640aa5f0 con 0x7fa27c06a270 2023-10-14T11:13:11.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.847+0000 7fa27affd640 1 -- 172.21.15.26:0/962718183 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2640aa750 con 0x7fa27c06a270 2023-10-14T11:13:11.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.847+0000 7fa27affd640 1 -- 172.21.15.26:0/962718183 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2640aaae0 con 0x7fa27c06a270 2023-10-14T11:13:11.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa281d0e640 1 -- 172.21.15.26:0/962718183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa27c06a270 msgr2=0x7fa27c0c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:11.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa281d0e640 1 --2- 172.21.15.26:0/962718183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa27c06a270 0x7fa27c0c9ce0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0b16e0 tx=0x7fa26401c4d0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa281d0e640 1 -- 172.21.15.26:0/962718183 shutdown_connections 2023-10-14T11:13:11.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa281d0e640 1 --2- 172.21.15.26:0/962718183 >> v2:172.21.15.110:3300/0 conn(0x7fa27c0702f0 0x7fa27c070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa281d0e640 1 --2- 172.21.15.26:0/962718183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa27c06a270 0x7fa27c0c9ce0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa281d0e640 1 --2- 172.21.15.26:0/962718183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa27c069e90 0x7fa27c06d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa281d0e640 1 -- 172.21.15.26:0/962718183 >> 172.21.15.26:0/962718183 conn(0x7fa27c0b0da0 msgr2=0x7fa27c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:11.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa281d0e640 1 -- 172.21.15.26:0/962718183 shutdown_connections 2023-10-14T11:13:11.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa281d0e640 1 -- 172.21.15.26:0/962718183 wait complete. 2023-10-14T11:13:11.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa281d0e640 1 Processor -- start 2023-10-14T11:13:11.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa281d0e640 1 -- start start 2023-10-14T11:13:11.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa281d0e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa27c069e90 0x7fa27c158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:11.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa281d0e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa27c06a270 0x7fa27c1f6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:11.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa281d0e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa27c0702f0 0x7fa27c1571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:11.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa281d0e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0c1a60 con 0x7fa27c0702f0 2023-10-14T11:13:11.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa281d0e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c1f6990 con 0x7fa27c069e90 2023-10-14T11:13:11.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa281d0e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c1f6c70 con 0x7fa27c06a270 2023-10-14T11:13:11.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa27bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa27c0702f0 0x7fa27c1571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:11.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa27bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa27c0702f0 0x7fa27c1571b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49414/0 (socket says 172.21.15.26:49414) 2023-10-14T11:13:11.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa27bfff640 1 -- 172.21.15.26:0/676672170 learned_addr learned my addr 172.21.15.26:0/676672170 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:11.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa27b7fe640 1 --2- 172.21.15.26:0/676672170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa27c069e90 0x7fa27c158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:11.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa273fff640 1 --2- 172.21.15.26:0/676672170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa27c06a270 0x7fa27c1f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:11.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa27bfff640 1 -- 172.21.15.26:0/676672170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa27c06a270 msgr2=0x7fa27c1f6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:11.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa27bfff640 1 --2- 172.21.15.26:0/676672170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa27c06a270 0x7fa27c1f6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa27bfff640 1 -- 172.21.15.26:0/676672170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa27c069e90 msgr2=0x7fa27c158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:11.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa27bfff640 1 --2- 172.21.15.26:0/676672170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa27c069e90 0x7fa27c158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:11.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa27bfff640 1 -- 172.21.15.26:0/676672170 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2640094d0 con 0x7fa27c0702f0 2023-10-14T11:13:11.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.851+0000 7fa27bfff640 1 --2- 172.21.15.26:0/676672170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa27c0702f0 0x7fa27c1571b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa27400cef0 tx=0x7fa27400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:11.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.855+0000 7fa278ff9640 1 -- 172.21.15.26:0/676672170 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27400d840 con 0x7fa27c0702f0 2023-10-14T11:13:11.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.855+0000 7fa278ff9640 1 -- 172.21.15.26:0/676672170 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27400d9c0 con 0x7fa27c0702f0 2023-10-14T11:13:11.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.855+0000 7fa278ff9640 1 -- 172.21.15.26:0/676672170 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27400dd70 con 0x7fa27c0702f0 2023-10-14T11:13:11.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.855+0000 7fa281d0e640 1 -- 172.21.15.26:0/676672170 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa27c1f6f50 con 0x7fa27c0702f0 2023-10-14T11:13:11.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.855+0000 7fa281d0e640 1 -- 172.21.15.26:0/676672170 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa27c15b250 con 0x7fa27c0702f0 2023-10-14T11:13:11.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.855+0000 7fa281d0e640 1 -- 172.21.15.26:0/676672170 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa27c15b440 con 0x7fa27c0702f0 2023-10-14T11:13:11.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.855+0000 7fa278ff9640 1 -- 172.21.15.26:0/676672170 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa27401e3b0 con 0x7fa27c0702f0 2023-10-14T11:13:11.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.855+0000 7fa278ff9640 1 --2- 172.21.15.26:0/676672170 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa25c0664d0 0x7fa25c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:11.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.855+0000 7fa278ff9640 1 -- 172.21.15.26:0/676672170 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa274084c00 con 0x7fa27c0702f0 2023-10-14T11:13:11.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.855+0000 7fa27b7fe640 1 --2- 172.21.15.26:0/676672170 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa25c0664d0 0x7fa25c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:11.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.859+0000 7fa27b7fe640 1 --2- 172.21.15.26:0/676672170 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa25c0664d0 0x7fa25c068990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa26c00aaf0 tx=0x7fa26c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:11.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:11.859+0000 7fa278ff9640 1 -- 172.21.15.26:0/676672170 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa27408b080 con 0x7fa27c0702f0 2023-10-14T11:13:12.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.015+0000 7fa281d0e640 1 -- 172.21.15.26:0/676672170 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa27c04e170 con 0x7fa27c0702f0 2023-10-14T11:13:12.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.019+0000 7fa278ff9640 1 -- 172.21.15.26:0/676672170 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa27401a0a0 con 0x7fa27c0702f0 2023-10-14T11:13:12.022 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:12.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.019+0000 7fa281d0e640 1 -- 172.21.15.26:0/676672170 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa25c0664d0 msgr2=0x7fa25c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:12.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.019+0000 7fa281d0e640 1 --2- 172.21.15.26:0/676672170 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa25c0664d0 0x7fa25c068990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa26c00aaf0 tx=0x7fa26c008040 comp rx=0 tx=0).stop 2023-10-14T11:13:12.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.019+0000 7fa281d0e640 1 -- 172.21.15.26:0/676672170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa27c0702f0 msgr2=0x7fa27c1571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:12.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.019+0000 7fa281d0e640 1 --2- 172.21.15.26:0/676672170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa27c0702f0 0x7fa27c1571b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa27400cef0 tx=0x7fa27400a710 comp rx=0 tx=0).stop 2023-10-14T11:13:12.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.019+0000 7fa281d0e640 1 -- 172.21.15.26:0/676672170 shutdown_connections 2023-10-14T11:13:12.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.019+0000 7fa281d0e640 1 --2- 172.21.15.26:0/676672170 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa25c0664d0 0x7fa25c068990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.019+0000 7fa281d0e640 1 --2- 172.21.15.26:0/676672170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa27c0702f0 0x7fa27c1571b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.019+0000 7fa281d0e640 1 --2- 172.21.15.26:0/676672170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa27c06a270 0x7fa27c1f6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.019+0000 7fa281d0e640 1 --2- 172.21.15.26:0/676672170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa27c069e90 0x7fa27c158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.019+0000 7fa281d0e640 1 -- 172.21.15.26:0/676672170 >> 172.21.15.26:0/676672170 conn(0x7fa27c0b0da0 msgr2=0x7fa27c0c3750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:12.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.019+0000 7fa281d0e640 1 -- 172.21.15.26:0/676672170 shutdown_connections 2023-10-14T11:13:12.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.019+0000 7fa281d0e640 1 -- 172.21.15.26:0/676672170 wait complete. 2023-10-14T11:13:12.043 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:13:12.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.187+0000 7f8ad1b3e640 1 Processor -- start 2023-10-14T11:13:12.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.187+0000 7f8ad1b3e640 1 -- start start 2023-10-14T11:13:12.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.187+0000 7f8ad1b3e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8acc069e90 0x7f8acc06d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:12.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.187+0000 7f8ad1b3e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8acc06a270 0x7f8acc0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:12.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.187+0000 7f8ad1b3e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8acc15ae30 con 0x7f8acc0702f0 2023-10-14T11:13:12.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.187+0000 7f8ad1b3e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8acc0cb090 con 0x7f8acc069e90 2023-10-14T11:13:12.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.187+0000 7f8ad1b3e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc0ca510 con 0x7f8acc06a270 2023-10-14T11:13:12.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.187+0000 7f8acb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8acc069e90 0x7f8acc06d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:12.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.187+0000 7f8acbfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8acc0702f0 0x7f8acc070780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53124/0 (socket says 172.21.15.26:53124) 2023-10-14T11:13:12.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.187+0000 7f8acb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8acc069e90 0x7f8acc06d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49416/0 (socket says 172.21.15.26:49416) 2023-10-14T11:13:12.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.187+0000 7f8acbfff640 1 -- 172.21.15.26:0/851322080 learned_addr learned my addr 172.21.15.26:0/851322080 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:12.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.187+0000 7f8acaffd640 1 --2- 172.21.15.26:0/851322080 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8acc06a270 0x7f8acc0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:12.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.187+0000 7f8acb7fe640 1 -- 172.21.15.26:0/851322080 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8acc06a270 msgr2=0x7f8acc0c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:12.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.187+0000 7f8acb7fe640 1 --2- 172.21.15.26:0/851322080 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8acc06a270 0x7f8acc0c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.187+0000 7f8acb7fe640 1 -- 172.21.15.26:0/851322080 >> v1:172.21.15.26:6789/0 conn(0x7f8acc0702f0 legacy=0x7f8acc070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:12.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.187+0000 7f8acb7fe640 1 -- 172.21.15.26:0/851322080 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8acc0ca7f0 con 0x7f8acc069e90 2023-10-14T11:13:12.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.187+0000 7f8aca7fc640 1 -- 172.21.15.26:0/851322080 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3893797401 0 0) 0x7f8acc15ae30 con 0x7f8acc0702f0 2023-10-14T11:13:12.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.191+0000 7f8acb7fe640 1 --2- 172.21.15.26:0/851322080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8acc069e90 0x7f8acc06d010 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8abc0097c0 tx=0x7f8abc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6703ebc748caae6f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:12.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.191+0000 7f8aca7fc640 1 -- 172.21.15.26:0/851322080 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc0ab650 con 0x7f8acc069e90 2023-10-14T11:13:12.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.191+0000 7f8aca7fc640 1 -- 172.21.15.26:0/851322080 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8abc0ab7b0 con 0x7f8acc069e90 2023-10-14T11:13:12.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.191+0000 7f8aca7fc640 1 -- 172.21.15.26:0/851322080 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc0abb40 con 0x7f8acc069e90 2023-10-14T11:13:12.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.191+0000 7f8ad1b3e640 1 -- 172.21.15.26:0/851322080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8acc069e90 msgr2=0x7f8acc06d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:12.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.191+0000 7f8ad1b3e640 1 --2- 172.21.15.26:0/851322080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8acc069e90 0x7f8acc06d010 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8abc0097c0 tx=0x7f8abc01c450 comp rx=0 tx=0).stop 2023-10-14T11:13:12.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.191+0000 7f8ad1b3e640 1 -- 172.21.15.26:0/851322080 shutdown_connections 2023-10-14T11:13:12.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.191+0000 7f8ad1b3e640 1 --2- 172.21.15.26:0/851322080 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8acc06a270 0x7f8acc0c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.191+0000 7f8ad1b3e640 1 --2- 172.21.15.26:0/851322080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8acc069e90 0x7f8acc06d010 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.191+0000 7f8ad1b3e640 1 -- 172.21.15.26:0/851322080 >> 172.21.15.26:0/851322080 conn(0x7f8acc0b0da0 msgr2=0x7f8acc0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:12.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.191+0000 7f8ad1b3e640 1 -- 172.21.15.26:0/851322080 shutdown_connections 2023-10-14T11:13:12.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.191+0000 7f8ad1b3e640 1 -- 172.21.15.26:0/851322080 wait complete. 2023-10-14T11:13:12.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8ad1b3e640 1 Processor -- start 2023-10-14T11:13:12.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8ad1b3e640 1 -- start start 2023-10-14T11:13:12.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8ad1b3e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8acc069e90 0x7f8acc1546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:12.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8ad1b3e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8acc06a270 0x7f8acc1f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:12.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8ad1b3e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8acc0702f0 0x7f8acc151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:12.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8ad1b3e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc0ae280 con 0x7f8acc06a270 2023-10-14T11:13:12.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8ad1b3e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc152de0 con 0x7f8acc0702f0 2023-10-14T11:13:12.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8ad1b3e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc0cd930 con 0x7f8acc069e90 2023-10-14T11:13:12.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8acaffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8acc06a270 0x7f8acc1f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:12.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8acaffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8acc06a270 0x7f8acc1f5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49422/0 (socket says 172.21.15.26:49422) 2023-10-14T11:13:12.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8acaffd640 1 -- 172.21.15.26:0/3757447751 learned_addr learned my addr 172.21.15.26:0/3757447751 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:12.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8acb7fe640 1 --2- 172.21.15.26:0/3757447751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8acc069e90 0x7f8acc1546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:12.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8acaffd640 1 -- 172.21.15.26:0/3757447751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8acc069e90 msgr2=0x7f8acc1546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:12.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8acbfff640 1 --2- 172.21.15.26:0/3757447751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8acc0702f0 0x7f8acc151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:12.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8acaffd640 1 --2- 172.21.15.26:0/3757447751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8acc069e90 0x7f8acc1546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8acaffd640 1 -- 172.21.15.26:0/3757447751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8acc0702f0 msgr2=0x7f8acc151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:12.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8acaffd640 1 --2- 172.21.15.26:0/3757447751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8acc0702f0 0x7f8acc151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8acaffd640 1 -- 172.21.15.26:0/3757447751 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc009420 con 0x7f8acc06a270 2023-10-14T11:13:12.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8acb7fe640 1 --2- 172.21.15.26:0/3757447751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8acc069e90 0x7f8acc1546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:12.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8acbfff640 1 --2- 172.21.15.26:0/3757447751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8acc0702f0 0x7f8acc151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:12.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8acaffd640 1 --2- 172.21.15.26:0/3757447751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8acc06a270 0x7f8acc1f5390 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000d800 tx=0x7f8ac000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:12.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8ab3fff640 1 -- 172.21.15.26:0/3757447751 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac000b6c0 con 0x7f8acc06a270 2023-10-14T11:13:12.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8ab3fff640 1 -- 172.21.15.26:0/3757447751 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac000b860 con 0x7f8acc06a270 2023-10-14T11:13:12.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8ab3fff640 1 -- 172.21.15.26:0/3757447751 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac000bc10 con 0x7f8acc06a270 2023-10-14T11:13:12.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8ad1b3e640 1 -- 172.21.15.26:0/3757447751 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8acc0cdc10 con 0x7f8acc06a270 2023-10-14T11:13:12.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8ad1b3e640 1 -- 172.21.15.26:0/3757447751 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8acc0ce1d0 con 0x7f8acc06a270 2023-10-14T11:13:12.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.195+0000 7f8ad1b3e640 1 -- 172.21.15.26:0/3757447751 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8acc0ce360 con 0x7f8acc06a270 2023-10-14T11:13:12.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.199+0000 7f8ab3fff640 1 -- 172.21.15.26:0/3757447751 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8ac001e460 con 0x7f8acc06a270 2023-10-14T11:13:12.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.199+0000 7f8ab3fff640 1 --2- 172.21.15.26:0/3757447751 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8ab80664a0 0x7f8ab8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:12.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.199+0000 7f8ab3fff640 1 -- 172.21.15.26:0/3757447751 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8ac0084860 con 0x7f8acc06a270 2023-10-14T11:13:12.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.199+0000 7f8acb7fe640 1 --2- 172.21.15.26:0/3757447751 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8ab80664a0 0x7f8ab8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:12.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.199+0000 7f8acb7fe640 1 --2- 172.21.15.26:0/3757447751 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8ab80664a0 0x7f8ab8068960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8abc0af000 tx=0x7f8abc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:12.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.203+0000 7f8ab3fff640 1 -- 172.21.15.26:0/3757447751 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8ac0051910 con 0x7f8acc06a270 2023-10-14T11:13:12.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.359+0000 7f8ad1b3e640 1 -- 172.21.15.26:0/3757447751 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8acc04e170 con 0x7f8acc06a270 2023-10-14T11:13:12.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.359+0000 7f8ab3fff640 1 -- 172.21.15.26:0/3757447751 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8ac0054f30 con 0x7f8acc06a270 2023-10-14T11:13:12.366 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:13:12.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.363+0000 7f8ad1b3e640 1 -- 172.21.15.26:0/3757447751 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8ab80664a0 msgr2=0x7f8ab8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:12.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.363+0000 7f8ad1b3e640 1 --2- 172.21.15.26:0/3757447751 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8ab80664a0 0x7f8ab8068960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8abc0af000 tx=0x7f8abc008040 comp rx=0 tx=0).stop 2023-10-14T11:13:12.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.363+0000 7f8ad1b3e640 1 -- 172.21.15.26:0/3757447751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8acc06a270 msgr2=0x7f8acc1f5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:12.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.363+0000 7f8ad1b3e640 1 --2- 172.21.15.26:0/3757447751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8acc06a270 0x7f8acc1f5390 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000d800 tx=0x7f8ac000dcc0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.363+0000 7f8ad1b3e640 1 -- 172.21.15.26:0/3757447751 shutdown_connections 2023-10-14T11:13:12.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.363+0000 7f8ad1b3e640 1 --2- 172.21.15.26:0/3757447751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8acc0702f0 0x7f8acc151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.363+0000 7f8ad1b3e640 1 --2- 172.21.15.26:0/3757447751 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8ab80664a0 0x7f8ab8068960 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.363+0000 7f8ad1b3e640 1 --2- 172.21.15.26:0/3757447751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8acc06a270 0x7f8acc1f5390 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.363+0000 7f8ad1b3e640 1 --2- 172.21.15.26:0/3757447751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8acc069e90 0x7f8acc1546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.363+0000 7f8ad1b3e640 1 -- 172.21.15.26:0/3757447751 >> 172.21.15.26:0/3757447751 conn(0x7f8acc0b0da0 msgr2=0x7f8acc0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.363+0000 7f8ad1b3e640 1 -- 172.21.15.26:0/3757447751 shutdown_connections 2023-10-14T11:13:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.363+0000 7f8ad1b3e640 1 -- 172.21.15.26:0/3757447751 wait complete. 2023-10-14T11:13:12.387 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T11:13:12.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.527+0000 7effbbb72640 1 Processor -- start 2023-10-14T11:13:12.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.527+0000 7effbbb72640 1 -- start start 2023-10-14T11:13:12.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.531+0000 7effbbb72640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7effb415cba0 0x7effb40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:12.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.531+0000 7effbbb72640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effb40d0210 0x7effb40b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:12.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.531+0000 7effbbb72640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb40d1670 con 0x7effb40b84e0 2023-10-14T11:13:12.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.531+0000 7effbbb72640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb40d1460 con 0x7effb415cba0 2023-10-14T11:13:12.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.531+0000 7effbbb72640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb40d1950 con 0x7effb40d0210 2023-10-14T11:13:12.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.531+0000 7effb990e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7effb415cba0 0x7effb40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:12.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.531+0000 7effb910d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7effb40b84e0 0x7effb40cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45016/0 (socket says 172.21.15.26:45016) 2023-10-14T11:13:12.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.531+0000 7effb990e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7effb415cba0 0x7effb40d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38408/0 (socket says 172.21.15.26:38408) 2023-10-14T11:13:12.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.531+0000 7effb910d640 1 -- 172.21.15.26:0/662344017 learned_addr learned my addr 172.21.15.26:0/662344017 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:12.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.531+0000 7effba10f640 1 --2- 172.21.15.26:0/662344017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effb40d0210 0x7effb40b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:12.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.531+0000 7effb990e640 1 -- 172.21.15.26:0/662344017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effb40d0210 msgr2=0x7effb40b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:12.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.531+0000 7effb990e640 1 --2- 172.21.15.26:0/662344017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effb40d0210 0x7effb40b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.531+0000 7effb990e640 1 -- 172.21.15.26:0/662344017 >> v1:172.21.15.26:6789/0 conn(0x7effb40b84e0 legacy=0x7effb40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:12.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.531+0000 7effb990e640 1 -- 172.21.15.26:0/662344017 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb40d1c30 con 0x7effb415cba0 2023-10-14T11:13:12.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.531+0000 7effb890c640 1 -- 172.21.15.26:0/662344017 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654046587 0 0) 0x7effb40d1670 con 0x7effb40b84e0 2023-10-14T11:13:12.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.531+0000 7effb990e640 1 --2- 172.21.15.26:0/662344017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb415cba0 0x7effb40d0f20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7effb00097c0 tx=0x7effb001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac413c8f2cfecfc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:12.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effb890c640 1 -- 172.21.15.26:0/662344017 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb00ab680 con 0x7effb415cba0 2023-10-14T11:13:12.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effb890c640 1 -- 172.21.15.26:0/662344017 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb00ab7e0 con 0x7effb415cba0 2023-10-14T11:13:12.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effb890c640 1 -- 172.21.15.26:0/662344017 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb00abb70 con 0x7effb415cba0 2023-10-14T11:13:12.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effbbb72640 1 -- 172.21.15.26:0/662344017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb415cba0 msgr2=0x7effb40d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:12.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effbbb72640 1 --2- 172.21.15.26:0/662344017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb415cba0 0x7effb40d0f20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7effb00097c0 tx=0x7effb001c480 comp rx=0 tx=0).stop 2023-10-14T11:13:12.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effbbb72640 1 -- 172.21.15.26:0/662344017 shutdown_connections 2023-10-14T11:13:12.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effbbb72640 1 --2- 172.21.15.26:0/662344017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effb40d0210 0x7effb40b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effbbb72640 1 --2- 172.21.15.26:0/662344017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb415cba0 0x7effb40d0f20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effbbb72640 1 -- 172.21.15.26:0/662344017 >> 172.21.15.26:0/662344017 conn(0x7effb40719c0 msgr2=0x7effb4071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:12.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effbbb72640 1 -- 172.21.15.26:0/662344017 shutdown_connections 2023-10-14T11:13:12.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effbbb72640 1 -- 172.21.15.26:0/662344017 wait complete. 2023-10-14T11:13:12.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effbbb72640 1 Processor -- start 2023-10-14T11:13:12.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effbbb72640 1 -- start start 2023-10-14T11:13:12.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effbbb72640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40b84e0 0x7effb4149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:12.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effbbb72640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb40d0210 0x7effb414c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:12.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effbbb72640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effb415cba0 0x7effb414c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:12.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effbbb72640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb414a3e0 con 0x7effb40b84e0 2023-10-14T11:13:12.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effbbb72640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb414b800 con 0x7effb40d0210 2023-10-14T11:13:12.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effbbb72640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb41519d0 con 0x7effb415cba0 2023-10-14T11:13:12.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effb990e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40b84e0 0x7effb4149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:12.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effb990e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40b84e0 0x7effb4149ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38420/0 (socket says 172.21.15.26:38420) 2023-10-14T11:13:12.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effb990e640 1 -- 172.21.15.26:0/3893783733 learned_addr learned my addr 172.21.15.26:0/3893783733 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:12.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effba10f640 1 --2- 172.21.15.26:0/3893783733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effb415cba0 0x7effb414c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:12.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.535+0000 7effb910d640 1 --2- 172.21.15.26:0/3893783733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb40d0210 0x7effb414c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:12.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.539+0000 7effb990e640 1 -- 172.21.15.26:0/3893783733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effb415cba0 msgr2=0x7effb414c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:12.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.539+0000 7effb990e640 1 --2- 172.21.15.26:0/3893783733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effb415cba0 0x7effb414c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.539+0000 7effb990e640 1 -- 172.21.15.26:0/3893783733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb40d0210 msgr2=0x7effb414c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:12.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.539+0000 7effb990e640 1 --2- 172.21.15.26:0/3893783733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb40d0210 0x7effb414c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.539+0000 7effb990e640 1 -- 172.21.15.26:0/3893783733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb0009420 con 0x7effb40b84e0 2023-10-14T11:13:12.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.539+0000 7effb990e640 1 --2- 172.21.15.26:0/3893783733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40b84e0 0x7effb4149ea0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7effb00ad040 tx=0x7effb001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:12.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.539+0000 7effaa7fc640 1 -- 172.21.15.26:0/3893783733 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb00b5810 con 0x7effb40b84e0 2023-10-14T11:13:12.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.539+0000 7effaa7fc640 1 -- 172.21.15.26:0/3893783733 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb00b59b0 con 0x7effb40b84e0 2023-10-14T11:13:12.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.539+0000 7effbbb72640 1 -- 172.21.15.26:0/3893783733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb4151cb0 con 0x7effb40b84e0 2023-10-14T11:13:12.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.539+0000 7effaa7fc640 1 -- 172.21.15.26:0/3893783733 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb00b5d60 con 0x7effb40b84e0 2023-10-14T11:13:12.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.539+0000 7effbbb72640 1 -- 172.21.15.26:0/3893783733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb4152270 con 0x7effb40b84e0 2023-10-14T11:13:12.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.539+0000 7effbbb72640 1 -- 172.21.15.26:0/3893783733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb404e170 con 0x7effb40b84e0 2023-10-14T11:13:12.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.539+0000 7effaa7fc640 1 -- 172.21.15.26:0/3893783733 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7effb00c83f0 con 0x7effb40b84e0 2023-10-14T11:13:12.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.539+0000 7effaa7fc640 1 --2- 172.21.15.26:0/3893783733 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7eff980664a0 0x7eff98068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:12.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.543+0000 7effaa7fc640 1 -- 172.21.15.26:0/3893783733 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7effb011f0a0 con 0x7effb40b84e0 2023-10-14T11:13:12.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.543+0000 7effb910d640 1 --2- 172.21.15.26:0/3893783733 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7eff980664a0 0x7eff98068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:12.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.543+0000 7effb910d640 1 --2- 172.21.15.26:0/3893783733 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7eff980664a0 0x7eff98068960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7effb41f8080 tx=0x7effa4007b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:12.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.547+0000 7effaa7fc640 1 -- 172.21.15.26:0/3893783733 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7effb00ec160 con 0x7effb40b84e0 2023-10-14T11:13:12.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.703+0000 7effbbb72640 1 -- 172.21.15.26:0/3893783733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7effb40cfca0 con 0x7effb40b84e0 2023-10-14T11:13:12.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.703+0000 7effaa7fc640 1 -- 172.21.15.26:0/3893783733 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7effb00ab640 con 0x7effb40b84e0 2023-10-14T11:13:12.709 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:12.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.707+0000 7effbbb72640 1 -- 172.21.15.26:0/3893783733 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7eff980664a0 msgr2=0x7eff98068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:12.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.707+0000 7effbbb72640 1 --2- 172.21.15.26:0/3893783733 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7eff980664a0 0x7eff98068960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7effb41f8080 tx=0x7effa4007b60 comp rx=0 tx=0).stop 2023-10-14T11:13:12.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.707+0000 7effbbb72640 1 -- 172.21.15.26:0/3893783733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40b84e0 msgr2=0x7effb4149ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:12.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.707+0000 7effbbb72640 1 --2- 172.21.15.26:0/3893783733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40b84e0 0x7effb4149ea0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7effb00ad040 tx=0x7effb001acc0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.707+0000 7effbbb72640 1 -- 172.21.15.26:0/3893783733 shutdown_connections 2023-10-14T11:13:12.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.707+0000 7effbbb72640 1 --2- 172.21.15.26:0/3893783733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effb415cba0 0x7effb414c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.707+0000 7effbbb72640 1 --2- 172.21.15.26:0/3893783733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb40d0210 0x7effb414c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.707+0000 7effbbb72640 1 --2- 172.21.15.26:0/3893783733 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7eff980664a0 0x7eff98068960 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.707+0000 7effbbb72640 1 --2- 172.21.15.26:0/3893783733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40b84e0 0x7effb4149ea0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.707+0000 7effbbb72640 1 -- 172.21.15.26:0/3893783733 >> 172.21.15.26:0/3893783733 conn(0x7effb40719c0 msgr2=0x7effb415b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:12.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.707+0000 7effbbb72640 1 -- 172.21.15.26:0/3893783733 shutdown_connections 2023-10-14T11:13:12.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.707+0000 7effbbb72640 1 -- 172.21.15.26:0/3893783733 wait complete. 2023-10-14T11:13:12.730 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:13:12.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.871+0000 7fd64bcc9640 1 Processor -- start 2023-10-14T11:13:12.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.871+0000 7fd64bcc9640 1 -- start start 2023-10-14T11:13:12.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.871+0000 7fd64bcc9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd64415cb90 0x7fd6440cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:12.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.871+0000 7fd64bcc9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6440ce770 con 0x7fd6440d3010 2023-10-14T11:13:12.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.871+0000 7fd64bcc9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6440d0600 con 0x7fd6440d15d0 2023-10-14T11:13:12.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.871+0000 7fd64bcc9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6440c6450 con 0x7fd64415cb90 2023-10-14T11:13:12.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.871+0000 7fd649264640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd6440d3010 0x7fd6440d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45026/0 (socket says 172.21.15.26:45026) 2023-10-14T11:13:12.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.871+0000 7fd649264640 1 -- 172.21.15.26:0/4192540837 learned_addr learned my addr 172.21.15.26:0/4192540837 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:12.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.871+0000 7fd649a65640 1 --2- 172.21.15.26:0/4192540837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd64415cb90 0x7fd6440cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:12.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.871+0000 7fd648a63640 1 -- 172.21.15.26:0/4192540837 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1719698609 0 0) 0x7fd6440ce770 con 0x7fd6440d3010 2023-10-14T11:13:12.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.871+0000 7fd648a63640 1 -- 172.21.15.26:0/4192540837 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd630003530 con 0x7fd6440d3010 2023-10-14T11:13:12.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.871+0000 7fd648a63640 1 -- 172.21.15.26:0/4192540837 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088391715 0 0) 0x7fd6440d0600 con 0x7fd6440d15d0 2023-10-14T11:13:12.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.871+0000 7fd648a63640 1 -- 172.21.15.26:0/4192540837 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6440ce770 con 0x7fd6440d15d0 2023-10-14T11:13:12.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.871+0000 7fd649a65640 1 -- 172.21.15.26:0/4192540837 >> v1:172.21.15.110:6789/0 conn(0x7fd6440d15d0 legacy=0x7fd6440c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:12.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.871+0000 7fd649a65640 1 -- 172.21.15.26:0/4192540837 >> v1:172.21.15.26:6789/0 conn(0x7fd6440d3010 legacy=0x7fd6440d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:12.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.871+0000 7fd649a65640 1 -- 172.21.15.26:0/4192540837 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6440d08a0 con 0x7fd64415cb90 2023-10-14T11:13:12.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.875+0000 7fd649a65640 1 --2- 172.21.15.26:0/4192540837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd64415cb90 0x7fd6440cfb10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd6400097d0 tx=0x7fd64001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80b00c4d493144cd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:12.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.875+0000 7fd648a63640 1 -- 172.21.15.26:0/4192540837 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6400ac640 con 0x7fd64415cb90 2023-10-14T11:13:12.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.875+0000 7fd648a63640 1 -- 172.21.15.26:0/4192540837 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6400ac7a0 con 0x7fd64415cb90 2023-10-14T11:13:12.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.875+0000 7fd648a63640 1 -- 172.21.15.26:0/4192540837 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6400acb30 con 0x7fd64415cb90 2023-10-14T11:13:12.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.875+0000 7fd64bcc9640 1 -- 172.21.15.26:0/4192540837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd64415cb90 msgr2=0x7fd6440cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:12.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.875+0000 7fd64bcc9640 1 --2- 172.21.15.26:0/4192540837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd64415cb90 0x7fd6440cfb10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd6400097d0 tx=0x7fd64001c3e0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.875+0000 7fd64bcc9640 1 -- 172.21.15.26:0/4192540837 shutdown_connections 2023-10-14T11:13:12.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.875+0000 7fd64bcc9640 1 --2- 172.21.15.26:0/4192540837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd64415cb90 0x7fd6440cfb10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.875+0000 7fd64bcc9640 1 -- 172.21.15.26:0/4192540837 >> 172.21.15.26:0/4192540837 conn(0x7fd64409bc50 msgr2=0x7fd6440d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:12.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.875+0000 7fd64bcc9640 1 -- 172.21.15.26:0/4192540837 shutdown_connections 2023-10-14T11:13:12.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.875+0000 7fd64bcc9640 1 -- 172.21.15.26:0/4192540837 wait complete. 2023-10-14T11:13:12.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd64bcc9640 1 Processor -- start 2023-10-14T11:13:12.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd64bcc9640 1 -- start start 2023-10-14T11:13:12.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd64bcc9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6440d15d0 0x7fd6440b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:12.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd64bcc9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6440d3010 0x7fd644156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:12.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd64bcc9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd64415cb90 0x7fd6441569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:12.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd64bcc9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6440cc9b0 con 0x7fd64415cb90 2023-10-14T11:13:12.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd64bcc9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6440b7300 con 0x7fd6440d15d0 2023-10-14T11:13:12.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd64bcc9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6440b66f0 con 0x7fd6440d3010 2023-10-14T11:13:12.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd64a266640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd64415cb90 0x7fd6441569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:12.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd64a266640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd64415cb90 0x7fd6441569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38424/0 (socket says 172.21.15.26:38424) 2023-10-14T11:13:12.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd64a266640 1 -- 172.21.15.26:0/4011267419 learned_addr learned my addr 172.21.15.26:0/4011267419 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:12.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd649a65640 1 --2- 172.21.15.26:0/4011267419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6440d15d0 0x7fd6440b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:12.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd649264640 1 --2- 172.21.15.26:0/4011267419 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6440d3010 0x7fd644156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:12.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd64a266640 1 -- 172.21.15.26:0/4011267419 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6440d3010 msgr2=0x7fd644156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:12.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd64a266640 1 --2- 172.21.15.26:0/4011267419 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6440d3010 0x7fd644156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd64a266640 1 -- 172.21.15.26:0/4011267419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6440d15d0 msgr2=0x7fd6440b7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:12.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd64a266640 1 --2- 172.21.15.26:0/4011267419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6440d15d0 0x7fd6440b7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:12.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd64a266640 1 -- 172.21.15.26:0/4011267419 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6400093b0 con 0x7fd64415cb90 2023-10-14T11:13:12.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd649a65640 1 --2- 172.21.15.26:0/4011267419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6440d15d0 0x7fd6440b7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:12.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd64a266640 1 --2- 172.21.15.26:0/4011267419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd64415cb90 0x7fd6441569c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00c6c0 tx=0x7fd63c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:12.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd63a7fc640 1 -- 172.21.15.26:0/4011267419 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c003b80 con 0x7fd64415cb90 2023-10-14T11:13:12.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd63a7fc640 1 -- 172.21.15.26:0/4011267419 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63c003ce0 con 0x7fd64415cb90 2023-10-14T11:13:12.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd64bcc9640 1 -- 172.21.15.26:0/4011267419 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6440b69d0 con 0x7fd64415cb90 2023-10-14T11:13:12.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd63a7fc640 1 -- 172.21.15.26:0/4011267419 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c0052f0 con 0x7fd64415cb90 2023-10-14T11:13:12.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd64bcc9640 1 -- 172.21.15.26:0/4011267419 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6440b6f90 con 0x7fd64415cb90 2023-10-14T11:13:12.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.879+0000 7fd64bcc9640 1 -- 172.21.15.26:0/4011267419 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6440b74b0 con 0x7fd64415cb90 2023-10-14T11:13:12.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.883+0000 7fd63a7fc640 1 -- 172.21.15.26:0/4011267419 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd63c005450 con 0x7fd64415cb90 2023-10-14T11:13:12.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.883+0000 7fd63a7fc640 1 --2- 172.21.15.26:0/4011267419 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd6280664a0 0x7fd628068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:12.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.883+0000 7fd63a7fc640 1 -- 172.21.15.26:0/4011267419 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd63c0840e0 con 0x7fd64415cb90 2023-10-14T11:13:12.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.883+0000 7fd649a65640 1 --2- 172.21.15.26:0/4011267419 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd6280664a0 0x7fd628068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:12.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.883+0000 7fd649a65640 1 --2- 172.21.15.26:0/4011267419 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd6280664a0 0x7fd628068960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd6400ae000 tx=0x7fd6400a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:12.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:12.887+0000 7fd63a7fc640 1 -- 172.21.15.26:0/4011267419 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd6440b74b0 con 0x7fd64415cb90 2023-10-14T11:13:13.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.047+0000 7fd64bcc9640 1 -- 172.21.15.26:0/4011267419 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6440b7470 con 0x7fd64415cb90 2023-10-14T11:13:13.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.047+0000 7fd63a7fc640 1 -- 172.21.15.26:0/4011267419 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18679 (secure 0 0 0) 0x7fd63c051100 con 0x7fd64415cb90 2023-10-14T11:13:13.052 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:13.052 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":27,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:13:03.866737+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:13:13.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.047+0000 7fd64bcc9640 1 -- 172.21.15.26:0/4011267419 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd6280664a0 msgr2=0x7fd628068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:13.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.047+0000 7fd64bcc9640 1 --2- 172.21.15.26:0/4011267419 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd6280664a0 0x7fd628068960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd6400ae000 tx=0x7fd6400a7000 comp rx=0 tx=0).stop 2023-10-14T11:13:13.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.051+0000 7fd64bcc9640 1 -- 172.21.15.26:0/4011267419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd64415cb90 msgr2=0x7fd6441569c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:13.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.051+0000 7fd64bcc9640 1 --2- 172.21.15.26:0/4011267419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd64415cb90 0x7fd6441569c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00c6c0 tx=0x7fd63c00cb80 comp rx=0 tx=0).stop 2023-10-14T11:13:13.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.051+0000 7fd64bcc9640 1 -- 172.21.15.26:0/4011267419 shutdown_connections 2023-10-14T11:13:13.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.051+0000 7fd64bcc9640 1 --2- 172.21.15.26:0/4011267419 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd6280664a0 0x7fd628068960 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.051+0000 7fd64bcc9640 1 --2- 172.21.15.26:0/4011267419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd64415cb90 0x7fd6441569c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.051+0000 7fd64bcc9640 1 --2- 172.21.15.26:0/4011267419 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6440d3010 0x7fd644156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.051+0000 7fd64bcc9640 1 --2- 172.21.15.26:0/4011267419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6440d15d0 0x7fd6440b7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.051+0000 7fd64bcc9640 1 -- 172.21.15.26:0/4011267419 >> 172.21.15.26:0/4011267419 conn(0x7fd64409bc50 msgr2=0x7fd6440ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:13.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.051+0000 7fd64bcc9640 1 -- 172.21.15.26:0/4011267419 shutdown_connections 2023-10-14T11:13:13.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.051+0000 7fd64bcc9640 1 -- 172.21.15.26:0/4011267419 wait complete. 2023-10-14T11:13:13.074 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:12:20.179562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:12:21.346111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T11:12:25.025159+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T11:13:13.075 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:13:13.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.219+0000 7f9ccf73e640 1 Processor -- start 2023-10-14T11:13:13.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.219+0000 7f9ccf73e640 1 -- start start 2023-10-14T11:13:13.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.219+0000 7f9ccf73e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9cc8159900 0x7f9cc806e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:13.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.219+0000 7f9ccf73e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc80b3f00 0x7f9cc8069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:13.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.219+0000 7f9ccf73e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9cc806a3d0 0x7f9cc80cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:13.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.219+0000 7f9ccf73e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc80cd740 con 0x7f9cc8159900 2023-10-14T11:13:13.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.219+0000 7f9ccf73e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc806a840 con 0x7f9cc806a3d0 2023-10-14T11:13:13.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.219+0000 7f9ccf73e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc80b4360 con 0x7f9cc80b3f00 2023-10-14T11:13:13.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.219+0000 7f9ccd4da640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9cc8159900 0x7f9cc806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:13.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.219+0000 7f9ccd4da640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9cc8159900 0x7f9cc806e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38438/0 (socket says 172.21.15.26:38438) 2023-10-14T11:13:13.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.219+0000 7f9ccd4da640 1 -- 172.21.15.26:0/1510108477 learned_addr learned my addr 172.21.15.26:0/1510108477 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:13.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.219+0000 7f9ccccd9640 1 --2- 172.21.15.26:0/1510108477 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc80b3f00 0x7f9cc8069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:13.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.219+0000 7f9ccdcdb640 1 --2- 172.21.15.26:0/1510108477 >> v2:172.21.15.110:3300/0 conn(0x7f9cc806a3d0 0x7f9cc80cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:13.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.219+0000 7f9ccd4da640 1 -- 172.21.15.26:0/1510108477 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc80b3f00 msgr2=0x7f9cc8069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:13.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.219+0000 7f9ccd4da640 1 --2- 172.21.15.26:0/1510108477 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc80b3f00 0x7f9cc8069e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.219+0000 7f9ccd4da640 1 -- 172.21.15.26:0/1510108477 >> v2:172.21.15.110:3300/0 conn(0x7f9cc806a3d0 msgr2=0x7f9cc80cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:13.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.219+0000 7f9ccd4da640 1 --2- 172.21.15.26:0/1510108477 >> v2:172.21.15.110:3300/0 conn(0x7f9cc806a3d0 0x7f9cc80cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.219+0000 7f9ccd4da640 1 -- 172.21.15.26:0/1510108477 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc80b4600 con 0x7f9cc8159900 2023-10-14T11:13:13.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.223+0000 7f9ccd4da640 1 --2- 172.21.15.26:0/1510108477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cc8159900 0x7f9cc806e260 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9cc80c8d10 tx=0x7f9cc401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a2a693aa434c81 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:13.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.223+0000 7f9cbffff640 1 -- 172.21.15.26:0/1510108477 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc40ab600 con 0x7f9cc8159900 2023-10-14T11:13:13.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.223+0000 7f9cbffff640 1 -- 172.21.15.26:0/1510108477 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc40a7050 con 0x7f9cc8159900 2023-10-14T11:13:13.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.223+0000 7f9cbffff640 1 -- 172.21.15.26:0/1510108477 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc40ab980 con 0x7f9cc8159900 2023-10-14T11:13:13.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.223+0000 7f9ccf73e640 1 -- 172.21.15.26:0/1510108477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cc8159900 msgr2=0x7f9cc806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:13.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.223+0000 7f9ccf73e640 1 --2- 172.21.15.26:0/1510108477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cc8159900 0x7f9cc806e260 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9cc80c8d10 tx=0x7f9cc401c210 comp rx=0 tx=0).stop 2023-10-14T11:13:13.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.223+0000 7f9ccf73e640 1 -- 172.21.15.26:0/1510108477 shutdown_connections 2023-10-14T11:13:13.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.223+0000 7f9ccf73e640 1 --2- 172.21.15.26:0/1510108477 >> v2:172.21.15.110:3300/0 conn(0x7f9cc806a3d0 0x7f9cc80cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.223+0000 7f9ccf73e640 1 --2- 172.21.15.26:0/1510108477 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc80b3f00 0x7f9cc8069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.223+0000 7f9ccf73e640 1 --2- 172.21.15.26:0/1510108477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cc8159900 0x7f9cc806e260 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.223+0000 7f9ccf73e640 1 -- 172.21.15.26:0/1510108477 >> 172.21.15.26:0/1510108477 conn(0x7f9cc80b0da0 msgr2=0x7f9cc80ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:13.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.223+0000 7f9ccf73e640 1 -- 172.21.15.26:0/1510108477 shutdown_connections 2023-10-14T11:13:13.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.223+0000 7f9ccf73e640 1 -- 172.21.15.26:0/1510108477 wait complete. 2023-10-14T11:13:13.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccf73e640 1 Processor -- start 2023-10-14T11:13:13.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccf73e640 1 -- start start 2023-10-14T11:13:13.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccf73e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc806a3d0 0x7f9cc80c22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:13.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccf73e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cc80b3f00 0x7f9cc81f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:13.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccf73e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc8159900 0x7f9cc80c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:13.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccf73e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc80c3130 con 0x7f9cc80b3f00 2023-10-14T11:13:13.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccf73e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc81f4ff0 con 0x7f9cc806a3d0 2023-10-14T11:13:13.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccf73e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc80c2890 con 0x7f9cc8159900 2023-10-14T11:13:13.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccccd9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cc80b3f00 0x7f9cc81f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:13.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccccd9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cc80b3f00 0x7f9cc81f4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38442/0 (socket says 172.21.15.26:38442) 2023-10-14T11:13:13.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccccd9640 1 -- 172.21.15.26:0/1625607978 learned_addr learned my addr 172.21.15.26:0/1625607978 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:13.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccd4da640 1 --2- 172.21.15.26:0/1625607978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc806a3d0 0x7f9cc80c22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:13.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccdcdb640 1 --2- 172.21.15.26:0/1625607978 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc8159900 0x7f9cc80c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:13.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccccd9640 1 -- 172.21.15.26:0/1625607978 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc8159900 msgr2=0x7f9cc80c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:13.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccccd9640 1 --2- 172.21.15.26:0/1625607978 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc8159900 0x7f9cc80c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccccd9640 1 -- 172.21.15.26:0/1625607978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc806a3d0 msgr2=0x7f9cc80c22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:13.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccccd9640 1 --2- 172.21.15.26:0/1625607978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc806a3d0 0x7f9cc80c22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccccd9640 1 -- 172.21.15.26:0/1625607978 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc40094d0 con 0x7f9cc80b3f00 2023-10-14T11:13:13.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccdcdb640 1 --2- 172.21.15.26:0/1625607978 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc8159900 0x7f9cc80c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:13.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccd4da640 1 --2- 172.21.15.26:0/1625607978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc806a3d0 0x7f9cc80c22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:13.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccccd9640 1 --2- 172.21.15.26:0/1625607978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cc80b3f00 0x7f9cc81f4ab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800ed40 tx=0x7f9cb800d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:13.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9cbdffb640 1 -- 172.21.15.26:0/1625607978 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb800de30 con 0x7f9cc80b3f00 2023-10-14T11:13:13.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9cbdffb640 1 -- 172.21.15.26:0/1625607978 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb8010650 con 0x7f9cc80b3f00 2023-10-14T11:13:13.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccf73e640 1 -- 172.21.15.26:0/1625607978 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc80c2b70 con 0x7f9cc80b3f00 2023-10-14T11:13:13.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9cbdffb640 1 -- 172.21.15.26:0/1625607978 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb80109c0 con 0x7f9cc80b3f00 2023-10-14T11:13:13.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccf73e640 1 -- 172.21.15.26:0/1625607978 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc815b810 con 0x7f9cc80b3f00 2023-10-14T11:13:13.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.227+0000 7f9ccf73e640 1 -- 172.21.15.26:0/1625607978 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc815b670 con 0x7f9cc80b3f00 2023-10-14T11:13:13.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.231+0000 7f9cbdffb640 1 -- 172.21.15.26:0/1625607978 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9cb8010b20 con 0x7f9cc80b3f00 2023-10-14T11:13:13.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.231+0000 7f9cbdffb640 1 --2- 172.21.15.26:0/1625607978 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9cac0664a0 0x7f9cac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:13.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.231+0000 7f9cbdffb640 1 -- 172.21.15.26:0/1625607978 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9cb8084800 con 0x7f9cc80b3f00 2023-10-14T11:13:13.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.231+0000 7f9ccd4da640 1 --2- 172.21.15.26:0/1625607978 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9cac0664a0 0x7f9cac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:13.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.231+0000 7f9ccd4da640 1 --2- 172.21.15.26:0/1625607978 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9cac0664a0 0x7f9cac068960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40ad000 tx=0x7f9cc4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:13.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.235+0000 7f9cbdffb640 1 -- 172.21.15.26:0/1625607978 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9cc815b670 con 0x7f9cc80b3f00 2023-10-14T11:13:13.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.391+0000 7f9ccf73e640 1 -- 172.21.15.26:0/1625607978 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9cc815b670 con 0x7f9cc80b3f00 2023-10-14T11:13:13.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.391+0000 7f9cbdffb640 1 -- 172.21.15.26:0/1625607978 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9cc815b670 con 0x7f9cc80b3f00 2023-10-14T11:13:13.396 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:13:13.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.395+0000 7f9ccf73e640 1 -- 172.21.15.26:0/1625607978 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9cac0664a0 msgr2=0x7f9cac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:13.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.395+0000 7f9ccf73e640 1 --2- 172.21.15.26:0/1625607978 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9cac0664a0 0x7f9cac068960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40ad000 tx=0x7f9cc4008040 comp rx=0 tx=0).stop 2023-10-14T11:13:13.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.395+0000 7f9ccf73e640 1 -- 172.21.15.26:0/1625607978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cc80b3f00 msgr2=0x7f9cc81f4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:13.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.395+0000 7f9ccf73e640 1 --2- 172.21.15.26:0/1625607978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cc80b3f00 0x7f9cc81f4ab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800ed40 tx=0x7f9cb800d720 comp rx=0 tx=0).stop 2023-10-14T11:13:13.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.395+0000 7f9ccf73e640 1 -- 172.21.15.26:0/1625607978 shutdown_connections 2023-10-14T11:13:13.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.395+0000 7f9ccf73e640 1 --2- 172.21.15.26:0/1625607978 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc8159900 0x7f9cc80c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.395+0000 7f9ccf73e640 1 --2- 172.21.15.26:0/1625607978 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9cac0664a0 0x7f9cac068960 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.395+0000 7f9ccf73e640 1 --2- 172.21.15.26:0/1625607978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cc80b3f00 0x7f9cc81f4ab0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.395+0000 7f9ccf73e640 1 --2- 172.21.15.26:0/1625607978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc806a3d0 0x7f9cc80c22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.395+0000 7f9ccf73e640 1 -- 172.21.15.26:0/1625607978 >> 172.21.15.26:0/1625607978 conn(0x7f9cc80b0da0 msgr2=0x7f9cc80b3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:13.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.395+0000 7f9ccf73e640 1 -- 172.21.15.26:0/1625607978 shutdown_connections 2023-10-14T11:13:13.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.395+0000 7f9ccf73e640 1 -- 172.21.15.26:0/1625607978 wait complete. 2023-10-14T11:13:13.417 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:13:13.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.559+0000 7facec609640 1 Processor -- start 2023-10-14T11:13:13.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.559+0000 7facec609640 1 -- start start 2023-10-14T11:13:13.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.559+0000 7facec609640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7face40ceda0 0x7face4167be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:13.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.559+0000 7facec609640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face40cc330 con 0x7face415cc60 2023-10-14T11:13:13.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.559+0000 7facec609640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face40cb4d0 con 0x7face40cb040 2023-10-14T11:13:13.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.559+0000 7facec609640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face40cb720 con 0x7face40ceda0 2023-10-14T11:13:13.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.559+0000 7facea3a5640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7face415cc60 0x7face4161260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45036/0 (socket says 172.21.15.26:45036) 2023-10-14T11:13:13.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.559+0000 7facea3a5640 1 -- 172.21.15.26:0/111022908 learned_addr learned my addr 172.21.15.26:0/111022908 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.559+0000 7faceaba6640 1 --2- 172.21.15.26:0/111022908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7face40ceda0 0x7face4167be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face93a3640 1 -- 172.21.15.26:0/111022908 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1670557583 0 0) 0x7face40cc330 con 0x7face415cc60 2023-10-14T11:13:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face93a3640 1 -- 172.21.15.26:0/111022908 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facd0003530 con 0x7face415cc60 2023-10-14T11:13:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face93a3640 1 -- 172.21.15.26:0/111022908 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083450476 0 0) 0x7face40cb4d0 con 0x7face40cb040 2023-10-14T11:13:13.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face93a3640 1 -- 172.21.15.26:0/111022908 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7face40cc330 con 0x7face40cb040 2023-10-14T11:13:13.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face93a3640 1 -- 172.21.15.26:0/111022908 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3517056336 0 0) 0x7facd0003530 con 0x7face415cc60 2023-10-14T11:13:13.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face93a3640 1 -- 172.21.15.26:0/111022908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7face40ceda0 msgr2=0x7face4167be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:13.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face93a3640 1 --2- 172.21.15.26:0/111022908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7face40ceda0 0x7face4167be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face93a3640 1 -- 172.21.15.26:0/111022908 >> v1:172.21.15.110:6789/0 conn(0x7face40cb040 legacy=0x7face40ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:13.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face93a3640 1 -- 172.21.15.26:0/111022908 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face40cba00 con 0x7face415cc60 2023-10-14T11:13:13.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face93a3640 1 -- 172.21.15.26:0/111022908 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7face0001680 con 0x7face415cc60 2023-10-14T11:13:13.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face93a3640 1 -- 172.21.15.26:0/111022908 >> v1:172.21.15.26:6789/0 conn(0x7face415cc60 legacy=0x7face4161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:13.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face93a3640 1 --2- 172.21.15.26:0/111022908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facd0003b40 0x7facd0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:13.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face93a3640 1 --2- 172.21.15.26:0/111022908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facd00047d0 0x7facd0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:13.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face93a3640 1 --2- 172.21.15.26:0/111022908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facd0005190 0x7facd000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:13.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face93a3640 1 -- 172.21.15.26:0/111022908 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face40cb720 con 0x7facd00047d0 2023-10-14T11:13:13.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face93a3640 1 -- 172.21.15.26:0/111022908 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd000bf80 con 0x7facd0005190 2023-10-14T11:13:13.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face93a3640 1 -- 172.21.15.26:0/111022908 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd000c140 con 0x7facd0003b40 2023-10-14T11:13:13.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7faceaba6640 1 --2- 172.21.15.26:0/111022908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7face40ceda0 0x7face4167be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:13:13.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face9ba4640 1 --2- 172.21.15.26:0/111022908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facd00047d0 0x7facd0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:13.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7facea3a5640 1 --2- 172.21.15.26:0/111022908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facd0003b40 0x7facd0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:13.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7faceaba6640 1 --2- 172.21.15.26:0/111022908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facd0005190 0x7facd000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:13.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face9ba4640 1 -- 172.21.15.26:0/111022908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facd0003b40 msgr2=0x7facd0003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:13.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face9ba4640 1 --2- 172.21.15.26:0/111022908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facd0003b40 0x7facd0003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face9ba4640 1 -- 172.21.15.26:0/111022908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facd0005190 msgr2=0x7facd000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:13.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face9ba4640 1 --2- 172.21.15.26:0/111022908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facd0005190 0x7facd000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.563+0000 7face9ba4640 1 -- 172.21.15.26:0/111022908 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd0003530 con 0x7facd00047d0 2023-10-14T11:13:13.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.567+0000 7face9ba4640 1 --2- 172.21.15.26:0/111022908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facd00047d0 0x7facd0004c50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7facd40018c0 tx=0x7facd401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c4d0f477d23d9a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:13.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.567+0000 7face93a3640 1 -- 172.21.15.26:0/111022908 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd40052d0 con 0x7facd00047d0 2023-10-14T11:13:13.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.567+0000 7face93a3640 1 -- 172.21.15.26:0/111022908 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd4005430 con 0x7facd00047d0 2023-10-14T11:13:13.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.567+0000 7face93a3640 1 -- 172.21.15.26:0/111022908 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd40a8910 con 0x7facd00047d0 2023-10-14T11:13:13.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.567+0000 7facec609640 1 -- 172.21.15.26:0/111022908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facd00047d0 msgr2=0x7facd0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:13.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.567+0000 7facec609640 1 --2- 172.21.15.26:0/111022908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facd00047d0 0x7facd0004c50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7facd40018c0 tx=0x7facd401ecd0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.567+0000 7faceaba6640 1 -- 172.21.15.26:0/111022908 reap_dead start 2023-10-14T11:13:13.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.567+0000 7facec609640 1 -- 172.21.15.26:0/111022908 shutdown_connections 2023-10-14T11:13:13.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.567+0000 7facec609640 1 -- 172.21.15.26:0/111022908 >> 172.21.15.26:0/111022908 conn(0x7face406e570 msgr2=0x7face406e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:13.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.567+0000 7facec609640 1 -- 172.21.15.26:0/111022908 shutdown_connections 2023-10-14T11:13:13.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.567+0000 7facec609640 1 -- 172.21.15.26:0/111022908 wait complete. 2023-10-14T11:13:13.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.567+0000 7facec609640 1 Processor -- start 2023-10-14T11:13:13.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.567+0000 7facec609640 1 -- start start 2023-10-14T11:13:13.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.567+0000 7facec609640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facd00047d0 0x7face40c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:13.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.567+0000 7facec609640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face415bab0 0x7face415b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:13.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.567+0000 7facec609640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7face40b5150 0x7face40b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:13.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.567+0000 7facec609640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face40b5b10 con 0x7face415bab0 2023-10-14T11:13:13.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.567+0000 7facec609640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face40c9320 con 0x7face40b5150 2023-10-14T11:13:13.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.567+0000 7facec609640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face40c88b0 con 0x7facd00047d0 2023-10-14T11:13:13.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.567+0000 7face9ba4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face415bab0 0x7face415b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:13.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.571+0000 7face9ba4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face415bab0 0x7face415b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38452/0 (socket says 172.21.15.26:38452) 2023-10-14T11:13:13.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.571+0000 7face9ba4640 1 -- 172.21.15.26:0/794400666 learned_addr learned my addr 172.21.15.26:0/794400666 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:13.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.571+0000 7faceaba6640 1 --2- 172.21.15.26:0/794400666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7face40b5150 0x7face40b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:13.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.571+0000 7facea3a5640 1 --2- 172.21.15.26:0/794400666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facd00047d0 0x7face40c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:13.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.571+0000 7face9ba4640 1 -- 172.21.15.26:0/794400666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facd00047d0 msgr2=0x7face40c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:13.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.571+0000 7face9ba4640 1 --2- 172.21.15.26:0/794400666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facd00047d0 0x7face40c7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.571+0000 7face9ba4640 1 -- 172.21.15.26:0/794400666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7face40b5150 msgr2=0x7face40b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:13.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.571+0000 7face9ba4640 1 --2- 172.21.15.26:0/794400666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7face40b5150 0x7face40b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.571+0000 7face9ba4640 1 -- 172.21.15.26:0/794400666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face415c2a0 con 0x7face415bab0 2023-10-14T11:13:13.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.571+0000 7facea3a5640 1 --2- 172.21.15.26:0/794400666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facd00047d0 0x7face40c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:13.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.571+0000 7face9ba4640 1 --2- 172.21.15.26:0/794400666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face415bab0 0x7face415b2a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7facd40018c0 tx=0x7facd0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:13.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.571+0000 7facdaffd640 1 -- 172.21.15.26:0/794400666 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd40052d0 con 0x7face415bab0 2023-10-14T11:13:13.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.571+0000 7facdaffd640 1 -- 172.21.15.26:0/794400666 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd4007a60 con 0x7face415bab0 2023-10-14T11:13:13.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.571+0000 7facdaffd640 1 -- 172.21.15.26:0/794400666 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd4006a20 con 0x7face415bab0 2023-10-14T11:13:13.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.571+0000 7facec609640 1 -- 172.21.15.26:0/794400666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face40c8010 con 0x7face415bab0 2023-10-14T11:13:13.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.571+0000 7facec609640 1 -- 172.21.15.26:0/794400666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face40c85d0 con 0x7face415bab0 2023-10-14T11:13:13.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.571+0000 7facec609640 1 -- 172.21.15.26:0/794400666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face404e170 con 0x7face415bab0 2023-10-14T11:13:13.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.571+0000 7facdaffd640 1 -- 172.21.15.26:0/794400666 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7facd4006b80 con 0x7face415bab0 2023-10-14T11:13:13.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.571+0000 7facdaffd640 1 --2- 172.21.15.26:0/794400666 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7facc80664a0 0x7facc8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:13.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.571+0000 7facdaffd640 1 -- 172.21.15.26:0/794400666 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7facd4121230 con 0x7face415bab0 2023-10-14T11:13:13.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.575+0000 7facea3a5640 1 --2- 172.21.15.26:0/794400666 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7facc80664a0 0x7facc8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:13.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.575+0000 7facea3a5640 1 --2- 172.21.15.26:0/794400666 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7facc80664a0 0x7facc8068960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7face0007c10 tx=0x7face0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:13.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.575+0000 7facdaffd640 1 -- 172.21.15.26:0/794400666 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7facd40ee300 con 0x7face415bab0 2023-10-14T11:13:13.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.743+0000 7facec609640 1 -- 172.21.15.26:0/794400666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7face404e170 con 0x7face415bab0 2023-10-14T11:13:13.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.743+0000 7facdaffd640 1 -- 172.21.15.26:0/794400666 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7facd40f1920 con 0x7face415bab0 2023-10-14T11:13:13.748 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:13.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.743+0000 7facec609640 1 -- 172.21.15.26:0/794400666 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7facc80664a0 msgr2=0x7facc8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:13.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.743+0000 7facec609640 1 --2- 172.21.15.26:0/794400666 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7facc80664a0 0x7facc8068960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7face0007c10 tx=0x7face0009040 comp rx=0 tx=0).stop 2023-10-14T11:13:13.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.743+0000 7facec609640 1 -- 172.21.15.26:0/794400666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face415bab0 msgr2=0x7face415b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:13.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.743+0000 7facec609640 1 --2- 172.21.15.26:0/794400666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face415bab0 0x7face415b2a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7facd40018c0 tx=0x7facd0005800 comp rx=0 tx=0).stop 2023-10-14T11:13:13.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.743+0000 7facec609640 1 -- 172.21.15.26:0/794400666 shutdown_connections 2023-10-14T11:13:13.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.743+0000 7facec609640 1 --2- 172.21.15.26:0/794400666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7face40b5150 0x7face40b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.743+0000 7facec609640 1 --2- 172.21.15.26:0/794400666 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7facc80664a0 0x7facc8068960 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.743+0000 7facec609640 1 --2- 172.21.15.26:0/794400666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face415bab0 0x7face415b2a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.743+0000 7facec609640 1 --2- 172.21.15.26:0/794400666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facd00047d0 0x7face40c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.743+0000 7facec609640 1 -- 172.21.15.26:0/794400666 >> 172.21.15.26:0/794400666 conn(0x7face406e570 msgr2=0x7face415eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:13.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.743+0000 7facec609640 1 -- 172.21.15.26:0/794400666 shutdown_connections 2023-10-14T11:13:13.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.743+0000 7facec609640 1 -- 172.21.15.26:0/794400666 wait complete. 2023-10-14T11:13:13.769 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:13:13.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.911+0000 7f7225846640 1 Processor -- start 2023-10-14T11:13:13.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.911+0000 7f7225846640 1 -- start start 2023-10-14T11:13:13.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.911+0000 7f7225846640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72200d1fa0 0x7f72200b8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:13.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.911+0000 7f7225846640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f722015d010 con 0x7f722015cc30 2023-10-14T11:13:13.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.911+0000 7f7225846640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72200b74d0 con 0x7f72200cdf50 2023-10-14T11:13:13.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.911+0000 7f7225846640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72200b77b0 con 0x7f72200d1fa0 2023-10-14T11:13:13.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.911+0000 7f721effd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f722015cc30 0x7f72200cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45042/0 (socket says 172.21.15.26:45042) 2023-10-14T11:13:13.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.911+0000 7f721effd640 1 -- 172.21.15.26:0/3825010456 learned_addr learned my addr 172.21.15.26:0/3825010456 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:13.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.911+0000 7f721e7fc640 1 --2- 172.21.15.26:0/3825010456 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72200d1fa0 0x7f72200b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:13.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.911+0000 7f721dffb640 1 -- 172.21.15.26:0/3825010456 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652442555 0 0) 0x7f722015d010 con 0x7f722015cc30 2023-10-14T11:13:13.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.911+0000 7f721dffb640 1 -- 172.21.15.26:0/3825010456 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7208003530 con 0x7f722015cc30 2023-10-14T11:13:13.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.911+0000 7f721dffb640 1 -- 172.21.15.26:0/3825010456 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984614525 0 0) 0x7f72200b74d0 con 0x7f72200cdf50 2023-10-14T11:13:13.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.911+0000 7f721dffb640 1 -- 172.21.15.26:0/3825010456 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f722015d010 con 0x7f72200cdf50 2023-10-14T11:13:13.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.911+0000 7f721e7fc640 1 -- 172.21.15.26:0/3825010456 >> v1:172.21.15.110:6789/0 conn(0x7f72200cdf50 legacy=0x7f72200b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:13.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.911+0000 7f721e7fc640 1 -- 172.21.15.26:0/3825010456 >> v1:172.21.15.26:6789/0 conn(0x7f722015cc30 legacy=0x7f72200cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:13.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.911+0000 7f721e7fc640 1 -- 172.21.15.26:0/3825010456 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72200b7a90 con 0x7f72200d1fa0 2023-10-14T11:13:13.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.915+0000 7f721e7fc640 1 --2- 172.21.15.26:0/3825010456 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72200d1fa0 0x7f72200b8780 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f72140097f0 tx=0x7f721401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69155109c8a2fd47 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:13.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.915+0000 7f721dffb640 1 -- 172.21.15.26:0/3825010456 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72140a89b0 con 0x7f72200d1fa0 2023-10-14T11:13:13.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.915+0000 7f721dffb640 1 -- 172.21.15.26:0/3825010456 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72140a8b10 con 0x7f72200d1fa0 2023-10-14T11:13:13.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.915+0000 7f721dffb640 1 -- 172.21.15.26:0/3825010456 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72140a8ea0 con 0x7f72200d1fa0 2023-10-14T11:13:13.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.915+0000 7f7225846640 1 -- 172.21.15.26:0/3825010456 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72200d1fa0 msgr2=0x7f72200b8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:13.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.915+0000 7f7225846640 1 --2- 172.21.15.26:0/3825010456 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72200d1fa0 0x7f72200b8780 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f72140097f0 tx=0x7f721401ecb0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.915+0000 7f7225846640 1 -- 172.21.15.26:0/3825010456 shutdown_connections 2023-10-14T11:13:13.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.915+0000 7f7225846640 1 --2- 172.21.15.26:0/3825010456 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72200d1fa0 0x7f72200b8780 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.915+0000 7f7225846640 1 -- 172.21.15.26:0/3825010456 >> 172.21.15.26:0/3825010456 conn(0x7f722006b750 msgr2=0x7f722006bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:13.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.915+0000 7f7225846640 1 -- 172.21.15.26:0/3825010456 shutdown_connections 2023-10-14T11:13:13.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.915+0000 7f7225846640 1 -- 172.21.15.26:0/3825010456 wait complete. 2023-10-14T11:13:13.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f7225846640 1 Processor -- start 2023-10-14T11:13:13.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f7225846640 1 -- start start 2023-10-14T11:13:13.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f7225846640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72200cdf50 0x7f7220150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:13.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f7225846640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72200d1fa0 0x7f72201510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:13.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f7225846640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f722015cc30 0x7f72200c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:13.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f7225846640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72201481a0 con 0x7f72200cdf50 2023-10-14T11:13:13.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f7225846640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7220147590 con 0x7f72200d1fa0 2023-10-14T11:13:13.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f7225846640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7220147870 con 0x7f722015cc30 2023-10-14T11:13:13.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f721effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72200cdf50 0x7f7220150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:13.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f721effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72200cdf50 0x7f7220150b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38468/0 (socket says 172.21.15.26:38468) 2023-10-14T11:13:13.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f721effd640 1 -- 172.21.15.26:0/4258094309 learned_addr learned my addr 172.21.15.26:0/4258094309 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:13.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f721f7fe640 1 --2- 172.21.15.26:0/4258094309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f722015cc30 0x7f72200c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:13.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f721e7fc640 1 --2- 172.21.15.26:0/4258094309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72200d1fa0 0x7f72201510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:13.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f721effd640 1 -- 172.21.15.26:0/4258094309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f722015cc30 msgr2=0x7f72200c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:13.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f721effd640 1 --2- 172.21.15.26:0/4258094309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f722015cc30 0x7f72200c5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f721effd640 1 -- 172.21.15.26:0/4258094309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72200d1fa0 msgr2=0x7f72201510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:13.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f721effd640 1 --2- 172.21.15.26:0/4258094309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72200d1fa0 0x7f72201510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:13.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f721effd640 1 -- 172.21.15.26:0/4258094309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7214009420 con 0x7f72200cdf50 2023-10-14T11:13:13.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f721e7fc640 1 --2- 172.21.15.26:0/4258094309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72200d1fa0 0x7f72201510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:13.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f721f7fe640 1 --2- 172.21.15.26:0/4258094309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f722015cc30 0x7f72200c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:13.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f721effd640 1 --2- 172.21.15.26:0/4258094309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72200cdf50 0x7f7220150b70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f721000c4d0 tx=0x7f721000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:13.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f7207fff640 1 -- 172.21.15.26:0/4258094309 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7210005cf0 con 0x7f72200cdf50 2023-10-14T11:13:13.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f7207fff640 1 -- 172.21.15.26:0/4258094309 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7210005e50 con 0x7f72200cdf50 2023-10-14T11:13:13.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f7225846640 1 -- 172.21.15.26:0/4258094309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7220147b50 con 0x7f72200cdf50 2023-10-14T11:13:13.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f7207fff640 1 -- 172.21.15.26:0/4258094309 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7210007290 con 0x7f72200cdf50 2023-10-14T11:13:13.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.919+0000 7f7225846640 1 -- 172.21.15.26:0/4258094309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7220148630 con 0x7f72200cdf50 2023-10-14T11:13:13.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.923+0000 7f7225846640 1 -- 172.21.15.26:0/4258094309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7220067230 con 0x7f72200cdf50 2023-10-14T11:13:13.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.923+0000 7f7207fff640 1 -- 172.21.15.26:0/4258094309 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f72100073f0 con 0x7f72200cdf50 2023-10-14T11:13:13.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.923+0000 7f7207fff640 1 --2- 172.21.15.26:0/4258094309 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f720c0664a0 0x7f720c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:13.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.923+0000 7f7207fff640 1 -- 172.21.15.26:0/4258094309 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7210083850 con 0x7f72200cdf50 2023-10-14T11:13:13.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.923+0000 7f721e7fc640 1 --2- 172.21.15.26:0/4258094309 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f720c0664a0 0x7f720c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:13.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.923+0000 7f721e7fc640 1 --2- 172.21.15.26:0/4258094309 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f720c0664a0 0x7f720c068960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f72140b2000 tx=0x7f72140aa070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:13.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:13.927+0000 7f7207fff640 1 -- 172.21.15.26:0/4258094309 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7210050900 con 0x7f72200cdf50 2023-10-14T11:13:14.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.087+0000 7f7225846640 1 -- 172.21.15.26:0/4258094309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f72200b83e0 con 0x7f72200cdf50 2023-10-14T11:13:14.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.087+0000 7f7207fff640 1 -- 172.21.15.26:0/4258094309 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7210017020 con 0x7f72200cdf50 2023-10-14T11:13:14.092 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:13:14.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.091+0000 7f7225846640 1 -- 172.21.15.26:0/4258094309 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f720c0664a0 msgr2=0x7f720c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:14.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.091+0000 7f7225846640 1 --2- 172.21.15.26:0/4258094309 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f720c0664a0 0x7f720c068960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f72140b2000 tx=0x7f72140aa070 comp rx=0 tx=0).stop 2023-10-14T11:13:14.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.091+0000 7f7225846640 1 -- 172.21.15.26:0/4258094309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72200cdf50 msgr2=0x7f7220150b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:14.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.091+0000 7f7225846640 1 --2- 172.21.15.26:0/4258094309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72200cdf50 0x7f7220150b70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f721000c4d0 tx=0x7f721000c990 comp rx=0 tx=0).stop 2023-10-14T11:13:14.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.091+0000 7f7225846640 1 -- 172.21.15.26:0/4258094309 shutdown_connections 2023-10-14T11:13:14.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.091+0000 7f7225846640 1 --2- 172.21.15.26:0/4258094309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f722015cc30 0x7f72200c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.091+0000 7f7225846640 1 --2- 172.21.15.26:0/4258094309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72200d1fa0 0x7f72201510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.091+0000 7f7225846640 1 --2- 172.21.15.26:0/4258094309 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f720c0664a0 0x7f720c068960 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.091+0000 7f7225846640 1 --2- 172.21.15.26:0/4258094309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72200cdf50 0x7f7220150b70 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.091+0000 7f7225846640 1 -- 172.21.15.26:0/4258094309 >> 172.21.15.26:0/4258094309 conn(0x7f722006b750 msgr2=0x7f72200715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:14.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.091+0000 7f7225846640 1 -- 172.21.15.26:0/4258094309 shutdown_connections 2023-10-14T11:13:14.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.091+0000 7f7225846640 1 -- 172.21.15.26:0/4258094309 wait complete. 2023-10-14T11:13:14.114 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T11:13:14.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.254+0000 7f906b1f8640 1 Processor -- start 2023-10-14T11:13:14.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.254+0000 7f906b1f8640 1 -- start start 2023-10-14T11:13:14.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.258+0000 7f906b1f8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9064069e90 0x7f906406d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:14.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.258+0000 7f906b1f8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f906415ae30 con 0x7f906406a270 2023-10-14T11:13:14.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.258+0000 7f906b1f8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90640ca510 con 0x7f90640c26b0 2023-10-14T11:13:14.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.258+0000 7f906b1f8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90640cb090 con 0x7f9064069e90 2023-10-14T11:13:14.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.258+0000 7f9068f94640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9064069e90 0x7f906406d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:14.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.258+0000 7f9063fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f906406a270 0x7f90640c9ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45044/0 (socket says 172.21.15.26:45044) 2023-10-14T11:13:14.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.258+0000 7f9063fff640 1 -- 172.21.15.26:0/1401253991 learned_addr learned my addr 172.21.15.26:0/1401253991 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:14.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.258+0000 7f9068f94640 1 -- 172.21.15.26:0/1401253991 >> v1:172.21.15.110:6789/0 conn(0x7f90640c26b0 legacy=0x7f90640c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:14.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.258+0000 7f9068f94640 1 -- 172.21.15.26:0/1401253991 >> v1:172.21.15.26:6789/0 conn(0x7f906406a270 legacy=0x7f90640c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:14.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.258+0000 7f9068f94640 1 -- 172.21.15.26:0/1401253991 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90640ca7f0 con 0x7f9064069e90 2023-10-14T11:13:14.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.258+0000 7f9068f94640 1 --2- 172.21.15.26:0/1401253991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9064069e90 0x7f906406d010 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f90580097c0 tx=0x7f905801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56486266fb4885e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:14.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.262+0000 7f90637fe640 1 -- 172.21.15.26:0/1401253991 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90640c3a20 con 0x7f9064069e90 2023-10-14T11:13:14.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.262+0000 7f90637fe640 1 -- 172.21.15.26:0/1401253991 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90580ab650 con 0x7f9064069e90 2023-10-14T11:13:14.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.262+0000 7f90637fe640 1 -- 172.21.15.26:0/1401253991 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90580ab9e0 con 0x7f9064069e90 2023-10-14T11:13:14.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.262+0000 7f906b1f8640 1 -- 172.21.15.26:0/1401253991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9064069e90 msgr2=0x7f906406d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:14.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.262+0000 7f906b1f8640 1 --2- 172.21.15.26:0/1401253991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9064069e90 0x7f906406d010 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f90580097c0 tx=0x7f905801c450 comp rx=0 tx=0).stop 2023-10-14T11:13:14.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.262+0000 7f906b1f8640 1 -- 172.21.15.26:0/1401253991 shutdown_connections 2023-10-14T11:13:14.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.262+0000 7f906b1f8640 1 --2- 172.21.15.26:0/1401253991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9064069e90 0x7f906406d010 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.262+0000 7f906b1f8640 1 -- 172.21.15.26:0/1401253991 >> 172.21.15.26:0/1401253991 conn(0x7f90640b0da0 msgr2=0x7f90640ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:14.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.262+0000 7f906b1f8640 1 -- 172.21.15.26:0/1401253991 shutdown_connections 2023-10-14T11:13:14.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.262+0000 7f906b1f8640 1 -- 172.21.15.26:0/1401253991 wait complete. 2023-10-14T11:13:14.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.262+0000 7f906b1f8640 1 Processor -- start 2023-10-14T11:13:14.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.262+0000 7f906b1f8640 1 -- start start 2023-10-14T11:13:14.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.262+0000 7f906b1f8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9064069e90 0x7f9064158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:14.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.262+0000 7f906b1f8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f906406a270 0x7f9064151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:14.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.262+0000 7f906b1f8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90640c26b0 0x7f9064070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:14.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.262+0000 7f906b1f8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906415a280 con 0x7f9064069e90 2023-10-14T11:13:14.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.262+0000 7f906b1f8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9064151e70 con 0x7f90640c26b0 2023-10-14T11:13:14.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.262+0000 7f906b1f8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9064159600 con 0x7f906406a270 2023-10-14T11:13:14.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.262+0000 7f9068f94640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9064069e90 0x7f9064158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:14.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.262+0000 7f9068f94640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9064069e90 0x7f9064158f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38482/0 (socket says 172.21.15.26:38482) 2023-10-14T11:13:14.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.262+0000 7f9068f94640 1 -- 172.21.15.26:0/1697753260 learned_addr learned my addr 172.21.15.26:0/1697753260 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:14.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.262+0000 7f9069795640 1 --2- 172.21.15.26:0/1697753260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90640c26b0 0x7f9064070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:14.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.266+0000 7f9063fff640 1 --2- 172.21.15.26:0/1697753260 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f906406a270 0x7f9064151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:14.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.266+0000 7f9068f94640 1 -- 172.21.15.26:0/1697753260 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f906406a270 msgr2=0x7f9064151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:14.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.266+0000 7f9068f94640 1 --2- 172.21.15.26:0/1697753260 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f906406a270 0x7f9064151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.266+0000 7f9068f94640 1 -- 172.21.15.26:0/1697753260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90640c26b0 msgr2=0x7f9064070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:14.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.266+0000 7f9068f94640 1 --2- 172.21.15.26:0/1697753260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90640c26b0 0x7f9064070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.266+0000 7f9068f94640 1 -- 172.21.15.26:0/1697753260 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9058009420 con 0x7f9064069e90 2023-10-14T11:13:14.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.266+0000 7f9069795640 1 --2- 172.21.15.26:0/1697753260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90640c26b0 0x7f9064070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:14.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.266+0000 7f9068f94640 1 --2- 172.21.15.26:0/1697753260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9064069e90 0x7f9064158f70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9058019060 tx=0x7f905801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:14.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.266+0000 7f90617fa640 1 -- 172.21.15.26:0/1697753260 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90580b5810 con 0x7f9064069e90 2023-10-14T11:13:14.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.266+0000 7f90617fa640 1 -- 172.21.15.26:0/1697753260 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90580b5990 con 0x7f9064069e90 2023-10-14T11:13:14.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.266+0000 7f906b1f8640 1 -- 172.21.15.26:0/1697753260 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90641598e0 con 0x7f9064069e90 2023-10-14T11:13:14.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.266+0000 7f90617fa640 1 -- 172.21.15.26:0/1697753260 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90580b5d40 con 0x7f9064069e90 2023-10-14T11:13:14.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.266+0000 7f906b1f8640 1 -- 172.21.15.26:0/1697753260 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9064159ea0 con 0x7f9064069e90 2023-10-14T11:13:14.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.266+0000 7f906b1f8640 1 -- 172.21.15.26:0/1697753260 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f906404e170 con 0x7f9064069e90 2023-10-14T11:13:14.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.266+0000 7f90617fa640 1 -- 172.21.15.26:0/1697753260 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f90580b4390 con 0x7f9064069e90 2023-10-14T11:13:14.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.266+0000 7f90617fa640 1 --2- 172.21.15.26:0/1697753260 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f90480664a0 0x7f9048068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:14.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.266+0000 7f90617fa640 1 -- 172.21.15.26:0/1697753260 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f905811ecb0 con 0x7f9064069e90 2023-10-14T11:13:14.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.266+0000 7f9063fff640 1 --2- 172.21.15.26:0/1697753260 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f90480664a0 0x7f9048068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:14.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.270+0000 7f9063fff640 1 --2- 172.21.15.26:0/1697753260 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f90480664a0 0x7f9048068960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f90641525b0 tx=0x7f9050009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:14.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.270+0000 7f90617fa640 1 -- 172.21.15.26:0/1697753260 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f90580ebe00 con 0x7f9064069e90 2023-10-14T11:13:14.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.426+0000 7f906b1f8640 1 -- 172.21.15.26:0/1697753260 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f90640c2090 con 0x7f9064069e90 2023-10-14T11:13:14.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.426+0000 7f90617fa640 1 -- 172.21.15.26:0/1697753260 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f90580ef420 con 0x7f9064069e90 2023-10-14T11:13:14.433 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:14.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.430+0000 7f906b1f8640 1 -- 172.21.15.26:0/1697753260 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f90480664a0 msgr2=0x7f9048068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:14.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.430+0000 7f906b1f8640 1 --2- 172.21.15.26:0/1697753260 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f90480664a0 0x7f9048068960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f90641525b0 tx=0x7f9050009040 comp rx=0 tx=0).stop 2023-10-14T11:13:14.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.430+0000 7f906b1f8640 1 -- 172.21.15.26:0/1697753260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9064069e90 msgr2=0x7f9064158f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:14.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.430+0000 7f906b1f8640 1 --2- 172.21.15.26:0/1697753260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9064069e90 0x7f9064158f70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9058019060 tx=0x7f905801ac90 comp rx=0 tx=0).stop 2023-10-14T11:13:14.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.430+0000 7f906b1f8640 1 -- 172.21.15.26:0/1697753260 shutdown_connections 2023-10-14T11:13:14.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.430+0000 7f906b1f8640 1 --2- 172.21.15.26:0/1697753260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90640c26b0 0x7f9064070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.430+0000 7f906b1f8640 1 --2- 172.21.15.26:0/1697753260 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f906406a270 0x7f9064151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.430+0000 7f906b1f8640 1 --2- 172.21.15.26:0/1697753260 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f90480664a0 0x7f9048068960 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.430+0000 7f906b1f8640 1 --2- 172.21.15.26:0/1697753260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9064069e90 0x7f9064158f70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.430+0000 7f906b1f8640 1 -- 172.21.15.26:0/1697753260 >> 172.21.15.26:0/1697753260 conn(0x7f90640b0da0 msgr2=0x7f90640ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:14.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.430+0000 7f906b1f8640 1 -- 172.21.15.26:0/1697753260 shutdown_connections 2023-10-14T11:13:14.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.430+0000 7f906b1f8640 1 -- 172.21.15.26:0/1697753260 wait complete. 2023-10-14T11:13:14.481 INFO:tasks.cephfs_test_runner:Starting test: test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) That a client who does not have the capability for setting 2023-10-14T11:13:14.482 INFO:tasks.cephfs_test_runner:test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-10-14T11:13:14.482 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:13:14.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.618+0000 7fee6b1d9640 1 Processor -- start 2023-10-14T11:13:14.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.618+0000 7fee6b1d9640 1 -- start start 2023-10-14T11:13:14.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.622+0000 7fee6b1d9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fee64159ba0 0x7fee640cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:14.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.622+0000 7fee6b1d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee640c8cb0 0x7fee640cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:14.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.622+0000 7fee6b1d9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee640723d0 con 0x7fee641597c0 2023-10-14T11:13:14.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.622+0000 7fee6b1d9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee640717c0 con 0x7fee64159ba0 2023-10-14T11:13:14.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.622+0000 7fee6b1d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee64071aa0 con 0x7fee640c8cb0 2023-10-14T11:13:14.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.622+0000 7fee63fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fee64159ba0 0x7fee640cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:14.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.622+0000 7fee68f75640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fee641597c0 0x7fee640ad6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45052/0 (socket says 172.21.15.26:45052) 2023-10-14T11:13:14.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.622+0000 7fee68f75640 1 -- 172.21.15.26:0/3911272588 learned_addr learned my addr 172.21.15.26:0/3911272588 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:14.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.622+0000 7fee69776640 1 --2- 172.21.15.26:0/3911272588 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee640c8cb0 0x7fee640cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:14.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.622+0000 7fee63fff640 1 -- 172.21.15.26:0/3911272588 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee640c8cb0 msgr2=0x7fee640cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:14.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.622+0000 7fee63fff640 1 --2- 172.21.15.26:0/3911272588 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee640c8cb0 0x7fee640cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.622+0000 7fee637fe640 1 -- 172.21.15.26:0/3911272588 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606246482 0 0) 0x7fee640723d0 con 0x7fee641597c0 2023-10-14T11:13:14.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.622+0000 7fee63fff640 1 -- 172.21.15.26:0/3911272588 >> v1:172.21.15.26:6789/0 conn(0x7fee641597c0 legacy=0x7fee640ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:14.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.622+0000 7fee63fff640 1 -- 172.21.15.26:0/3911272588 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee64071d80 con 0x7fee64159ba0 2023-10-14T11:13:14.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.626+0000 7fee63fff640 1 --2- 172.21.15.26:0/3911272588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee64159ba0 0x7fee640cae10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fee500097c0 tx=0x7fee5001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8fbd948f91d416 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:14.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.626+0000 7fee637fe640 1 -- 172.21.15.26:0/3911272588 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee500ab5f0 con 0x7fee64159ba0 2023-10-14T11:13:14.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.626+0000 7fee637fe640 1 -- 172.21.15.26:0/3911272588 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee500ab750 con 0x7fee64159ba0 2023-10-14T11:13:14.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.626+0000 7fee637fe640 1 -- 172.21.15.26:0/3911272588 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee500abae0 con 0x7fee64159ba0 2023-10-14T11:13:14.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.626+0000 7fee6b1d9640 1 -- 172.21.15.26:0/3911272588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee64159ba0 msgr2=0x7fee640cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:14.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.626+0000 7fee6b1d9640 1 --2- 172.21.15.26:0/3911272588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee64159ba0 0x7fee640cae10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fee500097c0 tx=0x7fee5001c450 comp rx=0 tx=0).stop 2023-10-14T11:13:14.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.626+0000 7fee6b1d9640 1 -- 172.21.15.26:0/3911272588 shutdown_connections 2023-10-14T11:13:14.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.626+0000 7fee6b1d9640 1 --2- 172.21.15.26:0/3911272588 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee640c8cb0 0x7fee640cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.626+0000 7fee6b1d9640 1 --2- 172.21.15.26:0/3911272588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee64159ba0 0x7fee640cae10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.626+0000 7fee6b1d9640 1 -- 172.21.15.26:0/3911272588 >> 172.21.15.26:0/3911272588 conn(0x7fee6406c190 msgr2=0x7fee6406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:14.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.626+0000 7fee6b1d9640 1 -- 172.21.15.26:0/3911272588 shutdown_connections 2023-10-14T11:13:14.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.626+0000 7fee6b1d9640 1 -- 172.21.15.26:0/3911272588 wait complete. 2023-10-14T11:13:14.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.626+0000 7fee6b1d9640 1 Processor -- start 2023-10-14T11:13:14.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.626+0000 7fee6b1d9640 1 -- start start 2023-10-14T11:13:14.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee6b1d9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee640c8cb0 0x7fee641496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:14.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee6b1d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee641597c0 0x7fee640c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:14.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee6b1d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee64159ba0 0x7fee6415a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:14.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee6b1d9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee640c7980 con 0x7fee640c8cb0 2023-10-14T11:13:14.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee6b1d9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee641f3ab0 con 0x7fee64159ba0 2023-10-14T11:13:14.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee6b1d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee641f3d90 con 0x7fee641597c0 2023-10-14T11:13:14.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee68f75640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee640c8cb0 0x7fee641496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:14.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee68f75640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee640c8cb0 0x7fee641496e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38498/0 (socket says 172.21.15.26:38498) 2023-10-14T11:13:14.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee68f75640 1 -- 172.21.15.26:0/2106848076 learned_addr learned my addr 172.21.15.26:0/2106848076 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:14.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee69776640 1 --2- 172.21.15.26:0/2106848076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee64159ba0 0x7fee6415a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:14.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee63fff640 1 --2- 172.21.15.26:0/2106848076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee641597c0 0x7fee640c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:14.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee68f75640 1 -- 172.21.15.26:0/2106848076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee641597c0 msgr2=0x7fee640c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:14.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee68f75640 1 --2- 172.21.15.26:0/2106848076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee641597c0 0x7fee640c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee68f75640 1 -- 172.21.15.26:0/2106848076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee64159ba0 msgr2=0x7fee6415a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:14.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee68f75640 1 --2- 172.21.15.26:0/2106848076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee64159ba0 0x7fee6415a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee68f75640 1 -- 172.21.15.26:0/2106848076 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee50009420 con 0x7fee640c8cb0 2023-10-14T11:13:14.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee68f75640 1 --2- 172.21.15.26:0/2106848076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee640c8cb0 0x7fee641496e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fee580011f0 tx=0x7fee5800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:14.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee617fa640 1 -- 172.21.15.26:0/2106848076 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee580074e0 con 0x7fee640c8cb0 2023-10-14T11:13:14.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee617fa640 1 -- 172.21.15.26:0/2106848076 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee58007640 con 0x7fee640c8cb0 2023-10-14T11:13:14.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee6b1d9640 1 -- 172.21.15.26:0/2106848076 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee640c7610 con 0x7fee640c8cb0 2023-10-14T11:13:14.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee617fa640 1 -- 172.21.15.26:0/2106848076 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58004a10 con 0x7fee640c8cb0 2023-10-14T11:13:14.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee6b1d9640 1 -- 172.21.15.26:0/2106848076 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee640c58e0 con 0x7fee640c8cb0 2023-10-14T11:13:14.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee6b1d9640 1 -- 172.21.15.26:0/2106848076 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee64074010 con 0x7fee640c8cb0 2023-10-14T11:13:14.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.630+0000 7fee617fa640 1 -- 172.21.15.26:0/2106848076 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fee58004b70 con 0x7fee640c8cb0 2023-10-14T11:13:14.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.634+0000 7fee617fa640 1 --2- 172.21.15.26:0/2106848076 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fee480664d0 0x7fee48068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:14.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.634+0000 7fee617fa640 1 -- 172.21.15.26:0/2106848076 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fee58083770 con 0x7fee640c8cb0 2023-10-14T11:13:14.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.634+0000 7fee63fff640 1 --2- 172.21.15.26:0/2106848076 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fee480664d0 0x7fee48068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:14.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.634+0000 7fee63fff640 1 --2- 172.21.15.26:0/2106848076 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fee480664d0 0x7fee48068990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fee500af000 tx=0x7fee500a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:14.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.638+0000 7fee617fa640 1 -- 172.21.15.26:0/2106848076 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fee58050840 con 0x7fee640c8cb0 2023-10-14T11:13:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.794+0000 7fee6b1d9640 1 -- 172.21.15.26:0/2106848076 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee640b4290 con 0x7fee640c8cb0 2023-10-14T11:13:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.794+0000 7fee617fa640 1 -- 172.21.15.26:0/2106848076 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18679 (secure 0 0 0) 0x7fee58053e60 con 0x7fee640c8cb0 2023-10-14T11:13:14.802 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:14.802 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":27,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:13:03.866737+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:13:14.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.798+0000 7fee6b1d9640 1 -- 172.21.15.26:0/2106848076 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fee480664d0 msgr2=0x7fee48068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:14.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.798+0000 7fee6b1d9640 1 --2- 172.21.15.26:0/2106848076 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fee480664d0 0x7fee48068990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fee500af000 tx=0x7fee500a7000 comp rx=0 tx=0).stop 2023-10-14T11:13:14.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.798+0000 7fee6b1d9640 1 -- 172.21.15.26:0/2106848076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee640c8cb0 msgr2=0x7fee641496e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:14.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.798+0000 7fee6b1d9640 1 --2- 172.21.15.26:0/2106848076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee640c8cb0 0x7fee641496e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fee580011f0 tx=0x7fee5800c9b0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.798+0000 7fee6b1d9640 1 -- 172.21.15.26:0/2106848076 shutdown_connections 2023-10-14T11:13:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.798+0000 7fee6b1d9640 1 --2- 172.21.15.26:0/2106848076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee64159ba0 0x7fee6415a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.798+0000 7fee6b1d9640 1 --2- 172.21.15.26:0/2106848076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee641597c0 0x7fee640c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.798+0000 7fee6b1d9640 1 --2- 172.21.15.26:0/2106848076 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fee480664d0 0x7fee48068990 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.798+0000 7fee6b1d9640 1 --2- 172.21.15.26:0/2106848076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee640c8cb0 0x7fee641496e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.798+0000 7fee6b1d9640 1 -- 172.21.15.26:0/2106848076 >> 172.21.15.26:0/2106848076 conn(0x7fee6406c190 msgr2=0x7fee640cb050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:14.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.798+0000 7fee6b1d9640 1 -- 172.21.15.26:0/2106848076 shutdown_connections 2023-10-14T11:13:14.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.798+0000 7fee6b1d9640 1 -- 172.21.15.26:0/2106848076 wait complete. 2023-10-14T11:13:14.823 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:12:20.179562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:12:21.346111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T11:12:25.025159+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T11:13:14.824 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:13:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.966+0000 7fc66b53e640 1 Processor -- start 2023-10-14T11:13:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.966+0000 7fc66b53e640 1 -- start start 2023-10-14T11:13:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.966+0000 7fc66b53e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc6640d0210 0x7fc6640d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.966+0000 7fc66b53e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc6640b84e0 0x7fc6640b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.966+0000 7fc66b53e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6640d1670 con 0x7fc66415cba0 2023-10-14T11:13:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.966+0000 7fc66b53e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6640d1460 con 0x7fc6640d0210 2023-10-14T11:13:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.966+0000 7fc66b53e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6640d1950 con 0x7fc6640b84e0 2023-10-14T11:13:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.966+0000 7fc668ad9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc6640d0210 0x7fc6640d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.966+0000 7fc668ad9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc6640d0210 0x7fc6640d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38514/0 (socket says 172.21.15.26:38514) 2023-10-14T11:13:14.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.966+0000 7fc668ad9640 1 -- 172.21.15.26:0/1720051418 learned_addr learned my addr 172.21.15.26:0/1720051418 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:14.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.966+0000 7fc669adb640 1 --2- 172.21.15.26:0/1720051418 >> v2:172.21.15.110:3300/0 conn(0x7fc6640b84e0 0x7fc6640b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:14.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.966+0000 7fc668ad9640 1 -- 172.21.15.26:0/1720051418 >> v2:172.21.15.110:3300/0 conn(0x7fc6640b84e0 msgr2=0x7fc6640b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:14.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.966+0000 7fc668ad9640 1 --2- 172.21.15.26:0/1720051418 >> v2:172.21.15.110:3300/0 conn(0x7fc6640b84e0 0x7fc6640b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.966+0000 7fc668ad9640 1 -- 172.21.15.26:0/1720051418 >> v1:172.21.15.110:6789/0 conn(0x7fc66415cba0 legacy=0x7fc6640cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:14.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.966+0000 7fc668ad9640 1 -- 172.21.15.26:0/1720051418 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6640d1c30 con 0x7fc6640d0210 2023-10-14T11:13:14.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.970+0000 7fc668ad9640 1 --2- 172.21.15.26:0/1720051418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6640d0210 0x7fc6640d0f20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc6640ce450 tx=0x7fc65401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6418497b5cce414 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:14.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.970+0000 7fc65bfff640 1 -- 172.21.15.26:0/1720051418 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6540ab670 con 0x7fc6640d0210 2023-10-14T11:13:14.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.970+0000 7fc65bfff640 1 -- 172.21.15.26:0/1720051418 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6540ab7d0 con 0x7fc6640d0210 2023-10-14T11:13:14.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.970+0000 7fc65bfff640 1 -- 172.21.15.26:0/1720051418 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6540abb60 con 0x7fc6640d0210 2023-10-14T11:13:14.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.970+0000 7fc66b53e640 1 -- 172.21.15.26:0/1720051418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6640d0210 msgr2=0x7fc6640d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:14.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.970+0000 7fc66b53e640 1 --2- 172.21.15.26:0/1720051418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6640d0210 0x7fc6640d0f20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc6640ce450 tx=0x7fc65401c470 comp rx=0 tx=0).stop 2023-10-14T11:13:14.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.970+0000 7fc66b53e640 1 -- 172.21.15.26:0/1720051418 shutdown_connections 2023-10-14T11:13:14.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.970+0000 7fc66b53e640 1 --2- 172.21.15.26:0/1720051418 >> v2:172.21.15.110:3300/0 conn(0x7fc6640b84e0 0x7fc6640b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.970+0000 7fc66b53e640 1 --2- 172.21.15.26:0/1720051418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6640d0210 0x7fc6640d0f20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.970+0000 7fc66b53e640 1 -- 172.21.15.26:0/1720051418 >> 172.21.15.26:0/1720051418 conn(0x7fc6640719c0 msgr2=0x7fc664071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:14.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.970+0000 7fc66b53e640 1 -- 172.21.15.26:0/1720051418 shutdown_connections 2023-10-14T11:13:14.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.970+0000 7fc66b53e640 1 -- 172.21.15.26:0/1720051418 wait complete. 2023-10-14T11:13:14.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc66b53e640 1 Processor -- start 2023-10-14T11:13:14.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc66b53e640 1 -- start start 2023-10-14T11:13:14.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc66b53e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6640b84e0 0x7fc664150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:14.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc66b53e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6640d0210 0x7fc664154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:14.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc66b53e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc66415cba0 0x7fc664154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:14.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc66b53e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc664157c30 con 0x7fc66415cba0 2023-10-14T11:13:14.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc66b53e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc664157f10 con 0x7fc6640b84e0 2023-10-14T11:13:14.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc66b53e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6641581f0 con 0x7fc6640d0210 2023-10-14T11:13:14.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc669adb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc66415cba0 0x7fc664154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:14.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc669adb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc66415cba0 0x7fc664154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38530/0 (socket says 172.21.15.26:38530) 2023-10-14T11:13:14.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc669adb640 1 -- 172.21.15.26:0/288425216 learned_addr learned my addr 172.21.15.26:0/288425216 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:14.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc6692da640 1 --2- 172.21.15.26:0/288425216 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6640b84e0 0x7fc664150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:14.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc668ad9640 1 --2- 172.21.15.26:0/288425216 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6640d0210 0x7fc664154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:14.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc669adb640 1 -- 172.21.15.26:0/288425216 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6640d0210 msgr2=0x7fc664154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:14.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc669adb640 1 --2- 172.21.15.26:0/288425216 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6640d0210 0x7fc664154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc669adb640 1 -- 172.21.15.26:0/288425216 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6640b84e0 msgr2=0x7fc664150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:14.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc669adb640 1 --2- 172.21.15.26:0/288425216 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6640b84e0 0x7fc664150340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:14.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc669adb640 1 -- 172.21.15.26:0/288425216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6540094d0 con 0x7fc66415cba0 2023-10-14T11:13:14.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc669adb640 1 --2- 172.21.15.26:0/288425216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc66415cba0 0x7fc664154590 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc65c007e30 tx=0x7fc65c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:14.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc659ffb640 1 -- 172.21.15.26:0/288425216 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c014620 con 0x7fc66415cba0 2023-10-14T11:13:14.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc659ffb640 1 -- 172.21.15.26:0/288425216 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65c00ee90 con 0x7fc66415cba0 2023-10-14T11:13:14.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc659ffb640 1 -- 172.21.15.26:0/288425216 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0149c0 con 0x7fc66415cba0 2023-10-14T11:13:14.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc66b53e640 1 -- 172.21.15.26:0/288425216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6641584d0 con 0x7fc66415cba0 2023-10-14T11:13:14.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.974+0000 7fc66b53e640 1 -- 172.21.15.26:0/288425216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6640c9db0 con 0x7fc66415cba0 2023-10-14T11:13:14.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.978+0000 7fc66b53e640 1 -- 172.21.15.26:0/288425216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc66404e170 con 0x7fc66415cba0 2023-10-14T11:13:14.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.978+0000 7fc659ffb640 1 -- 172.21.15.26:0/288425216 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc65c014b20 con 0x7fc66415cba0 2023-10-14T11:13:14.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.978+0000 7fc659ffb640 1 --2- 172.21.15.26:0/288425216 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc6480664d0 0x7fc648068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:14.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.978+0000 7fc659ffb640 1 -- 172.21.15.26:0/288425216 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc65c084b40 con 0x7fc66415cba0 2023-10-14T11:13:14.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.978+0000 7fc6692da640 1 --2- 172.21.15.26:0/288425216 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc6480664d0 0x7fc648068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:14.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.978+0000 7fc6692da640 1 --2- 172.21.15.26:0/288425216 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc6480664d0 0x7fc648068990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc660007fd0 tx=0x7fc660009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:14.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:14.982+0000 7fc659ffb640 1 -- 172.21.15.26:0/288425216 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc65c051c10 con 0x7fc66415cba0 2023-10-14T11:13:15.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.142+0000 7fc66b53e640 1 -- 172.21.15.26:0/288425216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc664158980 con 0x7fc66415cba0 2023-10-14T11:13:15.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.142+0000 7fc659ffb640 1 -- 172.21.15.26:0/288425216 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc65c055230 con 0x7fc66415cba0 2023-10-14T11:13:15.149 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:13:15.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.146+0000 7fc66b53e640 1 -- 172.21.15.26:0/288425216 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc6480664d0 msgr2=0x7fc648068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:15.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.146+0000 7fc66b53e640 1 --2- 172.21.15.26:0/288425216 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc6480664d0 0x7fc648068990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc660007fd0 tx=0x7fc660009040 comp rx=0 tx=0).stop 2023-10-14T11:13:15.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.146+0000 7fc66b53e640 1 -- 172.21.15.26:0/288425216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc66415cba0 msgr2=0x7fc664154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:15.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.146+0000 7fc66b53e640 1 --2- 172.21.15.26:0/288425216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc66415cba0 0x7fc664154590 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc65c007e30 tx=0x7fc65c00e4b0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.146+0000 7fc66b53e640 1 -- 172.21.15.26:0/288425216 shutdown_connections 2023-10-14T11:13:15.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.146+0000 7fc66b53e640 1 --2- 172.21.15.26:0/288425216 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc6480664d0 0x7fc648068990 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.146+0000 7fc66b53e640 1 --2- 172.21.15.26:0/288425216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc66415cba0 0x7fc664154590 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.146+0000 7fc66b53e640 1 --2- 172.21.15.26:0/288425216 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6640d0210 0x7fc664154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.146+0000 7fc66b53e640 1 --2- 172.21.15.26:0/288425216 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6640b84e0 0x7fc664150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.146+0000 7fc66b53e640 1 -- 172.21.15.26:0/288425216 >> 172.21.15.26:0/288425216 conn(0x7fc6640719c0 msgr2=0x7fc6640b7890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:15.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.146+0000 7fc66b53e640 1 -- 172.21.15.26:0/288425216 shutdown_connections 2023-10-14T11:13:15.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.146+0000 7fc66b53e640 1 -- 172.21.15.26:0/288425216 wait complete. 2023-10-14T11:13:15.170 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:13:15.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.314+0000 7fa6ef032640 1 Processor -- start 2023-10-14T11:13:15.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.314+0000 7fa6ef032640 1 -- start start 2023-10-14T11:13:15.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.314+0000 7fa6ef032640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa6e80b84e0 0x7fa6e80d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:15.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.314+0000 7fa6ef032640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e80d1670 con 0x7fa6e815cba0 2023-10-14T11:13:15.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.314+0000 7fa6ef032640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e80d1950 con 0x7fa6e80d0210 2023-10-14T11:13:15.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.314+0000 7fa6ef032640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e80d1460 con 0x7fa6e80b84e0 2023-10-14T11:13:15.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.314+0000 7fa6ecdce640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa6e815cba0 0x7fa6e80cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45058/0 (socket says 172.21.15.26:45058) 2023-10-14T11:13:15.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.314+0000 7fa6ecdce640 1 -- 172.21.15.26:0/2383034259 learned_addr learned my addr 172.21.15.26:0/2383034259 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:15.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.314+0000 7fa6ed5cf640 1 --2- 172.21.15.26:0/2383034259 >> v2:172.21.15.26:3300/0 conn(0x7fa6e80b84e0 0x7fa6e80d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:15.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.314+0000 7fa6ed5cf640 1 -- 172.21.15.26:0/2383034259 >> v1:172.21.15.110:6789/0 conn(0x7fa6e80d0210 legacy=0x7fa6e80b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:15.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.314+0000 7fa6ed5cf640 1 -- 172.21.15.26:0/2383034259 >> v1:172.21.15.26:6789/0 conn(0x7fa6e815cba0 legacy=0x7fa6e80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:15.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.314+0000 7fa6ed5cf640 1 -- 172.21.15.26:0/2383034259 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e80d1c30 con 0x7fa6e80b84e0 2023-10-14T11:13:15.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.318+0000 7fa6ed5cf640 1 --2- 172.21.15.26:0/2383034259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6e80b84e0 0x7fa6e80d0f20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0009d90 tx=0x7fa6e001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a940d17817efaf7d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:15.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.318+0000 7fa6e77fe640 1 -- 172.21.15.26:0/2383034259 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e00a5980 con 0x7fa6e80b84e0 2023-10-14T11:13:15.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.318+0000 7fa6e77fe640 1 -- 172.21.15.26:0/2383034259 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e00a5ae0 con 0x7fa6e80b84e0 2023-10-14T11:13:15.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.318+0000 7fa6e77fe640 1 -- 172.21.15.26:0/2383034259 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e00a5e70 con 0x7fa6e80b84e0 2023-10-14T11:13:15.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.318+0000 7fa6ef032640 1 -- 172.21.15.26:0/2383034259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6e80b84e0 msgr2=0x7fa6e80d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:15.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.318+0000 7fa6ef032640 1 --2- 172.21.15.26:0/2383034259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6e80b84e0 0x7fa6e80d0f20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0009d90 tx=0x7fa6e001c8c0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.318+0000 7fa6ef032640 1 -- 172.21.15.26:0/2383034259 shutdown_connections 2023-10-14T11:13:15.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.318+0000 7fa6ef032640 1 --2- 172.21.15.26:0/2383034259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6e80b84e0 0x7fa6e80d0f20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.318+0000 7fa6ef032640 1 -- 172.21.15.26:0/2383034259 >> 172.21.15.26:0/2383034259 conn(0x7fa6e80719c0 msgr2=0x7fa6e8071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:15.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.318+0000 7fa6ef032640 1 -- 172.21.15.26:0/2383034259 shutdown_connections 2023-10-14T11:13:15.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.318+0000 7fa6ef032640 1 -- 172.21.15.26:0/2383034259 wait complete. 2023-10-14T11:13:15.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6ef032640 1 Processor -- start 2023-10-14T11:13:15.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6ef032640 1 -- start start 2023-10-14T11:13:15.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6ef032640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6e80b84e0 0x7fa6e8152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:15.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6ef032640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6e80d0210 0x7fa6e8146e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:15.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6ef032640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6e815cba0 0x7fa6e814a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:15.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6ef032640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e814a4a0 con 0x7fa6e80b84e0 2023-10-14T11:13:15.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6ef032640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e8151e30 con 0x7fa6e815cba0 2023-10-14T11:13:15.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6ef032640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e8151220 con 0x7fa6e80d0210 2023-10-14T11:13:15.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6ecdce640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6e80b84e0 0x7fa6e8152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:15.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6ecdce640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6e80b84e0 0x7fa6e8152eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38546/0 (socket says 172.21.15.26:38546) 2023-10-14T11:13:15.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6ecdce640 1 -- 172.21.15.26:0/109684826 learned_addr learned my addr 172.21.15.26:0/109684826 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:15.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6e7fff640 1 --2- 172.21.15.26:0/109684826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6e80d0210 0x7fa6e8146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:15.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6ed5cf640 1 --2- 172.21.15.26:0/109684826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6e815cba0 0x7fa6e814a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:15.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6ecdce640 1 -- 172.21.15.26:0/109684826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6e80d0210 msgr2=0x7fa6e8146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:15.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6ecdce640 1 --2- 172.21.15.26:0/109684826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6e80d0210 0x7fa6e8146e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6ecdce640 1 -- 172.21.15.26:0/109684826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6e815cba0 msgr2=0x7fa6e814a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:15.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6ecdce640 1 --2- 172.21.15.26:0/109684826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6e815cba0 0x7fa6e814a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6ecdce640 1 -- 172.21.15.26:0/109684826 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e0009a70 con 0x7fa6e80b84e0 2023-10-14T11:13:15.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6ecdce640 1 --2- 172.21.15.26:0/109684826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6e80b84e0 0x7fa6e8152eb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00c400 tx=0x7fa6dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:15.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6e57fa640 1 -- 172.21.15.26:0/109684826 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc005cf0 con 0x7fa6e80b84e0 2023-10-14T11:13:15.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6e57fa640 1 -- 172.21.15.26:0/109684826 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6dc005e50 con 0x7fa6e80b84e0 2023-10-14T11:13:15.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6ef032640 1 -- 172.21.15.26:0/109684826 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e8151500 con 0x7fa6e80b84e0 2023-10-14T11:13:15.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6e57fa640 1 -- 172.21.15.26:0/109684826 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc0072d0 con 0x7fa6e80b84e0 2023-10-14T11:13:15.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6ef032640 1 -- 172.21.15.26:0/109684826 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e8151ac0 con 0x7fa6e80b84e0 2023-10-14T11:13:15.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.322+0000 7fa6ef032640 1 -- 172.21.15.26:0/109684826 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e804e170 con 0x7fa6e80b84e0 2023-10-14T11:13:15.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.326+0000 7fa6e57fa640 1 -- 172.21.15.26:0/109684826 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa6dc007430 con 0x7fa6e80b84e0 2023-10-14T11:13:15.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.326+0000 7fa6e57fa640 1 --2- 172.21.15.26:0/109684826 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa6cc0664a0 0x7fa6cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:15.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.326+0000 7fa6e57fa640 1 -- 172.21.15.26:0/109684826 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa6dc0837a0 con 0x7fa6e80b84e0 2023-10-14T11:13:15.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.326+0000 7fa6e7fff640 1 --2- 172.21.15.26:0/109684826 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa6cc0664a0 0x7fa6cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:15.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.326+0000 7fa6e7fff640 1 --2- 172.21.15.26:0/109684826 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa6cc0664a0 0x7fa6cc068960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80cf280 tx=0x7fa6d4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:15.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.330+0000 7fa6e57fa640 1 -- 172.21.15.26:0/109684826 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa6dc050900 con 0x7fa6e80b84e0 2023-10-14T11:13:15.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.486+0000 7fa6ef032640 1 -- 172.21.15.26:0/109684826 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa6e80d37f0 con 0x7fa6e80b84e0 2023-10-14T11:13:15.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.486+0000 7fa6e57fa640 1 -- 172.21.15.26:0/109684826 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa6dc053f20 con 0x7fa6e80b84e0 2023-10-14T11:13:15.493 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:15.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.490+0000 7fa6ef032640 1 -- 172.21.15.26:0/109684826 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa6cc0664a0 msgr2=0x7fa6cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:15.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.490+0000 7fa6ef032640 1 --2- 172.21.15.26:0/109684826 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa6cc0664a0 0x7fa6cc068960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80cf280 tx=0x7fa6d4009040 comp rx=0 tx=0).stop 2023-10-14T11:13:15.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.490+0000 7fa6ef032640 1 -- 172.21.15.26:0/109684826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6e80b84e0 msgr2=0x7fa6e8152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.490+0000 7fa6ef032640 1 --2- 172.21.15.26:0/109684826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6e80b84e0 0x7fa6e8152eb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00c400 tx=0x7fa6dc00c8c0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.490+0000 7fa6ef032640 1 -- 172.21.15.26:0/109684826 shutdown_connections 2023-10-14T11:13:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.490+0000 7fa6ef032640 1 --2- 172.21.15.26:0/109684826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6e815cba0 0x7fa6e814a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.490+0000 7fa6ef032640 1 --2- 172.21.15.26:0/109684826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6e80d0210 0x7fa6e8146e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.490+0000 7fa6ef032640 1 --2- 172.21.15.26:0/109684826 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa6cc0664a0 0x7fa6cc068960 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.490+0000 7fa6ef032640 1 --2- 172.21.15.26:0/109684826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6e80b84e0 0x7fa6e8152eb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.490+0000 7fa6ef032640 1 -- 172.21.15.26:0/109684826 >> 172.21.15.26:0/109684826 conn(0x7fa6e80719c0 msgr2=0x7fa6e8072820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:15.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.490+0000 7fa6ef032640 1 -- 172.21.15.26:0/109684826 shutdown_connections 2023-10-14T11:13:15.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.490+0000 7fa6ef032640 1 -- 172.21.15.26:0/109684826 wait complete. 2023-10-14T11:13:15.514 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:13:15.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.658+0000 7f2f1913e640 1 Processor -- start 2023-10-14T11:13:15.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.658+0000 7f2f1913e640 1 -- start start 2023-10-14T11:13:15.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.658+0000 7f2f1913e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2f140d0210 0x7f2f140d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:15.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.658+0000 7f2f1913e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f140b84e0 0x7f2f140b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:15.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.662+0000 7f2f1913e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f140d1670 con 0x7f2f1415cba0 2023-10-14T11:13:15.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.662+0000 7f2f1913e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f140d1460 con 0x7f2f140d0210 2023-10-14T11:13:15.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.662+0000 7f2f1913e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f140d1950 con 0x7f2f140b84e0 2023-10-14T11:13:15.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.662+0000 7f2f1359e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f140b84e0 0x7f2f140b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:15.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.662+0000 7f2f1259c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2f140d0210 0x7f2f140d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:15.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.662+0000 7f2f1259c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2f140d0210 0x7f2f140d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:39178/0 (socket says 172.21.15.26:39178) 2023-10-14T11:13:15.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.662+0000 7f2f1259c640 1 -- 172.21.15.26:0/2720574356 learned_addr learned my addr 172.21.15.26:0/2720574356 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:15.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.662+0000 7f2f1359e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f140b84e0 0x7f2f140b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:45962/0 (socket says 172.21.15.26:45962) 2023-10-14T11:13:15.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.662+0000 7f2f1259c640 1 -- 172.21.15.26:0/2720574356 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f140b84e0 msgr2=0x7f2f140b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:15.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.662+0000 7f2f1259c640 1 --2- 172.21.15.26:0/2720574356 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f140b84e0 0x7f2f140b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.662+0000 7f2f1259c640 1 -- 172.21.15.26:0/2720574356 >> v1:172.21.15.110:6789/0 conn(0x7f2f1415cba0 legacy=0x7f2f140cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:15.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.662+0000 7f2f1259c640 1 -- 172.21.15.26:0/2720574356 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f140d1c30 con 0x7f2f140d0210 2023-10-14T11:13:15.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.662+0000 7f2f1259c640 1 --2- 172.21.15.26:0/2720574356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f140d0210 0x7f2f140d0f20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009870 tx=0x7f2f0801c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16fd975069bc4801 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:15.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.666+0000 7f2f11d9b640 1 -- 172.21.15.26:0/2720574356 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f080a9400 con 0x7f2f140d0210 2023-10-14T11:13:15.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.666+0000 7f2f11d9b640 1 -- 172.21.15.26:0/2720574356 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f080a9560 con 0x7f2f140d0210 2023-10-14T11:13:15.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.666+0000 7f2f11d9b640 1 -- 172.21.15.26:0/2720574356 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f080a98f0 con 0x7f2f140d0210 2023-10-14T11:13:15.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.666+0000 7f2f1913e640 1 -- 172.21.15.26:0/2720574356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f140d0210 msgr2=0x7f2f140d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:15.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.666+0000 7f2f1913e640 1 --2- 172.21.15.26:0/2720574356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f140d0210 0x7f2f140d0f20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009870 tx=0x7f2f0801c540 comp rx=0 tx=0).stop 2023-10-14T11:13:15.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.666+0000 7f2f1913e640 1 -- 172.21.15.26:0/2720574356 shutdown_connections 2023-10-14T11:13:15.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.666+0000 7f2f1913e640 1 --2- 172.21.15.26:0/2720574356 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f140b84e0 0x7f2f140b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.666+0000 7f2f1913e640 1 --2- 172.21.15.26:0/2720574356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f140d0210 0x7f2f140d0f20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.666+0000 7f2f1913e640 1 -- 172.21.15.26:0/2720574356 >> 172.21.15.26:0/2720574356 conn(0x7f2f140719c0 msgr2=0x7f2f14071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:15.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.666+0000 7f2f1913e640 1 -- 172.21.15.26:0/2720574356 shutdown_connections 2023-10-14T11:13:15.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.666+0000 7f2f1913e640 1 -- 172.21.15.26:0/2720574356 wait complete. 2023-10-14T11:13:15.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.666+0000 7f2f1913e640 1 Processor -- start 2023-10-14T11:13:15.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.666+0000 7f2f1913e640 1 -- start start 2023-10-14T11:13:15.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.666+0000 7f2f1913e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f140b84e0 0x7f2f141503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:15.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.666+0000 7f2f1913e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f140d0210 0x7f2f140c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:15.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.666+0000 7f2f1913e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f1415cba0 0x7f2f14158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:15.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.666+0000 7f2f1913e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f140c78a0 con 0x7f2f1415cba0 2023-10-14T11:13:15.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.666+0000 7f2f1913e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f140c8200 con 0x7f2f140b84e0 2023-10-14T11:13:15.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.666+0000 7f2f1913e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f140c6c20 con 0x7f2f140d0210 2023-10-14T11:13:15.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.670+0000 7f2f1359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f1415cba0 0x7f2f14158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:15.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.670+0000 7f2f1359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f1415cba0 0x7f2f14158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38548/0 (socket says 172.21.15.26:38548) 2023-10-14T11:13:15.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.670+0000 7f2f1359e640 1 -- 172.21.15.26:0/2716291532 learned_addr learned my addr 172.21.15.26:0/2716291532 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:15.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.670+0000 7f2f12d9d640 1 --2- 172.21.15.26:0/2716291532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f140b84e0 0x7f2f141503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:15.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.670+0000 7f2f1259c640 1 --2- 172.21.15.26:0/2716291532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f140d0210 0x7f2f140c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:15.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.670+0000 7f2f1359e640 1 -- 172.21.15.26:0/2716291532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f140d0210 msgr2=0x7f2f140c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:15.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.670+0000 7f2f1359e640 1 --2- 172.21.15.26:0/2716291532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f140d0210 0x7f2f140c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.670+0000 7f2f1359e640 1 -- 172.21.15.26:0/2716291532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f140b84e0 msgr2=0x7f2f141503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:15.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.670+0000 7f2f1359e640 1 --2- 172.21.15.26:0/2716291532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f140b84e0 0x7f2f141503d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.670+0000 7f2f1359e640 1 -- 172.21.15.26:0/2716291532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f080094d0 con 0x7f2f1415cba0 2023-10-14T11:13:15.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.670+0000 7f2f1359e640 1 --2- 172.21.15.26:0/2716291532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f1415cba0 0x7f2f14158c80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009e30 tx=0x7f2f0c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:15.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.670+0000 7f2efb7fe640 1 -- 172.21.15.26:0/2716291532 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c009ca0 con 0x7f2f1415cba0 2023-10-14T11:13:15.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.670+0000 7f2efb7fe640 1 -- 172.21.15.26:0/2716291532 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0c00f040 con 0x7f2f1415cba0 2023-10-14T11:13:15.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.670+0000 7f2efb7fe640 1 -- 172.21.15.26:0/2716291532 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c0146c0 con 0x7f2f1415cba0 2023-10-14T11:13:15.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.670+0000 7f2f1913e640 1 -- 172.21.15.26:0/2716291532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f140c6f00 con 0x7f2f1415cba0 2023-10-14T11:13:15.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.670+0000 7f2f1913e640 1 -- 172.21.15.26:0/2716291532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f140c74c0 con 0x7f2f1415cba0 2023-10-14T11:13:15.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.670+0000 7f2f1913e640 1 -- 172.21.15.26:0/2716291532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f140c79e0 con 0x7f2f1415cba0 2023-10-14T11:13:15.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.670+0000 7f2efb7fe640 1 -- 172.21.15.26:0/2716291532 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2f0c014820 con 0x7f2f1415cba0 2023-10-14T11:13:15.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.674+0000 7f2efb7fe640 1 --2- 172.21.15.26:0/2716291532 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2f000664a0 0x7f2f00068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:15.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.674+0000 7f2efb7fe640 1 -- 172.21.15.26:0/2716291532 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2f0c085080 con 0x7f2f1415cba0 2023-10-14T11:13:15.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.674+0000 7f2f12d9d640 1 --2- 172.21.15.26:0/2716291532 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2f000664a0 0x7f2f00068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:15.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.674+0000 7f2f12d9d640 1 --2- 172.21.15.26:0/2716291532 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2f000664a0 0x7f2f00068960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2f04007fd0 tx=0x7f2f04009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:15.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.678+0000 7f2efb7fe640 1 -- 172.21.15.26:0/2716291532 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2f0c0b6090 con 0x7f2f1415cba0 2023-10-14T11:13:15.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.834+0000 7f2f1913e640 1 -- 172.21.15.26:0/2716291532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2f1404e170 con 0x7f2f1415cba0 2023-10-14T11:13:15.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.834+0000 7f2efb7fe640 1 -- 172.21.15.26:0/2716291532 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2f0c0180a0 con 0x7f2f1415cba0 2023-10-14T11:13:15.840 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:13:15.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.834+0000 7f2f1913e640 1 -- 172.21.15.26:0/2716291532 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2f000664a0 msgr2=0x7f2f00068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.834+0000 7f2f1913e640 1 --2- 172.21.15.26:0/2716291532 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2f000664a0 0x7f2f00068960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2f04007fd0 tx=0x7f2f04009040 comp rx=0 tx=0).stop 2023-10-14T11:13:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.834+0000 7f2f1913e640 1 -- 172.21.15.26:0/2716291532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f1415cba0 msgr2=0x7f2f14158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.834+0000 7f2f1913e640 1 --2- 172.21.15.26:0/2716291532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f1415cba0 0x7f2f14158c80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009e30 tx=0x7f2f0c00c490 comp rx=0 tx=0).stop 2023-10-14T11:13:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.834+0000 7f2f1913e640 1 -- 172.21.15.26:0/2716291532 shutdown_connections 2023-10-14T11:13:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.834+0000 7f2f1913e640 1 --2- 172.21.15.26:0/2716291532 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2f000664a0 0x7f2f00068960 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.834+0000 7f2f1913e640 1 --2- 172.21.15.26:0/2716291532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f1415cba0 0x7f2f14158c80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.834+0000 7f2f1913e640 1 --2- 172.21.15.26:0/2716291532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f140d0210 0x7f2f140c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.834+0000 7f2f1913e640 1 --2- 172.21.15.26:0/2716291532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f140b84e0 0x7f2f141503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:15.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.834+0000 7f2f1913e640 1 -- 172.21.15.26:0/2716291532 >> 172.21.15.26:0/2716291532 conn(0x7f2f140719c0 msgr2=0x7f2f14154550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:15.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.834+0000 7f2f1913e640 1 -- 172.21.15.26:0/2716291532 shutdown_connections 2023-10-14T11:13:15.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:15.834+0000 7f2f1913e640 1 -- 172.21.15.26:0/2716291532 wait complete. 2023-10-14T11:13:15.861 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T11:13:16.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.002+0000 7fac25365640 1 Processor -- start 2023-10-14T11:13:16.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.002+0000 7fac25365640 1 -- start start 2023-10-14T11:13:16.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.002+0000 7fac25365640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac20069e90 0x7fac2006d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:16.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.002+0000 7fac25365640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fac2006a270 0x7fac200c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:16.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.002+0000 7fac25365640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2015ae30 con 0x7fac200702f0 2023-10-14T11:13:16.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.002+0000 7fac25365640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac200cb090 con 0x7fac2006a270 2023-10-14T11:13:16.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.002+0000 7fac25365640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac200ca510 con 0x7fac20069e90 2023-10-14T11:13:16.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.006+0000 7fac1effd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac20069e90 0x7fac2006d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:16.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.006+0000 7fac17fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fac2006a270 0x7fac200c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:16.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.006+0000 7fac17fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fac2006a270 0x7fac200c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:39196/0 (socket says 172.21.15.26:39196) 2023-10-14T11:13:16.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.006+0000 7fac17fff640 1 -- 172.21.15.26:0/3727414397 learned_addr learned my addr 172.21.15.26:0/3727414397 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:16.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.006+0000 7fac1effd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac20069e90 0x7fac2006d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:45974/0 (socket says 172.21.15.26:45974) 2023-10-14T11:13:16.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.006+0000 7fac17fff640 1 -- 172.21.15.26:0/3727414397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac20069e90 msgr2=0x7fac2006d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:16.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.006+0000 7fac17fff640 1 --2- 172.21.15.26:0/3727414397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac20069e90 0x7fac2006d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:16.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.006+0000 7fac17fff640 1 -- 172.21.15.26:0/3727414397 >> v1:172.21.15.110:6789/0 conn(0x7fac200702f0 legacy=0x7fac20070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:16.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.006+0000 7fac17fff640 1 -- 172.21.15.26:0/3727414397 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac200ca7f0 con 0x7fac2006a270 2023-10-14T11:13:16.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.006+0000 7fac1effd640 1 --2- 172.21.15.26:0/3727414397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac20069e90 0x7fac2006d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:13:16.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.006+0000 7fac17fff640 1 --2- 172.21.15.26:0/3727414397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac2006a270 0x7fac200c9ce0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fac08009870 tx=0x7fac0801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7ceba24eb068e05 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:16.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.006+0000 7fac1e7fc640 1 -- 172.21.15.26:0/3727414397 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac080aa670 con 0x7fac2006a270 2023-10-14T11:13:16.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.006+0000 7fac1e7fc640 1 -- 172.21.15.26:0/3727414397 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac080aa7d0 con 0x7fac2006a270 2023-10-14T11:13:16.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.006+0000 7fac1e7fc640 1 -- 172.21.15.26:0/3727414397 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac080aab60 con 0x7fac2006a270 2023-10-14T11:13:16.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac25365640 1 -- 172.21.15.26:0/3727414397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac2006a270 msgr2=0x7fac200c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:16.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac25365640 1 --2- 172.21.15.26:0/3727414397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac2006a270 0x7fac200c9ce0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fac08009870 tx=0x7fac0801c510 comp rx=0 tx=0).stop 2023-10-14T11:13:16.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac25365640 1 -- 172.21.15.26:0/3727414397 shutdown_connections 2023-10-14T11:13:16.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac25365640 1 --2- 172.21.15.26:0/3727414397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac2006a270 0x7fac200c9ce0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:16.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac25365640 1 --2- 172.21.15.26:0/3727414397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac20069e90 0x7fac2006d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:16.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac25365640 1 -- 172.21.15.26:0/3727414397 >> 172.21.15.26:0/3727414397 conn(0x7fac200b0da0 msgr2=0x7fac200ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:16.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac25365640 1 -- 172.21.15.26:0/3727414397 shutdown_connections 2023-10-14T11:13:16.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac25365640 1 -- 172.21.15.26:0/3727414397 wait complete. 2023-10-14T11:13:16.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac25365640 1 Processor -- start 2023-10-14T11:13:16.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac25365640 1 -- start start 2023-10-14T11:13:16.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac25365640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac20069e90 0x7fac20152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:16.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac25365640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac2006a270 0x7fac20153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:16.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac25365640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac200702f0 0x7fac200cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:16.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac25365640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac200c6420 con 0x7fac200702f0 2023-10-14T11:13:16.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac25365640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac200c6700 con 0x7fac20069e90 2023-10-14T11:13:16.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac25365640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac200c69e0 con 0x7fac2006a270 2023-10-14T11:13:16.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac1f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac200702f0 0x7fac200cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:16.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac1effd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac20069e90 0x7fac20152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:16.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac1f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac200702f0 0x7fac200cb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38554/0 (socket says 172.21.15.26:38554) 2023-10-14T11:13:16.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac1f7fe640 1 -- 172.21.15.26:0/2909298997 learned_addr learned my addr 172.21.15.26:0/2909298997 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:16.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac17fff640 1 --2- 172.21.15.26:0/2909298997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac2006a270 0x7fac20153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:16.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac1effd640 1 -- 172.21.15.26:0/2909298997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac2006a270 msgr2=0x7fac20153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:16.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.010+0000 7fac1effd640 1 --2- 172.21.15.26:0/2909298997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac2006a270 0x7fac20153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:16.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.014+0000 7fac1effd640 1 -- 172.21.15.26:0/2909298997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac200702f0 msgr2=0x7fac200cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:16.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.014+0000 7fac1effd640 1 --2- 172.21.15.26:0/2909298997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac200702f0 0x7fac200cb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:16.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.014+0000 7fac1effd640 1 -- 172.21.15.26:0/2909298997 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac10009420 con 0x7fac20069e90 2023-10-14T11:13:16.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.014+0000 7fac1effd640 1 --2- 172.21.15.26:0/2909298997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac20069e90 0x7fac20152ca0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fac1000e9b0 tx=0x7fac1000ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:16.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.014+0000 7fac177fe640 1 -- 172.21.15.26:0/2909298997 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1000c9a0 con 0x7fac20069e90 2023-10-14T11:13:16.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.014+0000 7fac177fe640 1 -- 172.21.15.26:0/2909298997 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1000cb00 con 0x7fac20069e90 2023-10-14T11:13:16.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.014+0000 7fac177fe640 1 -- 172.21.15.26:0/2909298997 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac10013470 con 0x7fac20069e90 2023-10-14T11:13:16.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.014+0000 7fac25365640 1 -- 172.21.15.26:0/2909298997 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac080094d0 con 0x7fac20069e90 2023-10-14T11:13:16.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.014+0000 7fac25365640 1 -- 172.21.15.26:0/2909298997 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac200c6fa0 con 0x7fac20069e90 2023-10-14T11:13:16.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.014+0000 7fac25365640 1 -- 172.21.15.26:0/2909298997 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2004e170 con 0x7fac20069e90 2023-10-14T11:13:16.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.014+0000 7fac177fe640 1 -- 172.21.15.26:0/2909298997 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fac100135d0 con 0x7fac20069e90 2023-10-14T11:13:16.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.014+0000 7fac177fe640 1 --2- 172.21.15.26:0/2909298997 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fac000664d0 0x7fac00068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:16.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.014+0000 7fac177fe640 1 -- 172.21.15.26:0/2909298997 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fac100843b0 con 0x7fac20069e90 2023-10-14T11:13:16.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.014+0000 7fac17fff640 1 --2- 172.21.15.26:0/2909298997 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fac000664d0 0x7fac00068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:16.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.018+0000 7fac17fff640 1 --2- 172.21.15.26:0/2909298997 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fac000664d0 0x7fac00068990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fac080ae000 tx=0x7fac080b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:16.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.022+0000 7fac177fe640 1 -- 172.21.15.26:0/2909298997 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fac10051510 con 0x7fac20069e90 2023-10-14T11:13:16.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.178+0000 7fac25365640 1 -- 172.21.15.26:0/2909298997 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fac200c6840 con 0x7fac20069e90 2023-10-14T11:13:16.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.178+0000 7fac177fe640 1 -- 172.21.15.26:0/2909298997 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fac200c6840 con 0x7fac20069e90 2023-10-14T11:13:16.184 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:16.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.178+0000 7fac25365640 1 -- 172.21.15.26:0/2909298997 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fac000664d0 msgr2=0x7fac00068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:16.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.178+0000 7fac25365640 1 --2- 172.21.15.26:0/2909298997 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fac000664d0 0x7fac00068990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fac080ae000 tx=0x7fac080b5040 comp rx=0 tx=0).stop 2023-10-14T11:13:16.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.178+0000 7fac25365640 1 -- 172.21.15.26:0/2909298997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac20069e90 msgr2=0x7fac20152ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:16.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.178+0000 7fac25365640 1 --2- 172.21.15.26:0/2909298997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac20069e90 0x7fac20152ca0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fac1000e9b0 tx=0x7fac1000ee70 comp rx=0 tx=0).stop 2023-10-14T11:13:16.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.178+0000 7fac25365640 1 -- 172.21.15.26:0/2909298997 shutdown_connections 2023-10-14T11:13:16.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.178+0000 7fac25365640 1 --2- 172.21.15.26:0/2909298997 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fac000664d0 0x7fac00068990 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:16.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.178+0000 7fac25365640 1 --2- 172.21.15.26:0/2909298997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac200702f0 0x7fac200cb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:16.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.178+0000 7fac25365640 1 --2- 172.21.15.26:0/2909298997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac2006a270 0x7fac20153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:16.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.178+0000 7fac25365640 1 --2- 172.21.15.26:0/2909298997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac20069e90 0x7fac20152ca0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:16.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.178+0000 7fac25365640 1 -- 172.21.15.26:0/2909298997 >> 172.21.15.26:0/2909298997 conn(0x7fac200b0da0 msgr2=0x7fac200ae2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:16.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.182+0000 7fac25365640 1 -- 172.21.15.26:0/2909298997 shutdown_connections 2023-10-14T11:13:16.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.182+0000 7fac25365640 1 -- 172.21.15.26:0/2909298997 wait complete. 2023-10-14T11:13:16.205 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2023-10-14T11:13:16.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.342+0000 7f71be417640 1 Processor -- start 2023-10-14T11:13:16.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.342+0000 7f71be417640 1 -- start start 2023-10-14T11:13:16.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.346+0000 7f71be417640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f71b815a880 0x7f71b815dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:16.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.346+0000 7f71be417640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f71b80b00e0 0x7f71b80b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:16.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.346+0000 7f71be417640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b815e000 con 0x7f71b8160680 2023-10-14T11:13:16.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.346+0000 7f71be417640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b80b0ab0 con 0x7f71b80b00e0 2023-10-14T11:13:16.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.346+0000 7f71be417640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b80cb1d0 con 0x7f71b815a880 2023-10-14T11:13:16.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.346+0000 7f71b77fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f71b80b00e0 0x7f71b80b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:16.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.346+0000 7f71bc9b4640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f71b8160680 0x7f71b8160ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45074/0 (socket says 172.21.15.26:45074) 2023-10-14T11:13:16.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.346+0000 7f71bc9b4640 1 -- 172.21.15.26:0/473028791 learned_addr learned my addr 172.21.15.26:0/473028791 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:16.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.346+0000 7f71b7fff640 1 --2- 172.21.15.26:0/473028791 >> v2:172.21.15.110:3300/0 conn(0x7f71b815a880 0x7f71b815dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:16.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.346+0000 7f71b77fe640 1 -- 172.21.15.26:0/473028791 >> v2:172.21.15.110:3300/0 conn(0x7f71b815a880 msgr2=0x7f71b815dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:16.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.346+0000 7f71b77fe640 1 --2- 172.21.15.26:0/473028791 >> v2:172.21.15.110:3300/0 conn(0x7f71b815a880 0x7f71b815dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:16.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.346+0000 7f71b77fe640 1 -- 172.21.15.26:0/473028791 >> v1:172.21.15.26:6789/0 conn(0x7f71b8160680 legacy=0x7f71b8160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:16.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.346+0000 7f71b77fe640 1 -- 172.21.15.26:0/473028791 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b80cb4b0 con 0x7f71b80b00e0 2023-10-14T11:13:16.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.346+0000 7f71b6ffd640 1 -- 172.21.15.26:0/473028791 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234097431 0 0) 0x7f71b815e000 con 0x7f71b8160680 2023-10-14T11:13:16.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.350+0000 7f71b77fe640 1 --2- 172.21.15.26:0/473028791 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71b80b00e0 0x7f71b80b0570 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f71b806ae80 tx=0x7f71ac01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a32d9c03821e6ad server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:16.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.350+0000 7f71b6ffd640 1 -- 172.21.15.26:0/473028791 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac004230 con 0x7f71b80b00e0 2023-10-14T11:13:16.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.350+0000 7f71b6ffd640 1 -- 172.21.15.26:0/473028791 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac0a7050 con 0x7f71b80b00e0 2023-10-14T11:13:16.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.350+0000 7f71b6ffd640 1 -- 172.21.15.26:0/473028791 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac003620 con 0x7f71b80b00e0 2023-10-14T11:13:16.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.350+0000 7f71be417640 1 -- 172.21.15.26:0/473028791 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71b80b00e0 msgr2=0x7f71b80b0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:16.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.350+0000 7f71be417640 1 --2- 172.21.15.26:0/473028791 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71b80b00e0 0x7f71b80b0570 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f71b806ae80 tx=0x7f71ac01c460 comp rx=0 tx=0).stop 2023-10-14T11:13:16.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.350+0000 7f71be417640 1 -- 172.21.15.26:0/473028791 shutdown_connections 2023-10-14T11:13:16.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.350+0000 7f71be417640 1 --2- 172.21.15.26:0/473028791 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71b80b00e0 0x7f71b80b0570 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:16.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.350+0000 7f71be417640 1 --2- 172.21.15.26:0/473028791 >> v2:172.21.15.110:3300/0 conn(0x7f71b815a880 0x7f71b815dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:16.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.350+0000 7f71be417640 1 -- 172.21.15.26:0/473028791 >> 172.21.15.26:0/473028791 conn(0x7f71b806c190 msgr2=0x7f71b806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:16.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.350+0000 7f71be417640 1 -- 172.21.15.26:0/473028791 shutdown_connections 2023-10-14T11:13:16.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.350+0000 7f71be417640 1 -- 172.21.15.26:0/473028791 wait complete. 2023-10-14T11:13:16.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.350+0000 7f71be417640 1 Processor -- start 2023-10-14T11:13:16.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.350+0000 7f71be417640 1 -- start start 2023-10-14T11:13:16.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71be417640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71b80b00e0 0x7f71b8152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:16.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71be417640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71b815a880 0x7f71b80aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71be417640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71b8160680 0x7f71b80af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71be417640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b80ad200 con 0x7f71b8160680 2023-10-14T11:13:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71be417640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b8158f40 con 0x7f71b80b00e0 2023-10-14T11:13:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71be417640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b8158040 con 0x7f71b815a880 2023-10-14T11:13:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71bc9b4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71b8160680 0x7f71b80af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:16.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71bc9b4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71b8160680 0x7f71b80af1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38578/0 (socket says 172.21.15.26:38578) 2023-10-14T11:13:16.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71bc9b4640 1 -- 172.21.15.26:0/3012024578 learned_addr learned my addr 172.21.15.26:0/3012024578 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:16.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71b7fff640 1 --2- 172.21.15.26:0/3012024578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71b80b00e0 0x7f71b8152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:16.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71b77fe640 1 --2- 172.21.15.26:0/3012024578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71b815a880 0x7f71b80aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71bc9b4640 1 -- 172.21.15.26:0/3012024578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71b815a880 msgr2=0x7f71b80aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71bc9b4640 1 --2- 172.21.15.26:0/3012024578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71b815a880 0x7f71b80aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71bc9b4640 1 -- 172.21.15.26:0/3012024578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71b80b00e0 msgr2=0x7f71b8152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71bc9b4640 1 --2- 172.21.15.26:0/3012024578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71b80b00e0 0x7f71b8152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71bc9b4640 1 -- 172.21.15.26:0/3012024578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac009420 con 0x7f71b8160680 2023-10-14T11:13:16.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71bc9b4640 1 --2- 172.21.15.26:0/3012024578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71b8160680 0x7f71b80af1f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f71b000c780 tx=0x7f71b000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:16.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71b4ff9640 1 -- 172.21.15.26:0/3012024578 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b000ce30 con 0x7f71b8160680 2023-10-14T11:13:16.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71b4ff9640 1 -- 172.21.15.26:0/3012024578 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b000a5e0 con 0x7f71b8160680 2023-10-14T11:13:16.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71b4ff9640 1 -- 172.21.15.26:0/3012024578 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b000a9d0 con 0x7f71b8160680 2023-10-14T11:13:16.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71be417640 1 -- 172.21.15.26:0/3012024578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b81582c0 con 0x7f71b8160680 2023-10-14T11:13:16.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71be417640 1 -- 172.21.15.26:0/3012024578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b8158880 con 0x7f71b8160680 2023-10-14T11:13:16.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71be417640 1 -- 172.21.15.26:0/3012024578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b8159080 con 0x7f71b8160680 2023-10-14T11:13:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.354+0000 7f71b4ff9640 1 -- 172.21.15.26:0/3012024578 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f71b000ab30 con 0x7f71b8160680 2023-10-14T11:13:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.358+0000 7f71b4ff9640 1 --2- 172.21.15.26:0/3012024578 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f71a40664a0 0x7f71a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.358+0000 7f71b4ff9640 1 -- 172.21.15.26:0/3012024578 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f71b0083610 con 0x7f71b8160680 2023-10-14T11:13:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.358+0000 7f71b7fff640 1 --2- 172.21.15.26:0/3012024578 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f71a40664a0 0x7f71a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.358+0000 7f71b7fff640 1 --2- 172.21.15.26:0/3012024578 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f71a40664a0 0x7f71a4068960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f71a80079c0 tx=0x7f71a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.362+0000 7f71b4ff9640 1 -- 172.21.15.26:0/3012024578 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f71b8159080 con 0x7f71b8160680 2023-10-14T11:13:16.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.570+0000 7f71be417640 1 -- 172.21.15.26:0/3012024578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7f71b8159080 con 0x7f71b8160680 2023-10-14T11:13:16.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.914+0000 7f71b4ff9640 1 -- 172.21.15.26:0/3012024578 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v76) v1 ==== 150+0+0 (secure 0 0 0) 0x7f71b8159080 con 0x7f71b8160680 2023-10-14T11:13:16.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.918+0000 7f71be417640 1 -- 172.21.15.26:0/3012024578 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f71a40664a0 msgr2=0x7f71a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:16.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.918+0000 7f71be417640 1 --2- 172.21.15.26:0/3012024578 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f71a40664a0 0x7f71a4068960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f71a80079c0 tx=0x7f71a8008040 comp rx=0 tx=0).stop 2023-10-14T11:13:16.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.918+0000 7f71be417640 1 -- 172.21.15.26:0/3012024578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71b8160680 msgr2=0x7f71b80af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:16.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.918+0000 7f71be417640 1 --2- 172.21.15.26:0/3012024578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71b8160680 0x7f71b80af1f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f71b000c780 tx=0x7f71b000cc40 comp rx=0 tx=0).stop 2023-10-14T11:13:16.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.918+0000 7f71be417640 1 -- 172.21.15.26:0/3012024578 shutdown_connections 2023-10-14T11:13:16.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.918+0000 7f71be417640 1 --2- 172.21.15.26:0/3012024578 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f71a40664a0 0x7f71a4068960 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:16.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.918+0000 7f71be417640 1 --2- 172.21.15.26:0/3012024578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71b8160680 0x7f71b80af1f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:16.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.918+0000 7f71be417640 1 --2- 172.21.15.26:0/3012024578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71b815a880 0x7f71b80aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:16.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.918+0000 7f71be417640 1 --2- 172.21.15.26:0/3012024578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71b80b00e0 0x7f71b8152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:16.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.918+0000 7f71be417640 1 -- 172.21.15.26:0/3012024578 >> 172.21.15.26:0/3012024578 conn(0x7f71b806c190 msgr2=0x7f71b8160a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:16.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.918+0000 7f71be417640 1 -- 172.21.15.26:0/3012024578 shutdown_connections 2023-10-14T11:13:16.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:16.918+0000 7f71be417640 1 -- 172.21.15.26:0/3012024578 wait complete. 2023-10-14T11:13:16.944 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T11:13:17.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.086+0000 7f9af6f0f640 1 Processor -- start 2023-10-14T11:13:17.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.086+0000 7f9af6f0f640 1 -- start start 2023-10-14T11:13:17.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.086+0000 7f9af6f0f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9af006a5a0 0x7f9af006e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:17.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.086+0000 7f9af6f0f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9af00b3f00 0x7f9af00c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:17.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.086+0000 7f9af6f0f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af00b4370 con 0x7f9af0159900 2023-10-14T11:13:17.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.086+0000 7f9af6f0f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af00cd740 con 0x7f9af00b3f00 2023-10-14T11:13:17.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.086+0000 7f9af6f0f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af00b4600 con 0x7f9af006a5a0 2023-10-14T11:13:17.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.086+0000 7f9af54ac640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9af00b3f00 0x7f9af00c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:17.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.086+0000 7f9af54ac640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9af00b3f00 0x7f9af00c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38586/0 (socket says 172.21.15.26:38586) 2023-10-14T11:13:17.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.086+0000 7f9af54ac640 1 -- 172.21.15.26:0/2918769435 learned_addr learned my addr 172.21.15.26:0/2918769435 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:17.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.086+0000 7f9aeffff640 1 --2- 172.21.15.26:0/2918769435 >> v2:172.21.15.110:3300/0 conn(0x7f9af006a5a0 0x7f9af006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:17.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.090+0000 7f9af54ac640 1 -- 172.21.15.26:0/2918769435 >> v2:172.21.15.110:3300/0 conn(0x7f9af006a5a0 msgr2=0x7f9af006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:17.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.090+0000 7f9af54ac640 1 --2- 172.21.15.26:0/2918769435 >> v2:172.21.15.110:3300/0 conn(0x7f9af006a5a0 0x7f9af006e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:17.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.090+0000 7f9af54ac640 1 -- 172.21.15.26:0/2918769435 >> v1:172.21.15.110:6789/0 conn(0x7f9af0159900 legacy=0x7f9af0069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:17.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.090+0000 7f9af54ac640 1 -- 172.21.15.26:0/2918769435 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af00c8dd0 con 0x7f9af00b3f00 2023-10-14T11:13:17.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.090+0000 7f9af54ac640 1 --2- 172.21.15.26:0/2918769435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9af00b3f00 0x7f9af00c9b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9af0071620 tx=0x7f9ae801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a53060378471d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:17.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.090+0000 7f9aef7fe640 1 -- 172.21.15.26:0/2918769435 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80a5860 con 0x7f9af00b3f00 2023-10-14T11:13:17.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.090+0000 7f9aef7fe640 1 -- 172.21.15.26:0/2918769435 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae80a59c0 con 0x7f9af00b3f00 2023-10-14T11:13:17.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.090+0000 7f9aef7fe640 1 -- 172.21.15.26:0/2918769435 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80a5d50 con 0x7f9af00b3f00 2023-10-14T11:13:17.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.090+0000 7f9af6f0f640 1 -- 172.21.15.26:0/2918769435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9af00b3f00 msgr2=0x7f9af00c9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:17.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.090+0000 7f9af6f0f640 1 --2- 172.21.15.26:0/2918769435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9af00b3f00 0x7f9af00c9b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9af0071620 tx=0x7f9ae801c9a0 comp rx=0 tx=0).stop 2023-10-14T11:13:17.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9af6f0f640 1 -- 172.21.15.26:0/2918769435 shutdown_connections 2023-10-14T11:13:17.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9af6f0f640 1 --2- 172.21.15.26:0/2918769435 >> v2:172.21.15.110:3300/0 conn(0x7f9af006a5a0 0x7f9af006e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:17.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9af6f0f640 1 --2- 172.21.15.26:0/2918769435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9af00b3f00 0x7f9af00c9b90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:17.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9af6f0f640 1 -- 172.21.15.26:0/2918769435 >> 172.21.15.26:0/2918769435 conn(0x7f9af00b0da0 msgr2=0x7f9af00ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:17.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9af6f0f640 1 -- 172.21.15.26:0/2918769435 shutdown_connections 2023-10-14T11:13:17.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9af6f0f640 1 -- 172.21.15.26:0/2918769435 wait complete. 2023-10-14T11:13:17.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9af6f0f640 1 Processor -- start 2023-10-14T11:13:17.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9af6f0f640 1 -- start start 2023-10-14T11:13:17.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9af6f0f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af006a5a0 0x7f9af0153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:17.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9af6f0f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9af00b3f00 0x7f9af00cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:17.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9af6f0f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af0159900 0x7f9af00702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:17.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9af6f0f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af00ad5e0 con 0x7f9af00b3f00 2023-10-14T11:13:17.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9af6f0f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af00c6fa0 con 0x7f9af006a5a0 2023-10-14T11:13:17.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9af6f0f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af00aca60 con 0x7f9af0159900 2023-10-14T11:13:17.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9aeffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9af00b3f00 0x7f9af00cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:17.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9aeffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9af00b3f00 0x7f9af00cdd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38590/0 (socket says 172.21.15.26:38590) 2023-10-14T11:13:17.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9aeffff640 1 -- 172.21.15.26:0/2698323820 learned_addr learned my addr 172.21.15.26:0/2698323820 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:17.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9af54ac640 1 --2- 172.21.15.26:0/2698323820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af0159900 0x7f9af00702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:17.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9af4cab640 1 --2- 172.21.15.26:0/2698323820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af006a5a0 0x7f9af0153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:17.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9aeffff640 1 -- 172.21.15.26:0/2698323820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af0159900 msgr2=0x7f9af00702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:17.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9aeffff640 1 --2- 172.21.15.26:0/2698323820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af0159900 0x7f9af00702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:17.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9aeffff640 1 -- 172.21.15.26:0/2698323820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af006a5a0 msgr2=0x7f9af0153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:17.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9aeffff640 1 --2- 172.21.15.26:0/2698323820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af006a5a0 0x7f9af0153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:17.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.094+0000 7f9aeffff640 1 -- 172.21.15.26:0/2698323820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae8009b30 con 0x7f9af00b3f00 2023-10-14T11:13:17.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.098+0000 7f9aeffff640 1 --2- 172.21.15.26:0/2698323820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9af00b3f00 0x7f9af00cdd60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00e930 tx=0x7f9adc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:17.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.098+0000 7f9aed7fa640 1 -- 172.21.15.26:0/2698323820 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc009690 con 0x7f9af00b3f00 2023-10-14T11:13:17.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.098+0000 7f9aed7fa640 1 -- 172.21.15.26:0/2698323820 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9adc00ca00 con 0x7f9af00b3f00 2023-10-14T11:13:17.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.098+0000 7f9af6f0f640 1 -- 172.21.15.26:0/2698323820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af00acd40 con 0x7f9af00b3f00 2023-10-14T11:13:17.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.098+0000 7f9aed7fa640 1 -- 172.21.15.26:0/2698323820 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc00cd70 con 0x7f9af00b3f00 2023-10-14T11:13:17.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.098+0000 7f9af6f0f640 1 -- 172.21.15.26:0/2698323820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af00ad300 con 0x7f9af00b3f00 2023-10-14T11:13:17.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.098+0000 7f9af6f0f640 1 -- 172.21.15.26:0/2698323820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af004e170 con 0x7f9af00b3f00 2023-10-14T11:13:17.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.098+0000 7f9aed7fa640 1 -- 172.21.15.26:0/2698323820 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9adc013470 con 0x7f9af00b3f00 2023-10-14T11:13:17.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.098+0000 7f9aed7fa640 1 --2- 172.21.15.26:0/2698323820 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9ad40664a0 0x7f9ad4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:17.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.098+0000 7f9aed7fa640 1 -- 172.21.15.26:0/2698323820 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9adc084500 con 0x7f9af00b3f00 2023-10-14T11:13:17.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.098+0000 7f9af4cab640 1 --2- 172.21.15.26:0/2698323820 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9ad40664a0 0x7f9ad4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:17.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.102+0000 7f9af4cab640 1 --2- 172.21.15.26:0/2698323820 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9ad40664a0 0x7f9ad4068960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4007fd0 tx=0x7f9ae4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:17.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.102+0000 7f9aed7fa640 1 -- 172.21.15.26:0/2698323820 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9adc051690 con 0x7f9af00b3f00 2023-10-14T11:13:17.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.262+0000 7f9af6f0f640 1 -- 172.21.15.26:0/2698323820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9af00c89a0 con 0x7f9af00b3f00 2023-10-14T11:13:17.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.266+0000 7f9aed7fa640 1 -- 172.21.15.26:0/2698323820 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9adc054cb0 con 0x7f9af00b3f00 2023-10-14T11:13:17.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.270+0000 7f9af6f0f640 1 -- 172.21.15.26:0/2698323820 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9ad40664a0 msgr2=0x7f9ad4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:17.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.270+0000 7f9af6f0f640 1 --2- 172.21.15.26:0/2698323820 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9ad40664a0 0x7f9ad4068960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4007fd0 tx=0x7f9ae4009040 comp rx=0 tx=0).stop 2023-10-14T11:13:17.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.270+0000 7f9af6f0f640 1 -- 172.21.15.26:0/2698323820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9af00b3f00 msgr2=0x7f9af00cdd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:17.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.270+0000 7f9af6f0f640 1 --2- 172.21.15.26:0/2698323820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9af00b3f00 0x7f9af00cdd60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00e930 tx=0x7f9adc00edf0 comp rx=0 tx=0).stop 2023-10-14T11:13:17.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.270+0000 7f9af6f0f640 1 -- 172.21.15.26:0/2698323820 shutdown_connections 2023-10-14T11:13:17.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.270+0000 7f9af6f0f640 1 --2- 172.21.15.26:0/2698323820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af0159900 0x7f9af00702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:17.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.270+0000 7f9af6f0f640 1 --2- 172.21.15.26:0/2698323820 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9ad40664a0 0x7f9ad4068960 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:17.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.270+0000 7f9af6f0f640 1 --2- 172.21.15.26:0/2698323820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9af00b3f00 0x7f9af00cdd60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:17.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.270+0000 7f9af6f0f640 1 --2- 172.21.15.26:0/2698323820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af006a5a0 0x7f9af0153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:17.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.270+0000 7f9af6f0f640 1 -- 172.21.15.26:0/2698323820 >> 172.21.15.26:0/2698323820 conn(0x7f9af00b0da0 msgr2=0x7f9af00cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:17.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.270+0000 7f9af6f0f640 1 -- 172.21.15.26:0/2698323820 shutdown_connections 2023-10-14T11:13:17.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.270+0000 7f9af6f0f640 1 -- 172.21.15.26:0/2698323820 wait complete. 2023-10-14T11:13:17.294 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T11:13:17.294 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T11:13:17.400 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T11:13:17.453 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T11:13:17.454 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:13:17.454 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:13:17.464 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:13:17.464 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:13:17.514 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:13:17.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.694+0000 7fa22fe17640 1 Processor -- start 2023-10-14T11:13:17.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.694+0000 7fa22fe17640 1 -- start start 2023-10-14T11:13:17.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.694+0000 7fa22fe17640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa228070c40 0x7fa22815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:17.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.694+0000 7fa22fe17640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa2280b4020 0x7fa2280b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:17.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.694+0000 7fa22fe17640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22815be60 con 0x7fa2280b0620 2023-10-14T11:13:17.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.694+0000 7fa22fe17640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22815b3b0 con 0x7fa2280b4020 2023-10-14T11:13:17.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.694+0000 7fa22fe17640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22815c1f0 con 0x7fa228070c40 2023-10-14T11:13:17.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.694+0000 7fa22d3b2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa2280b4020 0x7fa2280b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:17.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.694+0000 7fa22d3b2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa2280b4020 0x7fa2280b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38602/0 (socket says 172.21.15.26:38602) 2023-10-14T11:13:17.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.694+0000 7fa22d3b2640 1 -- 172.21.15.26:0/3092737116 learned_addr learned my addr 172.21.15.26:0/3092737116 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:17.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.694+0000 7fa22dbb3640 1 --2- 172.21.15.26:0/3092737116 >> v2:172.21.15.110:3300/0 conn(0x7fa228070c40 0x7fa22815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:17.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.694+0000 7fa22d3b2640 1 -- 172.21.15.26:0/3092737116 >> v2:172.21.15.110:3300/0 conn(0x7fa228070c40 msgr2=0x7fa22815ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:17.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.694+0000 7fa22d3b2640 1 --2- 172.21.15.26:0/3092737116 >> v2:172.21.15.110:3300/0 conn(0x7fa228070c40 0x7fa22815ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:17.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.698+0000 7fa22d3b2640 1 -- 172.21.15.26:0/3092737116 >> v1:172.21.15.110:6789/0 conn(0x7fa2280b0620 legacy=0x7fa22815c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:17.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.698+0000 7fa22d3b2640 1 -- 172.21.15.26:0/3092737116 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2280b0a30 con 0x7fa2280b4020 2023-10-14T11:13:17.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.698+0000 7fa22d3b2640 1 --2- 172.21.15.26:0/3092737116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2280b4020 0x7fa2280b00e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa22806ae80 tx=0x7fa21801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c61d2f3a36e339 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:17.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.698+0000 7fa22cbb1640 1 -- 172.21.15.26:0/3092737116 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2180a7070 con 0x7fa2280b4020 2023-10-14T11:13:17.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.698+0000 7fa22cbb1640 1 -- 172.21.15.26:0/3092737116 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2180ab430 con 0x7fa2280b4020 2023-10-14T11:13:17.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.698+0000 7fa22cbb1640 1 -- 172.21.15.26:0/3092737116 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2180ab7c0 con 0x7fa2280b4020 2023-10-14T11:13:17.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.698+0000 7fa22fe17640 1 -- 172.21.15.26:0/3092737116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2280b4020 msgr2=0x7fa2280b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:17.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.698+0000 7fa22fe17640 1 --2- 172.21.15.26:0/3092737116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2280b4020 0x7fa2280b00e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa22806ae80 tx=0x7fa21801c430 comp rx=0 tx=0).stop 2023-10-14T11:13:17.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.698+0000 7fa22fe17640 1 -- 172.21.15.26:0/3092737116 shutdown_connections 2023-10-14T11:13:17.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.698+0000 7fa22fe17640 1 --2- 172.21.15.26:0/3092737116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2280b4020 0x7fa2280b00e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:17.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.698+0000 7fa22fe17640 1 --2- 172.21.15.26:0/3092737116 >> v2:172.21.15.110:3300/0 conn(0x7fa228070c40 0x7fa22815ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:17.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.698+0000 7fa22fe17640 1 -- 172.21.15.26:0/3092737116 >> 172.21.15.26:0/3092737116 conn(0x7fa22806c190 msgr2=0x7fa22806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:17.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.698+0000 7fa22fe17640 1 -- 172.21.15.26:0/3092737116 shutdown_connections 2023-10-14T11:13:17.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.698+0000 7fa22fe17640 1 -- 172.21.15.26:0/3092737116 wait complete. 2023-10-14T11:13:17.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa22fe17640 1 Processor -- start 2023-10-14T11:13:17.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa22fe17640 1 -- start start 2023-10-14T11:13:17.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa22fe17640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa228070c40 0x7fa22815a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:17.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa22fe17640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2280b0620 0x7fa2281f84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:17.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa22fe17640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2280b4020 0x7fa228147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:17.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa22fe17640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22815a640 con 0x7fa2280b0620 2023-10-14T11:13:17.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa22fe17640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22814ad50 con 0x7fa2280b4020 2023-10-14T11:13:17.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa22fe17640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22814aa20 con 0x7fa228070c40 2023-10-14T11:13:17.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa22d3b2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2280b0620 0x7fa2281f84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:17.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa22d3b2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2280b0620 0x7fa2281f84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38608/0 (socket says 172.21.15.26:38608) 2023-10-14T11:13:17.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa22d3b2640 1 -- 172.21.15.26:0/952762554 learned_addr learned my addr 172.21.15.26:0/952762554 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:17.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa22dbb3640 1 --2- 172.21.15.26:0/952762554 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa228070c40 0x7fa22815a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:17.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa22e3b4640 1 --2- 172.21.15.26:0/952762554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2280b4020 0x7fa228147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:17.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa22d3b2640 1 -- 172.21.15.26:0/952762554 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa228070c40 msgr2=0x7fa22815a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:17.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa22d3b2640 1 --2- 172.21.15.26:0/952762554 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa228070c40 0x7fa22815a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:17.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa22d3b2640 1 -- 172.21.15.26:0/952762554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2280b4020 msgr2=0x7fa228147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:17.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa22d3b2640 1 --2- 172.21.15.26:0/952762554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2280b4020 0x7fa228147830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:17.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa22d3b2640 1 -- 172.21.15.26:0/952762554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2180094d0 con 0x7fa2280b0620 2023-10-14T11:13:17.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa22e3b4640 1 --2- 172.21.15.26:0/952762554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2280b4020 0x7fa228147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:17.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa22d3b2640 1 --2- 172.21.15.26:0/952762554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2280b0620 0x7fa2281f84c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa21801a060 tx=0x7fa2180191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:17.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa21e7fc640 1 -- 172.21.15.26:0/952762554 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2180b4830 con 0x7fa2280b0620 2023-10-14T11:13:17.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa21e7fc640 1 -- 172.21.15.26:0/952762554 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2180b4990 con 0x7fa2280b0620 2023-10-14T11:13:17.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa22fe17640 1 -- 172.21.15.26:0/952762554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2281f8d10 con 0x7fa2280b0620 2023-10-14T11:13:17.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa21e7fc640 1 -- 172.21.15.26:0/952762554 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2180b4d40 con 0x7fa2280b0620 2023-10-14T11:13:17.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.702+0000 7fa22fe17640 1 -- 172.21.15.26:0/952762554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2281f92d0 con 0x7fa2280b0620 2023-10-14T11:13:17.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.706+0000 7fa22fe17640 1 -- 172.21.15.26:0/952762554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2280b3830 con 0x7fa2280b0620 2023-10-14T11:13:17.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.706+0000 7fa21e7fc640 1 -- 172.21.15.26:0/952762554 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa2180bd3b0 con 0x7fa2280b0620 2023-10-14T11:13:17.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.706+0000 7fa21e7fc640 1 --2- 172.21.15.26:0/952762554 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa20c0664a0 0x7fa20c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:17.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.706+0000 7fa21e7fc640 1 -- 172.21.15.26:0/952762554 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa21811e460 con 0x7fa2280b0620 2023-10-14T11:13:17.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.706+0000 7fa22dbb3640 1 --2- 172.21.15.26:0/952762554 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa20c0664a0 0x7fa20c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:17.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.706+0000 7fa22dbb3640 1 --2- 172.21.15.26:0/952762554 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa20c0664a0 0x7fa20c068960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa2281498c0 tx=0x7fa224008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:17.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.710+0000 7fa21e7fc640 1 -- 172.21.15.26:0/952762554 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa2180eb6d0 con 0x7fa2280b0620 2023-10-14T11:13:17.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.870+0000 7fa22fe17640 1 -- 172.21.15.26:0/952762554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa22815bb50 con 0x7fa2280b0620 2023-10-14T11:13:17.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.870+0000 7fa21e7fc640 1 -- 172.21.15.26:0/952762554 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18679 (secure 0 0 0) 0x7fa2180eecf0 con 0x7fa2280b0620 2023-10-14T11:13:17.878 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:17.878 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":27,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:13:03.866737+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:13:17.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.874+0000 7fa22fe17640 1 -- 172.21.15.26:0/952762554 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa20c0664a0 msgr2=0x7fa20c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:17.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.874+0000 7fa22fe17640 1 --2- 172.21.15.26:0/952762554 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa20c0664a0 0x7fa20c068960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa2281498c0 tx=0x7fa224008040 comp rx=0 tx=0).stop 2023-10-14T11:13:17.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.874+0000 7fa22fe17640 1 -- 172.21.15.26:0/952762554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2280b0620 msgr2=0x7fa2281f84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:17.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.874+0000 7fa22fe17640 1 --2- 172.21.15.26:0/952762554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2280b0620 0x7fa2281f84c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa21801a060 tx=0x7fa2180191d0 comp rx=0 tx=0).stop 2023-10-14T11:13:17.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.874+0000 7fa22fe17640 1 -- 172.21.15.26:0/952762554 shutdown_connections 2023-10-14T11:13:17.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.874+0000 7fa22fe17640 1 --2- 172.21.15.26:0/952762554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2280b4020 0x7fa228147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:17.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.874+0000 7fa22fe17640 1 --2- 172.21.15.26:0/952762554 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa20c0664a0 0x7fa20c068960 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:17.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.874+0000 7fa22fe17640 1 --2- 172.21.15.26:0/952762554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2280b0620 0x7fa2281f84c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:17.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.874+0000 7fa22fe17640 1 --2- 172.21.15.26:0/952762554 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa228070c40 0x7fa22815a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:17.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.874+0000 7fa22fe17640 1 -- 172.21.15.26:0/952762554 >> 172.21.15.26:0/952762554 conn(0x7fa22806c190 msgr2=0x7fa228151790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:17.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.874+0000 7fa22fe17640 1 -- 172.21.15.26:0/952762554 shutdown_connections 2023-10-14T11:13:17.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:17.874+0000 7fa22fe17640 1 -- 172.21.15.26:0/952762554 wait complete. 2023-10-14T11:13:17.899 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:12:20.179562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:12:21.346111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T11:12:25.025159+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T11:13:17.900 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:13:18.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.042+0000 7f5a035d9640 1 Processor -- start 2023-10-14T11:13:18.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.042+0000 7f5a035d9640 1 -- start start 2023-10-14T11:13:18.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.042+0000 7f5a035d9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f59fc15cba0 0x7f59fc0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:18.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.042+0000 7f5a035d9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f59fc0d0210 0x7f59fc0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:18.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.042+0000 7f5a035d9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59fc0d1670 con 0x7f59fc0b84e0 2023-10-14T11:13:18.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.042+0000 7f5a035d9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59fc0d1460 con 0x7f59fc0d0210 2023-10-14T11:13:18.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.042+0000 7f5a035d9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59fc0d1950 con 0x7f59fc15cba0 2023-10-14T11:13:18.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.042+0000 7f5a01b76640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f59fc0d0210 0x7f59fc0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:18.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.042+0000 7f5a00b74640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f59fc0b84e0 0x7f59fc0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45078/0 (socket says 172.21.15.26:45078) 2023-10-14T11:13:18.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.042+0000 7f5a00b74640 1 -- 172.21.15.26:0/2303698306 learned_addr learned my addr 172.21.15.26:0/2303698306 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:18.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.042+0000 7f5a01375640 1 --2- 172.21.15.26:0/2303698306 >> v2:172.21.15.110:3300/0 conn(0x7f59fc15cba0 0x7f59fc0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:18.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.042+0000 7f5a01b76640 1 -- 172.21.15.26:0/2303698306 >> v2:172.21.15.110:3300/0 conn(0x7f59fc15cba0 msgr2=0x7f59fc0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:18.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.042+0000 7f5a01b76640 1 --2- 172.21.15.26:0/2303698306 >> v2:172.21.15.110:3300/0 conn(0x7f59fc15cba0 0x7f59fc0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.042+0000 7f5a01b76640 1 -- 172.21.15.26:0/2303698306 >> v1:172.21.15.26:6789/0 conn(0x7f59fc0b84e0 legacy=0x7f59fc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:18.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.042+0000 7f5a01b76640 1 -- 172.21.15.26:0/2303698306 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59fc0d1c30 con 0x7f59fc0d0210 2023-10-14T11:13:18.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.042+0000 7f59f3fff640 1 -- 172.21.15.26:0/2303698306 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396317979 0 0) 0x7f59fc0d1670 con 0x7f59fc0b84e0 2023-10-14T11:13:18.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.046+0000 7f5a01b76640 1 --2- 172.21.15.26:0/2303698306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59fc0d0210 0x7f59fc0b5cf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f59fc0b4890 tx=0x7f59f401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c83d83b95d0d99 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:18.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.046+0000 7f59f3fff640 1 -- 172.21.15.26:0/2303698306 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f40a5940 con 0x7f59fc0d0210 2023-10-14T11:13:18.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.046+0000 7f59f3fff640 1 -- 172.21.15.26:0/2303698306 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f40a5aa0 con 0x7f59fc0d0210 2023-10-14T11:13:18.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.046+0000 7f59f3fff640 1 -- 172.21.15.26:0/2303698306 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f40a5e30 con 0x7f59fc0d0210 2023-10-14T11:13:18.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.046+0000 7f5a035d9640 1 -- 172.21.15.26:0/2303698306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59fc0d0210 msgr2=0x7f59fc0b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:18.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.046+0000 7f5a035d9640 1 --2- 172.21.15.26:0/2303698306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59fc0d0210 0x7f59fc0b5cf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f59fc0b4890 tx=0x7f59f401c880 comp rx=0 tx=0).stop 2023-10-14T11:13:18.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.046+0000 7f5a035d9640 1 -- 172.21.15.26:0/2303698306 shutdown_connections 2023-10-14T11:13:18.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.046+0000 7f5a035d9640 1 --2- 172.21.15.26:0/2303698306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59fc0d0210 0x7f59fc0b5cf0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.046+0000 7f5a035d9640 1 --2- 172.21.15.26:0/2303698306 >> v2:172.21.15.110:3300/0 conn(0x7f59fc15cba0 0x7f59fc0d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.046+0000 7f5a035d9640 1 -- 172.21.15.26:0/2303698306 >> 172.21.15.26:0/2303698306 conn(0x7f59fc0719c0 msgr2=0x7f59fc071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:18.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.046+0000 7f5a035d9640 1 -- 172.21.15.26:0/2303698306 shutdown_connections 2023-10-14T11:13:18.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.046+0000 7f5a035d9640 1 -- 172.21.15.26:0/2303698306 wait complete. 2023-10-14T11:13:18.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a035d9640 1 Processor -- start 2023-10-14T11:13:18.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a035d9640 1 -- start start 2023-10-14T11:13:18.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a035d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59fc0b84e0 0x7f59fc14b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:18.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a035d9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59fc0d0210 0x7f59fc152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:18.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a035d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59fc15cba0 0x7f59fc152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:18.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a035d9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc14d100 con 0x7f59fc0d0210 2023-10-14T11:13:18.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a035d9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc0c7620 con 0x7f59fc15cba0 2023-10-14T11:13:18.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a035d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc14c2d0 con 0x7f59fc0b84e0 2023-10-14T11:13:18.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a00b74640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59fc0d0210 0x7f59fc152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:18.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a00b74640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59fc0d0210 0x7f59fc152700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38626/0 (socket says 172.21.15.26:38626) 2023-10-14T11:13:18.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a00b74640 1 -- 172.21.15.26:0/2601999246 learned_addr learned my addr 172.21.15.26:0/2601999246 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:18.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a01375640 1 --2- 172.21.15.26:0/2601999246 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59fc0b84e0 0x7f59fc14b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:18.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a00b74640 1 -- 172.21.15.26:0/2601999246 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59fc0b84e0 msgr2=0x7f59fc14b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:18.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a00b74640 1 --2- 172.21.15.26:0/2601999246 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59fc0b84e0 0x7f59fc14b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a00b74640 1 -- 172.21.15.26:0/2601999246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59fc15cba0 msgr2=0x7f59fc152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:18.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a01b76640 1 --2- 172.21.15.26:0/2601999246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59fc15cba0 0x7f59fc152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:18.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a00b74640 1 --2- 172.21.15.26:0/2601999246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59fc15cba0 0x7f59fc152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a00b74640 1 -- 172.21.15.26:0/2601999246 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f4009a70 con 0x7f59fc0d0210 2023-10-14T11:13:18.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a01375640 1 --2- 172.21.15.26:0/2601999246 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59fc0b84e0 0x7f59fc14b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:18.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a01b76640 1 --2- 172.21.15.26:0/2601999246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59fc15cba0 0x7f59fc152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:18.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a00b74640 1 --2- 172.21.15.26:0/2601999246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59fc0d0210 0x7f59fc152700 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0011f0 tx=0x7f59ec00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:18.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f59f1ffb640 1 -- 172.21.15.26:0/2601999246 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec0074e0 con 0x7f59fc0d0210 2023-10-14T11:13:18.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f59f1ffb640 1 -- 172.21.15.26:0/2601999246 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ec007640 con 0x7f59fc0d0210 2023-10-14T11:13:18.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f59f1ffb640 1 -- 172.21.15.26:0/2601999246 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec004a10 con 0x7f59fc0d0210 2023-10-14T11:13:18.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a035d9640 1 -- 172.21.15.26:0/2601999246 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59fc14c580 con 0x7f59fc0d0210 2023-10-14T11:13:18.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.050+0000 7f5a035d9640 1 -- 172.21.15.26:0/2601999246 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59fc14cb40 con 0x7f59fc0d0210 2023-10-14T11:13:18.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.054+0000 7f5a035d9640 1 -- 172.21.15.26:0/2601999246 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59fc0c7760 con 0x7f59fc0d0210 2023-10-14T11:13:18.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.054+0000 7f59f1ffb640 1 -- 172.21.15.26:0/2601999246 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f59ec004b70 con 0x7f59fc0d0210 2023-10-14T11:13:18.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.054+0000 7f59f1ffb640 1 --2- 172.21.15.26:0/2601999246 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f59e00664d0 0x7f59e0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:18.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.054+0000 7f59f1ffb640 1 -- 172.21.15.26:0/2601999246 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f59ec083480 con 0x7f59fc0d0210 2023-10-14T11:13:18.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.054+0000 7f5a01375640 1 --2- 172.21.15.26:0/2601999246 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f59e00664d0 0x7f59e0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:18.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.054+0000 7f5a01375640 1 --2- 172.21.15.26:0/2601999246 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f59e00664d0 0x7f59e0068990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f59f8009a40 tx=0x7f59f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:18.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.058+0000 7f59f1ffb640 1 -- 172.21.15.26:0/2601999246 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f59ec0504a0 con 0x7f59fc0d0210 2023-10-14T11:13:18.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.218+0000 7f5a035d9640 1 -- 172.21.15.26:0/2601999246 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59fc04e170 con 0x7f59fc0d0210 2023-10-14T11:13:18.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.218+0000 7f59f1ffb640 1 -- 172.21.15.26:0/2601999246 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f59ec018020 con 0x7f59fc0d0210 2023-10-14T11:13:18.223 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:13:18.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.218+0000 7f5a035d9640 1 -- 172.21.15.26:0/2601999246 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f59e00664d0 msgr2=0x7f59e0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:18.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.218+0000 7f5a035d9640 1 --2- 172.21.15.26:0/2601999246 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f59e00664d0 0x7f59e0068990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f59f8009a40 tx=0x7f59f8008040 comp rx=0 tx=0).stop 2023-10-14T11:13:18.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.218+0000 7f5a035d9640 1 -- 172.21.15.26:0/2601999246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59fc0d0210 msgr2=0x7f59fc152700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:18.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.218+0000 7f5a035d9640 1 --2- 172.21.15.26:0/2601999246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59fc0d0210 0x7f59fc152700 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0011f0 tx=0x7f59ec00c9b0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.218+0000 7f5a035d9640 1 -- 172.21.15.26:0/2601999246 shutdown_connections 2023-10-14T11:13:18.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.218+0000 7f5a035d9640 1 --2- 172.21.15.26:0/2601999246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59fc15cba0 0x7f59fc152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.218+0000 7f5a035d9640 1 --2- 172.21.15.26:0/2601999246 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f59e00664d0 0x7f59e0068990 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.218+0000 7f5a035d9640 1 --2- 172.21.15.26:0/2601999246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59fc0d0210 0x7f59fc152700 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.218+0000 7f5a035d9640 1 --2- 172.21.15.26:0/2601999246 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59fc0b84e0 0x7f59fc14b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.218+0000 7f5a035d9640 1 -- 172.21.15.26:0/2601999246 >> 172.21.15.26:0/2601999246 conn(0x7f59fc0719c0 msgr2=0x7f59fc153c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:18.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.218+0000 7f5a035d9640 1 -- 172.21.15.26:0/2601999246 shutdown_connections 2023-10-14T11:13:18.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.218+0000 7f5a035d9640 1 -- 172.21.15.26:0/2601999246 wait complete. 2023-10-14T11:13:18.244 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:13:18.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.382+0000 7ff4e87aa640 1 Processor -- start 2023-10-14T11:13:18.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.382+0000 7ff4e87aa640 1 -- start start 2023-10-14T11:13:18.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.386+0000 7ff4e87aa640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4e0159900 0x7ff4e006e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:18.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.386+0000 7ff4e87aa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e00b3f00 0x7ff4e0069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:18.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.386+0000 7ff4e87aa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff4e006a3d0 0x7ff4e00cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:18.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.386+0000 7ff4e87aa640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e00cd740 con 0x7ff4e0159900 2023-10-14T11:13:18.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.386+0000 7ff4e87aa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e006a840 con 0x7ff4e006a3d0 2023-10-14T11:13:18.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.386+0000 7ff4e87aa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e00b4360 con 0x7ff4e00b3f00 2023-10-14T11:13:18.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.386+0000 7ff4e6546640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4e0159900 0x7ff4e006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:18.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.386+0000 7ff4e6546640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4e0159900 0x7ff4e006e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38634/0 (socket says 172.21.15.26:38634) 2023-10-14T11:13:18.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.386+0000 7ff4e6546640 1 -- 172.21.15.26:0/3046227490 learned_addr learned my addr 172.21.15.26:0/3046227490 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:18.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.386+0000 7ff4e5d45640 1 --2- 172.21.15.26:0/3046227490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e00b3f00 0x7ff4e0069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:18.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.386+0000 7ff4e6d47640 1 --2- 172.21.15.26:0/3046227490 >> v2:172.21.15.110:3300/0 conn(0x7ff4e006a3d0 0x7ff4e00cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:18.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.386+0000 7ff4e6546640 1 -- 172.21.15.26:0/3046227490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e00b3f00 msgr2=0x7ff4e0069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:18.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.386+0000 7ff4e6546640 1 --2- 172.21.15.26:0/3046227490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e00b3f00 0x7ff4e0069e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.386+0000 7ff4e6546640 1 -- 172.21.15.26:0/3046227490 >> v2:172.21.15.110:3300/0 conn(0x7ff4e006a3d0 msgr2=0x7ff4e00cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:18.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.386+0000 7ff4e6546640 1 --2- 172.21.15.26:0/3046227490 >> v2:172.21.15.110:3300/0 conn(0x7ff4e006a3d0 0x7ff4e00cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.386+0000 7ff4e6546640 1 -- 172.21.15.26:0/3046227490 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e00b4600 con 0x7ff4e0159900 2023-10-14T11:13:18.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.386+0000 7ff4e6d47640 1 --2- 172.21.15.26:0/3046227490 >> v2:172.21.15.110:3300/0 conn(0x7ff4e006a3d0 0x7ff4e00cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:18.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.390+0000 7ff4e6546640 1 --2- 172.21.15.26:0/3046227490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4e0159900 0x7ff4e006e260 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00c8d10 tx=0x7ff4dc01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac1927d69eb3fef server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:18.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.390+0000 7ff4e5544640 1 -- 172.21.15.26:0/3046227490 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0ab600 con 0x7ff4e0159900 2023-10-14T11:13:18.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.390+0000 7ff4e5544640 1 -- 172.21.15.26:0/3046227490 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc0a7050 con 0x7ff4e0159900 2023-10-14T11:13:18.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.390+0000 7ff4e5544640 1 -- 172.21.15.26:0/3046227490 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0ab980 con 0x7ff4e0159900 2023-10-14T11:13:18.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.390+0000 7ff4e87aa640 1 -- 172.21.15.26:0/3046227490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4e0159900 msgr2=0x7ff4e006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:18.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.390+0000 7ff4e87aa640 1 --2- 172.21.15.26:0/3046227490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4e0159900 0x7ff4e006e260 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00c8d10 tx=0x7ff4dc01c210 comp rx=0 tx=0).stop 2023-10-14T11:13:18.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.390+0000 7ff4e87aa640 1 -- 172.21.15.26:0/3046227490 shutdown_connections 2023-10-14T11:13:18.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.390+0000 7ff4e87aa640 1 --2- 172.21.15.26:0/3046227490 >> v2:172.21.15.110:3300/0 conn(0x7ff4e006a3d0 0x7ff4e00cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.390+0000 7ff4e87aa640 1 --2- 172.21.15.26:0/3046227490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e00b3f00 0x7ff4e0069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.390+0000 7ff4e87aa640 1 --2- 172.21.15.26:0/3046227490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4e0159900 0x7ff4e006e260 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.390+0000 7ff4e87aa640 1 -- 172.21.15.26:0/3046227490 >> 172.21.15.26:0/3046227490 conn(0x7ff4e00b0da0 msgr2=0x7ff4e00ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:18.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.390+0000 7ff4e87aa640 1 -- 172.21.15.26:0/3046227490 shutdown_connections 2023-10-14T11:13:18.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.390+0000 7ff4e87aa640 1 -- 172.21.15.26:0/3046227490 wait complete. 2023-10-14T11:13:18.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.390+0000 7ff4e87aa640 1 Processor -- start 2023-10-14T11:13:18.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.390+0000 7ff4e87aa640 1 -- start start 2023-10-14T11:13:18.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4e87aa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4e006a3d0 0x7ff4e00c3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:18.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4e87aa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e00b3f00 0x7ff4e00b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:18.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4e87aa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4e0159900 0x7ff4e0152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:18.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4e87aa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e0153200 con 0x7ff4e006a3d0 2023-10-14T11:13:18.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4e87aa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e01f89e0 con 0x7ff4e0159900 2023-10-14T11:13:18.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4e87aa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e01f8cc0 con 0x7ff4e00b3f00 2023-10-14T11:13:18.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4e6546640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4e006a3d0 0x7ff4e00c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:18.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4e6546640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4e006a3d0 0x7ff4e00c3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38650/0 (socket says 172.21.15.26:38650) 2023-10-14T11:13:18.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4e6546640 1 -- 172.21.15.26:0/3183307039 learned_addr learned my addr 172.21.15.26:0/3183307039 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:18.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4e5d45640 1 --2- 172.21.15.26:0/3183307039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e00b3f00 0x7ff4e00b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:18.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4e6d47640 1 --2- 172.21.15.26:0/3183307039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4e0159900 0x7ff4e0152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:18.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4e6546640 1 -- 172.21.15.26:0/3183307039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e00b3f00 msgr2=0x7ff4e00b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:18.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4e6546640 1 --2- 172.21.15.26:0/3183307039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e00b3f00 0x7ff4e00b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4e6546640 1 -- 172.21.15.26:0/3183307039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4e0159900 msgr2=0x7ff4e0152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:18.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4e6546640 1 --2- 172.21.15.26:0/3183307039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4e0159900 0x7ff4e0152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4e6546640 1 -- 172.21.15.26:0/3183307039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4dc0094d0 con 0x7ff4e006a3d0 2023-10-14T11:13:18.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4e6546640 1 --2- 172.21.15.26:0/3183307039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4e006a3d0 0x7ff4e00c3080 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc0ae040 tx=0x7ff4dc018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:18.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4d6ffd640 1 -- 172.21.15.26:0/3183307039 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0b4440 con 0x7ff4e006a3d0 2023-10-14T11:13:18.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4d6ffd640 1 -- 172.21.15.26:0/3183307039 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc0b45a0 con 0x7ff4e006a3d0 2023-10-14T11:13:18.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4d6ffd640 1 -- 172.21.15.26:0/3183307039 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0b4930 con 0x7ff4e006a3d0 2023-10-14T11:13:18.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4e87aa640 1 -- 172.21.15.26:0/3183307039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e01f8fa0 con 0x7ff4e006a3d0 2023-10-14T11:13:18.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4e87aa640 1 -- 172.21.15.26:0/3183307039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e01f9560 con 0x7ff4e006a3d0 2023-10-14T11:13:18.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4e87aa640 1 -- 172.21.15.26:0/3183307039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e006cad0 con 0x7ff4e006a3d0 2023-10-14T11:13:18.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.394+0000 7ff4d6ffd640 1 -- 172.21.15.26:0/3183307039 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff4dc0b2070 con 0x7ff4e006a3d0 2023-10-14T11:13:18.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.398+0000 7ff4d6ffd640 1 --2- 172.21.15.26:0/3183307039 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff4c40664d0 0x7ff4c4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:18.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.398+0000 7ff4d6ffd640 1 -- 172.21.15.26:0/3183307039 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff4dc11de90 con 0x7ff4e006a3d0 2023-10-14T11:13:18.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.398+0000 7ff4e5d45640 1 --2- 172.21.15.26:0/3183307039 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff4c40664d0 0x7ff4c4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:18.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.398+0000 7ff4e5d45640 1 --2- 172.21.15.26:0/3183307039 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff4c40664d0 0x7ff4c4068990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0159370 tx=0x7ff4d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:18.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.402+0000 7ff4d6ffd640 1 -- 172.21.15.26:0/3183307039 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff4dc0eb070 con 0x7ff4e006a3d0 2023-10-14T11:13:18.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.554+0000 7ff4e87aa640 1 -- 172.21.15.26:0/3183307039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff4e004e170 con 0x7ff4e006a3d0 2023-10-14T11:13:18.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.558+0000 7ff4d6ffd640 1 -- 172.21.15.26:0/3183307039 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff4dc0ee690 con 0x7ff4e006a3d0 2023-10-14T11:13:18.563 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:18.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.558+0000 7ff4e87aa640 1 -- 172.21.15.26:0/3183307039 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff4c40664d0 msgr2=0x7ff4c4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:18.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.558+0000 7ff4e87aa640 1 --2- 172.21.15.26:0/3183307039 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff4c40664d0 0x7ff4c4068990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0159370 tx=0x7ff4d0008040 comp rx=0 tx=0).stop 2023-10-14T11:13:18.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.558+0000 7ff4e87aa640 1 -- 172.21.15.26:0/3183307039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4e006a3d0 msgr2=0x7ff4e00c3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:18.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.558+0000 7ff4e87aa640 1 --2- 172.21.15.26:0/3183307039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4e006a3d0 0x7ff4e00c3080 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc0ae040 tx=0x7ff4dc018fb0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.558+0000 7ff4e87aa640 1 -- 172.21.15.26:0/3183307039 shutdown_connections 2023-10-14T11:13:18.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.558+0000 7ff4e87aa640 1 --2- 172.21.15.26:0/3183307039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4e0159900 0x7ff4e0152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.558+0000 7ff4e87aa640 1 --2- 172.21.15.26:0/3183307039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e00b3f00 0x7ff4e00b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.558+0000 7ff4e87aa640 1 --2- 172.21.15.26:0/3183307039 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff4c40664d0 0x7ff4c4068990 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.558+0000 7ff4e87aa640 1 --2- 172.21.15.26:0/3183307039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4e006a3d0 0x7ff4e00c3080 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.558+0000 7ff4e87aa640 1 -- 172.21.15.26:0/3183307039 >> 172.21.15.26:0/3183307039 conn(0x7ff4e00b0da0 msgr2=0x7ff4e0072a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:18.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.558+0000 7ff4e87aa640 1 -- 172.21.15.26:0/3183307039 shutdown_connections 2023-10-14T11:13:18.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.558+0000 7ff4e87aa640 1 -- 172.21.15.26:0/3183307039 wait complete. 2023-10-14T11:13:18.584 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:13:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.722+0000 7f88c226b640 1 Processor -- start 2023-10-14T11:13:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.726+0000 7f88c226b640 1 -- start start 2023-10-14T11:13:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.726+0000 7f88c226b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88bc0d0210 0x7f88bc0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.726+0000 7f88c226b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f88bc0b84e0 0x7f88bc0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.726+0000 7f88c226b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88bc0d1670 con 0x7f88bc15cba0 2023-10-14T11:13:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.726+0000 7f88c226b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88bc0d1460 con 0x7f88bc0b84e0 2023-10-14T11:13:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.726+0000 7f88c226b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc0d1950 con 0x7f88bc0d0210 2023-10-14T11:13:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.726+0000 7f88c0808640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f88bc0b84e0 0x7f88bc0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:18.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.726+0000 7f88bb7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88bc0d0210 0x7f88bc0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:18.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.726+0000 7f88c0808640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f88bc0b84e0 0x7f88bc0b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:39324/0 (socket says 172.21.15.26:39324) 2023-10-14T11:13:18.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.726+0000 7f88c0808640 1 -- 172.21.15.26:0/3716995775 learned_addr learned my addr 172.21.15.26:0/3716995775 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:18.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.726+0000 7f88c0808640 1 -- 172.21.15.26:0/3716995775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88bc0d0210 msgr2=0x7f88bc0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:18.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.726+0000 7f88c0808640 1 --2- 172.21.15.26:0/3716995775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88bc0d0210 0x7f88bc0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.726+0000 7f88c0808640 1 -- 172.21.15.26:0/3716995775 >> v1:172.21.15.110:6789/0 conn(0x7f88bc15cba0 legacy=0x7f88bc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:18.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.726+0000 7f88c0808640 1 -- 172.21.15.26:0/3716995775 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88bc0d1c30 con 0x7f88bc0b84e0 2023-10-14T11:13:18.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.730+0000 7f88c0808640 1 --2- 172.21.15.26:0/3716995775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88bc0b84e0 0x7f88bc0b5cf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009e50 tx=0x7f88b401ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfec702217bdb8f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:18.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.730+0000 7f88baffd640 1 -- 172.21.15.26:0/3716995775 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b40a58e0 con 0x7f88bc0b84e0 2023-10-14T11:13:18.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.730+0000 7f88baffd640 1 -- 172.21.15.26:0/3716995775 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b40a5a40 con 0x7f88bc0b84e0 2023-10-14T11:13:18.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.730+0000 7f88baffd640 1 -- 172.21.15.26:0/3716995775 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b40a5dd0 con 0x7f88bc0b84e0 2023-10-14T11:13:18.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.730+0000 7f88c226b640 1 -- 172.21.15.26:0/3716995775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88bc0b84e0 msgr2=0x7f88bc0b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:18.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.730+0000 7f88c226b640 1 --2- 172.21.15.26:0/3716995775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88bc0b84e0 0x7f88bc0b5cf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009e50 tx=0x7f88b401ca10 comp rx=0 tx=0).stop 2023-10-14T11:13:18.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.730+0000 7f88c226b640 1 -- 172.21.15.26:0/3716995775 shutdown_connections 2023-10-14T11:13:18.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.730+0000 7f88c226b640 1 --2- 172.21.15.26:0/3716995775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88bc0b84e0 0x7f88bc0b5cf0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.730+0000 7f88c226b640 1 --2- 172.21.15.26:0/3716995775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88bc0d0210 0x7f88bc0d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.730+0000 7f88c226b640 1 -- 172.21.15.26:0/3716995775 >> 172.21.15.26:0/3716995775 conn(0x7f88bc0719c0 msgr2=0x7f88bc071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:18.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.730+0000 7f88c226b640 1 -- 172.21.15.26:0/3716995775 shutdown_connections 2023-10-14T11:13:18.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.730+0000 7f88c226b640 1 -- 172.21.15.26:0/3716995775 wait complete. 2023-10-14T11:13:18.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.730+0000 7f88c226b640 1 Processor -- start 2023-10-14T11:13:18.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88c226b640 1 -- start start 2023-10-14T11:13:18.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88c226b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88bc0b84e0 0x7f88bc0b6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:18.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88c226b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88bc0d0210 0x7f88bc1f89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:18.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88c226b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88bc15cba0 0x7f88bc1f8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:18.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88c226b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc15d670 con 0x7f88bc0d0210 2023-10-14T11:13:18.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88c226b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc15d320 con 0x7f88bc0b84e0 2023-10-14T11:13:18.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88c226b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc14fc70 con 0x7f88bc15cba0 2023-10-14T11:13:18.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88bb7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88bc0d0210 0x7f88bc1f89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:18.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88bb7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88bc0d0210 0x7f88bc1f89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38658/0 (socket says 172.21.15.26:38658) 2023-10-14T11:13:18.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88bb7fe640 1 -- 172.21.15.26:0/213005394 learned_addr learned my addr 172.21.15.26:0/213005394 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:18.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88c0808640 1 --2- 172.21.15.26:0/213005394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88bc15cba0 0x7f88bc1f8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:18.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88bbfff640 1 --2- 172.21.15.26:0/213005394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88bc0b84e0 0x7f88bc0b6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:18.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88bb7fe640 1 -- 172.21.15.26:0/213005394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88bc15cba0 msgr2=0x7f88bc1f8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:18.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88bb7fe640 1 --2- 172.21.15.26:0/213005394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88bc15cba0 0x7f88bc1f8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88bb7fe640 1 -- 172.21.15.26:0/213005394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88bc0b84e0 msgr2=0x7f88bc0b6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:18.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88bb7fe640 1 --2- 172.21.15.26:0/213005394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88bc0b84e0 0x7f88bc0b6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88bb7fe640 1 -- 172.21.15.26:0/213005394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b4009b30 con 0x7f88bc0d0210 2023-10-14T11:13:18.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88bb7fe640 1 --2- 172.21.15.26:0/213005394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88bc0d0210 0x7f88bc1f89f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f88b000e930 tx=0x7f88b000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:18.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88b8ff9640 1 -- 172.21.15.26:0/213005394 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b0009690 con 0x7f88bc0d0210 2023-10-14T11:13:18.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88b8ff9640 1 -- 172.21.15.26:0/213005394 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b000ca00 con 0x7f88bc0d0210 2023-10-14T11:13:18.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88b8ff9640 1 -- 172.21.15.26:0/213005394 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b000cd70 con 0x7f88bc0d0210 2023-10-14T11:13:18.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88c226b640 1 -- 172.21.15.26:0/213005394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88bc15da90 con 0x7f88bc0d0210 2023-10-14T11:13:18.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88c226b640 1 -- 172.21.15.26:0/213005394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88bc0c9090 con 0x7f88bc0d0210 2023-10-14T11:13:18.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.734+0000 7f88c226b640 1 -- 172.21.15.26:0/213005394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88bc04e170 con 0x7f88bc0d0210 2023-10-14T11:13:18.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.738+0000 7f88b8ff9640 1 -- 172.21.15.26:0/213005394 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f88b0013470 con 0x7f88bc0d0210 2023-10-14T11:13:18.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.738+0000 7f88b8ff9640 1 --2- 172.21.15.26:0/213005394 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f88a80664a0 0x7f88a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:18.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.738+0000 7f88b8ff9640 1 -- 172.21.15.26:0/213005394 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f88b0084350 con 0x7f88bc0d0210 2023-10-14T11:13:18.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.738+0000 7f88bbfff640 1 --2- 172.21.15.26:0/213005394 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f88a80664a0 0x7f88a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:18.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.738+0000 7f88bbfff640 1 --2- 172.21.15.26:0/213005394 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f88a80664a0 0x7f88a8068960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f88bc072860 tx=0x7f88ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:18.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.742+0000 7f88b8ff9640 1 -- 172.21.15.26:0/213005394 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f88b00515f0 con 0x7f88bc0d0210 2023-10-14T11:13:18.841 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:13:18.845 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:13:18.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.898+0000 7f88c226b640 1 -- 172.21.15.26:0/213005394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f88bc0ce830 con 0x7f88bc0d0210 2023-10-14T11:13:18.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.898+0000 7f88b8ff9640 1 -- 172.21.15.26:0/213005394 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f88b0054c10 con 0x7f88bc0d0210 2023-10-14T11:13:18.906 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:13:18.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.902+0000 7f88c226b640 1 -- 172.21.15.26:0/213005394 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f88a80664a0 msgr2=0x7f88a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:18.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.902+0000 7f88c226b640 1 --2- 172.21.15.26:0/213005394 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f88a80664a0 0x7f88a8068960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f88bc072860 tx=0x7f88ac009040 comp rx=0 tx=0).stop 2023-10-14T11:13:18.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.902+0000 7f88c226b640 1 -- 172.21.15.26:0/213005394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88bc0d0210 msgr2=0x7f88bc1f89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:18.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.902+0000 7f88c226b640 1 --2- 172.21.15.26:0/213005394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88bc0d0210 0x7f88bc1f89f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f88b000e930 tx=0x7f88b000edf0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.902+0000 7f88c226b640 1 -- 172.21.15.26:0/213005394 shutdown_connections 2023-10-14T11:13:18.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.902+0000 7f88c226b640 1 --2- 172.21.15.26:0/213005394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88bc15cba0 0x7f88bc1f8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.902+0000 7f88c226b640 1 --2- 172.21.15.26:0/213005394 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f88a80664a0 0x7f88a8068960 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.902+0000 7f88c226b640 1 --2- 172.21.15.26:0/213005394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88bc0d0210 0x7f88bc1f89f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.902+0000 7f88c226b640 1 --2- 172.21.15.26:0/213005394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88bc0b84e0 0x7f88bc0b6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:18.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.902+0000 7f88c226b640 1 -- 172.21.15.26:0/213005394 >> 172.21.15.26:0/213005394 conn(0x7f88bc0719c0 msgr2=0x7f88bc0cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:18.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.902+0000 7f88c226b640 1 -- 172.21.15.26:0/213005394 shutdown_connections 2023-10-14T11:13:18.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:18.902+0000 7f88c226b640 1 -- 172.21.15.26:0/213005394 wait complete. 2023-10-14T11:13:18.928 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T11:13:19.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.114+0000 7f0bba196640 1 Processor -- start 2023-10-14T11:13:19.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.114+0000 7f0bba196640 1 -- start start 2023-10-14T11:13:19.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.114+0000 7f0bba196640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0bb40cf210 0x7f0bb40cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:19.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.114+0000 7f0bba196640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bb415cdc0 0x7f0bb40b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:19.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.114+0000 7f0bba196640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0bb40d3320 0x7f0bb40b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:19.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.114+0000 7f0bba196640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb40cfb30 con 0x7f0bb40cf210 2023-10-14T11:13:19.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.114+0000 7f0bba196640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb40d0880 con 0x7f0bb40d3320 2023-10-14T11:13:19.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.114+0000 7f0bba196640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb40b1c00 con 0x7f0bb415cdc0 2023-10-14T11:13:19.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.114+0000 7f0bb9194640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0bb40cf210 0x7f0bb40cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:19.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.114+0000 7f0bb9194640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0bb40cf210 0x7f0bb40cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38668/0 (socket says 172.21.15.26:38668) 2023-10-14T11:13:19.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.114+0000 7f0bb9194640 1 -- 172.21.15.26:0/187994660 learned_addr learned my addr 172.21.15.26:0/187994660 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:19.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.114+0000 7f0bb9194640 1 -- 172.21.15.26:0/187994660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bb415cdc0 msgr2=0x7f0bb40b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:19.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.114+0000 7f0bb9194640 1 --2- 172.21.15.26:0/187994660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bb415cdc0 0x7f0bb40b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.114+0000 7f0bb9194640 1 -- 172.21.15.26:0/187994660 >> v2:172.21.15.110:3300/0 conn(0x7f0bb40d3320 msgr2=0x7f0bb40b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:19.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.114+0000 7f0bb9995640 1 --2- 172.21.15.26:0/187994660 >> v2:172.21.15.110:3300/0 conn(0x7f0bb40d3320 0x7f0bb40b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:19.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.118+0000 7f0bb9194640 1 --2- 172.21.15.26:0/187994660 >> v2:172.21.15.110:3300/0 conn(0x7f0bb40d3320 0x7f0bb40b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.118+0000 7f0bb9194640 1 -- 172.21.15.26:0/187994660 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb40b1ee0 con 0x7f0bb40cf210 2023-10-14T11:13:19.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.118+0000 7f0bb9995640 1 --2- 172.21.15.26:0/187994660 >> v2:172.21.15.110:3300/0 conn(0x7f0bb40d3320 0x7f0bb40b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:19.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.118+0000 7f0bb9194640 1 --2- 172.21.15.26:0/187994660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb40cf210 0x7f0bb40cf5f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0bb408cf20 tx=0x7f0bb001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45bb605e0a7b434c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:19.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.118+0000 7f0babfff640 1 -- 172.21.15.26:0/187994660 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00ac600 con 0x7f0bb40cf210 2023-10-14T11:13:19.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.118+0000 7f0babfff640 1 -- 172.21.15.26:0/187994660 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb00a8050 con 0x7f0bb40cf210 2023-10-14T11:13:19.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.118+0000 7f0babfff640 1 -- 172.21.15.26:0/187994660 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00ac980 con 0x7f0bb40cf210 2023-10-14T11:13:19.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.118+0000 7f0bba196640 1 -- 172.21.15.26:0/187994660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb40cf210 msgr2=0x7f0bb40cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:19.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.118+0000 7f0bba196640 1 --2- 172.21.15.26:0/187994660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb40cf210 0x7f0bb40cf5f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0bb408cf20 tx=0x7f0bb001c4d0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.118+0000 7f0bba196640 1 -- 172.21.15.26:0/187994660 shutdown_connections 2023-10-14T11:13:19.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.118+0000 7f0bba196640 1 --2- 172.21.15.26:0/187994660 >> v2:172.21.15.110:3300/0 conn(0x7f0bb40d3320 0x7f0bb40b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.118+0000 7f0bba196640 1 --2- 172.21.15.26:0/187994660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bb415cdc0 0x7f0bb40b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.118+0000 7f0bba196640 1 --2- 172.21.15.26:0/187994660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb40cf210 0x7f0bb40cf5f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.118+0000 7f0bba196640 1 -- 172.21.15.26:0/187994660 >> 172.21.15.26:0/187994660 conn(0x7f0bb40d2800 msgr2=0x7f0bb40d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:19.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.122+0000 7f0bba196640 1 -- 172.21.15.26:0/187994660 shutdown_connections 2023-10-14T11:13:19.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.122+0000 7f0bba196640 1 -- 172.21.15.26:0/187994660 wait complete. 2023-10-14T11:13:19.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.122+0000 7f0bba196640 1 Processor -- start 2023-10-14T11:13:19.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.122+0000 7f0bba196640 1 -- start start 2023-10-14T11:13:19.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.122+0000 7f0bba196640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb40cf210 0x7f0bb415e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:19.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.122+0000 7f0bba196640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb40d3320 0x7f0bb40b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:19.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.122+0000 7f0bba196640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bb415cdc0 0x7f0bb415b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:19.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.122+0000 7f0bba196640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb4153700 con 0x7f0bb40d3320 2023-10-14T11:13:19.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.122+0000 7f0bba196640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb4153b00 con 0x7f0bb40cf210 2023-10-14T11:13:19.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.122+0000 7f0bba196640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb4152a80 con 0x7f0bb415cdc0 2023-10-14T11:13:19.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.122+0000 7f0bb8993640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb40d3320 0x7f0bb40b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:19.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.122+0000 7f0bb8993640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb40d3320 0x7f0bb40b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38680/0 (socket says 172.21.15.26:38680) 2023-10-14T11:13:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.122+0000 7f0bb8993640 1 -- 172.21.15.26:0/342795621 learned_addr learned my addr 172.21.15.26:0/342795621 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.122+0000 7f0bb9995640 1 --2- 172.21.15.26:0/342795621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bb415cdc0 0x7f0bb415b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.122+0000 7f0bb9194640 1 --2- 172.21.15.26:0/342795621 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb40cf210 0x7f0bb415e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.122+0000 7f0bb8993640 1 -- 172.21.15.26:0/342795621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bb415cdc0 msgr2=0x7f0bb415b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:19.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.122+0000 7f0bb8993640 1 --2- 172.21.15.26:0/342795621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bb415cdc0 0x7f0bb415b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.122+0000 7f0bb8993640 1 -- 172.21.15.26:0/342795621 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb40cf210 msgr2=0x7f0bb415e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:19.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.122+0000 7f0bb8993640 1 --2- 172.21.15.26:0/342795621 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb40cf210 0x7f0bb415e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.122+0000 7f0bb8993640 1 -- 172.21.15.26:0/342795621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb0009480 con 0x7f0bb40d3320 2023-10-14T11:13:19.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.122+0000 7f0bb9995640 1 --2- 172.21.15.26:0/342795621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bb415cdc0 0x7f0bb415b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:19.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.122+0000 7f0bb8993640 1 --2- 172.21.15.26:0/342795621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb40d3320 0x7f0bb40b0d90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0ba400b410 tx=0x7f0ba400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:19.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.126+0000 7f0ba9ffb640 1 -- 172.21.15.26:0/342795621 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4011830 con 0x7f0bb40d3320 2023-10-14T11:13:19.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.126+0000 7f0ba9ffb640 1 -- 172.21.15.26:0/342795621 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba4011990 con 0x7f0bb40d3320 2023-10-14T11:13:19.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.126+0000 7f0ba9ffb640 1 -- 172.21.15.26:0/342795621 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4011d40 con 0x7f0bb40d3320 2023-10-14T11:13:19.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.126+0000 7f0bba196640 1 -- 172.21.15.26:0/342795621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb4152d60 con 0x7f0bb40d3320 2023-10-14T11:13:19.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.126+0000 7f0bba196640 1 -- 172.21.15.26:0/342795621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb4153320 con 0x7f0bb40d3320 2023-10-14T11:13:19.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.126+0000 7f0bba196640 1 -- 172.21.15.26:0/342795621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb404e9c0 con 0x7f0bb40d3320 2023-10-14T11:13:19.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.126+0000 7f0ba9ffb640 1 -- 172.21.15.26:0/342795621 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0ba401a400 con 0x7f0bb40d3320 2023-10-14T11:13:19.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.126+0000 7f0ba9ffb640 1 --2- 172.21.15.26:0/342795621 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0b980664d0 0x7f0b98068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:19.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.126+0000 7f0ba9ffb640 1 -- 172.21.15.26:0/342795621 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0ba4084290 con 0x7f0bb40d3320 2023-10-14T11:13:19.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.126+0000 7f0bb9194640 1 --2- 172.21.15.26:0/342795621 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0b980664d0 0x7f0b98068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:19.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.130+0000 7f0bb9194640 1 --2- 172.21.15.26:0/342795621 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0b980664d0 0x7f0b98068990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00ae000 tx=0x7f0bb0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:19.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.130+0000 7f0ba9ffb640 1 -- 172.21.15.26:0/342795621 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0ba40513e0 con 0x7f0bb40d3320 2023-10-14T11:13:19.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.286+0000 7f0bba196640 1 -- 172.21.15.26:0/342795621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0bb40d0bc0 con 0x7f0bb40d3320 2023-10-14T11:13:19.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.286+0000 7f0ba9ffb640 1 -- 172.21.15.26:0/342795621 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0ba4054a00 con 0x7f0bb40d3320 2023-10-14T11:13:19.293 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:19.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.290+0000 7f0bba196640 1 -- 172.21.15.26:0/342795621 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0b980664d0 msgr2=0x7f0b98068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:19.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.290+0000 7f0bba196640 1 --2- 172.21.15.26:0/342795621 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0b980664d0 0x7f0b98068990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00ae000 tx=0x7f0bb0008040 comp rx=0 tx=0).stop 2023-10-14T11:13:19.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.290+0000 7f0bba196640 1 -- 172.21.15.26:0/342795621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb40d3320 msgr2=0x7f0bb40b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:19.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.290+0000 7f0bba196640 1 --2- 172.21.15.26:0/342795621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb40d3320 0x7f0bb40b0d90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0ba400b410 tx=0x7f0ba400b8d0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.290+0000 7f0bba196640 1 -- 172.21.15.26:0/342795621 shutdown_connections 2023-10-14T11:13:19.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.290+0000 7f0bba196640 1 --2- 172.21.15.26:0/342795621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bb415cdc0 0x7f0bb415b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.290+0000 7f0bba196640 1 --2- 172.21.15.26:0/342795621 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0b980664d0 0x7f0b98068990 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.290+0000 7f0bba196640 1 --2- 172.21.15.26:0/342795621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb40d3320 0x7f0bb40b0d90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.290+0000 7f0bba196640 1 --2- 172.21.15.26:0/342795621 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb40cf210 0x7f0bb415e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.290+0000 7f0bba196640 1 -- 172.21.15.26:0/342795621 >> 172.21.15.26:0/342795621 conn(0x7f0bb40d2800 msgr2=0x7f0bb40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:19.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.290+0000 7f0bba196640 1 -- 172.21.15.26:0/342795621 shutdown_connections 2023-10-14T11:13:19.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.290+0000 7f0bba196640 1 -- 172.21.15.26:0/342795621 wait complete. 2023-10-14T11:13:19.314 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:13:19.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.450+0000 7fcb5199d640 1 Processor -- start 2023-10-14T11:13:19.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.454+0000 7fcb5199d640 1 -- start start 2023-10-14T11:13:19.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.454+0000 7fcb5199d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb4c15ca70 0x7fcb4c0d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:19.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.454+0000 7fcb5199d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcb4c0d3550 0x7fcb4c0cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:19.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.454+0000 7fcb5199d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4c0c65f0 con 0x7fcb4c0cf5d0 2023-10-14T11:13:19.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.454+0000 7fcb5199d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb4c0ce820 con 0x7fcb4c0d3550 2023-10-14T11:13:19.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.454+0000 7fcb5199d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c0cfa40 con 0x7fcb4c15ca70 2023-10-14T11:13:19.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.454+0000 7fcb4b7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcb4c0cf5d0 0x7fcb4c0d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45088/0 (socket says 172.21.15.26:45088) 2023-10-14T11:13:19.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.454+0000 7fcb4b7fe640 1 -- 172.21.15.26:0/3859415595 learned_addr learned my addr 172.21.15.26:0/3859415595 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:19.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.454+0000 7fcb43fff640 1 --2- 172.21.15.26:0/3859415595 >> v2:172.21.15.110:3300/0 conn(0x7fcb4c0d3550 0x7fcb4c0cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:19.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.454+0000 7fcb4affd640 1 --2- 172.21.15.26:0/3859415595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb4c15ca70 0x7fcb4c0d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:19.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.454+0000 7fcb4a7fc640 1 -- 172.21.15.26:0/3859415595 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478281672 0 0) 0x7fcb4c0c65f0 con 0x7fcb4c0cf5d0 2023-10-14T11:13:19.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.454+0000 7fcb4a7fc640 1 -- 172.21.15.26:0/3859415595 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb38003530 con 0x7fcb4c0cf5d0 2023-10-14T11:13:19.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.454+0000 7fcb43fff640 1 -- 172.21.15.26:0/3859415595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb4c15ca70 msgr2=0x7fcb4c0d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:19.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.454+0000 7fcb43fff640 1 --2- 172.21.15.26:0/3859415595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb4c15ca70 0x7fcb4c0d3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.454+0000 7fcb43fff640 1 -- 172.21.15.26:0/3859415595 >> v1:172.21.15.26:6789/0 conn(0x7fcb4c0cf5d0 legacy=0x7fcb4c0d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:19.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.454+0000 7fcb43fff640 1 -- 172.21.15.26:0/3859415595 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c0cdf80 con 0x7fcb4c0d3550 2023-10-14T11:13:19.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.454+0000 7fcb4affd640 1 --2- 172.21.15.26:0/3859415595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb4c15ca70 0x7fcb4c0d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:13:19.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.458+0000 7fcb43fff640 1 --2- 172.21.15.26:0/3859415595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb4c0d3550 0x7fcb4c0cf090 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcb340097f0 tx=0x7fcb3401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a283dcd47437964 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:19.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.458+0000 7fcb4a7fc640 1 -- 172.21.15.26:0/3859415595 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb340ab650 con 0x7fcb4c0d3550 2023-10-14T11:13:19.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.458+0000 7fcb4a7fc640 1 -- 172.21.15.26:0/3859415595 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb340ab7b0 con 0x7fcb4c0d3550 2023-10-14T11:13:19.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.458+0000 7fcb4a7fc640 1 -- 172.21.15.26:0/3859415595 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb340abb40 con 0x7fcb4c0d3550 2023-10-14T11:13:19.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.458+0000 7fcb5199d640 1 -- 172.21.15.26:0/3859415595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb4c0d3550 msgr2=0x7fcb4c0cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:19.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.458+0000 7fcb5199d640 1 --2- 172.21.15.26:0/3859415595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb4c0d3550 0x7fcb4c0cf090 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcb340097f0 tx=0x7fcb3401c450 comp rx=0 tx=0).stop 2023-10-14T11:13:19.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.458+0000 7fcb5199d640 1 -- 172.21.15.26:0/3859415595 shutdown_connections 2023-10-14T11:13:19.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.458+0000 7fcb5199d640 1 --2- 172.21.15.26:0/3859415595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb4c0d3550 0x7fcb4c0cf090 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.458+0000 7fcb5199d640 1 --2- 172.21.15.26:0/3859415595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb4c15ca70 0x7fcb4c0d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.458+0000 7fcb5199d640 1 -- 172.21.15.26:0/3859415595 >> 172.21.15.26:0/3859415595 conn(0x7fcb4c09bc50 msgr2=0x7fcb4c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:19.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.458+0000 7fcb5199d640 1 -- 172.21.15.26:0/3859415595 shutdown_connections 2023-10-14T11:13:19.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.458+0000 7fcb5199d640 1 -- 172.21.15.26:0/3859415595 wait complete. 2023-10-14T11:13:19.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.458+0000 7fcb5199d640 1 Processor -- start 2023-10-14T11:13:19.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.458+0000 7fcb5199d640 1 -- start start 2023-10-14T11:13:19.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb5199d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb4c0cf5d0 0x7fcb4c1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:19.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb5199d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb4c0d3550 0x7fcb4c15b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:19.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb5199d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb4c15ca70 0x7fcb4c15b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:19.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb5199d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c1536f0 con 0x7fcb4c15ca70 2023-10-14T11:13:19.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb5199d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c15dc00 con 0x7fcb4c0d3550 2023-10-14T11:13:19.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb5199d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c15fc20 con 0x7fcb4c0cf5d0 2023-10-14T11:13:19.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb4b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb4c15ca70 0x7fcb4c15b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:19.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb4b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb4c15ca70 0x7fcb4c15b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38692/0 (socket says 172.21.15.26:38692) 2023-10-14T11:13:19.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb4b7fe640 1 -- 172.21.15.26:0/1836686100 learned_addr learned my addr 172.21.15.26:0/1836686100 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:19.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb4affd640 1 --2- 172.21.15.26:0/1836686100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb4c0cf5d0 0x7fcb4c1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:19.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb43fff640 1 --2- 172.21.15.26:0/1836686100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb4c0d3550 0x7fcb4c15b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:19.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb4b7fe640 1 -- 172.21.15.26:0/1836686100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb4c0cf5d0 msgr2=0x7fcb4c1531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:19.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb4b7fe640 1 --2- 172.21.15.26:0/1836686100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb4c0cf5d0 0x7fcb4c1531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb4b7fe640 1 -- 172.21.15.26:0/1836686100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb4c0d3550 msgr2=0x7fcb4c15b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:19.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb4b7fe640 1 --2- 172.21.15.26:0/1836686100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb4c0d3550 0x7fcb4c15b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb4b7fe640 1 -- 172.21.15.26:0/1836686100 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c0093b0 con 0x7fcb4c15ca70 2023-10-14T11:13:19.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb4b7fe640 1 --2- 172.21.15.26:0/1836686100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb4c15ca70 0x7fcb4c15b580 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400cb40 tx=0x7fcb4400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:19.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb48ff9640 1 -- 172.21.15.26:0/1836686100 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4400aca0 con 0x7fcb4c15ca70 2023-10-14T11:13:19.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb48ff9640 1 -- 172.21.15.26:0/1836686100 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4400ae00 con 0x7fcb4c15ca70 2023-10-14T11:13:19.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb5199d640 1 -- 172.21.15.26:0/1836686100 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb34009420 con 0x7fcb4c15ca70 2023-10-14T11:13:19.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb48ff9640 1 -- 172.21.15.26:0/1836686100 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44012620 con 0x7fcb4c15ca70 2023-10-14T11:13:19.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb5199d640 1 -- 172.21.15.26:0/1836686100 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4c15e180 con 0x7fcb4c15ca70 2023-10-14T11:13:19.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.462+0000 7fcb5199d640 1 -- 172.21.15.26:0/1836686100 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb4c15da50 con 0x7fcb4c15ca70 2023-10-14T11:13:19.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.466+0000 7fcb48ff9640 1 -- 172.21.15.26:0/1836686100 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcb44007070 con 0x7fcb4c15ca70 2023-10-14T11:13:19.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.466+0000 7fcb48ff9640 1 --2- 172.21.15.26:0/1836686100 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcb2c0664a0 0x7fcb2c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:19.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.466+0000 7fcb48ff9640 1 -- 172.21.15.26:0/1836686100 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcb440842b0 con 0x7fcb4c15ca70 2023-10-14T11:13:19.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.466+0000 7fcb4affd640 1 --2- 172.21.15.26:0/1836686100 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcb2c0664a0 0x7fcb2c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:19.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.466+0000 7fcb4affd640 1 --2- 172.21.15.26:0/1836686100 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcb2c0664a0 0x7fcb2c068960 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c06b340 tx=0x7fcb3c006f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:19.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.470+0000 7fcb48ff9640 1 -- 172.21.15.26:0/1836686100 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcb44051380 con 0x7fcb4c15ca70 2023-10-14T11:13:19.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.638+0000 7fcb5199d640 1 -- 172.21.15.26:0/1836686100 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcb4c074010 con 0x7fcb4c15ca70 2023-10-14T11:13:19.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.638+0000 7fcb48ff9640 1 -- 172.21.15.26:0/1836686100 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcb440549a0 con 0x7fcb4c15ca70 2023-10-14T11:13:19.644 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-10-14T11:13:19.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.638+0000 7fcb5199d640 1 -- 172.21.15.26:0/1836686100 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcb2c0664a0 msgr2=0x7fcb2c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:19.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.638+0000 7fcb5199d640 1 --2- 172.21.15.26:0/1836686100 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcb2c0664a0 0x7fcb2c068960 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c06b340 tx=0x7fcb3c006f90 comp rx=0 tx=0).stop 2023-10-14T11:13:19.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.638+0000 7fcb5199d640 1 -- 172.21.15.26:0/1836686100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb4c15ca70 msgr2=0x7fcb4c15b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:19.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.638+0000 7fcb5199d640 1 --2- 172.21.15.26:0/1836686100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb4c15ca70 0x7fcb4c15b580 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400cb40 tx=0x7fcb4400a060 comp rx=0 tx=0).stop 2023-10-14T11:13:19.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.638+0000 7fcb5199d640 1 -- 172.21.15.26:0/1836686100 shutdown_connections 2023-10-14T11:13:19.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.638+0000 7fcb5199d640 1 --2- 172.21.15.26:0/1836686100 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcb2c0664a0 0x7fcb2c068960 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.638+0000 7fcb5199d640 1 --2- 172.21.15.26:0/1836686100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb4c15ca70 0x7fcb4c15b580 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.638+0000 7fcb5199d640 1 --2- 172.21.15.26:0/1836686100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb4c0d3550 0x7fcb4c15b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.638+0000 7fcb5199d640 1 --2- 172.21.15.26:0/1836686100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb4c0cf5d0 0x7fcb4c1531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.638+0000 7fcb5199d640 1 -- 172.21.15.26:0/1836686100 >> 172.21.15.26:0/1836686100 conn(0x7fcb4c09bc50 msgr2=0x7fcb4c0c8970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:19.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.638+0000 7fcb5199d640 1 -- 172.21.15.26:0/1836686100 shutdown_connections 2023-10-14T11:13:19.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.638+0000 7fcb5199d640 1 -- 172.21.15.26:0/1836686100 wait complete. 2023-10-14T11:13:19.665 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:13:19.666 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:13:19.677 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:13:19.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.858+0000 7f471b2c9640 1 Processor -- start 2023-10-14T11:13:19.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.858+0000 7f471b2c9640 1 -- start start 2023-10-14T11:13:19.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.858+0000 7f471b2c9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f471415ca70 0x7f47140d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:19.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.858+0000 7f471b2c9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f47140cf7a0 0x7f47140c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:19.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.858+0000 7f471b2c9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47140c65f0 con 0x7f47140d3550 2023-10-14T11:13:19.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.858+0000 7f471b2c9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47140ce820 con 0x7f47140cf7a0 2023-10-14T11:13:19.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.858+0000 7f471b2c9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47140cdf80 con 0x7f471415ca70 2023-10-14T11:13:19.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.858+0000 7f4719866640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f47140cf7a0 0x7f47140c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:19.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.858+0000 7f4719866640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f47140cf7a0 0x7f47140c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38694/0 (socket says 172.21.15.26:38694) 2023-10-14T11:13:19.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.858+0000 7f4718864640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f47140d3550 0x7f47140cf090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45096/0 (socket says 172.21.15.26:45096) 2023-10-14T11:13:19.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.858+0000 7f4719866640 1 -- 172.21.15.26:0/251944161 learned_addr learned my addr 172.21.15.26:0/251944161 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:19.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.858+0000 7f4719065640 1 --2- 172.21.15.26:0/251944161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f471415ca70 0x7f47140d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:19.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.862+0000 7f4719866640 1 -- 172.21.15.26:0/251944161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f471415ca70 msgr2=0x7f47140d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:19.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.862+0000 7f4719866640 1 --2- 172.21.15.26:0/251944161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f471415ca70 0x7f47140d3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.862+0000 7f4719866640 1 -- 172.21.15.26:0/251944161 >> v1:172.21.15.26:6789/0 conn(0x7f47140d3550 legacy=0x7f47140cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:19.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.862+0000 7f4719866640 1 -- 172.21.15.26:0/251944161 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47140ce260 con 0x7f47140cf7a0 2023-10-14T11:13:19.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.862+0000 7f4719065640 1 --2- 172.21.15.26:0/251944161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f471415ca70 0x7f47140d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:19.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.862+0000 7f4719866640 1 --2- 172.21.15.26:0/251944161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47140cf7a0 0x7f47140c6ad0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f470c009e50 tx=0x7f470c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdab5bf50399c390 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:19.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.862+0000 7f470bfff640 1 -- 172.21.15.26:0/251944161 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c0a5810 con 0x7f47140cf7a0 2023-10-14T11:13:19.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.862+0000 7f470bfff640 1 -- 172.21.15.26:0/251944161 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470c0a5970 con 0x7f47140cf7a0 2023-10-14T11:13:19.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.862+0000 7f470bfff640 1 -- 172.21.15.26:0/251944161 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c0a5d00 con 0x7f47140cf7a0 2023-10-14T11:13:19.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.862+0000 7f471b2c9640 1 -- 172.21.15.26:0/251944161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47140cf7a0 msgr2=0x7f47140c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:19.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.862+0000 7f471b2c9640 1 --2- 172.21.15.26:0/251944161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47140cf7a0 0x7f47140c6ad0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f470c009e50 tx=0x7f470c01c9e0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.862+0000 7f471b2c9640 1 -- 172.21.15.26:0/251944161 shutdown_connections 2023-10-14T11:13:19.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.862+0000 7f471b2c9640 1 --2- 172.21.15.26:0/251944161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47140cf7a0 0x7f47140c6ad0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.862+0000 7f471b2c9640 1 --2- 172.21.15.26:0/251944161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f471415ca70 0x7f47140d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.862+0000 7f471b2c9640 1 -- 172.21.15.26:0/251944161 >> 172.21.15.26:0/251944161 conn(0x7f471409bc50 msgr2=0x7f47140d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:19.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f471b2c9640 1 -- 172.21.15.26:0/251944161 shutdown_connections 2023-10-14T11:13:19.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f471b2c9640 1 -- 172.21.15.26:0/251944161 wait complete. 2023-10-14T11:13:19.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f471b2c9640 1 Processor -- start 2023-10-14T11:13:19.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f471b2c9640 1 -- start start 2023-10-14T11:13:19.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f471b2c9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47140cf7a0 0x7f471414dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:19.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f471b2c9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47140d3550 0x7f47140b7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:19.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f471b2c9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f471415ca70 0x7f471415a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:19.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f471b2c9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47140b56b0 con 0x7f47140cf7a0 2023-10-14T11:13:19.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f471b2c9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471414e150 con 0x7f47140d3550 2023-10-14T11:13:19.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f471b2c9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471414f630 con 0x7f471415ca70 2023-10-14T11:13:19.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f4719065640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47140cf7a0 0x7f471414dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:19.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f4719065640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47140cf7a0 0x7f471414dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38702/0 (socket says 172.21.15.26:38702) 2023-10-14T11:13:19.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f4719065640 1 -- 172.21.15.26:0/3036392409 learned_addr learned my addr 172.21.15.26:0/3036392409 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:19.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f4719866640 1 --2- 172.21.15.26:0/3036392409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f471415ca70 0x7f471415a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:19.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f4718864640 1 --2- 172.21.15.26:0/3036392409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47140d3550 0x7f47140b7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:19.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f4719065640 1 -- 172.21.15.26:0/3036392409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f471415ca70 msgr2=0x7f471415a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:19.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f4719065640 1 --2- 172.21.15.26:0/3036392409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f471415ca70 0x7f471415a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f4719065640 1 -- 172.21.15.26:0/3036392409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47140d3550 msgr2=0x7f47140b7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:19.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f4719065640 1 --2- 172.21.15.26:0/3036392409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47140d3550 0x7f47140b7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:19.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f4719065640 1 -- 172.21.15.26:0/3036392409 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470c009b30 con 0x7f47140cf7a0 2023-10-14T11:13:19.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f4719065640 1 --2- 172.21.15.26:0/3036392409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47140cf7a0 0x7f471414dc10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f471000c7f0 tx=0x7f471000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:19.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f4709ffb640 1 -- 172.21.15.26:0/3036392409 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4710005ba0 con 0x7f47140cf7a0 2023-10-14T11:13:19.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f4709ffb640 1 -- 172.21.15.26:0/3036392409 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4710005d00 con 0x7f47140cf7a0 2023-10-14T11:13:19.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f4709ffb640 1 -- 172.21.15.26:0/3036392409 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4710006250 con 0x7f47140cf7a0 2023-10-14T11:13:19.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.866+0000 7f471b2c9640 1 -- 172.21.15.26:0/3036392409 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f471414ed90 con 0x7f47140cf7a0 2023-10-14T11:13:19.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.870+0000 7f471b2c9640 1 -- 172.21.15.26:0/3036392409 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f471414f350 con 0x7f47140cf7a0 2023-10-14T11:13:19.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.870+0000 7f471b2c9640 1 -- 172.21.15.26:0/3036392409 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f471415c410 con 0x7f47140cf7a0 2023-10-14T11:13:19.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.870+0000 7f4709ffb640 1 -- 172.21.15.26:0/3036392409 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f47100065c0 con 0x7f47140cf7a0 2023-10-14T11:13:19.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.870+0000 7f4709ffb640 1 --2- 172.21.15.26:0/3036392409 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f46f80664a0 0x7f46f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:19.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.870+0000 7f4709ffb640 1 -- 172.21.15.26:0/3036392409 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4710084390 con 0x7f47140cf7a0 2023-10-14T11:13:19.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.870+0000 7f4718864640 1 --2- 172.21.15.26:0/3036392409 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f46f80664a0 0x7f46f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:19.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.870+0000 7f4718864640 1 --2- 172.21.15.26:0/3036392409 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f46f80664a0 0x7f46f8068960 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4714150810 tx=0x7f4704007c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:19.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:19.874+0000 7f4709ffb640 1 -- 172.21.15.26:0/3036392409 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4710051440 con 0x7f47140cf7a0 2023-10-14T11:13:20.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.038+0000 7f471b2c9640 1 -- 172.21.15.26:0/3036392409 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4714074010 con 0x7f47140cf7a0 2023-10-14T11:13:20.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.038+0000 7f4709ffb640 1 -- 172.21.15.26:0/3036392409 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18679 (secure 0 0 0) 0x7f4710006870 con 0x7f47140cf7a0 2023-10-14T11:13:20.045 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:20.045 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":27,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:13:03.866737+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:13:20.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.042+0000 7f471b2c9640 1 -- 172.21.15.26:0/3036392409 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f46f80664a0 msgr2=0x7f46f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:20.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.042+0000 7f471b2c9640 1 --2- 172.21.15.26:0/3036392409 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f46f80664a0 0x7f46f8068960 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4714150810 tx=0x7f4704007c90 comp rx=0 tx=0).stop 2023-10-14T11:13:20.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.042+0000 7f471b2c9640 1 -- 172.21.15.26:0/3036392409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47140cf7a0 msgr2=0x7f471414dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:20.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.042+0000 7f471b2c9640 1 --2- 172.21.15.26:0/3036392409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47140cf7a0 0x7f471414dc10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f471000c7f0 tx=0x7f471000ccb0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.042+0000 7f471b2c9640 1 -- 172.21.15.26:0/3036392409 shutdown_connections 2023-10-14T11:13:20.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.042+0000 7f471b2c9640 1 --2- 172.21.15.26:0/3036392409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f471415ca70 0x7f471415a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.042+0000 7f471b2c9640 1 --2- 172.21.15.26:0/3036392409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47140d3550 0x7f47140b7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.042+0000 7f471b2c9640 1 --2- 172.21.15.26:0/3036392409 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f46f80664a0 0x7f46f8068960 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.042+0000 7f471b2c9640 1 --2- 172.21.15.26:0/3036392409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47140cf7a0 0x7f471414dc10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.042+0000 7f471b2c9640 1 -- 172.21.15.26:0/3036392409 >> 172.21.15.26:0/3036392409 conn(0x7f471409bc50 msgr2=0x7f47140ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:20.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.042+0000 7f471b2c9640 1 -- 172.21.15.26:0/3036392409 shutdown_connections 2023-10-14T11:13:20.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.042+0000 7f471b2c9640 1 -- 172.21.15.26:0/3036392409 wait complete. 2023-10-14T11:13:20.067 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:12:20.179562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:12:21.346111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T11:12:25.025159+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T11:13:20.068 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:13:20.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.210+0000 7fb888d3e640 1 Processor -- start 2023-10-14T11:13:20.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.210+0000 7fb888d3e640 1 -- start start 2023-10-14T11:13:20.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.210+0000 7fb888d3e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb88406df40 0x7fb8840702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:20.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.210+0000 7fb888d3e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb884070830 0x7fb8840cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:20.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.210+0000 7fb888d3e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb884070c60 con 0x7fb8841590d0 2023-10-14T11:13:20.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.210+0000 7fb888d3e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8840c9600 con 0x7fb88406df40 2023-10-14T11:13:20.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.210+0000 7fb888d3e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8840c98e0 con 0x7fb884070830 2023-10-14T11:13:20.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.210+0000 7fb881d9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb88406df40 0x7fb8840702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:20.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.210+0000 7fb881d9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb88406df40 0x7fb8840702f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38714/0 (socket says 172.21.15.26:38714) 2023-10-14T11:13:20.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.210+0000 7fb881d9b640 1 -- 172.21.15.26:0/1839945851 learned_addr learned my addr 172.21.15.26:0/1839945851 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:20.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.210+0000 7fb882d9d640 1 --2- 172.21.15.26:0/1839945851 >> v2:172.21.15.110:3300/0 conn(0x7fb884070830 0x7fb8840cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:20.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.210+0000 7fb881d9b640 1 -- 172.21.15.26:0/1839945851 >> v2:172.21.15.110:3300/0 conn(0x7fb884070830 msgr2=0x7fb8840cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:20.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.210+0000 7fb881d9b640 1 --2- 172.21.15.26:0/1839945851 >> v2:172.21.15.110:3300/0 conn(0x7fb884070830 0x7fb8840cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.210+0000 7fb881d9b640 1 -- 172.21.15.26:0/1839945851 >> v1:172.21.15.110:6789/0 conn(0x7fb8841590d0 legacy=0x7fb8840c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:20.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.210+0000 7fb881d9b640 1 -- 172.21.15.26:0/1839945851 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8840c9bc0 con 0x7fb88406df40 2023-10-14T11:13:20.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.214+0000 7fb881d9b640 1 --2- 172.21.15.26:0/1839945851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb88406df40 0x7fb8840702f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb8840adc40 tx=0x7fb87801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e46e898098fe84 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:20.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.214+0000 7fb88159a640 1 -- 172.21.15.26:0/1839945851 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8780ab650 con 0x7fb88406df40 2023-10-14T11:13:20.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.214+0000 7fb88159a640 1 -- 172.21.15.26:0/1839945851 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8780ab7b0 con 0x7fb88406df40 2023-10-14T11:13:20.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.214+0000 7fb88159a640 1 -- 172.21.15.26:0/1839945851 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8780abb40 con 0x7fb88406df40 2023-10-14T11:13:20.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.214+0000 7fb888d3e640 1 -- 172.21.15.26:0/1839945851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb88406df40 msgr2=0x7fb8840702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:20.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.214+0000 7fb888d3e640 1 --2- 172.21.15.26:0/1839945851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb88406df40 0x7fb8840702f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb8840adc40 tx=0x7fb87801c4d0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.214+0000 7fb888d3e640 1 -- 172.21.15.26:0/1839945851 shutdown_connections 2023-10-14T11:13:20.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.214+0000 7fb888d3e640 1 --2- 172.21.15.26:0/1839945851 >> v2:172.21.15.110:3300/0 conn(0x7fb884070830 0x7fb8840cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.214+0000 7fb888d3e640 1 --2- 172.21.15.26:0/1839945851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb88406df40 0x7fb8840702f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.214+0000 7fb888d3e640 1 -- 172.21.15.26:0/1839945851 >> 172.21.15.26:0/1839945851 conn(0x7fb8840b0da0 msgr2=0x7fb8840ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:20.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.214+0000 7fb888d3e640 1 -- 172.21.15.26:0/1839945851 shutdown_connections 2023-10-14T11:13:20.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.214+0000 7fb888d3e640 1 -- 172.21.15.26:0/1839945851 wait complete. 2023-10-14T11:13:20.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb888d3e640 1 Processor -- start 2023-10-14T11:13:20.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb888d3e640 1 -- start start 2023-10-14T11:13:20.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb888d3e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb88406df40 0x7fb8840b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:20.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb888d3e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb884070830 0x7fb8840c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:20.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb888d3e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8841590d0 0x7fb88414c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:20.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb888d3e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8840b2ee0 con 0x7fb88406df40 2023-10-14T11:13:20.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb888d3e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8840b31c0 con 0x7fb884070830 2023-10-14T11:13:20.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb888d3e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8840b34a0 con 0x7fb8841590d0 2023-10-14T11:13:20.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb88259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb88406df40 0x7fb8840b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:20.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb88259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb88406df40 0x7fb8840b3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38724/0 (socket says 172.21.15.26:38724) 2023-10-14T11:13:20.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb88259c640 1 -- 172.21.15.26:0/4268757450 learned_addr learned my addr 172.21.15.26:0/4268757450 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:20.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb881d9b640 1 --2- 172.21.15.26:0/4268757450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb884070830 0x7fb8840c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:20.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb882d9d640 1 --2- 172.21.15.26:0/4268757450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8841590d0 0x7fb88414c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:20.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb88259c640 1 -- 172.21.15.26:0/4268757450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8841590d0 msgr2=0x7fb88414c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:20.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb88259c640 1 --2- 172.21.15.26:0/4268757450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8841590d0 0x7fb88414c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb88259c640 1 -- 172.21.15.26:0/4268757450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb884070830 msgr2=0x7fb8840c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:20.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb88259c640 1 --2- 172.21.15.26:0/4268757450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb884070830 0x7fb8840c3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb88259c640 1 -- 172.21.15.26:0/4268757450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8780094d0 con 0x7fb88406df40 2023-10-14T11:13:20.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb881d9b640 1 --2- 172.21.15.26:0/4268757450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb884070830 0x7fb8840c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:20.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb88259c640 1 --2- 172.21.15.26:0/4268757450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb88406df40 0x7fb8840b3f80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb87400c500 tx=0x7fb87400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:20.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb872ffd640 1 -- 172.21.15.26:0/4268757450 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874005220 con 0x7fb88406df40 2023-10-14T11:13:20.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb872ffd640 1 -- 172.21.15.26:0/4268757450 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb874005380 con 0x7fb88406df40 2023-10-14T11:13:20.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb872ffd640 1 -- 172.21.15.26:0/4268757450 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874007270 con 0x7fb88406df40 2023-10-14T11:13:20.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb888d3e640 1 -- 172.21.15.26:0/4268757450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8840ca820 con 0x7fb88406df40 2023-10-14T11:13:20.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb888d3e640 1 -- 172.21.15.26:0/4268757450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8840b3a60 con 0x7fb88406df40 2023-10-14T11:13:20.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.218+0000 7fb888d3e640 1 -- 172.21.15.26:0/4268757450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb88404e170 con 0x7fb88406df40 2023-10-14T11:13:20.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.222+0000 7fb872ffd640 1 -- 172.21.15.26:0/4268757450 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb8740073d0 con 0x7fb88406df40 2023-10-14T11:13:20.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.222+0000 7fb872ffd640 1 --2- 172.21.15.26:0/4268757450 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb8640664a0 0x7fb864068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:20.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.222+0000 7fb872ffd640 1 -- 172.21.15.26:0/4268757450 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb874083ac0 con 0x7fb88406df40 2023-10-14T11:13:20.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.222+0000 7fb881d9b640 1 --2- 172.21.15.26:0/4268757450 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb8640664a0 0x7fb864068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:20.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.222+0000 7fb881d9b640 1 --2- 172.21.15.26:0/4268757450 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb8640664a0 0x7fb864068960 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb8780af000 tx=0x7fb8780a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:20.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.226+0000 7fb872ffd640 1 -- 172.21.15.26:0/4268757450 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb874050b70 con 0x7fb88406df40 2023-10-14T11:13:20.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.382+0000 7fb888d3e640 1 -- 172.21.15.26:0/4268757450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb884071270 con 0x7fb88406df40 2023-10-14T11:13:20.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.386+0000 7fb872ffd640 1 -- 172.21.15.26:0/4268757450 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb874054190 con 0x7fb88406df40 2023-10-14T11:13:20.391 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:13:20.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.386+0000 7fb888d3e640 1 -- 172.21.15.26:0/4268757450 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb8640664a0 msgr2=0x7fb864068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:20.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.386+0000 7fb888d3e640 1 --2- 172.21.15.26:0/4268757450 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb8640664a0 0x7fb864068960 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb8780af000 tx=0x7fb8780a7000 comp rx=0 tx=0).stop 2023-10-14T11:13:20.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.386+0000 7fb888d3e640 1 -- 172.21.15.26:0/4268757450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb88406df40 msgr2=0x7fb8840b3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:20.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.386+0000 7fb888d3e640 1 --2- 172.21.15.26:0/4268757450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb88406df40 0x7fb8840b3f80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb87400c500 tx=0x7fb87400c9c0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.386+0000 7fb888d3e640 1 -- 172.21.15.26:0/4268757450 shutdown_connections 2023-10-14T11:13:20.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.386+0000 7fb888d3e640 1 --2- 172.21.15.26:0/4268757450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8841590d0 0x7fb88414c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.386+0000 7fb888d3e640 1 --2- 172.21.15.26:0/4268757450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb884070830 0x7fb8840c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.386+0000 7fb888d3e640 1 --2- 172.21.15.26:0/4268757450 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb8640664a0 0x7fb864068960 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.386+0000 7fb888d3e640 1 --2- 172.21.15.26:0/4268757450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb88406df40 0x7fb8840b3f80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.386+0000 7fb888d3e640 1 -- 172.21.15.26:0/4268757450 >> 172.21.15.26:0/4268757450 conn(0x7fb8840b0da0 msgr2=0x7fb8840ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:20.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.386+0000 7fb888d3e640 1 -- 172.21.15.26:0/4268757450 shutdown_connections 2023-10-14T11:13:20.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.386+0000 7fb888d3e640 1 -- 172.21.15.26:0/4268757450 wait complete. 2023-10-14T11:13:20.412 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:13:20.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.550+0000 7f18552f7640 1 Processor -- start 2023-10-14T11:13:20.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.550+0000 7f18552f7640 1 -- start start 2023-10-14T11:13:20.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.554+0000 7f18552f7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18500cc630 0x7f18500cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:20.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.554+0000 7f18552f7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f18500cd330 0x7f185015fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:20.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.554+0000 7f18552f7640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f185006c3a0 con 0x7f18500cced0 2023-10-14T11:13:20.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.554+0000 7f18552f7640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185006b4f0 con 0x7f18500cd330 2023-10-14T11:13:20.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.554+0000 7f18552f7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185006b790 con 0x7f18500cc630 2023-10-14T11:13:20.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.554+0000 7f184f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f18500cd330 0x7f185015fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:20.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.554+0000 7f1847fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f18500cced0 0x7f185015f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45104/0 (socket says 172.21.15.26:45104) 2023-10-14T11:13:20.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.554+0000 7f1847fff640 1 -- 172.21.15.26:0/3801881996 learned_addr learned my addr 172.21.15.26:0/3801881996 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:20.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.554+0000 7f184effd640 1 --2- 172.21.15.26:0/3801881996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18500cc630 0x7f18500cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:20.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.554+0000 7f184f7fe640 1 -- 172.21.15.26:0/3801881996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18500cc630 msgr2=0x7f18500cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:20.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.554+0000 7f184f7fe640 1 --2- 172.21.15.26:0/3801881996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18500cc630 0x7f18500cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.554+0000 7f184f7fe640 1 -- 172.21.15.26:0/3801881996 >> v1:172.21.15.26:6789/0 conn(0x7f18500cced0 legacy=0x7f185015f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:20.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.554+0000 7f184f7fe640 1 -- 172.21.15.26:0/3801881996 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185006ba70 con 0x7f18500cd330 2023-10-14T11:13:20.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.554+0000 7f184e7fc640 1 -- 172.21.15.26:0/3801881996 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818403025 0 0) 0x7f185006c3a0 con 0x7f18500cced0 2023-10-14T11:13:20.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.558+0000 7f184f7fe640 1 --2- 172.21.15.26:0/3801881996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18500cd330 0x7f185015fdf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1848009d90 tx=0x7f184801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e6fba8878f641b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:20.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.558+0000 7f184e7fc640 1 -- 172.21.15.26:0/3801881996 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18480a5950 con 0x7f18500cd330 2023-10-14T11:13:20.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.558+0000 7f184e7fc640 1 -- 172.21.15.26:0/3801881996 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18480a5ab0 con 0x7f18500cd330 2023-10-14T11:13:20.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.558+0000 7f184e7fc640 1 -- 172.21.15.26:0/3801881996 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18480a5e40 con 0x7f18500cd330 2023-10-14T11:13:20.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.558+0000 7f18552f7640 1 -- 172.21.15.26:0/3801881996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18500cd330 msgr2=0x7f185015fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:20.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.558+0000 7f18552f7640 1 --2- 172.21.15.26:0/3801881996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18500cd330 0x7f185015fdf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1848009d90 tx=0x7f184801c890 comp rx=0 tx=0).stop 2023-10-14T11:13:20.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.558+0000 7f18552f7640 1 -- 172.21.15.26:0/3801881996 shutdown_connections 2023-10-14T11:13:20.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.558+0000 7f18552f7640 1 --2- 172.21.15.26:0/3801881996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18500cd330 0x7f185015fdf0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.558+0000 7f18552f7640 1 --2- 172.21.15.26:0/3801881996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18500cc630 0x7f18500cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.558+0000 7f18552f7640 1 -- 172.21.15.26:0/3801881996 >> 172.21.15.26:0/3801881996 conn(0x7f18500d0650 msgr2=0x7f18500d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:20.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.558+0000 7f18552f7640 1 -- 172.21.15.26:0/3801881996 shutdown_connections 2023-10-14T11:13:20.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.558+0000 7f18552f7640 1 -- 172.21.15.26:0/3801881996 wait complete. 2023-10-14T11:13:20.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.558+0000 7f18552f7640 1 Processor -- start 2023-10-14T11:13:20.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.558+0000 7f18552f7640 1 -- start start 2023-10-14T11:13:20.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f18552f7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18500cc630 0x7f1850156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:20.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f18552f7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18500cced0 0x7f1850154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:20.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f18552f7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18500cd330 0x7f18500aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:20.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f18552f7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18500b0160 con 0x7f18500cc630 2023-10-14T11:13:20.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f18552f7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1850154ae0 con 0x7f18500cced0 2023-10-14T11:13:20.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f18552f7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1850154d80 con 0x7f18500cd330 2023-10-14T11:13:20.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f184effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18500cc630 0x7f1850156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:20.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f184effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18500cc630 0x7f1850156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38738/0 (socket says 172.21.15.26:38738) 2023-10-14T11:13:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f184effd640 1 -- 172.21.15.26:0/1052768326 learned_addr learned my addr 172.21.15.26:0/1052768326 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f1847fff640 1 --2- 172.21.15.26:0/1052768326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18500cced0 0x7f1850154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f184f7fe640 1 --2- 172.21.15.26:0/1052768326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18500cd330 0x7f18500aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f184effd640 1 -- 172.21.15.26:0/1052768326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18500cd330 msgr2=0x7f18500aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:20.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f184effd640 1 --2- 172.21.15.26:0/1052768326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18500cd330 0x7f18500aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f184effd640 1 -- 172.21.15.26:0/1052768326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18500cced0 msgr2=0x7f1850154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:20.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f184effd640 1 --2- 172.21.15.26:0/1052768326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18500cced0 0x7f1850154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f184effd640 1 -- 172.21.15.26:0/1052768326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1848009a70 con 0x7f18500cc630 2023-10-14T11:13:20.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f184f7fe640 1 --2- 172.21.15.26:0/1052768326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18500cd330 0x7f18500aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:20.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f184effd640 1 --2- 172.21.15.26:0/1052768326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18500cc630 0x7f1850156b30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f184000d5f0 tx=0x7f184000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:20.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f18477fe640 1 -- 172.21.15.26:0/1052768326 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18400125f0 con 0x7f18500cc630 2023-10-14T11:13:20.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f18477fe640 1 -- 172.21.15.26:0/1052768326 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1840012750 con 0x7f18500cc630 2023-10-14T11:13:20.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f18477fe640 1 -- 172.21.15.26:0/1052768326 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1840012ae0 con 0x7f18500cc630 2023-10-14T11:13:20.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f18552f7640 1 -- 172.21.15.26:0/1052768326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1850155060 con 0x7f18500cc630 2023-10-14T11:13:20.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f18552f7640 1 -- 172.21.15.26:0/1052768326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18500af2f0 con 0x7f18500cc630 2023-10-14T11:13:20.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f18552f7640 1 -- 172.21.15.26:0/1052768326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1850073fa0 con 0x7f18500cc630 2023-10-14T11:13:20.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.562+0000 7f18477fe640 1 -- 172.21.15.26:0/1052768326 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1840012c40 con 0x7f18500cc630 2023-10-14T11:13:20.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.566+0000 7f18477fe640 1 --2- 172.21.15.26:0/1052768326 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f18300664a0 0x7f1830068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:20.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.566+0000 7f18477fe640 1 -- 172.21.15.26:0/1052768326 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1840084780 con 0x7f18500cc630 2023-10-14T11:13:20.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.566+0000 7f1847fff640 1 --2- 172.21.15.26:0/1052768326 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f18300664a0 0x7f1830068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:20.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.566+0000 7f1847fff640 1 --2- 172.21.15.26:0/1052768326 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f18300664a0 0x7f1830068960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f18500b64a0 tx=0x7f1838007b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.570+0000 7f18477fe640 1 -- 172.21.15.26:0/1052768326 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f18400517a0 con 0x7f18500cc630 2023-10-14T11:13:20.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.726+0000 7f18552f7640 1 -- 172.21.15.26:0/1052768326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f18500d12c0 con 0x7f18500cc630 2023-10-14T11:13:20.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.726+0000 7f18477fe640 1 -- 172.21.15.26:0/1052768326 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1840007380 con 0x7f18500cc630 2023-10-14T11:13:20.731 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:20.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.726+0000 7f18552f7640 1 -- 172.21.15.26:0/1052768326 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f18300664a0 msgr2=0x7f1830068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:20.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.726+0000 7f18552f7640 1 --2- 172.21.15.26:0/1052768326 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f18300664a0 0x7f1830068960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f18500b64a0 tx=0x7f1838007b60 comp rx=0 tx=0).stop 2023-10-14T11:13:20.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.726+0000 7f18552f7640 1 -- 172.21.15.26:0/1052768326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18500cc630 msgr2=0x7f1850156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:20.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.726+0000 7f18552f7640 1 --2- 172.21.15.26:0/1052768326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18500cc630 0x7f1850156b30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f184000d5f0 tx=0x7f184000dab0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.726+0000 7f18552f7640 1 -- 172.21.15.26:0/1052768326 shutdown_connections 2023-10-14T11:13:20.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.726+0000 7f18552f7640 1 --2- 172.21.15.26:0/1052768326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18500cd330 0x7f18500aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.726+0000 7f18552f7640 1 --2- 172.21.15.26:0/1052768326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18500cced0 0x7f1850154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.726+0000 7f18552f7640 1 --2- 172.21.15.26:0/1052768326 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f18300664a0 0x7f1830068960 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.726+0000 7f18552f7640 1 --2- 172.21.15.26:0/1052768326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18500cc630 0x7f1850156b30 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.726+0000 7f18552f7640 1 -- 172.21.15.26:0/1052768326 >> 172.21.15.26:0/1052768326 conn(0x7f18500d0650 msgr2=0x7f185015f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:20.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.726+0000 7f18552f7640 1 -- 172.21.15.26:0/1052768326 shutdown_connections 2023-10-14T11:13:20.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.726+0000 7f18552f7640 1 -- 172.21.15.26:0/1052768326 wait complete. 2023-10-14T11:13:20.753 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:13:20.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.894+0000 7fbd47e17640 1 Processor -- start 2023-10-14T11:13:20.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.894+0000 7fbd47e17640 1 -- start start 2023-10-14T11:13:20.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.894+0000 7fbd47e17640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd4006a0f0 0x7fbd400c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:20.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.894+0000 7fbd47e17640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd4006a4d0 0x7fbd400ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:20.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.894+0000 7fbd47e17640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbd40164dc0 0x7fbd400ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:20.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.894+0000 7fbd47e17640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4006c6d0 con 0x7fbd4006a4d0 2023-10-14T11:13:20.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.894+0000 7fbd47e17640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4006c950 con 0x7fbd40164dc0 2023-10-14T11:13:20.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.894+0000 7fbd47e17640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd401654f0 con 0x7fbd4006a0f0 2023-10-14T11:13:20.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.894+0000 7fbd453b2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd4006a4d0 0x7fbd400ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:20.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.894+0000 7fbd453b2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd4006a4d0 0x7fbd400ccd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38750/0 (socket says 172.21.15.26:38750) 2023-10-14T11:13:20.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.894+0000 7fbd453b2640 1 -- 172.21.15.26:0/3947544516 learned_addr learned my addr 172.21.15.26:0/3947544516 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:20.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.894+0000 7fbd45bb3640 1 --2- 172.21.15.26:0/3947544516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd4006a0f0 0x7fbd400c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:20.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.894+0000 7fbd463b4640 1 --2- 172.21.15.26:0/3947544516 >> v2:172.21.15.110:3300/0 conn(0x7fbd40164dc0 0x7fbd400ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:20.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.894+0000 7fbd453b2640 1 -- 172.21.15.26:0/3947544516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd4006a0f0 msgr2=0x7fbd400c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:20.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.894+0000 7fbd453b2640 1 --2- 172.21.15.26:0/3947544516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd4006a0f0 0x7fbd400c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.894+0000 7fbd453b2640 1 -- 172.21.15.26:0/3947544516 >> v2:172.21.15.110:3300/0 conn(0x7fbd40164dc0 msgr2=0x7fbd400ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:20.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.894+0000 7fbd453b2640 1 --2- 172.21.15.26:0/3947544516 >> v2:172.21.15.110:3300/0 conn(0x7fbd40164dc0 0x7fbd400ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.894+0000 7fbd453b2640 1 -- 172.21.15.26:0/3947544516 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd401657d0 con 0x7fbd4006a4d0 2023-10-14T11:13:20.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.894+0000 7fbd45bb3640 1 --2- 172.21.15.26:0/3947544516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd4006a0f0 0x7fbd400c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:20.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.898+0000 7fbd453b2640 1 --2- 172.21.15.26:0/3947544516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd4006a4d0 0x7fbd400ccd00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbd400c1d80 tx=0x7fbd3001ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38bc786ed81c5a95 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:20.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.898+0000 7fbd44bb1640 1 -- 172.21.15.26:0/3947544516 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd300ab650 con 0x7fbd4006a4d0 2023-10-14T11:13:20.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.898+0000 7fbd44bb1640 1 -- 172.21.15.26:0/3947544516 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd300ab7b0 con 0x7fbd4006a4d0 2023-10-14T11:13:20.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.898+0000 7fbd44bb1640 1 -- 172.21.15.26:0/3947544516 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd300abb40 con 0x7fbd4006a4d0 2023-10-14T11:13:20.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.898+0000 7fbd47e17640 1 -- 172.21.15.26:0/3947544516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd4006a4d0 msgr2=0x7fbd400ccd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:20.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.898+0000 7fbd47e17640 1 --2- 172.21.15.26:0/3947544516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd4006a4d0 0x7fbd400ccd00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbd400c1d80 tx=0x7fbd3001ced0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.898+0000 7fbd47e17640 1 -- 172.21.15.26:0/3947544516 shutdown_connections 2023-10-14T11:13:20.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.898+0000 7fbd47e17640 1 --2- 172.21.15.26:0/3947544516 >> v2:172.21.15.110:3300/0 conn(0x7fbd40164dc0 0x7fbd400ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.898+0000 7fbd47e17640 1 --2- 172.21.15.26:0/3947544516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd4006a4d0 0x7fbd400ccd00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.898+0000 7fbd47e17640 1 --2- 172.21.15.26:0/3947544516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd4006a0f0 0x7fbd400c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.898+0000 7fbd47e17640 1 -- 172.21.15.26:0/3947544516 >> 172.21.15.26:0/3947544516 conn(0x7fbd400b0da0 msgr2=0x7fbd400ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:20.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.898+0000 7fbd47e17640 1 -- 172.21.15.26:0/3947544516 shutdown_connections 2023-10-14T11:13:20.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.898+0000 7fbd47e17640 1 -- 172.21.15.26:0/3947544516 wait complete. 2023-10-14T11:13:20.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd47e17640 1 Processor -- start 2023-10-14T11:13:20.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd47e17640 1 -- start start 2023-10-14T11:13:20.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd47e17640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd4006a0f0 0x7fbd40158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:20.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd47e17640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd4006a4d0 0x7fbd4015f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:20.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd47e17640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd40164dc0 0x7fbd40151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:20.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd47e17640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd40153000 con 0x7fbd4006a4d0 2023-10-14T11:13:20.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd47e17640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd401523f0 con 0x7fbd4006a0f0 2023-10-14T11:13:20.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd47e17640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd401526d0 con 0x7fbd40164dc0 2023-10-14T11:13:20.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd453b2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd4006a4d0 0x7fbd4015f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:20.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd453b2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd4006a4d0 0x7fbd4015f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38764/0 (socket says 172.21.15.26:38764) 2023-10-14T11:13:20.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd453b2640 1 -- 172.21.15.26:0/1866153008 learned_addr learned my addr 172.21.15.26:0/1866153008 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:20.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd45bb3640 1 --2- 172.21.15.26:0/1866153008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd4006a0f0 0x7fbd40158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:20.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd463b4640 1 --2- 172.21.15.26:0/1866153008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd40164dc0 0x7fbd40151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:20.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd453b2640 1 -- 172.21.15.26:0/1866153008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd40164dc0 msgr2=0x7fbd40151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:20.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd453b2640 1 --2- 172.21.15.26:0/1866153008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd40164dc0 0x7fbd40151620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd453b2640 1 -- 172.21.15.26:0/1866153008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd4006a0f0 msgr2=0x7fbd40158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:20.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd453b2640 1 --2- 172.21.15.26:0/1866153008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd4006a0f0 0x7fbd40158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:20.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd453b2640 1 -- 172.21.15.26:0/1866153008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd300094d0 con 0x7fbd4006a4d0 2023-10-14T11:13:20.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd45bb3640 1 --2- 172.21.15.26:0/1866153008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd4006a0f0 0x7fbd40158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:20.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd453b2640 1 --2- 172.21.15.26:0/1866153008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd4006a4d0 0x7fbd4015f810 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbd300ad040 tx=0x7fbd3001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:20.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd367fc640 1 -- 172.21.15.26:0/1866153008 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd300b4800 con 0x7fbd4006a4d0 2023-10-14T11:13:20.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd367fc640 1 -- 172.21.15.26:0/1866153008 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd300b4980 con 0x7fbd4006a4d0 2023-10-14T11:13:20.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd367fc640 1 -- 172.21.15.26:0/1866153008 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd300b4d30 con 0x7fbd4006a4d0 2023-10-14T11:13:20.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd47e17640 1 -- 172.21.15.26:0/1866153008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd401529b0 con 0x7fbd4006a4d0 2023-10-14T11:13:20.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd47e17640 1 -- 172.21.15.26:0/1866153008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd40153ad0 con 0x7fbd4006a4d0 2023-10-14T11:13:20.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.902+0000 7fbd47e17640 1 -- 172.21.15.26:0/1866153008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd40153170 con 0x7fbd4006a4d0 2023-10-14T11:13:20.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.906+0000 7fbd367fc640 1 -- 172.21.15.26:0/1866153008 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbd300c7440 con 0x7fbd4006a4d0 2023-10-14T11:13:20.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.906+0000 7fbd367fc640 1 --2- 172.21.15.26:0/1866153008 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd240664d0 0x7fbd24068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:20.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.906+0000 7fbd367fc640 1 -- 172.21.15.26:0/1866153008 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbd3011ee20 con 0x7fbd4006a4d0 2023-10-14T11:13:20.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.906+0000 7fbd45bb3640 1 --2- 172.21.15.26:0/1866153008 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd240664d0 0x7fbd24068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:20.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.906+0000 7fbd45bb3640 1 --2- 172.21.15.26:0/1866153008 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd240664d0 0x7fbd24068990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00c940 tx=0x7fbd3c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:20.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:20.910+0000 7fbd367fc640 1 -- 172.21.15.26:0/1866153008 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbd300ebff0 con 0x7fbd4006a4d0 2023-10-14T11:13:21.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.066+0000 7fbd47e17640 1 -- 172.21.15.26:0/1866153008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd4004e170 con 0x7fbd4006a4d0 2023-10-14T11:13:21.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.066+0000 7fbd367fc640 1 -- 172.21.15.26:0/1866153008 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbd300ef610 con 0x7fbd4006a4d0 2023-10-14T11:13:21.073 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:13:21.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.070+0000 7fbd47e17640 1 -- 172.21.15.26:0/1866153008 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd240664d0 msgr2=0x7fbd24068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:21.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.070+0000 7fbd47e17640 1 --2- 172.21.15.26:0/1866153008 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd240664d0 0x7fbd24068990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00c940 tx=0x7fbd3c008040 comp rx=0 tx=0).stop 2023-10-14T11:13:21.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.070+0000 7fbd47e17640 1 -- 172.21.15.26:0/1866153008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd4006a4d0 msgr2=0x7fbd4015f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:21.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.070+0000 7fbd47e17640 1 --2- 172.21.15.26:0/1866153008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd4006a4d0 0x7fbd4015f810 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbd300ad040 tx=0x7fbd3001acb0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.070+0000 7fbd47e17640 1 -- 172.21.15.26:0/1866153008 shutdown_connections 2023-10-14T11:13:21.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.070+0000 7fbd47e17640 1 --2- 172.21.15.26:0/1866153008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd40164dc0 0x7fbd40151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.070+0000 7fbd47e17640 1 --2- 172.21.15.26:0/1866153008 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd240664d0 0x7fbd24068990 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.070+0000 7fbd47e17640 1 --2- 172.21.15.26:0/1866153008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd4006a4d0 0x7fbd4015f810 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.070+0000 7fbd47e17640 1 --2- 172.21.15.26:0/1866153008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd4006a0f0 0x7fbd40158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.070+0000 7fbd47e17640 1 -- 172.21.15.26:0/1866153008 >> 172.21.15.26:0/1866153008 conn(0x7fbd400b0da0 msgr2=0x7fbd400ae1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:21.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.070+0000 7fbd47e17640 1 -- 172.21.15.26:0/1866153008 shutdown_connections 2023-10-14T11:13:21.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.070+0000 7fbd47e17640 1 -- 172.21.15.26:0/1866153008 wait complete. 2023-10-14T11:13:21.095 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T11:13:21.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.234+0000 7f2cc7068640 1 Processor -- start 2023-10-14T11:13:21.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.234+0000 7f2cc7068640 1 -- start start 2023-10-14T11:13:21.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.234+0000 7f2cc7068640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2cc006e260 0x7f2cc00b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:21.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.238+0000 7f2cc7068640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc00b4600 con 0x7f2cc006a5a0 2023-10-14T11:13:21.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.238+0000 7f2cc7068640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc00c8dd0 con 0x7f2cc0159900 2023-10-14T11:13:21.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.238+0000 7f2cc7068640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc00cd740 con 0x7f2cc006e260 2023-10-14T11:13:21.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.238+0000 7f2cbffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2cc006a5a0 0x7f2cc00c9b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45106/0 (socket says 172.21.15.26:45106) 2023-10-14T11:13:21.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.238+0000 7f2cbffff640 1 -- 172.21.15.26:0/1483247834 learned_addr learned my addr 172.21.15.26:0/1483247834 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:21.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.238+0000 7f2cc5605640 1 --2- 172.21.15.26:0/1483247834 >> v2:172.21.15.26:3300/0 conn(0x7f2cc006e260 0x7f2cc00b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:21.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.238+0000 7f2cc5605640 1 -- 172.21.15.26:0/1483247834 >> v1:172.21.15.110:6789/0 conn(0x7f2cc0159900 legacy=0x7f2cc0069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:21.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.238+0000 7f2cc5605640 1 -- 172.21.15.26:0/1483247834 >> v1:172.21.15.26:6789/0 conn(0x7f2cc006a5a0 legacy=0x7f2cc00c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:21.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.238+0000 7f2cc5605640 1 -- 172.21.15.26:0/1483247834 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc00c90b0 con 0x7f2cc006e260 2023-10-14T11:13:21.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.238+0000 7f2cc5605640 1 --2- 172.21.15.26:0/1483247834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc006e260 0x7f2cc00b3f00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009d90 tx=0x7f2cb801c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f57c20eb7e2223 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:21.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.238+0000 7f2cbf7fe640 1 -- 172.21.15.26:0/1483247834 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb80a5840 con 0x7f2cc006e260 2023-10-14T11:13:21.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.238+0000 7f2cbf7fe640 1 -- 172.21.15.26:0/1483247834 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb80a59a0 con 0x7f2cc006e260 2023-10-14T11:13:21.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.238+0000 7f2cbf7fe640 1 -- 172.21.15.26:0/1483247834 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb80a5d30 con 0x7f2cc006e260 2023-10-14T11:13:21.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.242+0000 7f2cc7068640 1 -- 172.21.15.26:0/1483247834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc006e260 msgr2=0x7f2cc00b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:21.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.242+0000 7f2cc7068640 1 --2- 172.21.15.26:0/1483247834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc006e260 0x7f2cc00b3f00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009d90 tx=0x7f2cb801c7a0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.242+0000 7f2cc7068640 1 -- 172.21.15.26:0/1483247834 shutdown_connections 2023-10-14T11:13:21.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.242+0000 7f2cc7068640 1 --2- 172.21.15.26:0/1483247834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc006e260 0x7f2cc00b3f00 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.242+0000 7f2cc7068640 1 -- 172.21.15.26:0/1483247834 >> 172.21.15.26:0/1483247834 conn(0x7f2cc00b0da0 msgr2=0x7f2cc00ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:21.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.242+0000 7f2cc7068640 1 -- 172.21.15.26:0/1483247834 shutdown_connections 2023-10-14T11:13:21.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.242+0000 7f2cc7068640 1 -- 172.21.15.26:0/1483247834 wait complete. 2023-10-14T11:13:21.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.242+0000 7f2cc7068640 1 Processor -- start 2023-10-14T11:13:21.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.242+0000 7f2cc7068640 1 -- start start 2023-10-14T11:13:21.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.242+0000 7f2cc7068640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cc006a5a0 0x7f2cc0157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:21.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.242+0000 7f2cc7068640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cc006e260 0x7f2cc015a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:21.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.242+0000 7f2cc7068640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc0159900 0x7f2cc01f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:21.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.242+0000 7f2cc7068640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc015a490 con 0x7f2cc0159900 2023-10-14T11:13:21.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.242+0000 7f2cc7068640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc0157560 con 0x7f2cc006e260 2023-10-14T11:13:21.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.242+0000 7f2cc7068640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc01f2f30 con 0x7f2cc006a5a0 2023-10-14T11:13:21.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.242+0000 7f2cc5605640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc0159900 0x7f2cc01f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:21.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.242+0000 7f2cc5605640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc0159900 0x7f2cc01f1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38776/0 (socket says 172.21.15.26:38776) 2023-10-14T11:13:21.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.242+0000 7f2cc5605640 1 -- 172.21.15.26:0/1988957801 learned_addr learned my addr 172.21.15.26:0/1988957801 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:21.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.242+0000 7f2cbffff640 1 --2- 172.21.15.26:0/1988957801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cc006e260 0x7f2cc015a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:21.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.242+0000 7f2cc4e04640 1 --2- 172.21.15.26:0/1988957801 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cc006a5a0 0x7f2cc0157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:21.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.246+0000 7f2cc5605640 1 -- 172.21.15.26:0/1988957801 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cc006a5a0 msgr2=0x7f2cc0157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:21.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.246+0000 7f2cc5605640 1 --2- 172.21.15.26:0/1988957801 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cc006a5a0 0x7f2cc0157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.246+0000 7f2cc5605640 1 -- 172.21.15.26:0/1988957801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cc006e260 msgr2=0x7f2cc015a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:21.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.246+0000 7f2cc5605640 1 --2- 172.21.15.26:0/1988957801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cc006e260 0x7f2cc015a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.246+0000 7f2cc5605640 1 -- 172.21.15.26:0/1988957801 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb8009a70 con 0x7f2cc0159900 2023-10-14T11:13:21.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.246+0000 7f2cc5605640 1 --2- 172.21.15.26:0/1988957801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc0159900 0x7f2cc01f1f90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2cb80b0040 tx=0x7f2cb8019540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:21.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.246+0000 7f2cbd7fa640 1 -- 172.21.15.26:0/1988957801 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb80adcd0 con 0x7f2cc0159900 2023-10-14T11:13:21.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.246+0000 7f2cbd7fa640 1 -- 172.21.15.26:0/1988957801 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb80ade30 con 0x7f2cc0159900 2023-10-14T11:13:21.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.246+0000 7f2cbd7fa640 1 -- 172.21.15.26:0/1988957801 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb80b7650 con 0x7f2cc0159900 2023-10-14T11:13:21.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.246+0000 7f2cc7068640 1 -- 172.21.15.26:0/1988957801 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc01f2970 con 0x7f2cc0159900 2023-10-14T11:13:21.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.246+0000 7f2cc7068640 1 -- 172.21.15.26:0/1988957801 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc015a0b0 con 0x7f2cc0159900 2023-10-14T11:13:21.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.246+0000 7f2cc7068640 1 -- 172.21.15.26:0/1988957801 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc015a5d0 con 0x7f2cc0159900 2023-10-14T11:13:21.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.246+0000 7f2cbd7fa640 1 -- 172.21.15.26:0/1988957801 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2cb80b4050 con 0x7f2cc0159900 2023-10-14T11:13:21.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.246+0000 7f2cbd7fa640 1 --2- 172.21.15.26:0/1988957801 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2ca40664f0 0x7f2ca40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:21.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.246+0000 7f2cbd7fa640 1 -- 172.21.15.26:0/1988957801 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2cb811f9c0 con 0x7f2cc0159900 2023-10-14T11:13:21.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.246+0000 7f2cc4e04640 1 --2- 172.21.15.26:0/1988957801 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2ca40664f0 0x7f2ca40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:21.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.250+0000 7f2cc4e04640 1 --2- 172.21.15.26:0/1988957801 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2ca40664f0 0x7f2ca40689b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2cc01577c0 tx=0x7f2cb4009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:21.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.250+0000 7f2cbd7fa640 1 -- 172.21.15.26:0/1988957801 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2cc015a5d0 con 0x7f2cc0159900 2023-10-14T11:13:21.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.410+0000 7f2cc7068640 1 -- 172.21.15.26:0/1988957801 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2cc015a5d0 con 0x7f2cc0159900 2023-10-14T11:13:21.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.410+0000 7f2cbd7fa640 1 -- 172.21.15.26:0/1988957801 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2cb80c7020 con 0x7f2cc0159900 2023-10-14T11:13:21.415 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:21.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.410+0000 7f2cc7068640 1 -- 172.21.15.26:0/1988957801 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2ca40664f0 msgr2=0x7f2ca40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:21.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.410+0000 7f2cc7068640 1 --2- 172.21.15.26:0/1988957801 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2ca40664f0 0x7f2ca40689b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2cc01577c0 tx=0x7f2cb4009060 comp rx=0 tx=0).stop 2023-10-14T11:13:21.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.410+0000 7f2cc7068640 1 -- 172.21.15.26:0/1988957801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc0159900 msgr2=0x7f2cc01f1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:21.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.410+0000 7f2cc7068640 1 --2- 172.21.15.26:0/1988957801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc0159900 0x7f2cc01f1f90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2cb80b0040 tx=0x7f2cb8019540 comp rx=0 tx=0).stop 2023-10-14T11:13:21.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.410+0000 7f2cc7068640 1 -- 172.21.15.26:0/1988957801 shutdown_connections 2023-10-14T11:13:21.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.410+0000 7f2cc7068640 1 --2- 172.21.15.26:0/1988957801 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2ca40664f0 0x7f2ca40689b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.410+0000 7f2cc7068640 1 --2- 172.21.15.26:0/1988957801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc0159900 0x7f2cc01f1f90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.410+0000 7f2cc7068640 1 --2- 172.21.15.26:0/1988957801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cc006e260 0x7f2cc015a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.410+0000 7f2cc7068640 1 --2- 172.21.15.26:0/1988957801 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cc006a5a0 0x7f2cc0157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.410+0000 7f2cc7068640 1 -- 172.21.15.26:0/1988957801 >> 172.21.15.26:0/1988957801 conn(0x7f2cc00b0da0 msgr2=0x7f2cc00cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:21.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.410+0000 7f2cc7068640 1 -- 172.21.15.26:0/1988957801 shutdown_connections 2023-10-14T11:13:21.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.410+0000 7f2cc7068640 1 -- 172.21.15.26:0/1988957801 wait complete. 2023-10-14T11:13:21.437 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:13:21.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.574+0000 7f0282468640 1 Processor -- start 2023-10-14T11:13:21.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.574+0000 7f0282468640 1 -- start start 2023-10-14T11:13:21.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.574+0000 7f0282468640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f027c0cf520 0x7f027c0c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:21.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.574+0000 7f0282468640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f027c0c65f0 con 0x7f027c0cf090 2023-10-14T11:13:21.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.574+0000 7f0282468640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f027c0cf990 con 0x7f027c15ca70 2023-10-14T11:13:21.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.574+0000 7f0282468640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027c0ce820 con 0x7f027c0cf520 2023-10-14T11:13:21.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027b7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f027c0cf090 0x7f027c0c6ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45118/0 (socket says 172.21.15.26:45118) 2023-10-14T11:13:21.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027b7fe640 1 -- 172.21.15.26:0/284354099 learned_addr learned my addr 172.21.15.26:0/284354099 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:21.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f0280a05640 1 --2- 172.21.15.26:0/284354099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f027c0cf520 0x7f027c0c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:21.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027affd640 1 -- 172.21.15.26:0/284354099 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684426282 0 0) 0x7f027c0c65f0 con 0x7f027c0cf090 2023-10-14T11:13:21.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027affd640 1 -- 172.21.15.26:0/284354099 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0264003530 con 0x7f027c0cf090 2023-10-14T11:13:21.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027affd640 1 -- 172.21.15.26:0/284354099 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4099914109 0 0) 0x7f0264003530 con 0x7f027c0cf090 2023-10-14T11:13:21.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027affd640 1 -- 172.21.15.26:0/284354099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f027c0cf520 msgr2=0x7f027c0c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:21.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027affd640 1 --2- 172.21.15.26:0/284354099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f027c0cf520 0x7f027c0c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027affd640 1 -- 172.21.15.26:0/284354099 >> v1:172.21.15.110:6789/0 conn(0x7f027c15ca70 legacy=0x7f027c0d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:21.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027affd640 1 -- 172.21.15.26:0/284354099 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c0cdf80 con 0x7f027c0cf090 2023-10-14T11:13:21.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027affd640 1 -- 172.21.15.26:0/284354099 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f0270001680 con 0x7f027c0cf090 2023-10-14T11:13:21.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027affd640 1 -- 172.21.15.26:0/284354099 >> v1:172.21.15.26:6789/0 conn(0x7f027c0cf090 legacy=0x7f027c0c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:21.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027affd640 1 --2- 172.21.15.26:0/284354099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02640039b0 0x7f0264003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:21.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027affd640 1 --2- 172.21.15.26:0/284354099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f027c0cf520 0x7f02640047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:21.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027affd640 1 --2- 172.21.15.26:0/284354099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0264004d10 0x7f0264005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:21.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027affd640 1 -- 172.21.15.26:0/284354099 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c0ce820 con 0x7f02640039b0 2023-10-14T11:13:21.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027affd640 1 -- 172.21.15.26:0/284354099 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026400ba40 con 0x7f0264004d10 2023-10-14T11:13:21.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027affd640 1 -- 172.21.15.26:0/284354099 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026400bc00 con 0x7f027c0cf520 2023-10-14T11:13:21.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027bfff640 1 --2- 172.21.15.26:0/284354099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02640039b0 0x7f0264003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:21.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027b7fe640 1 --2- 172.21.15.26:0/284354099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f027c0cf520 0x7f02640047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:21.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f0280a05640 1 --2- 172.21.15.26:0/284354099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0264004d10 0x7f0264005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:21.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027bfff640 1 -- 172.21.15.26:0/284354099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f027c0cf520 msgr2=0x7f02640047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:21.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027bfff640 1 --2- 172.21.15.26:0/284354099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f027c0cf520 0x7f02640047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027bfff640 1 -- 172.21.15.26:0/284354099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0264004d10 msgr2=0x7f0264005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:21.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027bfff640 1 --2- 172.21.15.26:0/284354099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0264004d10 0x7f0264005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.578+0000 7f027bfff640 1 -- 172.21.15.26:0/284354099 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0264003530 con 0x7f02640039b0 2023-10-14T11:13:21.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.582+0000 7f027bfff640 1 --2- 172.21.15.26:0/284354099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02640039b0 0x7f0264003dd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f026c001780 tx=0x7f026c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa235103e0ae49df server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:21.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.582+0000 7f027affd640 1 -- 172.21.15.26:0/284354099 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c0052d0 con 0x7f02640039b0 2023-10-14T11:13:21.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.582+0000 7f027affd640 1 -- 172.21.15.26:0/284354099 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026c0a7050 con 0x7f02640039b0 2023-10-14T11:13:21.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.582+0000 7f027affd640 1 -- 172.21.15.26:0/284354099 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c003650 con 0x7f02640039b0 2023-10-14T11:13:21.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.582+0000 7f0282468640 1 -- 172.21.15.26:0/284354099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02640039b0 msgr2=0x7f0264003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:21.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.582+0000 7f0282468640 1 --2- 172.21.15.26:0/284354099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02640039b0 0x7f0264003dd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f026c001780 tx=0x7f026c01c370 comp rx=0 tx=0).stop 2023-10-14T11:13:21.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.582+0000 7f0280a05640 1 -- 172.21.15.26:0/284354099 reap_dead start 2023-10-14T11:13:21.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.582+0000 7f0282468640 1 -- 172.21.15.26:0/284354099 shutdown_connections 2023-10-14T11:13:21.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.582+0000 7f0282468640 1 -- 172.21.15.26:0/284354099 >> 172.21.15.26:0/284354099 conn(0x7f027c09bc50 msgr2=0x7f027c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:21.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.582+0000 7f0282468640 1 -- 172.21.15.26:0/284354099 shutdown_connections 2023-10-14T11:13:21.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.582+0000 7f0282468640 1 -- 172.21.15.26:0/284354099 wait complete. 2023-10-14T11:13:21.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.582+0000 7f0282468640 1 Processor -- start 2023-10-14T11:13:21.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.582+0000 7f0282468640 1 -- start start 2023-10-14T11:13:21.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f0282468640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02640039b0 0x7f027c0ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:21.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f0282468640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f027c154c50 0x7f027c0cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:21.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f0282468640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f027c151630 0x7f027c151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:21.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f0282468640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c154830 con 0x7f027c154c50 2023-10-14T11:13:21.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f0282468640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c151090 con 0x7f027c151630 2023-10-14T11:13:21.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f0282468640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027c153bb0 con 0x7f02640039b0 2023-10-14T11:13:21.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f027b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f027c154c50 0x7f027c0cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:21.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f027b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f027c154c50 0x7f027c0cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38804/0 (socket says 172.21.15.26:38804) 2023-10-14T11:13:21.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f027b7fe640 1 -- 172.21.15.26:0/77996937 learned_addr learned my addr 172.21.15.26:0/77996937 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:21.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f027bfff640 1 --2- 172.21.15.26:0/77996937 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02640039b0 0x7f027c0ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:21.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f0280a05640 1 --2- 172.21.15.26:0/77996937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f027c151630 0x7f027c151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:21.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f027b7fe640 1 -- 172.21.15.26:0/77996937 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02640039b0 msgr2=0x7f027c0ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:21.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f027b7fe640 1 --2- 172.21.15.26:0/77996937 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02640039b0 0x7f027c0ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f027b7fe640 1 -- 172.21.15.26:0/77996937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f027c151630 msgr2=0x7f027c151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:21.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f027b7fe640 1 --2- 172.21.15.26:0/77996937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f027c151630 0x7f027c151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f027b7fe640 1 -- 172.21.15.26:0/77996937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c0d38a0 con 0x7f027c154c50 2023-10-14T11:13:21.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f0280a05640 1 --2- 172.21.15.26:0/77996937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f027c151630 0x7f027c151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:21.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f027b7fe640 1 --2- 172.21.15.26:0/77996937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f027c154c50 0x7f027c0cc010 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f02700072c0 tx=0x7f0270007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:21.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f0278ff9640 1 -- 172.21.15.26:0/77996937 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027000f940 con 0x7f027c154c50 2023-10-14T11:13:21.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f0278ff9640 1 -- 172.21.15.26:0/77996937 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027000faa0 con 0x7f027c154c50 2023-10-14T11:13:21.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f0278ff9640 1 -- 172.21.15.26:0/77996937 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027000fe30 con 0x7f027c154c50 2023-10-14T11:13:21.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f0282468640 1 -- 172.21.15.26:0/77996937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027c153e90 con 0x7f027c154c50 2023-10-14T11:13:21.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f0282468640 1 -- 172.21.15.26:0/77996937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027c154450 con 0x7f027c154c50 2023-10-14T11:13:21.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f0282468640 1 -- 172.21.15.26:0/77996937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027c154970 con 0x7f027c154c50 2023-10-14T11:13:21.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.586+0000 7f0278ff9640 1 -- 172.21.15.26:0/77996937 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f027001d460 con 0x7f027c154c50 2023-10-14T11:13:21.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.590+0000 7f0278ff9640 1 --2- 172.21.15.26:0/77996937 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f02680664a0 0x7f0268068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:21.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.590+0000 7f0278ff9640 1 -- 172.21.15.26:0/77996937 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f02700842e0 con 0x7f027c154c50 2023-10-14T11:13:21.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.590+0000 7f027bfff640 1 --2- 172.21.15.26:0/77996937 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f02680664a0 0x7f0268068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:21.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.590+0000 7f027bfff640 1 --2- 172.21.15.26:0/77996937 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f02680664a0 0x7f0268068960 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f026c0ac000 tx=0x7f026c0011f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:21.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.594+0000 7f0278ff9640 1 -- 172.21.15.26:0/77996937 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f027c154970 con 0x7f027c154c50 2023-10-14T11:13:21.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.762+0000 7f0282468640 1 -- 172.21.15.26:0/77996937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f027c154970 con 0x7f027c154c50 2023-10-14T11:13:21.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.762+0000 7f0278ff9640 1 -- 172.21.15.26:0/77996937 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f027c154970 con 0x7f027c154c50 2023-10-14T11:13:21.767 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-10-14T11:13:21.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.762+0000 7f0282468640 1 -- 172.21.15.26:0/77996937 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f02680664a0 msgr2=0x7f0268068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:21.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.762+0000 7f0282468640 1 --2- 172.21.15.26:0/77996937 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f02680664a0 0x7f0268068960 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f026c0ac000 tx=0x7f026c0011f0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.762+0000 7f0282468640 1 -- 172.21.15.26:0/77996937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f027c154c50 msgr2=0x7f027c0cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:21.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.762+0000 7f0282468640 1 --2- 172.21.15.26:0/77996937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f027c154c50 0x7f027c0cc010 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f02700072c0 tx=0x7f0270007780 comp rx=0 tx=0).stop 2023-10-14T11:13:21.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.762+0000 7f0282468640 1 -- 172.21.15.26:0/77996937 shutdown_connections 2023-10-14T11:13:21.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.762+0000 7f0282468640 1 --2- 172.21.15.26:0/77996937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f027c151630 0x7f027c151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.762+0000 7f0282468640 1 --2- 172.21.15.26:0/77996937 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f02680664a0 0x7f0268068960 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.762+0000 7f0282468640 1 --2- 172.21.15.26:0/77996937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f027c154c50 0x7f027c0cc010 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.762+0000 7f0282468640 1 --2- 172.21.15.26:0/77996937 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02640039b0 0x7f027c0ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:21.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.762+0000 7f0282468640 1 -- 172.21.15.26:0/77996937 >> 172.21.15.26:0/77996937 conn(0x7f027c09bc50 msgr2=0x7f027c06c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:21.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.762+0000 7f0282468640 1 -- 172.21.15.26:0/77996937 shutdown_connections 2023-10-14T11:13:21.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:21.762+0000 7f0282468640 1 -- 172.21.15.26:0/77996937 wait complete. 2023-10-14T11:13:21.789 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi026.front.sepia.ceph.com... 2023-10-14T11:13:21.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:21.790 DEBUG:teuthology.orchestra.run.smithi026:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-14T11:13:21.815 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:13:21.816 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T11:13:21.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:21.819 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T11:13:21.874 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:13:21.875 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:13:21.888 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:13:21.889 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:13:21.956 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:13:22.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.098+0000 7f719c646640 1 Processor -- start 2023-10-14T11:13:22.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.098+0000 7f719c646640 1 -- start start 2023-10-14T11:13:22.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.098+0000 7f719c646640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f71941597c0 0x7f71940ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:22.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.098+0000 7f719c646640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71940adc10 0x7f71940cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:22.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.098+0000 7f719c646640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71940723d0 con 0x7f7194159ba0 2023-10-14T11:13:22.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.098+0000 7f719c646640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71940717c0 con 0x7f71941597c0 2023-10-14T11:13:22.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.098+0000 7f719c646640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7194071aa0 con 0x7f71940adc10 2023-10-14T11:13:22.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.098+0000 7f719a3e2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f71941597c0 0x7f71940ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:22.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.098+0000 7f719abe3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71940adc10 0x7f71940cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:22.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.098+0000 7f719a3e2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f71941597c0 0x7f71940ad6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:39442/0 (socket says 172.21.15.26:39442) 2023-10-14T11:13:22.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.098+0000 7f719a3e2640 1 -- 172.21.15.26:0/2166737695 learned_addr learned my addr 172.21.15.26:0/2166737695 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:22.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.102+0000 7f719a3e2640 1 -- 172.21.15.26:0/2166737695 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71940adc10 msgr2=0x7f71940cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:22.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.102+0000 7f719a3e2640 1 --2- 172.21.15.26:0/2166737695 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71940adc10 0x7f71940cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.102+0000 7f719a3e2640 1 -- 172.21.15.26:0/2166737695 >> v1:172.21.15.110:6789/0 conn(0x7f7194159ba0 legacy=0x7f71940cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:22.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.102+0000 7f719a3e2640 1 -- 172.21.15.26:0/2166737695 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7194071d80 con 0x7f71941597c0 2023-10-14T11:13:22.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.102+0000 7f71993e0640 1 -- 172.21.15.26:0/2166737695 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792498013 0 0) 0x7f71940723d0 con 0x7f7194159ba0 2023-10-14T11:13:22.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.102+0000 7f719abe3640 1 --2- 172.21.15.26:0/2166737695 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71940adc10 0x7f71940cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:13:22.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.102+0000 7f719a3e2640 1 --2- 172.21.15.26:0/2166737695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71941597c0 0x7f71940ad6d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7190009870 tx=0x7f719001c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ae915eb0d9a015f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:22.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.102+0000 7f71993e0640 1 -- 172.21.15.26:0/2166737695 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71900aa640 con 0x7f71941597c0 2023-10-14T11:13:22.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.102+0000 7f71993e0640 1 -- 172.21.15.26:0/2166737695 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71900aa7a0 con 0x7f71941597c0 2023-10-14T11:13:22.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.102+0000 7f71993e0640 1 -- 172.21.15.26:0/2166737695 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71900aab30 con 0x7f71941597c0 2023-10-14T11:13:22.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.102+0000 7f719c646640 1 -- 172.21.15.26:0/2166737695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71941597c0 msgr2=0x7f71940ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:22.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.102+0000 7f719c646640 1 --2- 172.21.15.26:0/2166737695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71941597c0 0x7f71940ad6d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7190009870 tx=0x7f719001c540 comp rx=0 tx=0).stop 2023-10-14T11:13:22.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719c646640 1 -- 172.21.15.26:0/2166737695 shutdown_connections 2023-10-14T11:13:22.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719c646640 1 --2- 172.21.15.26:0/2166737695 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71940adc10 0x7f71940cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719c646640 1 --2- 172.21.15.26:0/2166737695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71941597c0 0x7f71940ad6d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719c646640 1 -- 172.21.15.26:0/2166737695 >> 172.21.15.26:0/2166737695 conn(0x7f719406c190 msgr2=0x7f719406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:22.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719c646640 1 -- 172.21.15.26:0/2166737695 shutdown_connections 2023-10-14T11:13:22.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719c646640 1 -- 172.21.15.26:0/2166737695 wait complete. 2023-10-14T11:13:22.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719c646640 1 Processor -- start 2023-10-14T11:13:22.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719c646640 1 -- start start 2023-10-14T11:13:22.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719c646640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71940adc10 0x7f7194158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:22.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719c646640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71941597c0 0x7f719414a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:22.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719c646640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7194159ba0 0x7f71940c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:22.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719c646640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7194155b80 con 0x7f7194159ba0 2023-10-14T11:13:22.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719c646640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719414ab70 con 0x7f71940adc10 2023-10-14T11:13:22.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719c646640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71941565c0 con 0x7f71941597c0 2023-10-14T11:13:22.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719abe3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7194159ba0 0x7f71940c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:22.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719abe3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7194159ba0 0x7f71940c7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38820/0 (socket says 172.21.15.26:38820) 2023-10-14T11:13:22.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719abe3640 1 -- 172.21.15.26:0/3407080336 learned_addr learned my addr 172.21.15.26:0/3407080336 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:22.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f7199be1640 1 --2- 172.21.15.26:0/3407080336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71941597c0 0x7f719414a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:22.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719a3e2640 1 --2- 172.21.15.26:0/3407080336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71940adc10 0x7f7194158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:22.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719abe3640 1 -- 172.21.15.26:0/3407080336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71941597c0 msgr2=0x7f719414a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:22.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719abe3640 1 --2- 172.21.15.26:0/3407080336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71941597c0 0x7f719414a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719abe3640 1 -- 172.21.15.26:0/3407080336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71940adc10 msgr2=0x7f7194158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:22.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719abe3640 1 --2- 172.21.15.26:0/3407080336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71940adc10 0x7f7194158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.106+0000 7f719abe3640 1 -- 172.21.15.26:0/3407080336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718c00ba90 con 0x7f7194159ba0 2023-10-14T11:13:22.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.110+0000 7f719abe3640 1 --2- 172.21.15.26:0/3407080336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7194159ba0 0x7f71940c7c30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f718c009ed0 tx=0x7f718c010820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:22.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.110+0000 7f718affd640 1 -- 172.21.15.26:0/3407080336 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c015070 con 0x7f7194159ba0 2023-10-14T11:13:22.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.110+0000 7f718affd640 1 -- 172.21.15.26:0/3407080336 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c0174e0 con 0x7f7194159ba0 2023-10-14T11:13:22.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.110+0000 7f718affd640 1 -- 172.21.15.26:0/3407080336 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c017870 con 0x7f7194159ba0 2023-10-14T11:13:22.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.110+0000 7f719c646640 1 -- 172.21.15.26:0/3407080336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71900094d0 con 0x7f7194159ba0 2023-10-14T11:13:22.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.110+0000 7f719c646640 1 -- 172.21.15.26:0/3407080336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7194155dd0 con 0x7f7194159ba0 2023-10-14T11:13:22.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.110+0000 7f719c646640 1 -- 172.21.15.26:0/3407080336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7194074010 con 0x7f7194159ba0 2023-10-14T11:13:22.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.110+0000 7f718affd640 1 -- 172.21.15.26:0/3407080336 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f718c0179d0 con 0x7f7194159ba0 2023-10-14T11:13:22.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.110+0000 7f718affd640 1 --2- 172.21.15.26:0/3407080336 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f71780664a0 0x7f7178068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:22.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.110+0000 7f718affd640 1 -- 172.21.15.26:0/3407080336 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f718c0889f0 con 0x7f7194159ba0 2023-10-14T11:13:22.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.110+0000 7f719a3e2640 1 --2- 172.21.15.26:0/3407080336 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f71780664a0 0x7f7178068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:22.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.114+0000 7f719a3e2640 1 --2- 172.21.15.26:0/3407080336 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f71780664a0 0x7f7178068960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f71900ae000 tx=0x7f71900b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:22.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.114+0000 7f718affd640 1 -- 172.21.15.26:0/3407080336 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f718c055b50 con 0x7f7194159ba0 2023-10-14T11:13:22.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.274+0000 7f719c646640 1 -- 172.21.15.26:0/3407080336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f719406cb90 con 0x7f7194159ba0 2023-10-14T11:13:22.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.278+0000 7f718affd640 1 -- 172.21.15.26:0/3407080336 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18679 (secure 0 0 0) 0x7f718c00bda0 con 0x7f7194159ba0 2023-10-14T11:13:22.283 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:22.284 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":27,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:13:03.866737+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:13:22.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.278+0000 7f719c646640 1 -- 172.21.15.26:0/3407080336 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f71780664a0 msgr2=0x7f7178068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:22.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.278+0000 7f719c646640 1 --2- 172.21.15.26:0/3407080336 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f71780664a0 0x7f7178068960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f71900ae000 tx=0x7f71900b5040 comp rx=0 tx=0).stop 2023-10-14T11:13:22.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.278+0000 7f719c646640 1 -- 172.21.15.26:0/3407080336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7194159ba0 msgr2=0x7f71940c7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:22.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.278+0000 7f719c646640 1 --2- 172.21.15.26:0/3407080336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7194159ba0 0x7f71940c7c30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f718c009ed0 tx=0x7f718c010820 comp rx=0 tx=0).stop 2023-10-14T11:13:22.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.278+0000 7f719c646640 1 -- 172.21.15.26:0/3407080336 shutdown_connections 2023-10-14T11:13:22.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.278+0000 7f719c646640 1 --2- 172.21.15.26:0/3407080336 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f71780664a0 0x7f7178068960 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.278+0000 7f719c646640 1 --2- 172.21.15.26:0/3407080336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7194159ba0 0x7f71940c7c30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.278+0000 7f719c646640 1 --2- 172.21.15.26:0/3407080336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71941597c0 0x7f719414a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.278+0000 7f719c646640 1 --2- 172.21.15.26:0/3407080336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71940adc10 0x7f7194158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.278+0000 7f719c646640 1 -- 172.21.15.26:0/3407080336 >> 172.21.15.26:0/3407080336 conn(0x7f719406c190 msgr2=0x7f71940cee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:22.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.278+0000 7f719c646640 1 -- 172.21.15.26:0/3407080336 shutdown_connections 2023-10-14T11:13:22.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.278+0000 7f719c646640 1 -- 172.21.15.26:0/3407080336 wait complete. 2023-10-14T11:13:22.305 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:12:20.179562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:12:21.346111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T11:12:25.025159+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T11:13:22.307 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:13:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.454+0000 7f2db539d640 1 Processor -- start 2023-10-14T11:13:22.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.454+0000 7f2db539d640 1 -- start start 2023-10-14T11:13:22.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.454+0000 7f2db539d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2db0159900 0x7f2db006e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:22.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.454+0000 7f2db539d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2db00b3f00 0x7f2db0069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:22.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.454+0000 7f2db539d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db00b4360 con 0x7f2db006a3d0 2023-10-14T11:13:22.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.454+0000 7f2db539d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db00cd740 con 0x7f2db00b3f00 2023-10-14T11:13:22.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.454+0000 7f2db539d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db006a840 con 0x7f2db0159900 2023-10-14T11:13:22.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.454+0000 7f2dae7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2db00b3f00 0x7f2db0069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:22.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.454+0000 7f2daf7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2db006a3d0 0x7f2db00cc350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44498/0 (socket says 172.21.15.26:44498) 2023-10-14T11:13:22.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.454+0000 7f2daf7fe640 1 -- 172.21.15.26:0/59847135 learned_addr learned my addr 172.21.15.26:0/59847135 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:22.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.454+0000 7f2daeffd640 1 --2- 172.21.15.26:0/59847135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2db0159900 0x7f2db006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:22.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.454+0000 7f2dae7fc640 1 -- 172.21.15.26:0/59847135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2db0159900 msgr2=0x7f2db006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:22.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.454+0000 7f2dae7fc640 1 --2- 172.21.15.26:0/59847135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2db0159900 0x7f2db006e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.454+0000 7f2dae7fc640 1 -- 172.21.15.26:0/59847135 >> v1:172.21.15.26:6789/0 conn(0x7f2db006a3d0 legacy=0x7f2db00cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:22.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.454+0000 7f2dae7fc640 1 -- 172.21.15.26:0/59847135 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db00b4600 con 0x7f2db00b3f00 2023-10-14T11:13:22.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.454+0000 7f2dadffb640 1 -- 172.21.15.26:0/59847135 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625105918 0 0) 0x7f2db00b4360 con 0x7f2db006a3d0 2023-10-14T11:13:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.458+0000 7f2dae7fc640 1 --2- 172.21.15.26:0/59847135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2db00b3f00 0x7f2db0069e90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2da40097c0 tx=0x7f2da401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced5581ef5c6ba9c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.458+0000 7f2dadffb640 1 -- 172.21.15.26:0/59847135 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da40ab650 con 0x7f2db00b3f00 2023-10-14T11:13:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.458+0000 7f2dadffb640 1 -- 172.21.15.26:0/59847135 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da40ab7b0 con 0x7f2db00b3f00 2023-10-14T11:13:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.458+0000 7f2dadffb640 1 -- 172.21.15.26:0/59847135 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da40abb40 con 0x7f2db00b3f00 2023-10-14T11:13:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.458+0000 7f2db539d640 1 -- 172.21.15.26:0/59847135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2db00b3f00 msgr2=0x7f2db0069e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.458+0000 7f2db539d640 1 --2- 172.21.15.26:0/59847135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2db00b3f00 0x7f2db0069e90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2da40097c0 tx=0x7f2da401c450 comp rx=0 tx=0).stop 2023-10-14T11:13:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.458+0000 7f2db539d640 1 -- 172.21.15.26:0/59847135 shutdown_connections 2023-10-14T11:13:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.458+0000 7f2db539d640 1 --2- 172.21.15.26:0/59847135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2db00b3f00 0x7f2db0069e90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.458+0000 7f2db539d640 1 --2- 172.21.15.26:0/59847135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2db0159900 0x7f2db006e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.458+0000 7f2db539d640 1 -- 172.21.15.26:0/59847135 >> 172.21.15.26:0/59847135 conn(0x7f2db00b0da0 msgr2=0x7f2db00ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:22.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.458+0000 7f2db539d640 1 -- 172.21.15.26:0/59847135 shutdown_connections 2023-10-14T11:13:22.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.458+0000 7f2db539d640 1 -- 172.21.15.26:0/59847135 wait complete. 2023-10-14T11:13:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2db539d640 1 Processor -- start 2023-10-14T11:13:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2db539d640 1 -- start start 2023-10-14T11:13:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2db539d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2db006a3d0 0x7f2db00c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:22.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2db539d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2db00b3f00 0x7f2db00c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:22.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2db539d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2db0159900 0x7f2db01f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:22.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2db539d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db01f3d80 con 0x7f2db0159900 2023-10-14T11:13:22.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2db539d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db00c8af0 con 0x7f2db006a3d0 2023-10-14T11:13:22.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2db539d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db00c3630 con 0x7f2db00b3f00 2023-10-14T11:13:22.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2daf7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2db0159900 0x7f2db01f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:22.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2daf7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2db0159900 0x7f2db01f2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47422/0 (socket says 172.21.15.26:47422) 2023-10-14T11:13:22.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2daf7fe640 1 -- 172.21.15.26:0/409080007 learned_addr learned my addr 172.21.15.26:0/409080007 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:22.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2dae7fc640 1 --2- 172.21.15.26:0/409080007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2db00b3f00 0x7f2db00c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:22.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2daeffd640 1 --2- 172.21.15.26:0/409080007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2db006a3d0 0x7f2db00c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:22.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2daf7fe640 1 -- 172.21.15.26:0/409080007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2db00b3f00 msgr2=0x7f2db00c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:22.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2daf7fe640 1 --2- 172.21.15.26:0/409080007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2db00b3f00 0x7f2db00c2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2daf7fe640 1 -- 172.21.15.26:0/409080007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2db006a3d0 msgr2=0x7f2db00c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:22.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2daf7fe640 1 --2- 172.21.15.26:0/409080007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2db006a3d0 0x7f2db00c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2daf7fe640 1 -- 172.21.15.26:0/409080007 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da4009420 con 0x7f2db0159900 2023-10-14T11:13:22.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2daf7fe640 1 --2- 172.21.15.26:0/409080007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2db0159900 0x7f2db01f2bb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2da8001570 tx=0x7f2da800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:22.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2d977fe640 1 -- 172.21.15.26:0/409080007 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da800a640 con 0x7f2db0159900 2023-10-14T11:13:22.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2d977fe640 1 -- 172.21.15.26:0/409080007 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da800a7c0 con 0x7f2db0159900 2023-10-14T11:13:22.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2d977fe640 1 -- 172.21.15.26:0/409080007 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da800ab70 con 0x7f2db0159900 2023-10-14T11:13:22.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2db539d640 1 -- 172.21.15.26:0/409080007 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db00c3910 con 0x7f2db0159900 2023-10-14T11:13:22.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2db539d640 1 -- 172.21.15.26:0/409080007 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db00c3ed0 con 0x7f2db0159900 2023-10-14T11:13:22.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.462+0000 7f2db539d640 1 -- 172.21.15.26:0/409080007 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db01f3ef0 con 0x7f2db0159900 2023-10-14T11:13:22.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.466+0000 7f2d977fe640 1 -- 172.21.15.26:0/409080007 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2da800acd0 con 0x7f2db0159900 2023-10-14T11:13:22.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.466+0000 7f2d977fe640 1 --2- 172.21.15.26:0/409080007 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2d9c0664a0 0x7f2d9c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:22.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.466+0000 7f2d977fe640 1 -- 172.21.15.26:0/409080007 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2da8083770 con 0x7f2db0159900 2023-10-14T11:13:22.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.466+0000 7f2daeffd640 1 --2- 172.21.15.26:0/409080007 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2d9c0664a0 0x7f2d9c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:22.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.466+0000 7f2daeffd640 1 --2- 172.21.15.26:0/409080007 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2d9c0664a0 0x7f2d9c068960 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2db01f7270 tx=0x7f2da0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:22.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.470+0000 7f2d977fe640 1 -- 172.21.15.26:0/409080007 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2da80508d0 con 0x7f2db0159900 2023-10-14T11:13:22.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.626+0000 7f2db539d640 1 -- 172.21.15.26:0/409080007 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2db004e170 con 0x7f2db0159900 2023-10-14T11:13:22.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.626+0000 7f2d977fe640 1 -- 172.21.15.26:0/409080007 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2da80180a0 con 0x7f2db0159900 2023-10-14T11:13:22.634 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:13:22.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.630+0000 7f2db539d640 1 -- 172.21.15.26:0/409080007 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2d9c0664a0 msgr2=0x7f2d9c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:22.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.630+0000 7f2db539d640 1 --2- 172.21.15.26:0/409080007 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2d9c0664a0 0x7f2d9c068960 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2db01f7270 tx=0x7f2da0009190 comp rx=0 tx=0).stop 2023-10-14T11:13:22.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.630+0000 7f2db539d640 1 -- 172.21.15.26:0/409080007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2db0159900 msgr2=0x7f2db01f2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:22.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.630+0000 7f2db539d640 1 --2- 172.21.15.26:0/409080007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2db0159900 0x7f2db01f2bb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2da8001570 tx=0x7f2da800cca0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.630+0000 7f2db539d640 1 -- 172.21.15.26:0/409080007 shutdown_connections 2023-10-14T11:13:22.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.630+0000 7f2db539d640 1 --2- 172.21.15.26:0/409080007 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2d9c0664a0 0x7f2d9c068960 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.630+0000 7f2db539d640 1 --2- 172.21.15.26:0/409080007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2db0159900 0x7f2db01f2bb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.630+0000 7f2db539d640 1 --2- 172.21.15.26:0/409080007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2db00b3f00 0x7f2db00c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.630+0000 7f2db539d640 1 --2- 172.21.15.26:0/409080007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2db006a3d0 0x7f2db00c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.630+0000 7f2db539d640 1 -- 172.21.15.26:0/409080007 >> 172.21.15.26:0/409080007 conn(0x7f2db00b0da0 msgr2=0x7f2db0072920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:22.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.630+0000 7f2db539d640 1 -- 172.21.15.26:0/409080007 shutdown_connections 2023-10-14T11:13:22.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.630+0000 7f2db539d640 1 -- 172.21.15.26:0/409080007 wait complete. 2023-10-14T11:13:22.655 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:13:22.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.798+0000 7fb0f43d9640 1 Processor -- start 2023-10-14T11:13:22.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.798+0000 7fb0f43d9640 1 -- start start 2023-10-14T11:13:22.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.798+0000 7fb0f43d9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb0ec15c560 0x7fb0ec0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:22.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.798+0000 7fb0f43d9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb0ec0cdd20 0x7fb0ec0b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:22.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.798+0000 7fb0f43d9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0ec15c940 con 0x7fb0ec0caf30 2023-10-14T11:13:22.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.798+0000 7fb0f43d9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0ec0ce1a0 con 0x7fb0ec15c560 2023-10-14T11:13:22.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.798+0000 7fb0f43d9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0ec0b1870 con 0x7fb0ec0cdd20 2023-10-14T11:13:22.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.798+0000 7fb0f2175640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb0ec15c560 0x7fb0ec0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:22.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.798+0000 7fb0f2175640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb0ec15c560 0x7fb0ec0b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47434/0 (socket says 172.21.15.26:47434) 2023-10-14T11:13:22.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.798+0000 7fb0f2175640 1 -- 172.21.15.26:0/1802017334 learned_addr learned my addr 172.21.15.26:0/1802017334 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:22.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.798+0000 7fb0f1974640 1 --2- 172.21.15.26:0/1802017334 >> v2:172.21.15.110:3300/0 conn(0x7fb0ec0cdd20 0x7fb0ec0b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:22.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.798+0000 7fb0f2175640 1 -- 172.21.15.26:0/1802017334 >> v2:172.21.15.110:3300/0 conn(0x7fb0ec0cdd20 msgr2=0x7fb0ec0b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:22.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.798+0000 7fb0f2175640 1 --2- 172.21.15.26:0/1802017334 >> v2:172.21.15.110:3300/0 conn(0x7fb0ec0cdd20 0x7fb0ec0b1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.798+0000 7fb0f2175640 1 -- 172.21.15.26:0/1802017334 >> v1:172.21.15.110:6789/0 conn(0x7fb0ec0caf30 legacy=0x7fb0ec06bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:22.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.798+0000 7fb0f2175640 1 -- 172.21.15.26:0/1802017334 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec0b1540 con 0x7fb0ec15c560 2023-10-14T11:13:22.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.798+0000 7fb0f1974640 1 --2- 172.21.15.26:0/1802017334 >> v2:172.21.15.110:3300/0 conn(0x7fb0ec0cdd20 0x7fb0ec0b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:22.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.802+0000 7fb0f2175640 1 --2- 172.21.15.26:0/1802017334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0ec15c560 0x7fb0ec0b30d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec06d250 tx=0x7fb0e801d580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ba8652a6a7613c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:22.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.802+0000 7fb0f1173640 1 -- 172.21.15.26:0/1802017334 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e80a7040 con 0x7fb0ec15c560 2023-10-14T11:13:22.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.802+0000 7fb0f1173640 1 -- 172.21.15.26:0/1802017334 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e80ab600 con 0x7fb0ec15c560 2023-10-14T11:13:22.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.802+0000 7fb0f1173640 1 -- 172.21.15.26:0/1802017334 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e80ab990 con 0x7fb0ec15c560 2023-10-14T11:13:22.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.802+0000 7fb0f43d9640 1 -- 172.21.15.26:0/1802017334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0ec15c560 msgr2=0x7fb0ec0b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:22.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.802+0000 7fb0f43d9640 1 --2- 172.21.15.26:0/1802017334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0ec15c560 0x7fb0ec0b30d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec06d250 tx=0x7fb0e801d580 comp rx=0 tx=0).stop 2023-10-14T11:13:22.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.802+0000 7fb0f43d9640 1 -- 172.21.15.26:0/1802017334 shutdown_connections 2023-10-14T11:13:22.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.802+0000 7fb0f43d9640 1 --2- 172.21.15.26:0/1802017334 >> v2:172.21.15.110:3300/0 conn(0x7fb0ec0cdd20 0x7fb0ec0b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.802+0000 7fb0f43d9640 1 --2- 172.21.15.26:0/1802017334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0ec15c560 0x7fb0ec0b30d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.802+0000 7fb0f43d9640 1 -- 172.21.15.26:0/1802017334 >> 172.21.15.26:0/1802017334 conn(0x7fb0ec06a490 msgr2=0x7fb0ec0ce550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:22.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.802+0000 7fb0f43d9640 1 -- 172.21.15.26:0/1802017334 shutdown_connections 2023-10-14T11:13:22.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.802+0000 7fb0f43d9640 1 -- 172.21.15.26:0/1802017334 wait complete. 2023-10-14T11:13:22.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0f43d9640 1 Processor -- start 2023-10-14T11:13:22.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0f43d9640 1 -- start start 2023-10-14T11:13:22.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0f43d9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0ec0caf30 0x7fb0ec1f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:22.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0f43d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0ec0cdd20 0x7fb0ec097a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:22.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0f43d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0ec15c560 0x7fb0ec097f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:22.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0f43d9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec154480 con 0x7fb0ec0caf30 2023-10-14T11:13:22.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0f43d9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec1f5620 con 0x7fb0ec15c560 2023-10-14T11:13:22.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0f43d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec0984a0 con 0x7fb0ec0cdd20 2023-10-14T11:13:22.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0f2175640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0ec0caf30 0x7fb0ec1f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:22.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0f2175640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0ec0caf30 0x7fb0ec1f50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47442/0 (socket says 172.21.15.26:47442) 2023-10-14T11:13:22.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0f2175640 1 -- 172.21.15.26:0/3226593070 learned_addr learned my addr 172.21.15.26:0/3226593070 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:22.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0f2976640 1 --2- 172.21.15.26:0/3226593070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0ec15c560 0x7fb0ec097f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:22.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0f1974640 1 --2- 172.21.15.26:0/3226593070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0ec0cdd20 0x7fb0ec097a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:22.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0f2175640 1 -- 172.21.15.26:0/3226593070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0ec0cdd20 msgr2=0x7fb0ec097a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:22.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0f2175640 1 --2- 172.21.15.26:0/3226593070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0ec0cdd20 0x7fb0ec097a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0f2175640 1 -- 172.21.15.26:0/3226593070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0ec15c560 msgr2=0x7fb0ec097f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0f2175640 1 --2- 172.21.15.26:0/3226593070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0ec15c560 0x7fb0ec097f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0f2175640 1 -- 172.21.15.26:0/3226593070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e8009480 con 0x7fb0ec0caf30 2023-10-14T11:13:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0f2175640 1 --2- 172.21.15.26:0/3226593070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0ec0caf30 0x7fb0ec1f50e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8000c10 tx=0x7fb0e801a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0e2ffd640 1 -- 172.21.15.26:0/3226593070 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e80ba070 con 0x7fb0ec0caf30 2023-10-14T11:13:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0e2ffd640 1 -- 172.21.15.26:0/3226593070 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e80ab400 con 0x7fb0ec0caf30 2023-10-14T11:13:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0e2ffd640 1 -- 172.21.15.26:0/3226593070 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e80a7020 con 0x7fb0ec0caf30 2023-10-14T11:13:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0f43d9640 1 -- 172.21.15.26:0/3226593070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ec099850 con 0x7fb0ec0caf30 2023-10-14T11:13:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0f43d9640 1 -- 172.21.15.26:0/3226593070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0ec1585e0 con 0x7fb0ec0caf30 2023-10-14T11:13:22.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.806+0000 7fb0f43d9640 1 -- 172.21.15.26:0/3226593070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0ec0b2200 con 0x7fb0ec0caf30 2023-10-14T11:13:22.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.810+0000 7fb0e2ffd640 1 -- 172.21.15.26:0/3226593070 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb0e8003620 con 0x7fb0ec0caf30 2023-10-14T11:13:22.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.810+0000 7fb0e2ffd640 1 --2- 172.21.15.26:0/3226593070 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb0d0066490 0x7fb0d0068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:22.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.810+0000 7fb0e2ffd640 1 -- 172.21.15.26:0/3226593070 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb0e811e340 con 0x7fb0ec0caf30 2023-10-14T11:13:22.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.810+0000 7fb0f1974640 1 --2- 172.21.15.26:0/3226593070 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb0d0066490 0x7fb0d0068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:22.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.810+0000 7fb0f1974640 1 --2- 172.21.15.26:0/3226593070 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb0d0066490 0x7fb0d0068950 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec071620 tx=0x7fb0dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:22.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.814+0000 7fb0e2ffd640 1 -- 172.21.15.26:0/3226593070 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb0e80eb360 con 0x7fb0ec0caf30 2023-10-14T11:13:22.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.970+0000 7fb0f43d9640 1 -- 172.21.15.26:0/3226593070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb0ec073fa0 con 0x7fb0ec0caf30 2023-10-14T11:13:22.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.970+0000 7fb0e2ffd640 1 -- 172.21.15.26:0/3226593070 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb0e80ee980 con 0x7fb0ec0caf30 2023-10-14T11:13:22.978 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:22.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.974+0000 7fb0f43d9640 1 -- 172.21.15.26:0/3226593070 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb0d0066490 msgr2=0x7fb0d0068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:22.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.974+0000 7fb0f43d9640 1 --2- 172.21.15.26:0/3226593070 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb0d0066490 0x7fb0d0068950 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec071620 tx=0x7fb0dc008040 comp rx=0 tx=0).stop 2023-10-14T11:13:22.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.974+0000 7fb0f43d9640 1 -- 172.21.15.26:0/3226593070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0ec0caf30 msgr2=0x7fb0ec1f50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:22.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.974+0000 7fb0f43d9640 1 --2- 172.21.15.26:0/3226593070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0ec0caf30 0x7fb0ec1f50e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8000c10 tx=0x7fb0e801a320 comp rx=0 tx=0).stop 2023-10-14T11:13:22.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.974+0000 7fb0f43d9640 1 -- 172.21.15.26:0/3226593070 shutdown_connections 2023-10-14T11:13:22.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.974+0000 7fb0f43d9640 1 --2- 172.21.15.26:0/3226593070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0ec15c560 0x7fb0ec097f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.974+0000 7fb0f43d9640 1 --2- 172.21.15.26:0/3226593070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0ec0cdd20 0x7fb0ec097a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.974+0000 7fb0f43d9640 1 --2- 172.21.15.26:0/3226593070 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb0d0066490 0x7fb0d0068950 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.974+0000 7fb0f43d9640 1 --2- 172.21.15.26:0/3226593070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0ec0caf30 0x7fb0ec1f50e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.974+0000 7fb0f43d9640 1 -- 172.21.15.26:0/3226593070 >> 172.21.15.26:0/3226593070 conn(0x7fb0ec06a490 msgr2=0x7fb0ec070280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.974+0000 7fb0f43d9640 1 -- 172.21.15.26:0/3226593070 shutdown_connections 2023-10-14T11:13:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:22.974+0000 7fb0f43d9640 1 -- 172.21.15.26:0/3226593070 wait complete. 2023-10-14T11:13:22.999 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:13:23.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.142+0000 7f8050279640 1 Processor -- start 2023-10-14T11:13:23.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.142+0000 7f8050279640 1 -- start start 2023-10-14T11:13:23.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.142+0000 7f8050279640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f80480b84e0 0x7f80480d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:23.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.142+0000 7f8050279640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80480d1670 con 0x7f80480d0210 2023-10-14T11:13:23.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.142+0000 7f8050279640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80480d1950 con 0x7f804815cba0 2023-10-14T11:13:23.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.142+0000 7f8050279640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80480d1460 con 0x7f80480b84e0 2023-10-14T11:13:23.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.146+0000 7f804d814640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f80480d0210 0x7f80480b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44504/0 (socket says 172.21.15.26:44504) 2023-10-14T11:13:23.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.146+0000 7f804d814640 1 -- 172.21.15.26:0/1356579591 learned_addr learned my addr 172.21.15.26:0/1356579591 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:23.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.146+0000 7f804e816640 1 --2- 172.21.15.26:0/1356579591 >> v2:172.21.15.110:3300/0 conn(0x7f80480b84e0 0x7f80480d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:23.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.146+0000 7f804d013640 1 -- 172.21.15.26:0/1356579591 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065287283 0 0) 0x7f80480d1670 con 0x7f80480d0210 2023-10-14T11:13:23.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.146+0000 7f804d013640 1 -- 172.21.15.26:0/1356579591 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8034003530 con 0x7f80480d0210 2023-10-14T11:13:23.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.146+0000 7f804d013640 1 -- 172.21.15.26:0/1356579591 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1482327926 0 0) 0x7f80480d1950 con 0x7f804815cba0 2023-10-14T11:13:23.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.146+0000 7f804d013640 1 -- 172.21.15.26:0/1356579591 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80480d1670 con 0x7f804815cba0 2023-10-14T11:13:23.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.146+0000 7f804e816640 1 -- 172.21.15.26:0/1356579591 >> v1:172.21.15.110:6789/0 conn(0x7f804815cba0 legacy=0x7f80480cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:23.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.146+0000 7f804e816640 1 -- 172.21.15.26:0/1356579591 >> v1:172.21.15.26:6789/0 conn(0x7f80480d0210 legacy=0x7f80480b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:23.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.146+0000 7f804e816640 1 -- 172.21.15.26:0/1356579591 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80480d1c30 con 0x7f80480b84e0 2023-10-14T11:13:23.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.146+0000 7f804e816640 1 --2- 172.21.15.26:0/1356579591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80480b84e0 0x7f80480d0f20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8040009d90 tx=0x7f804001c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d27d1c0cdd8c459 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:23.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.146+0000 7f804d013640 1 -- 172.21.15.26:0/1356579591 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80400a5980 con 0x7f80480b84e0 2023-10-14T11:13:23.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.150+0000 7f804d013640 1 -- 172.21.15.26:0/1356579591 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80400a5ae0 con 0x7f80480b84e0 2023-10-14T11:13:23.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.150+0000 7f804d013640 1 -- 172.21.15.26:0/1356579591 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80400a5e70 con 0x7f80480b84e0 2023-10-14T11:13:23.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.150+0000 7f8050279640 1 -- 172.21.15.26:0/1356579591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80480b84e0 msgr2=0x7f80480d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:23.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.150+0000 7f8050279640 1 --2- 172.21.15.26:0/1356579591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80480b84e0 0x7f80480d0f20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8040009d90 tx=0x7f804001c8c0 comp rx=0 tx=0).stop 2023-10-14T11:13:23.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.150+0000 7f8050279640 1 -- 172.21.15.26:0/1356579591 shutdown_connections 2023-10-14T11:13:23.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.150+0000 7f8050279640 1 --2- 172.21.15.26:0/1356579591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80480b84e0 0x7f80480d0f20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:23.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.150+0000 7f8050279640 1 -- 172.21.15.26:0/1356579591 >> 172.21.15.26:0/1356579591 conn(0x7f80480719c0 msgr2=0x7f8048071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:23.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.150+0000 7f8050279640 1 -- 172.21.15.26:0/1356579591 shutdown_connections 2023-10-14T11:13:23.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.150+0000 7f8050279640 1 -- 172.21.15.26:0/1356579591 wait complete. 2023-10-14T11:13:23.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.150+0000 7f8050279640 1 Processor -- start 2023-10-14T11:13:23.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.150+0000 7f8050279640 1 -- start start 2023-10-14T11:13:23.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.150+0000 7f8050279640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80480b84e0 0x7f80480cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:23.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.150+0000 7f8050279640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80480d0210 0x7f80480c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:23.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.150+0000 7f8050279640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f804815cba0 0x7f80480ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:23.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.150+0000 7f8050279640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80480c77a0 con 0x7f804815cba0 2023-10-14T11:13:23.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.150+0000 7f8050279640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80480cac80 con 0x7f80480b84e0 2023-10-14T11:13:23.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.150+0000 7f8050279640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80480c9cc0 con 0x7f80480d0210 2023-10-14T11:13:23.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.150+0000 7f804e816640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f804815cba0 0x7f80480ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:23.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.150+0000 7f804e816640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f804815cba0 0x7f80480ca740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47450/0 (socket says 172.21.15.26:47450) 2023-10-14T11:13:23.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.150+0000 7f804e816640 1 -- 172.21.15.26:0/2504740769 learned_addr learned my addr 172.21.15.26:0/2504740769 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:23.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.150+0000 7f804e015640 1 --2- 172.21.15.26:0/2504740769 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80480b84e0 0x7f80480cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:23.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.150+0000 7f804d814640 1 --2- 172.21.15.26:0/2504740769 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80480d0210 0x7f80480c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:23.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.154+0000 7f804e816640 1 -- 172.21.15.26:0/2504740769 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80480d0210 msgr2=0x7f80480c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:23.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.154+0000 7f804e816640 1 --2- 172.21.15.26:0/2504740769 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80480d0210 0x7f80480c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:23.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.154+0000 7f804e816640 1 -- 172.21.15.26:0/2504740769 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80480b84e0 msgr2=0x7f80480cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:23.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.154+0000 7f804e816640 1 --2- 172.21.15.26:0/2504740769 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80480b84e0 0x7f80480cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:23.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.154+0000 7f804e816640 1 -- 172.21.15.26:0/2504740769 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8040009a70 con 0x7f804815cba0 2023-10-14T11:13:23.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.154+0000 7f804d814640 1 --2- 172.21.15.26:0/2504740769 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80480d0210 0x7f80480c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:23.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.154+0000 7f804e816640 1 --2- 172.21.15.26:0/2504740769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f804815cba0 0x7f80480ca740 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f804001a4f0 tx=0x7f8040019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:23.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.154+0000 7f803effd640 1 -- 172.21.15.26:0/2504740769 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80400b9860 con 0x7f804815cba0 2023-10-14T11:13:23.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.154+0000 7f803effd640 1 -- 172.21.15.26:0/2504740769 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80400b99c0 con 0x7f804815cba0 2023-10-14T11:13:23.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.154+0000 7f803effd640 1 -- 172.21.15.26:0/2504740769 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80400b9d30 con 0x7f804815cba0 2023-10-14T11:13:23.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.154+0000 7f8050279640 1 -- 172.21.15.26:0/2504740769 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80480c7a00 con 0x7f804815cba0 2023-10-14T11:13:23.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.154+0000 7f8050279640 1 -- 172.21.15.26:0/2504740769 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80480ca240 con 0x7f804815cba0 2023-10-14T11:13:23.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.154+0000 7f8050279640 1 -- 172.21.15.26:0/2504740769 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f804804e170 con 0x7f804815cba0 2023-10-14T11:13:23.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.154+0000 7f803effd640 1 -- 172.21.15.26:0/2504740769 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f80400ad440 con 0x7f804815cba0 2023-10-14T11:13:23.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.154+0000 7f803effd640 1 --2- 172.21.15.26:0/2504740769 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f802c0664a0 0x7f802c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:23.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.154+0000 7f803effd640 1 -- 172.21.15.26:0/2504740769 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f804011f440 con 0x7f804815cba0 2023-10-14T11:13:23.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.154+0000 7f804e015640 1 --2- 172.21.15.26:0/2504740769 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f802c0664a0 0x7f802c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:23.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.158+0000 7f804e015640 1 --2- 172.21.15.26:0/2504740769 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f802c0664a0 0x7f802c068960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f80440011f0 tx=0x7f8044009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:23.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.158+0000 7f803effd640 1 -- 172.21.15.26:0/2504740769 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f80400ec4f0 con 0x7f804815cba0 2023-10-14T11:13:23.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.318+0000 7f8050279640 1 -- 172.21.15.26:0/2504740769 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f80480cdaa0 con 0x7f804815cba0 2023-10-14T11:13:23.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.318+0000 7f803effd640 1 -- 172.21.15.26:0/2504740769 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f80400efb10 con 0x7f804815cba0 2023-10-14T11:13:23.325 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:13:23.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.322+0000 7f8050279640 1 -- 172.21.15.26:0/2504740769 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f802c0664a0 msgr2=0x7f802c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:23.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.322+0000 7f8050279640 1 --2- 172.21.15.26:0/2504740769 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f802c0664a0 0x7f802c068960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f80440011f0 tx=0x7f8044009040 comp rx=0 tx=0).stop 2023-10-14T11:13:23.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.322+0000 7f8050279640 1 -- 172.21.15.26:0/2504740769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f804815cba0 msgr2=0x7f80480ca740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:23.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.322+0000 7f8050279640 1 --2- 172.21.15.26:0/2504740769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f804815cba0 0x7f80480ca740 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f804001a4f0 tx=0x7f8040019660 comp rx=0 tx=0).stop 2023-10-14T11:13:23.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.322+0000 7f8050279640 1 -- 172.21.15.26:0/2504740769 shutdown_connections 2023-10-14T11:13:23.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.322+0000 7f8050279640 1 --2- 172.21.15.26:0/2504740769 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f802c0664a0 0x7f802c068960 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:23.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.322+0000 7f8050279640 1 --2- 172.21.15.26:0/2504740769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f804815cba0 0x7f80480ca740 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:23.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.322+0000 7f8050279640 1 --2- 172.21.15.26:0/2504740769 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80480d0210 0x7f80480c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:23.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.322+0000 7f8050279640 1 --2- 172.21.15.26:0/2504740769 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80480b84e0 0x7f80480cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:23.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.322+0000 7f8050279640 1 -- 172.21.15.26:0/2504740769 >> 172.21.15.26:0/2504740769 conn(0x7f80480719c0 msgr2=0x7f8048072900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:23.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.322+0000 7f8050279640 1 -- 172.21.15.26:0/2504740769 shutdown_connections 2023-10-14T11:13:23.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.322+0000 7f8050279640 1 -- 172.21.15.26:0/2504740769 wait complete. 2023-10-14T11:13:23.346 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T11:13:23.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.486+0000 7f9bd593e640 1 Processor -- start 2023-10-14T11:13:23.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.486+0000 7f9bd593e640 1 -- start start 2023-10-14T11:13:23.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.486+0000 7f9bd593e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9bd006e260 0x7f9bd00b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:23.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.486+0000 7f9bd593e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd00b4600 con 0x7f9bd0159900 2023-10-14T11:13:23.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.486+0000 7f9bd593e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd00c8dd0 con 0x7f9bd006a5a0 2023-10-14T11:13:23.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.486+0000 7f9bd593e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd00cd740 con 0x7f9bd006e260 2023-10-14T11:13:23.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.486+0000 7f9bceffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9bd0159900 0x7f9bd0069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44512/0 (socket says 172.21.15.26:44512) 2023-10-14T11:13:23.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.486+0000 7f9bceffd640 1 -- 172.21.15.26:0/3915217319 learned_addr learned my addr 172.21.15.26:0/3915217319 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:23.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.486+0000 7f9bcf7fe640 1 --2- 172.21.15.26:0/3915217319 >> v2:172.21.15.26:3300/0 conn(0x7f9bd006e260 0x7f9bd00b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:23.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.486+0000 7f9bce7fc640 1 -- 172.21.15.26:0/3915217319 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929749049 0 0) 0x7f9bd00b4600 con 0x7f9bd0159900 2023-10-14T11:13:23.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.486+0000 7f9bce7fc640 1 -- 172.21.15.26:0/3915217319 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bbc003530 con 0x7f9bd0159900 2023-10-14T11:13:23.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.486+0000 7f9bcf7fe640 1 -- 172.21.15.26:0/3915217319 >> v1:172.21.15.110:6789/0 conn(0x7f9bd006a5a0 legacy=0x7f9bd00c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:23.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.486+0000 7f9bcf7fe640 1 -- 172.21.15.26:0/3915217319 >> v1:172.21.15.26:6789/0 conn(0x7f9bd0159900 legacy=0x7f9bd0069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:23.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.486+0000 7f9bcf7fe640 1 -- 172.21.15.26:0/3915217319 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd00c90b0 con 0x7f9bd006e260 2023-10-14T11:13:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.490+0000 7f9bcf7fe640 1 --2- 172.21.15.26:0/3915217319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd006e260 0x7f9bd00b3f00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009d90 tx=0x7f9bc801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140260ef804ae9e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.490+0000 7f9bce7fc640 1 -- 172.21.15.26:0/3915217319 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc80a5a10 con 0x7f9bd006e260 2023-10-14T11:13:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.490+0000 7f9bce7fc640 1 -- 172.21.15.26:0/3915217319 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc80a5b70 con 0x7f9bd006e260 2023-10-14T11:13:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.490+0000 7f9bce7fc640 1 -- 172.21.15.26:0/3915217319 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc80ad440 con 0x7f9bd006e260 2023-10-14T11:13:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.490+0000 7f9bd593e640 1 -- 172.21.15.26:0/3915217319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd006e260 msgr2=0x7f9bd00b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.490+0000 7f9bd593e640 1 --2- 172.21.15.26:0/3915217319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd006e260 0x7f9bd00b3f00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009d90 tx=0x7f9bc801c950 comp rx=0 tx=0).stop 2023-10-14T11:13:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.490+0000 7f9bd593e640 1 -- 172.21.15.26:0/3915217319 shutdown_connections 2023-10-14T11:13:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.490+0000 7f9bd593e640 1 --2- 172.21.15.26:0/3915217319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd006e260 0x7f9bd00b3f00 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.490+0000 7f9bd593e640 1 -- 172.21.15.26:0/3915217319 >> 172.21.15.26:0/3915217319 conn(0x7f9bd00b0da0 msgr2=0x7f9bd00ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.490+0000 7f9bd593e640 1 -- 172.21.15.26:0/3915217319 shutdown_connections 2023-10-14T11:13:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.490+0000 7f9bd593e640 1 -- 172.21.15.26:0/3915217319 wait complete. 2023-10-14T11:13:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bd593e640 1 Processor -- start 2023-10-14T11:13:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bd593e640 1 -- start start 2023-10-14T11:13:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bd593e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bd006a5a0 0x7f9bd00c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bd593e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd006e260 0x7f9bd01f48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bd593e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bd0159900 0x7f9bd015c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bd593e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd00c7c30 con 0x7f9bd006e260 2023-10-14T11:13:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bd593e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd00c7f10 con 0x7f9bd006a5a0 2023-10-14T11:13:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bd593e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd00c81f0 con 0x7f9bd0159900 2023-10-14T11:13:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bc7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd006e260 0x7f9bd01f48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bc7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd006e260 0x7f9bd01f48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47474/0 (socket says 172.21.15.26:47474) 2023-10-14T11:13:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bc7fff640 1 -- 172.21.15.26:0/110531122 learned_addr learned my addr 172.21.15.26:0/110531122 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:23.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bceffd640 1 --2- 172.21.15.26:0/110531122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bd006a5a0 0x7f9bd00c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:23.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bcf7fe640 1 --2- 172.21.15.26:0/110531122 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bd0159900 0x7f9bd015c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:23.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bc7fff640 1 -- 172.21.15.26:0/110531122 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bd0159900 msgr2=0x7f9bd015c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:23.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bc7fff640 1 --2- 172.21.15.26:0/110531122 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bd0159900 0x7f9bd015c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:23.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bc7fff640 1 -- 172.21.15.26:0/110531122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bd006a5a0 msgr2=0x7f9bd00c72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bc7fff640 1 --2- 172.21.15.26:0/110531122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bd006a5a0 0x7f9bd00c72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bc7fff640 1 -- 172.21.15.26:0/110531122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc8009a70 con 0x7f9bd006e260 2023-10-14T11:13:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bc7fff640 1 --2- 172.21.15.26:0/110531122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd006e260 0x7f9bd01f48f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800c500 tx=0x7f9bb800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bccff9640 1 -- 172.21.15.26:0/110531122 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8005220 con 0x7f9bd006e260 2023-10-14T11:13:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bccff9640 1 -- 172.21.15.26:0/110531122 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb8005380 con 0x7f9bd006e260 2023-10-14T11:13:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bccff9640 1 -- 172.21.15.26:0/110531122 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8007270 con 0x7f9bd006e260 2023-10-14T11:13:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bd593e640 1 -- 172.21.15.26:0/110531122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd00c84d0 con 0x7f9bd006e260 2023-10-14T11:13:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.494+0000 7f9bd593e640 1 -- 172.21.15.26:0/110531122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd00c79d0 con 0x7f9bd006e260 2023-10-14T11:13:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.498+0000 7f9bd593e640 1 -- 172.21.15.26:0/110531122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd004e170 con 0x7f9bd006e260 2023-10-14T11:13:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.498+0000 7f9bccff9640 1 -- 172.21.15.26:0/110531122 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9bb80073d0 con 0x7f9bd006e260 2023-10-14T11:13:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.498+0000 7f9bccff9640 1 --2- 172.21.15.26:0/110531122 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9bb00664d0 0x7f9bb0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:23.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.498+0000 7f9bccff9640 1 -- 172.21.15.26:0/110531122 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9bb8083b70 con 0x7f9bd006e260 2023-10-14T11:13:23.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.498+0000 7f9bceffd640 1 --2- 172.21.15.26:0/110531122 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9bb00664d0 0x7f9bb0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:23.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.498+0000 7f9bceffd640 1 --2- 172.21.15.26:0/110531122 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9bb00664d0 0x7f9bb0068990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00011f0 tx=0x7f9bc0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:23.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.502+0000 7f9bccff9640 1 -- 172.21.15.26:0/110531122 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9bb8050ba0 con 0x7f9bd006e260 2023-10-14T11:13:23.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.670+0000 7f9bd593e640 1 -- 172.21.15.26:0/110531122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9bd0073fa0 con 0x7f9bd006e260 2023-10-14T11:13:23.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.670+0000 7f9bccff9640 1 -- 172.21.15.26:0/110531122 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9bb80541c0 con 0x7f9bd006e260 2023-10-14T11:13:23.677 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:23.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.674+0000 7f9bd593e640 1 -- 172.21.15.26:0/110531122 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9bb00664d0 msgr2=0x7f9bb0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:23.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.674+0000 7f9bd593e640 1 --2- 172.21.15.26:0/110531122 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9bb00664d0 0x7f9bb0068990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00011f0 tx=0x7f9bc0009040 comp rx=0 tx=0).stop 2023-10-14T11:13:23.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.674+0000 7f9bd593e640 1 -- 172.21.15.26:0/110531122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd006e260 msgr2=0x7f9bd01f48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:23.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.674+0000 7f9bd593e640 1 --2- 172.21.15.26:0/110531122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd006e260 0x7f9bd01f48f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800c500 tx=0x7f9bb800c9c0 comp rx=0 tx=0).stop 2023-10-14T11:13:23.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.674+0000 7f9bd593e640 1 -- 172.21.15.26:0/110531122 shutdown_connections 2023-10-14T11:13:23.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.674+0000 7f9bd593e640 1 --2- 172.21.15.26:0/110531122 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bd0159900 0x7f9bd015c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:23.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.674+0000 7f9bd593e640 1 --2- 172.21.15.26:0/110531122 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9bb00664d0 0x7f9bb0068990 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:23.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.674+0000 7f9bd593e640 1 --2- 172.21.15.26:0/110531122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd006e260 0x7f9bd01f48f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:23.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.674+0000 7f9bd593e640 1 --2- 172.21.15.26:0/110531122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bd006a5a0 0x7f9bd00c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:23.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.674+0000 7f9bd593e640 1 -- 172.21.15.26:0/110531122 >> 172.21.15.26:0/110531122 conn(0x7f9bd00b0da0 msgr2=0x7f9bd0069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:23.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.674+0000 7f9bd593e640 1 -- 172.21.15.26:0/110531122 shutdown_connections 2023-10-14T11:13:23.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.674+0000 7f9bd593e640 1 -- 172.21.15.26:0/110531122 wait complete. 2023-10-14T11:13:23.699 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:13:23.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.838+0000 7f7e0aa6b640 1 Processor -- start 2023-10-14T11:13:23.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.838+0000 7f7e0aa6b640 1 -- start start 2023-10-14T11:13:23.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.838+0000 7f7e0aa6b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7e040d15d0 0x7f7e040cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:23.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.838+0000 7f7e0aa6b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7e040d3010 0x7f7e040c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:23.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.838+0000 7f7e0aa6b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e040ce770 con 0x7f7e0415cb90 2023-10-14T11:13:23.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.838+0000 7f7e0aa6b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e040d0600 con 0x7f7e040d3010 2023-10-14T11:13:23.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.838+0000 7f7e0aa6b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e040c6450 con 0x7f7e040d15d0 2023-10-14T11:13:23.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.838+0000 7f7e09008640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7e040d3010 0x7f7e040c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:23.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.838+0000 7f7e09008640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7e040d3010 0x7f7e040c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47490/0 (socket says 172.21.15.26:47490) 2023-10-14T11:13:23.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.838+0000 7f7e09008640 1 -- 172.21.15.26:0/2496578519 learned_addr learned my addr 172.21.15.26:0/2496578519 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:23.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.838+0000 7f7e03fff640 1 --2- 172.21.15.26:0/2496578519 >> v2:172.21.15.110:3300/0 conn(0x7f7e040d15d0 0x7f7e040cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:23.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.838+0000 7f7e09008640 1 -- 172.21.15.26:0/2496578519 >> v2:172.21.15.110:3300/0 conn(0x7f7e040d15d0 msgr2=0x7f7e040cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:23.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.838+0000 7f7e09008640 1 --2- 172.21.15.26:0/2496578519 >> v2:172.21.15.110:3300/0 conn(0x7f7e040d15d0 0x7f7e040cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:23.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.838+0000 7f7e09008640 1 -- 172.21.15.26:0/2496578519 >> v1:172.21.15.110:6789/0 conn(0x7f7e0415cb90 legacy=0x7f7e040d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:23.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.838+0000 7f7e09008640 1 -- 172.21.15.26:0/2496578519 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e040d08a0 con 0x7f7e040d3010 2023-10-14T11:13:23.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.842+0000 7f7e09008640 1 --2- 172.21.15.26:0/2496578519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e040d3010 0x7f7e040c6c10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7e0408a880 tx=0x7f7dfc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a36873c7af76987 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:23.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.842+0000 7f7e037fe640 1 -- 172.21.15.26:0/2496578519 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc0a57d0 con 0x7f7e040d3010 2023-10-14T11:13:23.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.842+0000 7f7e037fe640 1 -- 172.21.15.26:0/2496578519 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dfc0a5930 con 0x7f7e040d3010 2023-10-14T11:13:23.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.842+0000 7f7e037fe640 1 -- 172.21.15.26:0/2496578519 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc0a5cc0 con 0x7f7e040d3010 2023-10-14T11:13:23.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.842+0000 7f7e0aa6b640 1 -- 172.21.15.26:0/2496578519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e040d3010 msgr2=0x7f7e040c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:23.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.842+0000 7f7e0aa6b640 1 --2- 172.21.15.26:0/2496578519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e040d3010 0x7f7e040c6c10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7e0408a880 tx=0x7f7dfc01c910 comp rx=0 tx=0).stop 2023-10-14T11:13:23.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.842+0000 7f7e0aa6b640 1 -- 172.21.15.26:0/2496578519 shutdown_connections 2023-10-14T11:13:23.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.842+0000 7f7e0aa6b640 1 --2- 172.21.15.26:0/2496578519 >> v2:172.21.15.110:3300/0 conn(0x7f7e040d15d0 0x7f7e040cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:23.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.842+0000 7f7e0aa6b640 1 --2- 172.21.15.26:0/2496578519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e040d3010 0x7f7e040c6c10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:23.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.842+0000 7f7e0aa6b640 1 -- 172.21.15.26:0/2496578519 >> 172.21.15.26:0/2496578519 conn(0x7f7e0409bc50 msgr2=0x7f7e040d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:23.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.842+0000 7f7e0aa6b640 1 -- 172.21.15.26:0/2496578519 shutdown_connections 2023-10-14T11:13:23.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.842+0000 7f7e0aa6b640 1 -- 172.21.15.26:0/2496578519 wait complete. 2023-10-14T11:13:23.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e0aa6b640 1 Processor -- start 2023-10-14T11:13:23.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e0aa6b640 1 -- start start 2023-10-14T11:13:23.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e0aa6b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e040d15d0 0x7f7e04157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:23.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e0aa6b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e040d3010 0x7f7e040b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:23.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e0aa6b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e0415cb90 0x7f7e040cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:23.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e0aa6b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e04142a60 con 0x7f7e040d3010 2023-10-14T11:13:23.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e0aa6b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e041580e0 con 0x7f7e040d15d0 2023-10-14T11:13:23.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e0aa6b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e04141de0 con 0x7f7e0415cb90 2023-10-14T11:13:23.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e03fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e040d3010 0x7f7e040b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:23.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e03fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e040d3010 0x7f7e040b0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47492/0 (socket says 172.21.15.26:47492) 2023-10-14T11:13:23.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e03fff640 1 -- 172.21.15.26:0/1552594694 learned_addr learned my addr 172.21.15.26:0/1552594694 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:23.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e08807640 1 --2- 172.21.15.26:0/1552594694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e040d15d0 0x7f7e04157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:23.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e09008640 1 --2- 172.21.15.26:0/1552594694 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e0415cb90 0x7f7e040cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:23.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e03fff640 1 -- 172.21.15.26:0/1552594694 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e0415cb90 msgr2=0x7f7e040cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:23.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e03fff640 1 --2- 172.21.15.26:0/1552594694 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e0415cb90 0x7f7e040cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:23.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e03fff640 1 -- 172.21.15.26:0/1552594694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e040d15d0 msgr2=0x7f7e04157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:23.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e03fff640 1 --2- 172.21.15.26:0/1552594694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e040d15d0 0x7f7e04157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:23.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e03fff640 1 -- 172.21.15.26:0/1552594694 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dfc009b30 con 0x7f7e040d3010 2023-10-14T11:13:23.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e03fff640 1 --2- 172.21.15.26:0/1552594694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e040d3010 0x7f7e040b0c50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7df000e930 tx=0x7f7df000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:23.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e017fa640 1 -- 172.21.15.26:0/1552594694 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0009690 con 0x7f7e040d3010 2023-10-14T11:13:23.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e017fa640 1 -- 172.21.15.26:0/1552594694 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df000ca00 con 0x7f7e040d3010 2023-10-14T11:13:23.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e017fa640 1 -- 172.21.15.26:0/1552594694 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df000cd70 con 0x7f7e040d3010 2023-10-14T11:13:23.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.846+0000 7f7e0aa6b640 1 -- 172.21.15.26:0/1552594694 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e041420c0 con 0x7f7e040d3010 2023-10-14T11:13:23.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.850+0000 7f7e0aa6b640 1 -- 172.21.15.26:0/1552594694 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e04142680 con 0x7f7e040d3010 2023-10-14T11:13:23.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.850+0000 7f7e0aa6b640 1 -- 172.21.15.26:0/1552594694 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e04142ba0 con 0x7f7e040d3010 2023-10-14T11:13:23.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.850+0000 7f7e017fa640 1 -- 172.21.15.26:0/1552594694 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7df0013470 con 0x7f7e040d3010 2023-10-14T11:13:23.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.850+0000 7f7e017fa640 1 --2- 172.21.15.26:0/1552594694 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7de80664a0 0x7f7de8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:23.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.850+0000 7f7e017fa640 1 -- 172.21.15.26:0/1552594694 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7df0084500 con 0x7f7e040d3010 2023-10-14T11:13:23.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.850+0000 7f7e08807640 1 --2- 172.21.15.26:0/1552594694 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7de80664a0 0x7f7de8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:23.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.850+0000 7f7e08807640 1 --2- 172.21.15.26:0/1552594694 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7de80664a0 0x7f7de8068960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7e041f7e40 tx=0x7f7df8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:23.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:23.854+0000 7f7e017fa640 1 -- 172.21.15.26:0/1552594694 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7e04142ba0 con 0x7f7e040d3010 2023-10-14T11:13:24.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.026+0000 7f7e0aa6b640 1 -- 172.21.15.26:0/1552594694 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7e04142ba0 con 0x7f7e040d3010 2023-10-14T11:13:24.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.026+0000 7f7e017fa640 1 -- 172.21.15.26:0/1552594694 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7e04142ba0 con 0x7f7e040d3010 2023-10-14T11:13:24.031 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-10-14T11:13:24.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.026+0000 7f7e0aa6b640 1 -- 172.21.15.26:0/1552594694 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7de80664a0 msgr2=0x7f7de8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:24.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.026+0000 7f7e0aa6b640 1 --2- 172.21.15.26:0/1552594694 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7de80664a0 0x7f7de8068960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7e041f7e40 tx=0x7f7df8009040 comp rx=0 tx=0).stop 2023-10-14T11:13:24.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.026+0000 7f7e0aa6b640 1 -- 172.21.15.26:0/1552594694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e040d3010 msgr2=0x7f7e040b0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:24.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.026+0000 7f7e0aa6b640 1 --2- 172.21.15.26:0/1552594694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e040d3010 0x7f7e040b0c50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7df000e930 tx=0x7f7df000edf0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.026+0000 7f7e0aa6b640 1 -- 172.21.15.26:0/1552594694 shutdown_connections 2023-10-14T11:13:24.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.026+0000 7f7e0aa6b640 1 --2- 172.21.15.26:0/1552594694 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e0415cb90 0x7f7e040cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.026+0000 7f7e0aa6b640 1 --2- 172.21.15.26:0/1552594694 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7de80664a0 0x7f7de8068960 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.026+0000 7f7e0aa6b640 1 --2- 172.21.15.26:0/1552594694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e040d3010 0x7f7e040b0c50 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.026+0000 7f7e0aa6b640 1 --2- 172.21.15.26:0/1552594694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e040d15d0 0x7f7e04157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.026+0000 7f7e0aa6b640 1 -- 172.21.15.26:0/1552594694 >> 172.21.15.26:0/1552594694 conn(0x7f7e0409bc50 msgr2=0x7f7e040d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:24.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.026+0000 7f7e0aa6b640 1 -- 172.21.15.26:0/1552594694 shutdown_connections 2023-10-14T11:13:24.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.026+0000 7f7e0aa6b640 1 -- 172.21.15.26:0/1552594694 wait complete. 2023-10-14T11:13:24.053 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:13:24.053 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:13:24.064 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:13:24.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.202+0000 7f6de3b65640 1 Processor -- start 2023-10-14T11:13:24.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.202+0000 7f6de3b65640 1 -- start start 2023-10-14T11:13:24.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.202+0000 7f6de3b65640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6ddc0cf090 0x7f6ddc0cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:24.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.202+0000 7f6de3b65640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ddc0c6ad0 0x7f6ddc0c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:24.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.202+0000 7f6de3b65640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ddc0c65f0 con 0x7f6ddc15ca70 2023-10-14T11:13:24.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.202+0000 7f6de3b65640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ddc0cfa60 con 0x7f6ddc0c6ad0 2023-10-14T11:13:24.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.202+0000 7f6de3b65640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ddc0ce820 con 0x7f6ddc0cf090 2023-10-14T11:13:24.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.202+0000 7f6de2102640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ddc0c6ad0 0x7f6ddc0c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:24.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.202+0000 7f6de2102640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ddc0c6ad0 0x7f6ddc0c6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47506/0 (socket says 172.21.15.26:47506) 2023-10-14T11:13:24.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.202+0000 7f6de2102640 1 -- 172.21.15.26:0/70536213 learned_addr learned my addr 172.21.15.26:0/70536213 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:24.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.202+0000 7f6de1100640 1 --2- 172.21.15.26:0/70536213 >> v2:172.21.15.110:3300/0 conn(0x7f6ddc0cf090 0x7f6ddc0cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.202+0000 7f6de2102640 1 -- 172.21.15.26:0/70536213 >> v2:172.21.15.110:3300/0 conn(0x7f6ddc0cf090 msgr2=0x7f6ddc0cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.202+0000 7f6de2102640 1 --2- 172.21.15.26:0/70536213 >> v2:172.21.15.110:3300/0 conn(0x7f6ddc0cf090 0x7f6ddc0cf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.202+0000 7f6de2102640 1 -- 172.21.15.26:0/70536213 >> v1:172.21.15.26:6789/0 conn(0x7f6ddc15ca70 legacy=0x7f6ddc0d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.202+0000 7f6de2102640 1 -- 172.21.15.26:0/70536213 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc0cdf80 con 0x7f6ddc0c6ad0 2023-10-14T11:13:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.202+0000 7f6de08ff640 1 -- 172.21.15.26:0/70536213 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953056313 0 0) 0x7f6ddc0c65f0 con 0x7f6ddc15ca70 2023-10-14T11:13:24.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.206+0000 7f6de2102640 1 --2- 172.21.15.26:0/70536213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ddc0c6ad0 0x7f6ddc0c6f00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc0b54f0 tx=0x7f6dd401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b791ea20baff5a07 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:24.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.206+0000 7f6de08ff640 1 -- 172.21.15.26:0/70536213 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd40a5860 con 0x7f6ddc0c6ad0 2023-10-14T11:13:24.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.206+0000 7f6de08ff640 1 -- 172.21.15.26:0/70536213 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd40a59c0 con 0x7f6ddc0c6ad0 2023-10-14T11:13:24.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.206+0000 7f6de08ff640 1 -- 172.21.15.26:0/70536213 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd40a5d50 con 0x7f6ddc0c6ad0 2023-10-14T11:13:24.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.206+0000 7f6de3b65640 1 -- 172.21.15.26:0/70536213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ddc0c6ad0 msgr2=0x7f6ddc0c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:24.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.206+0000 7f6de3b65640 1 --2- 172.21.15.26:0/70536213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ddc0c6ad0 0x7f6ddc0c6f00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc0b54f0 tx=0x7f6dd401c9a0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.206+0000 7f6de3b65640 1 -- 172.21.15.26:0/70536213 shutdown_connections 2023-10-14T11:13:24.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.206+0000 7f6de3b65640 1 --2- 172.21.15.26:0/70536213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ddc0c6ad0 0x7f6ddc0c6f00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.206+0000 7f6de3b65640 1 --2- 172.21.15.26:0/70536213 >> v2:172.21.15.110:3300/0 conn(0x7f6ddc0cf090 0x7f6ddc0cf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.206+0000 7f6de3b65640 1 -- 172.21.15.26:0/70536213 >> 172.21.15.26:0/70536213 conn(0x7f6ddc09bc50 msgr2=0x7f6ddc0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:24.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.206+0000 7f6de3b65640 1 -- 172.21.15.26:0/70536213 shutdown_connections 2023-10-14T11:13:24.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.206+0000 7f6de3b65640 1 -- 172.21.15.26:0/70536213 wait complete. 2023-10-14T11:13:24.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.210+0000 7f6de3b65640 1 Processor -- start 2023-10-14T11:13:24.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.210+0000 7f6de3b65640 1 -- start start 2023-10-14T11:13:24.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.210+0000 7f6de3b65640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ddc0c6ad0 0x7f6ddc147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:24.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.210+0000 7f6de3b65640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ddc0cf090 0x7f6ddc0b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:24.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.210+0000 7f6de3b65640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ddc15ca70 0x7f6ddc0b6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:24.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.210+0000 7f6de3b65640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc156c40 con 0x7f6ddc15ca70 2023-10-14T11:13:24.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.210+0000 7f6de3b65640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc0c9b50 con 0x7f6ddc0cf090 2023-10-14T11:13:24.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.210+0000 7f6de3b65640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc0c9e30 con 0x7f6ddc0c6ad0 2023-10-14T11:13:24.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.210+0000 7f6de2102640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ddc15ca70 0x7f6ddc0b6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:24.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.210+0000 7f6de2102640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ddc15ca70 0x7f6ddc0b6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47516/0 (socket says 172.21.15.26:47516) 2023-10-14T11:13:24.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.210+0000 7f6de2102640 1 -- 172.21.15.26:0/2469250990 learned_addr learned my addr 172.21.15.26:0/2469250990 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:24.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.210+0000 7f6de2102640 1 -- 172.21.15.26:0/2469250990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ddc0c6ad0 msgr2=0x7f6ddc147dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:24.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.210+0000 7f6de2102640 1 --2- 172.21.15.26:0/2469250990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ddc0c6ad0 0x7f6ddc147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.210+0000 7f6de2102640 1 -- 172.21.15.26:0/2469250990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ddc0cf090 msgr2=0x7f6ddc0b6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:24.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.210+0000 7f6de2102640 1 --2- 172.21.15.26:0/2469250990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ddc0cf090 0x7f6ddc0b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.210+0000 7f6de2102640 1 -- 172.21.15.26:0/2469250990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd4009b30 con 0x7f6ddc15ca70 2023-10-14T11:13:24.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.210+0000 7f6de2102640 1 --2- 172.21.15.26:0/2469250990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ddc15ca70 0x7f6ddc0b6bb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40195b0 tx=0x7f6dd4019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:24.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.210+0000 7f6dd27fc640 1 -- 172.21.15.26:0/2469250990 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd40b8670 con 0x7f6ddc15ca70 2023-10-14T11:13:24.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.210+0000 7f6dd27fc640 1 -- 172.21.15.26:0/2469250990 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd40b8830 con 0x7f6ddc15ca70 2023-10-14T11:13:24.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.210+0000 7f6dd27fc640 1 -- 172.21.15.26:0/2469250990 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd40b8be0 con 0x7f6ddc15ca70 2023-10-14T11:13:24.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.210+0000 7f6de3b65640 1 -- 172.21.15.26:0/2469250990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ddc0d38a0 con 0x7f6ddc15ca70 2023-10-14T11:13:24.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.210+0000 7f6de3b65640 1 -- 172.21.15.26:0/2469250990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ddc1454e0 con 0x7f6ddc15ca70 2023-10-14T11:13:24.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.214+0000 7f6de3b65640 1 -- 172.21.15.26:0/2469250990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ddc157120 con 0x7f6ddc15ca70 2023-10-14T11:13:24.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.214+0000 7f6dd27fc640 1 -- 172.21.15.26:0/2469250990 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6dd40b8d40 con 0x7f6ddc15ca70 2023-10-14T11:13:24.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.214+0000 7f6dd27fc640 1 --2- 172.21.15.26:0/2469250990 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6dc00664a0 0x7f6dc0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:24.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.214+0000 7f6dd27fc640 1 -- 172.21.15.26:0/2469250990 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6dd411f900 con 0x7f6ddc15ca70 2023-10-14T11:13:24.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.214+0000 7f6de1901640 1 --2- 172.21.15.26:0/2469250990 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6dc00664a0 0x7f6dc0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:24.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.214+0000 7f6de1901640 1 --2- 172.21.15.26:0/2469250990 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6dc00664a0 0x7f6dc0068960 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8001600 tx=0x7f6dd8007890 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:24.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.218+0000 7f6dd27fc640 1 -- 172.21.15.26:0/2469250990 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6ddc157120 con 0x7f6ddc15ca70 2023-10-14T11:13:24.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.374+0000 7f6de3b65640 1 -- 172.21.15.26:0/2469250990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ddc157120 con 0x7f6ddc15ca70 2023-10-14T11:13:24.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.378+0000 7f6dd27fc640 1 -- 172.21.15.26:0/2469250990 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18679 (secure 0 0 0) 0x7f6ddc157120 con 0x7f6ddc15ca70 2023-10-14T11:13:24.384 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:24.384 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":27,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:13:03.866737+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:13:24.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.378+0000 7f6de3b65640 1 -- 172.21.15.26:0/2469250990 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6dc00664a0 msgr2=0x7f6dc0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:24.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.378+0000 7f6de3b65640 1 --2- 172.21.15.26:0/2469250990 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6dc00664a0 0x7f6dc0068960 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8001600 tx=0x7f6dd8007890 comp rx=0 tx=0).stop 2023-10-14T11:13:24.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.378+0000 7f6de3b65640 1 -- 172.21.15.26:0/2469250990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ddc15ca70 msgr2=0x7f6ddc0b6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:24.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.378+0000 7f6de3b65640 1 --2- 172.21.15.26:0/2469250990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ddc15ca70 0x7f6ddc0b6bb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40195b0 tx=0x7f6dd4019740 comp rx=0 tx=0).stop 2023-10-14T11:13:24.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.378+0000 7f6de3b65640 1 -- 172.21.15.26:0/2469250990 shutdown_connections 2023-10-14T11:13:24.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.378+0000 7f6de3b65640 1 --2- 172.21.15.26:0/2469250990 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6dc00664a0 0x7f6dc0068960 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.378+0000 7f6de3b65640 1 --2- 172.21.15.26:0/2469250990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ddc15ca70 0x7f6ddc0b6bb0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.378+0000 7f6de3b65640 1 --2- 172.21.15.26:0/2469250990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ddc0cf090 0x7f6ddc0b6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.378+0000 7f6de3b65640 1 --2- 172.21.15.26:0/2469250990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ddc0c6ad0 0x7f6ddc147dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.378+0000 7f6de3b65640 1 -- 172.21.15.26:0/2469250990 >> 172.21.15.26:0/2469250990 conn(0x7f6ddc09bc50 msgr2=0x7f6ddc0ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:24.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.378+0000 7f6de3b65640 1 -- 172.21.15.26:0/2469250990 shutdown_connections 2023-10-14T11:13:24.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.378+0000 7f6de3b65640 1 -- 172.21.15.26:0/2469250990 wait complete. 2023-10-14T11:13:24.404 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:12:20.179562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:12:21.346111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T11:12:25.025159+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T11:13:24.405 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:13:24.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.546+0000 7fa50e846640 1 Processor -- start 2023-10-14T11:13:24.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.546+0000 7fa50e846640 1 -- start start 2023-10-14T11:13:24.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.546+0000 7fa50e846640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa508069e90 0x7fa50806d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:24.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.546+0000 7fa50e846640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa50806a270 0x7fa5080c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:24.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.546+0000 7fa50e846640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50815ae30 con 0x7fa5080702f0 2023-10-14T11:13:24.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.546+0000 7fa50e846640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5080cb090 con 0x7fa50806a270 2023-10-14T11:13:24.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.546+0000 7fa50e846640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5080ca510 con 0x7fa508069e90 2023-10-14T11:13:24.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.546+0000 7fa50cde3640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa5080702f0 0x7fa508070780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44520/0 (socket says 172.21.15.26:44520) 2023-10-14T11:13:24.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.546+0000 7fa50cde3640 1 -- 172.21.15.26:0/3078266294 learned_addr learned my addr 172.21.15.26:0/3078266294 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:24.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.546+0000 7fa5077fe640 1 --2- 172.21.15.26:0/3078266294 >> v2:172.21.15.110:3300/0 conn(0x7fa50806a270 0x7fa5080c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:24.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.546+0000 7fa507fff640 1 --2- 172.21.15.26:0/3078266294 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa508069e90 0x7fa50806d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:24.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.546+0000 7fa506ffd640 1 -- 172.21.15.26:0/3078266294 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1549513355 0 0) 0x7fa50815ae30 con 0x7fa5080702f0 2023-10-14T11:13:24.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.546+0000 7fa506ffd640 1 -- 172.21.15.26:0/3078266294 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4f0003530 con 0x7fa5080702f0 2023-10-14T11:13:24.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.546+0000 7fa5077fe640 1 -- 172.21.15.26:0/3078266294 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa508069e90 msgr2=0x7fa50806d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:24.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.546+0000 7fa5077fe640 1 --2- 172.21.15.26:0/3078266294 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa508069e90 0x7fa50806d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.546+0000 7fa5077fe640 1 -- 172.21.15.26:0/3078266294 >> v1:172.21.15.26:6789/0 conn(0x7fa5080702f0 legacy=0x7fa508070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:24.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.546+0000 7fa5077fe640 1 -- 172.21.15.26:0/3078266294 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5080ca7f0 con 0x7fa50806a270 2023-10-14T11:13:24.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.546+0000 7fa507fff640 1 --2- 172.21.15.26:0/3078266294 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa508069e90 0x7fa50806d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:13:24.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.550+0000 7fa5077fe640 1 --2- 172.21.15.26:0/3078266294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa50806a270 0x7fa5080c9ce0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0097c0 tx=0x7fa4fc01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b740eff53392c6a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:24.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.550+0000 7fa506ffd640 1 -- 172.21.15.26:0/3078266294 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc0ab650 con 0x7fa50806a270 2023-10-14T11:13:24.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.550+0000 7fa506ffd640 1 -- 172.21.15.26:0/3078266294 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc0ab7b0 con 0x7fa50806a270 2023-10-14T11:13:24.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.550+0000 7fa506ffd640 1 -- 172.21.15.26:0/3078266294 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc0abb40 con 0x7fa50806a270 2023-10-14T11:13:24.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.550+0000 7fa50e846640 1 -- 172.21.15.26:0/3078266294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa50806a270 msgr2=0x7fa5080c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:24.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.550+0000 7fa50e846640 1 --2- 172.21.15.26:0/3078266294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa50806a270 0x7fa5080c9ce0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0097c0 tx=0x7fa4fc01c450 comp rx=0 tx=0).stop 2023-10-14T11:13:24.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.550+0000 7fa50e846640 1 -- 172.21.15.26:0/3078266294 shutdown_connections 2023-10-14T11:13:24.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.550+0000 7fa50e846640 1 --2- 172.21.15.26:0/3078266294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa50806a270 0x7fa5080c9ce0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.550+0000 7fa50e846640 1 --2- 172.21.15.26:0/3078266294 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa508069e90 0x7fa50806d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.550+0000 7fa50e846640 1 -- 172.21.15.26:0/3078266294 >> 172.21.15.26:0/3078266294 conn(0x7fa5080b0da0 msgr2=0x7fa5080ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:24.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.550+0000 7fa50e846640 1 -- 172.21.15.26:0/3078266294 shutdown_connections 2023-10-14T11:13:24.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.550+0000 7fa50e846640 1 -- 172.21.15.26:0/3078266294 wait complete. 2023-10-14T11:13:24.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa50e846640 1 Processor -- start 2023-10-14T11:13:24.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa50e846640 1 -- start start 2023-10-14T11:13:24.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa50e846640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa508069e90 0x7fa5080c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:24.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa50e846640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa50806a270 0x7fa50815b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:24.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa50e846640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5080702f0 0x7fa50815b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:24.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa50e846640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50815c810 con 0x7fa50806a270 2023-10-14T11:13:24.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa50e846640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50815bc00 con 0x7fa508069e90 2023-10-14T11:13:24.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa50e846640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50815bee0 con 0x7fa5080702f0 2023-10-14T11:13:24.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa5077fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa50806a270 0x7fa50815b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:24.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa5077fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa50806a270 0x7fa50815b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47526/0 (socket says 172.21.15.26:47526) 2023-10-14T11:13:24.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa5077fe640 1 -- 172.21.15.26:0/3892780146 learned_addr learned my addr 172.21.15.26:0/3892780146 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:24.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa507fff640 1 --2- 172.21.15.26:0/3892780146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa508069e90 0x7fa5080c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:24.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa50cde3640 1 --2- 172.21.15.26:0/3892780146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5080702f0 0x7fa50815b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:24.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa5077fe640 1 -- 172.21.15.26:0/3892780146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5080702f0 msgr2=0x7fa50815b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:24.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa5077fe640 1 --2- 172.21.15.26:0/3892780146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5080702f0 0x7fa50815b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa5077fe640 1 -- 172.21.15.26:0/3892780146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa508069e90 msgr2=0x7fa5080c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:24.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa5077fe640 1 --2- 172.21.15.26:0/3892780146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa508069e90 0x7fa5080c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa5077fe640 1 -- 172.21.15.26:0/3892780146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f8009420 con 0x7fa50806a270 2023-10-14T11:13:24.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa50cde3640 1 --2- 172.21.15.26:0/3892780146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5080702f0 0x7fa50815b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:24.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa5077fe640 1 --2- 172.21.15.26:0/3892780146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa50806a270 0x7fa50815b010 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc01a080 tx=0x7fa4fc01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:24.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa504ff9640 1 -- 172.21.15.26:0/3892780146 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc0bf610 con 0x7fa50806a270 2023-10-14T11:13:24.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa504ff9640 1 -- 172.21.15.26:0/3892780146 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc0bf790 con 0x7fa50806a270 2023-10-14T11:13:24.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa504ff9640 1 -- 172.21.15.26:0/3892780146 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc0bfb40 con 0x7fa50806a270 2023-10-14T11:13:24.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa50e846640 1 -- 172.21.15.26:0/3892780146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4fc009420 con 0x7fa50806a270 2023-10-14T11:13:24.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.554+0000 7fa50e846640 1 -- 172.21.15.26:0/3892780146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50815c4a0 con 0x7fa50806a270 2023-10-14T11:13:24.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.558+0000 7fa50e846640 1 -- 172.21.15.26:0/3892780146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50815c980 con 0x7fa50806a270 2023-10-14T11:13:24.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.558+0000 7fa504ff9640 1 -- 172.21.15.26:0/3892780146 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa4fc0b5400 con 0x7fa50806a270 2023-10-14T11:13:24.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.558+0000 7fa504ff9640 1 --2- 172.21.15.26:0/3892780146 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa4f40664d0 0x7fa4f4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:24.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.558+0000 7fa504ff9640 1 -- 172.21.15.26:0/3892780146 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa4fc11ed00 con 0x7fa50806a270 2023-10-14T11:13:24.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.558+0000 7fa507fff640 1 --2- 172.21.15.26:0/3892780146 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa4f40664d0 0x7fa4f4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:24.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.558+0000 7fa507fff640 1 --2- 172.21.15.26:0/3892780146 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa4f40664d0 0x7fa4f4068990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8009cf0 tx=0x7fa4f8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:24.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.562+0000 7fa504ff9640 1 -- 172.21.15.26:0/3892780146 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa4fc0ebd50 con 0x7fa50806a270 2023-10-14T11:13:24.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.718+0000 7fa50e846640 1 -- 172.21.15.26:0/3892780146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa50804e170 con 0x7fa50806a270 2023-10-14T11:13:24.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.718+0000 7fa504ff9640 1 -- 172.21.15.26:0/3892780146 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa4fc0ef370 con 0x7fa50806a270 2023-10-14T11:13:24.725 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:13:24.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.722+0000 7fa50e846640 1 -- 172.21.15.26:0/3892780146 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa4f40664d0 msgr2=0x7fa4f4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:24.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.722+0000 7fa50e846640 1 --2- 172.21.15.26:0/3892780146 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa4f40664d0 0x7fa4f4068990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8009cf0 tx=0x7fa4f8009190 comp rx=0 tx=0).stop 2023-10-14T11:13:24.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.722+0000 7fa50e846640 1 -- 172.21.15.26:0/3892780146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa50806a270 msgr2=0x7fa50815b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:24.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.722+0000 7fa50e846640 1 --2- 172.21.15.26:0/3892780146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa50806a270 0x7fa50815b010 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc01a080 tx=0x7fa4fc01ac90 comp rx=0 tx=0).stop 2023-10-14T11:13:24.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.722+0000 7fa50e846640 1 -- 172.21.15.26:0/3892780146 shutdown_connections 2023-10-14T11:13:24.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.722+0000 7fa50e846640 1 --2- 172.21.15.26:0/3892780146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5080702f0 0x7fa50815b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.722+0000 7fa50e846640 1 --2- 172.21.15.26:0/3892780146 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa4f40664d0 0x7fa4f4068990 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.722+0000 7fa50e846640 1 --2- 172.21.15.26:0/3892780146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa50806a270 0x7fa50815b010 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.722+0000 7fa50e846640 1 --2- 172.21.15.26:0/3892780146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa508069e90 0x7fa5080c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.722+0000 7fa50e846640 1 -- 172.21.15.26:0/3892780146 >> 172.21.15.26:0/3892780146 conn(0x7fa5080b0da0 msgr2=0x7fa50815d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:24.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.722+0000 7fa50e846640 1 -- 172.21.15.26:0/3892780146 shutdown_connections 2023-10-14T11:13:24.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.722+0000 7fa50e846640 1 -- 172.21.15.26:0/3892780146 wait complete. 2023-10-14T11:13:24.747 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:13:24.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.886+0000 7fe1bbec9640 1 Processor -- start 2023-10-14T11:13:24.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.886+0000 7fe1bbec9640 1 -- start start 2023-10-14T11:13:24.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.890+0000 7fe1bbec9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe1b40cb040 0x7fe1b40ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:24.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.890+0000 7fe1bbec9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1b40cebd0 0x7fe1b40cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:24.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.890+0000 7fe1bbec9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b40cf020 con 0x7fe1b415cc60 2023-10-14T11:13:24.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.890+0000 7fe1bbec9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b40cc330 con 0x7fe1b40cb040 2023-10-14T11:13:24.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.890+0000 7fe1bbec9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b40cb4d0 con 0x7fe1b40cebd0 2023-10-14T11:13:24.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.890+0000 7fe1b9c65640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe1b415cc60 0x7fe1b4161260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44532/0 (socket says 172.21.15.26:44532) 2023-10-14T11:13:24.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.890+0000 7fe1b9c65640 1 -- 172.21.15.26:0/3455393414 learned_addr learned my addr 172.21.15.26:0/3455393414 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:24.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.890+0000 7fe1b9464640 1 --2- 172.21.15.26:0/3455393414 >> v2:172.21.15.110:3300/0 conn(0x7fe1b40cb040 0x7fe1b40ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:24.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.890+0000 7fe1ba466640 1 --2- 172.21.15.26:0/3455393414 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1b40cebd0 0x7fe1b40cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:24.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.890+0000 7fe1b8c63640 1 -- 172.21.15.26:0/3455393414 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2624310584 0 0) 0x7fe1b0001120 con 0x7fe1b415cc60 2023-10-14T11:13:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.890+0000 7fe1b8c63640 1 -- 172.21.15.26:0/3455393414 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1a0003530 con 0x7fe1b415cc60 2023-10-14T11:13:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.890+0000 7fe1b9464640 1 -- 172.21.15.26:0/3455393414 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1b40cebd0 msgr2=0x7fe1b40cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.890+0000 7fe1b9464640 1 --2- 172.21.15.26:0/3455393414 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1b40cebd0 0x7fe1b40cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.890+0000 7fe1b9464640 1 -- 172.21.15.26:0/3455393414 >> v1:172.21.15.26:6789/0 conn(0x7fe1b415cc60 legacy=0x7fe1b4161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:24.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.890+0000 7fe1b9464640 1 -- 172.21.15.26:0/3455393414 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b40cb720 con 0x7fe1b40cb040 2023-10-14T11:13:24.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.890+0000 7fe1b9464640 1 --2- 172.21.15.26:0/3455393414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1b40cb040 0x7fe1b40ce690 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe1a40097c0 tx=0x7fe1a401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d75b83bd14e13906 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:24.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.894+0000 7fe1b8c63640 1 -- 172.21.15.26:0/3455393414 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a40ab650 con 0x7fe1b40cb040 2023-10-14T11:13:24.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.894+0000 7fe1b8c63640 1 -- 172.21.15.26:0/3455393414 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a40ab7b0 con 0x7fe1b40cb040 2023-10-14T11:13:24.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.894+0000 7fe1b8c63640 1 -- 172.21.15.26:0/3455393414 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a40abb40 con 0x7fe1b40cb040 2023-10-14T11:13:24.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.894+0000 7fe1bbec9640 1 -- 172.21.15.26:0/3455393414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1b40cb040 msgr2=0x7fe1b40ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:24.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.894+0000 7fe1bbec9640 1 --2- 172.21.15.26:0/3455393414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1b40cb040 0x7fe1b40ce690 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe1a40097c0 tx=0x7fe1a401c450 comp rx=0 tx=0).stop 2023-10-14T11:13:24.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.894+0000 7fe1bbec9640 1 -- 172.21.15.26:0/3455393414 shutdown_connections 2023-10-14T11:13:24.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.894+0000 7fe1bbec9640 1 --2- 172.21.15.26:0/3455393414 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1b40cebd0 0x7fe1b40cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.894+0000 7fe1bbec9640 1 --2- 172.21.15.26:0/3455393414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1b40cb040 0x7fe1b40ce690 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.894+0000 7fe1bbec9640 1 -- 172.21.15.26:0/3455393414 >> 172.21.15.26:0/3455393414 conn(0x7fe1b406e570 msgr2=0x7fe1b406e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:24.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.894+0000 7fe1bbec9640 1 -- 172.21.15.26:0/3455393414 shutdown_connections 2023-10-14T11:13:24.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.894+0000 7fe1bbec9640 1 -- 172.21.15.26:0/3455393414 wait complete. 2023-10-14T11:13:24.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.894+0000 7fe1bbec9640 1 Processor -- start 2023-10-14T11:13:24.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.894+0000 7fe1bbec9640 1 -- start start 2023-10-14T11:13:24.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1bbec9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1b40cb040 0x7fe1b40b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:24.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1bbec9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1b40cebd0 0x7fe1b4153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:24.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1bbec9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1b415cc60 0x7fe1b415ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:24.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1bbec9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b41559a0 con 0x7fe1b40cb040 2023-10-14T11:13:24.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1bbec9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b41553e0 con 0x7fe1b415cc60 2023-10-14T11:13:24.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1bbec9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b41556c0 con 0x7fe1b40cebd0 2023-10-14T11:13:24.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1b9c65640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1b40cb040 0x7fe1b40b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:24.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1b9c65640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1b40cb040 0x7fe1b40b6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47528/0 (socket says 172.21.15.26:47528) 2023-10-14T11:13:24.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1b9c65640 1 -- 172.21.15.26:0/1876137385 learned_addr learned my addr 172.21.15.26:0/1876137385 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:24.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1b9464640 1 --2- 172.21.15.26:0/1876137385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1b40cebd0 0x7fe1b4153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:24.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1ba466640 1 --2- 172.21.15.26:0/1876137385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1b415cc60 0x7fe1b415ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:24.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1b9c65640 1 -- 172.21.15.26:0/1876137385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1b40cebd0 msgr2=0x7fe1b4153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:24.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1b9c65640 1 --2- 172.21.15.26:0/1876137385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1b40cebd0 0x7fe1b4153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1b9c65640 1 -- 172.21.15.26:0/1876137385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1b415cc60 msgr2=0x7fe1b415ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:24.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1b9c65640 1 --2- 172.21.15.26:0/1876137385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1b415cc60 0x7fe1b415ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:24.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1b9c65640 1 -- 172.21.15.26:0/1876137385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a4009420 con 0x7fe1b40cb040 2023-10-14T11:13:24.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1b9c65640 1 --2- 172.21.15.26:0/1876137385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1b40cb040 0x7fe1b40b6020 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000c400 tx=0x7fe1b000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:24.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1aa7fc640 1 -- 172.21.15.26:0/1876137385 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0005cf0 con 0x7fe1b40cb040 2023-10-14T11:13:24.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1aa7fc640 1 -- 172.21.15.26:0/1876137385 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b0005e70 con 0x7fe1b40cb040 2023-10-14T11:13:24.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1bbec9640 1 -- 172.21.15.26:0/1876137385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b40c7ab0 con 0x7fe1b40cb040 2023-10-14T11:13:24.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1aa7fc640 1 -- 172.21.15.26:0/1876137385 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b00072f0 con 0x7fe1b40cb040 2023-10-14T11:13:24.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1bbec9640 1 -- 172.21.15.26:0/1876137385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b41543b0 con 0x7fe1b40cb040 2023-10-14T11:13:24.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1bbec9640 1 -- 172.21.15.26:0/1876137385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b404e170 con 0x7fe1b40cb040 2023-10-14T11:13:24.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.898+0000 7fe1aa7fc640 1 -- 172.21.15.26:0/1876137385 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe1b0007450 con 0x7fe1b40cb040 2023-10-14T11:13:24.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.902+0000 7fe1aa7fc640 1 --2- 172.21.15.26:0/1876137385 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe1980664a0 0x7fe198068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:24.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.902+0000 7fe1aa7fc640 1 -- 172.21.15.26:0/1876137385 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe1b0083640 con 0x7fe1b40cb040 2023-10-14T11:13:24.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.902+0000 7fe1b9464640 1 --2- 172.21.15.26:0/1876137385 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe1980664a0 0x7fe198068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:24.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.902+0000 7fe1b9464640 1 --2- 172.21.15.26:0/1876137385 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe1980664a0 0x7fe198068960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe1a40af000 tx=0x7fe1a40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:24.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:24.906+0000 7fe1aa7fc640 1 -- 172.21.15.26:0/1876137385 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe1b00507a0 con 0x7fe1b40cb040 2023-10-14T11:13:25.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.062+0000 7fe1bbec9640 1 -- 172.21.15.26:0/1876137385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe1b40cf020 con 0x7fe1b40cb040 2023-10-14T11:13:25.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.062+0000 7fe1aa7fc640 1 -- 172.21.15.26:0/1876137385 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe1b40cf020 con 0x7fe1b40cb040 2023-10-14T11:13:25.067 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.062+0000 7fe1bbec9640 1 -- 172.21.15.26:0/1876137385 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe1980664a0 msgr2=0x7fe198068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.062+0000 7fe1bbec9640 1 --2- 172.21.15.26:0/1876137385 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe1980664a0 0x7fe198068960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe1a40af000 tx=0x7fe1a40a7000 comp rx=0 tx=0).stop 2023-10-14T11:13:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.062+0000 7fe1bbec9640 1 -- 172.21.15.26:0/1876137385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1b40cb040 msgr2=0x7fe1b40b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.062+0000 7fe1bbec9640 1 --2- 172.21.15.26:0/1876137385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1b40cb040 0x7fe1b40b6020 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000c400 tx=0x7fe1b000c8c0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.062+0000 7fe1bbec9640 1 -- 172.21.15.26:0/1876137385 shutdown_connections 2023-10-14T11:13:25.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.062+0000 7fe1bbec9640 1 --2- 172.21.15.26:0/1876137385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1b415cc60 0x7fe1b415ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.062+0000 7fe1bbec9640 1 --2- 172.21.15.26:0/1876137385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1b40cebd0 0x7fe1b4153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.062+0000 7fe1bbec9640 1 --2- 172.21.15.26:0/1876137385 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe1980664a0 0x7fe198068960 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.062+0000 7fe1bbec9640 1 --2- 172.21.15.26:0/1876137385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1b40cb040 0x7fe1b40b6020 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.062+0000 7fe1bbec9640 1 -- 172.21.15.26:0/1876137385 >> 172.21.15.26:0/1876137385 conn(0x7fe1b406e570 msgr2=0x7fe1b415f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:25.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.062+0000 7fe1bbec9640 1 -- 172.21.15.26:0/1876137385 shutdown_connections 2023-10-14T11:13:25.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.062+0000 7fe1bbec9640 1 -- 172.21.15.26:0/1876137385 wait complete. 2023-10-14T11:13:25.088 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:13:25.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.230+0000 7f22e9980640 1 Processor -- start 2023-10-14T11:13:25.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.230+0000 7f22e9980640 1 -- start start 2023-10-14T11:13:25.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.230+0000 7f22e9980640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f22e415cba0 0x7f22e40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:25.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.230+0000 7f22e9980640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22e40d0210 0x7f22e40b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:25.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.230+0000 7f22e9980640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e40d1670 con 0x7f22e40b84e0 2023-10-14T11:13:25.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.230+0000 7f22e9980640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e40d1460 con 0x7f22e415cba0 2023-10-14T11:13:25.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.230+0000 7f22e9980640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e40d1950 con 0x7f22e40d0210 2023-10-14T11:13:25.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.230+0000 7f22e2ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f22e415cba0 0x7f22e40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:25.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.230+0000 7f22dbfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f22e40b84e0 0x7f22e40cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44544/0 (socket says 172.21.15.26:44544) 2023-10-14T11:13:25.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.230+0000 7f22e2ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f22e415cba0 0x7f22e40d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47538/0 (socket says 172.21.15.26:47538) 2023-10-14T11:13:25.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.230+0000 7f22dbfff640 1 -- 172.21.15.26:0/3825430399 learned_addr learned my addr 172.21.15.26:0/3825430399 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:25.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.230+0000 7f22e37fe640 1 --2- 172.21.15.26:0/3825430399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22e40d0210 0x7f22e40b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:25.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.230+0000 7f22e2ffd640 1 -- 172.21.15.26:0/3825430399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22e40d0210 msgr2=0x7f22e40b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:25.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.230+0000 7f22e2ffd640 1 --2- 172.21.15.26:0/3825430399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22e40d0210 0x7f22e40b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.230+0000 7f22e2ffd640 1 -- 172.21.15.26:0/3825430399 >> v1:172.21.15.26:6789/0 conn(0x7f22e40b84e0 legacy=0x7f22e40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:25.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.230+0000 7f22e2ffd640 1 -- 172.21.15.26:0/3825430399 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e40d1c30 con 0x7f22e415cba0 2023-10-14T11:13:25.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.230+0000 7f22e27fc640 1 -- 172.21.15.26:0/3825430399 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364035677 0 0) 0x7f22e40d1670 con 0x7f22e40b84e0 2023-10-14T11:13:25.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.230+0000 7f22e37fe640 1 --2- 172.21.15.26:0/3825430399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22e40d0210 0x7f22e40b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:25.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.234+0000 7f22e2ffd640 1 --2- 172.21.15.26:0/3825430399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22e415cba0 0x7f22e40d0f20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f22d40097c0 tx=0x7f22d401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a496c7ccbbdc029 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:25.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.234+0000 7f22e27fc640 1 -- 172.21.15.26:0/3825430399 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40ab680 con 0x7f22e415cba0 2023-10-14T11:13:25.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.234+0000 7f22e27fc640 1 -- 172.21.15.26:0/3825430399 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d40ab7e0 con 0x7f22e415cba0 2023-10-14T11:13:25.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.234+0000 7f22e27fc640 1 -- 172.21.15.26:0/3825430399 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40abb70 con 0x7f22e415cba0 2023-10-14T11:13:25.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.234+0000 7f22e9980640 1 -- 172.21.15.26:0/3825430399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22e415cba0 msgr2=0x7f22e40d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:25.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.234+0000 7f22e9980640 1 --2- 172.21.15.26:0/3825430399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22e415cba0 0x7f22e40d0f20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f22d40097c0 tx=0x7f22d401c480 comp rx=0 tx=0).stop 2023-10-14T11:13:25.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.234+0000 7f22e9980640 1 -- 172.21.15.26:0/3825430399 shutdown_connections 2023-10-14T11:13:25.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.234+0000 7f22e9980640 1 --2- 172.21.15.26:0/3825430399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22e40d0210 0x7f22e40b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.234+0000 7f22e9980640 1 --2- 172.21.15.26:0/3825430399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22e415cba0 0x7f22e40d0f20 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.234+0000 7f22e9980640 1 -- 172.21.15.26:0/3825430399 >> 172.21.15.26:0/3825430399 conn(0x7f22e40719c0 msgr2=0x7f22e4071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:25.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.234+0000 7f22e9980640 1 -- 172.21.15.26:0/3825430399 shutdown_connections 2023-10-14T11:13:25.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.234+0000 7f22e9980640 1 -- 172.21.15.26:0/3825430399 wait complete. 2023-10-14T11:13:25.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e9980640 1 Processor -- start 2023-10-14T11:13:25.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e9980640 1 -- start start 2023-10-14T11:13:25.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e9980640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22e40b84e0 0x7f22e4158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:25.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e9980640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22e40d0210 0x7f22e40cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:25.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e9980640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22e415cba0 0x7f22e415a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:25.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e9980640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e4157d20 con 0x7f22e40b84e0 2023-10-14T11:13:25.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e9980640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e4157380 con 0x7f22e415cba0 2023-10-14T11:13:25.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e9980640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e4157660 con 0x7f22e40d0210 2023-10-14T11:13:25.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22e40b84e0 0x7f22e4158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:25.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22e40b84e0 0x7f22e4158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47546/0 (socket says 172.21.15.26:47546) 2023-10-14T11:13:25.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e2ffd640 1 -- 172.21.15.26:0/2322255229 learned_addr learned my addr 172.21.15.26:0/2322255229 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:25.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22dbfff640 1 --2- 172.21.15.26:0/2322255229 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22e40d0210 0x7f22e40cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:25.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e37fe640 1 --2- 172.21.15.26:0/2322255229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22e415cba0 0x7f22e415a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:25.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e2ffd640 1 -- 172.21.15.26:0/2322255229 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22e40d0210 msgr2=0x7f22e40cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:25.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e2ffd640 1 --2- 172.21.15.26:0/2322255229 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22e40d0210 0x7f22e40cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e2ffd640 1 -- 172.21.15.26:0/2322255229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22e415cba0 msgr2=0x7f22e415a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:25.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e2ffd640 1 --2- 172.21.15.26:0/2322255229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22e415cba0 0x7f22e415a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e2ffd640 1 -- 172.21.15.26:0/2322255229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d4009420 con 0x7f22e40b84e0 2023-10-14T11:13:25.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e37fe640 1 --2- 172.21.15.26:0/2322255229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22e415cba0 0x7f22e415a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:25.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22dbfff640 1 --2- 172.21.15.26:0/2322255229 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22e40d0210 0x7f22e40cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:25.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e2ffd640 1 --2- 172.21.15.26:0/2322255229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22e40b84e0 0x7f22e4158120 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f22d40ad040 tx=0x7f22d401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:25.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e0ff9640 1 -- 172.21.15.26:0/2322255229 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40b5810 con 0x7f22e40b84e0 2023-10-14T11:13:25.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e0ff9640 1 -- 172.21.15.26:0/2322255229 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d40b59b0 con 0x7f22e40b84e0 2023-10-14T11:13:25.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e0ff9640 1 -- 172.21.15.26:0/2322255229 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40b5d60 con 0x7f22e40b84e0 2023-10-14T11:13:25.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e9980640 1 -- 172.21.15.26:0/2322255229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e4157940 con 0x7f22e40b84e0 2023-10-14T11:13:25.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.238+0000 7f22e9980640 1 -- 172.21.15.26:0/2322255229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e415abb0 con 0x7f22e40b84e0 2023-10-14T11:13:25.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.242+0000 7f22e9980640 1 -- 172.21.15.26:0/2322255229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e40672e0 con 0x7f22e40b84e0 2023-10-14T11:13:25.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.242+0000 7f22e0ff9640 1 -- 172.21.15.26:0/2322255229 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f22d40b4390 con 0x7f22e40b84e0 2023-10-14T11:13:25.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.242+0000 7f22e0ff9640 1 --2- 172.21.15.26:0/2322255229 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f22c40664a0 0x7f22c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:25.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.242+0000 7f22e0ff9640 1 -- 172.21.15.26:0/2322255229 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f22d411ef40 con 0x7f22e40b84e0 2023-10-14T11:13:25.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.242+0000 7f22dbfff640 1 --2- 172.21.15.26:0/2322255229 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f22c40664a0 0x7f22c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:25.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.242+0000 7f22dbfff640 1 --2- 172.21.15.26:0/2322255229 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f22c40664a0 0x7f22c4068960 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f22e415c520 tx=0x7f22cc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:25.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.246+0000 7f22e0ff9640 1 -- 172.21.15.26:0/2322255229 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f22d40ebff0 con 0x7f22e40b84e0 2023-10-14T11:13:25.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.402+0000 7f22e9980640 1 -- 172.21.15.26:0/2322255229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f22e415ad40 con 0x7f22e40b84e0 2023-10-14T11:13:25.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.402+0000 7f22e0ff9640 1 -- 172.21.15.26:0/2322255229 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f22d40ab640 con 0x7f22e40b84e0 2023-10-14T11:13:25.409 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:13:25.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.406+0000 7f22e9980640 1 -- 172.21.15.26:0/2322255229 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f22c40664a0 msgr2=0x7f22c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:25.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.406+0000 7f22e9980640 1 --2- 172.21.15.26:0/2322255229 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f22c40664a0 0x7f22c4068960 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f22e415c520 tx=0x7f22cc009040 comp rx=0 tx=0).stop 2023-10-14T11:13:25.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.406+0000 7f22e9980640 1 -- 172.21.15.26:0/2322255229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22e40b84e0 msgr2=0x7f22e4158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:25.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.406+0000 7f22e9980640 1 --2- 172.21.15.26:0/2322255229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22e40b84e0 0x7f22e4158120 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f22d40ad040 tx=0x7f22d401acc0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.406+0000 7f22e9980640 1 -- 172.21.15.26:0/2322255229 shutdown_connections 2023-10-14T11:13:25.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.406+0000 7f22e9980640 1 --2- 172.21.15.26:0/2322255229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22e415cba0 0x7f22e415a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.406+0000 7f22e9980640 1 --2- 172.21.15.26:0/2322255229 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22e40d0210 0x7f22e40cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.406+0000 7f22e9980640 1 --2- 172.21.15.26:0/2322255229 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f22c40664a0 0x7f22c4068960 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.406+0000 7f22e9980640 1 --2- 172.21.15.26:0/2322255229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22e40b84e0 0x7f22e4158120 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.406+0000 7f22e9980640 1 -- 172.21.15.26:0/2322255229 >> 172.21.15.26:0/2322255229 conn(0x7f22e40719c0 msgr2=0x7f22e415b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:25.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.406+0000 7f22e9980640 1 -- 172.21.15.26:0/2322255229 shutdown_connections 2023-10-14T11:13:25.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.406+0000 7f22e9980640 1 -- 172.21.15.26:0/2322255229 wait complete. 2023-10-14T11:13:25.430 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T11:13:25.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.570+0000 7f2459a46640 1 Processor -- start 2023-10-14T11:13:25.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.570+0000 7f2459a46640 1 -- start start 2023-10-14T11:13:25.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.570+0000 7f2459a46640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f245415cba0 0x7f24540d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:25.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.570+0000 7f2459a46640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f24540d0210 0x7f24540b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:25.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.570+0000 7f2459a46640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24540d1670 con 0x7f24540b84e0 2023-10-14T11:13:25.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.570+0000 7f2459a46640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24540d1460 con 0x7f24540d0210 2023-10-14T11:13:25.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.570+0000 7f2459a46640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24540d1950 con 0x7f245415cba0 2023-10-14T11:13:25.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.570+0000 7f24537fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f24540d0210 0x7f24540b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:25.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.570+0000 7f24527fc640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f24540b84e0 0x7f24540cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44558/0 (socket says 172.21.15.26:44558) 2023-10-14T11:13:25.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.570+0000 7f24537fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f24540d0210 0x7f24540b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47548/0 (socket says 172.21.15.26:47548) 2023-10-14T11:13:25.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.570+0000 7f24527fc640 1 -- 172.21.15.26:0/3295459921 learned_addr learned my addr 172.21.15.26:0/3295459921 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:25.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.570+0000 7f2452ffd640 1 --2- 172.21.15.26:0/3295459921 >> v2:172.21.15.110:3300/0 conn(0x7f245415cba0 0x7f24540d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:25.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.574+0000 7f24537fe640 1 -- 172.21.15.26:0/3295459921 >> v2:172.21.15.110:3300/0 conn(0x7f245415cba0 msgr2=0x7f24540d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:25.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.574+0000 7f24537fe640 1 --2- 172.21.15.26:0/3295459921 >> v2:172.21.15.110:3300/0 conn(0x7f245415cba0 0x7f24540d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.574+0000 7f24537fe640 1 -- 172.21.15.26:0/3295459921 >> v1:172.21.15.26:6789/0 conn(0x7f24540b84e0 legacy=0x7f24540cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:25.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.574+0000 7f24537fe640 1 -- 172.21.15.26:0/3295459921 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24540d1c30 con 0x7f24540d0210 2023-10-14T11:13:25.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.574+0000 7f24537fe640 1 --2- 172.21.15.26:0/3295459921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24540d0210 0x7f24540b5cf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f24540b4890 tx=0x7f244c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca8e9e118852075 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:25.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.574+0000 7f2451ffb640 1 -- 172.21.15.26:0/3295459921 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c0a5940 con 0x7f24540d0210 2023-10-14T11:13:25.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.574+0000 7f2451ffb640 1 -- 172.21.15.26:0/3295459921 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c0a5aa0 con 0x7f24540d0210 2023-10-14T11:13:25.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.574+0000 7f2451ffb640 1 -- 172.21.15.26:0/3295459921 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c0a5e30 con 0x7f24540d0210 2023-10-14T11:13:25.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.574+0000 7f2459a46640 1 -- 172.21.15.26:0/3295459921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24540d0210 msgr2=0x7f24540b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:25.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.574+0000 7f2459a46640 1 --2- 172.21.15.26:0/3295459921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24540d0210 0x7f24540b5cf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f24540b4890 tx=0x7f244c01c880 comp rx=0 tx=0).stop 2023-10-14T11:13:25.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.574+0000 7f2459a46640 1 -- 172.21.15.26:0/3295459921 shutdown_connections 2023-10-14T11:13:25.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.574+0000 7f2459a46640 1 --2- 172.21.15.26:0/3295459921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24540d0210 0x7f24540b5cf0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.574+0000 7f2459a46640 1 --2- 172.21.15.26:0/3295459921 >> v2:172.21.15.110:3300/0 conn(0x7f245415cba0 0x7f24540d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.574+0000 7f2459a46640 1 -- 172.21.15.26:0/3295459921 >> 172.21.15.26:0/3295459921 conn(0x7f24540719c0 msgr2=0x7f2454071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:25.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.574+0000 7f2459a46640 1 -- 172.21.15.26:0/3295459921 shutdown_connections 2023-10-14T11:13:25.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.574+0000 7f2459a46640 1 -- 172.21.15.26:0/3295459921 wait complete. 2023-10-14T11:13:25.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f2459a46640 1 Processor -- start 2023-10-14T11:13:25.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f2459a46640 1 -- start start 2023-10-14T11:13:25.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f2459a46640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24540b84e0 0x7f2454145d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:25.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f2459a46640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24540d0210 0x7f245414e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:25.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f2459a46640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f245415cba0 0x7f245414e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:25.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f2459a46640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24540c9fd0 con 0x7f24540d0210 2023-10-14T11:13:25.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f2459a46640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2454156250 con 0x7f24540b84e0 2023-10-14T11:13:25.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f2459a46640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24540cc300 con 0x7f245415cba0 2023-10-14T11:13:25.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f24527fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24540d0210 0x7f245414e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:25.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f24527fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24540d0210 0x7f245414e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47560/0 (socket says 172.21.15.26:47560) 2023-10-14T11:13:25.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f24527fc640 1 -- 172.21.15.26:0/2407775385 learned_addr learned my addr 172.21.15.26:0/2407775385 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:25.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f2452ffd640 1 --2- 172.21.15.26:0/2407775385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24540b84e0 0x7f2454145d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:25.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f24537fe640 1 --2- 172.21.15.26:0/2407775385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f245415cba0 0x7f245414e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:25.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f24527fc640 1 -- 172.21.15.26:0/2407775385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f245415cba0 msgr2=0x7f245414e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:25.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f24527fc640 1 --2- 172.21.15.26:0/2407775385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f245415cba0 0x7f245414e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f24527fc640 1 -- 172.21.15.26:0/2407775385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24540b84e0 msgr2=0x7f2454145d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:25.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f24527fc640 1 --2- 172.21.15.26:0/2407775385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24540b84e0 0x7f2454145d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f24527fc640 1 -- 172.21.15.26:0/2407775385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244c009a70 con 0x7f24540d0210 2023-10-14T11:13:25.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f24527fc640 1 --2- 172.21.15.26:0/2407775385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24540d0210 0x7f245414e360 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f244800c500 tx=0x7f244800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:25.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f243bfff640 1 -- 172.21.15.26:0/2407775385 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448005cf0 con 0x7f24540d0210 2023-10-14T11:13:25.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f243bfff640 1 -- 172.21.15.26:0/2407775385 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2448005e50 con 0x7f24540d0210 2023-10-14T11:13:25.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f243bfff640 1 -- 172.21.15.26:0/2407775385 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24480072f0 con 0x7f24540d0210 2023-10-14T11:13:25.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.578+0000 7f2459a46640 1 -- 172.21.15.26:0/2407775385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24540cc5e0 con 0x7f24540d0210 2023-10-14T11:13:25.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.582+0000 7f2459a46640 1 -- 172.21.15.26:0/2407775385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2454156460 con 0x7f24540d0210 2023-10-14T11:13:25.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.582+0000 7f2459a46640 1 -- 172.21.15.26:0/2407775385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2454156680 con 0x7f24540d0210 2023-10-14T11:13:25.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.582+0000 7f243bfff640 1 -- 172.21.15.26:0/2407775385 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2448007450 con 0x7f24540d0210 2023-10-14T11:13:25.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.582+0000 7f243bfff640 1 --2- 172.21.15.26:0/2407775385 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f24400664d0 0x7f2440068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:25.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.582+0000 7f243bfff640 1 -- 172.21.15.26:0/2407775385 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f24480836a0 con 0x7f24540d0210 2023-10-14T11:13:25.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.582+0000 7f2452ffd640 1 --2- 172.21.15.26:0/2407775385 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f24400664d0 0x7f2440068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:25.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.582+0000 7f2452ffd640 1 --2- 172.21.15.26:0/2407775385 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f24400664d0 0x7f2440068990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2444009ac0 tx=0x7f2444009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:25.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.586+0000 7f243bfff640 1 -- 172.21.15.26:0/2407775385 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2448050800 con 0x7f24540d0210 2023-10-14T11:13:25.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.746+0000 7f2459a46640 1 -- 172.21.15.26:0/2407775385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f245404e170 con 0x7f24540d0210 2023-10-14T11:13:25.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.746+0000 7f243bfff640 1 -- 172.21.15.26:0/2407775385 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2448053e20 con 0x7f24540d0210 2023-10-14T11:13:25.752 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:25.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.746+0000 7f2459a46640 1 -- 172.21.15.26:0/2407775385 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f24400664d0 msgr2=0x7f2440068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:25.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.746+0000 7f2459a46640 1 --2- 172.21.15.26:0/2407775385 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f24400664d0 0x7f2440068990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2444009ac0 tx=0x7f2444009190 comp rx=0 tx=0).stop 2023-10-14T11:13:25.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.746+0000 7f2459a46640 1 -- 172.21.15.26:0/2407775385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24540d0210 msgr2=0x7f245414e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:25.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.746+0000 7f2459a46640 1 --2- 172.21.15.26:0/2407775385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24540d0210 0x7f245414e360 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f244800c500 tx=0x7f244800c9c0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.746+0000 7f2459a46640 1 -- 172.21.15.26:0/2407775385 shutdown_connections 2023-10-14T11:13:25.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.746+0000 7f2459a46640 1 --2- 172.21.15.26:0/2407775385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f245415cba0 0x7f245414e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.746+0000 7f2459a46640 1 --2- 172.21.15.26:0/2407775385 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f24400664d0 0x7f2440068990 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.746+0000 7f2459a46640 1 --2- 172.21.15.26:0/2407775385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24540d0210 0x7f245414e360 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.746+0000 7f2459a46640 1 --2- 172.21.15.26:0/2407775385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24540b84e0 0x7f2454145d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.746+0000 7f2459a46640 1 -- 172.21.15.26:0/2407775385 >> 172.21.15.26:0/2407775385 conn(0x7f24540719c0 msgr2=0x7f24541541b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:25.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.746+0000 7f2459a46640 1 -- 172.21.15.26:0/2407775385 shutdown_connections 2023-10-14T11:13:25.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.750+0000 7f2459a46640 1 -- 172.21.15.26:0/2407775385 wait complete. 2023-10-14T11:13:25.773 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:13:25.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.910+0000 7f00da13e640 1 Processor -- start 2023-10-14T11:13:25.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.910+0000 7f00da13e640 1 -- start start 2023-10-14T11:13:25.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.910+0000 7f00da13e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f00d40cf520 0x7f00d40c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:25.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.910+0000 7f00da13e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d40c65f0 con 0x7f00d415ca70 2023-10-14T11:13:25.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.910+0000 7f00da13e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d40cdf80 con 0x7f00d40cf090 2023-10-14T11:13:25.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.910+0000 7f00da13e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d40ce820 con 0x7f00d40cf520 2023-10-14T11:13:25.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.914+0000 7f00d3fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f00d40cf520 0x7f00d40c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:25.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.914+0000 7f00d3fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f00d40cf520 0x7f00d40c71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47568/0 (socket says 172.21.15.26:47568) 2023-10-14T11:13:25.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.914+0000 7f00d3fff640 1 -- 172.21.15.26:0/434830051 learned_addr learned my addr 172.21.15.26:0/434830051 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:25.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.914+0000 7f00d37fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f00d415ca70 0x7f00d40d3010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44574/0 (socket says 172.21.15.26:44574) 2023-10-14T11:13:25.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.914+0000 7f00d3fff640 1 -- 172.21.15.26:0/434830051 >> v1:172.21.15.110:6789/0 conn(0x7f00d40cf090 legacy=0x7f00d40c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:25.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.914+0000 7f00d3fff640 1 -- 172.21.15.26:0/434830051 >> v1:172.21.15.26:6789/0 conn(0x7f00d415ca70 legacy=0x7f00d40d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:25.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.914+0000 7f00d3fff640 1 -- 172.21.15.26:0/434830051 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d40ce260 con 0x7f00d40cf520 2023-10-14T11:13:25.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.914+0000 7f00d27fc640 1 -- 172.21.15.26:0/434830051 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777315517 0 0) 0x7f00d40c65f0 con 0x7f00d415ca70 2023-10-14T11:13:25.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.914+0000 7f00d3fff640 1 --2- 172.21.15.26:0/434830051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00d40cf520 0x7f00d40c71e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f00cc009e50 tx=0x7f00cc01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95870d2754c9f96 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:25.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.914+0000 7f00d27fc640 1 -- 172.21.15.26:0/434830051 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0a5870 con 0x7f00d40cf520 2023-10-14T11:13:25.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.914+0000 7f00d27fc640 1 -- 172.21.15.26:0/434830051 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc0a59d0 con 0x7f00d40cf520 2023-10-14T11:13:25.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.914+0000 7f00d27fc640 1 -- 172.21.15.26:0/434830051 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0a5d60 con 0x7f00d40cf520 2023-10-14T11:13:25.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00da13e640 1 -- 172.21.15.26:0/434830051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00d40cf520 msgr2=0x7f00d40c71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:25.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00da13e640 1 --2- 172.21.15.26:0/434830051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00d40cf520 0x7f00d40c71e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f00cc009e50 tx=0x7f00cc01c9e0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00da13e640 1 -- 172.21.15.26:0/434830051 shutdown_connections 2023-10-14T11:13:25.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00da13e640 1 --2- 172.21.15.26:0/434830051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00d40cf520 0x7f00d40c71e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00da13e640 1 -- 172.21.15.26:0/434830051 >> 172.21.15.26:0/434830051 conn(0x7f00d409bc50 msgr2=0x7f00d40d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:25.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00da13e640 1 -- 172.21.15.26:0/434830051 shutdown_connections 2023-10-14T11:13:25.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00da13e640 1 -- 172.21.15.26:0/434830051 wait complete. 2023-10-14T11:13:25.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00da13e640 1 Processor -- start 2023-10-14T11:13:25.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00da13e640 1 -- start start 2023-10-14T11:13:25.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00da13e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00d40cf090 0x7f00d415e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:25.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00da13e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00d40cf520 0x7f00d415ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:25.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00da13e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00d415ca70 0x7f00d40cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:25.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00da13e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d415fb10 con 0x7f00d415ca70 2023-10-14T11:13:25.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00da13e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d415ef00 con 0x7f00d40cf090 2023-10-14T11:13:25.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00da13e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d415f1e0 con 0x7f00d40cf520 2023-10-14T11:13:25.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00d3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00d415ca70 0x7f00d40cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:25.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00d3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00d415ca70 0x7f00d40cc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47574/0 (socket says 172.21.15.26:47574) 2023-10-14T11:13:25.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00d3fff640 1 -- 172.21.15.26:0/2116323297 learned_addr learned my addr 172.21.15.26:0/2116323297 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:25.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00d37fe640 1 --2- 172.21.15.26:0/2116323297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00d40cf090 0x7f00d415e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:25.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00d2ffd640 1 --2- 172.21.15.26:0/2116323297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00d40cf520 0x7f00d415ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:25.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00d3fff640 1 -- 172.21.15.26:0/2116323297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00d40cf520 msgr2=0x7f00d415ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:25.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00d3fff640 1 --2- 172.21.15.26:0/2116323297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00d40cf520 0x7f00d415ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00d3fff640 1 -- 172.21.15.26:0/2116323297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00d40cf090 msgr2=0x7f00d415e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:25.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00d3fff640 1 --2- 172.21.15.26:0/2116323297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00d40cf090 0x7f00d415e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:25.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.918+0000 7f00d3fff640 1 -- 172.21.15.26:0/2116323297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00cc009b30 con 0x7f00d415ca70 2023-10-14T11:13:25.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.922+0000 7f00d3fff640 1 --2- 172.21.15.26:0/2116323297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00d415ca70 0x7f00d40cc710 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f00cc0195f0 tx=0x7f00d40c7f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:25.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.922+0000 7f00bbfff640 1 -- 172.21.15.26:0/2116323297 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0b8670 con 0x7f00d415ca70 2023-10-14T11:13:25.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.922+0000 7f00bbfff640 1 -- 172.21.15.26:0/2116323297 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc0b87d0 con 0x7f00d415ca70 2023-10-14T11:13:25.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.922+0000 7f00da13e640 1 -- 172.21.15.26:0/2116323297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d40d38a0 con 0x7f00d415ca70 2023-10-14T11:13:25.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.922+0000 7f00bbfff640 1 -- 172.21.15.26:0/2116323297 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0b8b80 con 0x7f00d415ca70 2023-10-14T11:13:25.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.922+0000 7f00da13e640 1 -- 172.21.15.26:0/2116323297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d415f7a0 con 0x7f00d415ca70 2023-10-14T11:13:25.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.922+0000 7f00da13e640 1 -- 172.21.15.26:0/2116323297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d415fc80 con 0x7f00d415ca70 2023-10-14T11:13:25.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.922+0000 7f00bbfff640 1 -- 172.21.15.26:0/2116323297 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f00cc0b8ce0 con 0x7f00d415ca70 2023-10-14T11:13:25.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.922+0000 7f00bbfff640 1 --2- 172.21.15.26:0/2116323297 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f00c00664f0 0x7f00c00689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:25.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.922+0000 7f00bbfff640 1 -- 172.21.15.26:0/2116323297 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f00cc11f820 con 0x7f00d415ca70 2023-10-14T11:13:25.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.922+0000 7f00d37fe640 1 --2- 172.21.15.26:0/2116323297 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f00c00664f0 0x7f00c00689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:25.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.926+0000 7f00d37fe640 1 --2- 172.21.15.26:0/2116323297 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f00c00664f0 0x7f00c00689b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f00c4007fd0 tx=0x7f00c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:25.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:25.926+0000 7f00bbfff640 1 -- 172.21.15.26:0/2116323297 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f00cc0f0520 con 0x7f00d415ca70 2023-10-14T11:13:26.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.098+0000 7f00da13e640 1 -- 172.21.15.26:0/2116323297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f00d40d36a0 con 0x7f00d415ca70 2023-10-14T11:13:26.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.098+0000 7f00bbfff640 1 -- 172.21.15.26:0/2116323297 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f00cc0f00b0 con 0x7f00d415ca70 2023-10-14T11:13:26.104 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-10-14T11:13:26.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.098+0000 7f00da13e640 1 -- 172.21.15.26:0/2116323297 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f00c00664f0 msgr2=0x7f00c00689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:26.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.098+0000 7f00da13e640 1 --2- 172.21.15.26:0/2116323297 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f00c00664f0 0x7f00c00689b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f00c4007fd0 tx=0x7f00c4009040 comp rx=0 tx=0).stop 2023-10-14T11:13:26.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.098+0000 7f00da13e640 1 -- 172.21.15.26:0/2116323297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00d415ca70 msgr2=0x7f00d40cc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:26.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.098+0000 7f00da13e640 1 --2- 172.21.15.26:0/2116323297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00d415ca70 0x7f00d40cc710 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f00cc0195f0 tx=0x7f00d40c7f30 comp rx=0 tx=0).stop 2023-10-14T11:13:26.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.098+0000 7f00da13e640 1 -- 172.21.15.26:0/2116323297 shutdown_connections 2023-10-14T11:13:26.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.098+0000 7f00da13e640 1 --2- 172.21.15.26:0/2116323297 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f00c00664f0 0x7f00c00689b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:26.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.098+0000 7f00da13e640 1 --2- 172.21.15.26:0/2116323297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00d415ca70 0x7f00d40cc710 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:26.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.098+0000 7f00da13e640 1 --2- 172.21.15.26:0/2116323297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00d40cf520 0x7f00d415ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:26.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.098+0000 7f00da13e640 1 --2- 172.21.15.26:0/2116323297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00d40cf090 0x7f00d415e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.098+0000 7f00da13e640 1 -- 172.21.15.26:0/2116323297 >> 172.21.15.26:0/2116323297 conn(0x7f00d409bc50 msgr2=0x7f00d406c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.102+0000 7f00da13e640 1 -- 172.21.15.26:0/2116323297 shutdown_connections 2023-10-14T11:13:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.102+0000 7f00da13e640 1 -- 172.21.15.26:0/2116323297 wait complete. 2023-10-14T11:13:26.126 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi110.front.sepia.ceph.com... 2023-10-14T11:13:26.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:26.127 DEBUG:teuthology.orchestra.run.smithi110:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-14T11:13:26.167 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:13:26.168 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2023-10-14T11:13:26.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:26.169 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T11:13:26.229 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:13:26.230 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:13:26.240 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:13:26.241 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:13:26.295 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:13:26.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.478+0000 7fe9d4e6b640 1 Processor -- start 2023-10-14T11:13:26.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.478+0000 7fe9d4e6b640 1 -- start start 2023-10-14T11:13:26.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.478+0000 7fe9d4e6b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe9d00b2ad0 0x7fe9d006b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:26.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.478+0000 7fe9d4e6b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe9d015cf90 0x7fe9d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:26.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.478+0000 7fe9d4e6b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d015d4e0 con 0x7fe9d00ce310 2023-10-14T11:13:26.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.478+0000 7fe9d4e6b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d0160580 con 0x7fe9d00b2ad0 2023-10-14T11:13:26.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.478+0000 7fe9d4e6b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d015d7c0 con 0x7fe9d015cf90 2023-10-14T11:13:26.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.478+0000 7fe9ce59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe9d00b2ad0 0x7fe9d006b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:26.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.478+0000 7fe9ce59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe9d00b2ad0 0x7fe9d006b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47580/0 (socket says 172.21.15.26:47580) 2023-10-14T11:13:26.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.478+0000 7fe9ce59c640 1 -- 172.21.15.26:0/439305207 learned_addr learned my addr 172.21.15.26:0/439305207 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:26.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.478+0000 7fe9c7fff640 1 --2- 172.21.15.26:0/439305207 >> v2:172.21.15.110:3300/0 conn(0x7fe9d015cf90 0x7fe9d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:26.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.478+0000 7fe9ce59c640 1 -- 172.21.15.26:0/439305207 >> v2:172.21.15.110:3300/0 conn(0x7fe9d015cf90 msgr2=0x7fe9d006c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:26.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.478+0000 7fe9ce59c640 1 --2- 172.21.15.26:0/439305207 >> v2:172.21.15.110:3300/0 conn(0x7fe9d015cf90 0x7fe9d006c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:26.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.478+0000 7fe9ce59c640 1 -- 172.21.15.26:0/439305207 >> v1:172.21.15.110:6789/0 conn(0x7fe9d00ce310 legacy=0x7fe9d01609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:26.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.478+0000 7fe9ce59c640 1 -- 172.21.15.26:0/439305207 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d015daa0 con 0x7fe9d00b2ad0 2023-10-14T11:13:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.482+0000 7fe9ce59c640 1 --2- 172.21.15.26:0/439305207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d00b2ad0 0x7fe9d006b4b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009870 tx=0x7fe9c001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6cfb73682d26a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.482+0000 7fe9cdd9b640 1 -- 172.21.15.26:0/439305207 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c00ac600 con 0x7fe9d00b2ad0 2023-10-14T11:13:26.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.482+0000 7fe9cdd9b640 1 -- 172.21.15.26:0/439305207 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c00a8050 con 0x7fe9d00b2ad0 2023-10-14T11:13:26.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.482+0000 7fe9cdd9b640 1 -- 172.21.15.26:0/439305207 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c00ac980 con 0x7fe9d00b2ad0 2023-10-14T11:13:26.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.482+0000 7fe9d4e6b640 1 -- 172.21.15.26:0/439305207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d00b2ad0 msgr2=0x7fe9d006b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:26.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.482+0000 7fe9d4e6b640 1 --2- 172.21.15.26:0/439305207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d00b2ad0 0x7fe9d006b4b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009870 tx=0x7fe9c001c490 comp rx=0 tx=0).stop 2023-10-14T11:13:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.482+0000 7fe9d4e6b640 1 -- 172.21.15.26:0/439305207 shutdown_connections 2023-10-14T11:13:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.482+0000 7fe9d4e6b640 1 --2- 172.21.15.26:0/439305207 >> v2:172.21.15.110:3300/0 conn(0x7fe9d015cf90 0x7fe9d006c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.482+0000 7fe9d4e6b640 1 --2- 172.21.15.26:0/439305207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d00b2ad0 0x7fe9d006b4b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:26.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.482+0000 7fe9d4e6b640 1 -- 172.21.15.26:0/439305207 >> 172.21.15.26:0/439305207 conn(0x7fe9d00cd1c0 msgr2=0x7fe9d00cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:26.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.482+0000 7fe9d4e6b640 1 -- 172.21.15.26:0/439305207 shutdown_connections 2023-10-14T11:13:26.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.486+0000 7fe9d4e6b640 1 -- 172.21.15.26:0/439305207 wait complete. 2023-10-14T11:13:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.486+0000 7fe9d4e6b640 1 Processor -- start 2023-10-14T11:13:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.486+0000 7fe9d4e6b640 1 -- start start 2023-10-14T11:13:26.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.486+0000 7fe9d4e6b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d00b2ad0 0x7fe9d0143c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:26.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.486+0000 7fe9d4e6b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d00ce310 0x7fe9d0158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:26.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.486+0000 7fe9d4e6b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9d015cf90 0x7fe9d01592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:26.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.486+0000 7fe9d4e6b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d00b5990 con 0x7fe9d00b2ad0 2023-10-14T11:13:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.486+0000 7fe9d4e6b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d00b5e20 con 0x7fe9d00ce310 2023-10-14T11:13:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.486+0000 7fe9d4e6b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d0144160 con 0x7fe9d015cf90 2023-10-14T11:13:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.486+0000 7fe9ce59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d00b2ad0 0x7fe9d0143c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.486+0000 7fe9ce59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d00b2ad0 0x7fe9d0143c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47582/0 (socket says 172.21.15.26:47582) 2023-10-14T11:13:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.486+0000 7fe9ce59c640 1 -- 172.21.15.26:0/4221910173 learned_addr learned my addr 172.21.15.26:0/4221910173 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:26.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.486+0000 7fe9c7fff640 1 --2- 172.21.15.26:0/4221910173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d00ce310 0x7fe9d0158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:26.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.486+0000 7fe9ced9d640 1 --2- 172.21.15.26:0/4221910173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9d015cf90 0x7fe9d01592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:26.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.486+0000 7fe9ce59c640 1 -- 172.21.15.26:0/4221910173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9d015cf90 msgr2=0x7fe9d01592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:26.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.486+0000 7fe9ce59c640 1 --2- 172.21.15.26:0/4221910173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9d015cf90 0x7fe9d01592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:26.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.486+0000 7fe9ce59c640 1 -- 172.21.15.26:0/4221910173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d00ce310 msgr2=0x7fe9d0158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:26.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.486+0000 7fe9ce59c640 1 --2- 172.21.15.26:0/4221910173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d00ce310 0x7fe9d0158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:26.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.486+0000 7fe9ce59c640 1 -- 172.21.15.26:0/4221910173 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c00094d0 con 0x7fe9d00b2ad0 2023-10-14T11:13:26.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.486+0000 7fe9ce59c640 1 --2- 172.21.15.26:0/4221910173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d00b2ad0 0x7fe9d0143c20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe9c001a0c0 tx=0x7fe9c001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:26.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.490+0000 7fe9c6ffd640 1 -- 172.21.15.26:0/4221910173 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c00bc070 con 0x7fe9d00b2ad0 2023-10-14T11:13:26.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.490+0000 7fe9c6ffd640 1 -- 172.21.15.26:0/4221910173 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c00ace90 con 0x7fe9d00b2ad0 2023-10-14T11:13:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.490+0000 7fe9d4e6b640 1 -- 172.21.15.26:0/4221910173 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d00b4d80 con 0x7fe9d00b2ad0 2023-10-14T11:13:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.490+0000 7fe9c6ffd640 1 -- 172.21.15.26:0/4221910173 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c00b7670 con 0x7fe9d00b2ad0 2023-10-14T11:13:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.490+0000 7fe9d4e6b640 1 -- 172.21.15.26:0/4221910173 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d00b5340 con 0x7fe9d00b2ad0 2023-10-14T11:13:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.490+0000 7fe9d4e6b640 1 -- 172.21.15.26:0/4221910173 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d0074010 con 0x7fe9d00b2ad0 2023-10-14T11:13:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.490+0000 7fe9c6ffd640 1 -- 172.21.15.26:0/4221910173 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe9c00b3070 con 0x7fe9d00b2ad0 2023-10-14T11:13:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.490+0000 7fe9c6ffd640 1 --2- 172.21.15.26:0/4221910173 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe9b00664d0 0x7fe9b0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.490+0000 7fe9c6ffd640 1 -- 172.21.15.26:0/4221910173 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe9c011dae0 con 0x7fe9d00b2ad0 2023-10-14T11:13:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.490+0000 7fe9c7fff640 1 --2- 172.21.15.26:0/4221910173 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe9b00664d0 0x7fe9b0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.494+0000 7fe9c7fff640 1 --2- 172.21.15.26:0/4221910173 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe9b00664d0 0x7fe9b0068990 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe9d015afd0 tx=0x7fe9b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:26.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.494+0000 7fe9c6ffd640 1 -- 172.21.15.26:0/4221910173 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe9c00eac30 con 0x7fe9d00b2ad0 2023-10-14T11:13:26.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.654+0000 7fe9d4e6b640 1 -- 172.21.15.26:0/4221910173 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9d0156990 con 0x7fe9d00b2ad0 2023-10-14T11:13:26.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.654+0000 7fe9c6ffd640 1 -- 172.21.15.26:0/4221910173 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18679 (secure 0 0 0) 0x7fe9c00ee250 con 0x7fe9d00b2ad0 2023-10-14T11:13:26.661 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:26.661 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":27,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:13:03.866737+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:13:26.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.658+0000 7fe9d4e6b640 1 -- 172.21.15.26:0/4221910173 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe9b00664d0 msgr2=0x7fe9b0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:26.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.658+0000 7fe9d4e6b640 1 --2- 172.21.15.26:0/4221910173 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe9b00664d0 0x7fe9b0068990 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe9d015afd0 tx=0x7fe9b8008040 comp rx=0 tx=0).stop 2023-10-14T11:13:26.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.658+0000 7fe9d4e6b640 1 -- 172.21.15.26:0/4221910173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d00b2ad0 msgr2=0x7fe9d0143c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:26.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.658+0000 7fe9d4e6b640 1 --2- 172.21.15.26:0/4221910173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d00b2ad0 0x7fe9d0143c20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe9c001a0c0 tx=0x7fe9c001acd0 comp rx=0 tx=0).stop 2023-10-14T11:13:26.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.658+0000 7fe9d4e6b640 1 -- 172.21.15.26:0/4221910173 shutdown_connections 2023-10-14T11:13:26.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.658+0000 7fe9d4e6b640 1 --2- 172.21.15.26:0/4221910173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9d015cf90 0x7fe9d01592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:26.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.658+0000 7fe9d4e6b640 1 --2- 172.21.15.26:0/4221910173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d00ce310 0x7fe9d0158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:26.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.658+0000 7fe9d4e6b640 1 --2- 172.21.15.26:0/4221910173 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe9b00664d0 0x7fe9b0068990 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:26.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.658+0000 7fe9d4e6b640 1 --2- 172.21.15.26:0/4221910173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d00b2ad0 0x7fe9d0143c20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:26.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.658+0000 7fe9d4e6b640 1 -- 172.21.15.26:0/4221910173 >> 172.21.15.26:0/4221910173 conn(0x7fe9d00cd1c0 msgr2=0x7fe9d015b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:26.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.658+0000 7fe9d4e6b640 1 -- 172.21.15.26:0/4221910173 shutdown_connections 2023-10-14T11:13:26.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.658+0000 7fe9d4e6b640 1 -- 172.21.15.26:0/4221910173 wait complete. 2023-10-14T11:13:26.683 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:12:20.179562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:12:21.346111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T11:12:25.025159+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T11:13:26.684 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:13:26.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.822+0000 7efe88254640 1 Processor -- start 2023-10-14T11:13:26.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.822+0000 7efe88254640 1 -- start start 2023-10-14T11:13:26.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.826+0000 7efe88254640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe8015cba0 0x7efe800d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:26.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.826+0000 7efe88254640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efe800d0210 0x7efe800b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:26.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.826+0000 7efe88254640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe800d1670 con 0x7efe800b84e0 2023-10-14T11:13:26.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.826+0000 7efe88254640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe800d1460 con 0x7efe8015cba0 2023-10-14T11:13:26.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.826+0000 7efe88254640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe800d1950 con 0x7efe800d0210 2023-10-14T11:13:26.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.826+0000 7efe85ff0640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe8015cba0 0x7efe800d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:26.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.826+0000 7efe85ff0640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe8015cba0 0x7efe800d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47594/0 (socket says 172.21.15.26:47594) 2023-10-14T11:13:26.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.826+0000 7efe85ff0640 1 -- 172.21.15.26:0/704107421 learned_addr learned my addr 172.21.15.26:0/704107421 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:26.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.826+0000 7efe857ef640 1 --1- 172.21.15.26:0/704107421 >> v1:172.21.15.26:6789/0 conn(0x7efe800b84e0 0x7efe800cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44576/0 (socket says 172.21.15.26:44576) 2023-10-14T11:13:26.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.826+0000 7efe867f1640 1 --2- 172.21.15.26:0/704107421 >> v2:172.21.15.110:3300/0 conn(0x7efe800d0210 0x7efe800b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:26.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.826+0000 7efe85ff0640 1 -- 172.21.15.26:0/704107421 >> v2:172.21.15.110:3300/0 conn(0x7efe800d0210 msgr2=0x7efe800b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:26.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.826+0000 7efe85ff0640 1 --2- 172.21.15.26:0/704107421 >> v2:172.21.15.110:3300/0 conn(0x7efe800d0210 0x7efe800b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:26.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.826+0000 7efe85ff0640 1 -- 172.21.15.26:0/704107421 >> v1:172.21.15.26:6789/0 conn(0x7efe800b84e0 legacy=0x7efe800cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:26.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.826+0000 7efe85ff0640 1 -- 172.21.15.26:0/704107421 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe800d1c30 con 0x7efe8015cba0 2023-10-14T11:13:26.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.830+0000 7efe85ff0640 1 --2- 172.21.15.26:0/704107421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe8015cba0 0x7efe800d0f20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efe800ce450 tx=0x7efe7c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6085af54cf5e972d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:26.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.830+0000 7efe84fee640 1 -- 172.21.15.26:0/704107421 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c0ab670 con 0x7efe8015cba0 2023-10-14T11:13:26.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.830+0000 7efe84fee640 1 -- 172.21.15.26:0/704107421 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7c0ab7d0 con 0x7efe8015cba0 2023-10-14T11:13:26.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.830+0000 7efe84fee640 1 -- 172.21.15.26:0/704107421 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c0abb60 con 0x7efe8015cba0 2023-10-14T11:13:26.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.830+0000 7efe88254640 1 -- 172.21.15.26:0/704107421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe8015cba0 msgr2=0x7efe800d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:26.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.830+0000 7efe88254640 1 --2- 172.21.15.26:0/704107421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe8015cba0 0x7efe800d0f20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efe800ce450 tx=0x7efe7c01c470 comp rx=0 tx=0).stop 2023-10-14T11:13:26.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.830+0000 7efe88254640 1 -- 172.21.15.26:0/704107421 shutdown_connections 2023-10-14T11:13:26.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.830+0000 7efe88254640 1 --2- 172.21.15.26:0/704107421 >> v2:172.21.15.110:3300/0 conn(0x7efe800d0210 0x7efe800b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:26.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.830+0000 7efe88254640 1 --2- 172.21.15.26:0/704107421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe8015cba0 0x7efe800d0f20 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:26.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.830+0000 7efe88254640 1 -- 172.21.15.26:0/704107421 >> 172.21.15.26:0/704107421 conn(0x7efe800719c0 msgr2=0x7efe80071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:26.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.830+0000 7efe88254640 1 -- 172.21.15.26:0/704107421 shutdown_connections 2023-10-14T11:13:26.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.830+0000 7efe88254640 1 -- 172.21.15.26:0/704107421 wait complete. 2023-10-14T11:13:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.830+0000 7efe88254640 1 Processor -- start 2023-10-14T11:13:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.830+0000 7efe88254640 1 -- start start 2023-10-14T11:13:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe88254640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe800b84e0 0x7efe8014da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe88254640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe800d0210 0x7efe80158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe88254640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe8015cba0 0x7efe801572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe88254640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8014df90 con 0x7efe8015cba0 2023-10-14T11:13:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe88254640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe80157d80 con 0x7efe800b84e0 2023-10-14T11:13:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe88254640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe80158060 con 0x7efe800d0210 2023-10-14T11:13:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe867f1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe8015cba0 0x7efe801572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe867f1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe8015cba0 0x7efe801572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47610/0 (socket says 172.21.15.26:47610) 2023-10-14T11:13:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe867f1640 1 -- 172.21.15.26:0/1681773052 learned_addr learned my addr 172.21.15.26:0/1681773052 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe85ff0640 1 --2- 172.21.15.26:0/1681773052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe800b84e0 0x7efe8014da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:26.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe857ef640 1 --2- 172.21.15.26:0/1681773052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe800d0210 0x7efe80158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:26.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe867f1640 1 -- 172.21.15.26:0/1681773052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe800d0210 msgr2=0x7efe80158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:26.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe867f1640 1 --2- 172.21.15.26:0/1681773052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe800d0210 0x7efe80158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:26.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe867f1640 1 -- 172.21.15.26:0/1681773052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe800b84e0 msgr2=0x7efe8014da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:26.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe867f1640 1 --2- 172.21.15.26:0/1681773052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe800b84e0 0x7efe8014da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:26.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe867f1640 1 -- 172.21.15.26:0/1681773052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7c0094d0 con 0x7efe8015cba0 2023-10-14T11:13:26.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe857ef640 1 --2- 172.21.15.26:0/1681773052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe800d0210 0x7efe80158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:26.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe867f1640 1 --2- 172.21.15.26:0/1681773052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe8015cba0 0x7efe801572e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7efe7800efc0 tx=0x7efe7800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:26.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe767fc640 1 -- 172.21.15.26:0/1681773052 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe78014480 con 0x7efe8015cba0 2023-10-14T11:13:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe767fc640 1 -- 172.21.15.26:0/1681773052 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7800f040 con 0x7efe8015cba0 2023-10-14T11:13:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe767fc640 1 -- 172.21.15.26:0/1681773052 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe78014820 con 0x7efe8015cba0 2023-10-14T11:13:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe88254640 1 -- 172.21.15.26:0/1681773052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe80158340 con 0x7efe8015cba0 2023-10-14T11:13:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe88254640 1 -- 172.21.15.26:0/1681773052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe80158900 con 0x7efe8015cba0 2023-10-14T11:13:26.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe88254640 1 -- 172.21.15.26:0/1681773052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe80158b20 con 0x7efe8015cba0 2023-10-14T11:13:26.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.834+0000 7efe767fc640 1 -- 172.21.15.26:0/1681773052 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efe78014980 con 0x7efe8015cba0 2023-10-14T11:13:26.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.838+0000 7efe767fc640 1 --2- 172.21.15.26:0/1681773052 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efe640664d0 0x7efe64068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:26.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.838+0000 7efe767fc640 1 -- 172.21.15.26:0/1681773052 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efe78085130 con 0x7efe8015cba0 2023-10-14T11:13:26.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.838+0000 7efe85ff0640 1 --2- 172.21.15.26:0/1681773052 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efe640664d0 0x7efe64068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:26.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.838+0000 7efe85ff0640 1 --2- 172.21.15.26:0/1681773052 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efe640664d0 0x7efe64068990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efe7c0af000 tx=0x7efe7c0b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:26.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:26.842+0000 7efe767fc640 1 -- 172.21.15.26:0/1681773052 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efe780520c0 con 0x7efe8015cba0 2023-10-14T11:13:27.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.002+0000 7efe88254640 1 -- 172.21.15.26:0/1681773052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe8004e170 con 0x7efe8015cba0 2023-10-14T11:13:27.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.002+0000 7efe767fc640 1 -- 172.21.15.26:0/1681773052 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7efe780180a0 con 0x7efe8015cba0 2023-10-14T11:13:27.010 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:13:27.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.006+0000 7efe88254640 1 -- 172.21.15.26:0/1681773052 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efe640664d0 msgr2=0x7efe64068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:27.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.006+0000 7efe88254640 1 --2- 172.21.15.26:0/1681773052 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efe640664d0 0x7efe64068990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efe7c0af000 tx=0x7efe7c0b6040 comp rx=0 tx=0).stop 2023-10-14T11:13:27.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.006+0000 7efe88254640 1 -- 172.21.15.26:0/1681773052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe8015cba0 msgr2=0x7efe801572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:27.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.006+0000 7efe88254640 1 --2- 172.21.15.26:0/1681773052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe8015cba0 0x7efe801572e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7efe7800efc0 tx=0x7efe7800c490 comp rx=0 tx=0).stop 2023-10-14T11:13:27.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.006+0000 7efe88254640 1 -- 172.21.15.26:0/1681773052 shutdown_connections 2023-10-14T11:13:27.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.006+0000 7efe88254640 1 --2- 172.21.15.26:0/1681773052 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efe640664d0 0x7efe64068990 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.006+0000 7efe88254640 1 --2- 172.21.15.26:0/1681773052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe8015cba0 0x7efe801572e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.006+0000 7efe88254640 1 --2- 172.21.15.26:0/1681773052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe800d0210 0x7efe80158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.006+0000 7efe88254640 1 --2- 172.21.15.26:0/1681773052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe800b84e0 0x7efe8014da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.006+0000 7efe88254640 1 -- 172.21.15.26:0/1681773052 >> 172.21.15.26:0/1681773052 conn(0x7efe800719c0 msgr2=0x7efe80159d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:27.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.006+0000 7efe88254640 1 -- 172.21.15.26:0/1681773052 shutdown_connections 2023-10-14T11:13:27.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.006+0000 7efe88254640 1 -- 172.21.15.26:0/1681773052 wait complete. 2023-10-14T11:13:27.031 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:13:27.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.174+0000 7f3db686b640 1 Processor -- start 2023-10-14T11:13:27.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.174+0000 7f3db686b640 1 -- start start 2023-10-14T11:13:27.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.174+0000 7f3db686b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3db0069e90 0x7f3db006d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:27.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.174+0000 7f3db686b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3db006a270 0x7f3db00c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:27.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.174+0000 7f3db686b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3db00702f0 0x7f3db0070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:27.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.174+0000 7f3db686b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db00cb090 con 0x7f3db0069e90 2023-10-14T11:13:27.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.174+0000 7f3db686b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db015ae30 con 0x7f3db00702f0 2023-10-14T11:13:27.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.174+0000 7f3db686b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db00ca510 con 0x7f3db006a270 2023-10-14T11:13:27.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.174+0000 7f3daffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3db0069e90 0x7f3db006d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:27.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.174+0000 7f3daffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3db0069e90 0x7f3db006d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47616/0 (socket says 172.21.15.26:47616) 2023-10-14T11:13:27.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.174+0000 7f3daffff640 1 -- 172.21.15.26:0/1858169038 learned_addr learned my addr 172.21.15.26:0/1858169038 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:27.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.174+0000 7f3daf7fe640 1 --2- 172.21.15.26:0/1858169038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3db006a270 0x7f3db00c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:27.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.174+0000 7f3db4e08640 1 --2- 172.21.15.26:0/1858169038 >> v2:172.21.15.110:3300/0 conn(0x7f3db00702f0 0x7f3db0070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:27.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.174+0000 7f3daffff640 1 -- 172.21.15.26:0/1858169038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3db006a270 msgr2=0x7f3db00c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:27.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.174+0000 7f3daffff640 1 --2- 172.21.15.26:0/1858169038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3db006a270 0x7f3db00c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.174+0000 7f3daffff640 1 -- 172.21.15.26:0/1858169038 >> v2:172.21.15.110:3300/0 conn(0x7f3db00702f0 msgr2=0x7f3db0070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:27.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.174+0000 7f3daffff640 1 --2- 172.21.15.26:0/1858169038 >> v2:172.21.15.110:3300/0 conn(0x7f3db00702f0 0x7f3db0070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.174+0000 7f3daffff640 1 -- 172.21.15.26:0/1858169038 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db00ca7f0 con 0x7f3db0069e90 2023-10-14T11:13:27.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.178+0000 7f3daffff640 1 --2- 172.21.15.26:0/1858169038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3db0069e90 0x7f3db006d010 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3db00b16e0 tx=0x7f3da001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0b4cce77955371 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:27.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.178+0000 7f3daeffd640 1 -- 172.21.15.26:0/1858169038 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da00aa5f0 con 0x7f3db0069e90 2023-10-14T11:13:27.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.178+0000 7f3daeffd640 1 -- 172.21.15.26:0/1858169038 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da00aa750 con 0x7f3db0069e90 2023-10-14T11:13:27.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.178+0000 7f3daeffd640 1 -- 172.21.15.26:0/1858169038 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da00aaae0 con 0x7f3db0069e90 2023-10-14T11:13:27.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.178+0000 7f3db686b640 1 -- 172.21.15.26:0/1858169038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3db0069e90 msgr2=0x7f3db006d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:27.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.178+0000 7f3db686b640 1 --2- 172.21.15.26:0/1858169038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3db0069e90 0x7f3db006d010 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3db00b16e0 tx=0x7f3da001c4d0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.178+0000 7f3db686b640 1 -- 172.21.15.26:0/1858169038 shutdown_connections 2023-10-14T11:13:27.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.178+0000 7f3db686b640 1 --2- 172.21.15.26:0/1858169038 >> v2:172.21.15.110:3300/0 conn(0x7f3db00702f0 0x7f3db0070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.178+0000 7f3db686b640 1 --2- 172.21.15.26:0/1858169038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3db006a270 0x7f3db00c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.178+0000 7f3db686b640 1 --2- 172.21.15.26:0/1858169038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3db0069e90 0x7f3db006d010 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.178+0000 7f3db686b640 1 -- 172.21.15.26:0/1858169038 >> 172.21.15.26:0/1858169038 conn(0x7f3db00b0da0 msgr2=0x7f3db00ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:27.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.178+0000 7f3db686b640 1 -- 172.21.15.26:0/1858169038 shutdown_connections 2023-10-14T11:13:27.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.178+0000 7f3db686b640 1 -- 172.21.15.26:0/1858169038 wait complete. 2023-10-14T11:13:27.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.178+0000 7f3db686b640 1 Processor -- start 2023-10-14T11:13:27.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.178+0000 7f3db686b640 1 -- start start 2023-10-14T11:13:27.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3db686b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3db0069e90 0x7f3db0156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:27.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3db686b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3db006a270 0x7f3db00acbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:27.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3db686b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3db00702f0 0x7f3db0155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:27.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3db686b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db0155ab0 con 0x7f3db00702f0 2023-10-14T11:13:27.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3db686b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db0153aa0 con 0x7f3db0069e90 2023-10-14T11:13:27.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3db686b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db0154e30 con 0x7f3db006a270 2023-10-14T11:13:27.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3db4e08640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3db00702f0 0x7f3db0155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:27.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3db4e08640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3db00702f0 0x7f3db0155ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47626/0 (socket says 172.21.15.26:47626) 2023-10-14T11:13:27.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3daffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3db0069e90 0x7f3db0156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:27.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3db4e08640 1 -- 172.21.15.26:0/2302855014 learned_addr learned my addr 172.21.15.26:0/2302855014 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:27.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3daf7fe640 1 --2- 172.21.15.26:0/2302855014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3db006a270 0x7f3db00acbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:27.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3db4e08640 1 -- 172.21.15.26:0/2302855014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3db006a270 msgr2=0x7f3db00acbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:27.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3db4e08640 1 --2- 172.21.15.26:0/2302855014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3db006a270 0x7f3db00acbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3db4e08640 1 -- 172.21.15.26:0/2302855014 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3db0069e90 msgr2=0x7f3db0156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:27.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3db4e08640 1 --2- 172.21.15.26:0/2302855014 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3db0069e90 0x7f3db0156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3db4e08640 1 -- 172.21.15.26:0/2302855014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da00094d0 con 0x7f3db00702f0 2023-10-14T11:13:27.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3db4e08640 1 --2- 172.21.15.26:0/2302855014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3db00702f0 0x7f3db0155ed0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3da8007e70 tx=0x7f3da800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3dacff9640 1 -- 172.21.15.26:0/2302855014 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da8014620 con 0x7f3db00702f0 2023-10-14T11:13:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3dacff9640 1 -- 172.21.15.26:0/2302855014 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da80147a0 con 0x7f3db00702f0 2023-10-14T11:13:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3dacff9640 1 -- 172.21.15.26:0/2302855014 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da8014b50 con 0x7f3db00702f0 2023-10-14T11:13:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3db686b640 1 -- 172.21.15.26:0/2302855014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db0155110 con 0x7f3db00702f0 2023-10-14T11:13:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3db686b640 1 -- 172.21.15.26:0/2302855014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db01556d0 con 0x7f3db00702f0 2023-10-14T11:13:27.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.182+0000 7f3db686b640 1 -- 172.21.15.26:0/2302855014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db0155bf0 con 0x7f3db00702f0 2023-10-14T11:13:27.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.186+0000 7f3dacff9640 1 -- 172.21.15.26:0/2302855014 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3da8014cb0 con 0x7f3db00702f0 2023-10-14T11:13:27.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.186+0000 7f3dacff9640 1 --2- 172.21.15.26:0/2302855014 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3d9c0664a0 0x7f3d9c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:27.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.186+0000 7f3dacff9640 1 -- 172.21.15.26:0/2302855014 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3da8084ae0 con 0x7f3db00702f0 2023-10-14T11:13:27.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.186+0000 7f3daffff640 1 --2- 172.21.15.26:0/2302855014 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3d9c0664a0 0x7f3d9c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:27.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.186+0000 7f3daffff640 1 --2- 172.21.15.26:0/2302855014 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3d9c0664a0 0x7f3d9c068960 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3da00ae000 tx=0x7f3da00b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:27.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.190+0000 7f3dacff9640 1 -- 172.21.15.26:0/2302855014 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3db0155bf0 con 0x7f3db00702f0 2023-10-14T11:13:27.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.346+0000 7f3db686b640 1 -- 172.21.15.26:0/2302855014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3db0155bf0 con 0x7f3db00702f0 2023-10-14T11:13:27.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.346+0000 7f3dacff9640 1 -- 172.21.15.26:0/2302855014 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3db0155bf0 con 0x7f3db00702f0 2023-10-14T11:13:27.352 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:27.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.346+0000 7f3db686b640 1 -- 172.21.15.26:0/2302855014 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3d9c0664a0 msgr2=0x7f3d9c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:27.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.346+0000 7f3db686b640 1 --2- 172.21.15.26:0/2302855014 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3d9c0664a0 0x7f3d9c068960 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3da00ae000 tx=0x7f3da00b5040 comp rx=0 tx=0).stop 2023-10-14T11:13:27.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.346+0000 7f3db686b640 1 -- 172.21.15.26:0/2302855014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3db00702f0 msgr2=0x7f3db0155ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:27.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.346+0000 7f3db686b640 1 --2- 172.21.15.26:0/2302855014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3db00702f0 0x7f3db0155ed0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3da8007e70 tx=0x7f3da800e4b0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.346+0000 7f3db686b640 1 -- 172.21.15.26:0/2302855014 shutdown_connections 2023-10-14T11:13:27.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.346+0000 7f3db686b640 1 --2- 172.21.15.26:0/2302855014 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3d9c0664a0 0x7f3d9c068960 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.346+0000 7f3db686b640 1 --2- 172.21.15.26:0/2302855014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3db00702f0 0x7f3db0155ed0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.346+0000 7f3db686b640 1 --2- 172.21.15.26:0/2302855014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3db006a270 0x7f3db00acbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.346+0000 7f3db686b640 1 --2- 172.21.15.26:0/2302855014 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3db0069e90 0x7f3db0156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.346+0000 7f3db686b640 1 -- 172.21.15.26:0/2302855014 >> 172.21.15.26:0/2302855014 conn(0x7f3db00b0da0 msgr2=0x7f3db00c2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:27.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.346+0000 7f3db686b640 1 -- 172.21.15.26:0/2302855014 shutdown_connections 2023-10-14T11:13:27.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.346+0000 7f3db686b640 1 -- 172.21.15.26:0/2302855014 wait complete. 2023-10-14T11:13:27.373 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:13:27.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.514+0000 7f6deba91640 1 Processor -- start 2023-10-14T11:13:27.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.514+0000 7f6deba91640 1 -- start start 2023-10-14T11:13:27.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.514+0000 7f6deba91640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6de415cba0 0x7f6de40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:27.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.514+0000 7f6deba91640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de40d1670 con 0x7f6de40b84e0 2023-10-14T11:13:27.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.514+0000 7f6deba91640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de40d1950 con 0x7f6de40d0210 2023-10-14T11:13:27.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.514+0000 7f6deba91640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de40d1460 con 0x7f6de415cba0 2023-10-14T11:13:27.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.514+0000 7f6de902c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6de40b84e0 0x7f6de40cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44582/0 (socket says 172.21.15.26:44582) 2023-10-14T11:13:27.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.514+0000 7f6de902c640 1 -- 172.21.15.26:0/3681436159 learned_addr learned my addr 172.21.15.26:0/3681436159 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:27.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.514+0000 7f6de982d640 1 --2- 172.21.15.26:0/3681436159 >> v2:172.21.15.110:3300/0 conn(0x7f6de415cba0 0x7f6de40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:27.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.514+0000 7f6de882b640 1 -- 172.21.15.26:0/3681436159 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855449812 0 0) 0x7f6de40d1670 con 0x7f6de40b84e0 2023-10-14T11:13:27.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.514+0000 7f6de882b640 1 -- 172.21.15.26:0/3681436159 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dd0003530 con 0x7f6de40b84e0 2023-10-14T11:13:27.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.514+0000 7f6de982d640 1 -- 172.21.15.26:0/3681436159 >> v1:172.21.15.110:6789/0 conn(0x7f6de40d0210 legacy=0x7f6de40b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:27.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.514+0000 7f6de982d640 1 -- 172.21.15.26:0/3681436159 >> v1:172.21.15.26:6789/0 conn(0x7f6de40b84e0 legacy=0x7f6de40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:27.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.514+0000 7f6de982d640 1 -- 172.21.15.26:0/3681436159 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de40d1c30 con 0x7f6de415cba0 2023-10-14T11:13:27.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.518+0000 7f6de982d640 1 --2- 172.21.15.26:0/3681436159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6de415cba0 0x7f6de40d0f20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6de00097c0 tx=0x7f6de001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=369dd6d50e8fd3e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:27.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.518+0000 7f6de882b640 1 -- 172.21.15.26:0/3681436159 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de00ab5f0 con 0x7f6de415cba0 2023-10-14T11:13:27.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.518+0000 7f6de882b640 1 -- 172.21.15.26:0/3681436159 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de00ab750 con 0x7f6de415cba0 2023-10-14T11:13:27.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.518+0000 7f6de882b640 1 -- 172.21.15.26:0/3681436159 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de00abae0 con 0x7f6de415cba0 2023-10-14T11:13:27.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.518+0000 7f6deba91640 1 -- 172.21.15.26:0/3681436159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6de415cba0 msgr2=0x7f6de40d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:27.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.518+0000 7f6deba91640 1 --2- 172.21.15.26:0/3681436159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6de415cba0 0x7f6de40d0f20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6de00097c0 tx=0x7f6de001c3f0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.518+0000 7f6deba91640 1 -- 172.21.15.26:0/3681436159 shutdown_connections 2023-10-14T11:13:27.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.518+0000 7f6deba91640 1 --2- 172.21.15.26:0/3681436159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6de415cba0 0x7f6de40d0f20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.518+0000 7f6deba91640 1 -- 172.21.15.26:0/3681436159 >> 172.21.15.26:0/3681436159 conn(0x7f6de40719c0 msgr2=0x7f6de4071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:27.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.518+0000 7f6deba91640 1 -- 172.21.15.26:0/3681436159 shutdown_connections 2023-10-14T11:13:27.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.518+0000 7f6deba91640 1 -- 172.21.15.26:0/3681436159 wait complete. 2023-10-14T11:13:27.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6deba91640 1 Processor -- start 2023-10-14T11:13:27.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6deba91640 1 -- start start 2023-10-14T11:13:27.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6deba91640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de40b84e0 0x7f6de414c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:27.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6deba91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6de40d0210 0x7f6de40c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:27.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6deba91640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6de415cba0 0x7f6de4150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:27.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6deba91640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de415d7f0 con 0x7f6de40b84e0 2023-10-14T11:13:27.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6deba91640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de40c7e20 con 0x7f6de40d0210 2023-10-14T11:13:27.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6deba91640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de40c8100 con 0x7f6de415cba0 2023-10-14T11:13:27.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6de982d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de40b84e0 0x7f6de414c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:27.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6de982d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de40b84e0 0x7f6de414c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47634/0 (socket says 172.21.15.26:47634) 2023-10-14T11:13:27.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6de982d640 1 -- 172.21.15.26:0/2231706420 learned_addr learned my addr 172.21.15.26:0/2231706420 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:27.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6de902c640 1 --2- 172.21.15.26:0/2231706420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6de40d0210 0x7f6de40c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:27.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6de982d640 1 -- 172.21.15.26:0/2231706420 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6de415cba0 msgr2=0x7f6de4150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:27.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6dea02e640 1 --2- 172.21.15.26:0/2231706420 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6de415cba0 0x7f6de4150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:27.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6de982d640 1 --2- 172.21.15.26:0/2231706420 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6de415cba0 0x7f6de4150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6de982d640 1 -- 172.21.15.26:0/2231706420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6de40d0210 msgr2=0x7f6de40c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:27.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6de982d640 1 --2- 172.21.15.26:0/2231706420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6de40d0210 0x7f6de40c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6de982d640 1 -- 172.21.15.26:0/2231706420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de0009420 con 0x7f6de40b84e0 2023-10-14T11:13:27.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6de902c640 1 --2- 172.21.15.26:0/2231706420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6de40d0210 0x7f6de40c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:27.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6dea02e640 1 --2- 172.21.15.26:0/2231706420 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6de415cba0 0x7f6de4150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:27.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6de982d640 1 --2- 172.21.15.26:0/2231706420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de40b84e0 0x7f6de414c900 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6de00ad040 tx=0x7f6de001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:27.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6dda7fc640 1 -- 172.21.15.26:0/2231706420 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de00bf610 con 0x7f6de40b84e0 2023-10-14T11:13:27.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6dda7fc640 1 -- 172.21.15.26:0/2231706420 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de00bf7b0 con 0x7f6de40b84e0 2023-10-14T11:13:27.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6dda7fc640 1 -- 172.21.15.26:0/2231706420 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de00bfb60 con 0x7f6de40b84e0 2023-10-14T11:13:27.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6deba91640 1 -- 172.21.15.26:0/2231706420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de40c83e0 con 0x7f6de40b84e0 2023-10-14T11:13:27.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6deba91640 1 -- 172.21.15.26:0/2231706420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de40c89a0 con 0x7f6de40b84e0 2023-10-14T11:13:27.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.522+0000 7f6deba91640 1 -- 172.21.15.26:0/2231706420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de404e170 con 0x7f6de40b84e0 2023-10-14T11:13:27.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.526+0000 7f6dda7fc640 1 -- 172.21.15.26:0/2231706420 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6de00bfcc0 con 0x7f6de40b84e0 2023-10-14T11:13:27.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.526+0000 7f6dda7fc640 1 --2- 172.21.15.26:0/2231706420 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6dc80664a0 0x7f6dc8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:27.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.526+0000 7f6dda7fc640 1 -- 172.21.15.26:0/2231706420 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6de00a8050 con 0x7f6de40b84e0 2023-10-14T11:13:27.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.526+0000 7f6de902c640 1 --2- 172.21.15.26:0/2231706420 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6dc80664a0 0x7f6dc8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:27.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.526+0000 7f6de902c640 1 --2- 172.21.15.26:0/2231706420 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6dc80664a0 0x7f6dc8068960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6de40c7bf0 tx=0x7f6dd4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:27.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.530+0000 7f6dda7fc640 1 -- 172.21.15.26:0/2231706420 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6de00ebab0 con 0x7f6de40b84e0 2023-10-14T11:13:27.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.686+0000 7f6deba91640 1 -- 172.21.15.26:0/2231706420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6de4155520 con 0x7f6de40b84e0 2023-10-14T11:13:27.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.686+0000 7f6dda7fc640 1 -- 172.21.15.26:0/2231706420 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6de011ce60 con 0x7f6de40b84e0 2023-10-14T11:13:27.691 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:13:27.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.686+0000 7f6deba91640 1 -- 172.21.15.26:0/2231706420 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6dc80664a0 msgr2=0x7f6dc8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:27.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.686+0000 7f6deba91640 1 --2- 172.21.15.26:0/2231706420 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6dc80664a0 0x7f6dc8068960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6de40c7bf0 tx=0x7f6dd4009040 comp rx=0 tx=0).stop 2023-10-14T11:13:27.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.686+0000 7f6deba91640 1 -- 172.21.15.26:0/2231706420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de40b84e0 msgr2=0x7f6de414c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:27.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.686+0000 7f6deba91640 1 --2- 172.21.15.26:0/2231706420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de40b84e0 0x7f6de414c900 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6de00ad040 tx=0x7f6de001ac30 comp rx=0 tx=0).stop 2023-10-14T11:13:27.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.686+0000 7f6deba91640 1 -- 172.21.15.26:0/2231706420 shutdown_connections 2023-10-14T11:13:27.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.686+0000 7f6deba91640 1 --2- 172.21.15.26:0/2231706420 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6de415cba0 0x7f6de4150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.686+0000 7f6deba91640 1 --2- 172.21.15.26:0/2231706420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6de40d0210 0x7f6de40c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.686+0000 7f6deba91640 1 --2- 172.21.15.26:0/2231706420 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6dc80664a0 0x7f6dc8068960 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.686+0000 7f6deba91640 1 --2- 172.21.15.26:0/2231706420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de40b84e0 0x7f6de414c900 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.686+0000 7f6deba91640 1 -- 172.21.15.26:0/2231706420 >> 172.21.15.26:0/2231706420 conn(0x7f6de40719c0 msgr2=0x7f6de4155a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:27.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.686+0000 7f6deba91640 1 -- 172.21.15.26:0/2231706420 shutdown_connections 2023-10-14T11:13:27.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.686+0000 7f6deba91640 1 -- 172.21.15.26:0/2231706420 wait complete. 2023-10-14T11:13:27.712 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T11:13:27.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.850+0000 7f0f0bc91640 1 Processor -- start 2023-10-14T11:13:27.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.854+0000 7f0f0bc91640 1 -- start start 2023-10-14T11:13:27.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.854+0000 7f0f0bc91640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f0415cc60 0x7f0f040cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:27.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.854+0000 7f0f0bc91640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0f04161260 0x7f0f040ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:27.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.854+0000 7f0f0bc91640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0f040cebd0 0x7f0f040b2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:27.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.854+0000 7f0f0bc91640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f040cc330 con 0x7f0f040cebd0 2023-10-14T11:13:27.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.854+0000 7f0f0bc91640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f040cefe0 con 0x7f0f04161260 2023-10-14T11:13:27.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.854+0000 7f0f0bc91640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f040cb720 con 0x7f0f0415cc60 2023-10-14T11:13:27.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.854+0000 7f0f0a22e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0f040cebd0 0x7f0f040b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:27.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.854+0000 7f0f0a22e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0f040cebd0 0x7f0f040b2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47642/0 (socket says 172.21.15.26:47642) 2023-10-14T11:13:27.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.854+0000 7f0f0a22e640 1 -- 172.21.15.26:0/648046415 learned_addr learned my addr 172.21.15.26:0/648046415 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:27.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.854+0000 7f0f09a2d640 1 --2- 172.21.15.26:0/648046415 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f0415cc60 0x7f0f040cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:27.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.854+0000 7f0f0922c640 1 --2- 172.21.15.26:0/648046415 >> v2:172.21.15.110:3300/0 conn(0x7f0f04161260 0x7f0f040ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:27.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.854+0000 7f0f0a22e640 1 -- 172.21.15.26:0/648046415 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f0415cc60 msgr2=0x7f0f040cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:27.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.854+0000 7f0f0a22e640 1 --2- 172.21.15.26:0/648046415 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f0415cc60 0x7f0f040cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.854+0000 7f0f0a22e640 1 -- 172.21.15.26:0/648046415 >> v2:172.21.15.110:3300/0 conn(0x7f0f04161260 msgr2=0x7f0f040ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:27.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.854+0000 7f0f0a22e640 1 --2- 172.21.15.26:0/648046415 >> v2:172.21.15.110:3300/0 conn(0x7f0f04161260 0x7f0f040ce690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.854+0000 7f0f0a22e640 1 -- 172.21.15.26:0/648046415 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f040cba00 con 0x7f0f040cebd0 2023-10-14T11:13:27.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.858+0000 7f0f0a22e640 1 --2- 172.21.15.26:0/648046415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f040cebd0 0x7f0f040b2330 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0f0406f640 tx=0x7f0efc01c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac89db746b59c64 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:27.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.858+0000 7f0f08a2b640 1 -- 172.21.15.26:0/648046415 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc0a5560 con 0x7f0f040cebd0 2023-10-14T11:13:27.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.858+0000 7f0f08a2b640 1 -- 172.21.15.26:0/648046415 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0efc0a56c0 con 0x7f0f040cebd0 2023-10-14T11:13:27.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.858+0000 7f0f08a2b640 1 -- 172.21.15.26:0/648046415 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc0a5a50 con 0x7f0f040cebd0 2023-10-14T11:13:27.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.858+0000 7f0f0bc91640 1 -- 172.21.15.26:0/648046415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f040cebd0 msgr2=0x7f0f040b2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:27.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.858+0000 7f0f0bc91640 1 --2- 172.21.15.26:0/648046415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f040cebd0 0x7f0f040b2330 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0f0406f640 tx=0x7f0efc01c6e0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.858+0000 7f0f0bc91640 1 -- 172.21.15.26:0/648046415 shutdown_connections 2023-10-14T11:13:27.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.858+0000 7f0f0bc91640 1 --2- 172.21.15.26:0/648046415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f040cebd0 0x7f0f040b2330 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.858+0000 7f0f0bc91640 1 --2- 172.21.15.26:0/648046415 >> v2:172.21.15.110:3300/0 conn(0x7f0f04161260 0x7f0f040ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.858+0000 7f0f0bc91640 1 --2- 172.21.15.26:0/648046415 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f0415cc60 0x7f0f040cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.858+0000 7f0f0bc91640 1 -- 172.21.15.26:0/648046415 >> 172.21.15.26:0/648046415 conn(0x7f0f0406e570 msgr2=0x7f0f0406e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:27.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.858+0000 7f0f0bc91640 1 -- 172.21.15.26:0/648046415 shutdown_connections 2023-10-14T11:13:27.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.858+0000 7f0f0bc91640 1 -- 172.21.15.26:0/648046415 wait complete. 2023-10-14T11:13:27.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.858+0000 7f0f0bc91640 1 Processor -- start 2023-10-14T11:13:27.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.858+0000 7f0f0bc91640 1 -- start start 2023-10-14T11:13:27.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0f0bc91640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f040cebd0 0x7f0f04150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:27.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0f0bc91640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f0415cc60 0x7f0f0415b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:27.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0f0bc91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f04161260 0x7f0f04155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:27.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0f0bc91640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0415a0d0 con 0x7f0f040cebd0 2023-10-14T11:13:27.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0f0bc91640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0415a3b0 con 0x7f0f04161260 2023-10-14T11:13:27.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0f0bc91640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0415a690 con 0x7f0f0415cc60 2023-10-14T11:13:27.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0f09a2d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f040cebd0 0x7f0f04150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:27.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0f09a2d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f040cebd0 0x7f0f04150050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47650/0 (socket says 172.21.15.26:47650) 2023-10-14T11:13:27.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0f09a2d640 1 -- 172.21.15.26:0/1342041360 learned_addr learned my addr 172.21.15.26:0/1342041360 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:27.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0f0a22e640 1 --2- 172.21.15.26:0/1342041360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f04161260 0x7f0f04155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:27.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0f0922c640 1 --2- 172.21.15.26:0/1342041360 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f0415cc60 0x7f0f0415b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:27.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0f09a2d640 1 -- 172.21.15.26:0/1342041360 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f0415cc60 msgr2=0x7f0f0415b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:27.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0f09a2d640 1 --2- 172.21.15.26:0/1342041360 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f0415cc60 0x7f0f0415b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0f09a2d640 1 -- 172.21.15.26:0/1342041360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f04161260 msgr2=0x7f0f04155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:27.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0f09a2d640 1 --2- 172.21.15.26:0/1342041360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f04161260 0x7f0f04155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:27.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0f09a2d640 1 -- 172.21.15.26:0/1342041360 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc009b30 con 0x7f0f040cebd0 2023-10-14T11:13:27.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0f09a2d640 1 --2- 172.21.15.26:0/1342041360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f040cebd0 0x7f0f04150050 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000d800 tx=0x7f0f0000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:27.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0efa7fc640 1 -- 172.21.15.26:0/1342041360 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f000096a0 con 0x7f0f040cebd0 2023-10-14T11:13:27.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0efa7fc640 1 -- 172.21.15.26:0/1342041360 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f00009800 con 0x7f0f040cebd0 2023-10-14T11:13:27.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0f0bc91640 1 -- 172.21.15.26:0/1342041360 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0415a970 con 0x7f0f040cebd0 2023-10-14T11:13:27.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0efa7fc640 1 -- 172.21.15.26:0/1342041360 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f00009b70 con 0x7f0f040cebd0 2023-10-14T11:13:27.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0f0bc91640 1 -- 172.21.15.26:0/1342041360 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f040c82d0 con 0x7f0f040cebd0 2023-10-14T11:13:27.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.862+0000 7f0f0bc91640 1 -- 172.21.15.26:0/1342041360 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0404e170 con 0x7f0f040cebd0 2023-10-14T11:13:27.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.866+0000 7f0efa7fc640 1 -- 172.21.15.26:0/1342041360 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0f00009cd0 con 0x7f0f040cebd0 2023-10-14T11:13:27.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.866+0000 7f0efa7fc640 1 --2- 172.21.15.26:0/1342041360 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0ee80664a0 0x7f0ee8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:27.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.866+0000 7f0efa7fc640 1 -- 172.21.15.26:0/1342041360 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0f00084920 con 0x7f0f040cebd0 2023-10-14T11:13:27.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.866+0000 7f0f0922c640 1 --2- 172.21.15.26:0/1342041360 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0ee80664a0 0x7f0ee8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:27.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.866+0000 7f0f0922c640 1 --2- 172.21.15.26:0/1342041360 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0ee80664a0 0x7f0ee8068960 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0f041f8d60 tx=0x7f0ef4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:27.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:27.870+0000 7f0efa7fc640 1 -- 172.21.15.26:0/1342041360 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0f000519d0 con 0x7f0f040cebd0 2023-10-14T11:13:28.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.026+0000 7f0f0bc91640 1 -- 172.21.15.26:0/1342041360 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0f040b6830 con 0x7f0f040cebd0 2023-10-14T11:13:28.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.030+0000 7f0efa7fc640 1 -- 172.21.15.26:0/1342041360 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0f00054ff0 con 0x7f0f040cebd0 2023-10-14T11:13:28.035 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:28.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.030+0000 7f0f0bc91640 1 -- 172.21.15.26:0/1342041360 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0ee80664a0 msgr2=0x7f0ee8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:28.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.030+0000 7f0f0bc91640 1 --2- 172.21.15.26:0/1342041360 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0ee80664a0 0x7f0ee8068960 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0f041f8d60 tx=0x7f0ef4008040 comp rx=0 tx=0).stop 2023-10-14T11:13:28.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.030+0000 7f0f0bc91640 1 -- 172.21.15.26:0/1342041360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f040cebd0 msgr2=0x7f0f04150050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:28.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.030+0000 7f0f0bc91640 1 --2- 172.21.15.26:0/1342041360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f040cebd0 0x7f0f04150050 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000d800 tx=0x7f0f0000dcc0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.030+0000 7f0f0bc91640 1 -- 172.21.15.26:0/1342041360 shutdown_connections 2023-10-14T11:13:28.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.030+0000 7f0f0bc91640 1 --2- 172.21.15.26:0/1342041360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f04161260 0x7f0f04155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.030+0000 7f0f0bc91640 1 --2- 172.21.15.26:0/1342041360 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f0415cc60 0x7f0f0415b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.030+0000 7f0f0bc91640 1 --2- 172.21.15.26:0/1342041360 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0ee80664a0 0x7f0ee8068960 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.030+0000 7f0f0bc91640 1 --2- 172.21.15.26:0/1342041360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f040cebd0 0x7f0f04150050 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.030+0000 7f0f0bc91640 1 -- 172.21.15.26:0/1342041360 >> 172.21.15.26:0/1342041360 conn(0x7f0f0406e570 msgr2=0x7f0f040cc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:28.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.030+0000 7f0f0bc91640 1 -- 172.21.15.26:0/1342041360 shutdown_connections 2023-10-14T11:13:28.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.030+0000 7f0f0bc91640 1 -- 172.21.15.26:0/1342041360 wait complete. 2023-10-14T11:13:28.056 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:13:28.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.194+0000 7fd98e994640 1 Processor -- start 2023-10-14T11:13:28.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.194+0000 7fd98e994640 1 -- start start 2023-10-14T11:13:28.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.194+0000 7fd98e994640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd9881597c0 0x7fd9880ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:28.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.194+0000 7fd98e994640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9880723d0 con 0x7fd9880adc10 2023-10-14T11:13:28.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.194+0000 7fd98e994640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9880717c0 con 0x7fd988159ba0 2023-10-14T11:13:28.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.194+0000 7fd98e994640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd988071aa0 con 0x7fd9881597c0 2023-10-14T11:13:28.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.194+0000 7fd987fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd9881597c0 0x7fd9880ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:28.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.194+0000 7fd987fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd9881597c0 0x7fd9880ad6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47652/0 (socket says 172.21.15.26:47652) 2023-10-14T11:13:28.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.194+0000 7fd987fff640 1 -- 172.21.15.26:0/1053938790 learned_addr learned my addr 172.21.15.26:0/1053938790 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:28.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.194+0000 7fd98cf31640 1 --1- 172.21.15.26:0/1053938790 >> v1:172.21.15.26:6789/0 conn(0x7fd9880adc10 0x7fd98815d4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44596/0 (socket says 172.21.15.26:44596) 2023-10-14T11:13:28.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.198+0000 7fd987fff640 1 -- 172.21.15.26:0/1053938790 >> v1:172.21.15.110:6789/0 conn(0x7fd988159ba0 legacy=0x7fd9880cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:28.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.198+0000 7fd987fff640 1 -- 172.21.15.26:0/1053938790 >> v1:172.21.15.26:6789/0 conn(0x7fd9880adc10 legacy=0x7fd98815d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:28.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.198+0000 7fd987fff640 1 -- 172.21.15.26:0/1053938790 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd988071d80 con 0x7fd9881597c0 2023-10-14T11:13:28.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.198+0000 7fd987fff640 1 --2- 172.21.15.26:0/1053938790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9881597c0 0x7fd9880ad6d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd978009870 tx=0x7fd97801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb5d9bf90fe24e5b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:28.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.198+0000 7fd986ffd640 1 -- 172.21.15.26:0/1053938790 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9780aa610 con 0x7fd9881597c0 2023-10-14T11:13:28.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.198+0000 7fd986ffd640 1 -- 172.21.15.26:0/1053938790 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9780a6040 con 0x7fd9881597c0 2023-10-14T11:13:28.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.198+0000 7fd986ffd640 1 -- 172.21.15.26:0/1053938790 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9780aa990 con 0x7fd9881597c0 2023-10-14T11:13:28.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.198+0000 7fd98e994640 1 -- 172.21.15.26:0/1053938790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9881597c0 msgr2=0x7fd9880ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:28.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.198+0000 7fd98e994640 1 --2- 172.21.15.26:0/1053938790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9881597c0 0x7fd9880ad6d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd978009870 tx=0x7fd97801c510 comp rx=0 tx=0).stop 2023-10-14T11:13:28.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.198+0000 7fd98e994640 1 -- 172.21.15.26:0/1053938790 shutdown_connections 2023-10-14T11:13:28.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.198+0000 7fd98e994640 1 --2- 172.21.15.26:0/1053938790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9881597c0 0x7fd9880ad6d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.198+0000 7fd98e994640 1 -- 172.21.15.26:0/1053938790 >> 172.21.15.26:0/1053938790 conn(0x7fd98806c190 msgr2=0x7fd98806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:28.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.198+0000 7fd98e994640 1 -- 172.21.15.26:0/1053938790 shutdown_connections 2023-10-14T11:13:28.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.198+0000 7fd98e994640 1 -- 172.21.15.26:0/1053938790 wait complete. 2023-10-14T11:13:28.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.202+0000 7fd98e994640 1 Processor -- start 2023-10-14T11:13:28.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.202+0000 7fd98e994640 1 -- start start 2023-10-14T11:13:28.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.202+0000 7fd98e994640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9880adc10 0x7fd9880af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:28.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.202+0000 7fd98e994640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9881597c0 0x7fd9880c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:28.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.202+0000 7fd98e994640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd988159ba0 0x7fd988147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:28.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.202+0000 7fd98e994640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9880c6700 con 0x7fd988159ba0 2023-10-14T11:13:28.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.202+0000 7fd98e994640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9880c5c70 con 0x7fd9881597c0 2023-10-14T11:13:28.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.202+0000 7fd98e994640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd988156140 con 0x7fd9880adc10 2023-10-14T11:13:28.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.202+0000 7fd98cf31640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd988159ba0 0x7fd988147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:28.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.202+0000 7fd98cf31640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd988159ba0 0x7fd988147d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47668/0 (socket says 172.21.15.26:47668) 2023-10-14T11:13:28.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.202+0000 7fd98cf31640 1 -- 172.21.15.26:0/1943731103 learned_addr learned my addr 172.21.15.26:0/1943731103 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:28.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.202+0000 7fd9877fe640 1 --2- 172.21.15.26:0/1943731103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9881597c0 0x7fd9880c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:28.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.202+0000 7fd987fff640 1 --2- 172.21.15.26:0/1943731103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9880adc10 0x7fd9880af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:28.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.202+0000 7fd98cf31640 1 -- 172.21.15.26:0/1943731103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9880adc10 msgr2=0x7fd9880af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:28.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.202+0000 7fd98cf31640 1 --2- 172.21.15.26:0/1943731103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9880adc10 0x7fd9880af640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.202+0000 7fd98cf31640 1 -- 172.21.15.26:0/1943731103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9881597c0 msgr2=0x7fd9880c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:28.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.202+0000 7fd98cf31640 1 --2- 172.21.15.26:0/1943731103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9881597c0 0x7fd9880c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.202+0000 7fd98cf31640 1 -- 172.21.15.26:0/1943731103 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9780094d0 con 0x7fd988159ba0 2023-10-14T11:13:28.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.202+0000 7fd987fff640 1 --2- 172.21.15.26:0/1943731103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9880adc10 0x7fd9880af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:28.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.202+0000 7fd98cf31640 1 --2- 172.21.15.26:0/1943731103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd988159ba0 0x7fd988147d10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd98000caa0 tx=0x7fd98000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:28.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.206+0000 7fd984ff9640 1 -- 172.21.15.26:0/1943731103 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98000a6d0 con 0x7fd988159ba0 2023-10-14T11:13:28.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.206+0000 7fd984ff9640 1 -- 172.21.15.26:0/1943731103 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98000a830 con 0x7fd988159ba0 2023-10-14T11:13:28.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.206+0000 7fd98e994640 1 -- 172.21.15.26:0/1943731103 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd988148250 con 0x7fd988159ba0 2023-10-14T11:13:28.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.206+0000 7fd984ff9640 1 -- 172.21.15.26:0/1943731103 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98000abe0 con 0x7fd988159ba0 2023-10-14T11:13:28.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.206+0000 7fd98e994640 1 -- 172.21.15.26:0/1943731103 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9880c5f10 con 0x7fd988159ba0 2023-10-14T11:13:28.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.206+0000 7fd98e994640 1 -- 172.21.15.26:0/1943731103 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9880c6540 con 0x7fd988159ba0 2023-10-14T11:13:28.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.206+0000 7fd984ff9640 1 -- 172.21.15.26:0/1943731103 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd98000ad40 con 0x7fd988159ba0 2023-10-14T11:13:28.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.206+0000 7fd984ff9640 1 --2- 172.21.15.26:0/1943731103 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd9740664a0 0x7fd974068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:28.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.206+0000 7fd984ff9640 1 -- 172.21.15.26:0/1943731103 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd980083bc0 con 0x7fd988159ba0 2023-10-14T11:13:28.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.206+0000 7fd987fff640 1 --2- 172.21.15.26:0/1943731103 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd9740664a0 0x7fd974068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:28.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.206+0000 7fd987fff640 1 --2- 172.21.15.26:0/1943731103 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd9740664a0 0x7fd974068960 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd9780ae000 tx=0x7fd978008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:28.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.210+0000 7fd984ff9640 1 -- 172.21.15.26:0/1943731103 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd980050c90 con 0x7fd988159ba0 2023-10-14T11:13:28.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.382+0000 7fd98e994640 1 -- 172.21.15.26:0/1943731103 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd988074010 con 0x7fd988159ba0 2023-10-14T11:13:28.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.382+0000 7fd984ff9640 1 -- 172.21.15.26:0/1943731103 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd980017020 con 0x7fd988159ba0 2023-10-14T11:13:28.388 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-10-14T11:13:28.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.382+0000 7fd98e994640 1 -- 172.21.15.26:0/1943731103 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd9740664a0 msgr2=0x7fd974068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:28.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.382+0000 7fd98e994640 1 --2- 172.21.15.26:0/1943731103 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd9740664a0 0x7fd974068960 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd9780ae000 tx=0x7fd978008040 comp rx=0 tx=0).stop 2023-10-14T11:13:28.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.382+0000 7fd98e994640 1 -- 172.21.15.26:0/1943731103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd988159ba0 msgr2=0x7fd988147d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:28.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.382+0000 7fd98e994640 1 --2- 172.21.15.26:0/1943731103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd988159ba0 0x7fd988147d10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd98000caa0 tx=0x7fd98000cf60 comp rx=0 tx=0).stop 2023-10-14T11:13:28.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.382+0000 7fd98e994640 1 -- 172.21.15.26:0/1943731103 shutdown_connections 2023-10-14T11:13:28.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.382+0000 7fd98e994640 1 --2- 172.21.15.26:0/1943731103 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd9740664a0 0x7fd974068960 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.382+0000 7fd98e994640 1 --2- 172.21.15.26:0/1943731103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd988159ba0 0x7fd988147d10 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.382+0000 7fd98e994640 1 --2- 172.21.15.26:0/1943731103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9881597c0 0x7fd9880c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.382+0000 7fd98e994640 1 --2- 172.21.15.26:0/1943731103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9880adc10 0x7fd9880af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.382+0000 7fd98e994640 1 -- 172.21.15.26:0/1943731103 >> 172.21.15.26:0/1943731103 conn(0x7fd98806c190 msgr2=0x7fd9880ae2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:28.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.386+0000 7fd98e994640 1 -- 172.21.15.26:0/1943731103 shutdown_connections 2023-10-14T11:13:28.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.386+0000 7fd98e994640 1 -- 172.21.15.26:0/1943731103 wait complete. 2023-10-14T11:13:28.410 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:13:28.410 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:13:28.420 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:13:28.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.598+0000 7fc97473e640 1 Processor -- start 2023-10-14T11:13:28.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.598+0000 7fc97473e640 1 -- start start 2023-10-14T11:13:28.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.598+0000 7fc97473e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc96c070c40 0x7fc96c15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:28.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.598+0000 7fc97473e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c0b07f0 0x7fc96c164490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:28.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.598+0000 7fc97473e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96c15be60 con 0x7fc96c0b4020 2023-10-14T11:13:28.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.598+0000 7fc97473e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c15b3b0 con 0x7fc96c070c40 2023-10-14T11:13:28.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.598+0000 7fc97473e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c15c1f0 con 0x7fc96c0b07f0 2023-10-14T11:13:28.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.598+0000 7fc9724da640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc96c070c40 0x7fc96c15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:28.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.598+0000 7fc972cdb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c0b07f0 0x7fc96c164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:28.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.598+0000 7fc9724da640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc96c070c40 0x7fc96c15ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:53686/0 (socket says 172.21.15.26:53686) 2023-10-14T11:13:28.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.598+0000 7fc9724da640 1 -- 172.21.15.26:0/2173555725 learned_addr learned my addr 172.21.15.26:0/2173555725 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:28.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.598+0000 7fc972cdb640 1 --2- 172.21.15.26:0/2173555725 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c0b07f0 0x7fc96c164490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:38596/0 (socket says 172.21.15.26:38596) 2023-10-14T11:13:28.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.598+0000 7fc971cd9640 1 --1- 172.21.15.26:0/2173555725 >> v1:172.21.15.110:6789/0 conn(0x7fc96c0b4020 0x7fc96c0b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:48486/0 (socket says 172.21.15.26:48486) 2023-10-14T11:13:28.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.598+0000 7fc9724da640 1 -- 172.21.15.26:0/2173555725 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c0b07f0 msgr2=0x7fc96c164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:28.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.598+0000 7fc9724da640 1 --2- 172.21.15.26:0/2173555725 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c0b07f0 0x7fc96c164490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.598+0000 7fc9724da640 1 -- 172.21.15.26:0/2173555725 >> v1:172.21.15.110:6789/0 conn(0x7fc96c0b4020 legacy=0x7fc96c0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:28.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.598+0000 7fc9724da640 1 -- 172.21.15.26:0/2173555725 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c071020 con 0x7fc96c070c40 2023-10-14T11:13:28.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.598+0000 7fc972cdb640 1 --2- 172.21.15.26:0/2173555725 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c0b07f0 0x7fc96c164490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:13:28.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.598+0000 7fc9714d8640 1 -- 172.21.15.26:0/2173555725 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2251406736 0 0) 0x7fc96c15be60 con 0x7fc96c0b4020 2023-10-14T11:13:28.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.602+0000 7fc9724da640 1 --2- 172.21.15.26:0/2173555725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc96c070c40 0x7fc96c15ae70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc968009870 tx=0x7fc96801c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fce3efae3d8d697b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:28.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.602+0000 7fc9714d8640 1 -- 172.21.15.26:0/2173555725 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9680aa610 con 0x7fc96c070c40 2023-10-14T11:13:28.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.602+0000 7fc9714d8640 1 -- 172.21.15.26:0/2173555725 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9680a6040 con 0x7fc96c070c40 2023-10-14T11:13:28.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.602+0000 7fc9714d8640 1 -- 172.21.15.26:0/2173555725 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9680aa990 con 0x7fc96c070c40 2023-10-14T11:13:28.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.602+0000 7fc97473e640 1 -- 172.21.15.26:0/2173555725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc96c070c40 msgr2=0x7fc96c15ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:28.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.602+0000 7fc97473e640 1 --2- 172.21.15.26:0/2173555725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc96c070c40 0x7fc96c15ae70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc968009870 tx=0x7fc96801c4b0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.602+0000 7fc97473e640 1 -- 172.21.15.26:0/2173555725 shutdown_connections 2023-10-14T11:13:28.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.602+0000 7fc97473e640 1 --2- 172.21.15.26:0/2173555725 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c0b07f0 0x7fc96c164490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.602+0000 7fc97473e640 1 --2- 172.21.15.26:0/2173555725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc96c070c40 0x7fc96c15ae70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.602+0000 7fc97473e640 1 -- 172.21.15.26:0/2173555725 >> 172.21.15.26:0/2173555725 conn(0x7fc96c06c190 msgr2=0x7fc96c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:28.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.602+0000 7fc97473e640 1 -- 172.21.15.26:0/2173555725 shutdown_connections 2023-10-14T11:13:28.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.602+0000 7fc97473e640 1 -- 172.21.15.26:0/2173555725 wait complete. 2023-10-14T11:13:28.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc97473e640 1 Processor -- start 2023-10-14T11:13:28.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc97473e640 1 -- start start 2023-10-14T11:13:28.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc97473e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c070c40 0x7fc96c154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:28.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc97473e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc96c0b07f0 0x7fc96c159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:28.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc97473e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc96c0b4020 0x7fc96c14d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:28.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc97473e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c0b2180 con 0x7fc96c0b07f0 2023-10-14T11:13:28.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc97473e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c154f80 con 0x7fc96c0b4020 2023-10-14T11:13:28.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc97473e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c0cc730 con 0x7fc96c070c40 2023-10-14T11:13:28.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc971cd9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc96c0b07f0 0x7fc96c159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:28.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc971cd9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc96c0b07f0 0x7fc96c159ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47678/0 (socket says 172.21.15.26:47678) 2023-10-14T11:13:28.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc971cd9640 1 -- 172.21.15.26:0/2976999445 learned_addr learned my addr 172.21.15.26:0/2976999445 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:28.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc9724da640 1 --2- 172.21.15.26:0/2976999445 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c070c40 0x7fc96c154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:28.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc972cdb640 1 --2- 172.21.15.26:0/2976999445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc96c0b4020 0x7fc96c14d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:28.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc971cd9640 1 -- 172.21.15.26:0/2976999445 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c070c40 msgr2=0x7fc96c154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:28.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc971cd9640 1 --2- 172.21.15.26:0/2976999445 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c070c40 0x7fc96c154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc971cd9640 1 -- 172.21.15.26:0/2976999445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc96c0b4020 msgr2=0x7fc96c14d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:28.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc971cd9640 1 --2- 172.21.15.26:0/2976999445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc96c0b4020 0x7fc96c14d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc971cd9640 1 -- 172.21.15.26:0/2976999445 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc964009a70 con 0x7fc96c0b07f0 2023-10-14T11:13:28.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc971cd9640 1 --2- 172.21.15.26:0/2976999445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc96c0b07f0 0x7fc96c159ba0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00c4b0 tx=0x7fc95c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:28.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc962ffd640 1 -- 172.21.15.26:0/2976999445 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c0074e0 con 0x7fc96c0b07f0 2023-10-14T11:13:28.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc962ffd640 1 -- 172.21.15.26:0/2976999445 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c007660 con 0x7fc96c0b07f0 2023-10-14T11:13:28.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc97473e640 1 -- 172.21.15.26:0/2976999445 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9680094d0 con 0x7fc96c0b07f0 2023-10-14T11:13:28.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc962ffd640 1 -- 172.21.15.26:0/2976999445 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c004a30 con 0x7fc96c0b07f0 2023-10-14T11:13:28.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.606+0000 7fc97473e640 1 -- 172.21.15.26:0/2976999445 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96c0cccf0 con 0x7fc96c0b07f0 2023-10-14T11:13:28.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.610+0000 7fc97473e640 1 -- 172.21.15.26:0/2976999445 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96c0b22f0 con 0x7fc96c0b07f0 2023-10-14T11:13:28.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.610+0000 7fc962ffd640 1 -- 172.21.15.26:0/2976999445 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc95c004b90 con 0x7fc96c0b07f0 2023-10-14T11:13:28.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.610+0000 7fc962ffd640 1 --2- 172.21.15.26:0/2976999445 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc9500664a0 0x7fc950068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:28.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.610+0000 7fc962ffd640 1 -- 172.21.15.26:0/2976999445 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc95c083320 con 0x7fc96c0b07f0 2023-10-14T11:13:28.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.610+0000 7fc9724da640 1 --2- 172.21.15.26:0/2976999445 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc9500664a0 0x7fc950068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:28.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.610+0000 7fc9724da640 1 --2- 172.21.15.26:0/2976999445 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc9500664a0 0x7fc950068960 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc9680ae000 tx=0x7fc9680b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:28.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.614+0000 7fc962ffd640 1 -- 172.21.15.26:0/2976999445 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc95c050480 con 0x7fc96c0b07f0 2023-10-14T11:13:28.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.774+0000 7fc97473e640 1 -- 172.21.15.26:0/2976999445 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc96c074010 con 0x7fc96c0b07f0 2023-10-14T11:13:28.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.774+0000 7fc962ffd640 1 -- 172.21.15.26:0/2976999445 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18679 (secure 0 0 0) 0x7fc95c053aa0 con 0x7fc96c0b07f0 2023-10-14T11:13:28.780 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:28.780 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":27,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:13:03.866737+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:13:28.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.774+0000 7fc97473e640 1 -- 172.21.15.26:0/2976999445 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc9500664a0 msgr2=0x7fc950068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:28.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.774+0000 7fc97473e640 1 --2- 172.21.15.26:0/2976999445 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc9500664a0 0x7fc950068960 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc9680ae000 tx=0x7fc9680b5040 comp rx=0 tx=0).stop 2023-10-14T11:13:28.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.774+0000 7fc97473e640 1 -- 172.21.15.26:0/2976999445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc96c0b07f0 msgr2=0x7fc96c159ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:28.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.774+0000 7fc97473e640 1 --2- 172.21.15.26:0/2976999445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc96c0b07f0 0x7fc96c159ba0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00c4b0 tx=0x7fc95c00c970 comp rx=0 tx=0).stop 2023-10-14T11:13:28.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.774+0000 7fc97473e640 1 -- 172.21.15.26:0/2976999445 shutdown_connections 2023-10-14T11:13:28.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.774+0000 7fc97473e640 1 --2- 172.21.15.26:0/2976999445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc96c0b4020 0x7fc96c14d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.774+0000 7fc97473e640 1 --2- 172.21.15.26:0/2976999445 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc9500664a0 0x7fc950068960 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.774+0000 7fc97473e640 1 --2- 172.21.15.26:0/2976999445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc96c0b07f0 0x7fc96c159ba0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.774+0000 7fc97473e640 1 --2- 172.21.15.26:0/2976999445 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c070c40 0x7fc96c154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.774+0000 7fc97473e640 1 -- 172.21.15.26:0/2976999445 >> 172.21.15.26:0/2976999445 conn(0x7fc96c06c190 msgr2=0x7fc96c0c41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:28.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.774+0000 7fc97473e640 1 -- 172.21.15.26:0/2976999445 shutdown_connections 2023-10-14T11:13:28.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.774+0000 7fc97473e640 1 -- 172.21.15.26:0/2976999445 wait complete. 2023-10-14T11:13:28.801 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:12:20.179562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:12:21.346111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T11:12:25.025159+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T11:13:28.802 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:13:28.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.942+0000 7f044afd9640 1 Processor -- start 2023-10-14T11:13:28.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.942+0000 7f044afd9640 1 -- start start 2023-10-14T11:13:28.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.946+0000 7f044afd9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f044415cba0 0x7f04440d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:28.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.946+0000 7f044afd9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04440b84e0 0x7f04440cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:28.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.946+0000 7f044afd9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f04440d0040 0x7f04440d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:28.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.946+0000 7f044afd9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04440d1460 con 0x7f044415cba0 2023-10-14T11:13:28.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.946+0000 7f044afd9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04440d04b0 con 0x7f04440d0040 2023-10-14T11:13:28.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.946+0000 7f044afd9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04440d1670 con 0x7f04440b84e0 2023-10-14T11:13:28.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.946+0000 7f0448d75640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f044415cba0 0x7f04440d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:28.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.946+0000 7f0448d75640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f044415cba0 0x7f04440d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47694/0 (socket says 172.21.15.26:47694) 2023-10-14T11:13:28.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.946+0000 7f0448d75640 1 -- 172.21.15.26:0/1341993953 learned_addr learned my addr 172.21.15.26:0/1341993953 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:28.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.946+0000 7f0443fff640 1 --2- 172.21.15.26:0/1341993953 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04440b84e0 0x7f04440cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:28.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.946+0000 7f0449576640 1 --2- 172.21.15.26:0/1341993953 >> v2:172.21.15.110:3300/0 conn(0x7f04440d0040 0x7f04440d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:28.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.946+0000 7f0448d75640 1 -- 172.21.15.26:0/1341993953 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04440b84e0 msgr2=0x7f04440cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:28.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.946+0000 7f0448d75640 1 --2- 172.21.15.26:0/1341993953 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04440b84e0 0x7f04440cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.946+0000 7f0448d75640 1 -- 172.21.15.26:0/1341993953 >> v2:172.21.15.110:3300/0 conn(0x7f04440d0040 msgr2=0x7f04440d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:28.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.946+0000 7f0448d75640 1 --2- 172.21.15.26:0/1341993953 >> v2:172.21.15.110:3300/0 conn(0x7f04440d0040 0x7f04440d2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.946+0000 7f0448d75640 1 -- 172.21.15.26:0/1341993953 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04440d1950 con 0x7f044415cba0 2023-10-14T11:13:28.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.950+0000 7f0448d75640 1 --2- 172.21.15.26:0/1341993953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f044415cba0 0x7f04440d0f20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f04440cf040 tx=0x7f043801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87c558233b5edc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:28.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.950+0000 7f04437fe640 1 -- 172.21.15.26:0/1341993953 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04380ab600 con 0x7f044415cba0 2023-10-14T11:13:28.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.950+0000 7f04437fe640 1 -- 172.21.15.26:0/1341993953 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04380a7050 con 0x7f044415cba0 2023-10-14T11:13:28.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.950+0000 7f04437fe640 1 -- 172.21.15.26:0/1341993953 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04380ab980 con 0x7f044415cba0 2023-10-14T11:13:28.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.950+0000 7f044afd9640 1 -- 172.21.15.26:0/1341993953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f044415cba0 msgr2=0x7f04440d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:28.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.950+0000 7f044afd9640 1 --2- 172.21.15.26:0/1341993953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f044415cba0 0x7f04440d0f20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f04440cf040 tx=0x7f043801c240 comp rx=0 tx=0).stop 2023-10-14T11:13:28.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.950+0000 7f044afd9640 1 -- 172.21.15.26:0/1341993953 shutdown_connections 2023-10-14T11:13:28.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.950+0000 7f044afd9640 1 --2- 172.21.15.26:0/1341993953 >> v2:172.21.15.110:3300/0 conn(0x7f04440d0040 0x7f04440d2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.950+0000 7f044afd9640 1 --2- 172.21.15.26:0/1341993953 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04440b84e0 0x7f04440cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.950+0000 7f044afd9640 1 --2- 172.21.15.26:0/1341993953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f044415cba0 0x7f04440d0f20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.950+0000 7f044afd9640 1 -- 172.21.15.26:0/1341993953 >> 172.21.15.26:0/1341993953 conn(0x7f04440719c0 msgr2=0x7f0444071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:28.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.950+0000 7f044afd9640 1 -- 172.21.15.26:0/1341993953 shutdown_connections 2023-10-14T11:13:28.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.950+0000 7f044afd9640 1 -- 172.21.15.26:0/1341993953 wait complete. 2023-10-14T11:13:28.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.950+0000 7f044afd9640 1 Processor -- start 2023-10-14T11:13:28.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.950+0000 7f044afd9640 1 -- start start 2023-10-14T11:13:28.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f044afd9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04440b84e0 0x7f0444158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:28.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f044afd9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04440d0040 0x7f04441f5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:28.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f044afd9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f044415cba0 0x7f044414fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:28.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f044afd9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04441595d0 con 0x7f04440b84e0 2023-10-14T11:13:28.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f044afd9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0444151370 con 0x7f04440d0040 2023-10-14T11:13:28.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f044afd9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04441592f0 con 0x7f044415cba0 2023-10-14T11:13:28.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f0448d75640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04440b84e0 0x7f0444158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:28.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f0448d75640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04440b84e0 0x7f0444158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47710/0 (socket says 172.21.15.26:47710) 2023-10-14T11:13:28.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f0448d75640 1 -- 172.21.15.26:0/4093686765 learned_addr learned my addr 172.21.15.26:0/4093686765 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:28.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f0443fff640 1 --2- 172.21.15.26:0/4093686765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04440d0040 0x7f04441f5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:28.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f0449576640 1 --2- 172.21.15.26:0/4093686765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f044415cba0 0x7f044414fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:28.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f0448d75640 1 -- 172.21.15.26:0/4093686765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f044415cba0 msgr2=0x7f044414fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:28.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f0448d75640 1 --2- 172.21.15.26:0/4093686765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f044415cba0 0x7f044414fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f0448d75640 1 -- 172.21.15.26:0/4093686765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04440d0040 msgr2=0x7f04441f5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:28.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f0448d75640 1 --2- 172.21.15.26:0/4093686765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04440d0040 0x7f04441f5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:28.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f0448d75640 1 -- 172.21.15.26:0/4093686765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04380094d0 con 0x7f04440b84e0 2023-10-14T11:13:28.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f0443fff640 1 --2- 172.21.15.26:0/4093686765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04440d0040 0x7f04441f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:28.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f0448d75640 1 --2- 172.21.15.26:0/4093686765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04440b84e0 0x7f0444158d10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f04380ae040 tx=0x7f0438018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:28.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f04417fa640 1 -- 172.21.15.26:0/4093686765 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04380b4640 con 0x7f04440b84e0 2023-10-14T11:13:28.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f04417fa640 1 -- 172.21.15.26:0/4093686765 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04380a4e90 con 0x7f04440b84e0 2023-10-14T11:13:28.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f04417fa640 1 -- 172.21.15.26:0/4093686765 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04380b4a00 con 0x7f04440b84e0 2023-10-14T11:13:28.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f044afd9640 1 -- 172.21.15.26:0/4093686765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0444150d20 con 0x7f04440b84e0 2023-10-14T11:13:28.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f044afd9640 1 -- 172.21.15.26:0/4093686765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0444157a50 con 0x7f04440b84e0 2023-10-14T11:13:28.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f044afd9640 1 -- 172.21.15.26:0/4093686765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f044404e170 con 0x7f04440b84e0 2023-10-14T11:13:28.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.954+0000 7f04417fa640 1 -- 172.21.15.26:0/4093686765 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f04380b2070 con 0x7f04440b84e0 2023-10-14T11:13:28.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.958+0000 7f04417fa640 1 --2- 172.21.15.26:0/4093686765 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f04280664a0 0x7f0428068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:28.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.958+0000 7f04417fa640 1 -- 172.21.15.26:0/4093686765 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f043811e0c0 con 0x7f04440b84e0 2023-10-14T11:13:28.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.958+0000 7f0443fff640 1 --2- 172.21.15.26:0/4093686765 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f04280664a0 0x7f0428068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:28.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.958+0000 7f0443fff640 1 --2- 172.21.15.26:0/4093686765 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f04280664a0 0x7f0428068960 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0430004660 tx=0x7f0430008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:28.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:28.962+0000 7f04417fa640 1 -- 172.21.15.26:0/4093686765 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f04380eb0f0 con 0x7f04440b84e0 2023-10-14T11:13:29.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.118+0000 7f044afd9640 1 -- 172.21.15.26:0/4093686765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f044406a290 con 0x7f04440b84e0 2023-10-14T11:13:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.118+0000 7f04417fa640 1 -- 172.21.15.26:0/4093686765 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04380b0020 con 0x7f04440b84e0 2023-10-14T11:13:29.126 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:13:29.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.122+0000 7f044afd9640 1 -- 172.21.15.26:0/4093686765 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f04280664a0 msgr2=0x7f0428068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:29.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.122+0000 7f044afd9640 1 --2- 172.21.15.26:0/4093686765 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f04280664a0 0x7f0428068960 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0430004660 tx=0x7f0430008040 comp rx=0 tx=0).stop 2023-10-14T11:13:29.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.122+0000 7f044afd9640 1 -- 172.21.15.26:0/4093686765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04440b84e0 msgr2=0x7f0444158d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:29.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.122+0000 7f044afd9640 1 --2- 172.21.15.26:0/4093686765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04440b84e0 0x7f0444158d10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f04380ae040 tx=0x7f0438018fe0 comp rx=0 tx=0).stop 2023-10-14T11:13:29.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.122+0000 7f044afd9640 1 -- 172.21.15.26:0/4093686765 shutdown_connections 2023-10-14T11:13:29.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.122+0000 7f044afd9640 1 --2- 172.21.15.26:0/4093686765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f044415cba0 0x7f044414fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:29.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.122+0000 7f044afd9640 1 --2- 172.21.15.26:0/4093686765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04440d0040 0x7f04441f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:29.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.122+0000 7f044afd9640 1 --2- 172.21.15.26:0/4093686765 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f04280664a0 0x7f0428068960 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:29.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.122+0000 7f044afd9640 1 --2- 172.21.15.26:0/4093686765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04440b84e0 0x7f0444158d10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:29.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.122+0000 7f044afd9640 1 -- 172.21.15.26:0/4093686765 >> 172.21.15.26:0/4093686765 conn(0x7f04440719c0 msgr2=0x7f0444152ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:29.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.122+0000 7f044afd9640 1 -- 172.21.15.26:0/4093686765 shutdown_connections 2023-10-14T11:13:29.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.122+0000 7f044afd9640 1 -- 172.21.15.26:0/4093686765 wait complete. 2023-10-14T11:13:29.148 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:13:29.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.290+0000 7f3a8f446640 1 Processor -- start 2023-10-14T11:13:29.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.290+0000 7f3a8f446640 1 -- start start 2023-10-14T11:13:29.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.290+0000 7f3a8f446640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3a8806d010 0x7f3a880c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:29.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.290+0000 7f3a8f446640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8815ae30 con 0x7f3a88069e90 2023-10-14T11:13:29.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.290+0000 7f3a8f446640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a880ca510 con 0x7f3a880c26b0 2023-10-14T11:13:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.290+0000 7f3a8f446640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a880cb090 con 0x7f3a8806d010 2023-10-14T11:13:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.290+0000 7f3a8d1e2640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3a88069e90 0x7f3a8806a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44604/0 (socket says 172.21.15.26:44604) 2023-10-14T11:13:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.290+0000 7f3a8d1e2640 1 -- 172.21.15.26:0/3114279357 learned_addr learned my addr 172.21.15.26:0/3114279357 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.290+0000 7f3a8c9e1640 1 --2- 172.21.15.26:0/3114279357 >> v2:172.21.15.26:3300/0 conn(0x7f3a8806d010 0x7f3a880c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:29.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.290+0000 7f3a7ffff640 1 -- 172.21.15.26:0/3114279357 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 981972920 0 0) 0x7f3a8815ae30 con 0x7f3a88069e90 2023-10-14T11:13:29.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.290+0000 7f3a8c9e1640 1 -- 172.21.15.26:0/3114279357 >> v1:172.21.15.110:6789/0 conn(0x7f3a880c26b0 legacy=0x7f3a880c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:29.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.290+0000 7f3a8c9e1640 1 -- 172.21.15.26:0/3114279357 >> v1:172.21.15.26:6789/0 conn(0x7f3a88069e90 legacy=0x7f3a8806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.290+0000 7f3a8c9e1640 1 -- 172.21.15.26:0/3114279357 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a880ca7f0 con 0x7f3a8806d010 2023-10-14T11:13:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.294+0000 7f3a8c9e1640 1 --2- 172.21.15.26:0/3114279357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a8806d010 0x7f3a880c9ce0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3a780097c0 tx=0x7f3a7801ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee28a6b1a53d691 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:29.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.294+0000 7f3a7ffff640 1 -- 172.21.15.26:0/3114279357 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a780a8930 con 0x7f3a8806d010 2023-10-14T11:13:29.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.294+0000 7f3a7ffff640 1 -- 172.21.15.26:0/3114279357 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a780a8a90 con 0x7f3a8806d010 2023-10-14T11:13:29.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.294+0000 7f3a7ffff640 1 -- 172.21.15.26:0/3114279357 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a780a8e20 con 0x7f3a8806d010 2023-10-14T11:13:29.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.294+0000 7f3a8f446640 1 -- 172.21.15.26:0/3114279357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a8806d010 msgr2=0x7f3a880c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:29.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.294+0000 7f3a8f446640 1 --2- 172.21.15.26:0/3114279357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a8806d010 0x7f3a880c9ce0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3a780097c0 tx=0x7f3a7801ec30 comp rx=0 tx=0).stop 2023-10-14T11:13:29.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.294+0000 7f3a8f446640 1 -- 172.21.15.26:0/3114279357 shutdown_connections 2023-10-14T11:13:29.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.294+0000 7f3a8f446640 1 --2- 172.21.15.26:0/3114279357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a8806d010 0x7f3a880c9ce0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.294+0000 7f3a8f446640 1 -- 172.21.15.26:0/3114279357 >> 172.21.15.26:0/3114279357 conn(0x7f3a880b0da0 msgr2=0x7f3a880ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.294+0000 7f3a8f446640 1 -- 172.21.15.26:0/3114279357 shutdown_connections 2023-10-14T11:13:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.294+0000 7f3a8f446640 1 -- 172.21.15.26:0/3114279357 wait complete. 2023-10-14T11:13:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8f446640 1 Processor -- start 2023-10-14T11:13:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8f446640 1 -- start start 2023-10-14T11:13:29.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8f446640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a88069e90 0x7f3a8814e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:29.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8f446640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a8806d010 0x7f3a880cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:29.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8f446640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a880c26b0 0x7f3a8815b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:29.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8f446640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a880ad220 con 0x7f3a88069e90 2023-10-14T11:13:29.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8f446640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8814ead0 con 0x7f3a8806d010 2023-10-14T11:13:29.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8f446640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a880cc730 con 0x7f3a880c26b0 2023-10-14T11:13:29.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8d1e2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a88069e90 0x7f3a8814e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:29.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8d1e2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a88069e90 0x7f3a8814e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47730/0 (socket says 172.21.15.26:47730) 2023-10-14T11:13:29.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8d1e2640 1 -- 172.21.15.26:0/3569308216 learned_addr learned my addr 172.21.15.26:0/3569308216 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:29.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8c9e1640 1 --2- 172.21.15.26:0/3569308216 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a8806d010 0x7f3a880cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:29.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8d1e2640 1 -- 172.21.15.26:0/3569308216 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a880c26b0 msgr2=0x7f3a8815b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:29.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8d9e3640 1 --2- 172.21.15.26:0/3569308216 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a880c26b0 0x7f3a8815b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:29.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8d1e2640 1 --2- 172.21.15.26:0/3569308216 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a880c26b0 0x7f3a8815b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:29.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8d1e2640 1 -- 172.21.15.26:0/3569308216 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a8806d010 msgr2=0x7f3a880cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:29.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8d1e2640 1 --2- 172.21.15.26:0/3569308216 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a8806d010 0x7f3a880cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:29.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8d1e2640 1 -- 172.21.15.26:0/3569308216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a78009420 con 0x7f3a88069e90 2023-10-14T11:13:29.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8c9e1640 1 --2- 172.21.15.26:0/3569308216 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a8806d010 0x7f3a880cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:29.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8d9e3640 1 --2- 172.21.15.26:0/3569308216 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a880c26b0 0x7f3a8815b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:29.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8d1e2640 1 --2- 172.21.15.26:0/3569308216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a88069e90 0x7f3a8814e590 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3a840011f0 tx=0x7f3a8400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:29.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a7dffb640 1 -- 172.21.15.26:0/3569308216 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a840074e0 con 0x7f3a88069e90 2023-10-14T11:13:29.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a7dffb640 1 -- 172.21.15.26:0/3569308216 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a84007640 con 0x7f3a88069e90 2023-10-14T11:13:29.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8f446640 1 -- 172.21.15.26:0/3569308216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a880cca10 con 0x7f3a88069e90 2023-10-14T11:13:29.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a7dffb640 1 -- 172.21.15.26:0/3569308216 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84004a10 con 0x7f3a88069e90 2023-10-14T11:13:29.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8f446640 1 -- 172.21.15.26:0/3569308216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a880ccfd0 con 0x7f3a88069e90 2023-10-14T11:13:29.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.298+0000 7f3a8f446640 1 -- 172.21.15.26:0/3569308216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8804e170 con 0x7f3a88069e90 2023-10-14T11:13:29.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.302+0000 7f3a7dffb640 1 -- 172.21.15.26:0/3569308216 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3a84004b70 con 0x7f3a88069e90 2023-10-14T11:13:29.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.302+0000 7f3a7dffb640 1 --2- 172.21.15.26:0/3569308216 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3a6c0664a0 0x7f3a6c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:29.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.302+0000 7f3a7dffb640 1 -- 172.21.15.26:0/3569308216 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3a84083870 con 0x7f3a88069e90 2023-10-14T11:13:29.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.302+0000 7f3a8c9e1640 1 --2- 172.21.15.26:0/3569308216 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3a6c0664a0 0x7f3a6c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:29.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.302+0000 7f3a8c9e1640 1 --2- 172.21.15.26:0/3569308216 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3a6c0664a0 0x7f3a6c068960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3a780b2000 tx=0x7f3a78008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:29.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.306+0000 7f3a7dffb640 1 -- 172.21.15.26:0/3569308216 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3a84050890 con 0x7f3a88069e90 2023-10-14T11:13:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.462+0000 7f3a8f446640 1 -- 172.21.15.26:0/3569308216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3a880c2090 con 0x7f3a88069e90 2023-10-14T11:13:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.462+0000 7f3a7dffb640 1 -- 172.21.15.26:0/3569308216 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3a84053eb0 con 0x7f3a88069e90 2023-10-14T11:13:29.473 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:29.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.466+0000 7f3a8f446640 1 -- 172.21.15.26:0/3569308216 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3a6c0664a0 msgr2=0x7f3a6c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:29.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.466+0000 7f3a8f446640 1 --2- 172.21.15.26:0/3569308216 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3a6c0664a0 0x7f3a6c068960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3a780b2000 tx=0x7f3a78008040 comp rx=0 tx=0).stop 2023-10-14T11:13:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.466+0000 7f3a8f446640 1 -- 172.21.15.26:0/3569308216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a88069e90 msgr2=0x7f3a8814e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.466+0000 7f3a8f446640 1 --2- 172.21.15.26:0/3569308216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a88069e90 0x7f3a8814e590 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3a840011f0 tx=0x7f3a8400c9b0 comp rx=0 tx=0).stop 2023-10-14T11:13:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.466+0000 7f3a8f446640 1 -- 172.21.15.26:0/3569308216 shutdown_connections 2023-10-14T11:13:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.466+0000 7f3a8f446640 1 --2- 172.21.15.26:0/3569308216 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a880c26b0 0x7f3a8815b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.466+0000 7f3a8f446640 1 --2- 172.21.15.26:0/3569308216 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a8806d010 0x7f3a880cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.466+0000 7f3a8f446640 1 --2- 172.21.15.26:0/3569308216 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3a6c0664a0 0x7f3a6c068960 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.466+0000 7f3a8f446640 1 --2- 172.21.15.26:0/3569308216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a88069e90 0x7f3a8814e590 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.466+0000 7f3a8f446640 1 -- 172.21.15.26:0/3569308216 >> 172.21.15.26:0/3569308216 conn(0x7f3a880b0da0 msgr2=0x7f3a880aef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.466+0000 7f3a8f446640 1 -- 172.21.15.26:0/3569308216 shutdown_connections 2023-10-14T11:13:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.466+0000 7f3a8f446640 1 -- 172.21.15.26:0/3569308216 wait complete. 2023-10-14T11:13:29.491 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:13:29.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.634+0000 7f053ca9c640 1 Processor -- start 2023-10-14T11:13:29.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.634+0000 7f053ca9c640 1 -- start start 2023-10-14T11:13:29.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.634+0000 7f053ca9c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0538069e90 0x7f053806d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:29.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.634+0000 7f053ca9c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f053815ae30 con 0x7f053806a270 2023-10-14T11:13:29.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.634+0000 7f053ca9c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05380ca510 con 0x7f05380c26b0 2023-10-14T11:13:29.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.634+0000 7f053ca9c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05380cb090 con 0x7f0538069e90 2023-10-14T11:13:29.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.634+0000 7f052ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f053806a270 0x7f05380c9ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44610/0 (socket says 172.21.15.26:44610) 2023-10-14T11:13:29.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.634+0000 7f052ffff640 1 -- 172.21.15.26:0/2387702963 learned_addr learned my addr 172.21.15.26:0/2387702963 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:29.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.634+0000 7f053659c640 1 --2- 172.21.15.26:0/2387702963 >> v2:172.21.15.110:3300/0 conn(0x7f0538069e90 0x7f053806d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.634+0000 7f0535d9b640 1 -- 172.21.15.26:0/2387702963 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809001290 0 0) 0x7f053815ae30 con 0x7f053806a270 2023-10-14T11:13:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.634+0000 7f0535d9b640 1 -- 172.21.15.26:0/2387702963 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0524003530 con 0x7f053806a270 2023-10-14T11:13:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.634+0000 7f053659c640 1 -- 172.21.15.26:0/2387702963 >> v1:172.21.15.110:6789/0 conn(0x7f05380c26b0 legacy=0x7f05380c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.634+0000 7f053659c640 1 -- 172.21.15.26:0/2387702963 >> v1:172.21.15.26:6789/0 conn(0x7f053806a270 legacy=0x7f05380c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.634+0000 7f0535d9b640 1 -- 172.21.15.26:0/2387702963 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1901931049 0 0) 0x7f0524003530 con 0x7f053806a270 2023-10-14T11:13:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.634+0000 7f053659c640 1 -- 172.21.15.26:0/2387702963 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05380ca7f0 con 0x7f0538069e90 2023-10-14T11:13:29.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.638+0000 7f053659c640 1 --2- 172.21.15.26:0/2387702963 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0538069e90 0x7f053806d010 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f05280097c0 tx=0x7f052801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0853cf1b4b6fb28 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:29.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.638+0000 7f0535d9b640 1 -- 172.21.15.26:0/2387702963 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05380c3a20 con 0x7f0538069e90 2023-10-14T11:13:29.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.638+0000 7f0535d9b640 1 -- 172.21.15.26:0/2387702963 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05280a7050 con 0x7f0538069e90 2023-10-14T11:13:29.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.638+0000 7f0535d9b640 1 -- 172.21.15.26:0/2387702963 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0520001680 con 0x7f0538069e90 2023-10-14T11:13:29.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.638+0000 7f053ca9c640 1 -- 172.21.15.26:0/2387702963 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0538069e90 msgr2=0x7f053806d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:29.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.638+0000 7f053ca9c640 1 --2- 172.21.15.26:0/2387702963 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0538069e90 0x7f053806d010 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f05280097c0 tx=0x7f052801c370 comp rx=0 tx=0).stop 2023-10-14T11:13:29.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.638+0000 7f053ca9c640 1 -- 172.21.15.26:0/2387702963 shutdown_connections 2023-10-14T11:13:29.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.638+0000 7f053ca9c640 1 --2- 172.21.15.26:0/2387702963 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0538069e90 0x7f053806d010 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:29.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.638+0000 7f053ca9c640 1 -- 172.21.15.26:0/2387702963 >> 172.21.15.26:0/2387702963 conn(0x7f05380b0da0 msgr2=0x7f05380ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:29.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.638+0000 7f053ca9c640 1 -- 172.21.15.26:0/2387702963 shutdown_connections 2023-10-14T11:13:29.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.638+0000 7f053ca9c640 1 -- 172.21.15.26:0/2387702963 wait complete. 2023-10-14T11:13:29.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.638+0000 7f053ca9c640 1 Processor -- start 2023-10-14T11:13:29.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.638+0000 7f053ca9c640 1 -- start start 2023-10-14T11:13:29.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.638+0000 7f053ca9c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0538069e90 0x7f053815d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:29.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.638+0000 7f053ca9c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f053806a270 0x7f05380c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:29.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.638+0000 7f053ca9c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05380c26b0 0x7f05381525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:29.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.638+0000 7f053ca9c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053815c0e0 con 0x7f053806a270 2023-10-14T11:13:29.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.638+0000 7f053ca9c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05380ce2b0 con 0x7f0538069e90 2023-10-14T11:13:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.638+0000 7f053ca9c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053815d400 con 0x7f05380c26b0 2023-10-14T11:13:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.642+0000 7f052ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f053806a270 0x7f05380c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.642+0000 7f052ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f053806a270 0x7f05380c4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47732/0 (socket says 172.21.15.26:47732) 2023-10-14T11:13:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.642+0000 7f052ffff640 1 -- 172.21.15.26:0/1069277831 learned_addr learned my addr 172.21.15.26:0/1069277831 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.642+0000 7f053659c640 1 --2- 172.21.15.26:0/1069277831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0538069e90 0x7f053815d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.642+0000 7f0536d9d640 1 --2- 172.21.15.26:0/1069277831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05380c26b0 0x7f05381525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:29.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.642+0000 7f052ffff640 1 -- 172.21.15.26:0/1069277831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05380c26b0 msgr2=0x7f05381525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:29.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.642+0000 7f052ffff640 1 --2- 172.21.15.26:0/1069277831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05380c26b0 0x7f05381525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:29.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.642+0000 7f052ffff640 1 -- 172.21.15.26:0/1069277831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0538069e90 msgr2=0x7f053815d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:29.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.642+0000 7f052ffff640 1 --2- 172.21.15.26:0/1069277831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0538069e90 0x7f053815d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:29.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.642+0000 7f052ffff640 1 -- 172.21.15.26:0/1069277831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0528009420 con 0x7f053806a270 2023-10-14T11:13:29.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.642+0000 7f053659c640 1 --2- 172.21.15.26:0/1069277831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0538069e90 0x7f053815d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:29.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.642+0000 7f0536d9d640 1 --2- 172.21.15.26:0/1069277831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05380c26b0 0x7f05381525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:29.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.642+0000 7f052ffff640 1 --2- 172.21.15.26:0/1069277831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f053806a270 0x7f05380c4720 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f052000c760 tx=0x7f052000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:29.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.642+0000 7f052effd640 1 -- 172.21.15.26:0/1069277831 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0520005ae0 con 0x7f053806a270 2023-10-14T11:13:29.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.642+0000 7f052effd640 1 -- 172.21.15.26:0/1069277831 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0520005c40 con 0x7f053806a270 2023-10-14T11:13:29.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.642+0000 7f053ca9c640 1 -- 172.21.15.26:0/1069277831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053815b3d0 con 0x7f053806a270 2023-10-14T11:13:29.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.642+0000 7f052effd640 1 -- 172.21.15.26:0/1069277831 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0520007070 con 0x7f053806a270 2023-10-14T11:13:29.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.642+0000 7f053ca9c640 1 -- 172.21.15.26:0/1069277831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053815d090 con 0x7f053806a270 2023-10-14T11:13:29.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.642+0000 7f053ca9c640 1 -- 172.21.15.26:0/1069277831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053804e170 con 0x7f053806a270 2023-10-14T11:13:29.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.642+0000 7f052effd640 1 -- 172.21.15.26:0/1069277831 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f05200071d0 con 0x7f053806a270 2023-10-14T11:13:29.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.642+0000 7f052effd640 1 --2- 172.21.15.26:0/1069277831 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f05180664a0 0x7f0518068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:29.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.646+0000 7f052effd640 1 -- 172.21.15.26:0/1069277831 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0520083b40 con 0x7f053806a270 2023-10-14T11:13:29.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.646+0000 7f053659c640 1 --2- 172.21.15.26:0/1069277831 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f05180664a0 0x7f0518068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:29.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.646+0000 7f053659c640 1 --2- 172.21.15.26:0/1069277831 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f05180664a0 0x7f0518068960 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f05280ad000 tx=0x7f0528008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:29.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.650+0000 7f052effd640 1 -- 172.21.15.26:0/1069277831 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f05200545f0 con 0x7f053806a270 2023-10-14T11:13:29.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.806+0000 7f053ca9c640 1 -- 172.21.15.26:0/1069277831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f053815d540 con 0x7f053806a270 2023-10-14T11:13:29.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.806+0000 7f052effd640 1 -- 172.21.15.26:0/1069277831 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0520017020 con 0x7f053806a270 2023-10-14T11:13:29.811 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:13:29.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.810+0000 7f053ca9c640 1 -- 172.21.15.26:0/1069277831 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f05180664a0 msgr2=0x7f0518068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:29.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.810+0000 7f053ca9c640 1 --2- 172.21.15.26:0/1069277831 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f05180664a0 0x7f0518068960 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f05280ad000 tx=0x7f0528008040 comp rx=0 tx=0).stop 2023-10-14T11:13:29.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.810+0000 7f053ca9c640 1 -- 172.21.15.26:0/1069277831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f053806a270 msgr2=0x7f05380c4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:29.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.810+0000 7f053ca9c640 1 --2- 172.21.15.26:0/1069277831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f053806a270 0x7f05380c4720 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f052000c760 tx=0x7f052000cc20 comp rx=0 tx=0).stop 2023-10-14T11:13:29.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.810+0000 7f053ca9c640 1 -- 172.21.15.26:0/1069277831 shutdown_connections 2023-10-14T11:13:29.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.810+0000 7f053ca9c640 1 --2- 172.21.15.26:0/1069277831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05380c26b0 0x7f05381525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:29.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.810+0000 7f053ca9c640 1 --2- 172.21.15.26:0/1069277831 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f05180664a0 0x7f0518068960 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:29.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.810+0000 7f053ca9c640 1 --2- 172.21.15.26:0/1069277831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f053806a270 0x7f05380c4720 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:29.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.810+0000 7f053ca9c640 1 --2- 172.21.15.26:0/1069277831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0538069e90 0x7f053815d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:29.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.810+0000 7f053ca9c640 1 -- 172.21.15.26:0/1069277831 >> 172.21.15.26:0/1069277831 conn(0x7f05380b0da0 msgr2=0x7f053806c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:29.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.810+0000 7f053ca9c640 1 -- 172.21.15.26:0/1069277831 shutdown_connections 2023-10-14T11:13:29.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.810+0000 7f053ca9c640 1 -- 172.21.15.26:0/1069277831 wait complete. 2023-10-14T11:13:29.831 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T11:13:29.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.978+0000 7f70edc09640 1 Processor -- start 2023-10-14T11:13:29.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.978+0000 7f70edc09640 1 -- start start 2023-10-14T11:13:29.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.978+0000 7f70edc09640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f70e815ca80 0x7f70e80cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:29.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.978+0000 7f70edc09640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e815ce60 con 0x7f70e80d2d50 2023-10-14T11:13:29.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.978+0000 7f70edc09640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e806b310 con 0x7f70e80cd740 2023-10-14T11:13:29.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.978+0000 7f70edc09640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e806b5f0 con 0x7f70e815ca80 2023-10-14T11:13:29.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.978+0000 7f70ecc07640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f70e815ca80 0x7f70e80cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:29.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.978+0000 7f70ecc07640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f70e815ca80 0x7f70e80cd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47736/0 (socket says 172.21.15.26:47736) 2023-10-14T11:13:29.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.978+0000 7f70ecc07640 1 -- 172.21.15.26:0/4205401895 learned_addr learned my addr 172.21.15.26:0/4205401895 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:29.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.978+0000 7f70ecc07640 1 -- 172.21.15.26:0/4205401895 >> v1:172.21.15.110:6789/0 conn(0x7f70e80cd740 legacy=0x7f70e80d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:29.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.978+0000 7f70ecc07640 1 -- 172.21.15.26:0/4205401895 >> v1:172.21.15.26:6789/0 conn(0x7f70e80d2d50 legacy=0x7f70e806ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:29.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.978+0000 7f70e77fe640 1 -- 172.21.15.26:0/4205401895 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622006745 0 0) 0x7f70e00014a0 con 0x7f70e80d2d50 2023-10-14T11:13:29.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.978+0000 7f70ecc07640 1 -- 172.21.15.26:0/4205401895 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e80cf160 con 0x7f70e815ca80 2023-10-14T11:13:29.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.982+0000 7f70ecc07640 1 --2- 172.21.15.26:0/4205401895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70e815ca80 0x7f70e80cd200 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f70dc006fd0 tx=0x7f70dc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c7dceadbd37c8b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:29.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.982+0000 7f70e77fe640 1 -- 172.21.15.26:0/4205401895 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc0aa5f0 con 0x7f70e815ca80 2023-10-14T11:13:29.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.982+0000 7f70e77fe640 1 -- 172.21.15.26:0/4205401895 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc0aa750 con 0x7f70e815ca80 2023-10-14T11:13:29.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.982+0000 7f70e77fe640 1 -- 172.21.15.26:0/4205401895 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc0aaae0 con 0x7f70e815ca80 2023-10-14T11:13:29.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.982+0000 7f70edc09640 1 -- 172.21.15.26:0/4205401895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70e815ca80 msgr2=0x7f70e80cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:29.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.982+0000 7f70edc09640 1 --2- 172.21.15.26:0/4205401895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70e815ca80 0x7f70e80cd200 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f70dc006fd0 tx=0x7f70dc01c490 comp rx=0 tx=0).stop 2023-10-14T11:13:29.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.982+0000 7f70edc09640 1 -- 172.21.15.26:0/4205401895 shutdown_connections 2023-10-14T11:13:29.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.982+0000 7f70edc09640 1 --2- 172.21.15.26:0/4205401895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70e815ca80 0x7f70e80cd200 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:29.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.982+0000 7f70edc09640 1 -- 172.21.15.26:0/4205401895 >> 172.21.15.26:0/4205401895 conn(0x7f70e808c230 msgr2=0x7f70e809bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:29.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.982+0000 7f70edc09640 1 -- 172.21.15.26:0/4205401895 shutdown_connections 2023-10-14T11:13:29.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.982+0000 7f70edc09640 1 -- 172.21.15.26:0/4205401895 wait complete. 2023-10-14T11:13:29.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70edc09640 1 Processor -- start 2023-10-14T11:13:29.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70edc09640 1 -- start start 2023-10-14T11:13:29.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70edc09640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70e80cd740 0x7f70e815e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:29.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70edc09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70e80d2d50 0x7f70e815e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:29.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70edc09640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70e815ca80 0x7f70e8153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:29.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70edc09640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e815fca0 con 0x7f70e80d2d50 2023-10-14T11:13:29.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70edc09640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e815f020 con 0x7f70e80cd740 2023-10-14T11:13:30.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70edc09640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e815f300 con 0x7f70e815ca80 2023-10-14T11:13:30.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70e7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70e80d2d50 0x7f70e815e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:30.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70e7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70e80d2d50 0x7f70e815e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47740/0 (socket says 172.21.15.26:47740) 2023-10-14T11:13:30.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70e7fff640 1 -- 172.21.15.26:0/1029458496 learned_addr learned my addr 172.21.15.26:0/1029458496 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:30.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70ed408640 1 --2- 172.21.15.26:0/1029458496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70e815ca80 0x7f70e8153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:30.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70ecc07640 1 --2- 172.21.15.26:0/1029458496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70e80cd740 0x7f70e815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:30.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70e7fff640 1 -- 172.21.15.26:0/1029458496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70e815ca80 msgr2=0x7f70e8153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:30.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70e7fff640 1 --2- 172.21.15.26:0/1029458496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70e815ca80 0x7f70e8153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70e7fff640 1 -- 172.21.15.26:0/1029458496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70e80cd740 msgr2=0x7f70e815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:30.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70e7fff640 1 --2- 172.21.15.26:0/1029458496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70e80cd740 0x7f70e815e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70e7fff640 1 -- 172.21.15.26:0/1029458496 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc009480 con 0x7f70e80d2d50 2023-10-14T11:13:30.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70e7fff640 1 --2- 172.21.15.26:0/1029458496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70e80d2d50 0x7f70e815e0b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f70d400c500 tx=0x7f70d400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:30.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70e57fa640 1 -- 172.21.15.26:0/1029458496 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d4005220 con 0x7f70e80d2d50 2023-10-14T11:13:30.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70e57fa640 1 -- 172.21.15.26:0/1029458496 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d4005380 con 0x7f70e80d2d50 2023-10-14T11:13:30.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70e57fa640 1 -- 172.21.15.26:0/1029458496 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d4007270 con 0x7f70e80d2d50 2023-10-14T11:13:30.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70edc09640 1 -- 172.21.15.26:0/1029458496 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e815f5e0 con 0x7f70e80d2d50 2023-10-14T11:13:30.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70edc09640 1 -- 172.21.15.26:0/1029458496 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e81600c0 con 0x7f70e80d2d50 2023-10-14T11:13:30.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.986+0000 7f70edc09640 1 -- 172.21.15.26:0/1029458496 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e804e9c0 con 0x7f70e80d2d50 2023-10-14T11:13:30.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.990+0000 7f70e57fa640 1 -- 172.21.15.26:0/1029458496 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f70d40073d0 con 0x7f70e80d2d50 2023-10-14T11:13:30.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.990+0000 7f70e57fa640 1 --2- 172.21.15.26:0/1029458496 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f70cc0664a0 0x7f70cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:30.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.990+0000 7f70e57fa640 1 -- 172.21.15.26:0/1029458496 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f70d4083a90 con 0x7f70e80d2d50 2023-10-14T11:13:30.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.990+0000 7f70ecc07640 1 --2- 172.21.15.26:0/1029458496 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f70cc0664a0 0x7f70cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:30.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.990+0000 7f70ecc07640 1 --2- 172.21.15.26:0/1029458496 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f70cc0664a0 0x7f70cc068960 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f70dc0ae000 tx=0x7f70dc0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:30.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:29.994+0000 7f70e57fa640 1 -- 172.21.15.26:0/1029458496 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f70d4050b70 con 0x7f70e80d2d50 2023-10-14T11:13:30.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.154+0000 7f70edc09640 1 -- 172.21.15.26:0/1029458496 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f70e8158750 con 0x7f70e80d2d50 2023-10-14T11:13:30.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.154+0000 7f70e57fa640 1 -- 172.21.15.26:0/1029458496 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f70d4054190 con 0x7f70e80d2d50 2023-10-14T11:13:30.157 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:30.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.158+0000 7f70edc09640 1 -- 172.21.15.26:0/1029458496 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f70cc0664a0 msgr2=0x7f70cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:30.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.158+0000 7f70edc09640 1 --2- 172.21.15.26:0/1029458496 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f70cc0664a0 0x7f70cc068960 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f70dc0ae000 tx=0x7f70dc0a7000 comp rx=0 tx=0).stop 2023-10-14T11:13:30.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.158+0000 7f70edc09640 1 -- 172.21.15.26:0/1029458496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70e80d2d50 msgr2=0x7f70e815e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:30.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.158+0000 7f70edc09640 1 --2- 172.21.15.26:0/1029458496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70e80d2d50 0x7f70e815e0b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f70d400c500 tx=0x7f70d400c9c0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.158+0000 7f70edc09640 1 -- 172.21.15.26:0/1029458496 shutdown_connections 2023-10-14T11:13:30.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.158+0000 7f70edc09640 1 --2- 172.21.15.26:0/1029458496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70e815ca80 0x7f70e8153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.158+0000 7f70edc09640 1 --2- 172.21.15.26:0/1029458496 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f70cc0664a0 0x7f70cc068960 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.158+0000 7f70edc09640 1 --2- 172.21.15.26:0/1029458496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70e80d2d50 0x7f70e815e0b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.158+0000 7f70edc09640 1 --2- 172.21.15.26:0/1029458496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70e80cd740 0x7f70e815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.158+0000 7f70edc09640 1 -- 172.21.15.26:0/1029458496 >> 172.21.15.26:0/1029458496 conn(0x7f70e808c230 msgr2=0x7f70e806ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:30.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.158+0000 7f70edc09640 1 -- 172.21.15.26:0/1029458496 shutdown_connections 2023-10-14T11:13:30.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.158+0000 7f70edc09640 1 -- 172.21.15.26:0/1029458496 wait complete. 2023-10-14T11:13:30.178 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:13:30.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.318+0000 7f636f9b8640 1 Processor -- start 2023-10-14T11:13:30.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.322+0000 7f636f9b8640 1 -- start start 2023-10-14T11:13:30.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.322+0000 7f636f9b8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f636815ca70 0x7f63680d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:30.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.322+0000 7f636f9b8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f63680d3550 0x7f63680cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:30.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.322+0000 7f636f9b8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63680cfa00 con 0x7f63680cf5d0 2023-10-14T11:13:30.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.322+0000 7f636f9b8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63680ce820 con 0x7f636815ca70 2023-10-14T11:13:30.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.322+0000 7f636f9b8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63680c65f0 con 0x7f63680d3550 2023-10-14T11:13:30.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.322+0000 7f636d754640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f636815ca70 0x7f63680d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:30.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.322+0000 7f636d754640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f636815ca70 0x7f63680d3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47746/0 (socket says 172.21.15.26:47746) 2023-10-14T11:13:30.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.322+0000 7f636d754640 1 -- 172.21.15.26:0/747182469 learned_addr learned my addr 172.21.15.26:0/747182469 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:30.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.322+0000 7f636cf53640 1 --2- 172.21.15.26:0/747182469 >> v2:172.21.15.110:3300/0 conn(0x7f63680d3550 0x7f63680cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:30.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.322+0000 7f636d754640 1 -- 172.21.15.26:0/747182469 >> v2:172.21.15.110:3300/0 conn(0x7f63680d3550 msgr2=0x7f63680cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:30.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.322+0000 7f636d754640 1 --2- 172.21.15.26:0/747182469 >> v2:172.21.15.110:3300/0 conn(0x7f63680d3550 0x7f63680cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.322+0000 7f636d754640 1 -- 172.21.15.26:0/747182469 >> v1:172.21.15.110:6789/0 conn(0x7f63680cf5d0 legacy=0x7f63680d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:30.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.322+0000 7f636d754640 1 -- 172.21.15.26:0/747182469 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63680cdf80 con 0x7f636815ca70 2023-10-14T11:13:30.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.322+0000 7f636cf53640 1 --2- 172.21.15.26:0/747182469 >> v2:172.21.15.110:3300/0 conn(0x7f63680d3550 0x7f63680cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:30.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.326+0000 7f636d754640 1 --2- 172.21.15.26:0/747182469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f636815ca70 0x7f63680d3010 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f63680b54f0 tx=0x7f636401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a775655efad1a36c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:30.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.326+0000 7f635ffff640 1 -- 172.21.15.26:0/747182469 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63640aa5f0 con 0x7f636815ca70 2023-10-14T11:13:30.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.326+0000 7f635ffff640 1 -- 172.21.15.26:0/747182469 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63640aa750 con 0x7f636815ca70 2023-10-14T11:13:30.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.326+0000 7f635ffff640 1 -- 172.21.15.26:0/747182469 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63640aaae0 con 0x7f636815ca70 2023-10-14T11:13:30.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.326+0000 7f636f9b8640 1 -- 172.21.15.26:0/747182469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f636815ca70 msgr2=0x7f63680d3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:30.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.326+0000 7f636f9b8640 1 --2- 172.21.15.26:0/747182469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f636815ca70 0x7f63680d3010 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f63680b54f0 tx=0x7f636401c490 comp rx=0 tx=0).stop 2023-10-14T11:13:30.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.326+0000 7f636f9b8640 1 -- 172.21.15.26:0/747182469 shutdown_connections 2023-10-14T11:13:30.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.326+0000 7f636f9b8640 1 --2- 172.21.15.26:0/747182469 >> v2:172.21.15.110:3300/0 conn(0x7f63680d3550 0x7f63680cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.326+0000 7f636f9b8640 1 --2- 172.21.15.26:0/747182469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f636815ca70 0x7f63680d3010 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.326+0000 7f636f9b8640 1 -- 172.21.15.26:0/747182469 >> 172.21.15.26:0/747182469 conn(0x7f636809bc50 msgr2=0x7f63680d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:30.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.326+0000 7f636f9b8640 1 -- 172.21.15.26:0/747182469 shutdown_connections 2023-10-14T11:13:30.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.326+0000 7f636f9b8640 1 -- 172.21.15.26:0/747182469 wait complete. 2023-10-14T11:13:30.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.326+0000 7f636f9b8640 1 Processor -- start 2023-10-14T11:13:30.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.326+0000 7f636f9b8640 1 -- start start 2023-10-14T11:13:30.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f636f9b8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63680cf5d0 0x7f63680b82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:30.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f636f9b8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63680d3550 0x7f636806bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:30.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f636f9b8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636815ca70 0x7f636815ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:30.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f636f9b8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636815fd00 con 0x7f63680cf5d0 2023-10-14T11:13:30.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f636f9b8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63680c99d0 con 0x7f636815ca70 2023-10-14T11:13:30.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f636f9b8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63680c9cb0 con 0x7f63680d3550 2023-10-14T11:13:30.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f636d754640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63680cf5d0 0x7f63680b82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:30.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f636d754640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63680cf5d0 0x7f63680b82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47754/0 (socket says 172.21.15.26:47754) 2023-10-14T11:13:30.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f636d754640 1 -- 172.21.15.26:0/1537630044 learned_addr learned my addr 172.21.15.26:0/1537630044 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:30.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f636cf53640 1 --2- 172.21.15.26:0/1537630044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63680d3550 0x7f636806bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:30.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f636df55640 1 --2- 172.21.15.26:0/1537630044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636815ca70 0x7f636815ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:30.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f636d754640 1 -- 172.21.15.26:0/1537630044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63680d3550 msgr2=0x7f636806bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:30.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f636d754640 1 --2- 172.21.15.26:0/1537630044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63680d3550 0x7f636806bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f636d754640 1 -- 172.21.15.26:0/1537630044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636815ca70 msgr2=0x7f636815ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:30.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f636d754640 1 --2- 172.21.15.26:0/1537630044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636815ca70 0x7f636815ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f636d754640 1 -- 172.21.15.26:0/1537630044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6364009480 con 0x7f63680cf5d0 2023-10-14T11:13:30.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f636df55640 1 --2- 172.21.15.26:0/1537630044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636815ca70 0x7f636815ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:30.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f636d754640 1 --2- 172.21.15.26:0/1537630044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63680cf5d0 0x7f63680b82f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f636401ab40 tx=0x7f6364019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:30.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f635dffb640 1 -- 172.21.15.26:0/1537630044 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63640aacd0 con 0x7f63680cf5d0 2023-10-14T11:13:30.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f635dffb640 1 -- 172.21.15.26:0/1537630044 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63640aae30 con 0x7f63680cf5d0 2023-10-14T11:13:30.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f635dffb640 1 -- 172.21.15.26:0/1537630044 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6364003860 con 0x7f63680cf5d0 2023-10-14T11:13:30.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f636f9b8640 1 -- 172.21.15.26:0/1537630044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63680c9f90 con 0x7f63680cf5d0 2023-10-14T11:13:30.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f636f9b8640 1 -- 172.21.15.26:0/1537630044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6368154d00 con 0x7f63680cf5d0 2023-10-14T11:13:30.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.330+0000 7f636f9b8640 1 -- 172.21.15.26:0/1537630044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63680ca4b0 con 0x7f63680cf5d0 2023-10-14T11:13:30.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.334+0000 7f635dffb640 1 -- 172.21.15.26:0/1537630044 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f63640039c0 con 0x7f63680cf5d0 2023-10-14T11:13:30.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.334+0000 7f635dffb640 1 --2- 172.21.15.26:0/1537630044 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f634c0664a0 0x7f634c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:30.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.334+0000 7f635dffb640 1 -- 172.21.15.26:0/1537630044 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f63640a7070 con 0x7f63680cf5d0 2023-10-14T11:13:30.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.334+0000 7f636cf53640 1 --2- 172.21.15.26:0/1537630044 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f634c0664a0 0x7f634c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:30.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.334+0000 7f636cf53640 1 --2- 172.21.15.26:0/1537630044 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f634c0664a0 0x7f634c068960 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f63681554c0 tx=0x7f6358008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:30.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.338+0000 7f635dffb640 1 -- 172.21.15.26:0/1537630044 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f63680ca4b0 con 0x7f63680cf5d0 2023-10-14T11:13:30.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.506+0000 7f636f9b8640 1 -- 172.21.15.26:0/1537630044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f63680ca4b0 con 0x7f63680cf5d0 2023-10-14T11:13:30.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.506+0000 7f635dffb640 1 -- 172.21.15.26:0/1537630044 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f63640ebc40 con 0x7f63680cf5d0 2023-10-14T11:13:30.509 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-10-14T11:13:30.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.506+0000 7f636f9b8640 1 -- 172.21.15.26:0/1537630044 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f634c0664a0 msgr2=0x7f634c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:30.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.506+0000 7f636f9b8640 1 --2- 172.21.15.26:0/1537630044 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f634c0664a0 0x7f634c068960 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f63681554c0 tx=0x7f6358008040 comp rx=0 tx=0).stop 2023-10-14T11:13:30.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.506+0000 7f636f9b8640 1 -- 172.21.15.26:0/1537630044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63680cf5d0 msgr2=0x7f63680b82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:30.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.506+0000 7f636f9b8640 1 --2- 172.21.15.26:0/1537630044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63680cf5d0 0x7f63680b82f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f636401ab40 tx=0x7f6364019230 comp rx=0 tx=0).stop 2023-10-14T11:13:30.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.506+0000 7f636f9b8640 1 -- 172.21.15.26:0/1537630044 shutdown_connections 2023-10-14T11:13:30.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.506+0000 7f636f9b8640 1 --2- 172.21.15.26:0/1537630044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636815ca70 0x7f636815ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.506+0000 7f636f9b8640 1 --2- 172.21.15.26:0/1537630044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63680d3550 0x7f636806bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.506+0000 7f636f9b8640 1 --2- 172.21.15.26:0/1537630044 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f634c0664a0 0x7f634c068960 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.510+0000 7f636f9b8640 1 --2- 172.21.15.26:0/1537630044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63680cf5d0 0x7f63680b82f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.510+0000 7f636f9b8640 1 -- 172.21.15.26:0/1537630044 >> 172.21.15.26:0/1537630044 conn(0x7f636809bc50 msgr2=0x7f63680d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:30.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.510+0000 7f636f9b8640 1 -- 172.21.15.26:0/1537630044 shutdown_connections 2023-10-14T11:13:30.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.510+0000 7f636f9b8640 1 -- 172.21.15.26:0/1537630044 wait complete. 2023-10-14T11:13:30.529 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi026.front.sepia.ceph.com... 2023-10-14T11:13:30.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:30.530 DEBUG:teuthology.orchestra.run.smithi026:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-10-14T11:13:30.553 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:13:30.554 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T11:13:30.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:30.555 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-14T11:13:30.607 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:13:30.607 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:13:30.617 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:13:30.618 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:13:30.671 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:13:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.810+0000 7fa53b605640 1 Processor -- start 2023-10-14T11:13:30.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.810+0000 7fa53b605640 1 -- start start 2023-10-14T11:13:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa53b605640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa5340b2ad0 0x7fa53406b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa53b605640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa53415cf90 0x7fa53406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa53b605640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53415d4e0 con 0x7fa5340ce310 2023-10-14T11:13:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa53b605640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa534160580 con 0x7fa5340b2ad0 2023-10-14T11:13:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa53b605640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53415d7c0 con 0x7fa53415cf90 2023-10-14T11:13:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa539ba2640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa5340ce310 0x7fa5341609d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44628/0 (socket says 172.21.15.26:44628) 2023-10-14T11:13:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa539ba2640 1 -- 172.21.15.26:0/2659006423 learned_addr learned my addr 172.21.15.26:0/2659006423 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:30.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa5393a1640 1 --2- 172.21.15.26:0/2659006423 >> v2:172.21.15.110:3300/0 conn(0x7fa5340b2ad0 0x7fa53406b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:30.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa52bfff640 1 -- 172.21.15.26:0/2659006423 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610755706 0 0) 0x7fa53415d4e0 con 0x7fa5340ce310 2023-10-14T11:13:30.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa538ba0640 1 --2- 172.21.15.26:0/2659006423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa53415cf90 0x7fa53406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:30.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa52bfff640 1 -- 172.21.15.26:0/2659006423 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa520003530 con 0x7fa5340ce310 2023-10-14T11:13:30.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa52bfff640 1 -- 172.21.15.26:0/2659006423 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 172540080 0 0) 0x7fa520003530 con 0x7fa5340ce310 2023-10-14T11:13:30.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa52bfff640 1 -- 172.21.15.26:0/2659006423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa53415cf90 msgr2=0x7fa53406c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:30.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa52bfff640 1 --2- 172.21.15.26:0/2659006423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa53415cf90 0x7fa53406c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa52bfff640 1 -- 172.21.15.26:0/2659006423 >> v2:172.21.15.110:3300/0 conn(0x7fa5340b2ad0 msgr2=0x7fa53406b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:30.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa52bfff640 1 --2- 172.21.15.26:0/2659006423 >> v2:172.21.15.110:3300/0 conn(0x7fa5340b2ad0 0x7fa53406b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa52bfff640 1 -- 172.21.15.26:0/2659006423 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53415daa0 con 0x7fa5340ce310 2023-10-14T11:13:30.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa52bfff640 1 -- 172.21.15.26:0/2659006423 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7fa52c001a00 con 0x7fa5340ce310 2023-10-14T11:13:30.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa52bfff640 1 -- 172.21.15.26:0/2659006423 >> v1:172.21.15.26:6789/0 conn(0x7fa5340ce310 legacy=0x7fa5341609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:30.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa52bfff640 1 --2- 172.21.15.26:0/2659006423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa520003980 0x7fa520003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:30.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa52bfff640 1 --2- 172.21.15.26:0/2659006423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5200047d0 0x7fa520004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:30.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa52bfff640 1 --2- 172.21.15.26:0/2659006423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa53415cf90 0x7fa520005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:30.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa52bfff640 1 -- 172.21.15.26:0/2659006423 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa534160580 con 0x7fa520003980 2023-10-14T11:13:30.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa52bfff640 1 -- 172.21.15.26:0/2659006423 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53415d7c0 con 0x7fa5200047d0 2023-10-14T11:13:30.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa52bfff640 1 -- 172.21.15.26:0/2659006423 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52000b990 con 0x7fa53415cf90 2023-10-14T11:13:30.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa5393a1640 1 --2- 172.21.15.26:0/2659006423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa520003980 0x7fa520003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:30.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa539ba2640 1 --2- 172.21.15.26:0/2659006423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa53415cf90 0x7fa520005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:30.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa538ba0640 1 --2- 172.21.15.26:0/2659006423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5200047d0 0x7fa520004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:30.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa5393a1640 1 -- 172.21.15.26:0/2659006423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa53415cf90 msgr2=0x7fa520005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:30.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa5393a1640 1 --2- 172.21.15.26:0/2659006423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa53415cf90 0x7fa520005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa5393a1640 1 -- 172.21.15.26:0/2659006423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5200047d0 msgr2=0x7fa520004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:30.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa5393a1640 1 --2- 172.21.15.26:0/2659006423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5200047d0 0x7fa520004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.814+0000 7fa5393a1640 1 -- 172.21.15.26:0/2659006423 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa520003530 con 0x7fa520003980 2023-10-14T11:13:30.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.818+0000 7fa5393a1640 1 --2- 172.21.15.26:0/2659006423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa520003980 0x7fa520003da0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa530009ae0 tx=0x7fa53001ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b414108a5508eb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:30.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.818+0000 7fa52bfff640 1 -- 172.21.15.26:0/2659006423 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5300a6470 con 0x7fa520003980 2023-10-14T11:13:30.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.818+0000 7fa52bfff640 1 -- 172.21.15.26:0/2659006423 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5300a65d0 con 0x7fa520003980 2023-10-14T11:13:30.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.818+0000 7fa52bfff640 1 -- 172.21.15.26:0/2659006423 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5300a6980 con 0x7fa520003980 2023-10-14T11:13:30.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.818+0000 7fa53b605640 1 -- 172.21.15.26:0/2659006423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa520003980 msgr2=0x7fa520003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:30.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.818+0000 7fa53b605640 1 --2- 172.21.15.26:0/2659006423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa520003980 0x7fa520003da0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa530009ae0 tx=0x7fa53001ca60 comp rx=0 tx=0).stop 2023-10-14T11:13:30.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.818+0000 7fa539ba2640 1 -- 172.21.15.26:0/2659006423 reap_dead start 2023-10-14T11:13:30.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.818+0000 7fa53b605640 1 -- 172.21.15.26:0/2659006423 shutdown_connections 2023-10-14T11:13:30.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.818+0000 7fa53b605640 1 -- 172.21.15.26:0/2659006423 >> 172.21.15.26:0/2659006423 conn(0x7fa5340cd1c0 msgr2=0x7fa5340cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:30.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.818+0000 7fa53b605640 1 -- 172.21.15.26:0/2659006423 shutdown_connections 2023-10-14T11:13:30.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.818+0000 7fa53b605640 1 -- 172.21.15.26:0/2659006423 wait complete. 2023-10-14T11:13:30.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa53b605640 1 Processor -- start 2023-10-14T11:13:30.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa53b605640 1 -- start start 2023-10-14T11:13:30.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa53b605640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa520003980 0x7fa5340b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:30.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa53b605640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa53415e3a0 0x7fa5340c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:30.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa53b605640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa53415f750 0x7fa53415fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:30.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa53b605640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5340b4300 con 0x7fa53415f750 2023-10-14T11:13:30.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa53b605640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53415ec70 con 0x7fa53415e3a0 2023-10-14T11:13:30.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa53b605640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53415ef50 con 0x7fa520003980 2023-10-14T11:13:30.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa539ba2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa53415f750 0x7fa53415fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:30.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa539ba2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa53415f750 0x7fa53415fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47772/0 (socket says 172.21.15.26:47772) 2023-10-14T11:13:30.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa539ba2640 1 -- 172.21.15.26:0/2987371590 learned_addr learned my addr 172.21.15.26:0/2987371590 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:30.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa5393a1640 1 --2- 172.21.15.26:0/2987371590 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa520003980 0x7fa5340b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:30.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa538ba0640 1 --2- 172.21.15.26:0/2987371590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa53415e3a0 0x7fa5340c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:30.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa539ba2640 1 -- 172.21.15.26:0/2987371590 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa520003980 msgr2=0x7fa5340b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:30.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa539ba2640 1 --2- 172.21.15.26:0/2987371590 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa520003980 0x7fa5340b3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa539ba2640 1 -- 172.21.15.26:0/2987371590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa53415e3a0 msgr2=0x7fa5340c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:30.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa539ba2640 1 --2- 172.21.15.26:0/2987371590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa53415e3a0 0x7fa5340c6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa539ba2640 1 -- 172.21.15.26:0/2987371590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5340cecb0 con 0x7fa53415f750 2023-10-14T11:13:30.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa539ba2640 1 --2- 172.21.15.26:0/2987371590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa53415f750 0x7fa53415fbb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa5340d0710 tx=0x7fa52c007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:30.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa529ffb640 1 -- 172.21.15.26:0/2987371590 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c00ac80 con 0x7fa53415f750 2023-10-14T11:13:30.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa529ffb640 1 -- 172.21.15.26:0/2987371590 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52c00ae00 con 0x7fa53415f750 2023-10-14T11:13:30.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa53b605640 1 -- 172.21.15.26:0/2987371590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53415f230 con 0x7fa53415f750 2023-10-14T11:13:30.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa529ffb640 1 -- 172.21.15.26:0/2987371590 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c013630 con 0x7fa53415f750 2023-10-14T11:13:30.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.822+0000 7fa53b605640 1 -- 172.21.15.26:0/2987371590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53415e820 con 0x7fa53415f750 2023-10-14T11:13:30.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.826+0000 7fa53b605640 1 -- 172.21.15.26:0/2987371590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa53415cdc0 con 0x7fa53415f750 2023-10-14T11:13:30.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.826+0000 7fa529ffb640 1 -- 172.21.15.26:0/2987371590 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa52c013790 con 0x7fa53415f750 2023-10-14T11:13:30.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.826+0000 7fa529ffb640 1 --2- 172.21.15.26:0/2987371590 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5180664a0 0x7fa518068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:30.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.826+0000 7fa529ffb640 1 -- 172.21.15.26:0/2987371590 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa52c084c10 con 0x7fa53415f750 2023-10-14T11:13:30.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.826+0000 7fa5393a1640 1 --2- 172.21.15.26:0/2987371590 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5180664a0 0x7fa518068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:30.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.826+0000 7fa5393a1640 1 --2- 172.21.15.26:0/2987371590 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5180664a0 0x7fa518068960 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa5300ad000 tx=0x7fa5300b2040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:30.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.830+0000 7fa529ffb640 1 -- 172.21.15.26:0/2987371590 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa52c051d60 con 0x7fa53415f750 2023-10-14T11:13:30.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.990+0000 7fa53b605640 1 -- 172.21.15.26:0/2987371590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa534074010 con 0x7fa53415f750 2023-10-14T11:13:30.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.990+0000 7fa529ffb640 1 -- 172.21.15.26:0/2987371590 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18679 (secure 0 0 0) 0x7fa52c017070 con 0x7fa53415f750 2023-10-14T11:13:30.992 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:30.992 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":27,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:13:03.866737+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:13:30.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.990+0000 7fa53b605640 1 -- 172.21.15.26:0/2987371590 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5180664a0 msgr2=0x7fa518068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:30.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.990+0000 7fa53b605640 1 --2- 172.21.15.26:0/2987371590 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5180664a0 0x7fa518068960 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa5300ad000 tx=0x7fa5300b2040 comp rx=0 tx=0).stop 2023-10-14T11:13:30.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.990+0000 7fa53b605640 1 -- 172.21.15.26:0/2987371590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa53415f750 msgr2=0x7fa53415fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:30.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.990+0000 7fa53b605640 1 --2- 172.21.15.26:0/2987371590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa53415f750 0x7fa53415fbb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa5340d0710 tx=0x7fa52c007bd0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.990+0000 7fa53b605640 1 -- 172.21.15.26:0/2987371590 shutdown_connections 2023-10-14T11:13:30.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.990+0000 7fa53b605640 1 --2- 172.21.15.26:0/2987371590 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5180664a0 0x7fa518068960 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.990+0000 7fa53b605640 1 --2- 172.21.15.26:0/2987371590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa53415f750 0x7fa53415fbb0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.990+0000 7fa53b605640 1 --2- 172.21.15.26:0/2987371590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa53415e3a0 0x7fa5340c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.990+0000 7fa53b605640 1 --2- 172.21.15.26:0/2987371590 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa520003980 0x7fa5340b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:30.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.990+0000 7fa53b605640 1 -- 172.21.15.26:0/2987371590 >> 172.21.15.26:0/2987371590 conn(0x7fa5340cd1c0 msgr2=0x7fa534162650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:30.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.990+0000 7fa53b605640 1 -- 172.21.15.26:0/2987371590 shutdown_connections 2023-10-14T11:13:30.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:30.990+0000 7fa53b605640 1 -- 172.21.15.26:0/2987371590 wait complete. 2023-10-14T11:13:31.014 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:12:20.179562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:12:21.346111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T11:12:25.025159+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T11:13:31.015 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:13:31.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3bb189c640 1 Processor -- start 2023-10-14T11:13:31.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3bb189c640 1 -- start start 2023-10-14T11:13:31.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3bb189c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bac0b84e0 0x7f3bac0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:31.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3bb189c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bac0d1670 con 0x7f3bac15cba0 2023-10-14T11:13:31.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3bb189c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bac0d1950 con 0x7f3bac0d0210 2023-10-14T11:13:31.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3bb189c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac0d1460 con 0x7f3bac0b84e0 2023-10-14T11:13:31.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3baaffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3bac15cba0 0x7f3bac0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44640/0 (socket says 172.21.15.26:44640) 2023-10-14T11:13:31.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3baaffd640 1 -- 172.21.15.26:0/160805046 learned_addr learned my addr 172.21.15.26:0/160805046 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:31.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3bab7fe640 1 --2- 172.21.15.26:0/160805046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bac0b84e0 0x7f3bac0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:31.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3baa7fc640 1 -- 172.21.15.26:0/160805046 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308929647 0 0) 0x7f3bac0d1670 con 0x7f3bac15cba0 2023-10-14T11:13:31.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3baa7fc640 1 -- 172.21.15.26:0/160805046 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b98003530 con 0x7f3bac15cba0 2023-10-14T11:13:31.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3baa7fc640 1 -- 172.21.15.26:0/160805046 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469349126 0 0) 0x7f3bac0d1950 con 0x7f3bac0d0210 2023-10-14T11:13:31.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3baa7fc640 1 -- 172.21.15.26:0/160805046 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bac0d1670 con 0x7f3bac0d0210 2023-10-14T11:13:31.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3baa7fc640 1 -- 172.21.15.26:0/160805046 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1780967770 0 0) 0x7f3b98003530 con 0x7f3bac15cba0 2023-10-14T11:13:31.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3baa7fc640 1 -- 172.21.15.26:0/160805046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bac0b84e0 msgr2=0x7f3bac0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:31.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3baa7fc640 1 --2- 172.21.15.26:0/160805046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bac0b84e0 0x7f3bac0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:31.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3baa7fc640 1 -- 172.21.15.26:0/160805046 >> v1:172.21.15.110:6789/0 conn(0x7f3bac0d0210 legacy=0x7f3bac0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:31.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3baa7fc640 1 -- 172.21.15.26:0/160805046 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac0d1c30 con 0x7f3bac15cba0 2023-10-14T11:13:31.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3baa7fc640 1 -- 172.21.15.26:0/160805046 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f3b9c001680 con 0x7f3bac15cba0 2023-10-14T11:13:31.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3bab7fe640 1 --2- 172.21.15.26:0/160805046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bac0b84e0 0x7f3bac0d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:13:31.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3baa7fc640 1 -- 172.21.15.26:0/160805046 >> v1:172.21.15.26:6789/0 conn(0x7f3bac15cba0 legacy=0x7f3bac0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:31.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3baa7fc640 1 --2- 172.21.15.26:0/160805046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b98003b40 0x7f3b98003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:31.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3baa7fc640 1 --2- 172.21.15.26:0/160805046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b980047d0 0x7f3b98004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:31.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3baa7fc640 1 --2- 172.21.15.26:0/160805046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bac0b84e0 0x7f3b98005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:31.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3baa7fc640 1 -- 172.21.15.26:0/160805046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac0d1460 con 0x7f3b98003b40 2023-10-14T11:13:31.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3baa7fc640 1 -- 172.21.15.26:0/160805046 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9800b9c0 con 0x7f3b980047d0 2023-10-14T11:13:31.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3baa7fc640 1 -- 172.21.15.26:0/160805046 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9800bb80 con 0x7f3bac0b84e0 2023-10-14T11:13:31.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.162+0000 7f3baaffd640 1 --2- 172.21.15.26:0/160805046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b98003b40 0x7f3b98003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:31.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.166+0000 7f3ba3fff640 1 --2- 172.21.15.26:0/160805046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b980047d0 0x7f3b98004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:31.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.166+0000 7f3bab7fe640 1 --2- 172.21.15.26:0/160805046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bac0b84e0 0x7f3b98005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:31.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.166+0000 7f3baaffd640 1 -- 172.21.15.26:0/160805046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bac0b84e0 msgr2=0x7f3b98005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:31.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.166+0000 7f3baaffd640 1 --2- 172.21.15.26:0/160805046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bac0b84e0 0x7f3b98005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:31.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.166+0000 7f3baaffd640 1 -- 172.21.15.26:0/160805046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b980047d0 msgr2=0x7f3b98004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:31.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.166+0000 7f3baaffd640 1 --2- 172.21.15.26:0/160805046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b980047d0 0x7f3b98004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:31.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.166+0000 7f3baaffd640 1 -- 172.21.15.26:0/160805046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba4009a70 con 0x7f3b98003b40 2023-10-14T11:13:31.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.166+0000 7f3baaffd640 1 --2- 172.21.15.26:0/160805046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b98003b40 0x7f3b98003f40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c001ec0 tx=0x7f3b9c01cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1502291c2debf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:31.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.166+0000 7f3baa7fc640 1 -- 172.21.15.26:0/160805046 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c0058e0 con 0x7f3b98003b40 2023-10-14T11:13:31.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.166+0000 7f3baa7fc640 1 -- 172.21.15.26:0/160805046 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9c005a60 con 0x7f3b98003b40 2023-10-14T11:13:31.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.166+0000 7f3baa7fc640 1 -- 172.21.15.26:0/160805046 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c005e10 con 0x7f3b98003b40 2023-10-14T11:13:31.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.166+0000 7f3bb189c640 1 -- 172.21.15.26:0/160805046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b98003b40 msgr2=0x7f3b98003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:31.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.166+0000 7f3bb189c640 1 --2- 172.21.15.26:0/160805046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b98003b40 0x7f3b98003f40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c001ec0 tx=0x7f3b9c01cb80 comp rx=0 tx=0).stop 2023-10-14T11:13:31.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.166+0000 7f3bab7fe640 1 -- 172.21.15.26:0/160805046 reap_dead start 2023-10-14T11:13:31.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3bb189c640 1 -- 172.21.15.26:0/160805046 shutdown_connections 2023-10-14T11:13:31.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3bb189c640 1 -- 172.21.15.26:0/160805046 >> 172.21.15.26:0/160805046 conn(0x7f3bac0719c0 msgr2=0x7f3bac071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:31.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3bb189c640 1 -- 172.21.15.26:0/160805046 shutdown_connections 2023-10-14T11:13:31.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3bb189c640 1 -- 172.21.15.26:0/160805046 wait complete. 2023-10-14T11:13:31.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3bb189c640 1 Processor -- start 2023-10-14T11:13:31.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3bb189c640 1 -- start start 2023-10-14T11:13:31.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3bb189c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b98003b40 0x7f3bac1571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:31.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3bb189c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bac14f9c0 0x7f3bac1504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:31.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3bb189c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bac14a200 0x7f3bac15ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:31.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3bb189c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac14fe40 con 0x7f3bac14a200 2023-10-14T11:13:31.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3bb189c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac150a20 con 0x7f3b98003b40 2023-10-14T11:13:31.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3bb189c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac14ec00 con 0x7f3bac14f9c0 2023-10-14T11:13:31.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3bab7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bac14a200 0x7f3bac15ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:31.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3bab7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bac14a200 0x7f3bac15ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47784/0 (socket says 172.21.15.26:47784) 2023-10-14T11:13:31.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3bab7fe640 1 -- 172.21.15.26:0/3407175134 learned_addr learned my addr 172.21.15.26:0/3407175134 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:31.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3baaffd640 1 --2- 172.21.15.26:0/3407175134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b98003b40 0x7f3bac1571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:31.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3ba3fff640 1 --2- 172.21.15.26:0/3407175134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bac14f9c0 0x7f3bac1504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:31.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3bab7fe640 1 -- 172.21.15.26:0/3407175134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bac14f9c0 msgr2=0x7f3bac1504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:31.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3bab7fe640 1 --2- 172.21.15.26:0/3407175134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bac14f9c0 0x7f3bac1504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:31.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3bab7fe640 1 -- 172.21.15.26:0/3407175134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b98003b40 msgr2=0x7f3bac1571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:31.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3bab7fe640 1 --2- 172.21.15.26:0/3407175134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b98003b40 0x7f3bac1571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:31.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3bab7fe640 1 -- 172.21.15.26:0/3407175134 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac14eee0 con 0x7f3bac14a200 2023-10-14T11:13:31.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.170+0000 7f3bab7fe640 1 --2- 172.21.15.26:0/3407175134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bac14a200 0x7f3bac15ade0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0b8990 tx=0x7f3ba400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:31.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.174+0000 7f3ba8ff9640 1 -- 172.21.15.26:0/3407175134 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba400e040 con 0x7f3bac14a200 2023-10-14T11:13:31.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.174+0000 7f3ba8ff9640 1 -- 172.21.15.26:0/3407175134 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba400f040 con 0x7f3bac14a200 2023-10-14T11:13:31.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.174+0000 7f3bb189c640 1 -- 172.21.15.26:0/3407175134 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bac14f1c0 con 0x7f3bac14a200 2023-10-14T11:13:31.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.174+0000 7f3ba8ff9640 1 -- 172.21.15.26:0/3407175134 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4015670 con 0x7f3bac14a200 2023-10-14T11:13:31.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.174+0000 7f3bb189c640 1 -- 172.21.15.26:0/3407175134 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bac14a690 con 0x7f3bac14a200 2023-10-14T11:13:31.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.174+0000 7f3bb189c640 1 -- 172.21.15.26:0/3407175134 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bac14f6e0 con 0x7f3bac14a200 2023-10-14T11:13:31.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.174+0000 7f3ba8ff9640 1 -- 172.21.15.26:0/3407175134 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3ba40157d0 con 0x7f3bac14a200 2023-10-14T11:13:31.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.174+0000 7f3ba8ff9640 1 --2- 172.21.15.26:0/3407175134 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3b8c0664a0 0x7f3b8c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:31.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.174+0000 7f3ba8ff9640 1 -- 172.21.15.26:0/3407175134 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3ba4084ac0 con 0x7f3bac14a200 2023-10-14T11:13:31.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.174+0000 7f3baaffd640 1 --2- 172.21.15.26:0/3407175134 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3b8c0664a0 0x7f3b8c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:31.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.178+0000 7f3baaffd640 1 --2- 172.21.15.26:0/3407175134 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3b8c0664a0 0x7f3b8c068960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0aa000 tx=0x7f3b9c001a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:31.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.178+0000 7f3ba8ff9640 1 -- 172.21.15.26:0/3407175134 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3bac14f6e0 con 0x7f3bac14a200 2023-10-14T11:13:31.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.338+0000 7f3bb189c640 1 -- 172.21.15.26:0/3407175134 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3bac14f6e0 con 0x7f3bac14a200 2023-10-14T11:13:31.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.338+0000 7f3ba8ff9640 1 -- 172.21.15.26:0/3407175134 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3bac14f6e0 con 0x7f3bac14a200 2023-10-14T11:13:31.340 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:13:31.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.338+0000 7f3bb189c640 1 -- 172.21.15.26:0/3407175134 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3b8c0664a0 msgr2=0x7f3b8c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:31.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.338+0000 7f3bb189c640 1 --2- 172.21.15.26:0/3407175134 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3b8c0664a0 0x7f3b8c068960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0aa000 tx=0x7f3b9c001a00 comp rx=0 tx=0).stop 2023-10-14T11:13:31.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.338+0000 7f3bb189c640 1 -- 172.21.15.26:0/3407175134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bac14a200 msgr2=0x7f3bac15ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:31.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.338+0000 7f3bb189c640 1 --2- 172.21.15.26:0/3407175134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bac14a200 0x7f3bac15ade0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0b8990 tx=0x7f3ba400f580 comp rx=0 tx=0).stop 2023-10-14T11:13:31.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.338+0000 7f3bb189c640 1 -- 172.21.15.26:0/3407175134 shutdown_connections 2023-10-14T11:13:31.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.338+0000 7f3bb189c640 1 --2- 172.21.15.26:0/3407175134 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3b8c0664a0 0x7f3b8c068960 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:31.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.338+0000 7f3bb189c640 1 --2- 172.21.15.26:0/3407175134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bac14a200 0x7f3bac15ade0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:31.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.338+0000 7f3bb189c640 1 --2- 172.21.15.26:0/3407175134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bac14f9c0 0x7f3bac1504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:31.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.338+0000 7f3bb189c640 1 --2- 172.21.15.26:0/3407175134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b98003b40 0x7f3bac1571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:31.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.338+0000 7f3bb189c640 1 -- 172.21.15.26:0/3407175134 >> 172.21.15.26:0/3407175134 conn(0x7f3bac0719c0 msgr2=0x7f3bac0b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:31.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.338+0000 7f3bb189c640 1 -- 172.21.15.26:0/3407175134 shutdown_connections 2023-10-14T11:13:31.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.338+0000 7f3bb189c640 1 -- 172.21.15.26:0/3407175134 wait complete. 2023-10-14T11:13:31.361 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:13:31.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.506+0000 7fa58e4d6640 1 Processor -- start 2023-10-14T11:13:31.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.506+0000 7fa58e4d6640 1 -- start start 2023-10-14T11:13:31.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.506+0000 7fa58e4d6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa58815cc60 0x7fa5880cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:31.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.506+0000 7fa58e4d6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa588161260 0x7fa5880ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:31.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.506+0000 7fa58e4d6640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5880cc330 con 0x7fa5880cebd0 2023-10-14T11:13:31.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.506+0000 7fa58e4d6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5880cefe0 con 0x7fa58815cc60 2023-10-14T11:13:31.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.506+0000 7fa58e4d6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880cb720 con 0x7fa588161260 2023-10-14T11:13:31.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.506+0000 7fa5877fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa588161260 0x7fa5880ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:31.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.506+0000 7fa587fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa58815cc60 0x7fa5880cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:31.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.506+0000 7fa5877fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa588161260 0x7fa5880ce690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:38726/0 (socket says 172.21.15.26:38726) 2023-10-14T11:13:31.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.506+0000 7fa58ca73640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa5880cebd0 0x7fa5880b2330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:48542/0 (socket says 172.21.15.26:48542) 2023-10-14T11:13:31.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.506+0000 7fa5877fe640 1 -- 172.21.15.26:0/145117674 learned_addr learned my addr 172.21.15.26:0/145117674 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:31.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.510+0000 7fa5877fe640 1 -- 172.21.15.26:0/145117674 >> v2:172.21.15.110:3300/0 conn(0x7fa58815cc60 msgr2=0x7fa5880cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:31.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.510+0000 7fa5877fe640 1 --2- 172.21.15.26:0/145117674 >> v2:172.21.15.110:3300/0 conn(0x7fa58815cc60 0x7fa5880cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:31.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.510+0000 7fa5877fe640 1 -- 172.21.15.26:0/145117674 >> v1:172.21.15.110:6789/0 conn(0x7fa5880cebd0 legacy=0x7fa5880b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:31.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.510+0000 7fa586ffd640 1 -- 172.21.15.26:0/145117674 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68735216 0 0) 0x7fa5880cc330 con 0x7fa5880cebd0 2023-10-14T11:13:31.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.510+0000 7fa5877fe640 1 -- 172.21.15.26:0/145117674 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5880cba00 con 0x7fa588161260 2023-10-14T11:13:31.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.510+0000 7fa5877fe640 1 --2- 172.21.15.26:0/145117674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa588161260 0x7fa5880ce690 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa57c009870 tx=0x7fa57c01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3d529da900bae50 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:31.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.510+0000 7fa586ffd640 1 -- 172.21.15.26:0/145117674 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c0aa670 con 0x7fa588161260 2023-10-14T11:13:31.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.510+0000 7fa586ffd640 1 -- 172.21.15.26:0/145117674 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c0aa7d0 con 0x7fa588161260 2023-10-14T11:13:31.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.510+0000 7fa586ffd640 1 -- 172.21.15.26:0/145117674 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c0aab60 con 0x7fa588161260 2023-10-14T11:13:31.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa58e4d6640 1 -- 172.21.15.26:0/145117674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa588161260 msgr2=0x7fa5880ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:31.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa58e4d6640 1 --2- 172.21.15.26:0/145117674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa588161260 0x7fa5880ce690 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa57c009870 tx=0x7fa57c01c510 comp rx=0 tx=0).stop 2023-10-14T11:13:31.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa58e4d6640 1 -- 172.21.15.26:0/145117674 shutdown_connections 2023-10-14T11:13:31.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa58e4d6640 1 --2- 172.21.15.26:0/145117674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa588161260 0x7fa5880ce690 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:31.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa58e4d6640 1 --2- 172.21.15.26:0/145117674 >> v2:172.21.15.110:3300/0 conn(0x7fa58815cc60 0x7fa5880cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:31.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa58e4d6640 1 -- 172.21.15.26:0/145117674 >> 172.21.15.26:0/145117674 conn(0x7fa58806e570 msgr2=0x7fa58806e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:31.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa58e4d6640 1 -- 172.21.15.26:0/145117674 shutdown_connections 2023-10-14T11:13:31.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa58e4d6640 1 -- 172.21.15.26:0/145117674 wait complete. 2023-10-14T11:13:31.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa58e4d6640 1 Processor -- start 2023-10-14T11:13:31.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa58e4d6640 1 -- start start 2023-10-14T11:13:31.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa58e4d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5880cebd0 0x7fa58815d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:31.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa58e4d6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa58815cc60 0x7fa5881552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:31.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa58e4d6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa588161260 0x7fa5880c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:31.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa58e4d6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880c8850 con 0x7fa5880cebd0 2023-10-14T11:13:31.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa58e4d6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880c5150 con 0x7fa58815cc60 2023-10-14T11:13:31.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa58e4d6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880c5430 con 0x7fa588161260 2023-10-14T11:13:31.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa587fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5880cebd0 0x7fa58815d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:31.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa587fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5880cebd0 0x7fa58815d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47788/0 (socket says 172.21.15.26:47788) 2023-10-14T11:13:31.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa587fff640 1 -- 172.21.15.26:0/2139096891 learned_addr learned my addr 172.21.15.26:0/2139096891 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:31.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa5877fe640 1 --2- 172.21.15.26:0/2139096891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa58815cc60 0x7fa5881552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:31.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa58ca73640 1 --2- 172.21.15.26:0/2139096891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa588161260 0x7fa5880c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:31.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa587fff640 1 -- 172.21.15.26:0/2139096891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa588161260 msgr2=0x7fa5880c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:31.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa587fff640 1 --2- 172.21.15.26:0/2139096891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa588161260 0x7fa5880c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:31.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa587fff640 1 -- 172.21.15.26:0/2139096891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa58815cc60 msgr2=0x7fa5881552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:31.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa587fff640 1 --2- 172.21.15.26:0/2139096891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa58815cc60 0x7fa5881552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:31.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.514+0000 7fa587fff640 1 -- 172.21.15.26:0/2139096891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57c0094d0 con 0x7fa5880cebd0 2023-10-14T11:13:31.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.518+0000 7fa587fff640 1 --2- 172.21.15.26:0/2139096891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5880cebd0 0x7fa58815d1c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa57800e930 tx=0x7fa57800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:31.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.518+0000 7fa584ff9640 1 -- 172.21.15.26:0/2139096891 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa578009690 con 0x7fa5880cebd0 2023-10-14T11:13:31.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.518+0000 7fa584ff9640 1 -- 172.21.15.26:0/2139096891 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57800ca00 con 0x7fa5880cebd0 2023-10-14T11:13:31.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.518+0000 7fa584ff9640 1 -- 172.21.15.26:0/2139096891 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57800cd70 con 0x7fa5880cebd0 2023-10-14T11:13:31.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.518+0000 7fa58e4d6640 1 -- 172.21.15.26:0/2139096891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5880c5710 con 0x7fa5880cebd0 2023-10-14T11:13:31.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.518+0000 7fa58e4d6640 1 -- 172.21.15.26:0/2139096891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa588155810 con 0x7fa5880cebd0 2023-10-14T11:13:31.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.518+0000 7fa58e4d6640 1 -- 172.21.15.26:0/2139096891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa58804e170 con 0x7fa5880cebd0 2023-10-14T11:13:31.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.518+0000 7fa584ff9640 1 -- 172.21.15.26:0/2139096891 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa578013470 con 0x7fa5880cebd0 2023-10-14T11:13:31.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.518+0000 7fa584ff9640 1 --2- 172.21.15.26:0/2139096891 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5740664a0 0x7fa574068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:31.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.518+0000 7fa584ff9640 1 -- 172.21.15.26:0/2139096891 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa578084480 con 0x7fa5880cebd0 2023-10-14T11:13:31.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.518+0000 7fa5877fe640 1 --2- 172.21.15.26:0/2139096891 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5740664a0 0x7fa574068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:31.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.522+0000 7fa5877fe640 1 --2- 172.21.15.26:0/2139096891 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5740664a0 0x7fa574068960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa57c0ae000 tx=0x7fa57c0b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:31.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.522+0000 7fa584ff9640 1 -- 172.21.15.26:0/2139096891 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa578051610 con 0x7fa5880cebd0 2023-10-14T11:13:31.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.682+0000 7fa58e4d6640 1 -- 172.21.15.26:0/2139096891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa5880c8990 con 0x7fa5880cebd0 2023-10-14T11:13:31.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.682+0000 7fa584ff9640 1 -- 172.21.15.26:0/2139096891 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa578054c30 con 0x7fa5880cebd0 2023-10-14T11:13:31.687 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:31.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.686+0000 7fa58e4d6640 1 -- 172.21.15.26:0/2139096891 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5740664a0 msgr2=0x7fa574068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:31.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.686+0000 7fa58e4d6640 1 --2- 172.21.15.26:0/2139096891 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5740664a0 0x7fa574068960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa57c0ae000 tx=0x7fa57c0b5040 comp rx=0 tx=0).stop 2023-10-14T11:13:31.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.686+0000 7fa58e4d6640 1 -- 172.21.15.26:0/2139096891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5880cebd0 msgr2=0x7fa58815d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:31.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.686+0000 7fa58e4d6640 1 --2- 172.21.15.26:0/2139096891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5880cebd0 0x7fa58815d1c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa57800e930 tx=0x7fa57800edf0 comp rx=0 tx=0).stop 2023-10-14T11:13:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.686+0000 7fa58e4d6640 1 -- 172.21.15.26:0/2139096891 shutdown_connections 2023-10-14T11:13:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.686+0000 7fa58e4d6640 1 --2- 172.21.15.26:0/2139096891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa588161260 0x7fa5880c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.686+0000 7fa58e4d6640 1 --2- 172.21.15.26:0/2139096891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa58815cc60 0x7fa5881552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.686+0000 7fa58e4d6640 1 --2- 172.21.15.26:0/2139096891 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5740664a0 0x7fa574068960 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.686+0000 7fa58e4d6640 1 --2- 172.21.15.26:0/2139096891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5880cebd0 0x7fa58815d1c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:31.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.686+0000 7fa58e4d6640 1 -- 172.21.15.26:0/2139096891 >> 172.21.15.26:0/2139096891 conn(0x7fa58806e570 msgr2=0x7fa58815b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:31.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.686+0000 7fa58e4d6640 1 -- 172.21.15.26:0/2139096891 shutdown_connections 2023-10-14T11:13:31.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.686+0000 7fa58e4d6640 1 -- 172.21.15.26:0/2139096891 wait complete. 2023-10-14T11:13:31.707 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:13:31.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.850+0000 7fb791fd9640 1 Processor -- start 2023-10-14T11:13:31.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.850+0000 7fb791fd9640 1 -- start start 2023-10-14T11:13:31.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.854+0000 7fb791fd9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb78c0b84e0 0x7fb78c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:31.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.854+0000 7fb791fd9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78c0d1670 con 0x7fb78c0d0210 2023-10-14T11:13:31.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.854+0000 7fb791fd9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78c0d1950 con 0x7fb78c15cba0 2023-10-14T11:13:31.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.854+0000 7fb791fd9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c0d1460 con 0x7fb78c0b84e0 2023-10-14T11:13:31.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.854+0000 7fb78affd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb78c0d0210 0x7fb78c0b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44648/0 (socket says 172.21.15.26:44648) 2023-10-14T11:13:31.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.854+0000 7fb78affd640 1 -- 172.21.15.26:0/864334427 learned_addr learned my addr 172.21.15.26:0/864334427 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:31.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.854+0000 7fb78bfff640 1 --2- 172.21.15.26:0/864334427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb78c0b84e0 0x7fb78c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:31.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.854+0000 7fb78a7fc640 1 -- 172.21.15.26:0/864334427 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369087837 0 0) 0x7fb78c0d1670 con 0x7fb78c0d0210 2023-10-14T11:13:31.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.854+0000 7fb78a7fc640 1 -- 172.21.15.26:0/864334427 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb774003530 con 0x7fb78c0d0210 2023-10-14T11:13:31.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.854+0000 7fb78a7fc640 1 -- 172.21.15.26:0/864334427 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 866830641 0 0) 0x7fb78c0d1950 con 0x7fb78c15cba0 2023-10-14T11:13:31.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.854+0000 7fb78a7fc640 1 -- 172.21.15.26:0/864334427 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb78c0d1670 con 0x7fb78c15cba0 2023-10-14T11:13:31.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.854+0000 7fb78bfff640 1 -- 172.21.15.26:0/864334427 >> v1:172.21.15.110:6789/0 conn(0x7fb78c15cba0 legacy=0x7fb78c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:31.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.854+0000 7fb78bfff640 1 -- 172.21.15.26:0/864334427 >> v1:172.21.15.26:6789/0 conn(0x7fb78c0d0210 legacy=0x7fb78c0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:31.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.854+0000 7fb78bfff640 1 -- 172.21.15.26:0/864334427 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c0d1c30 con 0x7fb78c0b84e0 2023-10-14T11:13:31.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.854+0000 7fb78bfff640 1 --2- 172.21.15.26:0/864334427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb78c0b84e0 0x7fb78c0d0f20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb784009dc0 tx=0x7fb78401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc25c679777efded server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:31.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.858+0000 7fb78a7fc640 1 -- 172.21.15.26:0/864334427 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7840a5a30 con 0x7fb78c0b84e0 2023-10-14T11:13:31.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.858+0000 7fb78a7fc640 1 -- 172.21.15.26:0/864334427 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7840a5b90 con 0x7fb78c0b84e0 2023-10-14T11:13:31.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.858+0000 7fb78a7fc640 1 -- 172.21.15.26:0/864334427 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7840ad440 con 0x7fb78c0b84e0 2023-10-14T11:13:31.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.858+0000 7fb791fd9640 1 -- 172.21.15.26:0/864334427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb78c0b84e0 msgr2=0x7fb78c0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:31.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.858+0000 7fb791fd9640 1 --2- 172.21.15.26:0/864334427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb78c0b84e0 0x7fb78c0d0f20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb784009dc0 tx=0x7fb78401c970 comp rx=0 tx=0).stop 2023-10-14T11:13:31.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.858+0000 7fb791fd9640 1 -- 172.21.15.26:0/864334427 shutdown_connections 2023-10-14T11:13:31.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.858+0000 7fb791fd9640 1 --2- 172.21.15.26:0/864334427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb78c0b84e0 0x7fb78c0d0f20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:31.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.858+0000 7fb791fd9640 1 -- 172.21.15.26:0/864334427 >> 172.21.15.26:0/864334427 conn(0x7fb78c0719c0 msgr2=0x7fb78c071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:31.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.858+0000 7fb791fd9640 1 -- 172.21.15.26:0/864334427 shutdown_connections 2023-10-14T11:13:31.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.858+0000 7fb791fd9640 1 -- 172.21.15.26:0/864334427 wait complete. 2023-10-14T11:13:31.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.858+0000 7fb791fd9640 1 Processor -- start 2023-10-14T11:13:31.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.858+0000 7fb791fd9640 1 -- start start 2023-10-14T11:13:31.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.858+0000 7fb791fd9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb78c0b84e0 0x7fb78c0b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:31.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.858+0000 7fb791fd9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb78c0d0210 0x7fb78c14cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:31.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.858+0000 7fb791fd9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb78c15cba0 0x7fb78c0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:31.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.858+0000 7fb791fd9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c15fb90 con 0x7fb78c0d0210 2023-10-14T11:13:31.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.858+0000 7fb791fd9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c0b2c20 con 0x7fb78c15cba0 2023-10-14T11:13:31.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.858+0000 7fb791fd9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c0b36f0 con 0x7fb78c0b84e0 2023-10-14T11:13:31.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.858+0000 7fb78affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb78c0d0210 0x7fb78c14cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:31.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.862+0000 7fb78affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb78c0d0210 0x7fb78c14cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47800/0 (socket says 172.21.15.26:47800) 2023-10-14T11:13:31.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.862+0000 7fb78affd640 1 -- 172.21.15.26:0/889657213 learned_addr learned my addr 172.21.15.26:0/889657213 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:31.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.862+0000 7fb78bfff640 1 --2- 172.21.15.26:0/889657213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb78c15cba0 0x7fb78c0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:31.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.862+0000 7fb78b7fe640 1 --2- 172.21.15.26:0/889657213 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb78c0b84e0 0x7fb78c0b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:31.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.862+0000 7fb78affd640 1 -- 172.21.15.26:0/889657213 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb78c0b84e0 msgr2=0x7fb78c0b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.862+0000 7fb78affd640 1 --2- 172.21.15.26:0/889657213 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb78c0b84e0 0x7fb78c0b26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.862+0000 7fb78affd640 1 -- 172.21.15.26:0/889657213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb78c15cba0 msgr2=0x7fb78c0b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.862+0000 7fb78affd640 1 --2- 172.21.15.26:0/889657213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb78c15cba0 0x7fb78c0b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.862+0000 7fb78affd640 1 -- 172.21.15.26:0/889657213 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb784009a70 con 0x7fb78c0d0210 2023-10-14T11:13:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.862+0000 7fb78b7fe640 1 --2- 172.21.15.26:0/889657213 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb78c0b84e0 0x7fb78c0b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:31.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.862+0000 7fb78affd640 1 --2- 172.21.15.26:0/889657213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb78c0d0210 0x7fb78c14cd50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb780005890 tx=0x7fb78000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:31.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.862+0000 7fb773fff640 1 -- 172.21.15.26:0/889657213 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780005cf0 con 0x7fb78c0d0210 2023-10-14T11:13:31.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.862+0000 7fb773fff640 1 -- 172.21.15.26:0/889657213 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb780005e50 con 0x7fb78c0d0210 2023-10-14T11:13:31.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.862+0000 7fb773fff640 1 -- 172.21.15.26:0/889657213 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7800072b0 con 0x7fb78c0d0210 2023-10-14T11:13:31.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.862+0000 7fb791fd9640 1 -- 172.21.15.26:0/889657213 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78c0b2e50 con 0x7fb78c0d0210 2023-10-14T11:13:31.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.862+0000 7fb791fd9640 1 -- 172.21.15.26:0/889657213 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb78c0b3410 con 0x7fb78c0d0210 2023-10-14T11:13:31.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.862+0000 7fb791fd9640 1 -- 172.21.15.26:0/889657213 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78c04e170 con 0x7fb78c0d0210 2023-10-14T11:13:31.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.862+0000 7fb773fff640 1 -- 172.21.15.26:0/889657213 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb780007410 con 0x7fb78c0d0210 2023-10-14T11:13:31.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.862+0000 7fb773fff640 1 --2- 172.21.15.26:0/889657213 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb7780664a0 0x7fb778068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:31.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.866+0000 7fb773fff640 1 -- 172.21.15.26:0/889657213 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb780083710 con 0x7fb78c0d0210 2023-10-14T11:13:31.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.866+0000 7fb78b7fe640 1 --2- 172.21.15.26:0/889657213 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb7780664a0 0x7fb778068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:31.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.866+0000 7fb78b7fe640 1 --2- 172.21.15.26:0/889657213 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb7780664a0 0x7fb778068960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb77c0011f0 tx=0x7fb77c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:31.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:31.870+0000 7fb773fff640 1 -- 172.21.15.26:0/889657213 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb780050870 con 0x7fb78c0d0210 2023-10-14T11:13:32.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.026+0000 7fb791fd9640 1 -- 172.21.15.26:0/889657213 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb78c0b7bc0 con 0x7fb78c0d0210 2023-10-14T11:13:32.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.030+0000 7fb773fff640 1 -- 172.21.15.26:0/889657213 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb780053e90 con 0x7fb78c0d0210 2023-10-14T11:13:32.031 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:13:32.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.030+0000 7fb791fd9640 1 -- 172.21.15.26:0/889657213 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb7780664a0 msgr2=0x7fb778068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:32.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.030+0000 7fb791fd9640 1 --2- 172.21.15.26:0/889657213 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb7780664a0 0x7fb778068960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb77c0011f0 tx=0x7fb77c009040 comp rx=0 tx=0).stop 2023-10-14T11:13:32.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.030+0000 7fb791fd9640 1 -- 172.21.15.26:0/889657213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb78c0d0210 msgr2=0x7fb78c14cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:32.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.030+0000 7fb791fd9640 1 --2- 172.21.15.26:0/889657213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb78c0d0210 0x7fb78c14cd50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb780005890 tx=0x7fb78000c960 comp rx=0 tx=0).stop 2023-10-14T11:13:32.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.030+0000 7fb791fd9640 1 -- 172.21.15.26:0/889657213 shutdown_connections 2023-10-14T11:13:32.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.030+0000 7fb791fd9640 1 --2- 172.21.15.26:0/889657213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb78c15cba0 0x7fb78c0b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.030+0000 7fb791fd9640 1 --2- 172.21.15.26:0/889657213 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb7780664a0 0x7fb778068960 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.030+0000 7fb791fd9640 1 --2- 172.21.15.26:0/889657213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb78c0d0210 0x7fb78c14cd50 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.030+0000 7fb791fd9640 1 --2- 172.21.15.26:0/889657213 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb78c0b84e0 0x7fb78c0b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.030+0000 7fb791fd9640 1 -- 172.21.15.26:0/889657213 >> 172.21.15.26:0/889657213 conn(0x7fb78c0719c0 msgr2=0x7fb78c0729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:32.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.030+0000 7fb791fd9640 1 -- 172.21.15.26:0/889657213 shutdown_connections 2023-10-14T11:13:32.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.030+0000 7fb791fd9640 1 -- 172.21.15.26:0/889657213 wait complete. 2023-10-14T11:13:32.053 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T11:13:32.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.198+0000 7f2796dc5640 1 Processor -- start 2023-10-14T11:13:32.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.198+0000 7f2796dc5640 1 -- start start 2023-10-14T11:13:32.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.198+0000 7f2796dc5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f279015cba0 0x7f27900d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:32.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.198+0000 7f2796dc5640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27900d1670 con 0x7f27900d0210 2023-10-14T11:13:32.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.198+0000 7f2796dc5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27900d1950 con 0x7f27900b84e0 2023-10-14T11:13:32.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.198+0000 7f2796dc5640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27900d1460 con 0x7f279015cba0 2023-10-14T11:13:32.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.198+0000 7f2794b61640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f279015cba0 0x7f27900d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:32.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.198+0000 7f2795362640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f27900d0210 0x7f27900b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44654/0 (socket says 172.21.15.26:44654) 2023-10-14T11:13:32.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.198+0000 7f2795362640 1 -- 172.21.15.26:0/3477094176 learned_addr learned my addr 172.21.15.26:0/3477094176 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:32.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.198+0000 7f2794b61640 1 -- 172.21.15.26:0/3477094176 >> v1:172.21.15.110:6789/0 conn(0x7f27900b84e0 legacy=0x7f27900cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:32.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.198+0000 7f2794b61640 1 -- 172.21.15.26:0/3477094176 >> v1:172.21.15.26:6789/0 conn(0x7f27900d0210 legacy=0x7f27900b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:32.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.198+0000 7f2794b61640 1 -- 172.21.15.26:0/3477094176 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27900d1c30 con 0x7f279015cba0 2023-10-14T11:13:32.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.202+0000 7f2794b61640 1 --2- 172.21.15.26:0/3477094176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f279015cba0 0x7f27900d0f20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f27840097c0 tx=0x7f278401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19e91b2dc672811 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:32.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.202+0000 7f278f7fe640 1 -- 172.21.15.26:0/3477094176 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27840ac410 con 0x7f279015cba0 2023-10-14T11:13:32.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.202+0000 7f278f7fe640 1 -- 172.21.15.26:0/3477094176 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27840ac570 con 0x7f279015cba0 2023-10-14T11:13:32.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.202+0000 7f278f7fe640 1 -- 172.21.15.26:0/3477094176 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27840ac900 con 0x7f279015cba0 2023-10-14T11:13:32.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.202+0000 7f2796dc5640 1 -- 172.21.15.26:0/3477094176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f279015cba0 msgr2=0x7f27900d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:32.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.202+0000 7f2796dc5640 1 --2- 172.21.15.26:0/3477094176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f279015cba0 0x7f27900d0f20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f27840097c0 tx=0x7f278401c3b0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.202+0000 7f2796dc5640 1 -- 172.21.15.26:0/3477094176 shutdown_connections 2023-10-14T11:13:32.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.202+0000 7f2796dc5640 1 --2- 172.21.15.26:0/3477094176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f279015cba0 0x7f27900d0f20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.202+0000 7f2796dc5640 1 -- 172.21.15.26:0/3477094176 >> 172.21.15.26:0/3477094176 conn(0x7f27900719c0 msgr2=0x7f2790071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:32.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.202+0000 7f2796dc5640 1 -- 172.21.15.26:0/3477094176 shutdown_connections 2023-10-14T11:13:32.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.202+0000 7f2796dc5640 1 -- 172.21.15.26:0/3477094176 wait complete. 2023-10-14T11:13:32.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.202+0000 7f2796dc5640 1 Processor -- start 2023-10-14T11:13:32.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f2796dc5640 1 -- start start 2023-10-14T11:13:32.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f2796dc5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27900b84e0 0x7f279014bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:32.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f2796dc5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27900d0210 0x7f2790150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:32.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f2796dc5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f279015cba0 0x7f2790151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:32.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f2796dc5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2790156b00 con 0x7f27900b84e0 2023-10-14T11:13:32.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f2796dc5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279014c510 con 0x7f27900d0210 2023-10-14T11:13:32.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f2796dc5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27900c85d0 con 0x7f279015cba0 2023-10-14T11:13:32.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f2794b61640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27900b84e0 0x7f279014bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:32.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f2794b61640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27900b84e0 0x7f279014bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47830/0 (socket says 172.21.15.26:47830) 2023-10-14T11:13:32.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f2794b61640 1 -- 172.21.15.26:0/293200844 learned_addr learned my addr 172.21.15.26:0/293200844 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:32.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f2794b61640 1 -- 172.21.15.26:0/293200844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f279015cba0 msgr2=0x7f2790151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:32.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f2794b61640 1 --2- 172.21.15.26:0/293200844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f279015cba0 0x7f2790151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f2794b61640 1 -- 172.21.15.26:0/293200844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27900d0210 msgr2=0x7f2790150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:32.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f278ffff640 1 --2- 172.21.15.26:0/293200844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27900d0210 0x7f2790150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:32.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f2794b61640 1 --2- 172.21.15.26:0/293200844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27900d0210 0x7f2790150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f2794b61640 1 -- 172.21.15.26:0/293200844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2784009420 con 0x7f27900b84e0 2023-10-14T11:13:32.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f278ffff640 1 --2- 172.21.15.26:0/293200844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27900d0210 0x7f2790150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:32.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f2794b61640 1 --2- 172.21.15.26:0/293200844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27900b84e0 0x7f279014bfd0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f27840af040 tx=0x7f2784019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:32.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f278d7fa640 1 -- 172.21.15.26:0/293200844 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2784006e20 con 0x7f27900b84e0 2023-10-14T11:13:32.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f278d7fa640 1 -- 172.21.15.26:0/293200844 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27840b5620 con 0x7f27900b84e0 2023-10-14T11:13:32.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f2796dc5640 1 -- 172.21.15.26:0/293200844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27900c88b0 con 0x7f27900b84e0 2023-10-14T11:13:32.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f278d7fa640 1 -- 172.21.15.26:0/293200844 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27840b59f0 con 0x7f27900b84e0 2023-10-14T11:13:32.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f2796dc5640 1 -- 172.21.15.26:0/293200844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27900c8e70 con 0x7f27900b84e0 2023-10-14T11:13:32.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.206+0000 7f2796dc5640 1 -- 172.21.15.26:0/293200844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279004e170 con 0x7f27900b84e0 2023-10-14T11:13:32.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.210+0000 7f278d7fa640 1 -- 172.21.15.26:0/293200844 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f27840b3040 con 0x7f27900b84e0 2023-10-14T11:13:32.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.210+0000 7f278d7fa640 1 --2- 172.21.15.26:0/293200844 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27740664a0 0x7f2774068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:32.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.210+0000 7f278d7fa640 1 -- 172.21.15.26:0/293200844 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f278411e1e0 con 0x7f27900b84e0 2023-10-14T11:13:32.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.210+0000 7f278ffff640 1 --2- 172.21.15.26:0/293200844 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27740664a0 0x7f2774068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:32.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.210+0000 7f278ffff640 1 --2- 172.21.15.26:0/293200844 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27740664a0 0x7f2774068960 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f27900d3b50 tx=0x7f277c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:32.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.214+0000 7f278d7fa640 1 -- 172.21.15.26:0/293200844 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f27840eb170 con 0x7f27900b84e0 2023-10-14T11:13:32.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.370+0000 7f2796dc5640 1 -- 172.21.15.26:0/293200844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f27900d0f90 con 0x7f27900b84e0 2023-10-14T11:13:32.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.370+0000 7f278d7fa640 1 -- 172.21.15.26:0/293200844 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f27840b10a0 con 0x7f27900b84e0 2023-10-14T11:13:32.372 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:32.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.370+0000 7f2796dc5640 1 -- 172.21.15.26:0/293200844 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27740664a0 msgr2=0x7f2774068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:32.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.370+0000 7f2796dc5640 1 --2- 172.21.15.26:0/293200844 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27740664a0 0x7f2774068960 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f27900d3b50 tx=0x7f277c009040 comp rx=0 tx=0).stop 2023-10-14T11:13:32.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.370+0000 7f2796dc5640 1 -- 172.21.15.26:0/293200844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27900b84e0 msgr2=0x7f279014bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:32.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.370+0000 7f2796dc5640 1 --2- 172.21.15.26:0/293200844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27900b84e0 0x7f279014bfd0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f27840af040 tx=0x7f2784019150 comp rx=0 tx=0).stop 2023-10-14T11:13:32.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.370+0000 7f2796dc5640 1 -- 172.21.15.26:0/293200844 shutdown_connections 2023-10-14T11:13:32.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.370+0000 7f2796dc5640 1 --2- 172.21.15.26:0/293200844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f279015cba0 0x7f2790151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.370+0000 7f2796dc5640 1 --2- 172.21.15.26:0/293200844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27900d0210 0x7f2790150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.370+0000 7f2796dc5640 1 --2- 172.21.15.26:0/293200844 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27740664a0 0x7f2774068960 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.370+0000 7f2796dc5640 1 --2- 172.21.15.26:0/293200844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27900b84e0 0x7f279014bfd0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.370+0000 7f2796dc5640 1 -- 172.21.15.26:0/293200844 >> 172.21.15.26:0/293200844 conn(0x7f27900719c0 msgr2=0x7f2790071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:32.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.370+0000 7f2796dc5640 1 -- 172.21.15.26:0/293200844 shutdown_connections 2023-10-14T11:13:32.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.370+0000 7f2796dc5640 1 -- 172.21.15.26:0/293200844 wait complete. 2023-10-14T11:13:32.393 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:13:32.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.534+0000 7fe7990ad640 1 Processor -- start 2023-10-14T11:13:32.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.534+0000 7fe7990ad640 1 -- start start 2023-10-14T11:13:32.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.534+0000 7fe7990ad640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe79415c980 0x7fe79406af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:32.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.534+0000 7fe7990ad640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7940d3510 con 0x7fe79415cd60 2023-10-14T11:13:32.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.534+0000 7fe7990ad640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7940d2f50 con 0x7fe7940d1490 2023-10-14T11:13:32.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.534+0000 7fe7990ad640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7940cd2b0 con 0x7fe79415c980 2023-10-14T11:13:32.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.538+0000 7fe7937fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe79415cd60 0x7fe7940d0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35648/0 (socket says 172.21.15.26:35648) 2023-10-14T11:13:32.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.538+0000 7fe7937fe640 1 -- 172.21.15.26:0/1722483788 learned_addr learned my addr 172.21.15.26:0/1722483788 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:32.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.538+0000 7fe793fff640 1 --2- 172.21.15.26:0/1722483788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe79415c980 0x7fe79406af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:32.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.538+0000 7fe792ffd640 1 -- 172.21.15.26:0/1722483788 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842311243 0 0) 0x7fe788001120 con 0x7fe79415cd60 2023-10-14T11:13:32.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.538+0000 7fe792ffd640 1 -- 172.21.15.26:0/1722483788 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe77c003530 con 0x7fe79415cd60 2023-10-14T11:13:32.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.538+0000 7fe792ffd640 1 -- 172.21.15.26:0/1722483788 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2575255135 0 0) 0x7fe7940d2f50 con 0x7fe7940d1490 2023-10-14T11:13:32.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.538+0000 7fe792ffd640 1 -- 172.21.15.26:0/1722483788 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe788001120 con 0x7fe7940d1490 2023-10-14T11:13:32.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.538+0000 7fe793fff640 1 -- 172.21.15.26:0/1722483788 >> v1:172.21.15.110:6789/0 conn(0x7fe7940d1490 legacy=0x7fe7940cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:32.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.538+0000 7fe793fff640 1 -- 172.21.15.26:0/1722483788 >> v1:172.21.15.26:6789/0 conn(0x7fe79415cd60 legacy=0x7fe7940d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:32.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.538+0000 7fe793fff640 1 -- 172.21.15.26:0/1722483788 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7940d3230 con 0x7fe79415c980 2023-10-14T11:13:32.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.538+0000 7fe793fff640 1 --2- 172.21.15.26:0/1722483788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe79415c980 0x7fe79406af90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe784009800 tx=0x7fe78401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=310d1ef5e4a38ab9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:32.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.542+0000 7fe792ffd640 1 -- 172.21.15.26:0/1722483788 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7840a6040 con 0x7fe79415c980 2023-10-14T11:13:32.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.542+0000 7fe792ffd640 1 -- 172.21.15.26:0/1722483788 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7840aa600 con 0x7fe79415c980 2023-10-14T11:13:32.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.542+0000 7fe792ffd640 1 -- 172.21.15.26:0/1722483788 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7840aa990 con 0x7fe79415c980 2023-10-14T11:13:32.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.542+0000 7fe7990ad640 1 -- 172.21.15.26:0/1722483788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe79415c980 msgr2=0x7fe79406af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:32.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.542+0000 7fe7990ad640 1 --2- 172.21.15.26:0/1722483788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe79415c980 0x7fe79406af90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe784009800 tx=0x7fe78401c480 comp rx=0 tx=0).stop 2023-10-14T11:13:32.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.542+0000 7fe7990ad640 1 -- 172.21.15.26:0/1722483788 shutdown_connections 2023-10-14T11:13:32.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.542+0000 7fe7990ad640 1 --2- 172.21.15.26:0/1722483788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe79415c980 0x7fe79406af90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.542+0000 7fe7990ad640 1 -- 172.21.15.26:0/1722483788 >> 172.21.15.26:0/1722483788 conn(0x7fe79409ba80 msgr2=0x7fe7940d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.542+0000 7fe7990ad640 1 -- 172.21.15.26:0/1722483788 shutdown_connections 2023-10-14T11:13:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.542+0000 7fe7990ad640 1 -- 172.21.15.26:0/1722483788 wait complete. 2023-10-14T11:13:32.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.542+0000 7fe7990ad640 1 Processor -- start 2023-10-14T11:13:32.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.542+0000 7fe7990ad640 1 -- start start 2023-10-14T11:13:32.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.542+0000 7fe7990ad640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7940d1490 0x7fe79415a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:32.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.542+0000 7fe7990ad640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe79415c980 0x7fe7941579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:32.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.542+0000 7fe7990ad640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe79415cd60 0x7fe7940b7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:32.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.542+0000 7fe7990ad640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79415a1e0 con 0x7fe7940d1490 2023-10-14T11:13:32.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.542+0000 7fe7990ad640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7940b4710 con 0x7fe79415cd60 2023-10-14T11:13:32.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.542+0000 7fe7990ad640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe794159280 con 0x7fe79415c980 2023-10-14T11:13:32.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.542+0000 7fe793fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7940d1490 0x7fe79415a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:32.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.542+0000 7fe793fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7940d1490 0x7fe79415a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57838/0 (socket says 172.21.15.26:57838) 2023-10-14T11:13:32.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.542+0000 7fe793fff640 1 -- 172.21.15.26:0/206696733 learned_addr learned my addr 172.21.15.26:0/206696733 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:32.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.546+0000 7fe7937fe640 1 --2- 172.21.15.26:0/206696733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe79415c980 0x7fe7941579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:32.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.546+0000 7fe7988ac640 1 --2- 172.21.15.26:0/206696733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe79415cd60 0x7fe7940b7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:32.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.546+0000 7fe793fff640 1 -- 172.21.15.26:0/206696733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe79415c980 msgr2=0x7fe7941579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:32.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.546+0000 7fe793fff640 1 --2- 172.21.15.26:0/206696733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe79415c980 0x7fe7941579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.546+0000 7fe793fff640 1 -- 172.21.15.26:0/206696733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe79415cd60 msgr2=0x7fe7940b7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:32.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.546+0000 7fe793fff640 1 --2- 172.21.15.26:0/206696733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe79415cd60 0x7fe7940b7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.546+0000 7fe793fff640 1 -- 172.21.15.26:0/206696733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7840093b0 con 0x7fe7940d1490 2023-10-14T11:13:32.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.546+0000 7fe7988ac640 1 --2- 172.21.15.26:0/206696733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe79415cd60 0x7fe7940b7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:32.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.546+0000 7fe793fff640 1 --2- 172.21.15.26:0/206696733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7940d1490 0x7fe79415a600 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe784019090 tx=0x7fe78401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:32.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.546+0000 7fe790ff9640 1 -- 172.21.15.26:0/206696733 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe784006dc0 con 0x7fe7940d1490 2023-10-14T11:13:32.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.546+0000 7fe790ff9640 1 -- 172.21.15.26:0/206696733 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe784005bb0 con 0x7fe7940d1490 2023-10-14T11:13:32.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.546+0000 7fe790ff9640 1 -- 172.21.15.26:0/206696733 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe784006030 con 0x7fe7940d1490 2023-10-14T11:13:32.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.546+0000 7fe7990ad640 1 -- 172.21.15.26:0/206696733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe794159560 con 0x7fe7940d1490 2023-10-14T11:13:32.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.546+0000 7fe7990ad640 1 -- 172.21.15.26:0/206696733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe794159b20 con 0x7fe7940d1490 2023-10-14T11:13:32.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.546+0000 7fe7990ad640 1 -- 172.21.15.26:0/206696733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79415ab40 con 0x7fe7940d1490 2023-10-14T11:13:32.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.546+0000 7fe790ff9640 1 -- 172.21.15.26:0/206696733 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe784006190 con 0x7fe7940d1490 2023-10-14T11:13:32.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.550+0000 7fe790ff9640 1 --2- 172.21.15.26:0/206696733 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe7800664a0 0x7fe780068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:32.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.550+0000 7fe790ff9640 1 -- 172.21.15.26:0/206696733 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe78411e9e0 con 0x7fe7940d1490 2023-10-14T11:13:32.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.550+0000 7fe7937fe640 1 --2- 172.21.15.26:0/206696733 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe7800664a0 0x7fe780068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:32.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.550+0000 7fe7937fe640 1 --2- 172.21.15.26:0/206696733 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe7800664a0 0x7fe780068960 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe7940c91e0 tx=0x7fe788007d80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:32.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.554+0000 7fe790ff9640 1 -- 172.21.15.26:0/206696733 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe7840eba20 con 0x7fe7940d1490 2023-10-14T11:13:32.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.726+0000 7fe7990ad640 1 -- 172.21.15.26:0/206696733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe79415a450 con 0x7fe7940d1490 2023-10-14T11:13:32.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.726+0000 7fe790ff9640 1 -- 172.21.15.26:0/206696733 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe7840c2070 con 0x7fe7940d1490 2023-10-14T11:13:32.730 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-10-14T11:13:32.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.730+0000 7fe7990ad640 1 -- 172.21.15.26:0/206696733 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe7800664a0 msgr2=0x7fe780068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:32.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.730+0000 7fe7990ad640 1 --2- 172.21.15.26:0/206696733 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe7800664a0 0x7fe780068960 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe7940c91e0 tx=0x7fe788007d80 comp rx=0 tx=0).stop 2023-10-14T11:13:32.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.730+0000 7fe7990ad640 1 -- 172.21.15.26:0/206696733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7940d1490 msgr2=0x7fe79415a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:32.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.730+0000 7fe7990ad640 1 --2- 172.21.15.26:0/206696733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7940d1490 0x7fe79415a600 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe784019090 tx=0x7fe78401acc0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.730+0000 7fe7990ad640 1 -- 172.21.15.26:0/206696733 shutdown_connections 2023-10-14T11:13:32.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.730+0000 7fe7990ad640 1 --2- 172.21.15.26:0/206696733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe79415cd60 0x7fe7940b7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.730+0000 7fe7990ad640 1 --2- 172.21.15.26:0/206696733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe79415c980 0x7fe7941579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.730+0000 7fe7990ad640 1 --2- 172.21.15.26:0/206696733 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe7800664a0 0x7fe780068960 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.730+0000 7fe7990ad640 1 --2- 172.21.15.26:0/206696733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7940d1490 0x7fe79415a600 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.730+0000 7fe7990ad640 1 -- 172.21.15.26:0/206696733 >> 172.21.15.26:0/206696733 conn(0x7fe79409ba80 msgr2=0x7fe79406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:32.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.730+0000 7fe7990ad640 1 -- 172.21.15.26:0/206696733 shutdown_connections 2023-10-14T11:13:32.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.730+0000 7fe7990ad640 1 -- 172.21.15.26:0/206696733 wait complete. 2023-10-14T11:13:32.751 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:13:32.752 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:13:32.763 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:13:32.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.902+0000 7fd1ab1d9640 1 Processor -- start 2023-10-14T11:13:32.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.902+0000 7fd1ab1d9640 1 -- start start 2023-10-14T11:13:32.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.906+0000 7fd1ab1d9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd1a41597c0 0x7fd1a40ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:32.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.906+0000 7fd1ab1d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1a4159ba0 0x7fd1a40cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:32.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.906+0000 7fd1ab1d9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd1a40adc10 0x7fd1a40cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:32.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.906+0000 7fd1ab1d9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a40723d0 con 0x7fd1a41597c0 2023-10-14T11:13:32.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.906+0000 7fd1ab1d9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a40717c0 con 0x7fd1a40adc10 2023-10-14T11:13:32.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.906+0000 7fd1ab1d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a4071aa0 con 0x7fd1a4159ba0 2023-10-14T11:13:32.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.906+0000 7fd1a8f75640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd1a41597c0 0x7fd1a40ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:32.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.906+0000 7fd1a8f75640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd1a41597c0 0x7fd1a40ad6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57852/0 (socket says 172.21.15.26:57852) 2023-10-14T11:13:32.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.906+0000 7fd1a8f75640 1 -- 172.21.15.26:0/3879932202 learned_addr learned my addr 172.21.15.26:0/3879932202 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:32.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.906+0000 7fd1a3fff640 1 --2- 172.21.15.26:0/3879932202 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1a4159ba0 0x7fd1a40cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:32.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.906+0000 7fd1a8f75640 1 -- 172.21.15.26:0/3879932202 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1a4159ba0 msgr2=0x7fd1a40cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:32.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.906+0000 7fd1a9776640 1 --2- 172.21.15.26:0/3879932202 >> v2:172.21.15.110:3300/0 conn(0x7fd1a40adc10 0x7fd1a40cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:32.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.906+0000 7fd1a8f75640 1 --2- 172.21.15.26:0/3879932202 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1a4159ba0 0x7fd1a40cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.906+0000 7fd1a8f75640 1 -- 172.21.15.26:0/3879932202 >> v2:172.21.15.110:3300/0 conn(0x7fd1a40adc10 msgr2=0x7fd1a40cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:32.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.906+0000 7fd1a8f75640 1 --2- 172.21.15.26:0/3879932202 >> v2:172.21.15.110:3300/0 conn(0x7fd1a40adc10 0x7fd1a40cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.906+0000 7fd1a8f75640 1 -- 172.21.15.26:0/3879932202 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a4071d80 con 0x7fd1a41597c0 2023-10-14T11:13:32.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.906+0000 7fd1a9776640 1 --2- 172.21.15.26:0/3879932202 >> v2:172.21.15.110:3300/0 conn(0x7fd1a40adc10 0x7fd1a40cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:32.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.906+0000 7fd1a3fff640 1 --2- 172.21.15.26:0/3879932202 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1a4159ba0 0x7fd1a40cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:32.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.910+0000 7fd1a8f75640 1 --2- 172.21.15.26:0/3879932202 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1a41597c0 0x7fd1a40ad6d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd1a406e330 tx=0x7fd19801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5a210850f64b49 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:32.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.910+0000 7fd1a37fe640 1 -- 172.21.15.26:0/3879932202 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1980a7070 con 0x7fd1a41597c0 2023-10-14T11:13:32.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.910+0000 7fd1a37fe640 1 -- 172.21.15.26:0/3879932202 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1980ab430 con 0x7fd1a41597c0 2023-10-14T11:13:32.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.910+0000 7fd1a37fe640 1 -- 172.21.15.26:0/3879932202 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1980ab7c0 con 0x7fd1a41597c0 2023-10-14T11:13:32.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.910+0000 7fd1ab1d9640 1 -- 172.21.15.26:0/3879932202 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1a41597c0 msgr2=0x7fd1a40ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:32.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.910+0000 7fd1ab1d9640 1 --2- 172.21.15.26:0/3879932202 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1a41597c0 0x7fd1a40ad6d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd1a406e330 tx=0x7fd19801c4d0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.910+0000 7fd1ab1d9640 1 -- 172.21.15.26:0/3879932202 shutdown_connections 2023-10-14T11:13:32.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.910+0000 7fd1ab1d9640 1 --2- 172.21.15.26:0/3879932202 >> v2:172.21.15.110:3300/0 conn(0x7fd1a40adc10 0x7fd1a40cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.910+0000 7fd1ab1d9640 1 --2- 172.21.15.26:0/3879932202 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1a4159ba0 0x7fd1a40cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.910+0000 7fd1ab1d9640 1 --2- 172.21.15.26:0/3879932202 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1a41597c0 0x7fd1a40ad6d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.910+0000 7fd1ab1d9640 1 -- 172.21.15.26:0/3879932202 >> 172.21.15.26:0/3879932202 conn(0x7fd1a406c190 msgr2=0x7fd1a406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:32.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.910+0000 7fd1ab1d9640 1 -- 172.21.15.26:0/3879932202 shutdown_connections 2023-10-14T11:13:32.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.910+0000 7fd1ab1d9640 1 -- 172.21.15.26:0/3879932202 wait complete. 2023-10-14T11:13:32.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1ab1d9640 1 Processor -- start 2023-10-14T11:13:32.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1ab1d9640 1 -- start start 2023-10-14T11:13:32.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1ab1d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a40adc10 0x7fd1a41f9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:32.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1ab1d9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1a41597c0 0x7fd1a4154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:32.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1ab1d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1a4159ba0 0x7fd1a414ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:32.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1ab1d9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a4157860 con 0x7fd1a41597c0 2023-10-14T11:13:32.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1ab1d9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a4155300 con 0x7fd1a40adc10 2023-10-14T11:13:32.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1ab1d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a4155b80 con 0x7fd1a4159ba0 2023-10-14T11:13:32.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1a3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1a41597c0 0x7fd1a4154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:32.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1a3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1a41597c0 0x7fd1a4154dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57858/0 (socket says 172.21.15.26:57858) 2023-10-14T11:13:32.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1a3fff640 1 -- 172.21.15.26:0/687793439 learned_addr learned my addr 172.21.15.26:0/687793439 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:32.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1a9776640 1 --2- 172.21.15.26:0/687793439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1a4159ba0 0x7fd1a414ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:32.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1a8f75640 1 --2- 172.21.15.26:0/687793439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a40adc10 0x7fd1a41f9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:32.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1a3fff640 1 -- 172.21.15.26:0/687793439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1a4159ba0 msgr2=0x7fd1a414ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:32.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1a3fff640 1 --2- 172.21.15.26:0/687793439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1a4159ba0 0x7fd1a414ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1a3fff640 1 -- 172.21.15.26:0/687793439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a40adc10 msgr2=0x7fd1a41f9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:32.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1a3fff640 1 --2- 172.21.15.26:0/687793439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a40adc10 0x7fd1a41f9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:32.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1a3fff640 1 -- 172.21.15.26:0/687793439 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1980094d0 con 0x7fd1a41597c0 2023-10-14T11:13:32.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1a3fff640 1 --2- 172.21.15.26:0/687793439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1a41597c0 0x7fd1a4154dc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd19000c7f0 tx=0x7fd19000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:32.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1a17fa640 1 -- 172.21.15.26:0/687793439 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd190007820 con 0x7fd1a41597c0 2023-10-14T11:13:32.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1a17fa640 1 -- 172.21.15.26:0/687793439 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd190007980 con 0x7fd1a41597c0 2023-10-14T11:13:32.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1a17fa640 1 -- 172.21.15.26:0/687793439 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd190007d30 con 0x7fd1a41597c0 2023-10-14T11:13:32.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1ab1d9640 1 -- 172.21.15.26:0/687793439 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a4157b00 con 0x7fd1a41597c0 2023-10-14T11:13:32.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1ab1d9640 1 -- 172.21.15.26:0/687793439 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a414b080 con 0x7fd1a41597c0 2023-10-14T11:13:32.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.914+0000 7fd1ab1d9640 1 -- 172.21.15.26:0/687793439 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a4074010 con 0x7fd1a41597c0 2023-10-14T11:13:32.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.918+0000 7fd1a17fa640 1 -- 172.21.15.26:0/687793439 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd1900113f0 con 0x7fd1a41597c0 2023-10-14T11:13:32.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.918+0000 7fd1a17fa640 1 --2- 172.21.15.26:0/687793439 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd1880664a0 0x7fd188068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:32.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.918+0000 7fd1a17fa640 1 -- 172.21.15.26:0/687793439 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd190084470 con 0x7fd1a41597c0 2023-10-14T11:13:32.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.918+0000 7fd1a8f75640 1 --2- 172.21.15.26:0/687793439 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd1880664a0 0x7fd188068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:32.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.918+0000 7fd1a8f75640 1 --2- 172.21.15.26:0/687793439 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd1880664a0 0x7fd188068960 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd1980af000 tx=0x7fd198008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:32.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:32.922+0000 7fd1a17fa640 1 -- 172.21.15.26:0/687793439 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd1900515a0 con 0x7fd1a41597c0 2023-10-14T11:13:33.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.082+0000 7fd1ab1d9640 1 -- 172.21.15.26:0/687793439 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1a40cd3f0 con 0x7fd1a41597c0 2023-10-14T11:13:33.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.082+0000 7fd1a17fa640 1 -- 172.21.15.26:0/687793439 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18679 (secure 0 0 0) 0x7fd190054bc0 con 0x7fd1a41597c0 2023-10-14T11:13:33.084 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:33.085 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":27,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:13:03.866737+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:13:33.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.082+0000 7fd1ab1d9640 1 -- 172.21.15.26:0/687793439 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd1880664a0 msgr2=0x7fd188068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:33.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.082+0000 7fd1ab1d9640 1 --2- 172.21.15.26:0/687793439 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd1880664a0 0x7fd188068960 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd1980af000 tx=0x7fd198008040 comp rx=0 tx=0).stop 2023-10-14T11:13:33.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.082+0000 7fd1ab1d9640 1 -- 172.21.15.26:0/687793439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1a41597c0 msgr2=0x7fd1a4154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:33.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.082+0000 7fd1ab1d9640 1 --2- 172.21.15.26:0/687793439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1a41597c0 0x7fd1a4154dc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd19000c7f0 tx=0x7fd19000ccb0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.086+0000 7fd1ab1d9640 1 -- 172.21.15.26:0/687793439 shutdown_connections 2023-10-14T11:13:33.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.086+0000 7fd1ab1d9640 1 --2- 172.21.15.26:0/687793439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1a4159ba0 0x7fd1a414ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.086+0000 7fd1ab1d9640 1 --2- 172.21.15.26:0/687793439 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd1880664a0 0x7fd188068960 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.086+0000 7fd1ab1d9640 1 --2- 172.21.15.26:0/687793439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1a41597c0 0x7fd1a4154dc0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.086+0000 7fd1ab1d9640 1 --2- 172.21.15.26:0/687793439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a40adc10 0x7fd1a41f9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.086+0000 7fd1ab1d9640 1 -- 172.21.15.26:0/687793439 >> 172.21.15.26:0/687793439 conn(0x7fd1a406c190 msgr2=0x7fd1a414fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:33.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.086+0000 7fd1ab1d9640 1 -- 172.21.15.26:0/687793439 shutdown_connections 2023-10-14T11:13:33.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.086+0000 7fd1ab1d9640 1 -- 172.21.15.26:0/687793439 wait complete. 2023-10-14T11:13:33.106 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:12:20.179562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:12:21.346111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T11:12:25.025159+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T11:13:33.107 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:13:33.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.250+0000 7f764de54640 1 Processor -- start 2023-10-14T11:13:33.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.250+0000 7f764de54640 1 -- start start 2023-10-14T11:13:33.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.250+0000 7f764de54640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7648069e90 0x7f764806d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:33.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.250+0000 7f764de54640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f76480c26b0 0x7f76480c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:33.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.250+0000 7f764de54640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764815ae30 con 0x7f764806a270 2023-10-14T11:13:33.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.250+0000 7f764de54640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76480cb090 con 0x7f76480c26b0 2023-10-14T11:13:33.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.250+0000 7f764de54640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76480ca510 con 0x7f7648069e90 2023-10-14T11:13:33.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.250+0000 7f7647fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f76480c26b0 0x7f76480c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:33.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.250+0000 7f7647fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f76480c26b0 0x7f76480c2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57868/0 (socket says 172.21.15.26:57868) 2023-10-14T11:13:33.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.250+0000 7f7647fff640 1 -- 172.21.15.26:0/2077318270 learned_addr learned my addr 172.21.15.26:0/2077318270 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:33.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.250+0000 7f76477fe640 1 --2- 172.21.15.26:0/2077318270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7648069e90 0x7f764806d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:33.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.254+0000 7f7647fff640 1 -- 172.21.15.26:0/2077318270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7648069e90 msgr2=0x7f764806d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:33.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.254+0000 7f7647fff640 1 --2- 172.21.15.26:0/2077318270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7648069e90 0x7f764806d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.254+0000 7f7647fff640 1 -- 172.21.15.26:0/2077318270 >> v1:172.21.15.110:6789/0 conn(0x7f764806a270 legacy=0x7f76480c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:33.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.254+0000 7f7647fff640 1 -- 172.21.15.26:0/2077318270 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76480ca7f0 con 0x7f76480c26b0 2023-10-14T11:13:33.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.254+0000 7f7647fff640 1 --2- 172.21.15.26:0/2077318270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76480c26b0 0x7f76480c2b40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7640009e50 tx=0x7f764001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3723574285defc94 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:33.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.254+0000 7f76467fc640 1 -- 172.21.15.26:0/2077318270 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76400a58a0 con 0x7f76480c26b0 2023-10-14T11:13:33.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.254+0000 7f76467fc640 1 -- 172.21.15.26:0/2077318270 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76400a5a00 con 0x7f76480c26b0 2023-10-14T11:13:33.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.254+0000 7f76467fc640 1 -- 172.21.15.26:0/2077318270 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76400a5d90 con 0x7f76480c26b0 2023-10-14T11:13:33.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.254+0000 7f764de54640 1 -- 172.21.15.26:0/2077318270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76480c26b0 msgr2=0x7f76480c2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:33.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.254+0000 7f764de54640 1 --2- 172.21.15.26:0/2077318270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76480c26b0 0x7f76480c2b40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7640009e50 tx=0x7f764001c9e0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.254+0000 7f764de54640 1 -- 172.21.15.26:0/2077318270 shutdown_connections 2023-10-14T11:13:33.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.254+0000 7f764de54640 1 --2- 172.21.15.26:0/2077318270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76480c26b0 0x7f76480c2b40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.254+0000 7f764de54640 1 --2- 172.21.15.26:0/2077318270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7648069e90 0x7f764806d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.254+0000 7f764de54640 1 -- 172.21.15.26:0/2077318270 >> 172.21.15.26:0/2077318270 conn(0x7f76480b0da0 msgr2=0x7f76480ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:33.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.258+0000 7f764de54640 1 -- 172.21.15.26:0/2077318270 shutdown_connections 2023-10-14T11:13:33.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.258+0000 7f764de54640 1 -- 172.21.15.26:0/2077318270 wait complete. 2023-10-14T11:13:33.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.258+0000 7f764de54640 1 Processor -- start 2023-10-14T11:13:33.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.258+0000 7f764de54640 1 -- start start 2023-10-14T11:13:33.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.258+0000 7f764de54640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7648069e90 0x7f764814c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:33.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.258+0000 7f764de54640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f764806a270 0x7f7648157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:33.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.258+0000 7f764de54640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76480c26b0 0x7f76481546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:33.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.258+0000 7f764de54640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764815bbb0 con 0x7f764806a270 2023-10-14T11:13:33.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.258+0000 7f764de54640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764815dd40 con 0x7f76480c26b0 2023-10-14T11:13:33.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.258+0000 7f764de54640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7648156ca0 con 0x7f7648069e90 2023-10-14T11:13:33.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.258+0000 7f7646ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f764806a270 0x7f7648157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:33.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.258+0000 7f7646ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f764806a270 0x7f7648157a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57874/0 (socket says 172.21.15.26:57874) 2023-10-14T11:13:33.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.258+0000 7f7646ffd640 1 -- 172.21.15.26:0/367965090 learned_addr learned my addr 172.21.15.26:0/367965090 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:33.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.258+0000 7f76477fe640 1 --2- 172.21.15.26:0/367965090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7648069e90 0x7f764814c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:33.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.258+0000 7f7647fff640 1 --2- 172.21.15.26:0/367965090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76480c26b0 0x7f76481546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:33.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.258+0000 7f7646ffd640 1 -- 172.21.15.26:0/367965090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7648069e90 msgr2=0x7f764814c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:33.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.258+0000 7f7646ffd640 1 --2- 172.21.15.26:0/367965090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7648069e90 0x7f764814c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.258+0000 7f7646ffd640 1 -- 172.21.15.26:0/367965090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76480c26b0 msgr2=0x7f76481546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:33.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.258+0000 7f7646ffd640 1 --2- 172.21.15.26:0/367965090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76480c26b0 0x7f76481546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.258+0000 7f7646ffd640 1 -- 172.21.15.26:0/367965090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7640009b30 con 0x7f764806a270 2023-10-14T11:13:33.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.258+0000 7f7646ffd640 1 --2- 172.21.15.26:0/367965090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f764806a270 0x7f7648157a60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f763c00c500 tx=0x7f763c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:33.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.258+0000 7f762ffff640 1 -- 172.21.15.26:0/367965090 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c005220 con 0x7f764806a270 2023-10-14T11:13:33.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.262+0000 7f762ffff640 1 -- 172.21.15.26:0/367965090 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c005380 con 0x7f764806a270 2023-10-14T11:13:33.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.262+0000 7f762ffff640 1 -- 172.21.15.26:0/367965090 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c007270 con 0x7f764806a270 2023-10-14T11:13:33.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.262+0000 7f764de54640 1 -- 172.21.15.26:0/367965090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7648156f80 con 0x7f764806a270 2023-10-14T11:13:33.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.262+0000 7f764de54640 1 -- 172.21.15.26:0/367965090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7648157540 con 0x7f764806a270 2023-10-14T11:13:33.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.262+0000 7f764de54640 1 -- 172.21.15.26:0/367965090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7648157760 con 0x7f764806a270 2023-10-14T11:13:33.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.262+0000 7f762ffff640 1 -- 172.21.15.26:0/367965090 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f763c0073d0 con 0x7f764806a270 2023-10-14T11:13:33.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.262+0000 7f762ffff640 1 --2- 172.21.15.26:0/367965090 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f76340664a0 0x7f7634068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:33.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.262+0000 7f762ffff640 1 -- 172.21.15.26:0/367965090 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f763c083a90 con 0x7f764806a270 2023-10-14T11:13:33.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.262+0000 7f76477fe640 1 --2- 172.21.15.26:0/367965090 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f76340664a0 0x7f7634068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:33.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.266+0000 7f76477fe640 1 --2- 172.21.15.26:0/367965090 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f76340664a0 0x7f7634068960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7638007a60 tx=0x7f7638008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:33.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.266+0000 7f762ffff640 1 -- 172.21.15.26:0/367965090 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f763c050b70 con 0x7f764806a270 2023-10-14T11:13:33.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.422+0000 7f764de54640 1 -- 172.21.15.26:0/367965090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f764804e170 con 0x7f764806a270 2023-10-14T11:13:33.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.426+0000 7f762ffff640 1 -- 172.21.15.26:0/367965090 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f763c054190 con 0x7f764806a270 2023-10-14T11:13:33.427 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:13:33.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.426+0000 7f764de54640 1 -- 172.21.15.26:0/367965090 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f76340664a0 msgr2=0x7f7634068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:33.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.426+0000 7f764de54640 1 --2- 172.21.15.26:0/367965090 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f76340664a0 0x7f7634068960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7638007a60 tx=0x7f7638008040 comp rx=0 tx=0).stop 2023-10-14T11:13:33.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.426+0000 7f764de54640 1 -- 172.21.15.26:0/367965090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f764806a270 msgr2=0x7f7648157a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:33.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.426+0000 7f764de54640 1 --2- 172.21.15.26:0/367965090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f764806a270 0x7f7648157a60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f763c00c500 tx=0x7f763c00c9c0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.426+0000 7f764de54640 1 -- 172.21.15.26:0/367965090 shutdown_connections 2023-10-14T11:13:33.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.426+0000 7f764de54640 1 --2- 172.21.15.26:0/367965090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76480c26b0 0x7f76481546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.426+0000 7f764de54640 1 --2- 172.21.15.26:0/367965090 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f76340664a0 0x7f7634068960 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.426+0000 7f764de54640 1 --2- 172.21.15.26:0/367965090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f764806a270 0x7f7648157a60 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.426+0000 7f764de54640 1 --2- 172.21.15.26:0/367965090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7648069e90 0x7f764814c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.426+0000 7f764de54640 1 -- 172.21.15.26:0/367965090 >> 172.21.15.26:0/367965090 conn(0x7f76480b0da0 msgr2=0x7f76480ae9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:33.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.426+0000 7f764de54640 1 -- 172.21.15.26:0/367965090 shutdown_connections 2023-10-14T11:13:33.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.426+0000 7f764de54640 1 -- 172.21.15.26:0/367965090 wait complete. 2023-10-14T11:13:33.448 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:13:33.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.594+0000 7f3ef8cea640 1 Processor -- start 2023-10-14T11:13:33.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.594+0000 7f3ef8cea640 1 -- start start 2023-10-14T11:13:33.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.594+0000 7f3ef8cea640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3ef415cba0 0x7f3ef40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:33.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.594+0000 7f3ef8cea640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef40b84e0 0x7f3ef40cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:33.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.594+0000 7f3ef8cea640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ef40d0040 0x7f3ef40d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:33.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.594+0000 7f3ef8cea640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef40d1460 con 0x7f3ef40d0040 2023-10-14T11:13:33.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.594+0000 7f3ef8cea640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef40d04b0 con 0x7f3ef415cba0 2023-10-14T11:13:33.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.594+0000 7f3ef8cea640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef40d1670 con 0x7f3ef40b84e0 2023-10-14T11:13:33.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.594+0000 7f3ef2d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ef40d0040 0x7f3ef40d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:33.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.594+0000 7f3ef2d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ef40d0040 0x7f3ef40d2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57888/0 (socket says 172.21.15.26:57888) 2023-10-14T11:13:33.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.594+0000 7f3ef2d9d640 1 -- 172.21.15.26:0/3329308475 learned_addr learned my addr 172.21.15.26:0/3329308475 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:33.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.594+0000 7f3eebfff640 1 --2- 172.21.15.26:0/3329308475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef40b84e0 0x7f3ef40cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:33.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.594+0000 7f3ef259c640 1 --2- 172.21.15.26:0/3329308475 >> v2:172.21.15.110:3300/0 conn(0x7f3ef415cba0 0x7f3ef40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:33.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.594+0000 7f3ef2d9d640 1 -- 172.21.15.26:0/3329308475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef40b84e0 msgr2=0x7f3ef40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:33.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.594+0000 7f3ef2d9d640 1 --2- 172.21.15.26:0/3329308475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef40b84e0 0x7f3ef40cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.594+0000 7f3ef2d9d640 1 -- 172.21.15.26:0/3329308475 >> v2:172.21.15.110:3300/0 conn(0x7f3ef415cba0 msgr2=0x7f3ef40d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:33.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.594+0000 7f3ef2d9d640 1 --2- 172.21.15.26:0/3329308475 >> v2:172.21.15.110:3300/0 conn(0x7f3ef415cba0 0x7f3ef40d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.594+0000 7f3ef2d9d640 1 -- 172.21.15.26:0/3329308475 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef40d1950 con 0x7f3ef40d0040 2023-10-14T11:13:33.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.594+0000 7f3ef259c640 1 --2- 172.21.15.26:0/3329308475 >> v2:172.21.15.110:3300/0 conn(0x7f3ef415cba0 0x7f3ef40d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:33.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.598+0000 7f3ef2d9d640 1 --2- 172.21.15.26:0/3329308475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ef40d0040 0x7f3ef40d2ae0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40b4890 tx=0x7f3eec01c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b4dd811fa4e6e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:33.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.598+0000 7f3ef1d9b640 1 -- 172.21.15.26:0/3329308475 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec0a5590 con 0x7f3ef40d0040 2023-10-14T11:13:33.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.598+0000 7f3ef1d9b640 1 -- 172.21.15.26:0/3329308475 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec0a56f0 con 0x7f3ef40d0040 2023-10-14T11:13:33.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.598+0000 7f3ef1d9b640 1 -- 172.21.15.26:0/3329308475 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec0a5a80 con 0x7f3ef40d0040 2023-10-14T11:13:33.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.598+0000 7f3ef8cea640 1 -- 172.21.15.26:0/3329308475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ef40d0040 msgr2=0x7f3ef40d2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:33.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.598+0000 7f3ef8cea640 1 --2- 172.21.15.26:0/3329308475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ef40d0040 0x7f3ef40d2ae0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40b4890 tx=0x7f3eec01c710 comp rx=0 tx=0).stop 2023-10-14T11:13:33.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.598+0000 7f3ef8cea640 1 -- 172.21.15.26:0/3329308475 shutdown_connections 2023-10-14T11:13:33.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.598+0000 7f3ef8cea640 1 --2- 172.21.15.26:0/3329308475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ef40d0040 0x7f3ef40d2ae0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.598+0000 7f3ef8cea640 1 --2- 172.21.15.26:0/3329308475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef40b84e0 0x7f3ef40cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.598+0000 7f3ef8cea640 1 --2- 172.21.15.26:0/3329308475 >> v2:172.21.15.110:3300/0 conn(0x7f3ef415cba0 0x7f3ef40d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.598+0000 7f3ef8cea640 1 -- 172.21.15.26:0/3329308475 >> 172.21.15.26:0/3329308475 conn(0x7f3ef40719c0 msgr2=0x7f3ef4071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:33.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.598+0000 7f3ef8cea640 1 -- 172.21.15.26:0/3329308475 shutdown_connections 2023-10-14T11:13:33.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.598+0000 7f3ef8cea640 1 -- 172.21.15.26:0/3329308475 wait complete. 2023-10-14T11:13:33.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3ef8cea640 1 Processor -- start 2023-10-14T11:13:33.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3ef8cea640 1 -- start start 2023-10-14T11:13:33.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3ef8cea640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef40b84e0 0x7f3ef40c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:33.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3ef8cea640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef40d0040 0x7f3ef414de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:33.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3ef8cea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ef415cba0 0x7f3ef40cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:33.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3ef8cea640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef40c80e0 con 0x7f3ef415cba0 2023-10-14T11:13:33.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3ef8cea640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef40c8940 con 0x7f3ef40d0040 2023-10-14T11:13:33.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3ef8cea640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef414e3a0 con 0x7f3ef40b84e0 2023-10-14T11:13:33.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3ef2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ef415cba0 0x7f3ef40cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:33.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3ef2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ef415cba0 0x7f3ef40cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57902/0 (socket says 172.21.15.26:57902) 2023-10-14T11:13:33.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3ef2d9d640 1 -- 172.21.15.26:0/870585145 learned_addr learned my addr 172.21.15.26:0/870585145 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:33.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3ef259c640 1 --2- 172.21.15.26:0/870585145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef40b84e0 0x7f3ef40c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:33.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3eebfff640 1 --2- 172.21.15.26:0/870585145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef40d0040 0x7f3ef414de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:33.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3ef2d9d640 1 -- 172.21.15.26:0/870585145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef40b84e0 msgr2=0x7f3ef40c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:33.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3ef2d9d640 1 --2- 172.21.15.26:0/870585145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef40b84e0 0x7f3ef40c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3ef2d9d640 1 -- 172.21.15.26:0/870585145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef40d0040 msgr2=0x7f3ef414de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:33.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3ef2d9d640 1 --2- 172.21.15.26:0/870585145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef40d0040 0x7f3ef414de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3ef2d9d640 1 -- 172.21.15.26:0/870585145 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec009b30 con 0x7f3ef415cba0 2023-10-14T11:13:33.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3ef2d9d640 1 --2- 172.21.15.26:0/870585145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ef415cba0 0x7f3ef40cb080 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0af040 tx=0x7f3eec0194b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:33.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3eeaffd640 1 -- 172.21.15.26:0/870585145 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec0bd070 con 0x7f3ef415cba0 2023-10-14T11:13:33.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3eeaffd640 1 -- 172.21.15.26:0/870585145 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec009510 con 0x7f3ef415cba0 2023-10-14T11:13:33.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3eeaffd640 1 -- 172.21.15.26:0/870585145 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec0a5590 con 0x7f3ef415cba0 2023-10-14T11:13:33.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3ef8cea640 1 -- 172.21.15.26:0/870585145 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef415ae00 con 0x7f3ef415cba0 2023-10-14T11:13:33.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3ef8cea640 1 -- 172.21.15.26:0/870585145 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef40c85d0 con 0x7f3ef415cba0 2023-10-14T11:13:33.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.602+0000 7f3ef8cea640 1 -- 172.21.15.26:0/870585145 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef404e170 con 0x7f3ef415cba0 2023-10-14T11:13:33.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.606+0000 7f3eeaffd640 1 -- 172.21.15.26:0/870585145 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3eec0b86b0 con 0x7f3ef415cba0 2023-10-14T11:13:33.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.606+0000 7f3eeaffd640 1 --2- 172.21.15.26:0/870585145 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3ed40664d0 0x7f3ed4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:33.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.606+0000 7f3eeaffd640 1 -- 172.21.15.26:0/870585145 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3eec11ed60 con 0x7f3ef415cba0 2023-10-14T11:13:33.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.606+0000 7f3ef259c640 1 --2- 172.21.15.26:0/870585145 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3ed40664d0 0x7f3ed4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:33.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.606+0000 7f3ef259c640 1 --2- 172.21.15.26:0/870585145 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3ed40664d0 0x7f3ed4068990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40b6200 tx=0x7f3ee4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:33.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.610+0000 7f3eeaffd640 1 -- 172.21.15.26:0/870585145 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3eec0ebf80 con 0x7f3ef415cba0 2023-10-14T11:13:33.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.766+0000 7f3ef8cea640 1 -- 172.21.15.26:0/870585145 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3ef40c8a80 con 0x7f3ef415cba0 2023-10-14T11:13:33.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.766+0000 7f3eeaffd640 1 -- 172.21.15.26:0/870585145 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3eec0ef5a0 con 0x7f3ef415cba0 2023-10-14T11:13:33.769 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:33.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.766+0000 7f3ef8cea640 1 -- 172.21.15.26:0/870585145 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3ed40664d0 msgr2=0x7f3ed4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:33.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.766+0000 7f3ef8cea640 1 --2- 172.21.15.26:0/870585145 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3ed40664d0 0x7f3ed4068990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40b6200 tx=0x7f3ee4008040 comp rx=0 tx=0).stop 2023-10-14T11:13:33.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.766+0000 7f3ef8cea640 1 -- 172.21.15.26:0/870585145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ef415cba0 msgr2=0x7f3ef40cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:33.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.766+0000 7f3ef8cea640 1 --2- 172.21.15.26:0/870585145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ef415cba0 0x7f3ef40cb080 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0af040 tx=0x7f3eec0194b0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.766+0000 7f3ef8cea640 1 -- 172.21.15.26:0/870585145 shutdown_connections 2023-10-14T11:13:33.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.766+0000 7f3ef8cea640 1 --2- 172.21.15.26:0/870585145 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3ed40664d0 0x7f3ed4068990 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.766+0000 7f3ef8cea640 1 --2- 172.21.15.26:0/870585145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ef415cba0 0x7f3ef40cb080 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.766+0000 7f3ef8cea640 1 --2- 172.21.15.26:0/870585145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef40d0040 0x7f3ef414de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.766+0000 7f3ef8cea640 1 --2- 172.21.15.26:0/870585145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef40b84e0 0x7f3ef40c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.766+0000 7f3ef8cea640 1 -- 172.21.15.26:0/870585145 >> 172.21.15.26:0/870585145 conn(0x7f3ef40719c0 msgr2=0x7f3ef40b6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:33.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.766+0000 7f3ef8cea640 1 -- 172.21.15.26:0/870585145 shutdown_connections 2023-10-14T11:13:33.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.766+0000 7f3ef8cea640 1 -- 172.21.15.26:0/870585145 wait complete. 2023-10-14T11:13:33.790 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:13:33.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.934+0000 7ff971868640 1 Processor -- start 2023-10-14T11:13:33.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.934+0000 7ff971868640 1 -- start start 2023-10-14T11:13:33.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.934+0000 7ff971868640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c159900 0x7ff96c06e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:33.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.938+0000 7ff971868640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96c0b4360 con 0x7ff96c0b3f00 2023-10-14T11:13:33.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.938+0000 7ff971868640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96c0b4600 con 0x7ff96c06a5a0 2023-10-14T11:13:33.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.938+0000 7ff971868640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c0cd740 con 0x7ff96c159900 2023-10-14T11:13:33.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.938+0000 7ff96a7fc640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff96c0b3f00 0x7ff96c069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35664/0 (socket says 172.21.15.26:35664) 2023-10-14T11:13:33.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.938+0000 7ff96a7fc640 1 -- 172.21.15.26:0/3456045393 learned_addr learned my addr 172.21.15.26:0/3456045393 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:33.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.938+0000 7ff96affd640 1 --2- 172.21.15.26:0/3456045393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c159900 0x7ff96c06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:33.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.938+0000 7ff969ffb640 1 -- 172.21.15.26:0/3456045393 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749748609 0 0) 0x7ff96c0b4360 con 0x7ff96c0b3f00 2023-10-14T11:13:33.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.938+0000 7ff969ffb640 1 -- 172.21.15.26:0/3456045393 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff954003530 con 0x7ff96c0b3f00 2023-10-14T11:13:33.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.938+0000 7ff969ffb640 1 -- 172.21.15.26:0/3456045393 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077088177 0 0) 0x7ff96c0b4600 con 0x7ff96c06a5a0 2023-10-14T11:13:33.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.938+0000 7ff969ffb640 1 -- 172.21.15.26:0/3456045393 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff96c0b4360 con 0x7ff96c06a5a0 2023-10-14T11:13:33.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.938+0000 7ff969ffb640 1 -- 172.21.15.26:0/3456045393 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1485900516 0 0) 0x7ff954003530 con 0x7ff96c0b3f00 2023-10-14T11:13:33.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.938+0000 7ff96affd640 1 -- 172.21.15.26:0/3456045393 >> v1:172.21.15.110:6789/0 conn(0x7ff96c06a5a0 legacy=0x7ff96c0c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:33.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.938+0000 7ff96affd640 1 -- 172.21.15.26:0/3456045393 >> v1:172.21.15.26:6789/0 conn(0x7ff96c0b3f00 legacy=0x7ff96c069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:33.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.938+0000 7ff96affd640 1 -- 172.21.15.26:0/3456045393 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c0c8dd0 con 0x7ff96c159900 2023-10-14T11:13:33.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.942+0000 7ff96affd640 1 --2- 172.21.15.26:0/3456045393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c159900 0x7ff96c06e260 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff96c0cd880 tx=0x7ff95c01c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13552e2c2d403233 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:33.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.942+0000 7ff969ffb640 1 -- 172.21.15.26:0/3456045393 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff960001680 con 0x7ff96c159900 2023-10-14T11:13:33.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.942+0000 7ff969ffb640 1 -- 172.21.15.26:0/3456045393 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c0ac440 con 0x7ff96c159900 2023-10-14T11:13:33.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.942+0000 7ff969ffb640 1 -- 172.21.15.26:0/3456045393 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c0ac7d0 con 0x7ff96c159900 2023-10-14T11:13:33.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.942+0000 7ff971868640 1 -- 172.21.15.26:0/3456045393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c159900 msgr2=0x7ff96c06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:33.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.942+0000 7ff971868640 1 --2- 172.21.15.26:0/3456045393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c159900 0x7ff96c06e260 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff96c0cd880 tx=0x7ff95c01c390 comp rx=0 tx=0).stop 2023-10-14T11:13:33.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.942+0000 7ff971868640 1 -- 172.21.15.26:0/3456045393 shutdown_connections 2023-10-14T11:13:33.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.942+0000 7ff971868640 1 --2- 172.21.15.26:0/3456045393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c159900 0x7ff96c06e260 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.942+0000 7ff971868640 1 -- 172.21.15.26:0/3456045393 >> 172.21.15.26:0/3456045393 conn(0x7ff96c0b0da0 msgr2=0x7ff96c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:33.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.942+0000 7ff971868640 1 -- 172.21.15.26:0/3456045393 shutdown_connections 2023-10-14T11:13:33.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.942+0000 7ff971868640 1 -- 172.21.15.26:0/3456045393 wait complete. 2023-10-14T11:13:33.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.942+0000 7ff971868640 1 Processor -- start 2023-10-14T11:13:33.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.942+0000 7ff971868640 1 -- start start 2023-10-14T11:13:33.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff971868640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff96c06a5a0 0x7ff96c0c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:33.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff971868640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c0b3f00 0x7ff96c15ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:33.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff971868640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff96c159900 0x7ff96c156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:33.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff971868640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c156bd0 con 0x7ff96c06a5a0 2023-10-14T11:13:33.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff971868640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c15b990 con 0x7ff96c159900 2023-10-14T11:13:33.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff971868640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c15bc70 con 0x7ff96c0b3f00 2023-10-14T11:13:33.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff96affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff96c06a5a0 0x7ff96c0c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:33.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff96affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff96c06a5a0 0x7ff96c0c68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57910/0 (socket says 172.21.15.26:57910) 2023-10-14T11:13:33.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff96affd640 1 -- 172.21.15.26:0/1355408721 learned_addr learned my addr 172.21.15.26:0/1355408721 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:33.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff96a7fc640 1 --2- 172.21.15.26:0/1355408721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c0b3f00 0x7ff96c15ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:33.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff96affd640 1 -- 172.21.15.26:0/1355408721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c0b3f00 msgr2=0x7ff96c15ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:33.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff96affd640 1 --2- 172.21.15.26:0/1355408721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c0b3f00 0x7ff96c15ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff96affd640 1 -- 172.21.15.26:0/1355408721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff96c159900 msgr2=0x7ff96c156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff96b7fe640 1 --2- 172.21.15.26:0/1355408721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff96c159900 0x7ff96c156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff96affd640 1 --2- 172.21.15.26:0/1355408721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff96c159900 0x7ff96c156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff96affd640 1 -- 172.21.15.26:0/1355408721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c009420 con 0x7ff96c06a5a0 2023-10-14T11:13:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff96a7fc640 1 --2- 172.21.15.26:0/1355408721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c0b3f00 0x7ff96c15ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff96b7fe640 1 --2- 172.21.15.26:0/1355408721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff96c159900 0x7ff96c156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:33.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff96affd640 1 --2- 172.21.15.26:0/1355408721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff96c06a5a0 0x7ff96c0c68c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff95c018fa0 tx=0x7ff95c019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:33.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff953fff640 1 -- 172.21.15.26:0/1355408721 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c004220 con 0x7ff96c06a5a0 2023-10-14T11:13:33.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff953fff640 1 -- 172.21.15.26:0/1355408721 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c004380 con 0x7ff96c06a5a0 2023-10-14T11:13:33.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff971868640 1 -- 172.21.15.26:0/1355408721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96c15bf50 con 0x7ff96c06a5a0 2023-10-14T11:13:33.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff953fff640 1 -- 172.21.15.26:0/1355408721 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c003820 con 0x7ff96c06a5a0 2023-10-14T11:13:33.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff971868640 1 -- 172.21.15.26:0/1355408721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c15c510 con 0x7ff96c06a5a0 2023-10-14T11:13:33.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff971868640 1 -- 172.21.15.26:0/1355408721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96c15c700 con 0x7ff96c06a5a0 2023-10-14T11:13:33.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.946+0000 7ff953fff640 1 -- 172.21.15.26:0/1355408721 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff95c0b3040 con 0x7ff96c06a5a0 2023-10-14T11:13:33.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.950+0000 7ff953fff640 1 --2- 172.21.15.26:0/1355408721 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff9580664d0 0x7ff958068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:33.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.950+0000 7ff953fff640 1 -- 172.21.15.26:0/1355408721 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff95c11d8d0 con 0x7ff96c06a5a0 2023-10-14T11:13:33.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.950+0000 7ff96a7fc640 1 --2- 172.21.15.26:0/1355408721 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff9580664d0 0x7ff958068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:33.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.950+0000 7ff96a7fc640 1 --2- 172.21.15.26:0/1355408721 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff9580664d0 0x7ff958068990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff96c158310 tx=0x7ff960009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:33.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:33.954+0000 7ff953fff640 1 -- 172.21.15.26:0/1355408721 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff95c0ea8f0 con 0x7ff96c06a5a0 2023-10-14T11:13:34.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.110+0000 7ff971868640 1 -- 172.21.15.26:0/1355408721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff96c04e170 con 0x7ff96c06a5a0 2023-10-14T11:13:34.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.110+0000 7ff953fff640 1 -- 172.21.15.26:0/1355408721 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff95c0b1020 con 0x7ff96c06a5a0 2023-10-14T11:13:34.113 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:13:34.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.110+0000 7ff971868640 1 -- 172.21.15.26:0/1355408721 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff9580664d0 msgr2=0x7ff958068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:34.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.114+0000 7ff971868640 1 --2- 172.21.15.26:0/1355408721 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff9580664d0 0x7ff958068990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff96c158310 tx=0x7ff960009040 comp rx=0 tx=0).stop 2023-10-14T11:13:34.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.114+0000 7ff971868640 1 -- 172.21.15.26:0/1355408721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff96c06a5a0 msgr2=0x7ff96c0c68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:34.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.114+0000 7ff971868640 1 --2- 172.21.15.26:0/1355408721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff96c06a5a0 0x7ff96c0c68c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff95c018fa0 tx=0x7ff95c019130 comp rx=0 tx=0).stop 2023-10-14T11:13:34.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.114+0000 7ff971868640 1 -- 172.21.15.26:0/1355408721 shutdown_connections 2023-10-14T11:13:34.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.114+0000 7ff971868640 1 --2- 172.21.15.26:0/1355408721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff96c159900 0x7ff96c156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.114+0000 7ff971868640 1 --2- 172.21.15.26:0/1355408721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c0b3f00 0x7ff96c15ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.114+0000 7ff971868640 1 --2- 172.21.15.26:0/1355408721 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff9580664d0 0x7ff958068990 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.114+0000 7ff971868640 1 --2- 172.21.15.26:0/1355408721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff96c06a5a0 0x7ff96c0c68c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.114+0000 7ff971868640 1 -- 172.21.15.26:0/1355408721 >> 172.21.15.26:0/1355408721 conn(0x7ff96c0b0da0 msgr2=0x7ff96c1577d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:34.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.114+0000 7ff971868640 1 -- 172.21.15.26:0/1355408721 shutdown_connections 2023-10-14T11:13:34.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.114+0000 7ff971868640 1 -- 172.21.15.26:0/1355408721 wait complete. 2023-10-14T11:13:34.134 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T11:13:34.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.278+0000 7f414d72a640 1 Processor -- start 2023-10-14T11:13:34.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.278+0000 7f414d72a640 1 -- start start 2023-10-14T11:13:34.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.278+0000 7f414d72a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f414806d010 0x7f41480c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:34.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.278+0000 7f414d72a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41480c26b0 0x7f41480c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:34.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.278+0000 7f414d72a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414815ae30 con 0x7f4148069e90 2023-10-14T11:13:34.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.278+0000 7f414d72a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41480cb090 con 0x7f414806d010 2023-10-14T11:13:34.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.278+0000 7f414d72a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414806d470 con 0x7f41480c26b0 2023-10-14T11:13:34.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.282+0000 7f413ffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f414806d010 0x7f41480c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:34.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.282+0000 7f41477fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41480c26b0 0x7f41480c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:34.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.282+0000 7f413ffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f414806d010 0x7f41480c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:45734/0 (socket says 172.21.15.26:45734) 2023-10-14T11:13:34.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.282+0000 7f413ffff640 1 -- 172.21.15.26:0/2081831420 learned_addr learned my addr 172.21.15.26:0/2081831420 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:34.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.282+0000 7f4146ffd640 1 --1- 172.21.15.26:0/2081831420 >> v1:172.21.15.110:6789/0 conn(0x7f4148069e90 0x7f414806a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:39062/0 (socket says 172.21.15.26:39062) 2023-10-14T11:13:34.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.282+0000 7f41477fe640 1 -- 172.21.15.26:0/2081831420 >> v2:172.21.15.110:3300/0 conn(0x7f414806d010 msgr2=0x7f41480c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:34.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.282+0000 7f41477fe640 1 --2- 172.21.15.26:0/2081831420 >> v2:172.21.15.110:3300/0 conn(0x7f414806d010 0x7f41480c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.282+0000 7f41477fe640 1 -- 172.21.15.26:0/2081831420 >> v1:172.21.15.110:6789/0 conn(0x7f4148069e90 legacy=0x7f414806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:34.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.282+0000 7f41477fe640 1 -- 172.21.15.26:0/2081831420 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41480ca510 con 0x7f41480c26b0 2023-10-14T11:13:34.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.282+0000 7f41467fc640 1 -- 172.21.15.26:0/2081831420 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527340746 0 0) 0x7f414815ae30 con 0x7f4148069e90 2023-10-14T11:13:34.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.282+0000 7f413ffff640 1 --2- 172.21.15.26:0/2081831420 >> v2:172.21.15.110:3300/0 conn(0x7f414806d010 0x7f41480c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:13:34.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.282+0000 7f41477fe640 1 --2- 172.21.15.26:0/2081831420 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41480c26b0 0x7f41480c2b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4140009d90 tx=0x7f414001f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b2c646792386721 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:34.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.282+0000 7f41467fc640 1 -- 172.21.15.26:0/2081831420 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41400af600 con 0x7f41480c26b0 2023-10-14T11:13:34.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.282+0000 7f41467fc640 1 -- 172.21.15.26:0/2081831420 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41400ab050 con 0x7f41480c26b0 2023-10-14T11:13:34.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.282+0000 7f41467fc640 1 -- 172.21.15.26:0/2081831420 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41400af980 con 0x7f41480c26b0 2023-10-14T11:13:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f414d72a640 1 -- 172.21.15.26:0/2081831420 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41480c26b0 msgr2=0x7f41480c2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f414d72a640 1 --2- 172.21.15.26:0/2081831420 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41480c26b0 0x7f41480c2b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4140009d90 tx=0x7f414001f130 comp rx=0 tx=0).stop 2023-10-14T11:13:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f414d72a640 1 -- 172.21.15.26:0/2081831420 shutdown_connections 2023-10-14T11:13:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f414d72a640 1 --2- 172.21.15.26:0/2081831420 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41480c26b0 0x7f41480c2b40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f414d72a640 1 --2- 172.21.15.26:0/2081831420 >> v2:172.21.15.110:3300/0 conn(0x7f414806d010 0x7f41480c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f414d72a640 1 -- 172.21.15.26:0/2081831420 >> 172.21.15.26:0/2081831420 conn(0x7f41480b0da0 msgr2=0x7f41480ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f414d72a640 1 -- 172.21.15.26:0/2081831420 shutdown_connections 2023-10-14T11:13:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f414d72a640 1 -- 172.21.15.26:0/2081831420 wait complete. 2023-10-14T11:13:34.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f414d72a640 1 Processor -- start 2023-10-14T11:13:34.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f414d72a640 1 -- start start 2023-10-14T11:13:34.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f414d72a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4148069e90 0x7f41481f1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:34.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f414d72a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f414806d010 0x7f414815d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:34.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f414d72a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41480c26b0 0x7f4148154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:34.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f414d72a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4148152590 con 0x7f4148069e90 2023-10-14T11:13:34.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f414d72a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414815da80 con 0x7f41480c26b0 2023-10-14T11:13:34.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f414d72a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414815dce0 con 0x7f414806d010 2023-10-14T11:13:34.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f4146ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4148069e90 0x7f41481f1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:34.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f413ffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f414806d010 0x7f414815d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:34.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f4146ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4148069e90 0x7f41481f1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57920/0 (socket says 172.21.15.26:57920) 2023-10-14T11:13:34.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f4146ffd640 1 -- 172.21.15.26:0/1139806389 learned_addr learned my addr 172.21.15.26:0/1139806389 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:34.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f41477fe640 1 --2- 172.21.15.26:0/1139806389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41480c26b0 0x7f4148154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:34.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f4146ffd640 1 -- 172.21.15.26:0/1139806389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f414806d010 msgr2=0x7f414815d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:34.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f4146ffd640 1 --2- 172.21.15.26:0/1139806389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f414806d010 0x7f414815d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f4146ffd640 1 -- 172.21.15.26:0/1139806389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41480c26b0 msgr2=0x7f4148154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:34.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f4146ffd640 1 --2- 172.21.15.26:0/1139806389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41480c26b0 0x7f4148154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.286+0000 7f4146ffd640 1 -- 172.21.15.26:0/1139806389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41300094d0 con 0x7f4148069e90 2023-10-14T11:13:34.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.290+0000 7f4146ffd640 1 --2- 172.21.15.26:0/1139806389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4148069e90 0x7f41481f1010 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f413800c480 tx=0x7f413800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:34.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.290+0000 7f413f7fe640 1 -- 172.21.15.26:0/1139806389 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41380074e0 con 0x7f4148069e90 2023-10-14T11:13:34.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.290+0000 7f413f7fe640 1 -- 172.21.15.26:0/1139806389 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4138007660 con 0x7f4148069e90 2023-10-14T11:13:34.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.290+0000 7f413f7fe640 1 -- 172.21.15.26:0/1139806389 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4138004a30 con 0x7f4148069e90 2023-10-14T11:13:34.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.290+0000 7f414d72a640 1 -- 172.21.15.26:0/1139806389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4140009a70 con 0x7f4148069e90 2023-10-14T11:13:34.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.290+0000 7f414d72a640 1 -- 172.21.15.26:0/1139806389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4148152ac0 con 0x7f4148069e90 2023-10-14T11:13:34.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.290+0000 7f414d72a640 1 -- 172.21.15.26:0/1139806389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414804e170 con 0x7f4148069e90 2023-10-14T11:13:34.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.290+0000 7f413f7fe640 1 -- 172.21.15.26:0/1139806389 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4138004b90 con 0x7f4148069e90 2023-10-14T11:13:34.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.290+0000 7f413f7fe640 1 --2- 172.21.15.26:0/1139806389 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41280664a0 0x7f4128068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:34.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.290+0000 7f413f7fe640 1 -- 172.21.15.26:0/1139806389 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4138083350 con 0x7f4148069e90 2023-10-14T11:13:34.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.290+0000 7f413ffff640 1 --2- 172.21.15.26:0/1139806389 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41280664a0 0x7f4128068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:34.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.294+0000 7f413ffff640 1 --2- 172.21.15.26:0/1139806389 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41280664a0 0x7f4128068960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f41481492b0 tx=0x7f4130009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:34.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.294+0000 7f413f7fe640 1 -- 172.21.15.26:0/1139806389 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f41380504b0 con 0x7f4148069e90 2023-10-14T11:13:34.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.450+0000 7f414d72a640 1 -- 172.21.15.26:0/1139806389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f41480caaa0 con 0x7f4148069e90 2023-10-14T11:13:34.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.450+0000 7f413f7fe640 1 -- 172.21.15.26:0/1139806389 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4138053ad0 con 0x7f4148069e90 2023-10-14T11:13:34.454 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:34.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.454+0000 7f414d72a640 1 -- 172.21.15.26:0/1139806389 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41280664a0 msgr2=0x7f4128068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:34.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.454+0000 7f414d72a640 1 --2- 172.21.15.26:0/1139806389 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41280664a0 0x7f4128068960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f41481492b0 tx=0x7f4130009240 comp rx=0 tx=0).stop 2023-10-14T11:13:34.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.454+0000 7f414d72a640 1 -- 172.21.15.26:0/1139806389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4148069e90 msgr2=0x7f41481f1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:34.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.454+0000 7f414d72a640 1 --2- 172.21.15.26:0/1139806389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4148069e90 0x7f41481f1010 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f413800c480 tx=0x7f413800c940 comp rx=0 tx=0).stop 2023-10-14T11:13:34.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.454+0000 7f414d72a640 1 -- 172.21.15.26:0/1139806389 shutdown_connections 2023-10-14T11:13:34.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.454+0000 7f414d72a640 1 --2- 172.21.15.26:0/1139806389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41480c26b0 0x7f4148154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.454+0000 7f414d72a640 1 --2- 172.21.15.26:0/1139806389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f414806d010 0x7f414815d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.454+0000 7f414d72a640 1 --2- 172.21.15.26:0/1139806389 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41280664a0 0x7f4128068960 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.454+0000 7f414d72a640 1 --2- 172.21.15.26:0/1139806389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4148069e90 0x7f41481f1010 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.454+0000 7f414d72a640 1 -- 172.21.15.26:0/1139806389 >> 172.21.15.26:0/1139806389 conn(0x7f41480b0da0 msgr2=0x7f41480c2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:34.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.454+0000 7f414d72a640 1 -- 172.21.15.26:0/1139806389 shutdown_connections 2023-10-14T11:13:34.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.454+0000 7f414d72a640 1 -- 172.21.15.26:0/1139806389 wait complete. 2023-10-14T11:13:34.475 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:13:34.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.618+0000 7f278a809640 1 Processor -- start 2023-10-14T11:13:34.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.618+0000 7f278a809640 1 -- start start 2023-10-14T11:13:34.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.618+0000 7f278a809640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f278415cd10 0x7f278415de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:34.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.618+0000 7f278a809640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f278406a340 0x7f2784071990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:34.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.618+0000 7f278a809640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278415e390 con 0x7f2784069e90 2023-10-14T11:13:34.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.618+0000 7f278a809640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2784161990 con 0x7f278415cd10 2023-10-14T11:13:34.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.618+0000 7f278a809640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27840ca150 con 0x7f278406a340 2023-10-14T11:13:34.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.618+0000 7f2783fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f278415cd10 0x7f278415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:34.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.618+0000 7f2783fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f278415cd10 0x7f278415de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57934/0 (socket says 172.21.15.26:57934) 2023-10-14T11:13:34.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.618+0000 7f2783fff640 1 -- 172.21.15.26:0/357519115 learned_addr learned my addr 172.21.15.26:0/357519115 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:34.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.618+0000 7f2788da6640 1 --2- 172.21.15.26:0/357519115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f278406a340 0x7f2784071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:34.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.618+0000 7f2783fff640 1 -- 172.21.15.26:0/357519115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f278406a340 msgr2=0x7f2784071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:34.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.618+0000 7f2783fff640 1 --2- 172.21.15.26:0/357519115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f278406a340 0x7f2784071990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.618+0000 7f2783fff640 1 -- 172.21.15.26:0/357519115 >> v1:172.21.15.110:6789/0 conn(0x7f2784069e90 legacy=0x7f2784071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:34.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.618+0000 7f2783fff640 1 -- 172.21.15.26:0/357519115 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278406a790 con 0x7f278415cd10 2023-10-14T11:13:34.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.622+0000 7f2783fff640 1 --2- 172.21.15.26:0/357519115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f278415cd10 0x7f278415de50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2774009870 tx=0x7f277401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de256b9f5ce72ef6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:34.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.622+0000 7f2782ffd640 1 -- 172.21.15.26:0/357519115 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27740aa620 con 0x7f278415cd10 2023-10-14T11:13:34.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.622+0000 7f2782ffd640 1 -- 172.21.15.26:0/357519115 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27740aa780 con 0x7f278415cd10 2023-10-14T11:13:34.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.622+0000 7f2782ffd640 1 -- 172.21.15.26:0/357519115 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27740aab10 con 0x7f278415cd10 2023-10-14T11:13:34.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.622+0000 7f278a809640 1 -- 172.21.15.26:0/357519115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f278415cd10 msgr2=0x7f278415de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:34.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.622+0000 7f278a809640 1 --2- 172.21.15.26:0/357519115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f278415cd10 0x7f278415de50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2774009870 tx=0x7f277401c500 comp rx=0 tx=0).stop 2023-10-14T11:13:34.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.622+0000 7f278a809640 1 -- 172.21.15.26:0/357519115 shutdown_connections 2023-10-14T11:13:34.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.622+0000 7f278a809640 1 --2- 172.21.15.26:0/357519115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f278406a340 0x7f2784071990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.622+0000 7f278a809640 1 --2- 172.21.15.26:0/357519115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f278415cd10 0x7f278415de50 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.622+0000 7f278a809640 1 -- 172.21.15.26:0/357519115 >> 172.21.15.26:0/357519115 conn(0x7f278406d310 msgr2=0x7f278406d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:34.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.622+0000 7f278a809640 1 -- 172.21.15.26:0/357519115 shutdown_connections 2023-10-14T11:13:34.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.622+0000 7f278a809640 1 -- 172.21.15.26:0/357519115 wait complete. 2023-10-14T11:13:34.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f278a809640 1 Processor -- start 2023-10-14T11:13:34.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f278a809640 1 -- start start 2023-10-14T11:13:34.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f278a809640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2784069e90 0x7f27840c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:34.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f278a809640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f278406a340 0x7f27840c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:34.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f278a809640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f278415cd10 0x7f27840cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:34.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f278a809640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2784152900 con 0x7f278415cd10 2023-10-14T11:13:34.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f278a809640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2784152b50 con 0x7f278406a340 2023-10-14T11:13:34.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f278a809640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2784152e30 con 0x7f2784069e90 2023-10-14T11:13:34.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f2788da6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f278415cd10 0x7f27840cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:34.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f2788da6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f278415cd10 0x7f27840cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57944/0 (socket says 172.21.15.26:57944) 2023-10-14T11:13:34.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f2788da6640 1 -- 172.21.15.26:0/1126150989 learned_addr learned my addr 172.21.15.26:0/1126150989 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:34.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f27837fe640 1 --2- 172.21.15.26:0/1126150989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f278406a340 0x7f27840c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:34.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f2783fff640 1 --2- 172.21.15.26:0/1126150989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2784069e90 0x7f27840c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:34.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f2788da6640 1 -- 172.21.15.26:0/1126150989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2784069e90 msgr2=0x7f27840c56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:34.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f2788da6640 1 --2- 172.21.15.26:0/1126150989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2784069e90 0x7f27840c56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f2788da6640 1 -- 172.21.15.26:0/1126150989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f278406a340 msgr2=0x7f27840c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:34.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f2788da6640 1 --2- 172.21.15.26:0/1126150989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f278406a340 0x7f27840c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f2788da6640 1 -- 172.21.15.26:0/1126150989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27740094d0 con 0x7f278415cd10 2023-10-14T11:13:34.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f2788da6640 1 --2- 172.21.15.26:0/1126150989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f278415cd10 0x7f27840cf6b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f277c007e60 tx=0x7f277c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:34.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f2780ff9640 1 -- 172.21.15.26:0/1126150989 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c014420 con 0x7f278415cd10 2023-10-14T11:13:34.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f2780ff9640 1 -- 172.21.15.26:0/1126150989 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277c0145a0 con 0x7f278415cd10 2023-10-14T11:13:34.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f2780ff9640 1 -- 172.21.15.26:0/1126150989 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c014950 con 0x7f278415cd10 2023-10-14T11:13:34.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f278a809640 1 -- 172.21.15.26:0/1126150989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2784153110 con 0x7f278415cd10 2023-10-14T11:13:34.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.626+0000 7f278a809640 1 -- 172.21.15.26:0/1126150989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27841536d0 con 0x7f278415cd10 2023-10-14T11:13:34.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.630+0000 7f278a809640 1 -- 172.21.15.26:0/1126150989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2784074010 con 0x7f278415cd10 2023-10-14T11:13:34.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.630+0000 7f2780ff9640 1 -- 172.21.15.26:0/1126150989 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f277c014ab0 con 0x7f278415cd10 2023-10-14T11:13:34.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.630+0000 7f2780ff9640 1 --2- 172.21.15.26:0/1126150989 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27700664a0 0x7f2770068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:34.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.630+0000 7f2780ff9640 1 -- 172.21.15.26:0/1126150989 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f277c084a20 con 0x7f278415cd10 2023-10-14T11:13:34.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.630+0000 7f2783fff640 1 --2- 172.21.15.26:0/1126150989 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27700664a0 0x7f2770068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:34.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.630+0000 7f2783fff640 1 --2- 172.21.15.26:0/1126150989 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27700664a0 0x7f2770068960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f27740ae000 tx=0x7f27740b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:34.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.634+0000 7f2780ff9640 1 -- 172.21.15.26:0/1126150989 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f277c051b80 con 0x7f278415cd10 2023-10-14T11:13:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.801+0000 7f278a809640 1 -- 172.21.15.26:0/1126150989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f27840b1a60 con 0x7f278415cd10 2023-10-14T11:13:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.801+0000 7f2780ff9640 1 -- 172.21.15.26:0/1126150989 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f277c0551a0 con 0x7f278415cd10 2023-10-14T11:13:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-10-14T11:13:34.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.805+0000 7f278a809640 1 -- 172.21.15.26:0/1126150989 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27700664a0 msgr2=0x7f2770068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:34.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.805+0000 7f278a809640 1 --2- 172.21.15.26:0/1126150989 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27700664a0 0x7f2770068960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f27740ae000 tx=0x7f27740b5040 comp rx=0 tx=0).stop 2023-10-14T11:13:34.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.805+0000 7f278a809640 1 -- 172.21.15.26:0/1126150989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f278415cd10 msgr2=0x7f27840cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:34.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.805+0000 7f278a809640 1 --2- 172.21.15.26:0/1126150989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f278415cd10 0x7f27840cf6b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f277c007e60 tx=0x7f277c00e4b0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.805+0000 7f278a809640 1 -- 172.21.15.26:0/1126150989 shutdown_connections 2023-10-14T11:13:34.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.805+0000 7f278a809640 1 --2- 172.21.15.26:0/1126150989 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27700664a0 0x7f2770068960 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.805+0000 7f278a809640 1 --2- 172.21.15.26:0/1126150989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f278415cd10 0x7f27840cf6b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.805+0000 7f278a809640 1 --2- 172.21.15.26:0/1126150989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f278406a340 0x7f27840c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.805+0000 7f278a809640 1 --2- 172.21.15.26:0/1126150989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2784069e90 0x7f27840c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:34.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.805+0000 7f278a809640 1 -- 172.21.15.26:0/1126150989 >> 172.21.15.26:0/1126150989 conn(0x7f278406d310 msgr2=0x7f27840cc590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:34.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.805+0000 7f278a809640 1 -- 172.21.15.26:0/1126150989 shutdown_connections 2023-10-14T11:13:34.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:34.805+0000 7f278a809640 1 -- 172.21.15.26:0/1126150989 wait complete. 2023-10-14T11:13:34.827 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi110.front.sepia.ceph.com... 2023-10-14T11:13:34.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:34.828 DEBUG:teuthology.orchestra.run.smithi110:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-10-14T11:13:34.853 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:13:34.853 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2023-10-14T11:13:34.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:34.854 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-14T11:13:34.908 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T11:13:34.908 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:13:35.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.053+0000 7f32f359e640 1 Processor -- start 2023-10-14T11:13:35.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.053+0000 7f32f359e640 1 -- start start 2023-10-14T11:13:35.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.053+0000 7f32f359e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f32f415c910 0x7f32f40d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:35.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.053+0000 7f32f359e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32f40cefe0 0x7f32f40cf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:35.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.053+0000 7f32f359e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f40ce730 con 0x7f32f40d3170 2023-10-14T11:13:35.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.053+0000 7f32f359e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f40cf9d0 con 0x7f32f415c910 2023-10-14T11:13:35.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.053+0000 7f32f359e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f40ce540 con 0x7f32f40cefe0 2023-10-14T11:13:35.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.053+0000 7f32f2d9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32f40cefe0 0x7f32f40cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:35.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.053+0000 7f32f259c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f32f415c910 0x7f32f40d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:35.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.053+0000 7f32f2d9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32f40cefe0 0x7f32f40cf490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:53668/0 (socket says 172.21.15.26:53668) 2023-10-14T11:13:35.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.053+0000 7f32f2d9d640 1 -- 172.21.15.26:0/4033080240 learned_addr learned my addr 172.21.15.26:0/4033080240 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:35.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.053+0000 7f32f2d9d640 1 -- 172.21.15.26:0/4033080240 >> v2:172.21.15.110:3300/0 conn(0x7f32f415c910 msgr2=0x7f32f40d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:35.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.053+0000 7f32f2d9d640 1 --2- 172.21.15.26:0/4033080240 >> v2:172.21.15.110:3300/0 conn(0x7f32f415c910 0x7f32f40d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.053+0000 7f32f2d9d640 1 -- 172.21.15.26:0/4033080240 >> v1:172.21.15.110:6789/0 conn(0x7f32f40d3170 legacy=0x7f32f40cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:35.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.053+0000 7f32f2d9d640 1 -- 172.21.15.26:0/4033080240 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f40d0dd0 con 0x7f32f40cefe0 2023-10-14T11:13:35.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.057+0000 7f32f2d9d640 1 --2- 172.21.15.26:0/4033080240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32f40cefe0 0x7f32f40cf490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f32ec009e50 tx=0x7f32ec01c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2180f512acf1dd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:35.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.057+0000 7f32f159a640 1 -- 172.21.15.26:0/4033080240 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec0a5730 con 0x7f32f40cefe0 2023-10-14T11:13:35.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.057+0000 7f32f159a640 1 -- 172.21.15.26:0/4033080240 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ec0a5890 con 0x7f32f40cefe0 2023-10-14T11:13:35.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.057+0000 7f32f159a640 1 -- 172.21.15.26:0/4033080240 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec0a5c20 con 0x7f32f40cefe0 2023-10-14T11:13:35.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.057+0000 7f32f359e640 1 -- 172.21.15.26:0/4033080240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32f40cefe0 msgr2=0x7f32f40cf490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:35.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.057+0000 7f32f359e640 1 --2- 172.21.15.26:0/4033080240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32f40cefe0 0x7f32f40cf490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f32ec009e50 tx=0x7f32ec01c980 comp rx=0 tx=0).stop 2023-10-14T11:13:35.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.057+0000 7f32f359e640 1 -- 172.21.15.26:0/4033080240 shutdown_connections 2023-10-14T11:13:35.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.057+0000 7f32f359e640 1 --2- 172.21.15.26:0/4033080240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32f40cefe0 0x7f32f40cf490 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.057+0000 7f32f359e640 1 --2- 172.21.15.26:0/4033080240 >> v2:172.21.15.110:3300/0 conn(0x7f32f415c910 0x7f32f40d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.057+0000 7f32f359e640 1 -- 172.21.15.26:0/4033080240 >> 172.21.15.26:0/4033080240 conn(0x7f32f409bb50 msgr2=0x7f32f40d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:35.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.057+0000 7f32f359e640 1 -- 172.21.15.26:0/4033080240 shutdown_connections 2023-10-14T11:13:35.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.057+0000 7f32f359e640 1 -- 172.21.15.26:0/4033080240 wait complete. 2023-10-14T11:13:35.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f359e640 1 Processor -- start 2023-10-14T11:13:35.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f359e640 1 -- start start 2023-10-14T11:13:35.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f359e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32f40cefe0 0x7f32f4159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:35.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32f40d3170 0x7f32f4150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:35.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f359e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32f415c910 0x7f32f4157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:35.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f359e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f4157d80 con 0x7f32f40d3170 2023-10-14T11:13:35.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f359e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f4154480 con 0x7f32f415c910 2023-10-14T11:13:35.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f359e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f4158850 con 0x7f32f40cefe0 2023-10-14T11:13:35.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f1d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32f40d3170 0x7f32f4150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:35.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f1d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32f40d3170 0x7f32f4150d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57950/0 (socket says 172.21.15.26:57950) 2023-10-14T11:13:35.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f1d9b640 1 -- 172.21.15.26:0/4116309478 learned_addr learned my addr 172.21.15.26:0/4116309478 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:35.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f259c640 1 --2- 172.21.15.26:0/4116309478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32f40cefe0 0x7f32f4159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:35.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f2d9d640 1 --2- 172.21.15.26:0/4116309478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32f415c910 0x7f32f4157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:35.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f1d9b640 1 -- 172.21.15.26:0/4116309478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32f40cefe0 msgr2=0x7f32f4159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:35.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f1d9b640 1 --2- 172.21.15.26:0/4116309478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32f40cefe0 0x7f32f4159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f1d9b640 1 -- 172.21.15.26:0/4116309478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32f415c910 msgr2=0x7f32f4157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:35.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f1d9b640 1 --2- 172.21.15.26:0/4116309478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32f415c910 0x7f32f4157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f1d9b640 1 -- 172.21.15.26:0/4116309478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ec009b30 con 0x7f32f40d3170 2023-10-14T11:13:35.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f259c640 1 --2- 172.21.15.26:0/4116309478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32f40cefe0 0x7f32f4159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:35.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f2d9d640 1 --2- 172.21.15.26:0/4116309478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32f415c910 0x7f32f4157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:35.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f1d9b640 1 --2- 172.21.15.26:0/4116309478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32f40d3170 0x7f32f4150d40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f32e800c4d0 tx=0x7f32e800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:35.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32e2ffd640 1 -- 172.21.15.26:0/4116309478 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e80052d0 con 0x7f32f40d3170 2023-10-14T11:13:35.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32e2ffd640 1 -- 172.21.15.26:0/4116309478 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e8005430 con 0x7f32f40d3170 2023-10-14T11:13:35.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f359e640 1 -- 172.21.15.26:0/4116309478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f4157fb0 con 0x7f32f40d3170 2023-10-14T11:13:35.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32e2ffd640 1 -- 172.21.15.26:0/4116309478 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e8012830 con 0x7f32f40d3170 2023-10-14T11:13:35.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.061+0000 7f32f359e640 1 -- 172.21.15.26:0/4116309478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f4158570 con 0x7f32f40d3170 2023-10-14T11:13:35.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.065+0000 7f32f359e640 1 -- 172.21.15.26:0/4116309478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f4154630 con 0x7f32f40d3170 2023-10-14T11:13:35.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.065+0000 7f32e2ffd640 1 -- 172.21.15.26:0/4116309478 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f32e8012990 con 0x7f32f40d3170 2023-10-14T11:13:35.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.065+0000 7f32e2ffd640 1 --2- 172.21.15.26:0/4116309478 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f32d40664a0 0x7f32d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:35.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.065+0000 7f32e2ffd640 1 -- 172.21.15.26:0/4116309478 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f32e8083db0 con 0x7f32f40d3170 2023-10-14T11:13:35.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.065+0000 7f32f259c640 1 --2- 172.21.15.26:0/4116309478 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f32d40664a0 0x7f32d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:35.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.065+0000 7f32f259c640 1 --2- 172.21.15.26:0/4116309478 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f32d40664a0 0x7f32d4068960 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009af0 tx=0x7f32e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:35.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.069+0000 7f32e2ffd640 1 -- 172.21.15.26:0/4116309478 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f32f4154630 con 0x7f32f40d3170 2023-10-14T11:13:35.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.257+0000 7f32f359e640 1 -- 172.21.15.26:0/4116309478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32f41545f0 con 0x7f32f40d3170 2023-10-14T11:13:35.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.257+0000 7f32e2ffd640 1 -- 172.21.15.26:0/4116309478 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f32e8088070 con 0x7f32f40d3170 2023-10-14T11:13:35.263 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:35.263 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/2685368784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2685368784},{"type":"v1","addr":"172.21.15.110:6834","nonce":2685368784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6836/4242453713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":4242453713},{"type":"v1","addr":"172.21.15.26:6836","nonce":4242453713}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3507761146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":3507761146},{"type":"v1","addr":"172.21.15.26:6837","nonce":3507761146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:12:22.355867+0000","modified":"2023-10-14T11:12:46.435346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3522025152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3522025152},{"type":"v1","addr":"172.21.15.110:6835","nonce":3522025152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T11:13:35.264 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 9 2023-10-14T11:13:35.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.261+0000 7f32f359e640 1 -- 172.21.15.26:0/4116309478 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f32d40664a0 msgr2=0x7f32d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:35.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.261+0000 7f32f359e640 1 --2- 172.21.15.26:0/4116309478 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f32d40664a0 0x7f32d4068960 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009af0 tx=0x7f32e4008040 comp rx=0 tx=0).stop 2023-10-14T11:13:35.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.261+0000 7f32f359e640 1 -- 172.21.15.26:0/4116309478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32f40d3170 msgr2=0x7f32f4150d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:35.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.261+0000 7f32f359e640 1 --2- 172.21.15.26:0/4116309478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32f40d3170 0x7f32f4150d40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f32e800c4d0 tx=0x7f32e800c990 comp rx=0 tx=0).stop 2023-10-14T11:13:35.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.261+0000 7f32f359e640 1 -- 172.21.15.26:0/4116309478 shutdown_connections 2023-10-14T11:13:35.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.261+0000 7f32f359e640 1 --2- 172.21.15.26:0/4116309478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32f415c910 0x7f32f4157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.261+0000 7f32f359e640 1 --2- 172.21.15.26:0/4116309478 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f32d40664a0 0x7f32d4068960 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.261+0000 7f32f359e640 1 --2- 172.21.15.26:0/4116309478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32f40d3170 0x7f32f4150d40 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.261+0000 7f32f359e640 1 --2- 172.21.15.26:0/4116309478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32f40cefe0 0x7f32f4159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.261+0000 7f32f359e640 1 -- 172.21.15.26:0/4116309478 >> 172.21.15.26:0/4116309478 conn(0x7f32f409bb50 msgr2=0x7f32f40b0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:35.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.261+0000 7f32f359e640 1 -- 172.21.15.26:0/4116309478 shutdown_connections 2023-10-14T11:13:35.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.261+0000 7f32f359e640 1 -- 172.21.15.26:0/4116309478 wait complete. 2023-10-14T11:13:35.284 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:13:35.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.425+0000 7ff4cf780640 1 Processor -- start 2023-10-14T11:13:35.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.425+0000 7ff4cf780640 1 -- start start 2023-10-14T11:13:35.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.425+0000 7ff4cf780640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff4c81597c0 0x7ff4c80ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:35.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.425+0000 7ff4cf780640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c8159ba0 0x7ff4c80cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:35.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.425+0000 7ff4cf780640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4c80adc10 0x7ff4c80cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:35.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.425+0000 7ff4cf780640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c80723d0 con 0x7ff4c80adc10 2023-10-14T11:13:35.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.425+0000 7ff4cf780640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c80717c0 con 0x7ff4c81597c0 2023-10-14T11:13:35.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.425+0000 7ff4cf780640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c8071aa0 con 0x7ff4c8159ba0 2023-10-14T11:13:35.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.425+0000 7ff4cdd1d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4c80adc10 0x7ff4c80cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:35.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.425+0000 7ff4cdd1d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4c80adc10 0x7ff4c80cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57956/0 (socket says 172.21.15.26:57956) 2023-10-14T11:13:35.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.425+0000 7ff4cdd1d640 1 -- 172.21.15.26:0/2672064109 learned_addr learned my addr 172.21.15.26:0/2672064109 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:35.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.425+0000 7ff4cdd1d640 1 -- 172.21.15.26:0/2672064109 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c8159ba0 msgr2=0x7ff4c80cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:35.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.425+0000 7ff4cdd1d640 1 --2- 172.21.15.26:0/2672064109 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c8159ba0 0x7ff4c80cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.425+0000 7ff4cdd1d640 1 -- 172.21.15.26:0/2672064109 >> v2:172.21.15.110:3300/0 conn(0x7ff4c81597c0 msgr2=0x7ff4c80ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:35.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.425+0000 7ff4cdd1d640 1 --2- 172.21.15.26:0/2672064109 >> v2:172.21.15.110:3300/0 conn(0x7ff4c81597c0 0x7ff4c80ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.425+0000 7ff4cdd1d640 1 -- 172.21.15.26:0/2672064109 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c8071d80 con 0x7ff4c80adc10 2023-10-14T11:13:35.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.429+0000 7ff4cdd1d640 1 --2- 172.21.15.26:0/2672064109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c80adc10 0x7ff4c80cb350 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff4c80cdaf0 tx=0x7ff4c001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40541e73a424fdc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:35.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.429+0000 7ff4bffff640 1 -- 172.21.15.26:0/2672064109 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c00a57c0 con 0x7ff4c80adc10 2023-10-14T11:13:35.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.429+0000 7ff4bffff640 1 -- 172.21.15.26:0/2672064109 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c00a5920 con 0x7ff4c80adc10 2023-10-14T11:13:35.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.429+0000 7ff4bffff640 1 -- 172.21.15.26:0/2672064109 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c00a5cb0 con 0x7ff4c80adc10 2023-10-14T11:13:35.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.429+0000 7ff4cf780640 1 -- 172.21.15.26:0/2672064109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c80adc10 msgr2=0x7ff4c80cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:35.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.429+0000 7ff4cf780640 1 --2- 172.21.15.26:0/2672064109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c80adc10 0x7ff4c80cb350 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff4c80cdaf0 tx=0x7ff4c001c9a0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.429+0000 7ff4cf780640 1 -- 172.21.15.26:0/2672064109 shutdown_connections 2023-10-14T11:13:35.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.429+0000 7ff4cf780640 1 --2- 172.21.15.26:0/2672064109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c80adc10 0x7ff4c80cb350 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.429+0000 7ff4cf780640 1 --2- 172.21.15.26:0/2672064109 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c8159ba0 0x7ff4c80cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.429+0000 7ff4cf780640 1 --2- 172.21.15.26:0/2672064109 >> v2:172.21.15.110:3300/0 conn(0x7ff4c81597c0 0x7ff4c80ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.429+0000 7ff4cf780640 1 -- 172.21.15.26:0/2672064109 >> 172.21.15.26:0/2672064109 conn(0x7ff4c806c190 msgr2=0x7ff4c806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:35.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.429+0000 7ff4cf780640 1 -- 172.21.15.26:0/2672064109 shutdown_connections 2023-10-14T11:13:35.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.429+0000 7ff4cf780640 1 -- 172.21.15.26:0/2672064109 wait complete. 2023-10-14T11:13:35.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4cf780640 1 Processor -- start 2023-10-14T11:13:35.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4cf780640 1 -- start start 2023-10-14T11:13:35.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4cf780640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c80adc10 0x7ff4c8157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:35.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4cf780640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c81597c0 0x7ff4c8147cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:35.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4cf780640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c8159ba0 0x7ff4c8148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:35.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4cf780640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80c4b20 con 0x7ff4c80adc10 2023-10-14T11:13:35.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4cf780640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c8154a50 con 0x7ff4c8159ba0 2023-10-14T11:13:35.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4cf780640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c8157a00 con 0x7ff4c81597c0 2023-10-14T11:13:35.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4cd51c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c80adc10 0x7ff4c8157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:35.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4cd51c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c80adc10 0x7ff4c8157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57968/0 (socket says 172.21.15.26:57968) 2023-10-14T11:13:35.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4cd51c640 1 -- 172.21.15.26:0/3115303344 learned_addr learned my addr 172.21.15.26:0/3115303344 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:35.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4ccd1b640 1 --2- 172.21.15.26:0/3115303344 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c81597c0 0x7ff4c8147cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:35.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4cdd1d640 1 --2- 172.21.15.26:0/3115303344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c8159ba0 0x7ff4c8148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:35.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4cd51c640 1 -- 172.21.15.26:0/3115303344 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c81597c0 msgr2=0x7ff4c8147cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:35.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4cd51c640 1 --2- 172.21.15.26:0/3115303344 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c81597c0 0x7ff4c8147cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4cd51c640 1 -- 172.21.15.26:0/3115303344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c8159ba0 msgr2=0x7ff4c8148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:35.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4cd51c640 1 --2- 172.21.15.26:0/3115303344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c8159ba0 0x7ff4c8148210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4cd51c640 1 -- 172.21.15.26:0/3115303344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c0009b30 con 0x7ff4c80adc10 2023-10-14T11:13:35.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4cd51c640 1 --2- 172.21.15.26:0/3115303344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c80adc10 0x7ff4c8157e90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400b550 tx=0x7ff4c400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:35.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4bdffb640 1 -- 172.21.15.26:0/3115303344 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4010870 con 0x7ff4c80adc10 2023-10-14T11:13:35.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4bdffb640 1 -- 172.21.15.26:0/3115303344 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c40109f0 con 0x7ff4c80adc10 2023-10-14T11:13:35.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4cf780640 1 -- 172.21.15.26:0/3115303344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c8156e60 con 0x7ff4c80adc10 2023-10-14T11:13:35.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4bdffb640 1 -- 172.21.15.26:0/3115303344 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4010da0 con 0x7ff4c80adc10 2023-10-14T11:13:35.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4cf780640 1 -- 172.21.15.26:0/3115303344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c81573b0 con 0x7ff4c80adc10 2023-10-14T11:13:35.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.433+0000 7ff4cf780640 1 -- 172.21.15.26:0/3115303344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c8074010 con 0x7ff4c80adc10 2023-10-14T11:13:35.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.437+0000 7ff4bdffb640 1 -- 172.21.15.26:0/3115303344 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff4c400f3c0 con 0x7ff4c80adc10 2023-10-14T11:13:35.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.437+0000 7ff4bdffb640 1 --2- 172.21.15.26:0/3115303344 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff4ac0664a0 0x7ff4ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:35.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.437+0000 7ff4bdffb640 1 -- 172.21.15.26:0/3115303344 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff4c40842f0 con 0x7ff4c80adc10 2023-10-14T11:13:35.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.437+0000 7ff4ccd1b640 1 --2- 172.21.15.26:0/3115303344 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff4ac0664a0 0x7ff4ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:35.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.437+0000 7ff4ccd1b640 1 --2- 172.21.15.26:0/3115303344 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff4ac0664a0 0x7ff4ac068960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8006fd0 tx=0x7ff4b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:35.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.441+0000 7ff4bdffb640 1 -- 172.21.15.26:0/3115303344 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff4c4051310 con 0x7ff4c80adc10 2023-10-14T11:13:35.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.597+0000 7ff4cf780640 1 -- 172.21.15.26:0/3115303344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4c80cd3f0 con 0x7ff4c80adc10 2023-10-14T11:13:35.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.601+0000 7ff4bdffb640 1 -- 172.21.15.26:0/3115303344 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18679 (secure 0 0 0) 0x7ff4c4059e60 con 0x7ff4c80adc10 2023-10-14T11:13:35.603 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:35.603 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":27,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:13:03.866737+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:13:35.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.601+0000 7ff4cf780640 1 -- 172.21.15.26:0/3115303344 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff4ac0664a0 msgr2=0x7ff4ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:35.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.601+0000 7ff4cf780640 1 --2- 172.21.15.26:0/3115303344 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff4ac0664a0 0x7ff4ac068960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8006fd0 tx=0x7ff4b8008040 comp rx=0 tx=0).stop 2023-10-14T11:13:35.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.601+0000 7ff4cf780640 1 -- 172.21.15.26:0/3115303344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c80adc10 msgr2=0x7ff4c8157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:35.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.601+0000 7ff4cf780640 1 --2- 172.21.15.26:0/3115303344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c80adc10 0x7ff4c8157e90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400b550 tx=0x7ff4c400ba10 comp rx=0 tx=0).stop 2023-10-14T11:13:35.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.601+0000 7ff4cf780640 1 -- 172.21.15.26:0/3115303344 shutdown_connections 2023-10-14T11:13:35.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.601+0000 7ff4cf780640 1 --2- 172.21.15.26:0/3115303344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c8159ba0 0x7ff4c8148210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.601+0000 7ff4cf780640 1 --2- 172.21.15.26:0/3115303344 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c81597c0 0x7ff4c8147cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.601+0000 7ff4cf780640 1 --2- 172.21.15.26:0/3115303344 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff4ac0664a0 0x7ff4ac068960 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.601+0000 7ff4cf780640 1 --2- 172.21.15.26:0/3115303344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c80adc10 0x7ff4c8157e90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.601+0000 7ff4cf780640 1 -- 172.21.15.26:0/3115303344 >> 172.21.15.26:0/3115303344 conn(0x7ff4c806c190 msgr2=0x7ff4c80ca200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:35.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.601+0000 7ff4cf780640 1 -- 172.21.15.26:0/3115303344 shutdown_connections 2023-10-14T11:13:35.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.601+0000 7ff4cf780640 1 -- 172.21.15.26:0/3115303344 wait complete. 2023-10-14T11:13:35.624 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:12:20.179562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:12:21.346111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T11:12:25.025159+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T11:13:35.625 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:13:35.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.769+0000 7f2255c79640 1 Processor -- start 2023-10-14T11:13:35.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.769+0000 7f2255c79640 1 -- start start 2023-10-14T11:13:35.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.769+0000 7f2255c79640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2250069e90 0x7f225006d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:35.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.769+0000 7f2255c79640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f225006a270 0x7f22500c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:35.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.769+0000 7f2255c79640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225015ae30 con 0x7f22500702f0 2023-10-14T11:13:35.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.769+0000 7f2255c79640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22500cb090 con 0x7f225006a270 2023-10-14T11:13:35.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.769+0000 7f2255c79640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22500ca510 con 0x7f2250069e90 2023-10-14T11:13:35.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.769+0000 7f224effd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f225006a270 0x7f22500c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:35.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.769+0000 7f224effd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f225006a270 0x7f22500c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57978/0 (socket says 172.21.15.26:57978) 2023-10-14T11:13:35.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.769+0000 7f224effd640 1 -- 172.21.15.26:0/271777794 learned_addr learned my addr 172.21.15.26:0/271777794 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:35.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.769+0000 7f224ffff640 1 --1- 172.21.15.26:0/271777794 >> v1:172.21.15.26:6789/0 conn(0x7f22500702f0 0x7f2250070740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35676/0 (socket says 172.21.15.26:35676) 2023-10-14T11:13:35.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.769+0000 7f224f7fe640 1 --2- 172.21.15.26:0/271777794 >> v2:172.21.15.110:3300/0 conn(0x7f2250069e90 0x7f225006d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:35.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.769+0000 7f224effd640 1 -- 172.21.15.26:0/271777794 >> v2:172.21.15.110:3300/0 conn(0x7f2250069e90 msgr2=0x7f225006d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:35.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.769+0000 7f224effd640 1 --2- 172.21.15.26:0/271777794 >> v2:172.21.15.110:3300/0 conn(0x7f2250069e90 0x7f225006d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.769+0000 7f224effd640 1 -- 172.21.15.26:0/271777794 >> v1:172.21.15.26:6789/0 conn(0x7f22500702f0 legacy=0x7f2250070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:35.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.773+0000 7f224effd640 1 -- 172.21.15.26:0/271777794 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22500ca7f0 con 0x7f225006a270 2023-10-14T11:13:35.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.773+0000 7f224e7fc640 1 -- 172.21.15.26:0/271777794 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413196434 0 0) 0x7f225015ae30 con 0x7f22500702f0 2023-10-14T11:13:35.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.773+0000 7f224effd640 1 --2- 172.21.15.26:0/271777794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f225006a270 0x7f22500c9ce0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2250071590 tx=0x7f224401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22b4b746823d53f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:35.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.773+0000 7f224e7fc640 1 -- 172.21.15.26:0/271777794 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22440aa430 con 0x7f225006a270 2023-10-14T11:13:35.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.773+0000 7f224e7fc640 1 -- 172.21.15.26:0/271777794 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22440aa590 con 0x7f225006a270 2023-10-14T11:13:35.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.773+0000 7f224e7fc640 1 -- 172.21.15.26:0/271777794 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22440aa920 con 0x7f225006a270 2023-10-14T11:13:35.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.773+0000 7f2255c79640 1 -- 172.21.15.26:0/271777794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f225006a270 msgr2=0x7f22500c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:35.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.773+0000 7f2255c79640 1 --2- 172.21.15.26:0/271777794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f225006a270 0x7f22500c9ce0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2250071590 tx=0x7f224401c4d0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.773+0000 7f2255c79640 1 -- 172.21.15.26:0/271777794 shutdown_connections 2023-10-14T11:13:35.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.773+0000 7f2255c79640 1 --2- 172.21.15.26:0/271777794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f225006a270 0x7f22500c9ce0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.773+0000 7f2255c79640 1 --2- 172.21.15.26:0/271777794 >> v2:172.21.15.110:3300/0 conn(0x7f2250069e90 0x7f225006d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.773+0000 7f2255c79640 1 -- 172.21.15.26:0/271777794 >> 172.21.15.26:0/271777794 conn(0x7f22500b0da0 msgr2=0x7f22500ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:35.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.773+0000 7f2255c79640 1 -- 172.21.15.26:0/271777794 shutdown_connections 2023-10-14T11:13:35.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.773+0000 7f2255c79640 1 -- 172.21.15.26:0/271777794 wait complete. 2023-10-14T11:13:35.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f2255c79640 1 Processor -- start 2023-10-14T11:13:35.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f2255c79640 1 -- start start 2023-10-14T11:13:35.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f2255c79640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2250069e90 0x7f225015b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:35.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f2255c79640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f225006a270 0x7f22500c16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:35.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f2255c79640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22500702f0 0x7f22500c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:35.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f2255c79640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2250154db0 con 0x7f2250069e90 2023-10-14T11:13:35.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f2255c79640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225015b8b0 con 0x7f225006a270 2023-10-14T11:13:35.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f2255c79640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22500c8030 con 0x7f22500702f0 2023-10-14T11:13:35.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f224f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2250069e90 0x7f225015b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:35.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f224f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2250069e90 0x7f225015b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57988/0 (socket says 172.21.15.26:57988) 2023-10-14T11:13:35.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f224f7fe640 1 -- 172.21.15.26:0/3866281184 learned_addr learned my addr 172.21.15.26:0/3866281184 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:35.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f224ffff640 1 --2- 172.21.15.26:0/3866281184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22500702f0 0x7f22500c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:35.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f224effd640 1 --2- 172.21.15.26:0/3866281184 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f225006a270 0x7f22500c16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:35.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f224f7fe640 1 -- 172.21.15.26:0/3866281184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22500702f0 msgr2=0x7f22500c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:35.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f224f7fe640 1 --2- 172.21.15.26:0/3866281184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22500702f0 0x7f22500c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f224f7fe640 1 -- 172.21.15.26:0/3866281184 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f225006a270 msgr2=0x7f22500c16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:35.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f224f7fe640 1 --2- 172.21.15.26:0/3866281184 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f225006a270 0x7f22500c16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f224f7fe640 1 -- 172.21.15.26:0/3866281184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22440094d0 con 0x7f2250069e90 2023-10-14T11:13:35.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f224f7fe640 1 --2- 172.21.15.26:0/3866281184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2250069e90 0x7f225015b370 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f224000d800 tx=0x7f224000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:35.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f2237fff640 1 -- 172.21.15.26:0/3866281184 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224000b6c0 con 0x7f2250069e90 2023-10-14T11:13:35.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f2237fff640 1 -- 172.21.15.26:0/3866281184 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224000b820 con 0x7f2250069e90 2023-10-14T11:13:35.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f2237fff640 1 -- 172.21.15.26:0/3866281184 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224000bb90 con 0x7f2250069e90 2023-10-14T11:13:35.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.777+0000 7f2255c79640 1 -- 172.21.15.26:0/3866281184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22500c82b0 con 0x7f2250069e90 2023-10-14T11:13:35.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.781+0000 7f2255c79640 1 -- 172.21.15.26:0/3866281184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22500c8870 con 0x7f2250069e90 2023-10-14T11:13:35.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.781+0000 7f2255c79640 1 -- 172.21.15.26:0/3866281184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22500ab910 con 0x7f2250069e90 2023-10-14T11:13:35.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.781+0000 7f2237fff640 1 -- 172.21.15.26:0/3866281184 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f224000bcf0 con 0x7f2250069e90 2023-10-14T11:13:35.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.781+0000 7f2237fff640 1 --2- 172.21.15.26:0/3866281184 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f223c0664a0 0x7f223c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:35.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.781+0000 7f2237fff640 1 -- 172.21.15.26:0/3866281184 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f22400845b0 con 0x7f2250069e90 2023-10-14T11:13:35.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.781+0000 7f224effd640 1 --2- 172.21.15.26:0/3866281184 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f223c0664a0 0x7f223c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:35.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.781+0000 7f224effd640 1 --2- 172.21.15.26:0/3866281184 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f223c0664a0 0x7f223c068960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f22440ae000 tx=0x7f22440a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:35.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.785+0000 7f2237fff640 1 -- 172.21.15.26:0/3866281184 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f22400517b0 con 0x7f2250069e90 2023-10-14T11:13:35.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.941+0000 7f2255c79640 1 -- 172.21.15.26:0/3866281184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f225004e170 con 0x7f2250069e90 2023-10-14T11:13:35.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.941+0000 7f2237fff640 1 -- 172.21.15.26:0/3866281184 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2240054dd0 con 0x7f2250069e90 2023-10-14T11:13:35.947 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:13:35.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.945+0000 7f2255c79640 1 -- 172.21.15.26:0/3866281184 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f223c0664a0 msgr2=0x7f223c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:35.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.945+0000 7f2255c79640 1 --2- 172.21.15.26:0/3866281184 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f223c0664a0 0x7f223c068960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f22440ae000 tx=0x7f22440a7000 comp rx=0 tx=0).stop 2023-10-14T11:13:35.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.945+0000 7f2255c79640 1 -- 172.21.15.26:0/3866281184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2250069e90 msgr2=0x7f225015b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:35.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.945+0000 7f2255c79640 1 --2- 172.21.15.26:0/3866281184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2250069e90 0x7f225015b370 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f224000d800 tx=0x7f224000dcc0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.945+0000 7f2255c79640 1 -- 172.21.15.26:0/3866281184 shutdown_connections 2023-10-14T11:13:35.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.945+0000 7f2255c79640 1 --2- 172.21.15.26:0/3866281184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22500702f0 0x7f22500c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.945+0000 7f2255c79640 1 --2- 172.21.15.26:0/3866281184 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f225006a270 0x7f22500c16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.945+0000 7f2255c79640 1 --2- 172.21.15.26:0/3866281184 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f223c0664a0 0x7f223c068960 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.945+0000 7f2255c79640 1 --2- 172.21.15.26:0/3866281184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2250069e90 0x7f225015b370 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:35.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.945+0000 7f2255c79640 1 -- 172.21.15.26:0/3866281184 >> 172.21.15.26:0/3866281184 conn(0x7f22500b0da0 msgr2=0x7f22500abae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:35.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.945+0000 7f2255c79640 1 -- 172.21.15.26:0/3866281184 shutdown_connections 2023-10-14T11:13:35.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:35.945+0000 7f2255c79640 1 -- 172.21.15.26:0/3866281184 wait complete. 2023-10-14T11:13:35.968 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:13:36.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.113+0000 7fc2fedd9640 1 Processor -- start 2023-10-14T11:13:36.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.113+0000 7fc2fedd9640 1 -- start start 2023-10-14T11:13:36.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.113+0000 7fc2fedd9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2f8159900 0x7fc2f806e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:36.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.113+0000 7fc2fedd9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc2f806a5a0 0x7fc2f80c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:36.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.113+0000 7fc2fedd9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f80b4360 con 0x7fc2f80b3f00 2023-10-14T11:13:36.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.113+0000 7fc2fedd9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f80cd740 con 0x7fc2f806a5a0 2023-10-14T11:13:36.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.113+0000 7fc2fedd9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f80b4600 con 0x7fc2f8159900 2023-10-14T11:13:36.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.117+0000 7fc2fd376640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc2f806a5a0 0x7fc2f80c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:36.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.117+0000 7fc2fcb75640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2f8159900 0x7fc2f806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:36.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.117+0000 7fc2fd376640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc2f806a5a0 0x7fc2f80c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:45830/0 (socket says 172.21.15.26:45830) 2023-10-14T11:13:36.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.117+0000 7fc2fcb75640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2f8159900 0x7fc2f806e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:53704/0 (socket says 172.21.15.26:53704) 2023-10-14T11:13:36.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.117+0000 7fc2fd376640 1 -- 172.21.15.26:0/3490639245 learned_addr learned my addr 172.21.15.26:0/3490639245 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:36.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.117+0000 7fc2f7fff640 1 --1- 172.21.15.26:0/3490639245 >> v1:172.21.15.110:6789/0 conn(0x7fc2f80b3f00 0x7fc2f8069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:39074/0 (socket says 172.21.15.26:39074) 2023-10-14T11:13:36.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.117+0000 7fc2fcb75640 1 -- 172.21.15.26:0/3490639245 >> v2:172.21.15.110:3300/0 conn(0x7fc2f806a5a0 msgr2=0x7fc2f80c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:36.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.117+0000 7fc2fcb75640 1 --2- 172.21.15.26:0/3490639245 >> v2:172.21.15.110:3300/0 conn(0x7fc2f806a5a0 0x7fc2f80c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.117+0000 7fc2fcb75640 1 -- 172.21.15.26:0/3490639245 >> v1:172.21.15.110:6789/0 conn(0x7fc2f80b3f00 legacy=0x7fc2f8069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:36.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.117+0000 7fc2fcb75640 1 -- 172.21.15.26:0/3490639245 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f80c8dd0 con 0x7fc2f8159900 2023-10-14T11:13:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.117+0000 7fc2fcb75640 1 --2- 172.21.15.26:0/3490639245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2f8159900 0x7fc2f806e260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0097c0 tx=0x7fc2ec01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e7736b40f74f10d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.117+0000 7fc2f77fe640 1 -- 172.21.15.26:0/3490639245 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec0ab650 con 0x7fc2f8159900 2023-10-14T11:13:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.117+0000 7fc2f77fe640 1 -- 172.21.15.26:0/3490639245 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ec0ab7b0 con 0x7fc2f8159900 2023-10-14T11:13:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.121+0000 7fc2f77fe640 1 -- 172.21.15.26:0/3490639245 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec0abb40 con 0x7fc2f8159900 2023-10-14T11:13:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.121+0000 7fc2fedd9640 1 -- 172.21.15.26:0/3490639245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2f8159900 msgr2=0x7fc2f806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.121+0000 7fc2fedd9640 1 --2- 172.21.15.26:0/3490639245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2f8159900 0x7fc2f806e260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0097c0 tx=0x7fc2ec01c450 comp rx=0 tx=0).stop 2023-10-14T11:13:36.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.121+0000 7fc2fedd9640 1 -- 172.21.15.26:0/3490639245 shutdown_connections 2023-10-14T11:13:36.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.121+0000 7fc2fedd9640 1 --2- 172.21.15.26:0/3490639245 >> v2:172.21.15.110:3300/0 conn(0x7fc2f806a5a0 0x7fc2f80c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.121+0000 7fc2fedd9640 1 --2- 172.21.15.26:0/3490639245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2f8159900 0x7fc2f806e260 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.121+0000 7fc2fedd9640 1 -- 172.21.15.26:0/3490639245 >> 172.21.15.26:0/3490639245 conn(0x7fc2f80b0da0 msgr2=0x7fc2f80ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:36.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.121+0000 7fc2fedd9640 1 -- 172.21.15.26:0/3490639245 shutdown_connections 2023-10-14T11:13:36.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.121+0000 7fc2fedd9640 1 -- 172.21.15.26:0/3490639245 wait complete. 2023-10-14T11:13:36.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.121+0000 7fc2fedd9640 1 Processor -- start 2023-10-14T11:13:36.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.121+0000 7fc2fedd9640 1 -- start start 2023-10-14T11:13:36.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.121+0000 7fc2fedd9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2f806a5a0 0x7fc2f815c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:36.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.121+0000 7fc2fedd9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2f80b3f00 0x7fc2f81f85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:36.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.121+0000 7fc2fedd9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2f8159900 0x7fc2f815a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:36.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.121+0000 7fc2fedd9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f8153e40 con 0x7fc2f8159900 2023-10-14T11:13:36.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.121+0000 7fc2fedd9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f81f9520 con 0x7fc2f806a5a0 2023-10-14T11:13:36.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.121+0000 7fc2fedd9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f81f8f60 con 0x7fc2f80b3f00 2023-10-14T11:13:36.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.121+0000 7fc2fd376640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2f8159900 0x7fc2f815a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:36.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.121+0000 7fc2fd376640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2f8159900 0x7fc2f815a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57990/0 (socket says 172.21.15.26:57990) 2023-10-14T11:13:36.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.121+0000 7fc2fd376640 1 -- 172.21.15.26:0/2877649463 learned_addr learned my addr 172.21.15.26:0/2877649463 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:36.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.121+0000 7fc2f7fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2f80b3f00 0x7fc2f81f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:36.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.121+0000 7fc2fcb75640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2f806a5a0 0x7fc2f815c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:36.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.125+0000 7fc2fd376640 1 -- 172.21.15.26:0/2877649463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2f80b3f00 msgr2=0x7fc2f81f85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:36.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.125+0000 7fc2fd376640 1 --2- 172.21.15.26:0/2877649463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2f80b3f00 0x7fc2f81f85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.125+0000 7fc2fd376640 1 -- 172.21.15.26:0/2877649463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2f806a5a0 msgr2=0x7fc2f815c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.125+0000 7fc2fd376640 1 --2- 172.21.15.26:0/2877649463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2f806a5a0 0x7fc2f815c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.125+0000 7fc2fd376640 1 -- 172.21.15.26:0/2877649463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ec009420 con 0x7fc2f8159900 2023-10-14T11:13:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.125+0000 7fc2fd376640 1 --2- 172.21.15.26:0/2877649463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2f8159900 0x7fc2f815a040 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0009d90 tx=0x7fc2f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.125+0000 7fc2f57fa640 1 -- 172.21.15.26:0/2877649463 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f000cd20 con 0x7fc2f8159900 2023-10-14T11:13:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.125+0000 7fc2f57fa640 1 -- 172.21.15.26:0/2877649463 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f000f040 con 0x7fc2f8159900 2023-10-14T11:13:36.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.125+0000 7fc2fedd9640 1 -- 172.21.15.26:0/2877649463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f81f9240 con 0x7fc2f8159900 2023-10-14T11:13:36.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.125+0000 7fc2f57fa640 1 -- 172.21.15.26:0/2877649463 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0003bc0 con 0x7fc2f8159900 2023-10-14T11:13:36.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.125+0000 7fc2fedd9640 1 -- 172.21.15.26:0/2877649463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f8146a90 con 0x7fc2f8159900 2023-10-14T11:13:36.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.125+0000 7fc2fedd9640 1 -- 172.21.15.26:0/2877649463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f8153f80 con 0x7fc2f8159900 2023-10-14T11:13:36.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.125+0000 7fc2f57fa640 1 -- 172.21.15.26:0/2877649463 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc2f0003d20 con 0x7fc2f8159900 2023-10-14T11:13:36.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.129+0000 7fc2f57fa640 1 --2- 172.21.15.26:0/2877649463 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc2dc0664a0 0x7fc2dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:36.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.129+0000 7fc2f57fa640 1 -- 172.21.15.26:0/2877649463 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc2f0084700 con 0x7fc2f8159900 2023-10-14T11:13:36.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.129+0000 7fc2fcb75640 1 --2- 172.21.15.26:0/2877649463 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc2dc0664a0 0x7fc2dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:36.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.129+0000 7fc2fcb75640 1 --2- 172.21.15.26:0/2877649463 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc2dc0664a0 0x7fc2dc068960 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0af000 tx=0x7fc2ec0b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:36.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.133+0000 7fc2f57fa640 1 -- 172.21.15.26:0/2877649463 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc2f8153f80 con 0x7fc2f8159900 2023-10-14T11:13:36.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.289+0000 7fc2fedd9640 1 -- 172.21.15.26:0/2877649463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc2f8153f80 con 0x7fc2f8159900 2023-10-14T11:13:36.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.289+0000 7fc2f57fa640 1 -- 172.21.15.26:0/2877649463 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc2f8153f80 con 0x7fc2f8159900 2023-10-14T11:13:36.293 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:36.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.289+0000 7fc2fedd9640 1 -- 172.21.15.26:0/2877649463 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc2dc0664a0 msgr2=0x7fc2dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:36.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.289+0000 7fc2fedd9640 1 --2- 172.21.15.26:0/2877649463 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc2dc0664a0 0x7fc2dc068960 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0af000 tx=0x7fc2ec0b6040 comp rx=0 tx=0).stop 2023-10-14T11:13:36.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.289+0000 7fc2fedd9640 1 -- 172.21.15.26:0/2877649463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2f8159900 msgr2=0x7fc2f815a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:36.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.289+0000 7fc2fedd9640 1 --2- 172.21.15.26:0/2877649463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2f8159900 0x7fc2f815a040 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0009d90 tx=0x7fc2f000c490 comp rx=0 tx=0).stop 2023-10-14T11:13:36.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.289+0000 7fc2fedd9640 1 -- 172.21.15.26:0/2877649463 shutdown_connections 2023-10-14T11:13:36.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.289+0000 7fc2fedd9640 1 --2- 172.21.15.26:0/2877649463 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc2dc0664a0 0x7fc2dc068960 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.289+0000 7fc2fedd9640 1 --2- 172.21.15.26:0/2877649463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2f8159900 0x7fc2f815a040 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.289+0000 7fc2fedd9640 1 --2- 172.21.15.26:0/2877649463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2f80b3f00 0x7fc2f81f85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.289+0000 7fc2fedd9640 1 --2- 172.21.15.26:0/2877649463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2f806a5a0 0x7fc2f815c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.289+0000 7fc2fedd9640 1 -- 172.21.15.26:0/2877649463 >> 172.21.15.26:0/2877649463 conn(0x7fc2f80b0da0 msgr2=0x7fc2f8069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:36.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.289+0000 7fc2fedd9640 1 -- 172.21.15.26:0/2877649463 shutdown_connections 2023-10-14T11:13:36.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.289+0000 7fc2fedd9640 1 -- 172.21.15.26:0/2877649463 wait complete. 2023-10-14T11:13:36.315 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:13:36.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.457+0000 7f5a7b59e640 1 Processor -- start 2023-10-14T11:13:36.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.457+0000 7f5a7b59e640 1 -- start start 2023-10-14T11:13:36.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.461+0000 7f5a7b59e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a7c15cdc0 0x7f5a7c0cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:36.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.461+0000 7f5a7b59e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5a7c0b3cb0 0x7f5a7c0cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:36.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.461+0000 7f5a7b59e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7c0d0880 con 0x7f5a7c0cf210 2023-10-14T11:13:36.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.461+0000 7f5a7b59e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7c0b1c00 con 0x7f5a7c0b3cb0 2023-10-14T11:13:36.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.461+0000 7f5a7b59e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c0b1ee0 con 0x7f5a7c15cdc0 2023-10-14T11:13:36.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.461+0000 7f5a7ad9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5a7c0b3cb0 0x7f5a7c0cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:36.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.461+0000 7f5a7a59c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5a7c0cf210 0x7f5a7c0cf5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35678/0 (socket says 172.21.15.26:35678) 2023-10-14T11:13:36.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.461+0000 7f5a7a59c640 1 -- 172.21.15.26:0/2615326642 learned_addr learned my addr 172.21.15.26:0/2615326642 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:36.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.461+0000 7f5a73fff640 1 --2- 172.21.15.26:0/2615326642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a7c15cdc0 0x7f5a7c0cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:36.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.461+0000 7f5a7ad9d640 1 -- 172.21.15.26:0/2615326642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a7c15cdc0 msgr2=0x7f5a7c0cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:36.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.461+0000 7f5a7ad9d640 1 --2- 172.21.15.26:0/2615326642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a7c15cdc0 0x7f5a7c0cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.461+0000 7f5a7ad9d640 1 -- 172.21.15.26:0/2615326642 >> v1:172.21.15.26:6789/0 conn(0x7f5a7c0cf210 legacy=0x7f5a7c0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:36.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.461+0000 7f5a7ad9d640 1 -- 172.21.15.26:0/2615326642 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c0b21c0 con 0x7f5a7c0b3cb0 2023-10-14T11:13:36.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.461+0000 7f5a79d9b640 1 -- 172.21.15.26:0/2615326642 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 454011739 0 0) 0x7f5a7c0d0880 con 0x7f5a7c0cf210 2023-10-14T11:13:36.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.461+0000 7f5a73fff640 1 --2- 172.21.15.26:0/2615326642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a7c15cdc0 0x7f5a7c0cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:36.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.465+0000 7f5a7ad9d640 1 --2- 172.21.15.26:0/2615326642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a7c0b3cb0 0x7f5a7c0cda00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009d90 tx=0x7f5a7401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bbeec7ab835b7db server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:36.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.465+0000 7f5a79d9b640 1 -- 172.21.15.26:0/2615326642 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a740a58f0 con 0x7f5a7c0b3cb0 2023-10-14T11:13:36.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.465+0000 7f5a79d9b640 1 -- 172.21.15.26:0/2615326642 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a740a5a50 con 0x7f5a7c0b3cb0 2023-10-14T11:13:36.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.465+0000 7f5a79d9b640 1 -- 172.21.15.26:0/2615326642 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a740a5de0 con 0x7f5a7c0b3cb0 2023-10-14T11:13:36.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.465+0000 7f5a7b59e640 1 -- 172.21.15.26:0/2615326642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a7c0b3cb0 msgr2=0x7f5a7c0cda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:36.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.465+0000 7f5a7b59e640 1 --2- 172.21.15.26:0/2615326642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a7c0b3cb0 0x7f5a7c0cda00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009d90 tx=0x7f5a7401c920 comp rx=0 tx=0).stop 2023-10-14T11:13:36.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.465+0000 7f5a7b59e640 1 -- 172.21.15.26:0/2615326642 shutdown_connections 2023-10-14T11:13:36.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.465+0000 7f5a7b59e640 1 --2- 172.21.15.26:0/2615326642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a7c0b3cb0 0x7f5a7c0cda00 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.465+0000 7f5a7b59e640 1 --2- 172.21.15.26:0/2615326642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a7c15cdc0 0x7f5a7c0cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.465+0000 7f5a7b59e640 1 -- 172.21.15.26:0/2615326642 >> 172.21.15.26:0/2615326642 conn(0x7f5a7c0d2800 msgr2=0x7f5a7c0d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:36.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.465+0000 7f5a7b59e640 1 -- 172.21.15.26:0/2615326642 shutdown_connections 2023-10-14T11:13:36.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.465+0000 7f5a7b59e640 1 -- 172.21.15.26:0/2615326642 wait complete. 2023-10-14T11:13:36.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.465+0000 7f5a7b59e640 1 Processor -- start 2023-10-14T11:13:36.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.465+0000 7f5a7b59e640 1 -- start start 2023-10-14T11:13:36.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.465+0000 7f5a7b59e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a7c0b3cb0 0x7f5a7c15ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:36.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.465+0000 7f5a7b59e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a7c0cf210 0x7f5a7c0c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:36.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.465+0000 7f5a7b59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a7c15cdc0 0x7f5a7c1596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:36.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.465+0000 7f5a7b59e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c0b67c0 con 0x7f5a7c15cdc0 2023-10-14T11:13:36.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.465+0000 7f5a7b59e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c0b6aa0 con 0x7f5a7c0b3cb0 2023-10-14T11:13:36.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.465+0000 7f5a7b59e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c0b6d80 con 0x7f5a7c0cf210 2023-10-14T11:13:36.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.469+0000 7f5a7ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a7c15cdc0 0x7f5a7c1596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:36.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.469+0000 7f5a7ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a7c15cdc0 0x7f5a7c1596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57998/0 (socket says 172.21.15.26:57998) 2023-10-14T11:13:36.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.469+0000 7f5a7ad9d640 1 -- 172.21.15.26:0/1517945283 learned_addr learned my addr 172.21.15.26:0/1517945283 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:36.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.469+0000 7f5a7a59c640 1 --2- 172.21.15.26:0/1517945283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a7c0b3cb0 0x7f5a7c15ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:36.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.469+0000 7f5a73fff640 1 --2- 172.21.15.26:0/1517945283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a7c0cf210 0x7f5a7c0c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:36.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.469+0000 7f5a7ad9d640 1 -- 172.21.15.26:0/1517945283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a7c0cf210 msgr2=0x7f5a7c0c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:36.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.469+0000 7f5a7ad9d640 1 --2- 172.21.15.26:0/1517945283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a7c0cf210 0x7f5a7c0c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.469+0000 7f5a7ad9d640 1 -- 172.21.15.26:0/1517945283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a7c0b3cb0 msgr2=0x7f5a7c15ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:36.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.469+0000 7f5a7ad9d640 1 --2- 172.21.15.26:0/1517945283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a7c0b3cb0 0x7f5a7c15ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.469+0000 7f5a7ad9d640 1 -- 172.21.15.26:0/1517945283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a74009a70 con 0x7f5a7c15cdc0 2023-10-14T11:13:36.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.469+0000 7f5a73fff640 1 --2- 172.21.15.26:0/1517945283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a7c0cf210 0x7f5a7c0c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:36.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.469+0000 7f5a7ad9d640 1 --2- 172.21.15.26:0/1517945283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a7c15cdc0 0x7f5a7c1596c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5a740b0040 tx=0x7f5a740196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:36.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.469+0000 7f5a72ffd640 1 -- 172.21.15.26:0/1517945283 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a740b9860 con 0x7f5a7c15cdc0 2023-10-14T11:13:36.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.469+0000 7f5a72ffd640 1 -- 172.21.15.26:0/1517945283 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a740b99c0 con 0x7f5a7c15cdc0 2023-10-14T11:13:36.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.469+0000 7f5a72ffd640 1 -- 172.21.15.26:0/1517945283 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a740b9d70 con 0x7f5a7c15cdc0 2023-10-14T11:13:36.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.469+0000 7f5a7b59e640 1 -- 172.21.15.26:0/1517945283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a7c0b7060 con 0x7f5a7c15cdc0 2023-10-14T11:13:36.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.469+0000 7f5a7b59e640 1 -- 172.21.15.26:0/1517945283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7c0b6470 con 0x7f5a7c15cdc0 2023-10-14T11:13:36.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.469+0000 7f5a7b59e640 1 -- 172.21.15.26:0/1517945283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a7c04e9c0 con 0x7f5a7c15cdc0 2023-10-14T11:13:36.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.469+0000 7f5a72ffd640 1 -- 172.21.15.26:0/1517945283 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5a740c4460 con 0x7f5a7c15cdc0 2023-10-14T11:13:36.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.473+0000 7f5a72ffd640 1 --2- 172.21.15.26:0/1517945283 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5a5c0664a0 0x7f5a5c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:36.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.473+0000 7f5a72ffd640 1 -- 172.21.15.26:0/1517945283 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5a7411f7c0 con 0x7f5a7c15cdc0 2023-10-14T11:13:36.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.473+0000 7f5a7a59c640 1 --2- 172.21.15.26:0/1517945283 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5a5c0664a0 0x7f5a5c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:36.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.473+0000 7f5a7a59c640 1 --2- 172.21.15.26:0/1517945283 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5a5c0664a0 0x7f5a5c068960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0010f0 tx=0x7f5a6c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:36.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.477+0000 7f5a72ffd640 1 -- 172.21.15.26:0/1517945283 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5a740ec760 con 0x7f5a7c15cdc0 2023-10-14T11:13:36.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.629+0000 7f5a7b59e640 1 -- 172.21.15.26:0/1517945283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5a7c0d1550 con 0x7f5a7c15cdc0 2023-10-14T11:13:36.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.629+0000 7f5a72ffd640 1 -- 172.21.15.26:0/1517945283 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5a740efd80 con 0x7f5a7c15cdc0 2023-10-14T11:13:36.635 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:13:36.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.633+0000 7f5a7b59e640 1 -- 172.21.15.26:0/1517945283 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5a5c0664a0 msgr2=0x7f5a5c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:36.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.633+0000 7f5a7b59e640 1 --2- 172.21.15.26:0/1517945283 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5a5c0664a0 0x7f5a5c068960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0010f0 tx=0x7f5a6c009040 comp rx=0 tx=0).stop 2023-10-14T11:13:36.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.633+0000 7f5a7b59e640 1 -- 172.21.15.26:0/1517945283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a7c15cdc0 msgr2=0x7f5a7c1596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:36.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.633+0000 7f5a7b59e640 1 --2- 172.21.15.26:0/1517945283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a7c15cdc0 0x7f5a7c1596c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5a740b0040 tx=0x7f5a740196c0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.633+0000 7f5a7b59e640 1 -- 172.21.15.26:0/1517945283 shutdown_connections 2023-10-14T11:13:36.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.633+0000 7f5a7b59e640 1 --2- 172.21.15.26:0/1517945283 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5a5c0664a0 0x7f5a5c068960 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.633+0000 7f5a7b59e640 1 --2- 172.21.15.26:0/1517945283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a7c15cdc0 0x7f5a7c1596c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.633+0000 7f5a7b59e640 1 --2- 172.21.15.26:0/1517945283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a7c0cf210 0x7f5a7c0c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.633+0000 7f5a7b59e640 1 --2- 172.21.15.26:0/1517945283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a7c0b3cb0 0x7f5a7c15ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.633+0000 7f5a7b59e640 1 -- 172.21.15.26:0/1517945283 >> 172.21.15.26:0/1517945283 conn(0x7f5a7c0d2800 msgr2=0x7f5a7c0cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:36.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.633+0000 7f5a7b59e640 1 -- 172.21.15.26:0/1517945283 shutdown_connections 2023-10-14T11:13:36.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.633+0000 7f5a7b59e640 1 -- 172.21.15.26:0/1517945283 wait complete. 2023-10-14T11:13:36.655 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T11:13:36.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.797+0000 7f4e85580640 1 Processor -- start 2023-10-14T11:13:36.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.797+0000 7f4e85580640 1 -- start start 2023-10-14T11:13:36.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.801+0000 7f4e85580640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4e800b14c0 0x7f4e800b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:36.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.801+0000 7f4e85580640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e800afc40 con 0x7f4e800d0830 2023-10-14T11:13:36.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.801+0000 7f4e85580640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e800aff20 con 0x7f4e8015feb0 2023-10-14T11:13:36.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.801+0000 7f4e85580640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e800b0200 con 0x7f4e800b14c0 2023-10-14T11:13:36.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.801+0000 7f4e7e7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4e800b14c0 0x7f4e800b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:36.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.801+0000 7f4e7f7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4e800d0830 0x7f4e800d0c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35682/0 (socket says 172.21.15.26:35682) 2023-10-14T11:13:36.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.801+0000 7f4e7f7fe640 1 -- 172.21.15.26:0/2209583817 learned_addr learned my addr 172.21.15.26:0/2209583817 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:36.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.801+0000 7f4e7e7fc640 1 -- 172.21.15.26:0/2209583817 >> v1:172.21.15.110:6789/0 conn(0x7f4e8015feb0 legacy=0x7f4e800af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:36.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.801+0000 7f4e7e7fc640 1 -- 172.21.15.26:0/2209583817 >> v1:172.21.15.26:6789/0 conn(0x7f4e800d0830 legacy=0x7f4e800d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:36.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.801+0000 7f4e7e7fc640 1 -- 172.21.15.26:0/2209583817 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e800b04e0 con 0x7f4e800b14c0 2023-10-14T11:13:36.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.801+0000 7f4e7dffb640 1 -- 172.21.15.26:0/2209583817 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519270003 0 0) 0x7f4e800afc40 con 0x7f4e800d0830 2023-10-14T11:13:36.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.801+0000 7f4e7e7fc640 1 --2- 172.21.15.26:0/2209583817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e800b14c0 0x7f4e800b0ce0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4e740097c0 tx=0x7f4e7401cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712522fa35a3c691 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:36.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.805+0000 7f4e7dffb640 1 -- 172.21.15.26:0/2209583817 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e740ac600 con 0x7f4e800b14c0 2023-10-14T11:13:36.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.805+0000 7f4e7dffb640 1 -- 172.21.15.26:0/2209583817 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e740a8050 con 0x7f4e800b14c0 2023-10-14T11:13:36.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.805+0000 7f4e7dffb640 1 -- 172.21.15.26:0/2209583817 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e740ac980 con 0x7f4e800b14c0 2023-10-14T11:13:36.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.805+0000 7f4e85580640 1 -- 172.21.15.26:0/2209583817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e800b14c0 msgr2=0x7f4e800b0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:36.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.805+0000 7f4e85580640 1 --2- 172.21.15.26:0/2209583817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e800b14c0 0x7f4e800b0ce0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4e740097c0 tx=0x7f4e7401cde0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.805+0000 7f4e85580640 1 -- 172.21.15.26:0/2209583817 shutdown_connections 2023-10-14T11:13:36.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.805+0000 7f4e85580640 1 --2- 172.21.15.26:0/2209583817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e800b14c0 0x7f4e800b0ce0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.805+0000 7f4e85580640 1 -- 172.21.15.26:0/2209583817 >> 172.21.15.26:0/2209583817 conn(0x7f4e80089f80 msgr2=0x7f4e800d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:36.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.805+0000 7f4e85580640 1 -- 172.21.15.26:0/2209583817 shutdown_connections 2023-10-14T11:13:36.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.805+0000 7f4e85580640 1 -- 172.21.15.26:0/2209583817 wait complete. 2023-10-14T11:13:36.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.805+0000 7f4e85580640 1 Processor -- start 2023-10-14T11:13:36.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.805+0000 7f4e85580640 1 -- start start 2023-10-14T11:13:36.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.805+0000 7f4e85580640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e800b14c0 0x7f4e800cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:36.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.805+0000 7f4e85580640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e800d0830 0x7f4e800c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:36.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.805+0000 7f4e85580640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e8015feb0 0x7f4e80151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:36.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.805+0000 7f4e85580640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e800cc870 con 0x7f4e800b14c0 2023-10-14T11:13:36.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.805+0000 7f4e85580640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e800cd490 con 0x7f4e8015feb0 2023-10-14T11:13:36.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.805+0000 7f4e85580640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e80151fb0 con 0x7f4e800d0830 2023-10-14T11:13:36.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.805+0000 7f4e7effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e800b14c0 0x7f4e800cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:36.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.805+0000 7f4e7effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e800b14c0 0x7f4e800cc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58010/0 (socket says 172.21.15.26:58010) 2023-10-14T11:13:36.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.805+0000 7f4e7effd640 1 -- 172.21.15.26:0/3542398388 learned_addr learned my addr 172.21.15.26:0/3542398388 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:36.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.809+0000 7f4e7e7fc640 1 --2- 172.21.15.26:0/3542398388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e800d0830 0x7f4e800c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:36.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.809+0000 7f4e7f7fe640 1 --2- 172.21.15.26:0/3542398388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e8015feb0 0x7f4e80151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:36.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.809+0000 7f4e7effd640 1 -- 172.21.15.26:0/3542398388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e800d0830 msgr2=0x7f4e800c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:36.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.809+0000 7f4e7effd640 1 --2- 172.21.15.26:0/3542398388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e800d0830 0x7f4e800c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.809+0000 7f4e7effd640 1 -- 172.21.15.26:0/3542398388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e8015feb0 msgr2=0x7f4e80151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:36.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.809+0000 7f4e7effd640 1 --2- 172.21.15.26:0/3542398388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e8015feb0 0x7f4e80151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.809+0000 7f4e7effd640 1 -- 172.21.15.26:0/3542398388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e74009420 con 0x7f4e800b14c0 2023-10-14T11:13:36.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.809+0000 7f4e7effd640 1 --2- 172.21.15.26:0/3542398388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e800b14c0 0x7f4e800cc330 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000b3f0 tx=0x7f4e7000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:36.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.809+0000 7f4e677fe640 1 -- 172.21.15.26:0/3542398388 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e70011830 con 0x7f4e800b14c0 2023-10-14T11:13:36.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.809+0000 7f4e677fe640 1 -- 172.21.15.26:0/3542398388 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e700119b0 con 0x7f4e800b14c0 2023-10-14T11:13:36.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.809+0000 7f4e677fe640 1 -- 172.21.15.26:0/3542398388 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e70011d60 con 0x7f4e800b14c0 2023-10-14T11:13:36.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.809+0000 7f4e85580640 1 -- 172.21.15.26:0/3542398388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e80152290 con 0x7f4e800b14c0 2023-10-14T11:13:36.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.809+0000 7f4e85580640 1 -- 172.21.15.26:0/3542398388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e800cdde0 con 0x7f4e800b14c0 2023-10-14T11:13:36.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.809+0000 7f4e85580640 1 -- 172.21.15.26:0/3542398388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e80152480 con 0x7f4e800b14c0 2023-10-14T11:13:36.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.809+0000 7f4e677fe640 1 -- 172.21.15.26:0/3542398388 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4e7001a400 con 0x7f4e800b14c0 2023-10-14T11:13:36.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.809+0000 7f4e677fe640 1 --2- 172.21.15.26:0/3542398388 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4e6c0664f0 0x7f4e6c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:36.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.809+0000 7f4e677fe640 1 -- 172.21.15.26:0/3542398388 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4e70084400 con 0x7f4e800b14c0 2023-10-14T11:13:36.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.809+0000 7f4e7e7fc640 1 --2- 172.21.15.26:0/3542398388 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4e6c0664f0 0x7f4e6c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:36.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.813+0000 7f4e7e7fc640 1 --2- 172.21.15.26:0/3542398388 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4e6c0664f0 0x7f4e6c0689b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4e740ae000 tx=0x7f4e74008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:36.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.813+0000 7f4e677fe640 1 -- 172.21.15.26:0/3542398388 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4e700514a0 con 0x7f4e800b14c0 2023-10-14T11:13:36.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.973+0000 7f4e85580640 1 -- 172.21.15.26:0/3542398388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4e800cdfd0 con 0x7f4e800b14c0 2023-10-14T11:13:36.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.973+0000 7f4e677fe640 1 -- 172.21.15.26:0/3542398388 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4e700150a0 con 0x7f4e800b14c0 2023-10-14T11:13:36.977 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:13:36.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.977+0000 7f4e85580640 1 -- 172.21.15.26:0/3542398388 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4e6c0664f0 msgr2=0x7f4e6c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:36.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.977+0000 7f4e85580640 1 --2- 172.21.15.26:0/3542398388 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4e6c0664f0 0x7f4e6c0689b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4e740ae000 tx=0x7f4e74008040 comp rx=0 tx=0).stop 2023-10-14T11:13:36.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.977+0000 7f4e85580640 1 -- 172.21.15.26:0/3542398388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e800b14c0 msgr2=0x7f4e800cc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:36.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.977+0000 7f4e85580640 1 --2- 172.21.15.26:0/3542398388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e800b14c0 0x7f4e800cc330 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000b3f0 tx=0x7f4e7000b8b0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.977+0000 7f4e85580640 1 -- 172.21.15.26:0/3542398388 shutdown_connections 2023-10-14T11:13:36.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.977+0000 7f4e85580640 1 --2- 172.21.15.26:0/3542398388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e8015feb0 0x7f4e80151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.977+0000 7f4e85580640 1 --2- 172.21.15.26:0/3542398388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e800d0830 0x7f4e800c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.977+0000 7f4e85580640 1 --2- 172.21.15.26:0/3542398388 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4e6c0664f0 0x7f4e6c0689b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.977+0000 7f4e85580640 1 --2- 172.21.15.26:0/3542398388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e800b14c0 0x7f4e800cc330 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:36.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.977+0000 7f4e85580640 1 -- 172.21.15.26:0/3542398388 >> 172.21.15.26:0/3542398388 conn(0x7f4e80089f80 msgr2=0x7f4e800d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:36.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.977+0000 7f4e85580640 1 -- 172.21.15.26:0/3542398388 shutdown_connections 2023-10-14T11:13:36.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:36.977+0000 7f4e85580640 1 -- 172.21.15.26:0/3542398388 wait complete. 2023-10-14T11:13:36.999 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:13:37.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f280849e640 1 Processor -- start 2023-10-14T11:13:37.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f280849e640 1 -- start start 2023-10-14T11:13:37.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f280849e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f280015cb90 0x7f28000cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:37.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f280849e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28000ce770 con 0x7f28000d15d0 2023-10-14T11:13:37.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f280849e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28000d0600 con 0x7f28000d3010 2023-10-14T11:13:37.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f280849e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28000c6450 con 0x7f280015cb90 2023-10-14T11:13:37.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f2806a3b640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f28000d15d0 0x7f28000c6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35692/0 (socket says 172.21.15.26:35692) 2023-10-14T11:13:37.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f2806a3b640 1 -- 172.21.15.26:0/2251628826 learned_addr learned my addr 172.21.15.26:0/2251628826 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:37.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f280623a640 1 --2- 172.21.15.26:0/2251628826 >> v2:172.21.15.110:3300/0 conn(0x7f280015cb90 0x7f28000cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:37.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f2805238640 1 -- 172.21.15.26:0/2251628826 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3134943924 0 0) 0x7f28000ce770 con 0x7f28000d15d0 2023-10-14T11:13:37.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f2805238640 1 -- 172.21.15.26:0/2251628826 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27ec003530 con 0x7f28000d15d0 2023-10-14T11:13:37.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f2805238640 1 -- 172.21.15.26:0/2251628826 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3595152872 0 0) 0x7f27ec003530 con 0x7f28000d15d0 2023-10-14T11:13:37.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f2805238640 1 -- 172.21.15.26:0/2251628826 >> v2:172.21.15.110:3300/0 conn(0x7f280015cb90 msgr2=0x7f28000cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:37.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f2805238640 1 --2- 172.21.15.26:0/2251628826 >> v2:172.21.15.110:3300/0 conn(0x7f280015cb90 0x7f28000cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f2805238640 1 -- 172.21.15.26:0/2251628826 >> v1:172.21.15.110:6789/0 conn(0x7f28000d3010 legacy=0x7f28000d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:37.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f2805238640 1 -- 172.21.15.26:0/2251628826 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28000d08a0 con 0x7f28000d15d0 2023-10-14T11:13:37.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f2805238640 1 -- 172.21.15.26:0/2251628826 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f27f8001a20 con 0x7f28000d15d0 2023-10-14T11:13:37.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f2805238640 1 -- 172.21.15.26:0/2251628826 >> v1:172.21.15.26:6789/0 conn(0x7f28000d15d0 legacy=0x7f28000c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:37.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f2805238640 1 --2- 172.21.15.26:0/2251628826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27ec003980 0x7f27ec003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:37.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f2805238640 1 --2- 172.21.15.26:0/2251628826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27ec0047d0 0x7f27ec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:37.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f2805238640 1 --2- 172.21.15.26:0/2251628826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27ec005190 0x7f27ec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:37.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f2805238640 1 -- 172.21.15.26:0/2251628826 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28000c6450 con 0x7f27ec0047d0 2023-10-14T11:13:37.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f2805238640 1 -- 172.21.15.26:0/2251628826 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec00c130 con 0x7f27ec003980 2023-10-14T11:13:37.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f2805238640 1 -- 172.21.15.26:0/2251628826 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec00c2f0 con 0x7f27ec005190 2023-10-14T11:13:37.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f2805a39640 1 --2- 172.21.15.26:0/2251628826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27ec0047d0 0x7f27ec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:37.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f280623a640 1 --2- 172.21.15.26:0/2251628826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27ec003980 0x7f27ec003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:37.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.141+0000 7f2806a3b640 1 --2- 172.21.15.26:0/2251628826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27ec005190 0x7f27ec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:37.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.145+0000 7f2805a39640 1 -- 172.21.15.26:0/2251628826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27ec005190 msgr2=0x7f27ec00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:37.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.145+0000 7f2805a39640 1 --2- 172.21.15.26:0/2251628826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27ec005190 0x7f27ec00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.145+0000 7f2805a39640 1 -- 172.21.15.26:0/2251628826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27ec003980 msgr2=0x7f27ec003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:37.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.145+0000 7f2805a39640 1 --2- 172.21.15.26:0/2251628826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27ec003980 0x7f27ec003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.145+0000 7f2805a39640 1 -- 172.21.15.26:0/2251628826 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec003530 con 0x7f27ec0047d0 2023-10-14T11:13:37.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.145+0000 7f2806a3b640 1 -- 172.21.15.26:0/2251628826 reap_dead start 2023-10-14T11:13:37.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.145+0000 7f2805a39640 1 --2- 172.21.15.26:0/2251628826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27ec0047d0 0x7f27ec004c50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f27f0001780 tx=0x7f27f001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e008b23735b960d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:37.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.145+0000 7f2805238640 1 -- 172.21.15.26:0/2251628826 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f00052d0 con 0x7f27ec0047d0 2023-10-14T11:13:37.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.145+0000 7f2805238640 1 -- 172.21.15.26:0/2251628826 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f0005450 con 0x7f27ec0047d0 2023-10-14T11:13:37.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.145+0000 7f2805238640 1 -- 172.21.15.26:0/2251628826 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0003840 con 0x7f27ec0047d0 2023-10-14T11:13:37.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.145+0000 7f280849e640 1 -- 172.21.15.26:0/2251628826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27ec0047d0 msgr2=0x7f27ec004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:37.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.145+0000 7f280849e640 1 --2- 172.21.15.26:0/2251628826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27ec0047d0 0x7f27ec004c50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f27f0001780 tx=0x7f27f001c3b0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.145+0000 7f280849e640 1 -- 172.21.15.26:0/2251628826 shutdown_connections 2023-10-14T11:13:37.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.145+0000 7f280849e640 1 --2- 172.21.15.26:0/2251628826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27ec0047d0 0x7f27ec004c50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.145+0000 7f280849e640 1 -- 172.21.15.26:0/2251628826 >> 172.21.15.26:0/2251628826 conn(0x7f280009bc50 msgr2=0x7f28000d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:37.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.145+0000 7f280849e640 1 -- 172.21.15.26:0/2251628826 shutdown_connections 2023-10-14T11:13:37.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.145+0000 7f280849e640 1 -- 172.21.15.26:0/2251628826 wait complete. 2023-10-14T11:13:37.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.149+0000 7f280849e640 1 Processor -- start 2023-10-14T11:13:37.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.149+0000 7f280849e640 1 -- start start 2023-10-14T11:13:37.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.149+0000 7f280849e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27ec0047d0 0x7f2800157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:37.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.149+0000 7f280849e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28000b7aa0 0x7f28000b7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:37.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.149+0000 7f280849e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28001589e0 0x7f2800158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:37.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.149+0000 7f280849e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28000b6a00 con 0x7f27ec0047d0 2023-10-14T11:13:37.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.149+0000 7f280849e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28000b6ce0 con 0x7f28001589e0 2023-10-14T11:13:37.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.149+0000 7f280849e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28000b6fc0 con 0x7f28000b7aa0 2023-10-14T11:13:37.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.149+0000 7f280623a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27ec0047d0 0x7f2800157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:37.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.149+0000 7f280623a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27ec0047d0 0x7f2800157970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58034/0 (socket says 172.21.15.26:58034) 2023-10-14T11:13:37.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.149+0000 7f280623a640 1 -- 172.21.15.26:0/2050588968 learned_addr learned my addr 172.21.15.26:0/2050588968 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:37.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.149+0000 7f280623a640 1 -- 172.21.15.26:0/2050588968 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28000b7aa0 msgr2=0x7f28000b7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:37.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.149+0000 7f280623a640 1 --2- 172.21.15.26:0/2050588968 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28000b7aa0 0x7f28000b7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.149+0000 7f280623a640 1 -- 172.21.15.26:0/2050588968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28001589e0 msgr2=0x7f2800158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:37.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.149+0000 7f280623a640 1 --2- 172.21.15.26:0/2050588968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28001589e0 0x7f2800158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.149+0000 7f280623a640 1 -- 172.21.15.26:0/2050588968 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28000b72a0 con 0x7f27ec0047d0 2023-10-14T11:13:37.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.149+0000 7f280623a640 1 --2- 172.21.15.26:0/2050588968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27ec0047d0 0x7f2800157970 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0119a0 tx=0x7f27fc011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:37.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.149+0000 7f27f6ffd640 1 -- 172.21.15.26:0/2050588968 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc00fa70 con 0x7f27ec0047d0 2023-10-14T11:13:37.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.149+0000 7f27f6ffd640 1 -- 172.21.15.26:0/2050588968 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc00fbd0 con 0x7f27ec0047d0 2023-10-14T11:13:37.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.149+0000 7f27f6ffd640 1 -- 172.21.15.26:0/2050588968 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc014440 con 0x7f27ec0047d0 2023-10-14T11:13:37.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.149+0000 7f280849e640 1 -- 172.21.15.26:0/2050588968 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28000b7580 con 0x7f27ec0047d0 2023-10-14T11:13:37.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.149+0000 7f280849e640 1 -- 172.21.15.26:0/2050588968 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28000ce600 con 0x7f27ec0047d0 2023-10-14T11:13:37.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.153+0000 7f280849e640 1 -- 172.21.15.26:0/2050588968 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2800074010 con 0x7f27ec0047d0 2023-10-14T11:13:37.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.153+0000 7f27f6ffd640 1 -- 172.21.15.26:0/2050588968 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f27fc0145a0 con 0x7f27ec0047d0 2023-10-14T11:13:37.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.153+0000 7f27f6ffd640 1 --2- 172.21.15.26:0/2050588968 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27e40664f0 0x7f27e40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:37.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.153+0000 7f27f6ffd640 1 -- 172.21.15.26:0/2050588968 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f27fc084a20 con 0x7f27ec0047d0 2023-10-14T11:13:37.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.153+0000 7f2805a39640 1 --2- 172.21.15.26:0/2050588968 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27e40664f0 0x7f27e40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:37.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.153+0000 7f2805a39640 1 --2- 172.21.15.26:0/2050588968 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27e40664f0 0x7f27e40689b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f27f0001750 tx=0x7f27f0001130 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:37.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.157+0000 7f27f6ffd640 1 -- 172.21.15.26:0/2050588968 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f27fc051b40 con 0x7f27ec0047d0 2023-10-14T11:13:37.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.345+0000 7f280849e640 1 -- 172.21.15.26:0/2050588968 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28000d2be0 con 0x7f27ec0047d0 2023-10-14T11:13:37.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.345+0000 7f27f6ffd640 1 -- 172.21.15.26:0/2050588968 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f27fc055160 con 0x7f27ec0047d0 2023-10-14T11:13:37.351 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:37.351 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/2685368784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2685368784},{"type":"v1","addr":"172.21.15.110:6834","nonce":2685368784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6836/4242453713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":4242453713},{"type":"v1","addr":"172.21.15.26:6836","nonce":4242453713}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3507761146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":3507761146},{"type":"v1","addr":"172.21.15.26:6837","nonce":3507761146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:12:22.355867+0000","modified":"2023-10-14T11:12:46.435346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3522025152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3522025152},{"type":"v1","addr":"172.21.15.110:6835","nonce":3522025152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T11:13:37.351 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 9 2023-10-14T11:13:37.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.349+0000 7f280849e640 1 -- 172.21.15.26:0/2050588968 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27e40664f0 msgr2=0x7f27e40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:37.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.349+0000 7f280849e640 1 --2- 172.21.15.26:0/2050588968 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27e40664f0 0x7f27e40689b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f27f0001750 tx=0x7f27f0001130 comp rx=0 tx=0).stop 2023-10-14T11:13:37.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.349+0000 7f280849e640 1 -- 172.21.15.26:0/2050588968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27ec0047d0 msgr2=0x7f2800157970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:37.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.349+0000 7f280849e640 1 --2- 172.21.15.26:0/2050588968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27ec0047d0 0x7f2800157970 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0119a0 tx=0x7f27fc011e60 comp rx=0 tx=0).stop 2023-10-14T11:13:37.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.349+0000 7f280849e640 1 -- 172.21.15.26:0/2050588968 shutdown_connections 2023-10-14T11:13:37.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.349+0000 7f280849e640 1 --2- 172.21.15.26:0/2050588968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28001589e0 0x7f2800158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.349+0000 7f280849e640 1 --2- 172.21.15.26:0/2050588968 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28000b7aa0 0x7f28000b7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.349+0000 7f280849e640 1 --2- 172.21.15.26:0/2050588968 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27e40664f0 0x7f27e40689b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.349+0000 7f280849e640 1 --2- 172.21.15.26:0/2050588968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27ec0047d0 0x7f2800157970 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.349+0000 7f280849e640 1 -- 172.21.15.26:0/2050588968 >> 172.21.15.26:0/2050588968 conn(0x7f280009bc50 msgr2=0x7f280015baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:37.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.349+0000 7f280849e640 1 -- 172.21.15.26:0/2050588968 shutdown_connections 2023-10-14T11:13:37.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.349+0000 7f280849e640 1 -- 172.21.15.26:0/2050588968 wait complete. 2023-10-14T11:13:37.372 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:13:37.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.513+0000 7f0955846640 1 Processor -- start 2023-10-14T11:13:37.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.513+0000 7f0955846640 1 -- start start 2023-10-14T11:13:37.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.513+0000 7f0955846640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f095015ca70 0x7f09500d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:37.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.513+0000 7f0955846640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f09500d3550 0x7f09500cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:37.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.513+0000 7f0955846640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09500cfa00 con 0x7f09500cf5d0 2023-10-14T11:13:37.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.513+0000 7f0955846640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09500ce820 con 0x7f09500d3550 2023-10-14T11:13:37.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.513+0000 7f0955846640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09500c65f0 con 0x7f095015ca70 2023-10-14T11:13:37.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.513+0000 7f0947fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f09500d3550 0x7f09500cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:37.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.513+0000 7f0947fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f09500d3550 0x7f09500cf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58042/0 (socket says 172.21.15.26:58042) 2023-10-14T11:13:37.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.513+0000 7f0947fff640 1 -- 172.21.15.26:0/420011913 learned_addr learned my addr 172.21.15.26:0/420011913 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:37.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.513+0000 7f094effd640 1 --2- 172.21.15.26:0/420011913 >> v2:172.21.15.110:3300/0 conn(0x7f095015ca70 0x7f09500d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:37.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.513+0000 7f0947fff640 1 -- 172.21.15.26:0/420011913 >> v2:172.21.15.110:3300/0 conn(0x7f095015ca70 msgr2=0x7f09500d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:37.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.513+0000 7f0947fff640 1 --2- 172.21.15.26:0/420011913 >> v2:172.21.15.110:3300/0 conn(0x7f095015ca70 0x7f09500d3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.513+0000 7f0947fff640 1 -- 172.21.15.26:0/420011913 >> v1:172.21.15.110:6789/0 conn(0x7f09500cf5d0 legacy=0x7f09500d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:37.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.513+0000 7f0947fff640 1 -- 172.21.15.26:0/420011913 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09500cdf80 con 0x7f09500d3550 2023-10-14T11:13:37.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.517+0000 7f0947fff640 1 --2- 172.21.15.26:0/420011913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09500d3550 0x7f09500cf090 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f095008a880 tx=0x7f093801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e61e512008f206 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:37.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.517+0000 7f094e7fc640 1 -- 172.21.15.26:0/420011913 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09380aa430 con 0x7f09500d3550 2023-10-14T11:13:37.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.517+0000 7f094e7fc640 1 -- 172.21.15.26:0/420011913 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09380aa590 con 0x7f09500d3550 2023-10-14T11:13:37.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.517+0000 7f094e7fc640 1 -- 172.21.15.26:0/420011913 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09380aa920 con 0x7f09500d3550 2023-10-14T11:13:37.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.517+0000 7f0955846640 1 -- 172.21.15.26:0/420011913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09500d3550 msgr2=0x7f09500cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:37.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.517+0000 7f0955846640 1 --2- 172.21.15.26:0/420011913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09500d3550 0x7f09500cf090 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f095008a880 tx=0x7f093801c4d0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.517+0000 7f0955846640 1 -- 172.21.15.26:0/420011913 shutdown_connections 2023-10-14T11:13:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.517+0000 7f0955846640 1 --2- 172.21.15.26:0/420011913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09500d3550 0x7f09500cf090 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.517+0000 7f0955846640 1 --2- 172.21.15.26:0/420011913 >> v2:172.21.15.110:3300/0 conn(0x7f095015ca70 0x7f09500d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.517+0000 7f0955846640 1 -- 172.21.15.26:0/420011913 >> 172.21.15.26:0/420011913 conn(0x7f095009bc50 msgr2=0x7f09500d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.517+0000 7f0955846640 1 -- 172.21.15.26:0/420011913 shutdown_connections 2023-10-14T11:13:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.517+0000 7f0955846640 1 -- 172.21.15.26:0/420011913 wait complete. 2023-10-14T11:13:37.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f0955846640 1 Processor -- start 2023-10-14T11:13:37.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f0955846640 1 -- start start 2023-10-14T11:13:37.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f0955846640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09500cf5d0 0x7f095014efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:37.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f0955846640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09500d3550 0x7f095014ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:37.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f0955846640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f095015ca70 0x7f0950147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:37.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f0955846640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09501f8c30 con 0x7f09500cf5d0 2023-10-14T11:13:37.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f0955846640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09501f8f10 con 0x7f095015ca70 2023-10-14T11:13:37.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f0955846640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09501f91f0 con 0x7f09500d3550 2023-10-14T11:13:37.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f094effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09500cf5d0 0x7f095014efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:37.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f094effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09500cf5d0 0x7f095014efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58048/0 (socket says 172.21.15.26:58048) 2023-10-14T11:13:37.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f094effd640 1 -- 172.21.15.26:0/675352109 learned_addr learned my addr 172.21.15.26:0/675352109 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:37.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f0947fff640 1 --2- 172.21.15.26:0/675352109 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09500d3550 0x7f095014ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:37.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f094f7fe640 1 --2- 172.21.15.26:0/675352109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f095015ca70 0x7f0950147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:37.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f094effd640 1 -- 172.21.15.26:0/675352109 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09500d3550 msgr2=0x7f095014ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:37.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f094effd640 1 --2- 172.21.15.26:0/675352109 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09500d3550 0x7f095014ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f094effd640 1 -- 172.21.15.26:0/675352109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f095015ca70 msgr2=0x7f0950147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:37.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f094effd640 1 --2- 172.21.15.26:0/675352109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f095015ca70 0x7f0950147d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f094effd640 1 -- 172.21.15.26:0/675352109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09380094d0 con 0x7f09500cf5d0 2023-10-14T11:13:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f094effd640 1 --2- 172.21.15.26:0/675352109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09500cf5d0 0x7f095014efa0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f094000d7d0 tx=0x7f094000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f094cff9640 1 -- 172.21.15.26:0/675352109 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094000b6c0 con 0x7f09500cf5d0 2023-10-14T11:13:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f094cff9640 1 -- 172.21.15.26:0/675352109 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094000b820 con 0x7f09500cf5d0 2023-10-14T11:13:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f094cff9640 1 -- 172.21.15.26:0/675352109 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094000bbd0 con 0x7f09500cf5d0 2023-10-14T11:13:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f0955846640 1 -- 172.21.15.26:0/675352109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09501f94d0 con 0x7f09500cf5d0 2023-10-14T11:13:37.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f0955846640 1 -- 172.21.15.26:0/675352109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09501f9a90 con 0x7f09500cf5d0 2023-10-14T11:13:37.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.521+0000 7f0955846640 1 -- 172.21.15.26:0/675352109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0950074010 con 0x7f09500cf5d0 2023-10-14T11:13:37.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.525+0000 7f094cff9640 1 -- 172.21.15.26:0/675352109 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f094000bd30 con 0x7f09500cf5d0 2023-10-14T11:13:37.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.525+0000 7f094cff9640 1 --2- 172.21.15.26:0/675352109 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f09300664a0 0x7f0930068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:37.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.525+0000 7f094cff9640 1 -- 172.21.15.26:0/675352109 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f09400847e0 con 0x7f09500cf5d0 2023-10-14T11:13:37.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.525+0000 7f0947fff640 1 --2- 172.21.15.26:0/675352109 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f09300664a0 0x7f0930068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:37.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.525+0000 7f0947fff640 1 --2- 172.21.15.26:0/675352109 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f09300664a0 0x7f0930068960 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f09380ae000 tx=0x7f09380a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:37.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.529+0000 7f094cff9640 1 -- 172.21.15.26:0/675352109 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0940051800 con 0x7f09500cf5d0 2023-10-14T11:13:37.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.685+0000 7f0955846640 1 -- 172.21.15.26:0/675352109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09500678e0 con 0x7f09500cf5d0 2023-10-14T11:13:37.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.689+0000 7f094cff9640 1 -- 172.21.15.26:0/675352109 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18679 (secure 0 0 0) 0x7f0940054e20 con 0x7f09500cf5d0 2023-10-14T11:13:37.691 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:37.692 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":27,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:13:03.866737+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:13:37.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.689+0000 7f0955846640 1 -- 172.21.15.26:0/675352109 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f09300664a0 msgr2=0x7f0930068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:37.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.689+0000 7f0955846640 1 --2- 172.21.15.26:0/675352109 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f09300664a0 0x7f0930068960 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f09380ae000 tx=0x7f09380a7000 comp rx=0 tx=0).stop 2023-10-14T11:13:37.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.689+0000 7f0955846640 1 -- 172.21.15.26:0/675352109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09500cf5d0 msgr2=0x7f095014efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:37.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.689+0000 7f0955846640 1 --2- 172.21.15.26:0/675352109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09500cf5d0 0x7f095014efa0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f094000d7d0 tx=0x7f094000dc90 comp rx=0 tx=0).stop 2023-10-14T11:13:37.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.689+0000 7f0955846640 1 -- 172.21.15.26:0/675352109 shutdown_connections 2023-10-14T11:13:37.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.689+0000 7f0955846640 1 --2- 172.21.15.26:0/675352109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f095015ca70 0x7f0950147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.689+0000 7f0955846640 1 --2- 172.21.15.26:0/675352109 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09500d3550 0x7f095014ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.689+0000 7f0955846640 1 --2- 172.21.15.26:0/675352109 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f09300664a0 0x7f0930068960 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.689+0000 7f0955846640 1 --2- 172.21.15.26:0/675352109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09500cf5d0 0x7f095014efa0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.689+0000 7f0955846640 1 -- 172.21.15.26:0/675352109 >> 172.21.15.26:0/675352109 conn(0x7f095009bc50 msgr2=0x7f09500c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:37.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.689+0000 7f0955846640 1 -- 172.21.15.26:0/675352109 shutdown_connections 2023-10-14T11:13:37.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.689+0000 7f0955846640 1 -- 172.21.15.26:0/675352109 wait complete. 2023-10-14T11:13:37.713 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T11:13:37.713 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:13:37.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.857+0000 7f89fc3d0640 1 Processor -- start 2023-10-14T11:13:37.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.857+0000 7f89fc3d0640 1 -- start start 2023-10-14T11:13:37.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.857+0000 7f89fc3d0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f89f415cb90 0x7f89f40cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:37.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.857+0000 7f89fc3d0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89f40d3010 0x7f89f40d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:37.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.857+0000 7f89fc3d0640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f89f40d1400 0x7f89f40cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:37.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.857+0000 7f89fc3d0640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f40d1890 con 0x7f89f40d1400 2023-10-14T11:13:37.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.857+0000 7f89fc3d0640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f40ce770 con 0x7f89f415cb90 2023-10-14T11:13:37.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.857+0000 7f89fc3d0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f40d0600 con 0x7f89f40d3010 2023-10-14T11:13:37.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.857+0000 7f89fa96d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f89f40d1400 0x7f89f40cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:37.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.857+0000 7f89fa96d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f89f40d1400 0x7f89f40cd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58054/0 (socket says 172.21.15.26:58054) 2023-10-14T11:13:37.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.857+0000 7f89fa96d640 1 -- 172.21.15.26:0/2898627667 learned_addr learned my addr 172.21.15.26:0/2898627667 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:37.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.857+0000 7f89fa16c640 1 --2- 172.21.15.26:0/2898627667 >> v2:172.21.15.110:3300/0 conn(0x7f89f415cb90 0x7f89f40cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:37.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.857+0000 7f89f996b640 1 --2- 172.21.15.26:0/2898627667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89f40d3010 0x7f89f40d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:37.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.857+0000 7f89fa16c640 1 -- 172.21.15.26:0/2898627667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89f40d3010 msgr2=0x7f89f40d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:37.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.857+0000 7f89fa16c640 1 --2- 172.21.15.26:0/2898627667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89f40d3010 0x7f89f40d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.857+0000 7f89fa16c640 1 -- 172.21.15.26:0/2898627667 >> v2:172.21.15.26:3300/0 conn(0x7f89f40d1400 msgr2=0x7f89f40cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:37.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.857+0000 7f89fa16c640 1 --2- 172.21.15.26:0/2898627667 >> v2:172.21.15.26:3300/0 conn(0x7f89f40d1400 0x7f89f40cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.857+0000 7f89fa16c640 1 -- 172.21.15.26:0/2898627667 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f40c6450 con 0x7f89f415cb90 2023-10-14T11:13:37.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.857+0000 7f89fa96d640 1 --2- 172.21.15.26:0/2898627667 >> v2:172.21.15.26:3300/0 conn(0x7f89f40d1400 0x7f89f40cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:13:37.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.861+0000 7f89fa16c640 1 --2- 172.21.15.26:0/2898627667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89f415cb90 0x7f89f40cfb10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f89f408ba70 tx=0x7f89f001c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8f3ed6128ff0220 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.861+0000 7f89f916a640 1 -- 172.21.15.26:0/2898627667 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f00ab600 con 0x7f89f415cb90 2023-10-14T11:13:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.861+0000 7f89f916a640 1 -- 172.21.15.26:0/2898627667 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f00a7050 con 0x7f89f415cb90 2023-10-14T11:13:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.861+0000 7f89f916a640 1 -- 172.21.15.26:0/2898627667 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f00ab980 con 0x7f89f415cb90 2023-10-14T11:13:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.861+0000 7f89fc3d0640 1 -- 172.21.15.26:0/2898627667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89f415cb90 msgr2=0x7f89f40cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.861+0000 7f89fc3d0640 1 --2- 172.21.15.26:0/2898627667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89f415cb90 0x7f89f40cfb10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f89f408ba70 tx=0x7f89f001c380 comp rx=0 tx=0).stop 2023-10-14T11:13:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.861+0000 7f89fc3d0640 1 -- 172.21.15.26:0/2898627667 shutdown_connections 2023-10-14T11:13:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.861+0000 7f89fc3d0640 1 --2- 172.21.15.26:0/2898627667 >> v2:172.21.15.26:3300/0 conn(0x7f89f40d1400 0x7f89f40cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.861+0000 7f89fc3d0640 1 --2- 172.21.15.26:0/2898627667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89f40d3010 0x7f89f40d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.861+0000 7f89fc3d0640 1 --2- 172.21.15.26:0/2898627667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89f415cb90 0x7f89f40cfb10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.861+0000 7f89fc3d0640 1 -- 172.21.15.26:0/2898627667 >> 172.21.15.26:0/2898627667 conn(0x7f89f409bc50 msgr2=0x7f89f40d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:37.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.861+0000 7f89fc3d0640 1 -- 172.21.15.26:0/2898627667 shutdown_connections 2023-10-14T11:13:37.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.861+0000 7f89fc3d0640 1 -- 172.21.15.26:0/2898627667 wait complete. 2023-10-14T11:13:37.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89fc3d0640 1 Processor -- start 2023-10-14T11:13:37.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89fc3d0640 1 -- start start 2023-10-14T11:13:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89fc3d0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89f40d1400 0x7f89f40cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89fc3d0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89f40d3010 0x7f89f414b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:37.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89fc3d0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89f415cb90 0x7f89f4154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:37.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89fc3d0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f40cac30 con 0x7f89f40d1400 2023-10-14T11:13:37.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89fc3d0640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f4154270 con 0x7f89f415cb90 2023-10-14T11:13:37.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89fc3d0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f40ca950 con 0x7f89f40d3010 2023-10-14T11:13:37.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89fa16c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89f40d1400 0x7f89f40cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:37.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89fa16c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89f40d1400 0x7f89f40cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58068/0 (socket says 172.21.15.26:58068) 2023-10-14T11:13:37.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89fa16c640 1 -- 172.21.15.26:0/1580036526 learned_addr learned my addr 172.21.15.26:0/1580036526 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:37.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89f996b640 1 --2- 172.21.15.26:0/1580036526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89f40d3010 0x7f89f414b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:37.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89fa96d640 1 --2- 172.21.15.26:0/1580036526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89f415cb90 0x7f89f4154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:37.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89fa16c640 1 -- 172.21.15.26:0/1580036526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89f40d3010 msgr2=0x7f89f414b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:37.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89fa16c640 1 --2- 172.21.15.26:0/1580036526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89f40d3010 0x7f89f414b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89fa16c640 1 -- 172.21.15.26:0/1580036526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89f415cb90 msgr2=0x7f89f4154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:37.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89fa16c640 1 --2- 172.21.15.26:0/1580036526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89f415cb90 0x7f89f4154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:37.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89fa16c640 1 -- 172.21.15.26:0/1580036526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec009b30 con 0x7f89f40d1400 2023-10-14T11:13:37.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89f996b640 1 --2- 172.21.15.26:0/1580036526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89f40d3010 0x7f89f414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:37.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89fa96d640 1 --2- 172.21.15.26:0/1580036526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89f415cb90 0x7f89f4154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:37.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89fa16c640 1 --2- 172.21.15.26:0/1580036526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89f40d1400 0x7f89f40cc230 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f89f001cc20 tx=0x7f89f0019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:37.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89eaffd640 1 -- 172.21.15.26:0/1580036526 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f00abcf0 con 0x7f89f40d1400 2023-10-14T11:13:37.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89eaffd640 1 -- 172.21.15.26:0/1580036526 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f00abe50 con 0x7f89f40d1400 2023-10-14T11:13:37.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89eaffd640 1 -- 172.21.15.26:0/1580036526 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f0005bc0 con 0x7f89f40d1400 2023-10-14T11:13:37.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89fc3d0640 1 -- 172.21.15.26:0/1580036526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f00093b0 con 0x7f89f40d1400 2023-10-14T11:13:37.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.865+0000 7f89fc3d0640 1 -- 172.21.15.26:0/1580036526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f4153f00 con 0x7f89f40d1400 2023-10-14T11:13:37.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.869+0000 7f89fc3d0640 1 -- 172.21.15.26:0/1580036526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f4167550 con 0x7f89f40d1400 2023-10-14T11:13:37.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.869+0000 7f89eaffd640 1 -- 172.21.15.26:0/1580036526 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f89f00b2040 con 0x7f89f40d1400 2023-10-14T11:13:37.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.869+0000 7f89eaffd640 1 --2- 172.21.15.26:0/1580036526 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f89d80664a0 0x7f89d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:37.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.869+0000 7f89eaffd640 1 -- 172.21.15.26:0/1580036526 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f89f011dbe0 con 0x7f89f40d1400 2023-10-14T11:13:37.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.869+0000 7f89f996b640 1 --2- 172.21.15.26:0/1580036526 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f89d80664a0 0x7f89d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:37.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.869+0000 7f89f996b640 1 --2- 172.21.15.26:0/1580036526 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f89d80664a0 0x7f89d8068960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f89f40ca2a0 tx=0x7f89e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:37.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:37.873+0000 7f89eaffd640 1 -- 172.21.15.26:0/1580036526 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f89f00eac90 con 0x7f89f40d1400 2023-10-14T11:13:38.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.061+0000 7f89fc3d0640 1 -- 172.21.15.26:0/1580036526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89f4074010 con 0x7f89f40d1400 2023-10-14T11:13:38.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.065+0000 7f89eaffd640 1 -- 172.21.15.26:0/1580036526 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f89f00b0090 con 0x7f89f40d1400 2023-10-14T11:13:38.067 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:38.067 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/2685368784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2685368784},{"type":"v1","addr":"172.21.15.110:6834","nonce":2685368784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6836/4242453713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":4242453713},{"type":"v1","addr":"172.21.15.26:6836","nonce":4242453713}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3507761146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":3507761146},{"type":"v1","addr":"172.21.15.26:6837","nonce":3507761146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:12:22.355867+0000","modified":"2023-10-14T11:12:46.435346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3522025152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3522025152},{"type":"v1","addr":"172.21.15.110:6835","nonce":3522025152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T11:13:38.068 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 9 2023-10-14T11:13:38.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.065+0000 7f89fc3d0640 1 -- 172.21.15.26:0/1580036526 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f89d80664a0 msgr2=0x7f89d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:38.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.065+0000 7f89fc3d0640 1 --2- 172.21.15.26:0/1580036526 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f89d80664a0 0x7f89d8068960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f89f40ca2a0 tx=0x7f89e4008040 comp rx=0 tx=0).stop 2023-10-14T11:13:38.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.065+0000 7f89fc3d0640 1 -- 172.21.15.26:0/1580036526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89f40d1400 msgr2=0x7f89f40cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:38.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.065+0000 7f89fc3d0640 1 --2- 172.21.15.26:0/1580036526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89f40d1400 0x7f89f40cc230 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f89f001cc20 tx=0x7f89f0019120 comp rx=0 tx=0).stop 2023-10-14T11:13:38.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.065+0000 7f89fc3d0640 1 -- 172.21.15.26:0/1580036526 shutdown_connections 2023-10-14T11:13:38.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.065+0000 7f89fc3d0640 1 --2- 172.21.15.26:0/1580036526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89f415cb90 0x7f89f4154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.065+0000 7f89fc3d0640 1 --2- 172.21.15.26:0/1580036526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89f40d3010 0x7f89f414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.065+0000 7f89fc3d0640 1 --2- 172.21.15.26:0/1580036526 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f89d80664a0 0x7f89d8068960 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.065+0000 7f89fc3d0640 1 --2- 172.21.15.26:0/1580036526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89f40d1400 0x7f89f40cc230 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.065+0000 7f89fc3d0640 1 -- 172.21.15.26:0/1580036526 >> 172.21.15.26:0/1580036526 conn(0x7f89f409bc50 msgr2=0x7f89f415bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:38.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.065+0000 7f89fc3d0640 1 -- 172.21.15.26:0/1580036526 shutdown_connections 2023-10-14T11:13:38.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.065+0000 7f89fc3d0640 1 -- 172.21.15.26:0/1580036526 wait complete. 2023-10-14T11:13:38.088 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:13:38.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.229+0000 7f9023e46640 1 Processor -- start 2023-10-14T11:13:38.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.229+0000 7f9023e46640 1 -- start start 2023-10-14T11:13:38.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.229+0000 7f9023e46640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f901c15cb90 0x7f901c0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:38.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.229+0000 7f9023e46640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f901c0d15d0 0x7f901c0c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:38.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.229+0000 7f9023e46640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f901c0ce770 con 0x7f901c0d3010 2023-10-14T11:13:38.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.229+0000 7f9023e46640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f901c0d0600 con 0x7f901c0d15d0 2023-10-14T11:13:38.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.229+0000 7f9023e46640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f901c0c6450 con 0x7f901c15cb90 2023-10-14T11:13:38.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.229+0000 7f90213e1640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f901c0d3010 0x7f901c0d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35708/0 (socket says 172.21.15.26:35708) 2023-10-14T11:13:38.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.229+0000 7f90213e1640 1 -- 172.21.15.26:0/2400713087 learned_addr learned my addr 172.21.15.26:0/2400713087 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:38.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.229+0000 7f90223e3640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f901c0d15d0 0x7f901c0c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:38.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.229+0000 7f9021be2640 1 --2- 172.21.15.26:0/2400713087 >> v2:172.21.15.110:3300/0 conn(0x7f901c15cb90 0x7f901c0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:38.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.229+0000 7f90223e3640 1 -- 172.21.15.26:0/2400713087 >> v2:172.21.15.110:3300/0 conn(0x7f901c15cb90 msgr2=0x7f901c0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:38.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.229+0000 7f90223e3640 1 --2- 172.21.15.26:0/2400713087 >> v2:172.21.15.110:3300/0 conn(0x7f901c15cb90 0x7f901c0cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.229+0000 7f90223e3640 1 -- 172.21.15.26:0/2400713087 >> v1:172.21.15.26:6789/0 conn(0x7f901c0d3010 legacy=0x7f901c0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:38.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.229+0000 7f9020be0640 1 -- 172.21.15.26:0/2400713087 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3467921230 0 0) 0x7f901c0ce770 con 0x7f901c0d3010 2023-10-14T11:13:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.229+0000 7f90223e3640 1 -- 172.21.15.26:0/2400713087 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c0d08a0 con 0x7f901c0d15d0 2023-10-14T11:13:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.233+0000 7f90223e3640 1 --2- 172.21.15.26:0/2400713087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f901c0d15d0 0x7f901c0c6c10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f901c08ba70 tx=0x7f901401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5608c28d5bc611 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.233+0000 7f9020be0640 1 -- 172.21.15.26:0/2400713087 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90140a5910 con 0x7f901c0d15d0 2023-10-14T11:13:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.233+0000 7f9020be0640 1 -- 172.21.15.26:0/2400713087 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90140a5a70 con 0x7f901c0d15d0 2023-10-14T11:13:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.233+0000 7f9020be0640 1 -- 172.21.15.26:0/2400713087 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90140a5e00 con 0x7f901c0d15d0 2023-10-14T11:13:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.233+0000 7f9023e46640 1 -- 172.21.15.26:0/2400713087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f901c0d15d0 msgr2=0x7f901c0c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.233+0000 7f9023e46640 1 --2- 172.21.15.26:0/2400713087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f901c0d15d0 0x7f901c0c6c10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f901c08ba70 tx=0x7f901401c850 comp rx=0 tx=0).stop 2023-10-14T11:13:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.233+0000 7f9023e46640 1 -- 172.21.15.26:0/2400713087 shutdown_connections 2023-10-14T11:13:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.233+0000 7f9023e46640 1 --2- 172.21.15.26:0/2400713087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f901c0d15d0 0x7f901c0c6c10 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.233+0000 7f9023e46640 1 --2- 172.21.15.26:0/2400713087 >> v2:172.21.15.110:3300/0 conn(0x7f901c15cb90 0x7f901c0cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.233+0000 7f9023e46640 1 -- 172.21.15.26:0/2400713087 >> 172.21.15.26:0/2400713087 conn(0x7f901c09bc50 msgr2=0x7f901c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:38.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.233+0000 7f9023e46640 1 -- 172.21.15.26:0/2400713087 shutdown_connections 2023-10-14T11:13:38.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.233+0000 7f9023e46640 1 -- 172.21.15.26:0/2400713087 wait complete. 2023-10-14T11:13:38.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f9023e46640 1 Processor -- start 2023-10-14T11:13:38.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f9023e46640 1 -- start start 2023-10-14T11:13:38.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f9023e46640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f901c0d15d0 0x7f901c0b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:38.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f9023e46640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f901c0d3010 0x7f901c06b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:38.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f9023e46640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f901c15cb90 0x7f901c14fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:38.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f9023e46640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901c0ca9e0 con 0x7f901c0d3010 2023-10-14T11:13:38.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f9023e46640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901c0b6d20 con 0x7f901c15cb90 2023-10-14T11:13:38.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f9023e46640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901c0ca040 con 0x7f901c0d15d0 2023-10-14T11:13:38.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f90213e1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f901c0d3010 0x7f901c06b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:38.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f90213e1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f901c0d3010 0x7f901c06b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58080/0 (socket says 172.21.15.26:58080) 2023-10-14T11:13:38.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f90213e1640 1 -- 172.21.15.26:0/2863995588 learned_addr learned my addr 172.21.15.26:0/2863995588 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:38.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f90223e3640 1 --2- 172.21.15.26:0/2863995588 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f901c15cb90 0x7f901c14fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:38.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f9021be2640 1 --2- 172.21.15.26:0/2863995588 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f901c0d15d0 0x7f901c0b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:38.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f90213e1640 1 -- 172.21.15.26:0/2863995588 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f901c0d15d0 msgr2=0x7f901c0b5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:38.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f90213e1640 1 --2- 172.21.15.26:0/2863995588 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f901c0d15d0 0x7f901c0b5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f90213e1640 1 -- 172.21.15.26:0/2863995588 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f901c15cb90 msgr2=0x7f901c14fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:38.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f90213e1640 1 --2- 172.21.15.26:0/2863995588 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f901c15cb90 0x7f901c14fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f90213e1640 1 -- 172.21.15.26:0/2863995588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9014009a70 con 0x7f901c0d3010 2023-10-14T11:13:38.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f90213e1640 1 --2- 172.21.15.26:0/2863995588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f901c0d3010 0x7f901c06b370 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f900c00c550 tx=0x7f900c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:38.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f90127fc640 1 -- 172.21.15.26:0/2863995588 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c005cf0 con 0x7f901c0d3010 2023-10-14T11:13:38.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f90127fc640 1 -- 172.21.15.26:0/2863995588 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c005e70 con 0x7f901c0d3010 2023-10-14T11:13:38.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f90127fc640 1 -- 172.21.15.26:0/2863995588 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c007310 con 0x7f901c0d3010 2023-10-14T11:13:38.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f9023e46640 1 -- 172.21.15.26:0/2863995588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901c0ca380 con 0x7f901c0d3010 2023-10-14T11:13:38.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.237+0000 7f9023e46640 1 -- 172.21.15.26:0/2863995588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901c0b5c70 con 0x7f901c0d3010 2023-10-14T11:13:38.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.241+0000 7f9023e46640 1 -- 172.21.15.26:0/2863995588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f901c067010 con 0x7f901c0d3010 2023-10-14T11:13:38.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.241+0000 7f90127fc640 1 -- 172.21.15.26:0/2863995588 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f900c007470 con 0x7f901c0d3010 2023-10-14T11:13:38.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.241+0000 7f90127fc640 1 --2- 172.21.15.26:0/2863995588 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f90000664a0 0x7f9000068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:38.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.241+0000 7f90127fc640 1 -- 172.21.15.26:0/2863995588 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f900c0838e0 con 0x7f901c0d3010 2023-10-14T11:13:38.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.241+0000 7f9021be2640 1 --2- 172.21.15.26:0/2863995588 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f90000664a0 0x7f9000068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:38.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.241+0000 7f9021be2640 1 --2- 172.21.15.26:0/2863995588 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f90000664a0 0x7f9000068960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9018009a30 tx=0x7f9018008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:38.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.245+0000 7f90127fc640 1 -- 172.21.15.26:0/2863995588 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f900c050990 con 0x7f901c0d3010 2023-10-14T11:13:38.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.437+0000 7f9023e46640 1 -- 172.21.15.26:0/2863995588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f901c074010 con 0x7f901c0d3010 2023-10-14T11:13:38.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.437+0000 7f90127fc640 1 -- 172.21.15.26:0/2863995588 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f900c017090 con 0x7f901c0d3010 2023-10-14T11:13:38.442 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:38.442 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/2685368784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2685368784},{"type":"v1","addr":"172.21.15.110:6834","nonce":2685368784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6836/4242453713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":4242453713},{"type":"v1","addr":"172.21.15.26:6836","nonce":4242453713}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3507761146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":3507761146},{"type":"v1","addr":"172.21.15.26:6837","nonce":3507761146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:12:22.355867+0000","modified":"2023-10-14T11:12:46.435346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3522025152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3522025152},{"type":"v1","addr":"172.21.15.110:6835","nonce":3522025152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T11:13:38.443 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 9 2023-10-14T11:13:38.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.441+0000 7f9023e46640 1 -- 172.21.15.26:0/2863995588 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f90000664a0 msgr2=0x7f9000068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:38.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.441+0000 7f9023e46640 1 --2- 172.21.15.26:0/2863995588 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f90000664a0 0x7f9000068960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9018009a30 tx=0x7f9018008040 comp rx=0 tx=0).stop 2023-10-14T11:13:38.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.441+0000 7f9023e46640 1 -- 172.21.15.26:0/2863995588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f901c0d3010 msgr2=0x7f901c06b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:38.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.441+0000 7f9023e46640 1 --2- 172.21.15.26:0/2863995588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f901c0d3010 0x7f901c06b370 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f900c00c550 tx=0x7f900c00ca10 comp rx=0 tx=0).stop 2023-10-14T11:13:38.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.441+0000 7f9023e46640 1 -- 172.21.15.26:0/2863995588 shutdown_connections 2023-10-14T11:13:38.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.441+0000 7f9023e46640 1 --2- 172.21.15.26:0/2863995588 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f901c15cb90 0x7f901c14fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.441+0000 7f9023e46640 1 --2- 172.21.15.26:0/2863995588 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f90000664a0 0x7f9000068960 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.441+0000 7f9023e46640 1 --2- 172.21.15.26:0/2863995588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f901c0d3010 0x7f901c06b370 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.441+0000 7f9023e46640 1 --2- 172.21.15.26:0/2863995588 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f901c0d15d0 0x7f901c0b5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.441+0000 7f9023e46640 1 -- 172.21.15.26:0/2863995588 >> 172.21.15.26:0/2863995588 conn(0x7f901c09bc50 msgr2=0x7f901c06c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:38.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.441+0000 7f9023e46640 1 -- 172.21.15.26:0/2863995588 shutdown_connections 2023-10-14T11:13:38.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.441+0000 7f9023e46640 1 -- 172.21.15.26:0/2863995588 wait complete. 2023-10-14T11:13:38.463 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:13:38.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.601+0000 7f389e9d9640 1 Processor -- start 2023-10-14T11:13:38.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.601+0000 7f389e9d9640 1 -- start start 2023-10-14T11:13:38.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.605+0000 7f389e9d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38981597c0 0x7f38980ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:38.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.605+0000 7f389e9d9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3898159ba0 0x7f38980cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:38.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.605+0000 7f389e9d9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f38980adc10 0x7f38980cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:38.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.605+0000 7f389e9d9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38980723d0 con 0x7f3898159ba0 2023-10-14T11:13:38.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.605+0000 7f389e9d9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38980717c0 con 0x7f38980adc10 2023-10-14T11:13:38.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.605+0000 7f389e9d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3898071aa0 con 0x7f38981597c0 2023-10-14T11:13:38.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.605+0000 7f38977fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3898159ba0 0x7f38980cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:38.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.605+0000 7f38977fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3898159ba0 0x7f38980cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58082/0 (socket says 172.21.15.26:58082) 2023-10-14T11:13:38.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.605+0000 7f38977fe640 1 -- 172.21.15.26:0/1674884658 learned_addr learned my addr 172.21.15.26:0/1674884658 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:38.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.605+0000 7f389cf76640 1 --2- 172.21.15.26:0/1674884658 >> v2:172.21.15.110:3300/0 conn(0x7f38980adc10 0x7f38980cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:38.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.605+0000 7f3897fff640 1 --2- 172.21.15.26:0/1674884658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38981597c0 0x7f38980ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:38.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.605+0000 7f38977fe640 1 -- 172.21.15.26:0/1674884658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38981597c0 msgr2=0x7f38980ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:38.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.605+0000 7f38977fe640 1 --2- 172.21.15.26:0/1674884658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38981597c0 0x7f38980ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.605+0000 7f38977fe640 1 -- 172.21.15.26:0/1674884658 >> v2:172.21.15.110:3300/0 conn(0x7f38980adc10 msgr2=0x7f38980cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:38.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.605+0000 7f38977fe640 1 --2- 172.21.15.26:0/1674884658 >> v2:172.21.15.110:3300/0 conn(0x7f38980adc10 0x7f38980cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.605+0000 7f38977fe640 1 -- 172.21.15.26:0/1674884658 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3898071d80 con 0x7f3898159ba0 2023-10-14T11:13:38.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.609+0000 7f38977fe640 1 --2- 172.21.15.26:0/1674884658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3898159ba0 0x7f38980cae10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f389806e330 tx=0x7f388c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5d04efd86aec21 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:38.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.609+0000 7f3896ffd640 1 -- 172.21.15.26:0/1674884658 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c0a7070 con 0x7f3898159ba0 2023-10-14T11:13:38.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.609+0000 7f3896ffd640 1 -- 172.21.15.26:0/1674884658 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c0ab430 con 0x7f3898159ba0 2023-10-14T11:13:38.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.609+0000 7f3896ffd640 1 -- 172.21.15.26:0/1674884658 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c0ab7c0 con 0x7f3898159ba0 2023-10-14T11:13:38.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.609+0000 7f389e9d9640 1 -- 172.21.15.26:0/1674884658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3898159ba0 msgr2=0x7f38980cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:38.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.609+0000 7f389e9d9640 1 --2- 172.21.15.26:0/1674884658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3898159ba0 0x7f38980cae10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f389806e330 tx=0x7f388c01c4d0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.609+0000 7f389e9d9640 1 -- 172.21.15.26:0/1674884658 shutdown_connections 2023-10-14T11:13:38.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.609+0000 7f389e9d9640 1 --2- 172.21.15.26:0/1674884658 >> v2:172.21.15.110:3300/0 conn(0x7f38980adc10 0x7f38980cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.609+0000 7f389e9d9640 1 --2- 172.21.15.26:0/1674884658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3898159ba0 0x7f38980cae10 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.609+0000 7f389e9d9640 1 --2- 172.21.15.26:0/1674884658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38981597c0 0x7f38980ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.609+0000 7f389e9d9640 1 -- 172.21.15.26:0/1674884658 >> 172.21.15.26:0/1674884658 conn(0x7f389806c190 msgr2=0x7f389806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:38.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.609+0000 7f389e9d9640 1 -- 172.21.15.26:0/1674884658 shutdown_connections 2023-10-14T11:13:38.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.609+0000 7f389e9d9640 1 -- 172.21.15.26:0/1674884658 wait complete. 2023-10-14T11:13:38.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.609+0000 7f389e9d9640 1 Processor -- start 2023-10-14T11:13:38.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.609+0000 7f389e9d9640 1 -- start start 2023-10-14T11:13:38.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f389e9d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38980adc10 0x7f389815c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:38.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f389e9d9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38981597c0 0x7f3898157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:38.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f389e9d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3898159ba0 0x7f3898158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:38.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f389e9d9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389814b390 con 0x7f38981597c0 2023-10-14T11:13:38.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f389e9d9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389815abf0 con 0x7f38980adc10 2023-10-14T11:13:38.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f389e9d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3898159fe0 con 0x7f3898159ba0 2023-10-14T11:13:38.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f38977fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38981597c0 0x7f3898157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:38.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f38977fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38981597c0 0x7f3898157e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58084/0 (socket says 172.21.15.26:58084) 2023-10-14T11:13:38.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f38977fe640 1 -- 172.21.15.26:0/2440394825 learned_addr learned my addr 172.21.15.26:0/2440394825 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:38.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f389cf76640 1 --2- 172.21.15.26:0/2440394825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3898159ba0 0x7f3898158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:38.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f3897fff640 1 --2- 172.21.15.26:0/2440394825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38980adc10 0x7f389815c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:38.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f38977fe640 1 -- 172.21.15.26:0/2440394825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3898159ba0 msgr2=0x7f3898158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:38.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f38977fe640 1 --2- 172.21.15.26:0/2440394825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3898159ba0 0x7f3898158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f38977fe640 1 -- 172.21.15.26:0/2440394825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38980adc10 msgr2=0x7f389815c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:38.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f38977fe640 1 --2- 172.21.15.26:0/2440394825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38980adc10 0x7f389815c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f38977fe640 1 -- 172.21.15.26:0/2440394825 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c0094d0 con 0x7f38981597c0 2023-10-14T11:13:38.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f38977fe640 1 --2- 172.21.15.26:0/2440394825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38981597c0 0x7f3898157e10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f388c01ab80 tx=0x7f388c019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:38.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f3894ff9640 1 -- 172.21.15.26:0/2440394825 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c0b4620 con 0x7f38981597c0 2023-10-14T11:13:38.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f3894ff9640 1 -- 172.21.15.26:0/2440394825 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c0b4780 con 0x7f38981597c0 2023-10-14T11:13:38.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f389e9d9640 1 -- 172.21.15.26:0/2440394825 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f389815a2c0 con 0x7f38981597c0 2023-10-14T11:13:38.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f3894ff9640 1 -- 172.21.15.26:0/2440394825 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c0b4b10 con 0x7f38981597c0 2023-10-14T11:13:38.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f389e9d9640 1 -- 172.21.15.26:0/2440394825 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389815a880 con 0x7f38981597c0 2023-10-14T11:13:38.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f389e9d9640 1 -- 172.21.15.26:0/2440394825 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f389815ad60 con 0x7f38981597c0 2023-10-14T11:13:38.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.613+0000 7f3894ff9640 1 -- 172.21.15.26:0/2440394825 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f388c0b4c70 con 0x7f38981597c0 2023-10-14T11:13:38.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.617+0000 7f3894ff9640 1 --2- 172.21.15.26:0/2440394825 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f38840664a0 0x7f3884068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:38.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.617+0000 7f3894ff9640 1 -- 172.21.15.26:0/2440394825 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f388c11e470 con 0x7f38981597c0 2023-10-14T11:13:38.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.617+0000 7f3897fff640 1 --2- 172.21.15.26:0/2440394825 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f38840664a0 0x7f3884068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:38.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.617+0000 7f3897fff640 1 --2- 172.21.15.26:0/2440394825 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f38840664a0 0x7f3884068960 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f38981507b0 tx=0x7f3888008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:38.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.621+0000 7f3894ff9640 1 -- 172.21.15.26:0/2440394825 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f388c0eb540 con 0x7f38981597c0 2023-10-14T11:13:38.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.777+0000 7f389e9d9640 1 -- 172.21.15.26:0/2440394825 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3898074010 con 0x7f38981597c0 2023-10-14T11:13:38.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.777+0000 7f3894ff9640 1 -- 172.21.15.26:0/2440394825 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18679 (secure 0 0 0) 0x7f388c0eeb60 con 0x7f38981597c0 2023-10-14T11:13:38.782 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:38.782 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":27,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:13:03.866737+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:12:20.179562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:12:21.346111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T11:12:25.025159+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:13:38.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.781+0000 7f389e9d9640 1 -- 172.21.15.26:0/2440394825 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f38840664a0 msgr2=0x7f3884068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:38.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.781+0000 7f389e9d9640 1 --2- 172.21.15.26:0/2440394825 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f38840664a0 0x7f3884068960 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f38981507b0 tx=0x7f3888008040 comp rx=0 tx=0).stop 2023-10-14T11:13:38.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.781+0000 7f389e9d9640 1 -- 172.21.15.26:0/2440394825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38981597c0 msgr2=0x7f3898157e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:38.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.781+0000 7f389e9d9640 1 --2- 172.21.15.26:0/2440394825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38981597c0 0x7f3898157e10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f388c01ab80 tx=0x7f388c019270 comp rx=0 tx=0).stop 2023-10-14T11:13:38.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.781+0000 7f389e9d9640 1 -- 172.21.15.26:0/2440394825 shutdown_connections 2023-10-14T11:13:38.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.781+0000 7f389e9d9640 1 --2- 172.21.15.26:0/2440394825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3898159ba0 0x7f3898158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.781+0000 7f389e9d9640 1 --2- 172.21.15.26:0/2440394825 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f38840664a0 0x7f3884068960 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.781+0000 7f389e9d9640 1 --2- 172.21.15.26:0/2440394825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38981597c0 0x7f3898157e10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.781+0000 7f389e9d9640 1 --2- 172.21.15.26:0/2440394825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38980adc10 0x7f389815c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.781+0000 7f389e9d9640 1 -- 172.21.15.26:0/2440394825 >> 172.21.15.26:0/2440394825 conn(0x7f389806c190 msgr2=0x7f38980cc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:38.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.781+0000 7f389e9d9640 1 -- 172.21.15.26:0/2440394825 shutdown_connections 2023-10-14T11:13:38.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.781+0000 7f389e9d9640 1 -- 172.21.15.26:0/2440394825 wait complete. 2023-10-14T11:13:38.804 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T11:13:38.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.945+0000 7f73a7246640 1 Processor -- start 2023-10-14T11:13:38.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.945+0000 7f73a7246640 1 -- start start 2023-10-14T11:13:38.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.949+0000 7f73a7246640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f73a015ca50 0x7f73a006c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:38.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.949+0000 7f73a7246640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a01607e0 con 0x7f73a015ce30 2023-10-14T11:13:38.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.949+0000 7f73a7246640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a00cf060 con 0x7f73a00b21c0 2023-10-14T11:13:38.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.949+0000 7f73a7246640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a00cb4a0 con 0x7f73a015ca50 2023-10-14T11:13:38.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.949+0000 7f739ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f73a015ce30 0x7f73a00cad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35712/0 (socket says 172.21.15.26:35712) 2023-10-14T11:13:38.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.949+0000 7f739ffff640 1 -- 172.21.15.26:0/2173788504 learned_addr learned my addr 172.21.15.26:0/2173788504 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:38.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.949+0000 7f73a4fe2640 1 --2- 172.21.15.26:0/2173788504 >> v2:172.21.15.110:3300/0 conn(0x7f73a015ca50 0x7f73a006c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:38.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.949+0000 7f739f7fe640 1 -- 172.21.15.26:0/2173788504 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 643354699 0 0) 0x7f73a01607e0 con 0x7f73a015ce30 2023-10-14T11:13:38.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.949+0000 7f739f7fe640 1 -- 172.21.15.26:0/2173788504 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7390003530 con 0x7f73a015ce30 2023-10-14T11:13:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.949+0000 7f739f7fe640 1 -- 172.21.15.26:0/2173788504 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797387119 0 0) 0x7f73a00cf060 con 0x7f73a00b21c0 2023-10-14T11:13:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.949+0000 7f739f7fe640 1 -- 172.21.15.26:0/2173788504 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73a01607e0 con 0x7f73a00b21c0 2023-10-14T11:13:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.949+0000 7f73a4fe2640 1 -- 172.21.15.26:0/2173788504 >> v1:172.21.15.110:6789/0 conn(0x7f73a00b21c0 legacy=0x7f73a00b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.949+0000 7f73a4fe2640 1 -- 172.21.15.26:0/2173788504 >> v1:172.21.15.26:6789/0 conn(0x7f73a015ce30 legacy=0x7f73a00cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.949+0000 7f73a4fe2640 1 -- 172.21.15.26:0/2173788504 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a0070210 con 0x7f73a015ca50 2023-10-14T11:13:38.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.953+0000 7f73a4fe2640 1 --2- 172.21.15.26:0/2173788504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73a015ca50 0x7f73a006c980 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f73940097c0 tx=0x7f739401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f630deee2c384b1c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:38.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.953+0000 7f739f7fe640 1 -- 172.21.15.26:0/2173788504 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73940ab650 con 0x7f73a015ca50 2023-10-14T11:13:38.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.953+0000 7f739f7fe640 1 -- 172.21.15.26:0/2173788504 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73940ab7b0 con 0x7f73a015ca50 2023-10-14T11:13:38.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.953+0000 7f739f7fe640 1 -- 172.21.15.26:0/2173788504 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73940abb40 con 0x7f73a015ca50 2023-10-14T11:13:38.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.953+0000 7f73a7246640 1 -- 172.21.15.26:0/2173788504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73a015ca50 msgr2=0x7f73a006c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:38.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.953+0000 7f73a7246640 1 --2- 172.21.15.26:0/2173788504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73a015ca50 0x7f73a006c980 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f73940097c0 tx=0x7f739401c450 comp rx=0 tx=0).stop 2023-10-14T11:13:38.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.953+0000 7f73a7246640 1 -- 172.21.15.26:0/2173788504 shutdown_connections 2023-10-14T11:13:38.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.953+0000 7f73a7246640 1 --2- 172.21.15.26:0/2173788504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73a015ca50 0x7f73a006c980 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.953+0000 7f73a7246640 1 -- 172.21.15.26:0/2173788504 >> 172.21.15.26:0/2173788504 conn(0x7f73a00cd1c0 msgr2=0x7f73a00cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:38.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.953+0000 7f73a7246640 1 -- 172.21.15.26:0/2173788504 shutdown_connections 2023-10-14T11:13:38.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.953+0000 7f73a7246640 1 -- 172.21.15.26:0/2173788504 wait complete. 2023-10-14T11:13:38.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.953+0000 7f73a7246640 1 Processor -- start 2023-10-14T11:13:38.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.953+0000 7f73a7246640 1 -- start start 2023-10-14T11:13:38.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f73a7246640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73a00b21c0 0x7f73a0150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:38.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f73a7246640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73a015ca50 0x7f73a00b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:38.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f73a7246640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73a015ce30 0x7f73a00b4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:38.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f73a7246640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a0157820 con 0x7f73a015ca50 2023-10-14T11:13:38.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f73a7246640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a00b4f60 con 0x7f73a00b21c0 2023-10-14T11:13:38.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f73a7246640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a00b5240 con 0x7f73a015ce30 2023-10-14T11:13:38.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f739ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73a015ca50 0x7f73a00b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:38.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f739ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73a015ca50 0x7f73a00b4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58092/0 (socket says 172.21.15.26:58092) 2023-10-14T11:13:38.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f739ffff640 1 -- 172.21.15.26:0/891522139 learned_addr learned my addr 172.21.15.26:0/891522139 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:38.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f73a4fe2640 1 --2- 172.21.15.26:0/891522139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73a00b21c0 0x7f73a0150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:38.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f73a57e3640 1 --2- 172.21.15.26:0/891522139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73a015ce30 0x7f73a00b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:38.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f739ffff640 1 -- 172.21.15.26:0/891522139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73a015ce30 msgr2=0x7f73a00b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:38.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f739ffff640 1 --2- 172.21.15.26:0/891522139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73a015ce30 0x7f73a00b4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f739ffff640 1 -- 172.21.15.26:0/891522139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73a00b21c0 msgr2=0x7f73a0150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:38.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f739ffff640 1 --2- 172.21.15.26:0/891522139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73a00b21c0 0x7f73a0150480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:38.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f739ffff640 1 -- 172.21.15.26:0/891522139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7394009420 con 0x7f73a015ca50 2023-10-14T11:13:38.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f73a57e3640 1 --2- 172.21.15.26:0/891522139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73a015ce30 0x7f73a00b4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:38.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f73a4fe2640 1 --2- 172.21.15.26:0/891522139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73a00b21c0 0x7f73a0150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:38.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f739ffff640 1 --2- 172.21.15.26:0/891522139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73a015ca50 0x7f73a00b4310 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f738c00c420 tx=0x7f738c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:38.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f739d7fa640 1 -- 172.21.15.26:0/891522139 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c005cf0 con 0x7f73a015ca50 2023-10-14T11:13:38.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f739d7fa640 1 -- 172.21.15.26:0/891522139 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738c005e50 con 0x7f73a015ca50 2023-10-14T11:13:38.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f739d7fa640 1 -- 172.21.15.26:0/891522139 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c007310 con 0x7f73a015ca50 2023-10-14T11:13:38.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f73a7246640 1 -- 172.21.15.26:0/891522139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a00b5520 con 0x7f73a015ca50 2023-10-14T11:13:38.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f73a7246640 1 -- 172.21.15.26:0/891522139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a00b5ae0 con 0x7f73a015ca50 2023-10-14T11:13:38.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f73a7246640 1 -- 172.21.15.26:0/891522139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a015d490 con 0x7f73a015ca50 2023-10-14T11:13:38.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.957+0000 7f739d7fa640 1 -- 172.21.15.26:0/891522139 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f738c007470 con 0x7f73a015ca50 2023-10-14T11:13:38.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.961+0000 7f739d7fa640 1 --2- 172.21.15.26:0/891522139 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73840664a0 0x7f7384068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:38.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.961+0000 7f739d7fa640 1 -- 172.21.15.26:0/891522139 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f738c083820 con 0x7f73a015ca50 2023-10-14T11:13:38.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.961+0000 7f73a4fe2640 1 --2- 172.21.15.26:0/891522139 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73840664a0 0x7f7384068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:38.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.961+0000 7f73a4fe2640 1 --2- 172.21.15.26:0/891522139 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73840664a0 0x7f7384068960 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f73940af000 tx=0x7f73940a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:38.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:38.965+0000 7f739d7fa640 1 -- 172.21.15.26:0/891522139 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f73a015d490 con 0x7f73a015ca50 2023-10-14T11:13:39.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.157+0000 7f73a7246640 1 -- 172.21.15.26:0/891522139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f73a015d490 con 0x7f73a015ca50 2023-10-14T11:13:39.161 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-14T11:13:39.157+0000 7f7c7d495640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T11:13:39.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.161+0000 7f739d7fa640 1 -- 172.21.15.26:0/891522139 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f73a015d490 con 0x7f73a015ca50 2023-10-14T11:13:39.164 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T11:13:39.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.165+0000 7f73a7246640 1 -- 172.21.15.26:0/891522139 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73840664a0 msgr2=0x7f7384068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:39.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.165+0000 7f73a7246640 1 --2- 172.21.15.26:0/891522139 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73840664a0 0x7f7384068960 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f73940af000 tx=0x7f73940a7000 comp rx=0 tx=0).stop 2023-10-14T11:13:39.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.165+0000 7f73a7246640 1 -- 172.21.15.26:0/891522139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73a015ca50 msgr2=0x7f73a00b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:39.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.165+0000 7f73a7246640 1 --2- 172.21.15.26:0/891522139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73a015ca50 0x7f73a00b4310 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f738c00c420 tx=0x7f738c00c8e0 comp rx=0 tx=0).stop 2023-10-14T11:13:39.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.165+0000 7f73a7246640 1 -- 172.21.15.26:0/891522139 shutdown_connections 2023-10-14T11:13:39.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.165+0000 7f73a7246640 1 --2- 172.21.15.26:0/891522139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73a015ce30 0x7f73a00b4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:39.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.165+0000 7f73a7246640 1 --2- 172.21.15.26:0/891522139 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73840664a0 0x7f7384068960 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:39.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.165+0000 7f73a7246640 1 --2- 172.21.15.26:0/891522139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73a015ca50 0x7f73a00b4310 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:39.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.165+0000 7f73a7246640 1 --2- 172.21.15.26:0/891522139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73a00b21c0 0x7f73a0150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:39.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.165+0000 7f73a7246640 1 -- 172.21.15.26:0/891522139 >> 172.21.15.26:0/891522139 conn(0x7f73a00cd1c0 msgr2=0x7f73a0154a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:39.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.165+0000 7f73a7246640 1 -- 172.21.15.26:0/891522139 shutdown_connections 2023-10-14T11:13:39.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.165+0000 7f73a7246640 1 -- 172.21.15.26:0/891522139 wait complete. 2023-10-14T11:13:39.177 INFO:tasks.ceph.mds.b.smithi110.stderr: -4416> 2023-10-14T11:12:26.402+0000 7fd3aebfa640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T11:13:39.187 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T11:13:39.226 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2023-10-14T11:13:39.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.329+0000 7f7ffa301640 1 Processor -- start 2023-10-14T11:13:39.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.329+0000 7f7ffa301640 1 -- start start 2023-10-14T11:13:39.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.333+0000 7f7ffa301640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7ff415cb60 0x7f7ff40c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:39.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.333+0000 7f7ffa301640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7ff415cf40 0x7f7ff406ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:39.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.333+0000 7f7ffa301640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff406f390 0x7f7ff4071400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:39.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.333+0000 7f7ffa301640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff40723f0 con 0x7f7ff415cf40 2023-10-14T11:13:39.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.333+0000 7f7ffa301640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff406f7e0 con 0x7f7ff415cb60 2023-10-14T11:13:39.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.333+0000 7f7ffa301640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff406ac10 con 0x7f7ff406f390 2023-10-14T11:13:39.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.333+0000 7f7ff37fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7ff415cf40 0x7f7ff406ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:39.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.333+0000 7f7ff889e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff406f390 0x7f7ff4071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:39.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.333+0000 7f7ff3fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7ff415cb60 0x7f7ff40c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:39.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.333+0000 7f7ff37fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7ff415cf40 0x7f7ff406ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58100/0 (socket says 172.21.15.26:58100) 2023-10-14T11:13:39.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.333+0000 7f7ff37fe640 1 -- 172.21.15.26:0/1852455848 learned_addr learned my addr 172.21.15.26:0/1852455848 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:39.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.333+0000 7f7ff889e640 1 -- 172.21.15.26:0/1852455848 >> v2:172.21.15.110:3300/0 conn(0x7f7ff415cb60 msgr2=0x7f7ff40c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:39.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.333+0000 7f7ff889e640 1 --2- 172.21.15.26:0/1852455848 >> v2:172.21.15.110:3300/0 conn(0x7f7ff415cb60 0x7f7ff40c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:39.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.333+0000 7f7ff889e640 1 -- 172.21.15.26:0/1852455848 >> v2:172.21.15.26:3300/0 conn(0x7f7ff415cf40 msgr2=0x7f7ff406ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:39.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.333+0000 7f7ff889e640 1 --2- 172.21.15.26:0/1852455848 >> v2:172.21.15.26:3300/0 conn(0x7f7ff415cf40 0x7f7ff406ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.333+0000 7f7ff889e640 1 -- 172.21.15.26:0/1852455848 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff4072110 con 0x7f7ff406f390 2023-10-14T11:13:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.333+0000 7f7ff3fff640 1 --2- 172.21.15.26:0/1852455848 >> v2:172.21.15.110:3300/0 conn(0x7f7ff415cb60 0x7f7ff40c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:13:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.333+0000 7f7ff37fe640 1 --2- 172.21.15.26:0/1852455848 >> v2:172.21.15.26:3300/0 conn(0x7f7ff415cf40 0x7f7ff406ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:13:39.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.333+0000 7f7ff889e640 1 --2- 172.21.15.26:0/1852455848 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff406f390 0x7f7ff4071400 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40d0370 tx=0x7f7fec01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0f1582b25e546b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:39.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.337+0000 7f7ff2ffd640 1 -- 172.21.15.26:0/1852455848 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec0a5960 con 0x7f7ff406f390 2023-10-14T11:13:39.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.337+0000 7f7ff2ffd640 1 -- 172.21.15.26:0/1852455848 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fec0a5ac0 con 0x7f7ff406f390 2023-10-14T11:13:39.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.337+0000 7f7ff2ffd640 1 -- 172.21.15.26:0/1852455848 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec0a5e50 con 0x7f7ff406f390 2023-10-14T11:13:39.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.337+0000 7f7ffa301640 1 -- 172.21.15.26:0/1852455848 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff406f390 msgr2=0x7f7ff4071400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:39.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.337+0000 7f7ffa301640 1 --2- 172.21.15.26:0/1852455848 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff406f390 0x7f7ff4071400 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40d0370 tx=0x7f7fec01c8e0 comp rx=0 tx=0).stop 2023-10-14T11:13:39.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.337+0000 7f7ffa301640 1 -- 172.21.15.26:0/1852455848 shutdown_connections 2023-10-14T11:13:39.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.337+0000 7f7ffa301640 1 --2- 172.21.15.26:0/1852455848 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff406f390 0x7f7ff4071400 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:39.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.337+0000 7f7ffa301640 1 --2- 172.21.15.26:0/1852455848 >> v2:172.21.15.26:3300/0 conn(0x7f7ff415cf40 0x7f7ff406ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:39.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.337+0000 7f7ffa301640 1 --2- 172.21.15.26:0/1852455848 >> v2:172.21.15.110:3300/0 conn(0x7f7ff415cb60 0x7f7ff40c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:39.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.337+0000 7f7ffa301640 1 -- 172.21.15.26:0/1852455848 >> 172.21.15.26:0/1852455848 conn(0x7f7ff40cf7a0 msgr2=0x7f7ff40cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.337+0000 7f7ffa301640 1 -- 172.21.15.26:0/1852455848 shutdown_connections 2023-10-14T11:13:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.337+0000 7f7ffa301640 1 -- 172.21.15.26:0/1852455848 wait complete. 2023-10-14T11:13:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.337+0000 7f7ffa301640 1 Processor -- start 2023-10-14T11:13:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.337+0000 7f7ffa301640 1 -- start start 2023-10-14T11:13:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.337+0000 7f7ffa301640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ff406f390 0x7f7ff40c5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.337+0000 7f7ffa301640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff415cb60 0x7f7ff41538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:39.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.337+0000 7f7ffa301640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff415cf40 0x7f7ff40b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:39.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.337+0000 7f7ffa301640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff4153df0 con 0x7f7ff406f390 2023-10-14T11:13:39.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.337+0000 7f7ffa301640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff40b4110 con 0x7f7ff415cf40 2023-10-14T11:13:39.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.337+0000 7f7ffa301640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff40b2b30 con 0x7f7ff415cb60 2023-10-14T11:13:39.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.337+0000 7f7ff3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ff406f390 0x7f7ff40c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:39.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.341+0000 7f7ff3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ff406f390 0x7f7ff40c5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58106/0 (socket says 172.21.15.26:58106) 2023-10-14T11:13:39.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.341+0000 7f7ff3fff640 1 -- 172.21.15.26:0/695914157 learned_addr learned my addr 172.21.15.26:0/695914157 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:39.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.341+0000 7f7ff37fe640 1 --2- 172.21.15.26:0/695914157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff415cb60 0x7f7ff41538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:39.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.341+0000 7f7ff889e640 1 --2- 172.21.15.26:0/695914157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff415cf40 0x7f7ff40b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:39.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.341+0000 7f7ff3fff640 1 -- 172.21.15.26:0/695914157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff415cb60 msgr2=0x7f7ff41538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:39.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.341+0000 7f7ff3fff640 1 --2- 172.21.15.26:0/695914157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff415cb60 0x7f7ff41538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:39.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.341+0000 7f7ff3fff640 1 -- 172.21.15.26:0/695914157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff415cf40 msgr2=0x7f7ff40b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:39.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.341+0000 7f7ff3fff640 1 --2- 172.21.15.26:0/695914157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff415cf40 0x7f7ff40b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:39.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.341+0000 7f7ff3fff640 1 -- 172.21.15.26:0/695914157 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe4009420 con 0x7f7ff406f390 2023-10-14T11:13:39.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.341+0000 7f7ff37fe640 1 --2- 172.21.15.26:0/695914157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff415cb60 0x7f7ff41538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:13:39.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.341+0000 7f7ff3fff640 1 --2- 172.21.15.26:0/695914157 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ff406f390 0x7f7ff40c5540 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7fe400ebe0 tx=0x7f7fe400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:39.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.341+0000 7f7ff0ff9640 1 -- 172.21.15.26:0/695914157 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe400eee0 con 0x7f7ff406f390 2023-10-14T11:13:39.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.341+0000 7f7ff0ff9640 1 -- 172.21.15.26:0/695914157 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe400cc30 con 0x7f7ff406f390 2023-10-14T11:13:39.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.341+0000 7f7ffa301640 1 -- 172.21.15.26:0/695914157 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe80094d0 con 0x7f7ff406f390 2023-10-14T11:13:39.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.341+0000 7f7ff0ff9640 1 -- 172.21.15.26:0/695914157 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4013470 con 0x7f7ff406f390 2023-10-14T11:13:39.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.341+0000 7f7ffa301640 1 -- 172.21.15.26:0/695914157 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fec009a70 con 0x7f7ff406f390 2023-10-14T11:13:39.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.341+0000 7f7ffa301640 1 -- 172.21.15.26:0/695914157 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff404e170 con 0x7f7ff406f390 2023-10-14T11:13:39.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.341+0000 7f7ff0ff9640 1 -- 172.21.15.26:0/695914157 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7fe40135d0 con 0x7f7ff406f390 2023-10-14T11:13:39.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.345+0000 7f7ff0ff9640 1 --2- 172.21.15.26:0/695914157 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7fe00664d0 0x7f7fe0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:39.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.345+0000 7f7ff0ff9640 1 -- 172.21.15.26:0/695914157 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f7fe40844b0 con 0x7f7ff406f390 2023-10-14T11:13:39.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.345+0000 7f7ff37fe640 1 --2- 172.21.15.26:0/695914157 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7fe00664d0 0x7f7fe0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:39.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.345+0000 7f7ff37fe640 1 --2- 172.21.15.26:0/695914157 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7fe00664d0 0x7f7fe0068990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40b52f0 tx=0x7f7fe8009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:39.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.349+0000 7f7ff0ff9640 1 -- 172.21.15.26:0/695914157 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7fe40515d0 con 0x7f7ff406f390 2023-10-14T11:13:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:39.541+0000 7f7ffa301640 1 -- 172.21.15.26:0/695914157 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7ff40b5720 con 0x7f7ff406f390 2023-10-14T11:13:40.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.161+0000 7f7ff0ff9640 1 -- 172.21.15.26:0/695914157 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7fe4054bf0 con 0x7f7ff406f390 2023-10-14T11:13:40.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.165+0000 7f7ffa301640 1 -- 172.21.15.26:0/695914157 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7fe00664d0 msgr2=0x7f7fe0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:40.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.165+0000 7f7ffa301640 1 --2- 172.21.15.26:0/695914157 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7fe00664d0 0x7f7fe0068990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40b52f0 tx=0x7f7fe8009240 comp rx=0 tx=0).stop 2023-10-14T11:13:40.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.165+0000 7f7ffa301640 1 -- 172.21.15.26:0/695914157 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ff406f390 msgr2=0x7f7ff40c5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:40.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.165+0000 7f7ffa301640 1 --2- 172.21.15.26:0/695914157 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ff406f390 0x7f7ff40c5540 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7fe400ebe0 tx=0x7f7fe400c520 comp rx=0 tx=0).stop 2023-10-14T11:13:40.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.165+0000 7f7ffa301640 1 -- 172.21.15.26:0/695914157 shutdown_connections 2023-10-14T11:13:40.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.165+0000 7f7ffa301640 1 --2- 172.21.15.26:0/695914157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff415cf40 0x7f7ff40b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:40.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.165+0000 7f7ffa301640 1 --2- 172.21.15.26:0/695914157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff415cb60 0x7f7ff41538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:40.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.165+0000 7f7ffa301640 1 --2- 172.21.15.26:0/695914157 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7fe00664d0 0x7f7fe0068990 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:40.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.165+0000 7f7ffa301640 1 --2- 172.21.15.26:0/695914157 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ff406f390 0x7f7ff40c5540 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:40.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.165+0000 7f7ffa301640 1 -- 172.21.15.26:0/695914157 >> 172.21.15.26:0/695914157 conn(0x7f7ff40cf7a0 msgr2=0x7f7ff40c9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:40.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.165+0000 7f7ffa301640 1 -- 172.21.15.26:0/695914157 shutdown_connections 2023-10-14T11:13:40.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.165+0000 7f7ffa301640 1 -- 172.21.15.26:0/695914157 wait complete. 2023-10-14T11:13:40.191 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T11:13:40.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab157d9640 1 Processor -- start 2023-10-14T11:13:40.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab157d9640 1 -- start start 2023-10-14T11:13:40.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab157d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab10160140 0x7fab100d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:40.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab157d9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab100cdf60 con 0x7fab100b1c50 2023-10-14T11:13:40.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab157d9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab100ce240 con 0x7fab100b3820 2023-10-14T11:13:40.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab157d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab100d19b0 con 0x7fab10160140 2023-10-14T11:13:40.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0e7fc640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fab100b1c50 0x7fab100b4100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35722/0 (socket says 172.21.15.26:35722) 2023-10-14T11:13:40.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0e7fc640 1 -- 172.21.15.26:0/517947838 learned_addr learned my addr 172.21.15.26:0/517947838 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:40.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0effd640 1 --2- 172.21.15.26:0/517947838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab10160140 0x7fab100d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:40.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0dffb640 1 -- 172.21.15.26:0/517947838 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606574480 0 0) 0x7fab100cdf60 con 0x7fab100b1c50 2023-10-14T11:13:40.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0dffb640 1 -- 172.21.15.26:0/517947838 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaf8003530 con 0x7fab100b1c50 2023-10-14T11:13:40.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0dffb640 1 -- 172.21.15.26:0/517947838 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569607442 0 0) 0x7fab100ce240 con 0x7fab100b3820 2023-10-14T11:13:40.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0dffb640 1 -- 172.21.15.26:0/517947838 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab100cdf60 con 0x7fab100b3820 2023-10-14T11:13:40.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0dffb640 1 -- 172.21.15.26:0/517947838 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3861945193 0 0) 0x7faaf8003530 con 0x7fab100b1c50 2023-10-14T11:13:40.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0dffb640 1 -- 172.21.15.26:0/517947838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab10160140 msgr2=0x7fab100d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:40.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0dffb640 1 --2- 172.21.15.26:0/517947838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab10160140 0x7fab100d0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:40.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0dffb640 1 -- 172.21.15.26:0/517947838 >> v1:172.21.15.110:6789/0 conn(0x7fab100b3820 legacy=0x7fab100b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:40.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0dffb640 1 -- 172.21.15.26:0/517947838 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab100ce520 con 0x7fab100b1c50 2023-10-14T11:13:40.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0dffb640 1 -- 172.21.15.26:0/517947838 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7fab04001680 con 0x7fab100b1c50 2023-10-14T11:13:40.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0dffb640 1 -- 172.21.15.26:0/517947838 >> v1:172.21.15.26:6789/0 conn(0x7fab100b1c50 legacy=0x7fab100b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:40.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0dffb640 1 --2- 172.21.15.26:0/517947838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaf8003bb0 0x7faaf8003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:40.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0dffb640 1 --2- 172.21.15.26:0/517947838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaf80047d0 0x7faaf8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:40.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0dffb640 1 --2- 172.21.15.26:0/517947838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab10160140 0x7faaf8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:40.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0dffb640 1 -- 172.21.15.26:0/517947838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab100d19b0 con 0x7faaf8003bb0 2023-10-14T11:13:40.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0dffb640 1 -- 172.21.15.26:0/517947838 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf800ba70 con 0x7faaf80047d0 2023-10-14T11:13:40.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0dffb640 1 -- 172.21.15.26:0/517947838 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf800bc30 con 0x7fab10160140 2023-10-14T11:13:40.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0effd640 1 --2- 172.21.15.26:0/517947838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaf8003bb0 0x7faaf8003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:40.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0e7fc640 1 --2- 172.21.15.26:0/517947838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaf80047d0 0x7faaf8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:40.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0f7fe640 1 --2- 172.21.15.26:0/517947838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab10160140 0x7faaf8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:40.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0effd640 1 -- 172.21.15.26:0/517947838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab10160140 msgr2=0x7faaf8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:40.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0effd640 1 --2- 172.21.15.26:0/517947838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab10160140 0x7faaf8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:40.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0effd640 1 -- 172.21.15.26:0/517947838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaf80047d0 msgr2=0x7faaf8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:40.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0effd640 1 --2- 172.21.15.26:0/517947838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaf80047d0 0x7faaf8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:40.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0effd640 1 -- 172.21.15.26:0/517947838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf8003530 con 0x7faaf8003bb0 2023-10-14T11:13:40.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.337+0000 7fab0f7fe640 1 --2- 172.21.15.26:0/517947838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab10160140 0x7faaf8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:40.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.341+0000 7fab0effd640 1 --2- 172.21.15.26:0/517947838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaf8003bb0 0x7faaf8003fb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fab00009a90 tx=0x7fab0001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a423bbb0bb624813 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:40.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.341+0000 7fab0dffb640 1 -- 172.21.15.26:0/517947838 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab000059a0 con 0x7faaf8003bb0 2023-10-14T11:13:40.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.341+0000 7fab0dffb640 1 -- 172.21.15.26:0/517947838 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab00005b00 con 0x7faaf8003bb0 2023-10-14T11:13:40.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.341+0000 7fab0dffb640 1 -- 172.21.15.26:0/517947838 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab00006030 con 0x7faaf8003bb0 2023-10-14T11:13:40.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.341+0000 7fab157d9640 1 -- 172.21.15.26:0/517947838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaf8003bb0 msgr2=0x7faaf8003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:40.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.341+0000 7fab157d9640 1 --2- 172.21.15.26:0/517947838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaf8003bb0 0x7faaf8003fb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fab00009a90 tx=0x7fab0001c9f0 comp rx=0 tx=0).stop 2023-10-14T11:13:40.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.341+0000 7fab0f7fe640 1 -- 172.21.15.26:0/517947838 reap_dead start 2023-10-14T11:13:40.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.341+0000 7fab157d9640 1 -- 172.21.15.26:0/517947838 shutdown_connections 2023-10-14T11:13:40.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.341+0000 7fab157d9640 1 -- 172.21.15.26:0/517947838 >> 172.21.15.26:0/517947838 conn(0x7fab100d2830 msgr2=0x7fab100d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:40.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.341+0000 7fab157d9640 1 -- 172.21.15.26:0/517947838 shutdown_connections 2023-10-14T11:13:40.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.341+0000 7fab157d9640 1 -- 172.21.15.26:0/517947838 wait complete. 2023-10-14T11:13:40.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7fab157d9640 1 Processor -- start 2023-10-14T11:13:40.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7fab157d9640 1 -- start start 2023-10-14T11:13:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7fab157d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaf8003bb0 0x7fab1014bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7fab157d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab1015e520 0x7fab1015e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7fab157d9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab100ca930 0x7fab100cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7fab157d9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1015eee0 con 0x7fab100ca930 2023-10-14T11:13:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7fab157d9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1014c8f0 con 0x7faaf8003bb0 2023-10-14T11:13:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7fab157d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab100cb6a0 con 0x7fab1015e520 2023-10-14T11:13:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7fab0f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab100ca930 0x7fab100cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7fab0effd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaf8003bb0 0x7fab1014bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7fab0f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab100ca930 0x7fab100cadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58118/0 (socket says 172.21.15.26:58118) 2023-10-14T11:13:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7fab0effd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaf8003bb0 0x7fab1014bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:45996/0 (socket says 172.21.15.26:45996) 2023-10-14T11:13:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7fab0f7fe640 1 -- 172.21.15.26:0/3127074752 learned_addr learned my addr 172.21.15.26:0/3127074752 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7fab0e7fc640 1 --2- 172.21.15.26:0/3127074752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab1015e520 0x7fab1015e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7fab0f7fe640 1 -- 172.21.15.26:0/3127074752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab1015e520 msgr2=0x7fab1015e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7fab0f7fe640 1 --2- 172.21.15.26:0/3127074752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab1015e520 0x7fab1015e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7fab0f7fe640 1 -- 172.21.15.26:0/3127074752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaf8003bb0 msgr2=0x7fab1014bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7fab0f7fe640 1 --2- 172.21.15.26:0/3127074752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaf8003bb0 0x7fab1014bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:40.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7fab0f7fe640 1 -- 172.21.15.26:0/3127074752 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1014cb40 con 0x7fab100ca930 2023-10-14T11:13:40.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7fab0effd640 1 --2- 172.21.15.26:0/3127074752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaf8003bb0 0x7fab1014bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:13:40.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7fab0f7fe640 1 --2- 172.21.15.26:0/3127074752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab100ca930 0x7fab100cadb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fab08007d30 tx=0x7fab0800f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:40.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7faaf77fe640 1 -- 172.21.15.26:0/3127074752 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0800fda0 con 0x7fab100ca930 2023-10-14T11:13:40.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7faaf77fe640 1 -- 172.21.15.26:0/3127074752 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab08015410 con 0x7fab100ca930 2023-10-14T11:13:40.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7faaf77fe640 1 -- 172.21.15.26:0/3127074752 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab08015800 con 0x7fab100ca930 2023-10-14T11:13:40.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.345+0000 7fab157d9640 1 -- 172.21.15.26:0/3127074752 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab1014ce20 con 0x7fab100ca930 2023-10-14T11:13:40.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.349+0000 7fab157d9640 1 -- 172.21.15.26:0/3127074752 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1014c520 con 0x7fab100ca930 2023-10-14T11:13:40.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.349+0000 7fab157d9640 1 -- 172.21.15.26:0/3127074752 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab1004e9c0 con 0x7fab100ca930 2023-10-14T11:13:40.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.349+0000 7faaf77fe640 1 -- 172.21.15.26:0/3127074752 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fab08015960 con 0x7fab100ca930 2023-10-14T11:13:40.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.349+0000 7faaf77fe640 1 --2- 172.21.15.26:0/3127074752 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7faafc0664a0 0x7faafc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:40.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.349+0000 7faaf77fe640 1 -- 172.21.15.26:0/3127074752 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fab080876b0 con 0x7fab100ca930 2023-10-14T11:13:40.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.349+0000 7fab0effd640 1 --2- 172.21.15.26:0/3127074752 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7faafc0664a0 0x7faafc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:40.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.349+0000 7fab0effd640 1 --2- 172.21.15.26:0/3127074752 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7faafc0664a0 0x7faafc068960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fab000ae000 tx=0x7fab000046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:40.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.353+0000 7faaf77fe640 1 -- 172.21.15.26:0/3127074752 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fab08054730 con 0x7fab100ca930 2023-10-14T11:13:40.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:40.517+0000 7fab157d9640 1 -- 172.21.15.26:0/3127074752 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fab100b4ec0 con 0x7fab100ca930 2023-10-14T11:13:41.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.169+0000 7faaf77fe640 1 -- 172.21.15.26:0/3127074752 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7fab08057d50 con 0x7fab100ca930 2023-10-14T11:13:41.172 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' removed 2023-10-14T11:13:41.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.173+0000 7fab157d9640 1 -- 172.21.15.26:0/3127074752 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7faafc0664a0 msgr2=0x7faafc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:41.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.173+0000 7fab157d9640 1 --2- 172.21.15.26:0/3127074752 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7faafc0664a0 0x7faafc068960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fab000ae000 tx=0x7fab000046d0 comp rx=0 tx=0).stop 2023-10-14T11:13:41.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.173+0000 7fab157d9640 1 -- 172.21.15.26:0/3127074752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab100ca930 msgr2=0x7fab100cadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:41.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.173+0000 7fab157d9640 1 --2- 172.21.15.26:0/3127074752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab100ca930 0x7fab100cadb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fab08007d30 tx=0x7fab0800f540 comp rx=0 tx=0).stop 2023-10-14T11:13:41.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.173+0000 7fab157d9640 1 -- 172.21.15.26:0/3127074752 shutdown_connections 2023-10-14T11:13:41.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.173+0000 7fab157d9640 1 --2- 172.21.15.26:0/3127074752 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7faafc0664a0 0x7faafc068960 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:41.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.173+0000 7fab157d9640 1 --2- 172.21.15.26:0/3127074752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab100ca930 0x7fab100cadb0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:41.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.173+0000 7fab157d9640 1 --2- 172.21.15.26:0/3127074752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab1015e520 0x7fab1015e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:41.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.173+0000 7fab157d9640 1 --2- 172.21.15.26:0/3127074752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaf8003bb0 0x7fab1014bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:41.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.173+0000 7fab157d9640 1 -- 172.21.15.26:0/3127074752 >> 172.21.15.26:0/3127074752 conn(0x7fab100d2830 msgr2=0x7fab100cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:41.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.173+0000 7fab157d9640 1 -- 172.21.15.26:0/3127074752 shutdown_connections 2023-10-14T11:13:41.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.173+0000 7fab157d9640 1 -- 172.21.15.26:0/3127074752 wait complete. 2023-10-14T11:13:41.202 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T11:13:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.353+0000 7f7976ec9640 1 Processor -- start 2023-10-14T11:13:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.353+0000 7f7976ec9640 1 -- start start 2023-10-14T11:13:41.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f7976ec9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79701595a0 0x7f797006c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:41.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f7976ec9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79700c8a20 con 0x7f79700b42d0 2023-10-14T11:13:41.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f7976ec9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79700c8c10 con 0x7f7970159980 2023-10-14T11:13:41.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f7976ec9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79700c8ef0 con 0x7f79701595a0 2023-10-14T11:13:41.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f7975466640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f79700b42d0 0x7f797015d2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35738/0 (socket says 172.21.15.26:35738) 2023-10-14T11:13:41.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f7975466640 1 -- 172.21.15.26:0/1524521081 learned_addr learned my addr 172.21.15.26:0/1524521081 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:41.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f7974c65640 1 --2- 172.21.15.26:0/1524521081 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79701595a0 0x7f797006c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:41.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f796f7fe640 1 -- 172.21.15.26:0/1524521081 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342683358 0 0) 0x7f79700c8a20 con 0x7f79700b42d0 2023-10-14T11:13:41.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f796f7fe640 1 -- 172.21.15.26:0/1524521081 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7960003530 con 0x7f79700b42d0 2023-10-14T11:13:41.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f796f7fe640 1 -- 172.21.15.26:0/1524521081 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1481539113 0 0) 0x7f7960003530 con 0x7f79700b42d0 2023-10-14T11:13:41.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f796f7fe640 1 -- 172.21.15.26:0/1524521081 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79701595a0 msgr2=0x7f797006c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:41.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f796f7fe640 1 --2- 172.21.15.26:0/1524521081 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79701595a0 0x7f797006c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:41.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f796f7fe640 1 -- 172.21.15.26:0/1524521081 >> v1:172.21.15.110:6789/0 conn(0x7f7970159980 legacy=0x7f79700b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:41.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f796f7fe640 1 -- 172.21.15.26:0/1524521081 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79700c91d0 con 0x7f79700b42d0 2023-10-14T11:13:41.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f796f7fe640 1 -- 172.21.15.26:0/1524521081 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f7968001a00 con 0x7f79700b42d0 2023-10-14T11:13:41.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f796f7fe640 1 -- 172.21.15.26:0/1524521081 >> v1:172.21.15.26:6789/0 conn(0x7f79700b42d0 legacy=0x7f797015d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:41.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f796f7fe640 1 --2- 172.21.15.26:0/1524521081 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79701595a0 0x7f79600039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:41.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f796f7fe640 1 --2- 172.21.15.26:0/1524521081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7960003ef0 0x7f79600047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:41.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f796f7fe640 1 --2- 172.21.15.26:0/1524521081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7960004d10 0x7f7960005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:41.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f796f7fe640 1 -- 172.21.15.26:0/1524521081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79700c8ef0 con 0x7f7960003ef0 2023-10-14T11:13:41.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f796f7fe640 1 -- 172.21.15.26:0/1524521081 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796000dcb0 con 0x7f7960004d10 2023-10-14T11:13:41.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f796f7fe640 1 -- 172.21.15.26:0/1524521081 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796000de70 con 0x7f79701595a0 2023-10-14T11:13:41.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f796ffff640 1 --2- 172.21.15.26:0/1524521081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7960003ef0 0x7f79600047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:41.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f7974c65640 1 --2- 172.21.15.26:0/1524521081 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79701595a0 0x7f79600039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:41.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f7975466640 1 --2- 172.21.15.26:0/1524521081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7960004d10 0x7f7960005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:41.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f796ffff640 1 -- 172.21.15.26:0/1524521081 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79701595a0 msgr2=0x7f79600039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:41.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f796ffff640 1 --2- 172.21.15.26:0/1524521081 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79701595a0 0x7f79600039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:41.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f796ffff640 1 -- 172.21.15.26:0/1524521081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7960004d10 msgr2=0x7f7960005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:41.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f796ffff640 1 --2- 172.21.15.26:0/1524521081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7960004d10 0x7f7960005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:41.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.357+0000 7f796ffff640 1 -- 172.21.15.26:0/1524521081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7960003530 con 0x7f7960003ef0 2023-10-14T11:13:41.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.361+0000 7f796ffff640 1 --2- 172.21.15.26:0/1524521081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7960003ef0 0x7f79600047d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f797006e6d0 tx=0x7f795c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c572a20ebc2c7ea server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:41.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.361+0000 7f796f7fe640 1 -- 172.21.15.26:0/1524521081 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c0a88b0 con 0x7f7960003ef0 2023-10-14T11:13:41.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.361+0000 7f796f7fe640 1 -- 172.21.15.26:0/1524521081 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c0a8a30 con 0x7f7960003ef0 2023-10-14T11:13:41.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.361+0000 7f796f7fe640 1 -- 172.21.15.26:0/1524521081 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c0a8de0 con 0x7f7960003ef0 2023-10-14T11:13:41.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.361+0000 7f7976ec9640 1 -- 172.21.15.26:0/1524521081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7960003ef0 msgr2=0x7f79600047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:41.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.361+0000 7f7976ec9640 1 --2- 172.21.15.26:0/1524521081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7960003ef0 0x7f79600047d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f797006e6d0 tx=0x7f795c01ec90 comp rx=0 tx=0).stop 2023-10-14T11:13:41.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.361+0000 7f7975466640 1 -- 172.21.15.26:0/1524521081 reap_dead start 2023-10-14T11:13:41.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.361+0000 7f7976ec9640 1 -- 172.21.15.26:0/1524521081 shutdown_connections 2023-10-14T11:13:41.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.361+0000 7f7976ec9640 1 -- 172.21.15.26:0/1524521081 >> 172.21.15.26:0/1524521081 conn(0x7f797006a820 msgr2=0x7f79700b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:41.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.361+0000 7f7976ec9640 1 -- 172.21.15.26:0/1524521081 shutdown_connections 2023-10-14T11:13:41.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.361+0000 7f7976ec9640 1 -- 172.21.15.26:0/1524521081 wait complete. 2023-10-14T11:13:41.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f7976ec9640 1 Processor -- start 2023-10-14T11:13:41.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f7976ec9640 1 -- start start 2023-10-14T11:13:41.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f7976ec9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7960003ef0 0x7f7970141fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:41.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f7976ec9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f797015c4a0 0x7f797015adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:41.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f7976ec9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7970070a20 0x7f7970070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:41.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f7976ec9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797015beb0 con 0x7f797015c4a0 2023-10-14T11:13:41.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f7976ec9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79700713e0 con 0x7f7970070a20 2023-10-14T11:13:41.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f7976ec9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797015b610 con 0x7f7960003ef0 2023-10-14T11:13:41.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f796ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f797015c4a0 0x7f797015adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:41.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f796ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f797015c4a0 0x7f797015adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58134/0 (socket says 172.21.15.26:58134) 2023-10-14T11:13:41.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f796ffff640 1 -- 172.21.15.26:0/2819405725 learned_addr learned my addr 172.21.15.26:0/2819405725 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:41.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f7975466640 1 --2- 172.21.15.26:0/2819405725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7970070a20 0x7f7970070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:41.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f7974c65640 1 --2- 172.21.15.26:0/2819405725 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7960003ef0 0x7f7970141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:41.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f796ffff640 1 -- 172.21.15.26:0/2819405725 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7960003ef0 msgr2=0x7f7970141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:41.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f796ffff640 1 --2- 172.21.15.26:0/2819405725 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7960003ef0 0x7f7970141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:41.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f796ffff640 1 -- 172.21.15.26:0/2819405725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7970070a20 msgr2=0x7f7970070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:41.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f796ffff640 1 --2- 172.21.15.26:0/2819405725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7970070a20 0x7f7970070ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:41.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f796ffff640 1 -- 172.21.15.26:0/2819405725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797015b8f0 con 0x7f797015c4a0 2023-10-14T11:13:41.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f796ffff640 1 --2- 172.21.15.26:0/2819405725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f797015c4a0 0x7f797015adc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f795c0b3040 tx=0x7f7960005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:41.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f796d7fa640 1 -- 172.21.15.26:0/2819405725 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c0050c0 con 0x7f797015c4a0 2023-10-14T11:13:41.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f796d7fa640 1 -- 172.21.15.26:0/2819405725 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c005220 con 0x7f797015c4a0 2023-10-14T11:13:41.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f796d7fa640 1 -- 172.21.15.26:0/2819405725 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c0067e0 con 0x7f797015c4a0 2023-10-14T11:13:41.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f7976ec9640 1 -- 172.21.15.26:0/2819405725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797015bbd0 con 0x7f797015c4a0 2023-10-14T11:13:41.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f7976ec9640 1 -- 172.21.15.26:0/2819405725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79701424e0 con 0x7f797015c4a0 2023-10-14T11:13:41.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.365+0000 7f7976ec9640 1 -- 172.21.15.26:0/2819405725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79701550b0 con 0x7f797015c4a0 2023-10-14T11:13:41.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.369+0000 7f796d7fa640 1 -- 172.21.15.26:0/2819405725 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f795c0b7040 con 0x7f797015c4a0 2023-10-14T11:13:41.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.369+0000 7f796d7fa640 1 --2- 172.21.15.26:0/2819405725 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f79540664d0 0x7f7954068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:41.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.369+0000 7f796d7fa640 1 -- 172.21.15.26:0/2819405725 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f795c120dd0 con 0x7f797015c4a0 2023-10-14T11:13:41.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.369+0000 7f7974c65640 1 --2- 172.21.15.26:0/2819405725 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f79540664d0 0x7f7954068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:41.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.369+0000 7f7974c65640 1 --2- 172.21.15.26:0/2819405725 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f79540664d0 0x7f7954068990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7964009be0 tx=0x7f7964009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:41.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.373+0000 7f796d7fa640 1 -- 172.21.15.26:0/2819405725 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f79701550b0 con 0x7f797015c4a0 2023-10-14T11:13:41.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:41.529+0000 7f7976ec9640 1 -- 172.21.15.26:0/2819405725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f79701550b0 con 0x7f797015c4a0 2023-10-14T11:13:42.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.169+0000 7f796d7fa640 1 -- 172.21.15.26:0/2819405725 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f79701550b0 con 0x7f797015c4a0 2023-10-14T11:13:42.175 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' removed 2023-10-14T11:13:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.173+0000 7f7976ec9640 1 -- 172.21.15.26:0/2819405725 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f79540664d0 msgr2=0x7f7954068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.173+0000 7f7976ec9640 1 --2- 172.21.15.26:0/2819405725 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f79540664d0 0x7f7954068990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7964009be0 tx=0x7f7964009190 comp rx=0 tx=0).stop 2023-10-14T11:13:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.173+0000 7f7976ec9640 1 -- 172.21.15.26:0/2819405725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f797015c4a0 msgr2=0x7f797015adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.173+0000 7f7976ec9640 1 --2- 172.21.15.26:0/2819405725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f797015c4a0 0x7f797015adc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f795c0b3040 tx=0x7f7960005800 comp rx=0 tx=0).stop 2023-10-14T11:13:42.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.173+0000 7f7976ec9640 1 -- 172.21.15.26:0/2819405725 shutdown_connections 2023-10-14T11:13:42.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.173+0000 7f7976ec9640 1 --2- 172.21.15.26:0/2819405725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7970070a20 0x7f7970070ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:42.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.173+0000 7f7976ec9640 1 --2- 172.21.15.26:0/2819405725 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f79540664d0 0x7f7954068990 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:42.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.173+0000 7f7976ec9640 1 --2- 172.21.15.26:0/2819405725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f797015c4a0 0x7f797015adc0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:42.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.173+0000 7f7976ec9640 1 --2- 172.21.15.26:0/2819405725 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7960003ef0 0x7f7970141fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:42.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.173+0000 7f7976ec9640 1 -- 172.21.15.26:0/2819405725 >> 172.21.15.26:0/2819405725 conn(0x7f797006a820 msgr2=0x7f79700cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:42.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.177+0000 7f7976ec9640 1 -- 172.21.15.26:0/2819405725 shutdown_connections 2023-10-14T11:13:42.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.177+0000 7f7976ec9640 1 -- 172.21.15.26:0/2819405725 wait complete. 2023-10-14T11:13:42.205 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-14T11:13:42.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcbaf94640 1 Processor -- start 2023-10-14T11:13:42.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcbaf94640 1 -- start start 2023-10-14T11:13:42.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcbaf94640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbcb41441a0 0x7fbcb40b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:42.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcbaf94640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb415e5f0 con 0x7fbcb40cb530 2023-10-14T11:13:42.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcbaf94640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb415e8d0 con 0x7fbcb40b1a90 2023-10-14T11:13:42.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcbaf94640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb40b1f20 con 0x7fbcb41441a0 2023-10-14T11:13:42.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb9531640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbcb40cb530 0x7fbcb40c8fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34580/0 (socket says 172.21.15.26:34580) 2023-10-14T11:13:42.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb9531640 1 -- 172.21.15.26:0/746424710 learned_addr learned my addr 172.21.15.26:0/746424710 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:42.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb37fe640 1 -- 172.21.15.26:0/746424710 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161906229 0 0) 0x7fbcb415e5f0 con 0x7fbcb40cb530 2023-10-14T11:13:42.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb37fe640 1 -- 172.21.15.26:0/746424710 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbca4003530 con 0x7fbcb40cb530 2023-10-14T11:13:42.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb8d30640 1 --2- 172.21.15.26:0/746424710 >> v2:172.21.15.110:3300/0 conn(0x7fbcb41441a0 0x7fbcb40b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:42.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb37fe640 1 -- 172.21.15.26:0/746424710 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 829412572 0 0) 0x7fbca4003530 con 0x7fbcb40cb530 2023-10-14T11:13:42.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb37fe640 1 -- 172.21.15.26:0/746424710 >> v2:172.21.15.110:3300/0 conn(0x7fbcb41441a0 msgr2=0x7fbcb40b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:42.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb37fe640 1 --2- 172.21.15.26:0/746424710 >> v2:172.21.15.110:3300/0 conn(0x7fbcb41441a0 0x7fbcb40b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:42.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb37fe640 1 -- 172.21.15.26:0/746424710 >> v1:172.21.15.110:6789/0 conn(0x7fbcb40b1a90 legacy=0x7fbcb40cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:42.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb37fe640 1 -- 172.21.15.26:0/746424710 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb415ebb0 con 0x7fbcb40cb530 2023-10-14T11:13:42.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb37fe640 1 -- 172.21.15.26:0/746424710 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7fbcac001a00 con 0x7fbcb40cb530 2023-10-14T11:13:42.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb37fe640 1 -- 172.21.15.26:0/746424710 >> v1:172.21.15.26:6789/0 conn(0x7fbcb40cb530 legacy=0x7fbcb40c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:42.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb37fe640 1 --2- 172.21.15.26:0/746424710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbca4003980 0x7fbca4003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:42.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb37fe640 1 --2- 172.21.15.26:0/746424710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbca4004380 0x7fbca4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:42.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb37fe640 1 --2- 172.21.15.26:0/746424710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbca4005050 0x7fbca400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:42.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb37fe640 1 -- 172.21.15.26:0/746424710 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb40b1f20 con 0x7fbca4005050 2023-10-14T11:13:42.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb37fe640 1 -- 172.21.15.26:0/746424710 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca400bfb0 con 0x7fbca4003980 2023-10-14T11:13:42.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb37fe640 1 -- 172.21.15.26:0/746424710 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca400c170 con 0x7fbca4004380 2023-10-14T11:13:42.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb9531640 1 --2- 172.21.15.26:0/746424710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbca4005050 0x7fbca400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:42.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb8d30640 1 --2- 172.21.15.26:0/746424710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbca4003980 0x7fbca4003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:42.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb3fff640 1 --2- 172.21.15.26:0/746424710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbca4004380 0x7fbca4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:42.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb9531640 1 -- 172.21.15.26:0/746424710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbca4004380 msgr2=0x7fbca4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:42.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb9531640 1 --2- 172.21.15.26:0/746424710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbca4004380 0x7fbca4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:42.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb9531640 1 -- 172.21.15.26:0/746424710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbca4003980 msgr2=0x7fbca4003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:42.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb9531640 1 --2- 172.21.15.26:0/746424710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbca4003980 0x7fbca4003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:42.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.373+0000 7fbcb9531640 1 -- 172.21.15.26:0/746424710 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca4003530 con 0x7fbca4005050 2023-10-14T11:13:42.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.377+0000 7fbcb9531640 1 -- 172.21.15.26:0/746424710 reap_dead start 2023-10-14T11:13:42.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.377+0000 7fbcb9531640 1 --2- 172.21.15.26:0/746424710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbca4005050 0x7fbca400b990 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00a840 tx=0x7fbcac01fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec09fd1b57a8027 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:42.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.377+0000 7fbcb37fe640 1 -- 172.21.15.26:0/746424710 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac0af070 con 0x7fbca4005050 2023-10-14T11:13:42.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.377+0000 7fbcb37fe640 1 -- 172.21.15.26:0/746424710 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcac0aa4b0 con 0x7fbca4005050 2023-10-14T11:13:42.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.377+0000 7fbcb37fe640 1 -- 172.21.15.26:0/746424710 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac0aa860 con 0x7fbca4005050 2023-10-14T11:13:42.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.377+0000 7fbcbaf94640 1 -- 172.21.15.26:0/746424710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbca4005050 msgr2=0x7fbca400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:42.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.377+0000 7fbcbaf94640 1 --2- 172.21.15.26:0/746424710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbca4005050 0x7fbca400b990 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00a840 tx=0x7fbcac01fa80 comp rx=0 tx=0).stop 2023-10-14T11:13:42.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.377+0000 7fbcbaf94640 1 -- 172.21.15.26:0/746424710 shutdown_connections 2023-10-14T11:13:42.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.377+0000 7fbcbaf94640 1 --2- 172.21.15.26:0/746424710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbca4005050 0x7fbca400b990 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:42.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.377+0000 7fbcbaf94640 1 -- 172.21.15.26:0/746424710 >> 172.21.15.26:0/746424710 conn(0x7fbcb406a820 msgr2=0x7fbcb40b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:42.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.377+0000 7fbcbaf94640 1 -- 172.21.15.26:0/746424710 shutdown_connections 2023-10-14T11:13:42.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.377+0000 7fbcbaf94640 1 -- 172.21.15.26:0/746424710 wait complete. 2023-10-14T11:13:42.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcbaf94640 1 Processor -- start 2023-10-14T11:13:42.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcbaf94640 1 -- start start 2023-10-14T11:13:42.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcbaf94640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbca4005050 0x7fbcb40cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:42.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcbaf94640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcb40c8410 0x7fbcb415cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:42.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcbaf94640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbcb415a350 0x7fbcb415d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:42.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcbaf94640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb40cd760 con 0x7fbcb40c8410 2023-10-14T11:13:42.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcbaf94640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb41429e0 con 0x7fbcb415a350 2023-10-14T11:13:42.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcbaf94640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb40ccae0 con 0x7fbca4005050 2023-10-14T11:13:42.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcb3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcb40c8410 0x7fbcb415cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:42.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcb3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcb40c8410 0x7fbcb415cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41352/0 (socket says 172.21.15.26:41352) 2023-10-14T11:13:42.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcb3fff640 1 -- 172.21.15.26:0/2062126137 learned_addr learned my addr 172.21.15.26:0/2062126137 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:42.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcb8d30640 1 --2- 172.21.15.26:0/2062126137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbca4005050 0x7fbcb40cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:42.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcb9531640 1 --2- 172.21.15.26:0/2062126137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbcb415a350 0x7fbcb415d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:42.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcb3fff640 1 -- 172.21.15.26:0/2062126137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbca4005050 msgr2=0x7fbcb40cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:42.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcb3fff640 1 --2- 172.21.15.26:0/2062126137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbca4005050 0x7fbcb40cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:42.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcb3fff640 1 -- 172.21.15.26:0/2062126137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbcb415a350 msgr2=0x7fbcb415d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:42.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcb3fff640 1 --2- 172.21.15.26:0/2062126137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbcb415a350 0x7fbcb415d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:42.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcb3fff640 1 -- 172.21.15.26:0/2062126137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb40ccdc0 con 0x7fbcb40c8410 2023-10-14T11:13:42.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcb8d30640 1 --2- 172.21.15.26:0/2062126137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbca4005050 0x7fbcb40cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:42.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcb3fff640 1 --2- 172.21.15.26:0/2062126137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcb40c8410 0x7fbcb415cd80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fbca000f7f0 tx=0x7fbca000fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:42.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcb17fa640 1 -- 172.21.15.26:0/2062126137 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca000fea0 con 0x7fbcb40c8410 2023-10-14T11:13:42.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcb17fa640 1 -- 172.21.15.26:0/2062126137 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca00052e0 con 0x7fbcb40c8410 2023-10-14T11:13:42.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcb17fa640 1 -- 172.21.15.26:0/2062126137 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca000d970 con 0x7fbcb40c8410 2023-10-14T11:13:42.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.381+0000 7fbcbaf94640 1 -- 172.21.15.26:0/2062126137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb40cd0a0 con 0x7fbcb40c8410 2023-10-14T11:13:42.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.385+0000 7fbcbaf94640 1 -- 172.21.15.26:0/2062126137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb40cc6d0 con 0x7fbcb40c8410 2023-10-14T11:13:42.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.385+0000 7fbcbaf94640 1 -- 172.21.15.26:0/2062126137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb40cd8a0 con 0x7fbcb40c8410 2023-10-14T11:13:42.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.385+0000 7fbcb17fa640 1 -- 172.21.15.26:0/2062126137 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbca000dad0 con 0x7fbcb40c8410 2023-10-14T11:13:42.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.385+0000 7fbcb17fa640 1 --2- 172.21.15.26:0/2062126137 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbc980664a0 0x7fbc98068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:42.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.385+0000 7fbcb17fa640 1 -- 172.21.15.26:0/2062126137 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5781+0+0 (secure 0 0 0) 0x7fbca0083dc0 con 0x7fbcb40c8410 2023-10-14T11:13:42.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.385+0000 7fbcb8d30640 1 --2- 172.21.15.26:0/2062126137 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbc980664a0 0x7fbc98068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:42.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.385+0000 7fbcb8d30640 1 --2- 172.21.15.26:0/2062126137 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbc980664a0 0x7fbc98068960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbcb41349f0 tx=0x7fbca8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:42.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.389+0000 7fbcb17fa640 1 -- 172.21.15.26:0/2062126137 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbcb40cd8a0 con 0x7fbcb40c8410 2023-10-14T11:13:42.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:42.549+0000 7fbcbaf94640 1 -- 172.21.15.26:0/2062126137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbcb40cd8a0 con 0x7fbcb40c8410 2023-10-14T11:13:43.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.177+0000 7fbcb17fa640 1 -- 172.21.15.26:0/2062126137 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7fbcb40cd8a0 con 0x7fbcb40c8410 2023-10-14T11:13:43.181 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data_ec' removed 2023-10-14T11:13:43.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.181+0000 7fbcbaf94640 1 -- 172.21.15.26:0/2062126137 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbc980664a0 msgr2=0x7fbc98068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:43.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.181+0000 7fbcbaf94640 1 --2- 172.21.15.26:0/2062126137 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbc980664a0 0x7fbc98068960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbcb41349f0 tx=0x7fbca8008040 comp rx=0 tx=0).stop 2023-10-14T11:13:43.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.181+0000 7fbcbaf94640 1 -- 172.21.15.26:0/2062126137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcb40c8410 msgr2=0x7fbcb415cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:43.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.181+0000 7fbcbaf94640 1 --2- 172.21.15.26:0/2062126137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcb40c8410 0x7fbcb415cd80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fbca000f7f0 tx=0x7fbca000fcb0 comp rx=0 tx=0).stop 2023-10-14T11:13:43.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.181+0000 7fbcbaf94640 1 -- 172.21.15.26:0/2062126137 shutdown_connections 2023-10-14T11:13:43.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.181+0000 7fbcbaf94640 1 --2- 172.21.15.26:0/2062126137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbcb415a350 0x7fbcb415d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:43.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.181+0000 7fbcbaf94640 1 --2- 172.21.15.26:0/2062126137 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbc980664a0 0x7fbc98068960 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:43.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.181+0000 7fbcbaf94640 1 --2- 172.21.15.26:0/2062126137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcb40c8410 0x7fbcb415cd80 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:43.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.181+0000 7fbcbaf94640 1 --2- 172.21.15.26:0/2062126137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbca4005050 0x7fbcb40cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:43.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.181+0000 7fbcbaf94640 1 -- 172.21.15.26:0/2062126137 >> 172.21.15.26:0/2062126137 conn(0x7fbcb406a820 msgr2=0x7fbcb4071b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:43.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.181+0000 7fbcbaf94640 1 -- 172.21.15.26:0/2062126137 shutdown_connections 2023-10-14T11:13:43.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.181+0000 7fbcbaf94640 1 -- 172.21.15.26:0/2062126137 wait complete. 2023-10-14T11:13:43.212 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T11:13:43.212 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T11:13:43.212 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T11:13:43.213 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:13:43.213 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T11:13:43.213 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T11:13:43.214 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T11:13:43.214 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:13:43.214 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T11:13:43.214 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T11:13:43.215 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T11:13:43.215 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:13:43.215 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T11:13:43.216 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T11:13:43.216 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T11:13:43.216 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:13:43.226 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T11:13:43.227 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T11:13:43.228 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T11:13:43.229 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T11:13:43.230 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T11:13:43.230 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T11:13:43.231 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T11:13:43.232 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T11:13:43.277 INFO:tasks.ceph.mds.a:Started 2023-10-14T11:13:43.278 DEBUG:teuthology.parallel:result is None 2023-10-14T11:13:43.281 INFO:tasks.ceph.mds.c:Started 2023-10-14T11:13:43.281 DEBUG:teuthology.parallel:result is None 2023-10-14T11:13:43.282 INFO:tasks.ceph.mds.b:Started 2023-10-14T11:13:43.283 DEBUG:teuthology.parallel:result is None 2023-10-14T11:13:43.284 INFO:tasks.ceph.mds.d:Started 2023-10-14T11:13:43.284 DEBUG:teuthology.parallel:result is None 2023-10-14T11:13:43.285 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T11:13:43.371 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2023-10-14T11:13:43.372 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2023-10-14T11:13:43.373 INFO:tasks.ceph.mds.d.smithi110.stderr:2023-10-14T11:13:43.367+0000 7f6849c90640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-10-14T11:13:43.374 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-14T11:13:43.376 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-10-14T11:13:43.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.441+0000 7f73899a1640 1 Processor -- start 2023-10-14T11:13:43.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.441+0000 7f73899a1640 1 -- start start 2023-10-14T11:13:43.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.441+0000 7f73899a1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f738415cae0 0x7f73840cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:43.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.441+0000 7f73899a1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f73840d3190 0x7f73840d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:43.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.441+0000 7f73899a1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73840ce730 con 0x7f73840d1570 2023-10-14T11:13:43.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.441+0000 7f73899a1640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73840d0ba0 con 0x7f73840d3190 2023-10-14T11:13:43.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.441+0000 7f73899a1640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73840ce450 con 0x7f738415cae0 2023-10-14T11:13:43.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.441+0000 7f737bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f73840d3190 0x7f73840d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:43.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.441+0000 7f737bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f73840d3190 0x7f73840d1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41390/0 (socket says 172.21.15.26:41390) 2023-10-14T11:13:43.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.441+0000 7f737bfff640 1 -- 172.21.15.26:0/3385211703 learned_addr learned my addr 172.21.15.26:0/3385211703 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:43.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.441+0000 7f7382ffd640 1 --2- 172.21.15.26:0/3385211703 >> v2:172.21.15.110:3300/0 conn(0x7f738415cae0 0x7f73840cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:43.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.441+0000 7f737bfff640 1 -- 172.21.15.26:0/3385211703 >> v2:172.21.15.110:3300/0 conn(0x7f738415cae0 msgr2=0x7f73840cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:43.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.441+0000 7f737bfff640 1 --2- 172.21.15.26:0/3385211703 >> v2:172.21.15.110:3300/0 conn(0x7f738415cae0 0x7f73840cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:43.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.441+0000 7f737bfff640 1 -- 172.21.15.26:0/3385211703 >> v1:172.21.15.110:6789/0 conn(0x7f73840d1570 legacy=0x7f73840cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:43.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.441+0000 7f737bfff640 1 -- 172.21.15.26:0/3385211703 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73840d0550 con 0x7f73840d3190 2023-10-14T11:13:43.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.445+0000 7f737bfff640 1 --2- 172.21.15.26:0/3385211703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73840d3190 0x7f73840d1030 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f738408ce20 tx=0x7f736c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4731ceed114a6722 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:43.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.445+0000 7f73827fc640 1 -- 172.21.15.26:0/3385211703 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c0ab5f0 con 0x7f73840d3190 2023-10-14T11:13:43.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.445+0000 7f73827fc640 1 -- 172.21.15.26:0/3385211703 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736c0ab750 con 0x7f73840d3190 2023-10-14T11:13:43.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.445+0000 7f73827fc640 1 -- 172.21.15.26:0/3385211703 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c0abae0 con 0x7f73840d3190 2023-10-14T11:13:43.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.445+0000 7f73899a1640 1 -- 172.21.15.26:0/3385211703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73840d3190 msgr2=0x7f73840d1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:43.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.445+0000 7f73899a1640 1 --2- 172.21.15.26:0/3385211703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73840d3190 0x7f73840d1030 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f738408ce20 tx=0x7f736c01c4d0 comp rx=0 tx=0).stop 2023-10-14T11:13:43.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.445+0000 7f73899a1640 1 -- 172.21.15.26:0/3385211703 shutdown_connections 2023-10-14T11:13:43.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.445+0000 7f73899a1640 1 --2- 172.21.15.26:0/3385211703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73840d3190 0x7f73840d1030 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:43.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.445+0000 7f73899a1640 1 --2- 172.21.15.26:0/3385211703 >> v2:172.21.15.110:3300/0 conn(0x7f738415cae0 0x7f73840cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:43.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.445+0000 7f73899a1640 1 -- 172.21.15.26:0/3385211703 >> 172.21.15.26:0/3385211703 conn(0x7f738409bb50 msgr2=0x7f73840d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:43.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.445+0000 7f73899a1640 1 -- 172.21.15.26:0/3385211703 shutdown_connections 2023-10-14T11:13:43.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.445+0000 7f73899a1640 1 -- 172.21.15.26:0/3385211703 wait complete. 2023-10-14T11:13:43.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f73899a1640 1 Processor -- start 2023-10-14T11:13:43.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f73899a1640 1 -- start start 2023-10-14T11:13:43.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f73899a1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73840d1570 0x7f738414eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:43.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f73899a1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73840d3190 0x7f73840af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:43.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f73899a1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f738415cae0 0x7f73840af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:43.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f73899a1640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738415b5a0 con 0x7f738415cae0 2023-10-14T11:13:43.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f73899a1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738415a990 con 0x7f73840d1570 2023-10-14T11:13:43.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f73899a1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738415ac70 con 0x7f73840d3190 2023-10-14T11:13:43.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f73837fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f738415cae0 0x7f73840af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:43.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f737bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73840d3190 0x7f73840af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:43.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f73837fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f738415cae0 0x7f73840af8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41400/0 (socket says 172.21.15.26:41400) 2023-10-14T11:13:43.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f73837fe640 1 -- 172.21.15.26:0/450181934 learned_addr learned my addr 172.21.15.26:0/450181934 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:43.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f7382ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73840d1570 0x7f738414eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:43.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f73837fe640 1 -- 172.21.15.26:0/450181934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73840d3190 msgr2=0x7f73840af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:43.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f73837fe640 1 --2- 172.21.15.26:0/450181934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73840d3190 0x7f73840af3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:43.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f73837fe640 1 -- 172.21.15.26:0/450181934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73840d1570 msgr2=0x7f738414eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:43.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f73837fe640 1 --2- 172.21.15.26:0/450181934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73840d1570 0x7f738414eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:43.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f73837fe640 1 -- 172.21.15.26:0/450181934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c0094d0 con 0x7f738415cae0 2023-10-14T11:13:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f73837fe640 1 --2- 172.21.15.26:0/450181934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f738415cae0 0x7f73840af8f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f737c00c730 tx=0x7f737c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f7380ff9640 1 -- 172.21.15.26:0/450181934 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c003b80 con 0x7f738415cae0 2023-10-14T11:13:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f7380ff9640 1 -- 172.21.15.26:0/450181934 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737c003ce0 con 0x7f738415cae0 2023-10-14T11:13:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f73899a1640 1 -- 172.21.15.26:0/450181934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738415af50 con 0x7f738415cae0 2023-10-14T11:13:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f7380ff9640 1 -- 172.21.15.26:0/450181934 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c00aa30 con 0x7f738415cae0 2023-10-14T11:13:43.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.449+0000 7f73899a1640 1 -- 172.21.15.26:0/450181934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738414f2e0 con 0x7f738415cae0 2023-10-14T11:13:43.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.453+0000 7f73899a1640 1 -- 172.21.15.26:0/450181934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738415d9d0 con 0x7f738415cae0 2023-10-14T11:13:43.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.453+0000 7f7380ff9640 1 -- 172.21.15.26:0/450181934 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f737c00ab90 con 0x7f738415cae0 2023-10-14T11:13:43.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.453+0000 7f7380ff9640 1 --2- 172.21.15.26:0/450181934 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73640664a0 0x7f7364068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:43.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.453+0000 7f7380ff9640 1 -- 172.21.15.26:0/450181934 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f737c0838e0 con 0x7f738415cae0 2023-10-14T11:13:43.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.453+0000 7f7382ffd640 1 --2- 172.21.15.26:0/450181934 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73640664a0 0x7f7364068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:43.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.453+0000 7f7382ffd640 1 --2- 172.21.15.26:0/450181934 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73640664a0 0x7f7364068960 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7374009aa0 tx=0x7f7374006f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:43.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.457+0000 7f7380ff9640 1 -- 172.21.15.26:0/450181934 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f737c051040 con 0x7f738415cae0 2023-10-14T11:13:43.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:43.625+0000 7f73899a1640 1 -- 172.21.15.26:0/450181934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7384067230 con 0x7f738415cae0 2023-10-14T11:13:44.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.193+0000 7f7380ff9640 1 -- 172.21.15.26:0/450181934 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7f737c054660 con 0x7f738415cae0 2023-10-14T11:13:44.197 INFO:teuthology.orchestra.run.smithi026.stderr: removed all blocklist entries 2023-10-14T11:13:44.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.197+0000 7f73899a1640 1 -- 172.21.15.26:0/450181934 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73640664a0 msgr2=0x7f7364068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:44.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.197+0000 7f73899a1640 1 --2- 172.21.15.26:0/450181934 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73640664a0 0x7f7364068960 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7374009aa0 tx=0x7f7374006f90 comp rx=0 tx=0).stop 2023-10-14T11:13:44.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.197+0000 7f73899a1640 1 -- 172.21.15.26:0/450181934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f738415cae0 msgr2=0x7f73840af8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:44.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.197+0000 7f73899a1640 1 --2- 172.21.15.26:0/450181934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f738415cae0 0x7f73840af8f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f737c00c730 tx=0x7f737c00cbf0 comp rx=0 tx=0).stop 2023-10-14T11:13:44.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.197+0000 7f73899a1640 1 -- 172.21.15.26:0/450181934 shutdown_connections 2023-10-14T11:13:44.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.197+0000 7f73899a1640 1 --2- 172.21.15.26:0/450181934 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73640664a0 0x7f7364068960 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:44.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.197+0000 7f73899a1640 1 --2- 172.21.15.26:0/450181934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f738415cae0 0x7f73840af8f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:44.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.197+0000 7f73899a1640 1 --2- 172.21.15.26:0/450181934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73840d3190 0x7f73840af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:44.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.197+0000 7f73899a1640 1 --2- 172.21.15.26:0/450181934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73840d1570 0x7f738414eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:44.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.197+0000 7f73899a1640 1 -- 172.21.15.26:0/450181934 >> 172.21.15.26:0/450181934 conn(0x7f738409bb50 msgr2=0x7f7384158c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:44.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.197+0000 7f73899a1640 1 -- 172.21.15.26:0/450181934 shutdown_connections 2023-10-14T11:13:44.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.197+0000 7f73899a1640 1 -- 172.21.15.26:0/450181934 wait complete. 2023-10-14T11:13:44.223 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T11:13:44.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.365+0000 7f4eca53e640 1 Processor -- start 2023-10-14T11:13:44.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.365+0000 7f4eca53e640 1 -- start start 2023-10-14T11:13:44.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.365+0000 7f4eca53e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ec415cb90 0x7f4ec40cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:44.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.365+0000 7f4eca53e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4ec40d3010 0x7f4ec40d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:44.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.365+0000 7f4eca53e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4ec40d1400 0x7f4ec40cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:44.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.365+0000 7f4eca53e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec40d1890 con 0x7f4ec40d3010 2023-10-14T11:13:44.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.365+0000 7f4eca53e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec40ce770 con 0x7f4ec40d1400 2023-10-14T11:13:44.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.365+0000 7f4eca53e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec40d0600 con 0x7f4ec415cb90 2023-10-14T11:13:44.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.365+0000 7f4ec37fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4ec40d3010 0x7f4ec40d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:44.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.365+0000 7f4ec37fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4ec40d3010 0x7f4ec40d0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41412/0 (socket says 172.21.15.26:41412) 2023-10-14T11:13:44.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.365+0000 7f4ec37fe640 1 -- 172.21.15.26:0/2662330576 learned_addr learned my addr 172.21.15.26:0/2662330576 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:44.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.365+0000 7f4ec8adb640 1 --2- 172.21.15.26:0/2662330576 >> v2:172.21.15.110:3300/0 conn(0x7f4ec40d1400 0x7f4ec40cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:44.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.365+0000 7f4ec3fff640 1 --2- 172.21.15.26:0/2662330576 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ec415cb90 0x7f4ec40cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:44.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.365+0000 7f4ec37fe640 1 -- 172.21.15.26:0/2662330576 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ec415cb90 msgr2=0x7f4ec40cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:44.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.365+0000 7f4ec37fe640 1 --2- 172.21.15.26:0/2662330576 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ec415cb90 0x7f4ec40cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:44.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.365+0000 7f4ec37fe640 1 -- 172.21.15.26:0/2662330576 >> v2:172.21.15.110:3300/0 conn(0x7f4ec40d1400 msgr2=0x7f4ec40cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:44.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.365+0000 7f4ec37fe640 1 --2- 172.21.15.26:0/2662330576 >> v2:172.21.15.110:3300/0 conn(0x7f4ec40d1400 0x7f4ec40cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:44.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.365+0000 7f4ec37fe640 1 -- 172.21.15.26:0/2662330576 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec40c6450 con 0x7f4ec40d3010 2023-10-14T11:13:44.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.365+0000 7f4ec8adb640 1 --2- 172.21.15.26:0/2662330576 >> v2:172.21.15.110:3300/0 conn(0x7f4ec40d1400 0x7f4ec40cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:44.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.365+0000 7f4ec3fff640 1 --2- 172.21.15.26:0/2662330576 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ec415cb90 0x7f4ec40cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:44.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.369+0000 7f4ec37fe640 1 --2- 172.21.15.26:0/2662330576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ec40d3010 0x7f4ec40d0ec0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40725c0 tx=0x7f4eb801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244bddb0505fcd67 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.369+0000 7f4ec2ffd640 1 -- 172.21.15.26:0/2662330576 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb80ab600 con 0x7f4ec40d3010 2023-10-14T11:13:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.369+0000 7f4ec2ffd640 1 -- 172.21.15.26:0/2662330576 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb80ab760 con 0x7f4ec40d3010 2023-10-14T11:13:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.369+0000 7f4ec2ffd640 1 -- 172.21.15.26:0/2662330576 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb80abaf0 con 0x7f4ec40d3010 2023-10-14T11:13:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.369+0000 7f4eca53e640 1 -- 172.21.15.26:0/2662330576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ec40d3010 msgr2=0x7f4ec40d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.369+0000 7f4eca53e640 1 --2- 172.21.15.26:0/2662330576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ec40d3010 0x7f4ec40d0ec0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40725c0 tx=0x7f4eb801c440 comp rx=0 tx=0).stop 2023-10-14T11:13:44.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.369+0000 7f4eca53e640 1 -- 172.21.15.26:0/2662330576 shutdown_connections 2023-10-14T11:13:44.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.369+0000 7f4eca53e640 1 --2- 172.21.15.26:0/2662330576 >> v2:172.21.15.110:3300/0 conn(0x7f4ec40d1400 0x7f4ec40cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:44.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.369+0000 7f4eca53e640 1 --2- 172.21.15.26:0/2662330576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ec40d3010 0x7f4ec40d0ec0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:44.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.369+0000 7f4eca53e640 1 --2- 172.21.15.26:0/2662330576 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ec415cb90 0x7f4ec40cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:44.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.369+0000 7f4eca53e640 1 -- 172.21.15.26:0/2662330576 >> 172.21.15.26:0/2662330576 conn(0x7f4ec409bc50 msgr2=0x7f4ec40d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:44.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.369+0000 7f4eca53e640 1 -- 172.21.15.26:0/2662330576 shutdown_connections 2023-10-14T11:13:44.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.369+0000 7f4eca53e640 1 -- 172.21.15.26:0/2662330576 wait complete. 2023-10-14T11:13:44.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4eca53e640 1 Processor -- start 2023-10-14T11:13:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4eca53e640 1 -- start start 2023-10-14T11:13:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4eca53e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ec40d1400 0x7f4ec414b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4eca53e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ec40d3010 0x7f4ec414f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4eca53e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ec415cb90 0x7f4ec414d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4eca53e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec414eb60 con 0x7f4ec40d3010 2023-10-14T11:13:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4eca53e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec414dc70 con 0x7f4ec40d1400 2023-10-14T11:13:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4eca53e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec415a4d0 con 0x7f4ec415cb90 2023-10-14T11:13:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4ec37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ec40d3010 0x7f4ec414f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4ec37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ec40d3010 0x7f4ec414f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41416/0 (socket says 172.21.15.26:41416) 2023-10-14T11:13:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4ec37fe640 1 -- 172.21.15.26:0/717449735 learned_addr learned my addr 172.21.15.26:0/717449735 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:44.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4ec3fff640 1 --2- 172.21.15.26:0/717449735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ec40d1400 0x7f4ec414b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:44.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4ec8adb640 1 --2- 172.21.15.26:0/717449735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ec415cb90 0x7f4ec414d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:44.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4ec37fe640 1 -- 172.21.15.26:0/717449735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ec415cb90 msgr2=0x7f4ec414d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:44.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4ec37fe640 1 --2- 172.21.15.26:0/717449735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ec415cb90 0x7f4ec414d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4ec37fe640 1 -- 172.21.15.26:0/717449735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ec40d1400 msgr2=0x7f4ec414b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4ec37fe640 1 --2- 172.21.15.26:0/717449735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ec40d1400 0x7f4ec414b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4ec37fe640 1 -- 172.21.15.26:0/717449735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb80094d0 con 0x7f4ec40d3010 2023-10-14T11:13:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4ec3fff640 1 --2- 172.21.15.26:0/717449735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ec40d1400 0x7f4ec414b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4ec37fe640 1 --2- 172.21.15.26:0/717449735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ec40d3010 0x7f4ec414f9b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4eb801aaf0 tx=0x7f4eb801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4ec0ff9640 1 -- 172.21.15.26:0/717449735 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb80b48c0 con 0x7f4ec40d3010 2023-10-14T11:13:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4ec0ff9640 1 -- 172.21.15.26:0/717449735 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb80b4a20 con 0x7f4ec40d3010 2023-10-14T11:13:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4ec0ff9640 1 -- 172.21.15.26:0/717449735 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb80b4db0 con 0x7f4ec40d3010 2023-10-14T11:13:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4eca53e640 1 -- 172.21.15.26:0/717449735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec415a6e0 con 0x7f4ec40d3010 2023-10-14T11:13:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.373+0000 7f4eca53e640 1 -- 172.21.15.26:0/717449735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec415aca0 con 0x7f4ec40d3010 2023-10-14T11:13:44.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.377+0000 7f4eca53e640 1 -- 172.21.15.26:0/717449735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec4074010 con 0x7f4ec40d3010 2023-10-14T11:13:44.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.377+0000 7f4ec0ff9640 1 -- 172.21.15.26:0/717449735 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4eb80b3380 con 0x7f4ec40d3010 2023-10-14T11:13:44.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.377+0000 7f4ec0ff9640 1 --2- 172.21.15.26:0/717449735 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4eb00664a0 0x7f4eb0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:44.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.377+0000 7f4ec0ff9640 1 -- 172.21.15.26:0/717449735 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f4eb811e3f0 con 0x7f4ec40d3010 2023-10-14T11:13:44.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.377+0000 7f4ec3fff640 1 --2- 172.21.15.26:0/717449735 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4eb00664a0 0x7f4eb0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:44.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.377+0000 7f4ec3fff640 1 --2- 172.21.15.26:0/717449735 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4eb00664a0 0x7f4eb0068960 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40b8970 tx=0x7f4eb4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:44.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.381+0000 7f4ec0ff9640 1 -- 172.21.15.26:0/717449735 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4eb80ebb30 con 0x7f4ec40d3010 2023-10-14T11:13:44.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.597+0000 7f4eca53e640 1 -- 172.21.15.26:0/717449735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4ec40c8840 con 0x7f4ec40d3010 2023-10-14T11:13:44.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.597+0000 7f4ec0ff9640 1 -- 172.21.15.26:0/717449735 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f4eb80ef150 con 0x7f4ec40d3010 2023-10-14T11:13:44.602 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:44.602 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:13:44.603 INFO:teuthology.orchestra.run.smithi026.stdout: "auth_dump": [ 2023-10-14T11:13:44.603 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.603 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.a", 2023-10-14T11:13:44.603 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBZdyplRm7mBhAA9TLX9jvw13hKZFBzlqLVWA==", 2023-10-14T11:13:44.604 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.605 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-14T11:13:44.605 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-14T11:13:44.606 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-14T11:13:44.606 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:13:44.606 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.606 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.606 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.606 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.b", 2023-10-14T11:13:44.607 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBZdyplCziNExAADrUZ/ARa7JGEmPPFlzyiOg==", 2023-10-14T11:13:44.607 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.607 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-14T11:13:44.607 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-14T11:13:44.607 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-14T11:13:44.608 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:13:44.608 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.608 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.608 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.608 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.c", 2023-10-14T11:13:44.609 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBZdyplCHJwDhAAfunTAdo2FVxukOSj7Hztsg==", 2023-10-14T11:13:44.609 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.609 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-14T11:13:44.609 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-14T11:13:44.609 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-14T11:13:44.609 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:13:44.610 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.610 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.610 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.610 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.d", 2023-10-14T11:13:44.610 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBZdyplzgA5GxAAK5Ah/o0nnDMVIZprhphkxw==", 2023-10-14T11:13:44.611 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.611 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-14T11:13:44.611 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-14T11:13:44.611 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-14T11:13:44.611 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:13:44.612 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.612 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.612 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.612 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.0", 2023-10-14T11:13:44.612 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBbdyplyABdBRAALhGtz0Y51kT1x8n8Vj21Cw==", 2023-10-14T11:13:44.612 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.613 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-14T11:13:44.613 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-14T11:13:44.613 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:13:44.613 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.614 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.614 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.614 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.1", 2023-10-14T11:13:44.614 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBedyplCaVcCxAAFVOhDkVThePN3Y/gjD3wNA==", 2023-10-14T11:13:44.614 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.614 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-14T11:13:44.615 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-14T11:13:44.615 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:13:44.615 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.615 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.615 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.616 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.2", 2023-10-14T11:13:44.616 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBhdypljagWEhAAFVSbpqTlV5d/o/ydvm53tQ==", 2023-10-14T11:13:44.616 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.616 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-14T11:13:44.616 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-14T11:13:44.617 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:13:44.617 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.617 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.617 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.617 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.3", 2023-10-14T11:13:44.617 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBkdyplvzxDGhAAn9TglOxt8PgopVubKj+J/Q==", 2023-10-14T11:13:44.618 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.618 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-14T11:13:44.618 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-14T11:13:44.618 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:13:44.619 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.619 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.619 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.619 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.4", 2023-10-14T11:13:44.619 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBodyploWvTJxAAFxIauZ1IG+Taz4096ajC2Q==", 2023-10-14T11:13:44.619 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.620 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-14T11:13:44.620 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-14T11:13:44.620 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:13:44.620 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.620 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.621 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.621 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.5", 2023-10-14T11:13:44.621 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBrdyplw++tLRAALzDk+Aw1H/IDM+5WsjSPvA==", 2023-10-14T11:13:44.621 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.621 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-14T11:13:44.622 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-14T11:13:44.622 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:13:44.622 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.622 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.622 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.623 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.6", 2023-10-14T11:13:44.623 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBudyplwJJdNBAARKiA3WwEH8t1/y7UNy92eg==", 2023-10-14T11:13:44.623 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.623 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-14T11:13:44.623 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-14T11:13:44.623 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:13:44.624 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.624 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.624 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.624 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.7", 2023-10-14T11:13:44.624 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBxdyplgBijOhAAy21yvN9VKAds3X/rGbCUgQ==", 2023-10-14T11:13:44.625 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.625 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-14T11:13:44.625 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-14T11:13:44.625 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:13:44.625 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.626 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.626 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.626 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.0", 2023-10-14T11:13:44.626 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBZdyplGXdwHxAA3yn7fC60cZX9BQGuvdlfYw==", 2023-10-14T11:13:44.626 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.626 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-14T11:13:44.627 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-14T11:13:44.627 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-14T11:13:44.627 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-14T11:13:44.627 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.627 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.628 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.628 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.1", 2023-10-14T11:13:44.628 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBZdypl5UdxKRAAeFk3cdLM7WTuHwdsE3PZIA==", 2023-10-14T11:13:44.628 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.628 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-14T11:13:44.629 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-14T11:13:44.629 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-14T11:13:44.629 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-14T11:13:44.629 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.629 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.630 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.630 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.2", 2023-10-14T11:13:44.630 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBZdyplH9PCJRAArxibYqSOXNQRw3K/6HcKTQ==", 2023-10-14T11:13:44.630 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.630 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-14T11:13:44.630 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-14T11:13:44.631 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-14T11:13:44.631 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-14T11:13:44.631 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.631 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.631 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.632 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.3", 2023-10-14T11:13:44.632 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBZdyplVCFoLxAAqT8U/Z+hM68mTywgrINGzg==", 2023-10-14T11:13:44.632 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.632 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-14T11:13:44.632 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-14T11:13:44.632 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-14T11:13:44.633 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-14T11:13:44.633 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.633 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.633 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.633 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.admin", 2023-10-14T11:13:44.634 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBYdyplTP0tJRAAwMbMTzoX7DJ0QpPsPr+ckw==", 2023-10-14T11:13:44.634 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.634 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-14T11:13:44.634 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-14T11:13:44.634 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-14T11:13:44.635 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:13:44.635 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.635 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.635 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.635 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-mds", 2023-10-14T11:13:44.636 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB9dyplB8QDAhAAxHv8Twz3/Ou/e7AMkWNrVw==", 2023-10-14T11:13:44.636 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.636 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-mds" 2023-10-14T11:13:44.636 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.636 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.636 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.637 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-mgr", 2023-10-14T11:13:44.637 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB9dyplms4DAhAArylitokrw1E3jqmJ0TjdGg==", 2023-10-14T11:13:44.637 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.637 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-14T11:13:44.637 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.638 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.638 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.638 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-osd", 2023-10-14T11:13:44.638 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB9dyplDtgDAhAAjwUxCqVi+BtfPxtc/NhFAw==", 2023-10-14T11:13:44.638 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.639 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-osd" 2023-10-14T11:13:44.639 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.639 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.639 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.639 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-rbd", 2023-10-14T11:13:44.639 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB9dyplIOEDAhAA5Pl7IWYtSEVDuKKFTyXS4A==", 2023-10-14T11:13:44.640 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.640 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-14T11:13:44.640 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.640 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.640 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.641 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-14T11:13:44.641 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB9dypl3ukDAhAA69TbPfY1Ve5PjPE6YB2r3Q==", 2023-10-14T11:13:44.641 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.641 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-14T11:13:44.641 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.641 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.642 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.642 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-rgw", 2023-10-14T11:13:44.642 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB9dyplJPYDAhAAeeaFcbsJO9fT8FSWuYhYkQ==", 2023-10-14T11:13:44.642 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.642 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-14T11:13:44.643 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.643 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.643 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.643 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.x", 2023-10-14T11:13:44.643 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBZdyplKBIpAhAAcL6wVN4Q7x9dIscL9JZjPw==", 2023-10-14T11:13:44.644 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.644 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-14T11:13:44.644 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-14T11:13:44.644 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:13:44.644 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.644 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:44.645 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:44.645 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.y", 2023-10-14T11:13:44.645 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBYdyplAXfkORAAVGkkCTmYSKxUhZbWw9wJYg==", 2023-10-14T11:13:44.645 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:13:44.645 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-14T11:13:44.646 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-14T11:13:44.646 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:13:44.646 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.646 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:44.646 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-14T11:13:44.646 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:13:44.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.601+0000 7f4eca53e640 1 -- 172.21.15.26:0/717449735 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4eb00664a0 msgr2=0x7f4eb0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:44.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.601+0000 7f4eca53e640 1 --2- 172.21.15.26:0/717449735 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4eb00664a0 0x7f4eb0068960 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40b8970 tx=0x7f4eb4008040 comp rx=0 tx=0).stop 2023-10-14T11:13:44.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.601+0000 7f4eca53e640 1 -- 172.21.15.26:0/717449735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ec40d3010 msgr2=0x7f4ec414f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:44.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.601+0000 7f4eca53e640 1 --2- 172.21.15.26:0/717449735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ec40d3010 0x7f4ec414f9b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4eb801aaf0 tx=0x7f4eb801ac80 comp rx=0 tx=0).stop 2023-10-14T11:13:44.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.601+0000 7f4eca53e640 1 -- 172.21.15.26:0/717449735 shutdown_connections 2023-10-14T11:13:44.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.601+0000 7f4eca53e640 1 --2- 172.21.15.26:0/717449735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ec415cb90 0x7f4ec414d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:44.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.601+0000 7f4eca53e640 1 --2- 172.21.15.26:0/717449735 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4eb00664a0 0x7f4eb0068960 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:44.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.601+0000 7f4eca53e640 1 --2- 172.21.15.26:0/717449735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ec40d3010 0x7f4ec414f9b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:44.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.601+0000 7f4eca53e640 1 --2- 172.21.15.26:0/717449735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ec40d1400 0x7f4ec414b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:44.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.601+0000 7f4eca53e640 1 -- 172.21.15.26:0/717449735 >> 172.21.15.26:0/717449735 conn(0x7f4ec409bc50 msgr2=0x7f4ec40c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:44.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.601+0000 7f4eca53e640 1 -- 172.21.15.26:0/717449735 shutdown_connections 2023-10-14T11:13:44.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.601+0000 7f4eca53e640 1 -- 172.21.15.26:0/717449735 wait complete. 2023-10-14T11:13:44.651 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-14T11:13:44.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.793+0000 7f3757017640 1 Processor -- start 2023-10-14T11:13:44.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.793+0000 7f3757017640 1 -- start start 2023-10-14T11:13:44.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.793+0000 7f3757017640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f375015cf90 0x7f375006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:44.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.793+0000 7f3757017640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37500ce310 0x7f37500ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:44.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.793+0000 7f3757017640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375015d4e0 con 0x7f37500b2ad0 2023-10-14T11:13:44.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.793+0000 7f3757017640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37500ced00 con 0x7f375015cf90 2023-10-14T11:13:44.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.793+0000 7f3757017640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3750160580 con 0x7f37500ce310 2023-10-14T11:13:44.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.793+0000 7f3754db3640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f37500b2ad0 0x7f375006b4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34606/0 (socket says 172.21.15.26:34606) 2023-10-14T11:13:44.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.793+0000 7f3754db3640 1 -- 172.21.15.26:0/1622007937 learned_addr learned my addr 172.21.15.26:0/1622007937 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:44.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.793+0000 7f37555b4640 1 --2- 172.21.15.26:0/1622007937 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37500ce310 0x7f37500ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:44.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.793+0000 7f374ffff640 1 --2- 172.21.15.26:0/1622007937 >> v2:172.21.15.110:3300/0 conn(0x7f375015cf90 0x7f375006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:44.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.793+0000 7f374f7fe640 1 -- 172.21.15.26:0/1622007937 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388874767 0 0) 0x7f375015d4e0 con 0x7f37500b2ad0 2023-10-14T11:13:44.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.793+0000 7f374f7fe640 1 -- 172.21.15.26:0/1622007937 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3740003530 con 0x7f37500b2ad0 2023-10-14T11:13:44.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.793+0000 7f37555b4640 1 -- 172.21.15.26:0/1622007937 >> v2:172.21.15.110:3300/0 conn(0x7f375015cf90 msgr2=0x7f375006c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:44.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.793+0000 7f37555b4640 1 --2- 172.21.15.26:0/1622007937 >> v2:172.21.15.110:3300/0 conn(0x7f375015cf90 0x7f375006c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:44.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.793+0000 7f37555b4640 1 -- 172.21.15.26:0/1622007937 >> v1:172.21.15.26:6789/0 conn(0x7f37500b2ad0 legacy=0x7f375006b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:44.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.793+0000 7f374f7fe640 1 -- 172.21.15.26:0/1622007937 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1624160466 0 0) 0x7f3740003530 con 0x7f37500b2ad0 2023-10-14T11:13:44.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.793+0000 7f37555b4640 1 -- 172.21.15.26:0/1622007937 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375015d7c0 con 0x7f37500ce310 2023-10-14T11:13:44.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.797+0000 7f37555b4640 1 --2- 172.21.15.26:0/1622007937 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37500ce310 0x7f37500ce7c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3748009dc0 tx=0x7f374801c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=300505a673588a2f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:44.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.797+0000 7f374f7fe640 1 -- 172.21.15.26:0/1622007937 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37480a59c0 con 0x7f37500ce310 2023-10-14T11:13:44.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.797+0000 7f374f7fe640 1 -- 172.21.15.26:0/1622007937 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37480a5b20 con 0x7f37500ce310 2023-10-14T11:13:44.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.797+0000 7f374f7fe640 1 -- 172.21.15.26:0/1622007937 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37480ad440 con 0x7f37500ce310 2023-10-14T11:13:44.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.797+0000 7f3757017640 1 -- 172.21.15.26:0/1622007937 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37500ce310 msgr2=0x7f37500ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:44.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.797+0000 7f3757017640 1 --2- 172.21.15.26:0/1622007937 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37500ce310 0x7f37500ce7c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3748009dc0 tx=0x7f374801c900 comp rx=0 tx=0).stop 2023-10-14T11:13:44.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.797+0000 7f3757017640 1 -- 172.21.15.26:0/1622007937 shutdown_connections 2023-10-14T11:13:44.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.797+0000 7f3757017640 1 --2- 172.21.15.26:0/1622007937 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37500ce310 0x7f37500ce7c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:44.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.797+0000 7f3757017640 1 --2- 172.21.15.26:0/1622007937 >> v2:172.21.15.110:3300/0 conn(0x7f375015cf90 0x7f375006c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:44.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.797+0000 7f3757017640 1 -- 172.21.15.26:0/1622007937 >> 172.21.15.26:0/1622007937 conn(0x7f37500cd1c0 msgr2=0x7f37500cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:44.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.797+0000 7f3757017640 1 -- 172.21.15.26:0/1622007937 shutdown_connections 2023-10-14T11:13:44.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.797+0000 7f3757017640 1 -- 172.21.15.26:0/1622007937 wait complete. 2023-10-14T11:13:44.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f3757017640 1 Processor -- start 2023-10-14T11:13:44.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f3757017640 1 -- start start 2023-10-14T11:13:44.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f3757017640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37500b2ad0 0x7f37501551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:44.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f3757017640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37500ce310 0x7f37500b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:44.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f3757017640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f375015cf90 0x7f37501566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:44.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f3757017640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37500c56d0 con 0x7f37500b2ad0 2023-10-14T11:13:44.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f3757017640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37500c53a0 con 0x7f375015cf90 2023-10-14T11:13:44.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f3757017640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3750155710 con 0x7f37500ce310 2023-10-14T11:13:44.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f3754db3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37500b2ad0 0x7f37501551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:44.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f3754db3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37500b2ad0 0x7f37501551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41428/0 (socket says 172.21.15.26:41428) 2023-10-14T11:13:44.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f3754db3640 1 -- 172.21.15.26:0/2708646139 learned_addr learned my addr 172.21.15.26:0/2708646139 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:44.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f374ffff640 1 --2- 172.21.15.26:0/2708646139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37500ce310 0x7f37500b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:44.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f37555b4640 1 --2- 172.21.15.26:0/2708646139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f375015cf90 0x7f37501566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:44.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f3754db3640 1 -- 172.21.15.26:0/2708646139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37500ce310 msgr2=0x7f37500b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:44.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f3754db3640 1 --2- 172.21.15.26:0/2708646139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37500ce310 0x7f37500b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:44.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f3754db3640 1 -- 172.21.15.26:0/2708646139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f375015cf90 msgr2=0x7f37501566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:44.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f3754db3640 1 --2- 172.21.15.26:0/2708646139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f375015cf90 0x7f37501566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:44.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f3754db3640 1 -- 172.21.15.26:0/2708646139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3748009a70 con 0x7f37500b2ad0 2023-10-14T11:13:44.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f374ffff640 1 --2- 172.21.15.26:0/2708646139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37500ce310 0x7f37500b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:44.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f37555b4640 1 --2- 172.21.15.26:0/2708646139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f375015cf90 0x7f37501566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:44.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f3754db3640 1 --2- 172.21.15.26:0/2708646139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37500b2ad0 0x7f37501551d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f374400c460 tx=0x7f374400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:44.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f374d7fa640 1 -- 172.21.15.26:0/2708646139 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3744005cf0 con 0x7f37500b2ad0 2023-10-14T11:13:44.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f374d7fa640 1 -- 172.21.15.26:0/2708646139 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3744005e50 con 0x7f37500b2ad0 2023-10-14T11:13:44.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f374d7fa640 1 -- 172.21.15.26:0/2708646139 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3744007290 con 0x7f37500b2ad0 2023-10-14T11:13:44.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f3757017640 1 -- 172.21.15.26:0/2708646139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37500b3bb0 con 0x7f37500b2ad0 2023-10-14T11:13:44.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.801+0000 7f3757017640 1 -- 172.21.15.26:0/2708646139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37500b4170 con 0x7f37500b2ad0 2023-10-14T11:13:44.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.805+0000 7f3757017640 1 -- 172.21.15.26:0/2708646139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37500c5510 con 0x7f37500b2ad0 2023-10-14T11:13:44.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.805+0000 7f374d7fa640 1 -- 172.21.15.26:0/2708646139 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f37440073f0 con 0x7f37500b2ad0 2023-10-14T11:13:44.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.805+0000 7f374d7fa640 1 --2- 172.21.15.26:0/2708646139 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37340664a0 0x7f3734068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:44.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.805+0000 7f374d7fa640 1 -- 172.21.15.26:0/2708646139 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f3744083810 con 0x7f37500b2ad0 2023-10-14T11:13:44.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.805+0000 7f374ffff640 1 --2- 172.21.15.26:0/2708646139 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37340664a0 0x7f3734068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:44.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.805+0000 7f374ffff640 1 --2- 172.21.15.26:0/2708646139 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37340664a0 0x7f3734068960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f375006b6f0 tx=0x7f373c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:44.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:44.809+0000 7f374d7fa640 1 -- 172.21.15.26:0/2708646139 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f37500c5510 con 0x7f37500b2ad0 2023-10-14T11:13:45.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.025+0000 7f3757017640 1 -- 172.21.15.26:0/2708646139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f37500c5510 con 0x7f37500b2ad0 2023-10-14T11:13:45.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.029+0000 7f374d7fa640 1 -- 172.21.15.26:0/2708646139 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f37500c5510 con 0x7f37500b2ad0 2023-10-14T11:13:45.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.029+0000 7f3757017640 1 -- 172.21.15.26:0/2708646139 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37340664a0 msgr2=0x7f3734068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:45.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.029+0000 7f3757017640 1 --2- 172.21.15.26:0/2708646139 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37340664a0 0x7f3734068960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f375006b6f0 tx=0x7f373c008040 comp rx=0 tx=0).stop 2023-10-14T11:13:45.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.029+0000 7f3757017640 1 -- 172.21.15.26:0/2708646139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37500b2ad0 msgr2=0x7f37501551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:45.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.029+0000 7f3757017640 1 --2- 172.21.15.26:0/2708646139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37500b2ad0 0x7f37501551d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f374400c460 tx=0x7f374400c920 comp rx=0 tx=0).stop 2023-10-14T11:13:45.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.029+0000 7f3757017640 1 -- 172.21.15.26:0/2708646139 shutdown_connections 2023-10-14T11:13:45.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.029+0000 7f3757017640 1 --2- 172.21.15.26:0/2708646139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f375015cf90 0x7f37501566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.029+0000 7f3757017640 1 --2- 172.21.15.26:0/2708646139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37500ce310 0x7f37500b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.029+0000 7f3757017640 1 --2- 172.21.15.26:0/2708646139 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37340664a0 0x7f3734068960 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.033+0000 7f3757017640 1 --2- 172.21.15.26:0/2708646139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37500b2ad0 0x7f37501551d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.033+0000 7f3757017640 1 -- 172.21.15.26:0/2708646139 >> 172.21.15.26:0/2708646139 conn(0x7f37500cd1c0 msgr2=0x7f375015f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:45.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.033+0000 7f3757017640 1 -- 172.21.15.26:0/2708646139 shutdown_connections 2023-10-14T11:13:45.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.033+0000 7f3757017640 1 -- 172.21.15.26:0/2708646139 wait complete. 2023-10-14T11:13:45.054 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-14T11:13:45.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.197+0000 7faebd254640 1 Processor -- start 2023-10-14T11:13:45.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.197+0000 7faebd254640 1 -- start start 2023-10-14T11:13:45.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.197+0000 7faebd254640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faeb80d15d0 0x7faeb80cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:45.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.197+0000 7faebd254640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faeb80d3010 0x7faeb80c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:45.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.197+0000 7faebd254640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb80ce770 con 0x7faeb815cb90 2023-10-14T11:13:45.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.197+0000 7faebd254640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb80d0600 con 0x7faeb80d3010 2023-10-14T11:13:45.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.197+0000 7faebd254640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80c6450 con 0x7faeb80d15d0 2023-10-14T11:13:45.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.197+0000 7faeb759e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faeb80d3010 0x7faeb80c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:45.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.201+0000 7faeb6d9d640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7faeb815cb90 0x7faeb80d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:50432/0 (socket says 172.21.15.26:50432) 2023-10-14T11:13:45.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.201+0000 7faeb6d9d640 1 -- 172.21.15.26:0/177093091 learned_addr learned my addr 172.21.15.26:0/177093091 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:45.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.201+0000 7faeb759e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faeb80d3010 0x7faeb80c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:49730/0 (socket says 172.21.15.26:49730) 2023-10-14T11:13:45.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.201+0000 7faeb659c640 1 --2- 172.21.15.26:0/177093091 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faeb80d15d0 0x7faeb80cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:45.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.201+0000 7faeb759e640 1 -- 172.21.15.26:0/177093091 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faeb80d15d0 msgr2=0x7faeb80cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:45.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.201+0000 7faeb759e640 1 --2- 172.21.15.26:0/177093091 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faeb80d15d0 0x7faeb80cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.201+0000 7faeb759e640 1 -- 172.21.15.26:0/177093091 >> v1:172.21.15.110:6789/0 conn(0x7faeb815cb90 legacy=0x7faeb80d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:45.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.201+0000 7faeb759e640 1 -- 172.21.15.26:0/177093091 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb80d08a0 con 0x7faeb80d3010 2023-10-14T11:13:45.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.201+0000 7faeb5d9b640 1 -- 172.21.15.26:0/177093091 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770699316 0 0) 0x7faeb80ce770 con 0x7faeb815cb90 2023-10-14T11:13:45.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.201+0000 7faeb759e640 1 --2- 172.21.15.26:0/177093091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faeb80d3010 0x7faeb80c6c10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009d90 tx=0x7faeb001c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20fb1f7f89b5fe7c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:45.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.201+0000 7faeb5d9b640 1 -- 172.21.15.26:0/177093091 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb00a5950 con 0x7faeb80d3010 2023-10-14T11:13:45.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.201+0000 7faeb5d9b640 1 -- 172.21.15.26:0/177093091 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb00a5ab0 con 0x7faeb80d3010 2023-10-14T11:13:45.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.201+0000 7faeb5d9b640 1 -- 172.21.15.26:0/177093091 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb00a5e40 con 0x7faeb80d3010 2023-10-14T11:13:45.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.205+0000 7faebd254640 1 -- 172.21.15.26:0/177093091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faeb80d3010 msgr2=0x7faeb80c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:45.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.205+0000 7faebd254640 1 --2- 172.21.15.26:0/177093091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faeb80d3010 0x7faeb80c6c10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009d90 tx=0x7faeb001c890 comp rx=0 tx=0).stop 2023-10-14T11:13:45.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.205+0000 7faebd254640 1 -- 172.21.15.26:0/177093091 shutdown_connections 2023-10-14T11:13:45.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.205+0000 7faebd254640 1 --2- 172.21.15.26:0/177093091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faeb80d3010 0x7faeb80c6c10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.205+0000 7faebd254640 1 --2- 172.21.15.26:0/177093091 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faeb80d15d0 0x7faeb80cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.205+0000 7faebd254640 1 -- 172.21.15.26:0/177093091 >> 172.21.15.26:0/177093091 conn(0x7faeb809bc50 msgr2=0x7faeb80d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:45.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.205+0000 7faebd254640 1 -- 172.21.15.26:0/177093091 shutdown_connections 2023-10-14T11:13:45.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.205+0000 7faebd254640 1 -- 172.21.15.26:0/177093091 wait complete. 2023-10-14T11:13:45.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.205+0000 7faebd254640 1 Processor -- start 2023-10-14T11:13:45.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.205+0000 7faebd254640 1 -- start start 2023-10-14T11:13:45.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.205+0000 7faebd254640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faeb80d15d0 0x7faeb8153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:45.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.205+0000 7faebd254640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faeb80d3010 0x7faeb81536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:45.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.205+0000 7faebd254640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faeb815cb90 0x7faeb80cd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:45.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.205+0000 7faebd254640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb81544b0 con 0x7faeb80d15d0 2023-10-14T11:13:45.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.205+0000 7faebd254640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb815a760 con 0x7faeb815cb90 2023-10-14T11:13:45.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.205+0000 7faebd254640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb815aa40 con 0x7faeb80d3010 2023-10-14T11:13:45.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.205+0000 7faeb6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faeb80d15d0 0x7faeb8153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:45.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.205+0000 7faeb6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faeb80d15d0 0x7faeb8153f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41434/0 (socket says 172.21.15.26:41434) 2023-10-14T11:13:45.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.205+0000 7faeb6d9d640 1 -- 172.21.15.26:0/133029646 learned_addr learned my addr 172.21.15.26:0/133029646 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:45.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.205+0000 7faeb659c640 1 --2- 172.21.15.26:0/133029646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faeb80d3010 0x7faeb81536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:45.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.205+0000 7faeb759e640 1 --2- 172.21.15.26:0/133029646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faeb815cb90 0x7faeb80cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:45.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.209+0000 7faeb6d9d640 1 -- 172.21.15.26:0/133029646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faeb80d3010 msgr2=0x7faeb81536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:45.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.209+0000 7faeb6d9d640 1 --2- 172.21.15.26:0/133029646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faeb80d3010 0x7faeb81536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.209+0000 7faeb6d9d640 1 -- 172.21.15.26:0/133029646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faeb815cb90 msgr2=0x7faeb80cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:45.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.209+0000 7faeb6d9d640 1 --2- 172.21.15.26:0/133029646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faeb815cb90 0x7faeb80cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.209+0000 7faeb6d9d640 1 -- 172.21.15.26:0/133029646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb0009a70 con 0x7faeb80d15d0 2023-10-14T11:13:45.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.209+0000 7faeb759e640 1 --2- 172.21.15.26:0/133029646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faeb815cb90 0x7faeb80cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:45.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.209+0000 7faeb6d9d640 1 --2- 172.21.15.26:0/133029646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faeb80d15d0 0x7faeb8153f70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7faea800c3f0 tx=0x7faea800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:45.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.209+0000 7fae9f7fe640 1 -- 172.21.15.26:0/133029646 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea80074e0 con 0x7faeb80d15d0 2023-10-14T11:13:45.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.209+0000 7fae9f7fe640 1 -- 172.21.15.26:0/133029646 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea8007660 con 0x7faeb80d15d0 2023-10-14T11:13:45.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.209+0000 7fae9f7fe640 1 -- 172.21.15.26:0/133029646 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8004a80 con 0x7faeb80d15d0 2023-10-14T11:13:45.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.209+0000 7faebd254640 1 -- 172.21.15.26:0/133029646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb815ad20 con 0x7faeb80d15d0 2023-10-14T11:13:45.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.209+0000 7faebd254640 1 -- 172.21.15.26:0/133029646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb815b2e0 con 0x7faeb80d15d0 2023-10-14T11:13:45.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.209+0000 7faebd254640 1 -- 172.21.15.26:0/133029646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb815b500 con 0x7faeb80d15d0 2023-10-14T11:13:45.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.209+0000 7fae9f7fe640 1 -- 172.21.15.26:0/133029646 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faea8004be0 con 0x7faeb80d15d0 2023-10-14T11:13:45.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.209+0000 7fae9f7fe640 1 --2- 172.21.15.26:0/133029646 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7faea40664a0 0x7faea4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:45.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.209+0000 7fae9f7fe640 1 -- 172.21.15.26:0/133029646 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7faea8083a30 con 0x7faeb80d15d0 2023-10-14T11:13:45.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.213+0000 7faeb659c640 1 --2- 172.21.15.26:0/133029646 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7faea40664a0 0x7faea4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:45.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.213+0000 7faeb659c640 1 --2- 172.21.15.26:0/133029646 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7faea40664a0 0x7faea4068960 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7faeb80b8940 tx=0x7faeac009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:45.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.213+0000 7fae9f7fe640 1 -- 172.21.15.26:0/133029646 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faea8051020 con 0x7faeb80d15d0 2023-10-14T11:13:45.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.429+0000 7faebd254640 1 -- 172.21.15.26:0/133029646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7faeb8074010 con 0x7faeb80d15d0 2023-10-14T11:13:45.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.433+0000 7fae9f7fe640 1 -- 172.21.15.26:0/133029646 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7faea8054640 con 0x7faeb80d15d0 2023-10-14T11:13:45.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.433+0000 7faebd254640 1 -- 172.21.15.26:0/133029646 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7faea40664a0 msgr2=0x7faea4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:45.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.433+0000 7faebd254640 1 --2- 172.21.15.26:0/133029646 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7faea40664a0 0x7faea4068960 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7faeb80b8940 tx=0x7faeac009190 comp rx=0 tx=0).stop 2023-10-14T11:13:45.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.433+0000 7faebd254640 1 -- 172.21.15.26:0/133029646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faeb80d15d0 msgr2=0x7faeb8153f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:45.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.433+0000 7faebd254640 1 --2- 172.21.15.26:0/133029646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faeb80d15d0 0x7faeb8153f70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7faea800c3f0 tx=0x7faea800c8b0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.433+0000 7faebd254640 1 -- 172.21.15.26:0/133029646 shutdown_connections 2023-10-14T11:13:45.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.433+0000 7faebd254640 1 --2- 172.21.15.26:0/133029646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faeb815cb90 0x7faeb80cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.433+0000 7faebd254640 1 --2- 172.21.15.26:0/133029646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faeb80d3010 0x7faeb81536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.433+0000 7faebd254640 1 --2- 172.21.15.26:0/133029646 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7faea40664a0 0x7faea4068960 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.433+0000 7faebd254640 1 --2- 172.21.15.26:0/133029646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faeb80d15d0 0x7faeb8153f70 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.433+0000 7faebd254640 1 -- 172.21.15.26:0/133029646 >> 172.21.15.26:0/133029646 conn(0x7faeb809bc50 msgr2=0x7faeb80d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:45.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.433+0000 7faebd254640 1 -- 172.21.15.26:0/133029646 shutdown_connections 2023-10-14T11:13:45.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.433+0000 7faebd254640 1 -- 172.21.15.26:0/133029646 wait complete. 2023-10-14T11:13:45.456 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-14T11:13:45.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.597+0000 7fe90f9f8640 1 Processor -- start 2023-10-14T11:13:45.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.597+0000 7fe90f9f8640 1 -- start start 2023-10-14T11:13:45.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.597+0000 7fe90f9f8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9080ad960 0x7fe9080ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:45.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.597+0000 7fe90f9f8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe9080b07f0 0x7fe9080cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:45.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.597+0000 7fe90f9f8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9080c96f0 con 0x7fe908164520 2023-10-14T11:13:45.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.597+0000 7fe90f9f8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe908164900 con 0x7fe9080b07f0 2023-10-14T11:13:45.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.597+0000 7fe90f9f8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080cb950 con 0x7fe9080ad960 2023-10-14T11:13:45.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.597+0000 7fe90df95640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe9080b07f0 0x7fe9080cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:45.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.597+0000 7fe90d794640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe908164520 0x7fe9080b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34608/0 (socket says 172.21.15.26:34608) 2023-10-14T11:13:45.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.597+0000 7fe90d794640 1 -- 172.21.15.26:0/1444798718 learned_addr learned my addr 172.21.15.26:0/1444798718 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:45.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.597+0000 7fe90cf93640 1 --2- 172.21.15.26:0/1444798718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9080ad960 0x7fe9080ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:45.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.597+0000 7fe90df95640 1 -- 172.21.15.26:0/1444798718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9080ad960 msgr2=0x7fe9080ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:45.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.597+0000 7fe90df95640 1 --2- 172.21.15.26:0/1444798718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9080ad960 0x7fe9080ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.597+0000 7fe90df95640 1 -- 172.21.15.26:0/1444798718 >> v1:172.21.15.26:6789/0 conn(0x7fe908164520 legacy=0x7fe9080b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:45.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.597+0000 7fe90df95640 1 -- 172.21.15.26:0/1444798718 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9080cbed0 con 0x7fe9080b07f0 2023-10-14T11:13:45.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.597+0000 7fe90cf93640 1 --2- 172.21.15.26:0/1444798718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9080ad960 0x7fe9080ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:45.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.601+0000 7fe90df95640 1 --2- 172.21.15.26:0/1444798718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9080b07f0 0x7fe9080cc870 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe900009d90 tx=0x7fe90001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8d09671695c2eb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:45.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.601+0000 7fe8fffff640 1 -- 172.21.15.26:0/1444798718 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9000a5a00 con 0x7fe9080b07f0 2023-10-14T11:13:45.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.601+0000 7fe8fffff640 1 -- 172.21.15.26:0/1444798718 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9000a5b60 con 0x7fe9080b07f0 2023-10-14T11:13:45.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.601+0000 7fe8fffff640 1 -- 172.21.15.26:0/1444798718 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9000ad440 con 0x7fe9080b07f0 2023-10-14T11:13:45.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.601+0000 7fe90f9f8640 1 -- 172.21.15.26:0/1444798718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9080b07f0 msgr2=0x7fe9080cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:45.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.601+0000 7fe90f9f8640 1 --2- 172.21.15.26:0/1444798718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9080b07f0 0x7fe9080cc870 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe900009d90 tx=0x7fe90001c920 comp rx=0 tx=0).stop 2023-10-14T11:13:45.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.601+0000 7fe90f9f8640 1 -- 172.21.15.26:0/1444798718 shutdown_connections 2023-10-14T11:13:45.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.601+0000 7fe90f9f8640 1 --2- 172.21.15.26:0/1444798718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9080b07f0 0x7fe9080cc870 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.601+0000 7fe90f9f8640 1 --2- 172.21.15.26:0/1444798718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9080ad960 0x7fe9080ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.601+0000 7fe90f9f8640 1 -- 172.21.15.26:0/1444798718 >> 172.21.15.26:0/1444798718 conn(0x7fe90806c190 msgr2=0x7fe90806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:45.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.601+0000 7fe90f9f8640 1 -- 172.21.15.26:0/1444798718 shutdown_connections 2023-10-14T11:13:45.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.601+0000 7fe90f9f8640 1 -- 172.21.15.26:0/1444798718 wait complete. 2023-10-14T11:13:45.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90f9f8640 1 Processor -- start 2023-10-14T11:13:45.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90f9f8640 1 -- start start 2023-10-14T11:13:45.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90f9f8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9080ad960 0x7fe908071970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:45.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90f9f8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9080b07f0 0x7fe9080b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:45.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90f9f8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe908164520 0x7fe9080c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:45.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90f9f8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080b30a0 con 0x7fe9080b07f0 2023-10-14T11:13:45.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90f9f8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe908159560 con 0x7fe9080ad960 2023-10-14T11:13:45.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90f9f8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080c81e0 con 0x7fe908164520 2023-10-14T11:13:45.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90cf93640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9080b07f0 0x7fe9080b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:45.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90cf93640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9080b07f0 0x7fe9080b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41462/0 (socket says 172.21.15.26:41462) 2023-10-14T11:13:45.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90cf93640 1 -- 172.21.15.26:0/3193911894 learned_addr learned my addr 172.21.15.26:0/3193911894 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:45.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90df95640 1 --2- 172.21.15.26:0/3193911894 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe908164520 0x7fe9080c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:45.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90cf93640 1 -- 172.21.15.26:0/3193911894 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe908164520 msgr2=0x7fe9080c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:45.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90cf93640 1 --2- 172.21.15.26:0/3193911894 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe908164520 0x7fe9080c7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90d794640 1 --2- 172.21.15.26:0/3193911894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9080ad960 0x7fe908071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:45.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90cf93640 1 -- 172.21.15.26:0/3193911894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9080ad960 msgr2=0x7fe908071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:45.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90cf93640 1 --2- 172.21.15.26:0/3193911894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9080ad960 0x7fe908071970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90cf93640 1 -- 172.21.15.26:0/3193911894 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe900009a70 con 0x7fe9080b07f0 2023-10-14T11:13:45.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90d794640 1 --2- 172.21.15.26:0/3193911894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9080ad960 0x7fe908071970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:45.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90cf93640 1 --2- 172.21.15.26:0/3193911894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9080b07f0 0x7fe9080b2b60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800d800 tx=0x7fe8f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:45.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe8fdffb640 1 -- 172.21.15.26:0/3193911894 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f80096c0 con 0x7fe9080b07f0 2023-10-14T11:13:45.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe8fdffb640 1 -- 172.21.15.26:0/3193911894 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f8009820 con 0x7fe9080b07f0 2023-10-14T11:13:45.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe8fdffb640 1 -- 172.21.15.26:0/3193911894 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8009bd0 con 0x7fe9080b07f0 2023-10-14T11:13:45.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90f9f8640 1 -- 172.21.15.26:0/3193911894 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe908158f10 con 0x7fe9080b07f0 2023-10-14T11:13:45.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90f9f8640 1 -- 172.21.15.26:0/3193911894 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9081517e0 con 0x7fe9080b07f0 2023-10-14T11:13:45.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.605+0000 7fe90f9f8640 1 -- 172.21.15.26:0/3193911894 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe908074010 con 0x7fe9080b07f0 2023-10-14T11:13:45.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.609+0000 7fe8fdffb640 1 -- 172.21.15.26:0/3193911894 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe8f8009d30 con 0x7fe9080b07f0 2023-10-14T11:13:45.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.609+0000 7fe8fdffb640 1 --2- 172.21.15.26:0/3193911894 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe8ec0664a0 0x7fe8ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:45.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.609+0000 7fe8fdffb640 1 -- 172.21.15.26:0/3193911894 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe8f8084450 con 0x7fe9080b07f0 2023-10-14T11:13:45.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.609+0000 7fe90d794640 1 --2- 172.21.15.26:0/3193911894 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe8ec0664a0 0x7fe8ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:45.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.609+0000 7fe90d794640 1 --2- 172.21.15.26:0/3193911894 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe8ec0664a0 0x7fe8ec068960 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe904005890 tx=0x7fe904009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:45.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.613+0000 7fe8fdffb640 1 -- 172.21.15.26:0/3193911894 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe8f8051a40 con 0x7fe9080b07f0 2023-10-14T11:13:45.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.825+0000 7fe90f9f8640 1 -- 172.21.15.26:0/3193911894 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fe9080cc300 con 0x7fe9080b07f0 2023-10-14T11:13:45.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.829+0000 7fe8fdffb640 1 -- 172.21.15.26:0/3193911894 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe8f8055060 con 0x7fe9080b07f0 2023-10-14T11:13:45.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.829+0000 7fe90f9f8640 1 -- 172.21.15.26:0/3193911894 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe8ec0664a0 msgr2=0x7fe8ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:45.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.829+0000 7fe90f9f8640 1 --2- 172.21.15.26:0/3193911894 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe8ec0664a0 0x7fe8ec068960 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe904005890 tx=0x7fe904009040 comp rx=0 tx=0).stop 2023-10-14T11:13:45.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.829+0000 7fe90f9f8640 1 -- 172.21.15.26:0/3193911894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9080b07f0 msgr2=0x7fe9080b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:45.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.829+0000 7fe90f9f8640 1 --2- 172.21.15.26:0/3193911894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9080b07f0 0x7fe9080b2b60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800d800 tx=0x7fe8f800dcc0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.829+0000 7fe90f9f8640 1 -- 172.21.15.26:0/3193911894 shutdown_connections 2023-10-14T11:13:45.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.829+0000 7fe90f9f8640 1 --2- 172.21.15.26:0/3193911894 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe908164520 0x7fe9080c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.829+0000 7fe90f9f8640 1 --2- 172.21.15.26:0/3193911894 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe8ec0664a0 0x7fe8ec068960 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.829+0000 7fe90f9f8640 1 --2- 172.21.15.26:0/3193911894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9080b07f0 0x7fe9080b2b60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.829+0000 7fe90f9f8640 1 --2- 172.21.15.26:0/3193911894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9080ad960 0x7fe908071970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:45.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.829+0000 7fe90f9f8640 1 -- 172.21.15.26:0/3193911894 >> 172.21.15.26:0/3193911894 conn(0x7fe90806c190 msgr2=0x7fe90815e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:45.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.829+0000 7fe90f9f8640 1 -- 172.21.15.26:0/3193911894 shutdown_connections 2023-10-14T11:13:45.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.829+0000 7fe90f9f8640 1 -- 172.21.15.26:0/3193911894 wait complete. 2023-10-14T11:13:45.852 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-14T11:13:45.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa03cdd9640 1 Processor -- start 2023-10-14T11:13:45.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa03cdd9640 1 -- start start 2023-10-14T11:13:45.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa03cdd9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0380b88c0 0x7fa038167b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:45.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa03cdd9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03815e3a0 con 0x7fa0380cfd90 2023-10-14T11:13:45.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa03cdd9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0380ce1c0 con 0x7fa0380d0170 2023-10-14T11:13:45.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa03cdd9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03815e640 con 0x7fa0380b88c0 2023-10-14T11:13:45.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa03659c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa0380cfd90 0x7fa03815dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34624/0 (socket says 172.21.15.26:34624) 2023-10-14T11:13:45.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa03659c640 1 -- 172.21.15.26:0/3717583186 learned_addr learned my addr 172.21.15.26:0/3717583186 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:46.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa036d9d640 1 --2- 172.21.15.26:0/3717583186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0380b88c0 0x7fa038167b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:46.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa035d9b640 1 -- 172.21.15.26:0/3717583186 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 253204939 0 0) 0x7fa03815e3a0 con 0x7fa0380cfd90 2023-10-14T11:13:46.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa035d9b640 1 -- 172.21.15.26:0/3717583186 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa024003530 con 0x7fa0380cfd90 2023-10-14T11:13:46.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa035d9b640 1 -- 172.21.15.26:0/3717583186 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279763174 0 0) 0x7fa0380ce1c0 con 0x7fa0380d0170 2023-10-14T11:13:46.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa035d9b640 1 -- 172.21.15.26:0/3717583186 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa03815e3a0 con 0x7fa0380d0170 2023-10-14T11:13:46.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa035d9b640 1 -- 172.21.15.26:0/3717583186 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1622879557 0 0) 0x7fa024003530 con 0x7fa0380cfd90 2023-10-14T11:13:46.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa035d9b640 1 -- 172.21.15.26:0/3717583186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0380b88c0 msgr2=0x7fa038167b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:46.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa035d9b640 1 --2- 172.21.15.26:0/3717583186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0380b88c0 0x7fa038167b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa035d9b640 1 -- 172.21.15.26:0/3717583186 >> v1:172.21.15.110:6789/0 conn(0x7fa0380d0170 legacy=0x7fa0380b81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:46.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa035d9b640 1 -- 172.21.15.26:0/3717583186 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03815e920 con 0x7fa0380cfd90 2023-10-14T11:13:46.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa035d9b640 1 -- 172.21.15.26:0/3717583186 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7fa0280016a0 con 0x7fa0380cfd90 2023-10-14T11:13:46.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa035d9b640 1 -- 172.21.15.26:0/3717583186 >> v1:172.21.15.26:6789/0 conn(0x7fa0380cfd90 legacy=0x7fa03815dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:46.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa035d9b640 1 --2- 172.21.15.26:0/3717583186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa024003b40 0x7fa024003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:46.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa035d9b640 1 --2- 172.21.15.26:0/3717583186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0240047d0 0x7fa024004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:46.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa035d9b640 1 --2- 172.21.15.26:0/3717583186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0380b88c0 0x7fa024005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:46.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa035d9b640 1 -- 172.21.15.26:0/3717583186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03815e640 con 0x7fa0240047d0 2023-10-14T11:13:46.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa035d9b640 1 -- 172.21.15.26:0/3717583186 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02400ba40 con 0x7fa024003b40 2023-10-14T11:13:46.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa035d9b640 1 -- 172.21.15.26:0/3717583186 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02400bc00 con 0x7fa0380b88c0 2023-10-14T11:13:46.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa02ffff640 1 --2- 172.21.15.26:0/3717583186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0240047d0 0x7fa024004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:46.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa036d9d640 1 --2- 172.21.15.26:0/3717583186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0380b88c0 0x7fa024005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:46.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.993+0000 7fa03659c640 1 --2- 172.21.15.26:0/3717583186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa024003b40 0x7fa024003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:46.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.997+0000 7fa02ffff640 1 -- 172.21.15.26:0/3717583186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0380b88c0 msgr2=0x7fa024005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:46.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.997+0000 7fa02ffff640 1 --2- 172.21.15.26:0/3717583186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0380b88c0 0x7fa024005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.997+0000 7fa02ffff640 1 -- 172.21.15.26:0/3717583186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa024003b40 msgr2=0x7fa024003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:46.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.997+0000 7fa02ffff640 1 --2- 172.21.15.26:0/3717583186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa024003b40 0x7fa024003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.997+0000 7fa02ffff640 1 -- 172.21.15.26:0/3717583186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa024003530 con 0x7fa0240047d0 2023-10-14T11:13:46.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.997+0000 7fa02ffff640 1 --2- 172.21.15.26:0/3717583186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0240047d0 0x7fa024004c50 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa020007fd0 tx=0x7fa02001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1431c7b94fd37cf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:46.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.997+0000 7fa035d9b640 1 -- 172.21.15.26:0/3717583186 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0200052d0 con 0x7fa0240047d0 2023-10-14T11:13:46.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.997+0000 7fa035d9b640 1 -- 172.21.15.26:0/3717583186 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa020005450 con 0x7fa0240047d0 2023-10-14T11:13:46.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.997+0000 7fa035d9b640 1 -- 172.21.15.26:0/3717583186 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0200a88f0 con 0x7fa0240047d0 2023-10-14T11:13:46.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.997+0000 7fa03cdd9640 1 -- 172.21.15.26:0/3717583186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0240047d0 msgr2=0x7fa024004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:46.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.997+0000 7fa03cdd9640 1 --2- 172.21.15.26:0/3717583186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0240047d0 0x7fa024004c50 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa020007fd0 tx=0x7fa02001ec90 comp rx=0 tx=0).stop 2023-10-14T11:13:46.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.997+0000 7fa036d9d640 1 -- 172.21.15.26:0/3717583186 reap_dead start 2023-10-14T11:13:46.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.997+0000 7fa03cdd9640 1 -- 172.21.15.26:0/3717583186 shutdown_connections 2023-10-14T11:13:46.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.997+0000 7fa03cdd9640 1 -- 172.21.15.26:0/3717583186 >> 172.21.15.26:0/3717583186 conn(0x7fa0380719c0 msgr2=0x7fa038071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:46.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.997+0000 7fa03cdd9640 1 -- 172.21.15.26:0/3717583186 shutdown_connections 2023-10-14T11:13:46.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:45.997+0000 7fa03cdd9640 1 -- 172.21.15.26:0/3717583186 wait complete. 2023-10-14T11:13:46.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.001+0000 7fa03cdd9640 1 Processor -- start 2023-10-14T11:13:46.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.001+0000 7fa03cdd9640 1 -- start start 2023-10-14T11:13:46.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.001+0000 7fa03cdd9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0240047d0 0x7fa038158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:46.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.001+0000 7fa03cdd9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0381564d0 0x7fa038155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:46.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.001+0000 7fa03cdd9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa03815a120 0x7fa03815aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:46.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.001+0000 7fa03cdd9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa038159110 con 0x7fa03815a120 2023-10-14T11:13:46.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.001+0000 7fa03cdd9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0381562e0 con 0x7fa0381564d0 2023-10-14T11:13:46.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.001+0000 7fa03cdd9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa038159360 con 0x7fa0240047d0 2023-10-14T11:13:46.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.001+0000 7fa036d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa03815a120 0x7fa03815aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:46.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.001+0000 7fa036d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa03815a120 0x7fa03815aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41474/0 (socket says 172.21.15.26:41474) 2023-10-14T11:13:46.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.001+0000 7fa036d9d640 1 -- 172.21.15.26:0/1525332535 learned_addr learned my addr 172.21.15.26:0/1525332535 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:46.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.001+0000 7fa03659c640 1 --2- 172.21.15.26:0/1525332535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0240047d0 0x7fa038158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:46.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.001+0000 7fa02ffff640 1 --2- 172.21.15.26:0/1525332535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0381564d0 0x7fa038155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:46.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.001+0000 7fa036d9d640 1 -- 172.21.15.26:0/1525332535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0240047d0 msgr2=0x7fa038158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:46.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.001+0000 7fa036d9d640 1 --2- 172.21.15.26:0/1525332535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0240047d0 0x7fa038158280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.001+0000 7fa036d9d640 1 -- 172.21.15.26:0/1525332535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0381564d0 msgr2=0x7fa038155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:46.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.001+0000 7fa036d9d640 1 --2- 172.21.15.26:0/1525332535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0381564d0 0x7fa038155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.001+0000 7fa036d9d640 1 -- 172.21.15.26:0/1525332535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa038159640 con 0x7fa03815a120 2023-10-14T11:13:46.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.001+0000 7fa03659c640 1 --2- 172.21.15.26:0/1525332535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0240047d0 0x7fa038158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:46.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.001+0000 7fa02ffff640 1 --2- 172.21.15.26:0/1525332535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0381564d0 0x7fa038155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:46.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.001+0000 7fa036d9d640 1 --2- 172.21.15.26:0/1525332535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa03815a120 0x7fa03815aee0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa0380d3bb0 tx=0x7fa03000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:46.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.001+0000 7fa02effd640 1 -- 172.21.15.26:0/1525332535 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03000e040 con 0x7fa03815a120 2023-10-14T11:13:46.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.005+0000 7fa02effd640 1 -- 172.21.15.26:0/1525332535 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03000f040 con 0x7fa03815a120 2023-10-14T11:13:46.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.005+0000 7fa03cdd9640 1 -- 172.21.15.26:0/1525332535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa038159920 con 0x7fa03815a120 2023-10-14T11:13:46.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.005+0000 7fa02effd640 1 -- 172.21.15.26:0/1525332535 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa030015670 con 0x7fa03815a120 2023-10-14T11:13:46.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.005+0000 7fa03cdd9640 1 -- 172.21.15.26:0/1525332535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa038156c50 con 0x7fa03815a120 2023-10-14T11:13:46.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.005+0000 7fa03cdd9640 1 -- 172.21.15.26:0/1525332535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03804e170 con 0x7fa03815a120 2023-10-14T11:13:46.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.005+0000 7fa02effd640 1 -- 172.21.15.26:0/1525332535 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa0300157d0 con 0x7fa03815a120 2023-10-14T11:13:46.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.005+0000 7fa02effd640 1 --2- 172.21.15.26:0/1525332535 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa0180664a0 0x7fa018068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:46.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.005+0000 7fa02effd640 1 -- 172.21.15.26:0/1525332535 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa0300845d0 con 0x7fa03815a120 2023-10-14T11:13:46.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.005+0000 7fa03659c640 1 --2- 172.21.15.26:0/1525332535 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa0180664a0 0x7fa018068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:46.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.005+0000 7fa03659c640 1 --2- 172.21.15.26:0/1525332535 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa0180664a0 0x7fa018068960 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa0380d0630 tx=0x7fa028009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:46.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.009+0000 7fa02effd640 1 -- 172.21.15.26:0/1525332535 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa030051cf0 con 0x7fa03815a120 2023-10-14T11:13:46.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.221+0000 7fa03cdd9640 1 -- 172.21.15.26:0/1525332535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fa0380cd9e0 con 0x7fa03815a120 2023-10-14T11:13:46.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.225+0000 7fa02effd640 1 -- 172.21.15.26:0/1525332535 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa030055310 con 0x7fa03815a120 2023-10-14T11:13:46.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.225+0000 7fa03cdd9640 1 -- 172.21.15.26:0/1525332535 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa0180664a0 msgr2=0x7fa018068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:46.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.225+0000 7fa03cdd9640 1 --2- 172.21.15.26:0/1525332535 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa0180664a0 0x7fa018068960 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa0380d0630 tx=0x7fa028009040 comp rx=0 tx=0).stop 2023-10-14T11:13:46.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.225+0000 7fa03cdd9640 1 -- 172.21.15.26:0/1525332535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa03815a120 msgr2=0x7fa03815aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:46.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.225+0000 7fa03cdd9640 1 --2- 172.21.15.26:0/1525332535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa03815a120 0x7fa03815aee0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa0380d3bb0 tx=0x7fa03000f580 comp rx=0 tx=0).stop 2023-10-14T11:13:46.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.225+0000 7fa03cdd9640 1 -- 172.21.15.26:0/1525332535 shutdown_connections 2023-10-14T11:13:46.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.225+0000 7fa03cdd9640 1 --2- 172.21.15.26:0/1525332535 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa0180664a0 0x7fa018068960 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.225+0000 7fa03cdd9640 1 --2- 172.21.15.26:0/1525332535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa03815a120 0x7fa03815aee0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.225+0000 7fa03cdd9640 1 --2- 172.21.15.26:0/1525332535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0381564d0 0x7fa038155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.225+0000 7fa03cdd9640 1 --2- 172.21.15.26:0/1525332535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0240047d0 0x7fa038158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.225+0000 7fa03cdd9640 1 -- 172.21.15.26:0/1525332535 >> 172.21.15.26:0/1525332535 conn(0x7fa0380719c0 msgr2=0x7fa0380b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:46.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.225+0000 7fa03cdd9640 1 -- 172.21.15.26:0/1525332535 shutdown_connections 2023-10-14T11:13:46.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.225+0000 7fa03cdd9640 1 -- 172.21.15.26:0/1525332535 wait complete. 2023-10-14T11:13:46.250 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-14T11:13:46.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.389+0000 7f1d4130f640 1 Processor -- start 2023-10-14T11:13:46.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.389+0000 7f1d4130f640 1 -- start start 2023-10-14T11:13:46.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.393+0000 7f1d4130f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1d3c1597c0 0x7f1d3c0ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:46.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.393+0000 7f1d4130f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3c0adc10 0x7f1d3c0cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:46.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.393+0000 7f1d4130f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3c0723d0 con 0x7f1d3c159ba0 2023-10-14T11:13:46.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.393+0000 7f1d4130f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d3c0717c0 con 0x7f1d3c1597c0 2023-10-14T11:13:46.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.393+0000 7f1d4130f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c071aa0 con 0x7f1d3c0adc10 2023-10-14T11:13:46.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.393+0000 7f1d33fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1d3c159ba0 0x7f1d3c0cae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34638/0 (socket says 172.21.15.26:34638) 2023-10-14T11:13:46.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.393+0000 7f1d33fff640 1 -- 172.21.15.26:0/4239372706 learned_addr learned my addr 172.21.15.26:0/4239372706 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:46.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.393+0000 7f1d3b7fe640 1 --2- 172.21.15.26:0/4239372706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3c0adc10 0x7f1d3c0cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:46.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.393+0000 7f1d3affd640 1 --2- 172.21.15.26:0/4239372706 >> v2:172.21.15.110:3300/0 conn(0x7f1d3c1597c0 0x7f1d3c0ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:46.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.393+0000 7f1d3a7fc640 1 -- 172.21.15.26:0/4239372706 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850514769 0 0) 0x7f1d3c0723d0 con 0x7f1d3c159ba0 2023-10-14T11:13:46.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.393+0000 7f1d3a7fc640 1 -- 172.21.15.26:0/4239372706 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d28003530 con 0x7f1d3c159ba0 2023-10-14T11:13:46.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.393+0000 7f1d3a7fc640 1 -- 172.21.15.26:0/4239372706 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4130062452 0 0) 0x7f1d28003530 con 0x7f1d3c159ba0 2023-10-14T11:13:46.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.393+0000 7f1d3b7fe640 1 -- 172.21.15.26:0/4239372706 >> v2:172.21.15.110:3300/0 conn(0x7f1d3c1597c0 msgr2=0x7f1d3c0ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:46.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.393+0000 7f1d3b7fe640 1 --2- 172.21.15.26:0/4239372706 >> v2:172.21.15.110:3300/0 conn(0x7f1d3c1597c0 0x7f1d3c0ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.393+0000 7f1d3b7fe640 1 -- 172.21.15.26:0/4239372706 >> v1:172.21.15.26:6789/0 conn(0x7f1d3c159ba0 legacy=0x7f1d3c0cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:46.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.393+0000 7f1d3b7fe640 1 -- 172.21.15.26:0/4239372706 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c071d80 con 0x7f1d3c0adc10 2023-10-14T11:13:46.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.397+0000 7f1d3b7fe640 1 --2- 172.21.15.26:0/4239372706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3c0adc10 0x7f1d3c0cb520 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1d34009d90 tx=0x7f1d3401c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=984c1b2e77eb0eb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:46.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.397+0000 7f1d3a7fc640 1 -- 172.21.15.26:0/4239372706 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24001680 con 0x7f1d3c0adc10 2023-10-14T11:13:46.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.397+0000 7f1d3a7fc640 1 -- 172.21.15.26:0/4239372706 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d340a5610 con 0x7f1d3c0adc10 2023-10-14T11:13:46.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.397+0000 7f1d3a7fc640 1 -- 172.21.15.26:0/4239372706 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d340a59a0 con 0x7f1d3c0adc10 2023-10-14T11:13:46.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.397+0000 7f1d4130f640 1 -- 172.21.15.26:0/4239372706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3c0adc10 msgr2=0x7f1d3c0cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:46.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.397+0000 7f1d4130f640 1 --2- 172.21.15.26:0/4239372706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3c0adc10 0x7f1d3c0cb520 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1d34009d90 tx=0x7f1d3401c870 comp rx=0 tx=0).stop 2023-10-14T11:13:46.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.397+0000 7f1d4130f640 1 -- 172.21.15.26:0/4239372706 shutdown_connections 2023-10-14T11:13:46.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.397+0000 7f1d4130f640 1 --2- 172.21.15.26:0/4239372706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3c0adc10 0x7f1d3c0cb520 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.397+0000 7f1d4130f640 1 --2- 172.21.15.26:0/4239372706 >> v2:172.21.15.110:3300/0 conn(0x7f1d3c1597c0 0x7f1d3c0ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.397+0000 7f1d4130f640 1 -- 172.21.15.26:0/4239372706 >> 172.21.15.26:0/4239372706 conn(0x7f1d3c06c190 msgr2=0x7f1d3c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:46.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.397+0000 7f1d4130f640 1 -- 172.21.15.26:0/4239372706 shutdown_connections 2023-10-14T11:13:46.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.397+0000 7f1d4130f640 1 -- 172.21.15.26:0/4239372706 wait complete. 2023-10-14T11:13:46.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.397+0000 7f1d4130f640 1 Processor -- start 2023-10-14T11:13:46.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.397+0000 7f1d4130f640 1 -- start start 2023-10-14T11:13:46.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d4130f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3c0adc10 0x7f1d3c152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:46.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d4130f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3c1597c0 0x7f1d3c15c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:46.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d4130f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d3c159ba0 0x7f1d3c14bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:46.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d4130f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c15c860 con 0x7f1d3c1597c0 2023-10-14T11:13:46.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d4130f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c0c5e20 con 0x7f1d3c159ba0 2023-10-14T11:13:46.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d4130f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c15ca70 con 0x7f1d3c0adc10 2023-10-14T11:13:46.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d33fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3c1597c0 0x7f1d3c15c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:46.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d33fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3c1597c0 0x7f1d3c15c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41478/0 (socket says 172.21.15.26:41478) 2023-10-14T11:13:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d33fff640 1 -- 172.21.15.26:0/2861038175 learned_addr learned my addr 172.21.15.26:0/2861038175 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d3affd640 1 --2- 172.21.15.26:0/2861038175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3c0adc10 0x7f1d3c152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d3b7fe640 1 --2- 172.21.15.26:0/2861038175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d3c159ba0 0x7f1d3c14bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d33fff640 1 -- 172.21.15.26:0/2861038175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3c0adc10 msgr2=0x7f1d3c152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d33fff640 1 --2- 172.21.15.26:0/2861038175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3c0adc10 0x7f1d3c152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d33fff640 1 -- 172.21.15.26:0/2861038175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d3c159ba0 msgr2=0x7f1d3c14bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:46.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d33fff640 1 --2- 172.21.15.26:0/2861038175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d3c159ba0 0x7f1d3c14bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d33fff640 1 -- 172.21.15.26:0/2861038175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d34009a70 con 0x7f1d3c1597c0 2023-10-14T11:13:46.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d3affd640 1 --2- 172.21.15.26:0/2861038175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3c0adc10 0x7f1d3c152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:46.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d3b7fe640 1 --2- 172.21.15.26:0/2861038175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d3c159ba0 0x7f1d3c14bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:46.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d33fff640 1 --2- 172.21.15.26:0/2861038175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3c1597c0 0x7f1d3c15c320 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1d240011f0 tx=0x7f1d2400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d337fe640 1 -- 172.21.15.26:0/2861038175 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24005ae0 con 0x7f1d3c1597c0 2023-10-14T11:13:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d337fe640 1 -- 172.21.15.26:0/2861038175 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d24005c40 con 0x7f1d3c1597c0 2023-10-14T11:13:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d4130f640 1 -- 172.21.15.26:0/2861038175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3c0c57d0 con 0x7f1d3c1597c0 2023-10-14T11:13:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d337fe640 1 -- 172.21.15.26:0/2861038175 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24007070 con 0x7f1d3c1597c0 2023-10-14T11:13:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d4130f640 1 -- 172.21.15.26:0/2861038175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3c15cd50 con 0x7f1d3c1597c0 2023-10-14T11:13:46.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d4130f640 1 -- 172.21.15.26:0/2861038175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d3c0c5f90 con 0x7f1d3c1597c0 2023-10-14T11:13:46.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.401+0000 7f1d337fe640 1 -- 172.21.15.26:0/2861038175 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1d240071d0 con 0x7f1d3c1597c0 2023-10-14T11:13:46.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.405+0000 7f1d337fe640 1 --2- 172.21.15.26:0/2861038175 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d1c0664a0 0x7f1d1c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:46.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.405+0000 7f1d337fe640 1 -- 172.21.15.26:0/2861038175 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1d240839e0 con 0x7f1d3c1597c0 2023-10-14T11:13:46.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.405+0000 7f1d3affd640 1 --2- 172.21.15.26:0/2861038175 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d1c0664a0 0x7f1d1c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:46.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.405+0000 7f1d3affd640 1 --2- 172.21.15.26:0/2861038175 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d1c0664a0 0x7f1d1c068960 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009ae0 tx=0x7f1d2c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:46.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.409+0000 7f1d337fe640 1 -- 172.21.15.26:0/2861038175 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1d24050fd0 con 0x7f1d3c1597c0 2023-10-14T11:13:46.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.621+0000 7f1d4130f640 1 -- 172.21.15.26:0/2861038175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f1d3c074010 con 0x7f1d3c1597c0 2023-10-14T11:13:46.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.621+0000 7f1d337fe640 1 -- 172.21.15.26:0/2861038175 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1d240545f0 con 0x7f1d3c1597c0 2023-10-14T11:13:46.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.625+0000 7f1d4130f640 1 -- 172.21.15.26:0/2861038175 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d1c0664a0 msgr2=0x7f1d1c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:46.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.625+0000 7f1d4130f640 1 --2- 172.21.15.26:0/2861038175 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d1c0664a0 0x7f1d1c068960 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009ae0 tx=0x7f1d2c008040 comp rx=0 tx=0).stop 2023-10-14T11:13:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.625+0000 7f1d4130f640 1 -- 172.21.15.26:0/2861038175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3c1597c0 msgr2=0x7f1d3c15c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.625+0000 7f1d4130f640 1 --2- 172.21.15.26:0/2861038175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3c1597c0 0x7f1d3c15c320 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1d240011f0 tx=0x7f1d2400cbe0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.625+0000 7f1d4130f640 1 -- 172.21.15.26:0/2861038175 shutdown_connections 2023-10-14T11:13:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.625+0000 7f1d4130f640 1 --2- 172.21.15.26:0/2861038175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d3c159ba0 0x7f1d3c14bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.625+0000 7f1d4130f640 1 --2- 172.21.15.26:0/2861038175 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d1c0664a0 0x7f1d1c068960 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.625+0000 7f1d4130f640 1 --2- 172.21.15.26:0/2861038175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3c1597c0 0x7f1d3c15c320 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.625+0000 7f1d4130f640 1 --2- 172.21.15.26:0/2861038175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3c0adc10 0x7f1d3c152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.625+0000 7f1d4130f640 1 -- 172.21.15.26:0/2861038175 >> 172.21.15.26:0/2861038175 conn(0x7f1d3c06c190 msgr2=0x7f1d3c0cae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:46.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.625+0000 7f1d4130f640 1 -- 172.21.15.26:0/2861038175 shutdown_connections 2023-10-14T11:13:46.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.625+0000 7f1d4130f640 1 -- 172.21.15.26:0/2861038175 wait complete. 2023-10-14T11:13:46.647 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-14T11:13:46.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.789+0000 7f715f079640 1 Processor -- start 2023-10-14T11:13:46.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.789+0000 7f715f079640 1 -- start start 2023-10-14T11:13:46.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.789+0000 7f715f079640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71581597c0 0x7f71580ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:46.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.789+0000 7f715f079640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f71580adc10 0x7f71580cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:46.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.789+0000 7f715f079640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71580723d0 con 0x7f7158159ba0 2023-10-14T11:13:46.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.789+0000 7f715f079640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71580717c0 con 0x7f71580adc10 2023-10-14T11:13:46.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.789+0000 7f715f079640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7158071aa0 con 0x7f71581597c0 2023-10-14T11:13:46.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.789+0000 7f715d616640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f71580adc10 0x7f71580cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:46.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.789+0000 7f715d616640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f71580adc10 0x7f71580cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41488/0 (socket says 172.21.15.26:41488) 2023-10-14T11:13:46.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.789+0000 7f715d616640 1 -- 172.21.15.26:0/201495110 learned_addr learned my addr 172.21.15.26:0/201495110 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:46.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.789+0000 7f715ce15640 1 --2- 172.21.15.26:0/201495110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71581597c0 0x7f71580ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:46.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.789+0000 7f715d616640 1 -- 172.21.15.26:0/201495110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71581597c0 msgr2=0x7f71580ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:46.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.789+0000 7f715d616640 1 --2- 172.21.15.26:0/201495110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71581597c0 0x7f71580ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.789+0000 7f715d616640 1 -- 172.21.15.26:0/201495110 >> v1:172.21.15.110:6789/0 conn(0x7f7158159ba0 legacy=0x7f71580cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:46.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.789+0000 7f715d616640 1 -- 172.21.15.26:0/201495110 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7158071d80 con 0x7f71580adc10 2023-10-14T11:13:46.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.789+0000 7f715ce15640 1 --2- 172.21.15.26:0/201495110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71581597c0 0x7f71580ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:46.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.793+0000 7f715d616640 1 --2- 172.21.15.26:0/201495110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71580adc10 0x7f71580cb520 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7150009e50 tx=0x7f715001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f651f50326dabc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:46.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.793+0000 7f71577fe640 1 -- 172.21.15.26:0/201495110 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71500a5880 con 0x7f71580adc10 2023-10-14T11:13:46.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.793+0000 7f71577fe640 1 -- 172.21.15.26:0/201495110 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71500a59e0 con 0x7f71580adc10 2023-10-14T11:13:46.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.793+0000 7f71577fe640 1 -- 172.21.15.26:0/201495110 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71500a5d70 con 0x7f71580adc10 2023-10-14T11:13:46.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.793+0000 7f715f079640 1 -- 172.21.15.26:0/201495110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71580adc10 msgr2=0x7f71580cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:46.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.793+0000 7f715f079640 1 --2- 172.21.15.26:0/201495110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71580adc10 0x7f71580cb520 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7150009e50 tx=0x7f715001ca10 comp rx=0 tx=0).stop 2023-10-14T11:13:46.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.793+0000 7f715f079640 1 -- 172.21.15.26:0/201495110 shutdown_connections 2023-10-14T11:13:46.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.793+0000 7f715f079640 1 --2- 172.21.15.26:0/201495110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71580adc10 0x7f71580cb520 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.793+0000 7f715f079640 1 --2- 172.21.15.26:0/201495110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71581597c0 0x7f71580ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.793+0000 7f715f079640 1 -- 172.21.15.26:0/201495110 >> 172.21.15.26:0/201495110 conn(0x7f715806c190 msgr2=0x7f715806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:46.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.793+0000 7f715f079640 1 -- 172.21.15.26:0/201495110 shutdown_connections 2023-10-14T11:13:46.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.793+0000 7f715f079640 1 -- 172.21.15.26:0/201495110 wait complete. 2023-10-14T11:13:46.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f715f079640 1 Processor -- start 2023-10-14T11:13:46.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f715f079640 1 -- start start 2023-10-14T11:13:46.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f715f079640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71580adc10 0x7f71581502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:46.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f715f079640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71581597c0 0x7f7158151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:46.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f715f079640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7158159ba0 0x7f715815c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:46.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f715f079640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715814bfd0 con 0x7f71581597c0 2023-10-14T11:13:46.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f715f079640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715815c910 con 0x7f71580adc10 2023-10-14T11:13:46.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f715f079640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71581508a0 con 0x7f7158159ba0 2023-10-14T11:13:46.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f7157fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71581597c0 0x7f7158151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:46.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f7157fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71581597c0 0x7f7158151940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41494/0 (socket says 172.21.15.26:41494) 2023-10-14T11:13:46.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f7157fff640 1 -- 172.21.15.26:0/2005318413 learned_addr learned my addr 172.21.15.26:0/2005318413 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:46.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f715ce15640 1 --2- 172.21.15.26:0/2005318413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71580adc10 0x7f71581502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:46.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f715d616640 1 --2- 172.21.15.26:0/2005318413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7158159ba0 0x7f715815c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:46.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f7157fff640 1 -- 172.21.15.26:0/2005318413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7158159ba0 msgr2=0x7f715815c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:46.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f7157fff640 1 --2- 172.21.15.26:0/2005318413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7158159ba0 0x7f715815c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f7157fff640 1 -- 172.21.15.26:0/2005318413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71580adc10 msgr2=0x7f71581502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:46.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f7157fff640 1 --2- 172.21.15.26:0/2005318413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71580adc10 0x7f71581502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:46.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f7157fff640 1 -- 172.21.15.26:0/2005318413 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7150009b30 con 0x7f71581597c0 2023-10-14T11:13:46.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f715ce15640 1 --2- 172.21.15.26:0/2005318413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71580adc10 0x7f71581502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:46.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f7157fff640 1 --2- 172.21.15.26:0/2005318413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71581597c0 0x7f7158151940 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f714400c3f0 tx=0x7f714400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:46.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f71557fa640 1 -- 172.21.15.26:0/2005318413 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71440052d0 con 0x7f71581597c0 2023-10-14T11:13:46.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f71557fa640 1 -- 172.21.15.26:0/2005318413 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7144005430 con 0x7f71581597c0 2023-10-14T11:13:46.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f71557fa640 1 -- 172.21.15.26:0/2005318413 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7144003840 con 0x7f71581597c0 2023-10-14T11:13:46.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f715f079640 1 -- 172.21.15.26:0/2005318413 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7158150b80 con 0x7f71581597c0 2023-10-14T11:13:46.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f715f079640 1 -- 172.21.15.26:0/2005318413 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7158151140 con 0x7f71581597c0 2023-10-14T11:13:46.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.797+0000 7f715f079640 1 -- 172.21.15.26:0/2005318413 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7158074010 con 0x7f71581597c0 2023-10-14T11:13:46.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.801+0000 7f71557fa640 1 -- 172.21.15.26:0/2005318413 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f71440039a0 con 0x7f71581597c0 2023-10-14T11:13:46.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.801+0000 7f71557fa640 1 --2- 172.21.15.26:0/2005318413 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f713c0664a0 0x7f713c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:46.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.801+0000 7f71557fa640 1 -- 172.21.15.26:0/2005318413 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7144083280 con 0x7f71581597c0 2023-10-14T11:13:46.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.801+0000 7f715ce15640 1 --2- 172.21.15.26:0/2005318413 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f713c0664a0 0x7f713c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:46.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.801+0000 7f715ce15640 1 --2- 172.21.15.26:0/2005318413 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f713c0664a0 0x7f713c068960 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7158152640 tx=0x7f714c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:46.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:46.805+0000 7f71557fa640 1 -- 172.21.15.26:0/2005318413 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7144050870 con 0x7f71581597c0 2023-10-14T11:13:47.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.017+0000 7f715f079640 1 -- 172.21.15.26:0/2005318413 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f71580cd3f0 con 0x7f71581597c0 2023-10-14T11:13:47.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.021+0000 7f71557fa640 1 -- 172.21.15.26:0/2005318413 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7144053e90 con 0x7f71581597c0 2023-10-14T11:13:47.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.021+0000 7f715f079640 1 -- 172.21.15.26:0/2005318413 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f713c0664a0 msgr2=0x7f713c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:47.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.021+0000 7f715f079640 1 --2- 172.21.15.26:0/2005318413 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f713c0664a0 0x7f713c068960 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7158152640 tx=0x7f714c008040 comp rx=0 tx=0).stop 2023-10-14T11:13:47.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.021+0000 7f715f079640 1 -- 172.21.15.26:0/2005318413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71581597c0 msgr2=0x7f7158151940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:47.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.021+0000 7f715f079640 1 --2- 172.21.15.26:0/2005318413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71581597c0 0x7f7158151940 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f714400c3f0 tx=0x7f714400c8b0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.021+0000 7f715f079640 1 -- 172.21.15.26:0/2005318413 shutdown_connections 2023-10-14T11:13:47.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.021+0000 7f715f079640 1 --2- 172.21.15.26:0/2005318413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7158159ba0 0x7f715815c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.021+0000 7f715f079640 1 --2- 172.21.15.26:0/2005318413 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f713c0664a0 0x7f713c068960 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.021+0000 7f715f079640 1 --2- 172.21.15.26:0/2005318413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71581597c0 0x7f7158151940 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.021+0000 7f715f079640 1 --2- 172.21.15.26:0/2005318413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71580adc10 0x7f71581502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.021+0000 7f715f079640 1 -- 172.21.15.26:0/2005318413 >> 172.21.15.26:0/2005318413 conn(0x7f715806c190 msgr2=0x7f71580ae140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:47.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.021+0000 7f715f079640 1 -- 172.21.15.26:0/2005318413 shutdown_connections 2023-10-14T11:13:47.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.021+0000 7f715f079640 1 -- 172.21.15.26:0/2005318413 wait complete. 2023-10-14T11:13:47.046 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:13:47.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.185+0000 7f5f4b0ea640 1 Processor -- start 2023-10-14T11:13:47.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.185+0000 7f5f4b0ea640 1 -- start start 2023-10-14T11:13:47.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.185+0000 7f5f4b0ea640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f441597c0 0x7f5f440ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:47.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.185+0000 7f5f4b0ea640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5f44159ba0 0x7f5f440cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:47.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.185+0000 7f5f4b0ea640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f440723d0 con 0x7f5f440adc10 2023-10-14T11:13:47.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.185+0000 7f5f4b0ea640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f440717c0 con 0x7f5f44159ba0 2023-10-14T11:13:47.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.185+0000 7f5f4b0ea640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f44071aa0 con 0x7f5f441597c0 2023-10-14T11:13:47.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.189+0000 7f5f43fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5f44159ba0 0x7f5f440cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:47.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.189+0000 7f5f43fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5f44159ba0 0x7f5f440cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41508/0 (socket says 172.21.15.26:41508) 2023-10-14T11:13:47.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.189+0000 7f5f43fff640 1 -- 172.21.15.26:0/256558223 learned_addr learned my addr 172.21.15.26:0/256558223 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:47.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.189+0000 7f5f49687640 1 --1- 172.21.15.26:0/256558223 >> v1:172.21.15.26:6789/0 conn(0x7f5f440adc10 0x7f5f440cb350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34642/0 (socket says 172.21.15.26:34642) 2023-10-14T11:13:47.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.189+0000 7f5f48e86640 1 --2- 172.21.15.26:0/256558223 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f441597c0 0x7f5f440ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:47.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.189+0000 7f5f43fff640 1 -- 172.21.15.26:0/256558223 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f441597c0 msgr2=0x7f5f440ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:47.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.189+0000 7f5f43fff640 1 --2- 172.21.15.26:0/256558223 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f441597c0 0x7f5f440ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.189+0000 7f5f43fff640 1 -- 172.21.15.26:0/256558223 >> v1:172.21.15.26:6789/0 conn(0x7f5f440adc10 legacy=0x7f5f440cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:47.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.189+0000 7f5f43fff640 1 -- 172.21.15.26:0/256558223 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f44071d80 con 0x7f5f44159ba0 2023-10-14T11:13:47.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.189+0000 7f5f43fff640 1 --2- 172.21.15.26:0/256558223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f44159ba0 0x7f5f440cae10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000bb10 tx=0x7f5f3001ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d2bea7307d9ba4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:47.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.189+0000 7f5f437fe640 1 -- 172.21.15.26:0/256558223 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f300a7c80 con 0x7f5f44159ba0 2023-10-14T11:13:47.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.189+0000 7f5f437fe640 1 -- 172.21.15.26:0/256558223 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f300a7de0 con 0x7f5f44159ba0 2023-10-14T11:13:47.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.189+0000 7f5f437fe640 1 -- 172.21.15.26:0/256558223 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f300af660 con 0x7f5f44159ba0 2023-10-14T11:13:47.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f4b0ea640 1 -- 172.21.15.26:0/256558223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f44159ba0 msgr2=0x7f5f440cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:47.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f4b0ea640 1 --2- 172.21.15.26:0/256558223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f44159ba0 0x7f5f440cae10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000bb10 tx=0x7f5f3001ec10 comp rx=0 tx=0).stop 2023-10-14T11:13:47.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f4b0ea640 1 -- 172.21.15.26:0/256558223 shutdown_connections 2023-10-14T11:13:47.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f4b0ea640 1 --2- 172.21.15.26:0/256558223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f44159ba0 0x7f5f440cae10 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f4b0ea640 1 --2- 172.21.15.26:0/256558223 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f441597c0 0x7f5f440ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f4b0ea640 1 -- 172.21.15.26:0/256558223 >> 172.21.15.26:0/256558223 conn(0x7f5f4406c190 msgr2=0x7f5f4406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:47.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f4b0ea640 1 -- 172.21.15.26:0/256558223 shutdown_connections 2023-10-14T11:13:47.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f4b0ea640 1 -- 172.21.15.26:0/256558223 wait complete. 2023-10-14T11:13:47.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f4b0ea640 1 Processor -- start 2023-10-14T11:13:47.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f4b0ea640 1 -- start start 2023-10-14T11:13:47.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f4b0ea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f440adc10 0x7f5f4414edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:47.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f4b0ea640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f441597c0 0x7f5f441502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:47.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f4b0ea640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f44159ba0 0x7f5f440c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:47.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f4b0ea640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4414f330 con 0x7f5f440adc10 2023-10-14T11:13:47.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f4b0ea640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f441535b0 con 0x7f5f441597c0 2023-10-14T11:13:47.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f4b0ea640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f44152ff0 con 0x7f5f44159ba0 2023-10-14T11:13:47.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f48e86640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f440adc10 0x7f5f4414edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:47.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f48e86640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f440adc10 0x7f5f4414edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41510/0 (socket says 172.21.15.26:41510) 2023-10-14T11:13:47.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f48e86640 1 -- 172.21.15.26:0/4142133036 learned_addr learned my addr 172.21.15.26:0/4142133036 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:47.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f43fff640 1 --2- 172.21.15.26:0/4142133036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f441597c0 0x7f5f441502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:47.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f49687640 1 --2- 172.21.15.26:0/4142133036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f44159ba0 0x7f5f440c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:47.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f48e86640 1 -- 172.21.15.26:0/4142133036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f44159ba0 msgr2=0x7f5f440c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:47.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.193+0000 7f5f48e86640 1 --2- 172.21.15.26:0/4142133036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f44159ba0 0x7f5f440c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.197+0000 7f5f48e86640 1 -- 172.21.15.26:0/4142133036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f441597c0 msgr2=0x7f5f441502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:47.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.197+0000 7f5f48e86640 1 --2- 172.21.15.26:0/4142133036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f441597c0 0x7f5f441502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.197+0000 7f5f48e86640 1 -- 172.21.15.26:0/4142133036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3000b770 con 0x7f5f440adc10 2023-10-14T11:13:47.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.197+0000 7f5f49687640 1 --2- 172.21.15.26:0/4142133036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f44159ba0 0x7f5f440c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:47.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.197+0000 7f5f43fff640 1 --2- 172.21.15.26:0/4142133036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f441597c0 0x7f5f441502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:47.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.197+0000 7f5f48e86640 1 --2- 172.21.15.26:0/4142133036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f440adc10 0x7f5f4414edf0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800e930 tx=0x7f5f3800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:47.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.197+0000 7f5f417fa640 1 -- 172.21.15.26:0/4142133036 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38009690 con 0x7f5f440adc10 2023-10-14T11:13:47.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.197+0000 7f5f4b0ea640 1 -- 172.21.15.26:0/4142133036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f441532d0 con 0x7f5f440adc10 2023-10-14T11:13:47.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.197+0000 7f5f417fa640 1 -- 172.21.15.26:0/4142133036 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3800ca00 con 0x7f5f440adc10 2023-10-14T11:13:47.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.197+0000 7f5f417fa640 1 -- 172.21.15.26:0/4142133036 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3800cd70 con 0x7f5f440adc10 2023-10-14T11:13:47.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.197+0000 7f5f4b0ea640 1 -- 172.21.15.26:0/4142133036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4415c9c0 con 0x7f5f440adc10 2023-10-14T11:13:47.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.201+0000 7f5f4b0ea640 1 -- 172.21.15.26:0/4142133036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f440aee50 con 0x7f5f440adc10 2023-10-14T11:13:47.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.201+0000 7f5f417fa640 1 -- 172.21.15.26:0/4142133036 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5f38013470 con 0x7f5f440adc10 2023-10-14T11:13:47.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.201+0000 7f5f417fa640 1 --2- 172.21.15.26:0/4142133036 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5f280664a0 0x7f5f28068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:47.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.201+0000 7f5f417fa640 1 -- 172.21.15.26:0/4142133036 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f5f38083e30 con 0x7f5f440adc10 2023-10-14T11:13:47.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.201+0000 7f5f43fff640 1 --2- 172.21.15.26:0/4142133036 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5f280664a0 0x7f5f28068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:47.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.201+0000 7f5f43fff640 1 --2- 172.21.15.26:0/4142133036 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5f280664a0 0x7f5f28068960 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5f300b1000 tx=0x7f5f30008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:47.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.205+0000 7f5f417fa640 1 -- 172.21.15.26:0/4142133036 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5f38051610 con 0x7f5f440adc10 2023-10-14T11:13:47.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.365+0000 7f5f4b0ea640 1 -- 172.21.15.26:0/4142133036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f44074010 con 0x7f5f440adc10 2023-10-14T11:13:47.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.365+0000 7f5f417fa640 1 -- 172.21.15.26:0/4142133036 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+13062 (secure 0 0 0) 0x7f5f38017090 con 0x7f5f440adc10 2023-10-14T11:13:47.368 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:47.368 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":35,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:13:44.204265+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:13:47.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.365+0000 7f5f4b0ea640 1 -- 172.21.15.26:0/4142133036 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5f280664a0 msgr2=0x7f5f28068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:47.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.365+0000 7f5f4b0ea640 1 --2- 172.21.15.26:0/4142133036 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5f280664a0 0x7f5f28068960 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5f300b1000 tx=0x7f5f30008040 comp rx=0 tx=0).stop 2023-10-14T11:13:47.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.365+0000 7f5f4b0ea640 1 -- 172.21.15.26:0/4142133036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f440adc10 msgr2=0x7f5f4414edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:47.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.365+0000 7f5f4b0ea640 1 --2- 172.21.15.26:0/4142133036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f440adc10 0x7f5f4414edf0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800e930 tx=0x7f5f3800edf0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.365+0000 7f5f4b0ea640 1 -- 172.21.15.26:0/4142133036 shutdown_connections 2023-10-14T11:13:47.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.365+0000 7f5f4b0ea640 1 --2- 172.21.15.26:0/4142133036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f44159ba0 0x7f5f440c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.365+0000 7f5f4b0ea640 1 --2- 172.21.15.26:0/4142133036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f441597c0 0x7f5f441502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.365+0000 7f5f4b0ea640 1 --2- 172.21.15.26:0/4142133036 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5f280664a0 0x7f5f28068960 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.365+0000 7f5f4b0ea640 1 --2- 172.21.15.26:0/4142133036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f440adc10 0x7f5f4414edf0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.365+0000 7f5f4b0ea640 1 -- 172.21.15.26:0/4142133036 >> 172.21.15.26:0/4142133036 conn(0x7f5f4406c190 msgr2=0x7f5f44157f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:47.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.365+0000 7f5f4b0ea640 1 -- 172.21.15.26:0/4142133036 shutdown_connections 2023-10-14T11:13:47.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.365+0000 7f5f4b0ea640 1 -- 172.21.15.26:0/4142133036 wait complete. 2023-10-14T11:13:47.390 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:13:47.391 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:13:47.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.533+0000 7f9d12701640 1 Processor -- start 2023-10-14T11:13:47.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.533+0000 7f9d12701640 1 -- start start 2023-10-14T11:13:47.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.533+0000 7f9d12701640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9d0c0ab870 0x7f9d0c069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:47.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.533+0000 7f9d12701640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d0c06a800 con 0x7f9d0c15cbc0 2023-10-14T11:13:47.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.533+0000 7f9d12701640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d0c0abd00 con 0x7f9d0c06a3d0 2023-10-14T11:13:47.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.533+0000 7f9d12701640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d0c161390 con 0x7f9d0c0ab870 2023-10-14T11:13:47.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.533+0000 7f9d0bfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9d0c15cbc0 0x7f9d0c160860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34644/0 (socket says 172.21.15.26:34644) 2023-10-14T11:13:47.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.533+0000 7f9d0bfff640 1 -- 172.21.15.26:0/2322440870 learned_addr learned my addr 172.21.15.26:0/2322440870 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:47.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.533+0000 7f9d0b7fe640 1 --2- 172.21.15.26:0/2322440870 >> v2:172.21.15.110:3300/0 conn(0x7f9d0c0ab870 0x7f9d0c069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:47.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.537+0000 7f9d0affd640 1 -- 172.21.15.26:0/2322440870 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159407841 0 0) 0x7f9d0c06a800 con 0x7f9d0c15cbc0 2023-10-14T11:13:47.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.537+0000 7f9d0affd640 1 -- 172.21.15.26:0/2322440870 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cf4003530 con 0x7f9d0c15cbc0 2023-10-14T11:13:47.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.537+0000 7f9d0b7fe640 1 -- 172.21.15.26:0/2322440870 >> v1:172.21.15.110:6789/0 conn(0x7f9d0c06a3d0 legacy=0x7f9d0c0cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:47.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.537+0000 7f9d0affd640 1 -- 172.21.15.26:0/2322440870 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4191400002 0 0) 0x7f9d0c0abd00 con 0x7f9d0c06a3d0 2023-10-14T11:13:47.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.537+0000 7f9d0b7fe640 1 -- 172.21.15.26:0/2322440870 >> v1:172.21.15.26:6789/0 conn(0x7f9d0c15cbc0 legacy=0x7f9d0c160860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:47.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.537+0000 7f9d0b7fe640 1 -- 172.21.15.26:0/2322440870 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c0ccda0 con 0x7f9d0c0ab870 2023-10-14T11:13:47.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.537+0000 7f9d0b7fe640 1 --2- 172.21.15.26:0/2322440870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d0c0ab870 0x7f9d0c069e90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9d000097c0 tx=0x7f9d0001c200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad304db647bd5772 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.537+0000 7f9d0affd640 1 -- 172.21.15.26:0/2322440870 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc001680 con 0x7f9d0c0ab870 2023-10-14T11:13:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.537+0000 7f9d0affd640 1 -- 172.21.15.26:0/2322440870 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d000a7050 con 0x7f9d0c0ab870 2023-10-14T11:13:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.537+0000 7f9d0affd640 1 -- 172.21.15.26:0/2322440870 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d000ab620 con 0x7f9d0c0ab870 2023-10-14T11:13:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d12701640 1 -- 172.21.15.26:0/2322440870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d0c0ab870 msgr2=0x7f9d0c069e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d12701640 1 --2- 172.21.15.26:0/2322440870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d0c0ab870 0x7f9d0c069e90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9d000097c0 tx=0x7f9d0001c200 comp rx=0 tx=0).stop 2023-10-14T11:13:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d12701640 1 -- 172.21.15.26:0/2322440870 shutdown_connections 2023-10-14T11:13:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d12701640 1 --2- 172.21.15.26:0/2322440870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d0c0ab870 0x7f9d0c069e90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d12701640 1 -- 172.21.15.26:0/2322440870 >> 172.21.15.26:0/2322440870 conn(0x7f9d0c0b0da0 msgr2=0x7f9d0c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d12701640 1 -- 172.21.15.26:0/2322440870 shutdown_connections 2023-10-14T11:13:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d12701640 1 -- 172.21.15.26:0/2322440870 wait complete. 2023-10-14T11:13:47.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d12701640 1 Processor -- start 2023-10-14T11:13:47.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d12701640 1 -- start start 2023-10-14T11:13:47.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d12701640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0c06a3d0 0x7f9d0c157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:47.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d12701640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0c0ab870 0x7f9d0c0af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:47.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d12701640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d0c15cbc0 0x7f9d0c153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:47.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d12701640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c15e640 con 0x7f9d0c06a3d0 2023-10-14T11:13:47.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d12701640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c1583c0 con 0x7f9d0c15cbc0 2023-10-14T11:13:47.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d12701640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c0ce8b0 con 0x7f9d0c0ab870 2023-10-14T11:13:47.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d0bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0c06a3d0 0x7f9d0c157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:47.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d0bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0c06a3d0 0x7f9d0c157c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41516/0 (socket says 172.21.15.26:41516) 2023-10-14T11:13:47.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d0bfff640 1 -- 172.21.15.26:0/3363015284 learned_addr learned my addr 172.21.15.26:0/3363015284 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:47.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d0b7fe640 1 --2- 172.21.15.26:0/3363015284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0c0ab870 0x7f9d0c0af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:47.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d10c9e640 1 --2- 172.21.15.26:0/3363015284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d0c15cbc0 0x7f9d0c153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:47.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d0bfff640 1 -- 172.21.15.26:0/3363015284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0c0ab870 msgr2=0x7f9d0c0af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:47.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d0bfff640 1 --2- 172.21.15.26:0/3363015284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0c0ab870 0x7f9d0c0af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d0bfff640 1 -- 172.21.15.26:0/3363015284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d0c15cbc0 msgr2=0x7f9d0c153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:47.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d0bfff640 1 --2- 172.21.15.26:0/3363015284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d0c15cbc0 0x7f9d0c153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.541+0000 7f9d0bfff640 1 -- 172.21.15.26:0/3363015284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d00009420 con 0x7f9d0c06a3d0 2023-10-14T11:13:47.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.545+0000 7f9d0bfff640 1 --2- 172.21.15.26:0/3363015284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0c06a3d0 0x7f9d0c157c10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00c730 tx=0x7f9cfc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:47.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.545+0000 7f9d08ff9640 1 -- 172.21.15.26:0/3363015284 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc0074e0 con 0x7f9d0c06a3d0 2023-10-14T11:13:47.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.545+0000 7f9d08ff9640 1 -- 172.21.15.26:0/3363015284 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cfc007660 con 0x7f9d0c06a3d0 2023-10-14T11:13:47.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.545+0000 7f9d08ff9640 1 -- 172.21.15.26:0/3363015284 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc004a30 con 0x7f9d0c06a3d0 2023-10-14T11:13:47.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.545+0000 7f9d12701640 1 -- 172.21.15.26:0/3363015284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d0c0ceb50 con 0x7f9d0c06a3d0 2023-10-14T11:13:47.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.545+0000 7f9d12701640 1 -- 172.21.15.26:0/3363015284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d0c15e2d0 con 0x7f9d0c06a3d0 2023-10-14T11:13:47.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.545+0000 7f9d12701640 1 -- 172.21.15.26:0/3363015284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d0c04e170 con 0x7f9d0c06a3d0 2023-10-14T11:13:47.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.545+0000 7f9d08ff9640 1 -- 172.21.15.26:0/3363015284 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9cfc004b90 con 0x7f9d0c06a3d0 2023-10-14T11:13:47.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.545+0000 7f9d08ff9640 1 --2- 172.21.15.26:0/3363015284 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9cf80664d0 0x7f9cf8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:47.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.545+0000 7f9d08ff9640 1 -- 172.21.15.26:0/3363015284 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9cfc0830b0 con 0x7f9d0c06a3d0 2023-10-14T11:13:47.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.545+0000 7f9d0b7fe640 1 --2- 172.21.15.26:0/3363015284 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9cf80664d0 0x7f9cf8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:47.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.549+0000 7f9d0b7fe640 1 --2- 172.21.15.26:0/3363015284 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9cf80664d0 0x7f9cf8068990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9d000ad000 tx=0x7f9d000a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:47.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.549+0000 7f9d08ff9640 1 -- 172.21.15.26:0/3363015284 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9cfc050730 con 0x7f9d0c06a3d0 2023-10-14T11:13:47.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.709+0000 7f9d12701640 1 -- 172.21.15.26:0/3363015284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9d0c0cc5d0 con 0x7f9d0c06a3d0 2023-10-14T11:13:47.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.709+0000 7f9d08ff9640 1 -- 172.21.15.26:0/3363015284 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9cfc0180a0 con 0x7f9d0c06a3d0 2023-10-14T11:13:47.713 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:13:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.709+0000 7f9d12701640 1 -- 172.21.15.26:0/3363015284 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9cf80664d0 msgr2=0x7f9cf8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:47.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.709+0000 7f9d12701640 1 --2- 172.21.15.26:0/3363015284 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9cf80664d0 0x7f9cf8068990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9d000ad000 tx=0x7f9d000a6000 comp rx=0 tx=0).stop 2023-10-14T11:13:47.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.709+0000 7f9d12701640 1 -- 172.21.15.26:0/3363015284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0c06a3d0 msgr2=0x7f9d0c157c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:47.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.709+0000 7f9d12701640 1 --2- 172.21.15.26:0/3363015284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0c06a3d0 0x7f9d0c157c10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00c730 tx=0x7f9cfc00cbf0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.709+0000 7f9d12701640 1 -- 172.21.15.26:0/3363015284 shutdown_connections 2023-10-14T11:13:47.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.709+0000 7f9d12701640 1 --2- 172.21.15.26:0/3363015284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d0c15cbc0 0x7f9d0c153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.709+0000 7f9d12701640 1 --2- 172.21.15.26:0/3363015284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0c0ab870 0x7f9d0c0af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.709+0000 7f9d12701640 1 --2- 172.21.15.26:0/3363015284 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9cf80664d0 0x7f9cf8068990 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.709+0000 7f9d12701640 1 --2- 172.21.15.26:0/3363015284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0c06a3d0 0x7f9d0c157c10 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.709+0000 7f9d12701640 1 -- 172.21.15.26:0/3363015284 >> 172.21.15.26:0/3363015284 conn(0x7f9d0c0b0da0 msgr2=0x7f9d0c06d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:47.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.713+0000 7f9d12701640 1 -- 172.21.15.26:0/3363015284 shutdown_connections 2023-10-14T11:13:47.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.713+0000 7f9d12701640 1 -- 172.21.15.26:0/3363015284 wait complete. 2023-10-14T11:13:47.734 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T11:13:47.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.873+0000 7f61da180640 1 Processor -- start 2023-10-14T11:13:47.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.873+0000 7f61da180640 1 -- start start 2023-10-14T11:13:47.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.873+0000 7f61da180640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f61d4159ba0 0x7f61d40cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:47.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.873+0000 7f61da180640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d40723d0 con 0x7f61d40c8cb0 2023-10-14T11:13:47.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.873+0000 7f61da180640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d40717c0 con 0x7f61d41597c0 2023-10-14T11:13:47.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.873+0000 7f61da180640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d4071aa0 con 0x7f61d4159ba0 2023-10-14T11:13:47.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.873+0000 7f61d3fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f61d40c8cb0 0x7f61d40cb350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34652/0 (socket says 172.21.15.26:34652) 2023-10-14T11:13:47.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.873+0000 7f61d3fff640 1 -- 172.21.15.26:0/210675524 learned_addr learned my addr 172.21.15.26:0/210675524 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:47.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.877+0000 7f61d2ffd640 1 --2- 172.21.15.26:0/210675524 >> v2:172.21.15.110:3300/0 conn(0x7f61d4159ba0 0x7f61d40cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.877+0000 7f61d27fc640 1 -- 172.21.15.26:0/210675524 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955860291 0 0) 0x7f61d40723d0 con 0x7f61d40c8cb0 2023-10-14T11:13:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.877+0000 7f61d27fc640 1 -- 172.21.15.26:0/210675524 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61bc003530 con 0x7f61d40c8cb0 2023-10-14T11:13:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.877+0000 7f61d2ffd640 1 -- 172.21.15.26:0/210675524 >> v1:172.21.15.110:6789/0 conn(0x7f61d41597c0 legacy=0x7f61d40ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.877+0000 7f61d2ffd640 1 -- 172.21.15.26:0/210675524 >> v1:172.21.15.26:6789/0 conn(0x7f61d40c8cb0 legacy=0x7f61d40cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.877+0000 7f61d2ffd640 1 -- 172.21.15.26:0/210675524 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d4071d80 con 0x7f61d4159ba0 2023-10-14T11:13:47.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.877+0000 7f61d2ffd640 1 --2- 172.21.15.26:0/210675524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61d4159ba0 0x7f61d40cae10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f61c80097c0 tx=0x7f61c801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ef5464df5e1a48c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.877+0000 7f61d27fc640 1 -- 172.21.15.26:0/210675524 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c80ab620 con 0x7f61d4159ba0 2023-10-14T11:13:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.877+0000 7f61d27fc640 1 -- 172.21.15.26:0/210675524 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c80ab780 con 0x7f61d4159ba0 2023-10-14T11:13:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.877+0000 7f61d27fc640 1 -- 172.21.15.26:0/210675524 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c80abb10 con 0x7f61d4159ba0 2023-10-14T11:13:47.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61da180640 1 -- 172.21.15.26:0/210675524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61d4159ba0 msgr2=0x7f61d40cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:47.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61da180640 1 --2- 172.21.15.26:0/210675524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61d4159ba0 0x7f61d40cae10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f61c80097c0 tx=0x7f61c801c480 comp rx=0 tx=0).stop 2023-10-14T11:13:47.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61da180640 1 -- 172.21.15.26:0/210675524 shutdown_connections 2023-10-14T11:13:47.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61da180640 1 --2- 172.21.15.26:0/210675524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61d4159ba0 0x7f61d40cae10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61da180640 1 -- 172.21.15.26:0/210675524 >> 172.21.15.26:0/210675524 conn(0x7f61d406c190 msgr2=0x7f61d406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:47.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61da180640 1 -- 172.21.15.26:0/210675524 shutdown_connections 2023-10-14T11:13:47.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61da180640 1 -- 172.21.15.26:0/210675524 wait complete. 2023-10-14T11:13:47.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61da180640 1 Processor -- start 2023-10-14T11:13:47.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61da180640 1 -- start start 2023-10-14T11:13:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61da180640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61d40c8cb0 0x7f61d4149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61da180640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61d41597c0 0x7f61d41f5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61da180640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61d4159ba0 0x7f61d4158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61da180640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d4157450 con 0x7f61d41597c0 2023-10-14T11:13:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61da180640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d414a200 con 0x7f61d4159ba0 2023-10-14T11:13:47.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61da180640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d41576a0 con 0x7f61d40c8cb0 2023-10-14T11:13:47.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61d2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61d41597c0 0x7f61d41f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:47.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61d2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61d41597c0 0x7f61d41f5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41522/0 (socket says 172.21.15.26:41522) 2023-10-14T11:13:47.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61d2ffd640 1 -- 172.21.15.26:0/789754874 learned_addr learned my addr 172.21.15.26:0/789754874 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:47.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61d37fe640 1 --2- 172.21.15.26:0/789754874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61d40c8cb0 0x7f61d4149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:47.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61d3fff640 1 --2- 172.21.15.26:0/789754874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61d4159ba0 0x7f61d4158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:47.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61d2ffd640 1 -- 172.21.15.26:0/789754874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61d40c8cb0 msgr2=0x7f61d4149cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:47.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61d2ffd640 1 --2- 172.21.15.26:0/789754874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61d40c8cb0 0x7f61d4149cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61d2ffd640 1 -- 172.21.15.26:0/789754874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61d4159ba0 msgr2=0x7f61d4158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:47.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61d2ffd640 1 --2- 172.21.15.26:0/789754874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61d4159ba0 0x7f61d4158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:47.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.881+0000 7f61d2ffd640 1 -- 172.21.15.26:0/789754874 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c8009420 con 0x7f61d41597c0 2023-10-14T11:13:47.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.885+0000 7f61d2ffd640 1 --2- 172.21.15.26:0/789754874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61d41597c0 0x7f61d41f5500 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f61c8019090 tx=0x7f61c801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:47.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.885+0000 7f61bbfff640 1 -- 172.21.15.26:0/789754874 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c80abdc0 con 0x7f61d41597c0 2023-10-14T11:13:47.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.885+0000 7f61bbfff640 1 -- 172.21.15.26:0/789754874 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c80bf410 con 0x7f61d41597c0 2023-10-14T11:13:47.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.885+0000 7f61da180640 1 -- 172.21.15.26:0/789754874 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d4157980 con 0x7f61d41597c0 2023-10-14T11:13:47.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.885+0000 7f61bbfff640 1 -- 172.21.15.26:0/789754874 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c80bf7c0 con 0x7f61d41597c0 2023-10-14T11:13:47.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.885+0000 7f61da180640 1 -- 172.21.15.26:0/789754874 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d4157f40 con 0x7f61d41597c0 2023-10-14T11:13:47.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.885+0000 7f61da180640 1 -- 172.21.15.26:0/789754874 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d4158130 con 0x7f61d41597c0 2023-10-14T11:13:47.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.885+0000 7f61bbfff640 1 -- 172.21.15.26:0/789754874 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f61c80bf920 con 0x7f61d41597c0 2023-10-14T11:13:47.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.885+0000 7f61bbfff640 1 --2- 172.21.15.26:0/789754874 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f61c00664a0 0x7f61c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:47.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.885+0000 7f61bbfff640 1 -- 172.21.15.26:0/789754874 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f61c811e440 con 0x7f61d41597c0 2023-10-14T11:13:47.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.885+0000 7f61d37fe640 1 --2- 172.21.15.26:0/789754874 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f61c00664a0 0x7f61c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:47.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.889+0000 7f61d37fe640 1 --2- 172.21.15.26:0/789754874 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f61c00664a0 0x7f61c0068960 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f61c4007fd0 tx=0x7f61c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:47.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:47.889+0000 7f61bbfff640 1 -- 172.21.15.26:0/789754874 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f61c80ebb70 con 0x7f61d41597c0 2023-10-14T11:13:48.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.057+0000 7f61da180640 1 -- 172.21.15.26:0/789754874 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f61d4074010 con 0x7f61d41597c0 2023-10-14T11:13:48.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.057+0000 7f61bbfff640 1 -- 172.21.15.26:0/789754874 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+65 (secure 0 0 0) 0x7f61c80ef190 con 0x7f61d41597c0 2023-10-14T11:13:48.063 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:48.063 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-14T11:13:48.064 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:13:48.064 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-10-14T11:13:48.064 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-10-14T11:13:48.064 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:48.065 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-14T11:13:48.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.061+0000 7f61da180640 1 -- 172.21.15.26:0/789754874 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f61c00664a0 msgr2=0x7f61c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:48.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.061+0000 7f61da180640 1 --2- 172.21.15.26:0/789754874 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f61c00664a0 0x7f61c0068960 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f61c4007fd0 tx=0x7f61c4009040 comp rx=0 tx=0).stop 2023-10-14T11:13:48.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.061+0000 7f61da180640 1 -- 172.21.15.26:0/789754874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61d41597c0 msgr2=0x7f61d41f5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:48.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.061+0000 7f61da180640 1 --2- 172.21.15.26:0/789754874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61d41597c0 0x7f61d41f5500 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f61c8019090 tx=0x7f61c801acc0 comp rx=0 tx=0).stop 2023-10-14T11:13:48.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.061+0000 7f61da180640 1 -- 172.21.15.26:0/789754874 shutdown_connections 2023-10-14T11:13:48.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.061+0000 7f61da180640 1 --2- 172.21.15.26:0/789754874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61d4159ba0 0x7f61d4158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:48.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.061+0000 7f61da180640 1 --2- 172.21.15.26:0/789754874 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f61c00664a0 0x7f61c0068960 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:48.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.061+0000 7f61da180640 1 --2- 172.21.15.26:0/789754874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61d41597c0 0x7f61d41f5500 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:48.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.061+0000 7f61da180640 1 --2- 172.21.15.26:0/789754874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61d40c8cb0 0x7f61d4149cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:48.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.061+0000 7f61da180640 1 -- 172.21.15.26:0/789754874 >> 172.21.15.26:0/789754874 conn(0x7f61d406c190 msgr2=0x7f61d414f150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:48.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.061+0000 7f61da180640 1 -- 172.21.15.26:0/789754874 shutdown_connections 2023-10-14T11:13:48.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.061+0000 7f61da180640 1 -- 172.21.15.26:0/789754874 wait complete. 2023-10-14T11:13:48.084 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'testcephfs1' 2023-10-14T11:13:48.085 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_metadata --pg_num_min 64 2023-10-14T11:13:48.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.229+0000 7effb933e640 1 Processor -- start 2023-10-14T11:13:48.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.229+0000 7effb933e640 1 -- start start 2023-10-14T11:13:48.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.233+0000 7effb933e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7effb40d2570 0x7effb4161210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:48.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.233+0000 7effb933e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7effb40cfd20 0x7effb40d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:48.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.233+0000 7effb933e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb40ce460 con 0x7effb40cdc80 2023-10-14T11:13:48.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.233+0000 7effb933e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb40cd830 con 0x7effb40cfd20 2023-10-14T11:13:48.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.233+0000 7effb933e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb415da30 con 0x7effb40d2570 2023-10-14T11:13:48.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.233+0000 7effb37fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7effb40cfd20 0x7effb40d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:48.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.233+0000 7effb37fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7effb40cfd20 0x7effb40d0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41526/0 (socket says 172.21.15.26:41526) 2023-10-14T11:13:48.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.233+0000 7effb37fe640 1 -- 172.21.15.26:0/675386084 learned_addr learned my addr 172.21.15.26:0/675386084 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:48.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.233+0000 7effabfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7effb40cdc80 0x7effb40cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34654/0 (socket says 172.21.15.26:34654) 2023-10-14T11:13:48.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.233+0000 7effb2ffd640 1 --2- 172.21.15.26:0/675386084 >> v2:172.21.15.110:3300/0 conn(0x7effb40d2570 0x7effb4161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:48.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.233+0000 7effb37fe640 1 -- 172.21.15.26:0/675386084 >> v2:172.21.15.110:3300/0 conn(0x7effb40d2570 msgr2=0x7effb4161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:48.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.233+0000 7effb37fe640 1 --2- 172.21.15.26:0/675386084 >> v2:172.21.15.110:3300/0 conn(0x7effb40d2570 0x7effb4161210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:48.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.233+0000 7effb37fe640 1 -- 172.21.15.26:0/675386084 >> v1:172.21.15.26:6789/0 conn(0x7effb40cdc80 legacy=0x7effb40cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:48.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.233+0000 7effb37fe640 1 -- 172.21.15.26:0/675386084 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb4161750 con 0x7effb40cfd20 2023-10-14T11:13:48.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.233+0000 7effb27fc640 1 -- 172.21.15.26:0/675386084 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3803549258 0 0) 0x7effb40ce460 con 0x7effb40cdc80 2023-10-14T11:13:48.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.237+0000 7effb37fe640 1 --2- 172.21.15.26:0/675386084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40cfd20 0x7effb40d0e60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7effb40722b0 tx=0x7effac01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d830a3f861fafd94 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:48.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.237+0000 7effb27fc640 1 -- 172.21.15.26:0/675386084 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac0a5770 con 0x7effb40cfd20 2023-10-14T11:13:48.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.237+0000 7effb27fc640 1 -- 172.21.15.26:0/675386084 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac0a58d0 con 0x7effb40cfd20 2023-10-14T11:13:48.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.237+0000 7effb27fc640 1 -- 172.21.15.26:0/675386084 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac0a5c60 con 0x7effb40cfd20 2023-10-14T11:13:48.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.237+0000 7effb933e640 1 -- 172.21.15.26:0/675386084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40cfd20 msgr2=0x7effb40d0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:48.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.237+0000 7effb933e640 1 --2- 172.21.15.26:0/675386084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40cfd20 0x7effb40d0e60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7effb40722b0 tx=0x7effac01c9a0 comp rx=0 tx=0).stop 2023-10-14T11:13:48.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.237+0000 7effb933e640 1 -- 172.21.15.26:0/675386084 shutdown_connections 2023-10-14T11:13:48.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.237+0000 7effb933e640 1 --2- 172.21.15.26:0/675386084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40cfd20 0x7effb40d0e60 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:48.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.237+0000 7effb933e640 1 --2- 172.21.15.26:0/675386084 >> v2:172.21.15.110:3300/0 conn(0x7effb40d2570 0x7effb4161210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:48.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.237+0000 7effb933e640 1 -- 172.21.15.26:0/675386084 >> 172.21.15.26:0/675386084 conn(0x7effb40715c0 msgr2=0x7effb40719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:48.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.237+0000 7effb933e640 1 -- 172.21.15.26:0/675386084 shutdown_connections 2023-10-14T11:13:48.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.237+0000 7effb933e640 1 -- 172.21.15.26:0/675386084 wait complete. 2023-10-14T11:13:48.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.237+0000 7effb933e640 1 Processor -- start 2023-10-14T11:13:48.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.237+0000 7effb933e640 1 -- start start 2023-10-14T11:13:48.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effb933e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb40cdc80 0x7effb414f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:48.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effb933e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40cfd20 0x7effb4150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:48.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effb933e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effb40d2570 0x7effb414d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:48.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effb933e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb414e050 con 0x7effb40cfd20 2023-10-14T11:13:48.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effb933e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb41586c0 con 0x7effb40cdc80 2023-10-14T11:13:48.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effb933e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb41589a0 con 0x7effb40d2570 2023-10-14T11:13:48.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effabfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40cfd20 0x7effb4150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:48.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effabfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40cfd20 0x7effb4150f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41528/0 (socket says 172.21.15.26:41528) 2023-10-14T11:13:48.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effabfff640 1 -- 172.21.15.26:0/2648554251 learned_addr learned my addr 172.21.15.26:0/2648554251 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:48.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effb2ffd640 1 --2- 172.21.15.26:0/2648554251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb40cdc80 0x7effb414f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:48.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effb37fe640 1 --2- 172.21.15.26:0/2648554251 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effb40d2570 0x7effb414d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:48.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effabfff640 1 -- 172.21.15.26:0/2648554251 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effb40d2570 msgr2=0x7effb414d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:48.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effabfff640 1 --2- 172.21.15.26:0/2648554251 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effb40d2570 0x7effb414d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:48.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effabfff640 1 -- 172.21.15.26:0/2648554251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb40cdc80 msgr2=0x7effb414f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:48.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effabfff640 1 --2- 172.21.15.26:0/2648554251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb40cdc80 0x7effb414f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:48.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effabfff640 1 -- 172.21.15.26:0/2648554251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac009b30 con 0x7effb40cfd20 2023-10-14T11:13:48.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effb2ffd640 1 --2- 172.21.15.26:0/2648554251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb40cdc80 0x7effb414f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:48.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effb37fe640 1 --2- 172.21.15.26:0/2648554251 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effb40d2570 0x7effb414d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:48.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effabfff640 1 --2- 172.21.15.26:0/2648554251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40cfd20 0x7effb4150f90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00c480 tx=0x7eff9c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:48.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effab7fe640 1 -- 172.21.15.26:0/2648554251 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c0074e0 con 0x7effb40cfd20 2023-10-14T11:13:48.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effab7fe640 1 -- 172.21.15.26:0/2648554251 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9c007660 con 0x7effb40cfd20 2023-10-14T11:13:48.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effab7fe640 1 -- 172.21.15.26:0/2648554251 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c004a30 con 0x7effb40cfd20 2023-10-14T11:13:48.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effb933e640 1 -- 172.21.15.26:0/2648554251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb4158c80 con 0x7effb40cfd20 2023-10-14T11:13:48.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effb933e640 1 -- 172.21.15.26:0/2648554251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb4159240 con 0x7effb40cfd20 2023-10-14T11:13:48.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effb933e640 1 -- 172.21.15.26:0/2648554251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb4159460 con 0x7effb40cfd20 2023-10-14T11:13:48.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.241+0000 7effab7fe640 1 -- 172.21.15.26:0/2648554251 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7eff9c004b90 con 0x7effb40cfd20 2023-10-14T11:13:48.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.245+0000 7effab7fe640 1 --2- 172.21.15.26:0/2648554251 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7eff940664a0 0x7eff94068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:48.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.245+0000 7effab7fe640 1 -- 172.21.15.26:0/2648554251 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7eff9c082df0 con 0x7effb40cfd20 2023-10-14T11:13:48.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.245+0000 7effb2ffd640 1 --2- 172.21.15.26:0/2648554251 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7eff940664a0 0x7eff94068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:48.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.245+0000 7effb2ffd640 1 --2- 172.21.15.26:0/2648554251 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7eff940664a0 0x7eff94068960 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7effb41544f0 tx=0x7effa4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:48.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.249+0000 7effab7fe640 1 -- 172.21.15.26:0/2648554251 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7eff9c053fa0 con 0x7effb40cfd20 2023-10-14T11:13:48.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:48.405+0000 7effb933e640 1 -- 172.21.15.26:0/2648554251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64} v 0) v1 -- 0x7effb404e170 con 0x7effb40cfd20 2023-10-14T11:13:48.925 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:13:48.929 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:13:49.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.213+0000 7effab7fe640 1 -- 172.21.15.26:0/2648554251 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64}]=0 pool 'testcephfs1_metadata' created v36) v1 ==== 148+0+0 (secure 0 0 0) 0x7eff9c018020 con 0x7effb40cfd20 2023-10-14T11:13:49.215 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'testcephfs1_metadata' created 2023-10-14T11:13:49.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.213+0000 7effb933e640 1 -- 172.21.15.26:0/2648554251 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7eff940664a0 msgr2=0x7eff94068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:49.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.213+0000 7effb933e640 1 --2- 172.21.15.26:0/2648554251 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7eff940664a0 0x7eff94068960 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7effb41544f0 tx=0x7effa4008040 comp rx=0 tx=0).stop 2023-10-14T11:13:49.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.213+0000 7effb933e640 1 -- 172.21.15.26:0/2648554251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40cfd20 msgr2=0x7effb4150f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:49.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.213+0000 7effb933e640 1 --2- 172.21.15.26:0/2648554251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40cfd20 0x7effb4150f90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00c480 tx=0x7eff9c00c940 comp rx=0 tx=0).stop 2023-10-14T11:13:49.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.213+0000 7effb933e640 1 -- 172.21.15.26:0/2648554251 shutdown_connections 2023-10-14T11:13:49.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.213+0000 7effb933e640 1 --2- 172.21.15.26:0/2648554251 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effb40d2570 0x7effb414d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:49.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.213+0000 7effb933e640 1 --2- 172.21.15.26:0/2648554251 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7eff940664a0 0x7eff94068960 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:49.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.213+0000 7effb933e640 1 --2- 172.21.15.26:0/2648554251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40cfd20 0x7effb4150f90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:49.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.213+0000 7effb933e640 1 --2- 172.21.15.26:0/2648554251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb40cdc80 0x7effb414f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:49.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.213+0000 7effb933e640 1 -- 172.21.15.26:0/2648554251 >> 172.21.15.26:0/2648554251 conn(0x7effb40715c0 msgr2=0x7effb4156b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:49.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.213+0000 7effb933e640 1 -- 172.21.15.26:0/2648554251 shutdown_connections 2023-10-14T11:13:49.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.213+0000 7effb933e640 1 -- 172.21.15.26:0/2648554251 wait complete. 2023-10-14T11:13:49.246 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T11:13:49.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.397+0000 7fefed609640 1 Processor -- start 2023-10-14T11:13:49.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.397+0000 7fefed609640 1 -- start start 2023-10-14T11:13:49.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.401+0000 7fefed609640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fefe806dbd0 0x7fefe815ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:49.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.401+0000 7fefed609640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefe8069e90 0x7fefe806a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:49.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.401+0000 7fefed609640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe815e5e0 con 0x7fefe80c8e50 2023-10-14T11:13:49.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.401+0000 7fefed609640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe806a840 con 0x7fefe806dbd0 2023-10-14T11:13:49.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.401+0000 7fefed609640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe815b320 con 0x7fefe8069e90 2023-10-14T11:13:49.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.401+0000 7fefe77fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefe8069e90 0x7fefe806a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:49.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.401+0000 7fefe6ffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fefe806dbd0 0x7fefe815ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:49.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.401+0000 7fefe77fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefe8069e90 0x7fefe806a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:35138/0 (socket says 172.21.15.26:35138) 2023-10-14T11:13:49.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.401+0000 7fefe77fe640 1 -- 172.21.15.26:0/3677146205 learned_addr learned my addr 172.21.15.26:0/3677146205 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:49.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.401+0000 7fefdffff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fefe80c8e50 0x7fefe806c660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:50482/0 (socket says 172.21.15.26:50482) 2023-10-14T11:13:49.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.401+0000 7fefe6ffd640 1 -- 172.21.15.26:0/3677146205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefe8069e90 msgr2=0x7fefe806a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:49.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.401+0000 7fefe6ffd640 1 --2- 172.21.15.26:0/3677146205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefe8069e90 0x7fefe806a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:49.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.401+0000 7fefe6ffd640 1 -- 172.21.15.26:0/3677146205 >> v1:172.21.15.110:6789/0 conn(0x7fefe80c8e50 legacy=0x7fefe806c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:49.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.401+0000 7fefe6ffd640 1 -- 172.21.15.26:0/3677146205 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe815b570 con 0x7fefe806dbd0 2023-10-14T11:13:49.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.401+0000 7fefe67fc640 1 -- 172.21.15.26:0/3677146205 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706215433 0 0) 0x7fefe815e5e0 con 0x7fefe80c8e50 2023-10-14T11:13:49.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.401+0000 7fefe77fe640 1 --2- 172.21.15.26:0/3677146205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefe8069e90 0x7fefe806a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:13:49.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.405+0000 7fefe6ffd640 1 --2- 172.21.15.26:0/3677146205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefe806dbd0 0x7fefe815ade0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fefd80097c0 tx=0x7fefd801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86a992a733122ef2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:49.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.405+0000 7fefe67fc640 1 -- 172.21.15.26:0/3677146205 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd80ab650 con 0x7fefe806dbd0 2023-10-14T11:13:49.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.405+0000 7fefe67fc640 1 -- 172.21.15.26:0/3677146205 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd80ab7b0 con 0x7fefe806dbd0 2023-10-14T11:13:49.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.405+0000 7fefe67fc640 1 -- 172.21.15.26:0/3677146205 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd80abb40 con 0x7fefe806dbd0 2023-10-14T11:13:49.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.405+0000 7fefed609640 1 -- 172.21.15.26:0/3677146205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefe806dbd0 msgr2=0x7fefe815ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:49.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.405+0000 7fefed609640 1 --2- 172.21.15.26:0/3677146205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefe806dbd0 0x7fefe815ade0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fefd80097c0 tx=0x7fefd801c450 comp rx=0 tx=0).stop 2023-10-14T11:13:49.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.405+0000 7fefed609640 1 -- 172.21.15.26:0/3677146205 shutdown_connections 2023-10-14T11:13:49.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.405+0000 7fefed609640 1 --2- 172.21.15.26:0/3677146205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefe8069e90 0x7fefe806a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:49.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.405+0000 7fefed609640 1 --2- 172.21.15.26:0/3677146205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefe806dbd0 0x7fefe815ade0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:49.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.405+0000 7fefed609640 1 -- 172.21.15.26:0/3677146205 >> 172.21.15.26:0/3677146205 conn(0x7fefe80b0d10 msgr2=0x7fefe80ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:49.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.405+0000 7fefed609640 1 -- 172.21.15.26:0/3677146205 shutdown_connections 2023-10-14T11:13:49.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.405+0000 7fefed609640 1 -- 172.21.15.26:0/3677146205 wait complete. 2023-10-14T11:13:49.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.405+0000 7fefed609640 1 Processor -- start 2023-10-14T11:13:49.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.405+0000 7fefed609640 1 -- start start 2023-10-14T11:13:49.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefed609640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefe8069e90 0x7fefe80c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:49.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefed609640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefe806dbd0 0x7fefe8150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:49.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefed609640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefe80c8e50 0x7fefe80c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:49.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefed609640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe81518d0 con 0x7fefe8069e90 2023-10-14T11:13:49.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefed609640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe8150d50 con 0x7fefe806dbd0 2023-10-14T11:13:49.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefed609640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe8151030 con 0x7fefe80c8e50 2023-10-14T11:13:49.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefe6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefe8069e90 0x7fefe80c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:49.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefe6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefe8069e90 0x7fefe80c6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41532/0 (socket says 172.21.15.26:41532) 2023-10-14T11:13:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefe6ffd640 1 -- 172.21.15.26:0/3154914207 learned_addr learned my addr 172.21.15.26:0/3154914207 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefdffff640 1 --2- 172.21.15.26:0/3154914207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefe806dbd0 0x7fefe8150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefe77fe640 1 --2- 172.21.15.26:0/3154914207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefe80c8e50 0x7fefe80c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefe6ffd640 1 -- 172.21.15.26:0/3154914207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefe80c8e50 msgr2=0x7fefe80c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefe6ffd640 1 --2- 172.21.15.26:0/3154914207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefe80c8e50 0x7fefe80c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:49.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefe6ffd640 1 -- 172.21.15.26:0/3154914207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefe806dbd0 msgr2=0x7fefe8150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:49.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefe6ffd640 1 --2- 172.21.15.26:0/3154914207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefe806dbd0 0x7fefe8150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:49.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefe6ffd640 1 -- 172.21.15.26:0/3154914207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe0009b30 con 0x7fefe8069e90 2023-10-14T11:13:49.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefe6ffd640 1 --2- 172.21.15.26:0/3154914207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefe8069e90 0x7fefe80c6950 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fefd80ad040 tx=0x7fefd801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:49.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefdf7fe640 1 -- 172.21.15.26:0/3154914207 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd80bf610 con 0x7fefe8069e90 2023-10-14T11:13:49.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefdf7fe640 1 -- 172.21.15.26:0/3154914207 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd80bf790 con 0x7fefe8069e90 2023-10-14T11:13:49.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefdf7fe640 1 -- 172.21.15.26:0/3154914207 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd80bfb40 con 0x7fefe8069e90 2023-10-14T11:13:49.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefed609640 1 -- 172.21.15.26:0/3154914207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd8009420 con 0x7fefe8069e90 2023-10-14T11:13:49.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefed609640 1 -- 172.21.15.26:0/3154914207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe81515f0 con 0x7fefe8069e90 2023-10-14T11:13:49.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefed609640 1 -- 172.21.15.26:0/3154914207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe80c9250 con 0x7fefe8069e90 2023-10-14T11:13:49.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.409+0000 7fefdf7fe640 1 -- 172.21.15.26:0/3154914207 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fefd80b5400 con 0x7fefe8069e90 2023-10-14T11:13:49.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.413+0000 7fefdf7fe640 1 --2- 172.21.15.26:0/3154914207 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fefc80664a0 0x7fefc8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:49.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.413+0000 7fefdf7fe640 1 -- 172.21.15.26:0/3154914207 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5552+0+0 (secure 0 0 0) 0x7fefd811eb30 con 0x7fefe8069e90 2023-10-14T11:13:49.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.413+0000 7fefdffff640 1 --2- 172.21.15.26:0/3154914207 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fefc80664a0 0x7fefc8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:49.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.413+0000 7fefdffff640 1 --2- 172.21.15.26:0/3154914207 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fefc80664a0 0x7fefc8068960 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fefd0000f70 tx=0x7fefd0007df0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:49.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.417+0000 7fefdf7fe640 1 -- 172.21.15.26:0/3154914207 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fefd80ec2b0 con 0x7fefe8069e90 2023-10-14T11:13:49.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:49.577+0000 7fefed609640 1 -- 172.21.15.26:0/3154914207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fefe804e170 con 0x7fefe8069e90 2023-10-14T11:13:50.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.217+0000 7fefdf7fe640 1 -- 172.21.15.26:0/3154914207 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'testcephfs1_data' created v37) v1 ==== 180+0+0 (secure 0 0 0) 0x7fefd80ef8d0 con 0x7fefe8069e90 2023-10-14T11:13:50.222 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'testcephfs1_data' created 2023-10-14T11:13:50.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.221+0000 7fefed609640 1 -- 172.21.15.26:0/3154914207 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fefc80664a0 msgr2=0x7fefc8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:50.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.221+0000 7fefed609640 1 --2- 172.21.15.26:0/3154914207 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fefc80664a0 0x7fefc8068960 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fefd0000f70 tx=0x7fefd0007df0 comp rx=0 tx=0).stop 2023-10-14T11:13:50.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.221+0000 7fefed609640 1 -- 172.21.15.26:0/3154914207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefe8069e90 msgr2=0x7fefe80c6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:50.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.221+0000 7fefed609640 1 --2- 172.21.15.26:0/3154914207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefe8069e90 0x7fefe80c6950 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fefd80ad040 tx=0x7fefd801ac90 comp rx=0 tx=0).stop 2023-10-14T11:13:50.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.221+0000 7fefed609640 1 -- 172.21.15.26:0/3154914207 shutdown_connections 2023-10-14T11:13:50.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.221+0000 7fefed609640 1 --2- 172.21.15.26:0/3154914207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefe80c8e50 0x7fefe80c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:50.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.221+0000 7fefed609640 1 --2- 172.21.15.26:0/3154914207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefe806dbd0 0x7fefe8150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:50.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.221+0000 7fefed609640 1 --2- 172.21.15.26:0/3154914207 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fefc80664a0 0x7fefc8068960 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:50.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.221+0000 7fefed609640 1 --2- 172.21.15.26:0/3154914207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefe8069e90 0x7fefe80c6950 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:50.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.221+0000 7fefed609640 1 -- 172.21.15.26:0/3154914207 >> 172.21.15.26:0/3154914207 conn(0x7fefe80b0d10 msgr2=0x7fefe80c9600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:50.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.221+0000 7fefed609640 1 -- 172.21.15.26:0/3154914207 shutdown_connections 2023-10-14T11:13:50.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.225+0000 7fefed609640 1 -- 172.21.15.26:0/3154914207 wait complete. 2023-10-14T11:13:50.263 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new testcephfs1 testcephfs1_metadata testcephfs1_data 2023-10-14T11:13:50.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.405+0000 7fa2a3dd9640 1 Processor -- start 2023-10-14T11:13:50.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.405+0000 7fa2a3dd9640 1 -- start start 2023-10-14T11:13:50.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.405+0000 7fa2a3dd9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa29c069e90 0x7fa29c06d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:50.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.405+0000 7fa2a3dd9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29c15ae30 con 0x7fa29c0c26b0 2023-10-14T11:13:50.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.405+0000 7fa2a3dd9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29c0ca510 con 0x7fa29c06a270 2023-10-14T11:13:50.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.409+0000 7fa2a3dd9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c0cb090 con 0x7fa29c069e90 2023-10-14T11:13:50.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.409+0000 7fa2a2376640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa29c0c26b0 0x7fa29c0c2b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34666/0 (socket says 172.21.15.26:34666) 2023-10-14T11:13:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.409+0000 7fa2a2376640 1 -- 172.21.15.26:0/4200828855 learned_addr learned my addr 172.21.15.26:0/4200828855 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.409+0000 7fa2a1b75640 1 --2- 172.21.15.26:0/4200828855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa29c069e90 0x7fa29c06d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.409+0000 7fa2a0b73640 1 -- 172.21.15.26:0/4200828855 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947692864 0 0) 0x7fa29c15ae30 con 0x7fa29c0c26b0 2023-10-14T11:13:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.409+0000 7fa2a0b73640 1 -- 172.21.15.26:0/4200828855 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa288003530 con 0x7fa29c0c26b0 2023-10-14T11:13:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.409+0000 7fa2a0b73640 1 -- 172.21.15.26:0/4200828855 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215803021 0 0) 0x7fa29c0ca510 con 0x7fa29c06a270 2023-10-14T11:13:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.409+0000 7fa2a0b73640 1 -- 172.21.15.26:0/4200828855 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa29c15ae30 con 0x7fa29c06a270 2023-10-14T11:13:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.409+0000 7fa2a1b75640 1 -- 172.21.15.26:0/4200828855 >> v1:172.21.15.110:6789/0 conn(0x7fa29c06a270 legacy=0x7fa29c0c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:50.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.409+0000 7fa2a1b75640 1 -- 172.21.15.26:0/4200828855 >> v1:172.21.15.26:6789/0 conn(0x7fa29c0c26b0 legacy=0x7fa29c0c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:50.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.409+0000 7fa2a0b73640 1 -- 172.21.15.26:0/4200828855 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 517294151 0 0) 0x7fa288003530 con 0x7fa29c0c26b0 2023-10-14T11:13:50.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.409+0000 7fa2a1b75640 1 -- 172.21.15.26:0/4200828855 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c0ca7f0 con 0x7fa29c069e90 2023-10-14T11:13:50.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.413+0000 7fa2a1b75640 1 --2- 172.21.15.26:0/4200828855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa29c069e90 0x7fa29c06d010 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa2980097f0 tx=0x7fa29801c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0f2c0215e7f70e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:50.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.413+0000 7fa2a0b73640 1 -- 172.21.15.26:0/4200828855 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa294001a00 con 0x7fa29c069e90 2023-10-14T11:13:50.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.413+0000 7fa2a0b73640 1 -- 172.21.15.26:0/4200828855 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2980a7050 con 0x7fa29c069e90 2023-10-14T11:13:50.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.413+0000 7fa2a0b73640 1 -- 172.21.15.26:0/4200828855 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2980ab620 con 0x7fa29c069e90 2023-10-14T11:13:50.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.413+0000 7fa2a3dd9640 1 -- 172.21.15.26:0/4200828855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa29c069e90 msgr2=0x7fa29c06d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.413+0000 7fa2a3dd9640 1 --2- 172.21.15.26:0/4200828855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa29c069e90 0x7fa29c06d010 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa2980097f0 tx=0x7fa29801c3b0 comp rx=0 tx=0).stop 2023-10-14T11:13:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.413+0000 7fa2a3dd9640 1 -- 172.21.15.26:0/4200828855 shutdown_connections 2023-10-14T11:13:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.413+0000 7fa2a3dd9640 1 --2- 172.21.15.26:0/4200828855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa29c069e90 0x7fa29c06d010 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.413+0000 7fa2a3dd9640 1 -- 172.21.15.26:0/4200828855 >> 172.21.15.26:0/4200828855 conn(0x7fa29c0b0da0 msgr2=0x7fa29c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.413+0000 7fa2a3dd9640 1 -- 172.21.15.26:0/4200828855 shutdown_connections 2023-10-14T11:13:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.413+0000 7fa2a3dd9640 1 -- 172.21.15.26:0/4200828855 wait complete. 2023-10-14T11:13:50.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.413+0000 7fa2a3dd9640 1 Processor -- start 2023-10-14T11:13:50.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.413+0000 7fa2a3dd9640 1 -- start start 2023-10-14T11:13:50.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.413+0000 7fa2a3dd9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa29c069e90 0x7fa29c152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:50.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.413+0000 7fa2a3dd9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa29c06a270 0x7fa29c143af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:50.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.413+0000 7fa2a3dd9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa29c0c26b0 0x7fa29c0cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:50.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.413+0000 7fa2a3dd9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c144030 con 0x7fa29c0c26b0 2023-10-14T11:13:50.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.413+0000 7fa2a3dd9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c153510 con 0x7fa29c069e90 2023-10-14T11:13:50.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.417+0000 7fa2a3dd9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c1537f0 con 0x7fa29c06a270 2023-10-14T11:13:50.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.417+0000 7fa2a2376640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa29c0c26b0 0x7fa29c0cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:50.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.417+0000 7fa2a2376640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa29c0c26b0 0x7fa29c0cd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41542/0 (socket says 172.21.15.26:41542) 2023-10-14T11:13:50.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.417+0000 7fa2a2376640 1 -- 172.21.15.26:0/3105360642 learned_addr learned my addr 172.21.15.26:0/3105360642 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:50.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.417+0000 7fa2a1374640 1 --2- 172.21.15.26:0/3105360642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa29c06a270 0x7fa29c143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:50.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.417+0000 7fa2a1b75640 1 --2- 172.21.15.26:0/3105360642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa29c069e90 0x7fa29c152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:50.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.417+0000 7fa2a2376640 1 -- 172.21.15.26:0/3105360642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa29c06a270 msgr2=0x7fa29c143af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:50.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.417+0000 7fa2a2376640 1 --2- 172.21.15.26:0/3105360642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa29c06a270 0x7fa29c143af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:50.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.417+0000 7fa2a2376640 1 -- 172.21.15.26:0/3105360642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa29c069e90 msgr2=0x7fa29c152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:50.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.417+0000 7fa2a2376640 1 --2- 172.21.15.26:0/3105360642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa29c069e90 0x7fa29c152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:50.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.417+0000 7fa2a2376640 1 -- 172.21.15.26:0/3105360642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa298009420 con 0x7fa29c0c26b0 2023-10-14T11:13:50.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.417+0000 7fa2a1b75640 1 --2- 172.21.15.26:0/3105360642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa29c069e90 0x7fa29c152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:50.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.417+0000 7fa2a1374640 1 --2- 172.21.15.26:0/3105360642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa29c06a270 0x7fa29c143af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:50.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.417+0000 7fa2a2376640 1 --2- 172.21.15.26:0/3105360642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa29c0c26b0 0x7fa29c0cd100 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa29400cc60 tx=0x7fa29400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:50.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.417+0000 7fa2927fc640 1 -- 172.21.15.26:0/3105360642 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29400ce70 con 0x7fa29c0c26b0 2023-10-14T11:13:50.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.417+0000 7fa2927fc640 1 -- 172.21.15.26:0/3105360642 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa294012400 con 0x7fa29c0c26b0 2023-10-14T11:13:50.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.417+0000 7fa2a3dd9640 1 -- 172.21.15.26:0/3105360642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29c153ad0 con 0x7fa29c0c26b0 2023-10-14T11:13:50.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.417+0000 7fa2927fc640 1 -- 172.21.15.26:0/3105360642 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2940127b0 con 0x7fa29c0c26b0 2023-10-14T11:13:50.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.417+0000 7fa2a3dd9640 1 -- 172.21.15.26:0/3105360642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29c154090 con 0x7fa29c0c26b0 2023-10-14T11:13:50.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.417+0000 7fa2a3dd9640 1 -- 172.21.15.26:0/3105360642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29c1542b0 con 0x7fa29c0c26b0 2023-10-14T11:13:50.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.417+0000 7fa2927fc640 1 -- 172.21.15.26:0/3105360642 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa294012910 con 0x7fa29c0c26b0 2023-10-14T11:13:50.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.421+0000 7fa2927fc640 1 --2- 172.21.15.26:0/3105360642 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa2800664a0 0x7fa280068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:50.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.421+0000 7fa2927fc640 1 -- 172.21.15.26:0/3105360642 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5939+0+0 (secure 0 0 0) 0x7fa2940846c0 con 0x7fa29c0c26b0 2023-10-14T11:13:50.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.421+0000 7fa2a1b75640 1 --2- 172.21.15.26:0/3105360642 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa2800664a0 0x7fa280068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:50.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.421+0000 7fa2a1b75640 1 --2- 172.21.15.26:0/3105360642 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa2800664a0 0x7fa280068960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa2980ad000 tx=0x7fa2980a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:50.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.425+0000 7fa2927fc640 1 -- 172.21.15.26:0/3105360642 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa294051a40 con 0x7fa29c0c26b0 2023-10-14T11:13:50.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:50.617+0000 7fa2a3dd9640 1 -- 172.21.15.26:0/3105360642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"} v 0) v1 -- 0x7fa29c04e170 con 0x7fa29c0c26b0 2023-10-14T11:13:51.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.221+0000 7fa2927fc640 1 -- 172.21.15.26:0/3105360642 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 187+0+0 (secure 0 0 0) 0x7fa294055060 con 0x7fa29c0c26b0 2023-10-14T11:13:51.224 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 5 and data pool 6 2023-10-14T11:13:51.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.225+0000 7fa2a3dd9640 1 -- 172.21.15.26:0/3105360642 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa2800664a0 msgr2=0x7fa280068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:51.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.225+0000 7fa2a3dd9640 1 --2- 172.21.15.26:0/3105360642 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa2800664a0 0x7fa280068960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa2980ad000 tx=0x7fa2980a6000 comp rx=0 tx=0).stop 2023-10-14T11:13:51.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.225+0000 7fa2a3dd9640 1 -- 172.21.15.26:0/3105360642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa29c0c26b0 msgr2=0x7fa29c0cd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:51.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.225+0000 7fa2a3dd9640 1 --2- 172.21.15.26:0/3105360642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa29c0c26b0 0x7fa29c0cd100 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa29400cc60 tx=0x7fa29400a430 comp rx=0 tx=0).stop 2023-10-14T11:13:51.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.225+0000 7fa2a3dd9640 1 -- 172.21.15.26:0/3105360642 shutdown_connections 2023-10-14T11:13:51.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.225+0000 7fa2a3dd9640 1 --2- 172.21.15.26:0/3105360642 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa2800664a0 0x7fa280068960 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.225+0000 7fa2a3dd9640 1 --2- 172.21.15.26:0/3105360642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa29c0c26b0 0x7fa29c0cd100 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.225+0000 7fa2a3dd9640 1 --2- 172.21.15.26:0/3105360642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa29c06a270 0x7fa29c143af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.225+0000 7fa2a3dd9640 1 --2- 172.21.15.26:0/3105360642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa29c069e90 0x7fa29c152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.225+0000 7fa2a3dd9640 1 -- 172.21.15.26:0/3105360642 >> 172.21.15.26:0/3105360642 conn(0x7fa29c0b0da0 msgr2=0x7fa29c0ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:51.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.225+0000 7fa2a3dd9640 1 -- 172.21.15.26:0/3105360642 shutdown_connections 2023-10-14T11:13:51.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.225+0000 7fa2a3dd9640 1 -- 172.21.15.26:0/3105360642 wait complete. 2023-10-14T11:13:51.275 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:13:51.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.417+0000 7f7b3c3d9640 1 Processor -- start 2023-10-14T11:13:51.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.417+0000 7f7b3c3d9640 1 -- start start 2023-10-14T11:13:51.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.417+0000 7f7b3c3d9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7b3415cb90 0x7f7b340cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:51.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.417+0000 7f7b3c3d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b340d15d0 0x7f7b340c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:51.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.417+0000 7f7b3c3d9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b340ce770 con 0x7f7b340d3010 2023-10-14T11:13:51.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.417+0000 7f7b3c3d9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b340d0600 con 0x7f7b3415cb90 2023-10-14T11:13:51.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.417+0000 7f7b3c3d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340c6450 con 0x7f7b340d15d0 2023-10-14T11:13:51.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.417+0000 7f7b39974640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7b340d3010 0x7f7b340d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34682/0 (socket says 172.21.15.26:34682) 2023-10-14T11:13:51.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.417+0000 7f7b39974640 1 -- 172.21.15.26:0/2133204577 learned_addr learned my addr 172.21.15.26:0/2133204577 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:51.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.417+0000 7f7b3a175640 1 --2- 172.21.15.26:0/2133204577 >> v2:172.21.15.110:3300/0 conn(0x7f7b3415cb90 0x7f7b340cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:51.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.417+0000 7f7b3a976640 1 --2- 172.21.15.26:0/2133204577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b340d15d0 0x7f7b340c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:51.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.417+0000 7f7b39173640 1 -- 172.21.15.26:0/2133204577 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378608207 0 0) 0x7f7b340ce770 con 0x7f7b340d3010 2023-10-14T11:13:51.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.417+0000 7f7b39173640 1 -- 172.21.15.26:0/2133204577 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b20003530 con 0x7f7b340d3010 2023-10-14T11:13:51.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.417+0000 7f7b3a175640 1 -- 172.21.15.26:0/2133204577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b340d15d0 msgr2=0x7f7b340c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:51.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.417+0000 7f7b3a175640 1 --2- 172.21.15.26:0/2133204577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b340d15d0 0x7f7b340c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.417+0000 7f7b3a175640 1 -- 172.21.15.26:0/2133204577 >> v1:172.21.15.26:6789/0 conn(0x7f7b340d3010 legacy=0x7f7b340d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:51.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.417+0000 7f7b3a175640 1 -- 172.21.15.26:0/2133204577 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b340d08a0 con 0x7f7b3415cb90 2023-10-14T11:13:51.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.417+0000 7f7b3a976640 1 --2- 172.21.15.26:0/2133204577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b340d15d0 0x7f7b340c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:13:51.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.421+0000 7f7b3a175640 1 --2- 172.21.15.26:0/2133204577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b3415cb90 0x7f7b340cfb10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7b300097a0 tx=0x7f7b3001c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dce982655951573 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:51.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.421+0000 7f7b39173640 1 -- 172.21.15.26:0/2133204577 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300ac600 con 0x7f7b3415cb90 2023-10-14T11:13:51.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.421+0000 7f7b39173640 1 -- 172.21.15.26:0/2133204577 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b300a8050 con 0x7f7b3415cb90 2023-10-14T11:13:51.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.421+0000 7f7b39173640 1 -- 172.21.15.26:0/2133204577 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300ac980 con 0x7f7b3415cb90 2023-10-14T11:13:51.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.421+0000 7f7b3c3d9640 1 -- 172.21.15.26:0/2133204577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b3415cb90 msgr2=0x7f7b340cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:51.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.421+0000 7f7b3c3d9640 1 --2- 172.21.15.26:0/2133204577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b3415cb90 0x7f7b340cfb10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7b300097a0 tx=0x7f7b3001c3a0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.421+0000 7f7b3c3d9640 1 -- 172.21.15.26:0/2133204577 shutdown_connections 2023-10-14T11:13:51.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.421+0000 7f7b3c3d9640 1 --2- 172.21.15.26:0/2133204577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b340d15d0 0x7f7b340c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.421+0000 7f7b3c3d9640 1 --2- 172.21.15.26:0/2133204577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b3415cb90 0x7f7b340cfb10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.421+0000 7f7b3c3d9640 1 -- 172.21.15.26:0/2133204577 >> 172.21.15.26:0/2133204577 conn(0x7f7b3409bc50 msgr2=0x7f7b340d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:51.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.421+0000 7f7b3c3d9640 1 -- 172.21.15.26:0/2133204577 shutdown_connections 2023-10-14T11:13:51.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.421+0000 7f7b3c3d9640 1 -- 172.21.15.26:0/2133204577 wait complete. 2023-10-14T11:13:51.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.425+0000 7f7b3c3d9640 1 Processor -- start 2023-10-14T11:13:51.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.425+0000 7f7b3c3d9640 1 -- start start 2023-10-14T11:13:51.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.425+0000 7f7b3c3d9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b340d15d0 0x7f7b340cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:51.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.425+0000 7f7b3c3d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b340d3010 0x7f7b341478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:51.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.425+0000 7f7b3c3d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b3415cb90 0x7f7b3406ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:51.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.425+0000 7f7b3c3d9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340caa40 con 0x7f7b340d15d0 2023-10-14T11:13:51.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.425+0000 7f7b3c3d9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b34148450 con 0x7f7b3415cb90 2023-10-14T11:13:51.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.425+0000 7f7b3c3d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340ccd60 con 0x7f7b340d3010 2023-10-14T11:13:51.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.425+0000 7f7b3a175640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b340d15d0 0x7f7b340cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:51.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.425+0000 7f7b3a175640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b340d15d0 0x7f7b340cc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41548/0 (socket says 172.21.15.26:41548) 2023-10-14T11:13:51.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.425+0000 7f7b3a175640 1 -- 172.21.15.26:0/3007220199 learned_addr learned my addr 172.21.15.26:0/3007220199 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:51.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.425+0000 7f7b3a175640 1 -- 172.21.15.26:0/3007220199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b340d3010 msgr2=0x7f7b341478e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:51.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.425+0000 7f7b3a175640 1 --2- 172.21.15.26:0/3007220199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b340d3010 0x7f7b341478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.425+0000 7f7b3a175640 1 -- 172.21.15.26:0/3007220199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b3415cb90 msgr2=0x7f7b3406ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:51.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.425+0000 7f7b3a175640 1 --2- 172.21.15.26:0/3007220199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b3415cb90 0x7f7b3406ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.425+0000 7f7b3a175640 1 -- 172.21.15.26:0/3007220199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2c009a70 con 0x7f7b340d15d0 2023-10-14T11:13:51.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.425+0000 7f7b3a175640 1 --2- 172.21.15.26:0/3007220199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b340d15d0 0x7f7b340cc820 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7b30019fd0 tx=0x7f7b3001abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:51.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.425+0000 7f7b2affd640 1 -- 172.21.15.26:0/3007220199 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300b7420 con 0x7f7b340d15d0 2023-10-14T11:13:51.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.425+0000 7f7b2affd640 1 -- 172.21.15.26:0/3007220199 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b300b7580 con 0x7f7b340d15d0 2023-10-14T11:13:51.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.425+0000 7f7b3c3d9640 1 -- 172.21.15.26:0/3007220199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b300093b0 con 0x7f7b340d15d0 2023-10-14T11:13:51.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.425+0000 7f7b2affd640 1 -- 172.21.15.26:0/3007220199 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300b7910 con 0x7f7b340d15d0 2023-10-14T11:13:51.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.425+0000 7f7b3c3d9640 1 -- 172.21.15.26:0/3007220199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b340ca380 con 0x7f7b340d15d0 2023-10-14T11:13:51.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.429+0000 7f7b3c3d9640 1 -- 172.21.15.26:0/3007220199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b34074010 con 0x7f7b340d15d0 2023-10-14T11:13:51.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.429+0000 7f7b2affd640 1 -- 172.21.15.26:0/3007220199 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7b300b3040 con 0x7f7b340d15d0 2023-10-14T11:13:51.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.429+0000 7f7b2affd640 1 --2- 172.21.15.26:0/3007220199 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7b180664a0 0x7f7b18068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:51.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.429+0000 7f7b2affd640 1 -- 172.21.15.26:0/3007220199 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f7b3011e3e0 con 0x7f7b340d15d0 2023-10-14T11:13:51.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.429+0000 7f7b39974640 1 --2- 172.21.15.26:0/3007220199 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7b180664a0 0x7f7b18068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:51.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.429+0000 7f7b39974640 1 --2- 172.21.15.26:0/3007220199 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7b180664a0 0x7f7b18068960 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7b24007fd0 tx=0x7f7b24007940 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:51.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.433+0000 7f7b2affd640 1 -- 172.21.15.26:0/3007220199 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7b300eb660 con 0x7f7b340d15d0 2023-10-14T11:13:51.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.589+0000 7f7b3c3d9640 1 -- 172.21.15.26:0/3007220199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b3408c950 con 0x7f7b340d15d0 2023-10-14T11:13:51.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.593+0000 7f7b2affd640 1 -- 172.21.15.26:0/3007220199 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16807 (secure 0 0 0) 0x7f7b300eec80 con 0x7f7b340d15d0 2023-10-14T11:13:51.596 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:51.596 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":38,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:13:50.621765+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:13:48.453821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:13:49.623527+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:13:51.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.593+0000 7f7b3c3d9640 1 -- 172.21.15.26:0/3007220199 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7b180664a0 msgr2=0x7f7b18068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:51.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.593+0000 7f7b3c3d9640 1 --2- 172.21.15.26:0/3007220199 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7b180664a0 0x7f7b18068960 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7b24007fd0 tx=0x7f7b24007940 comp rx=0 tx=0).stop 2023-10-14T11:13:51.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.593+0000 7f7b3c3d9640 1 -- 172.21.15.26:0/3007220199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b340d15d0 msgr2=0x7f7b340cc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:51.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.593+0000 7f7b3c3d9640 1 --2- 172.21.15.26:0/3007220199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b340d15d0 0x7f7b340cc820 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7b30019fd0 tx=0x7f7b3001abe0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.593+0000 7f7b3c3d9640 1 -- 172.21.15.26:0/3007220199 shutdown_connections 2023-10-14T11:13:51.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.593+0000 7f7b3c3d9640 1 --2- 172.21.15.26:0/3007220199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b3415cb90 0x7f7b3406ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.593+0000 7f7b3c3d9640 1 --2- 172.21.15.26:0/3007220199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b340d3010 0x7f7b341478e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.593+0000 7f7b3c3d9640 1 --2- 172.21.15.26:0/3007220199 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7b180664a0 0x7f7b18068960 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.593+0000 7f7b3c3d9640 1 --2- 172.21.15.26:0/3007220199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b340d15d0 0x7f7b340cc820 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.593+0000 7f7b3c3d9640 1 -- 172.21.15.26:0/3007220199 >> 172.21.15.26:0/3007220199 conn(0x7f7b3409bc50 msgr2=0x7f7b340b7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:51.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.593+0000 7f7b3c3d9640 1 -- 172.21.15.26:0/3007220199 shutdown_connections 2023-10-14T11:13:51.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.593+0000 7f7b3c3d9640 1 -- 172.21.15.26:0/3007220199 wait complete. 2023-10-14T11:13:51.619 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:13:51.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.757+0000 7f792546b640 1 Processor -- start 2023-10-14T11:13:51.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.757+0000 7f792546b640 1 -- start start 2023-10-14T11:13:51.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.757+0000 7f792546b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7920070c40 0x7f792015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:51.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.757+0000 7f792546b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f79200b4020 0x7f79200b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:51.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.757+0000 7f792546b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f79200b0620 0x7f792015c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:51.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.757+0000 7f792546b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792015b3b0 con 0x7f79200b4020 2023-10-14T11:13:51.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.757+0000 7f792546b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79200b0a90 con 0x7f79200b0620 2023-10-14T11:13:51.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.757+0000 7f792546b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792015be60 con 0x7f7920070c40 2023-10-14T11:13:51.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.761+0000 7f7917fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f79200b4020 0x7f79200b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:51.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.761+0000 7f7917fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f79200b4020 0x7f79200b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41558/0 (socket says 172.21.15.26:41558) 2023-10-14T11:13:51.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.761+0000 7f7917fff640 1 -- 172.21.15.26:0/1276915509 learned_addr learned my addr 172.21.15.26:0/1276915509 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:51.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.761+0000 7f791effd640 1 --2- 172.21.15.26:0/1276915509 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7920070c40 0x7f792015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:51.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.761+0000 7f791f7fe640 1 --2- 172.21.15.26:0/1276915509 >> v2:172.21.15.110:3300/0 conn(0x7f79200b0620 0x7f792015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:51.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.761+0000 7f7917fff640 1 -- 172.21.15.26:0/1276915509 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7920070c40 msgr2=0x7f792015ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:51.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.761+0000 7f7917fff640 1 --2- 172.21.15.26:0/1276915509 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7920070c40 0x7f792015ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.761+0000 7f7917fff640 1 -- 172.21.15.26:0/1276915509 >> v2:172.21.15.110:3300/0 conn(0x7f79200b0620 msgr2=0x7f792015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:51.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.761+0000 7f7917fff640 1 --2- 172.21.15.26:0/1276915509 >> v2:172.21.15.110:3300/0 conn(0x7f79200b0620 0x7f792015c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.761+0000 7f7917fff640 1 -- 172.21.15.26:0/1276915509 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792015c1f0 con 0x7f79200b4020 2023-10-14T11:13:51.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.761+0000 7f7917fff640 1 --2- 172.21.15.26:0/1276915509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79200b4020 0x7f79200b00e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f79200b0e30 tx=0x7f790801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1b27d42f3c54f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:51.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.761+0000 7f791e7fc640 1 -- 172.21.15.26:0/1276915509 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79080a7070 con 0x7f79200b4020 2023-10-14T11:13:51.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.761+0000 7f791e7fc640 1 -- 172.21.15.26:0/1276915509 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79080ab430 con 0x7f79200b4020 2023-10-14T11:13:51.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.761+0000 7f791e7fc640 1 -- 172.21.15.26:0/1276915509 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79080ab7c0 con 0x7f79200b4020 2023-10-14T11:13:51.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f792546b640 1 -- 172.21.15.26:0/1276915509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79200b4020 msgr2=0x7f79200b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:51.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f792546b640 1 --2- 172.21.15.26:0/1276915509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79200b4020 0x7f79200b00e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f79200b0e30 tx=0x7f790801c470 comp rx=0 tx=0).stop 2023-10-14T11:13:51.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f792546b640 1 -- 172.21.15.26:0/1276915509 shutdown_connections 2023-10-14T11:13:51.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f792546b640 1 --2- 172.21.15.26:0/1276915509 >> v2:172.21.15.110:3300/0 conn(0x7f79200b0620 0x7f792015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f792546b640 1 --2- 172.21.15.26:0/1276915509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79200b4020 0x7f79200b00e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f792546b640 1 --2- 172.21.15.26:0/1276915509 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7920070c40 0x7f792015ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f792546b640 1 -- 172.21.15.26:0/1276915509 >> 172.21.15.26:0/1276915509 conn(0x7f792006c190 msgr2=0x7f792006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:51.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f792546b640 1 -- 172.21.15.26:0/1276915509 shutdown_connections 2023-10-14T11:13:51.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f792546b640 1 -- 172.21.15.26:0/1276915509 wait complete. 2023-10-14T11:13:51.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f792546b640 1 Processor -- start 2023-10-14T11:13:51.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f792546b640 1 -- start start 2023-10-14T11:13:51.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f792546b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7920070c40 0x7f79200c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:51.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f792546b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79200b0620 0x7f79201f4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:51.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f792546b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79200b4020 0x7f7920159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:51.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f792546b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79200c37e0 con 0x7f79200b0620 2023-10-14T11:13:51.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f792546b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79200b2d00 con 0x7f7920070c40 2023-10-14T11:13:51.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f792546b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79200c2c10 con 0x7f79200b4020 2023-10-14T11:13:51.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f7917fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79200b0620 0x7f79201f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:51.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f7917fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79200b0620 0x7f79201f4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41564/0 (socket says 172.21.15.26:41564) 2023-10-14T11:13:51.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f7917fff640 1 -- 172.21.15.26:0/2180351628 learned_addr learned my addr 172.21.15.26:0/2180351628 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:51.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f791f7fe640 1 --2- 172.21.15.26:0/2180351628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79200b4020 0x7f7920159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:51.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f791effd640 1 --2- 172.21.15.26:0/2180351628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7920070c40 0x7f79200c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:51.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f7917fff640 1 -- 172.21.15.26:0/2180351628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79200b4020 msgr2=0x7f7920159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:51.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f7917fff640 1 --2- 172.21.15.26:0/2180351628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79200b4020 0x7f7920159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f7917fff640 1 -- 172.21.15.26:0/2180351628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7920070c40 msgr2=0x7f79200c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:51.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f7917fff640 1 --2- 172.21.15.26:0/2180351628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7920070c40 0x7f79200c3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.765+0000 7f7917fff640 1 -- 172.21.15.26:0/2180351628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79080094d0 con 0x7f79200b0620 2023-10-14T11:13:51.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.769+0000 7f7917fff640 1 --2- 172.21.15.26:0/2180351628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79200b0620 0x7f79201f4990 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f79080ad040 tx=0x7f7908019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:51.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.769+0000 7f79177fe640 1 -- 172.21.15.26:0/2180351628 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79080b4620 con 0x7f79200b0620 2023-10-14T11:13:51.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.769+0000 7f79177fe640 1 -- 172.21.15.26:0/2180351628 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79080b47a0 con 0x7f79200b0620 2023-10-14T11:13:51.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.769+0000 7f79177fe640 1 -- 172.21.15.26:0/2180351628 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79080b4b50 con 0x7f79200b0620 2023-10-14T11:13:51.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.769+0000 7f792546b640 1 -- 172.21.15.26:0/2180351628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79200c2eb0 con 0x7f79200b0620 2023-10-14T11:13:51.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.769+0000 7f792546b640 1 -- 172.21.15.26:0/2180351628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79200c3470 con 0x7f79200b0620 2023-10-14T11:13:51.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.769+0000 7f792546b640 1 -- 172.21.15.26:0/2180351628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79200c3950 con 0x7f79200b0620 2023-10-14T11:13:51.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.769+0000 7f79177fe640 1 -- 172.21.15.26:0/2180351628 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f79080b4cb0 con 0x7f79200b0620 2023-10-14T11:13:51.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.769+0000 7f79177fe640 1 --2- 172.21.15.26:0/2180351628 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f79000664d0 0x7f7900068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:51.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.769+0000 7f79177fe640 1 -- 172.21.15.26:0/2180351628 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f790811e1f0 con 0x7f79200b0620 2023-10-14T11:13:51.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.773+0000 7f791effd640 1 --2- 172.21.15.26:0/2180351628 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f79000664d0 0x7f7900068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:51.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.773+0000 7f791effd640 1 --2- 172.21.15.26:0/2180351628 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f79000664d0 0x7f7900068990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7910009b60 tx=0x7f7910009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:51.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.773+0000 7f79177fe640 1 -- 172.21.15.26:0/2180351628 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f79080eb770 con 0x7f79200b0620 2023-10-14T11:13:51.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.937+0000 7f792546b640 1 -- 172.21.15.26:0/2180351628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f792015bb50 con 0x7f79200b0620 2023-10-14T11:13:51.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.941+0000 7f79177fe640 1 -- 172.21.15.26:0/2180351628 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16807 (secure 0 0 0) 0x7f79080eed90 con 0x7f79200b0620 2023-10-14T11:13:51.943 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:51.944 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":38,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:13:50.621765+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:13:48.453821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:13:49.623527+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:13:51.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.941+0000 7f792546b640 1 -- 172.21.15.26:0/2180351628 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f79000664d0 msgr2=0x7f7900068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:51.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.941+0000 7f792546b640 1 --2- 172.21.15.26:0/2180351628 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f79000664d0 0x7f7900068990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7910009b60 tx=0x7f7910009190 comp rx=0 tx=0).stop 2023-10-14T11:13:51.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.941+0000 7f792546b640 1 -- 172.21.15.26:0/2180351628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79200b0620 msgr2=0x7f79201f4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:51.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.941+0000 7f792546b640 1 --2- 172.21.15.26:0/2180351628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79200b0620 0x7f79201f4990 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f79080ad040 tx=0x7f7908019210 comp rx=0 tx=0).stop 2023-10-14T11:13:51.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.941+0000 7f792546b640 1 -- 172.21.15.26:0/2180351628 shutdown_connections 2023-10-14T11:13:51.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.941+0000 7f792546b640 1 --2- 172.21.15.26:0/2180351628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79200b4020 0x7f7920159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.941+0000 7f792546b640 1 --2- 172.21.15.26:0/2180351628 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f79000664d0 0x7f7900068990 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.941+0000 7f792546b640 1 --2- 172.21.15.26:0/2180351628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79200b0620 0x7f79201f4990 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.941+0000 7f792546b640 1 --2- 172.21.15.26:0/2180351628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7920070c40 0x7f79200c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:51.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.941+0000 7f792546b640 1 -- 172.21.15.26:0/2180351628 >> 172.21.15.26:0/2180351628 conn(0x7f792006c190 msgr2=0x7f79200afba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:51.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.941+0000 7f792546b640 1 -- 172.21.15.26:0/2180351628 shutdown_connections 2023-10-14T11:13:51.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:51.941+0000 7f792546b640 1 -- 172.21.15.26:0/2180351628 wait complete. 2023-10-14T11:13:51.966 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 standby_count_wanted 0 2023-10-14T11:13:52.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.109+0000 7fd707a17640 1 Processor -- start 2023-10-14T11:13:52.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.109+0000 7fd707a17640 1 -- start start 2023-10-14T11:13:52.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.109+0000 7fd707a17640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd70015cc60 0x7fd7000cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:52.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.109+0000 7fd707a17640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd700161260 0x7fd7000ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:52.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.109+0000 7fd707a17640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7000cc330 con 0x7fd7000cebd0 2023-10-14T11:13:52.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.109+0000 7fd707a17640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7000cefe0 con 0x7fd700161260 2023-10-14T11:13:52.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.109+0000 7fd707a17640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7000cb720 con 0x7fd70015cc60 2023-10-14T11:13:52.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.113+0000 7fd704fb2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd700161260 0x7fd7000ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:52.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.113+0000 7fd704fb2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd700161260 0x7fd7000ce690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41574/0 (socket says 172.21.15.26:41574) 2023-10-14T11:13:52.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.113+0000 7fd704fb2640 1 -- 172.21.15.26:0/513448993 learned_addr learned my addr 172.21.15.26:0/513448993 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:52.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.113+0000 7fd7057b3640 1 --2- 172.21.15.26:0/513448993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd70015cc60 0x7fd7000cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:52.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.113+0000 7fd704fb2640 1 -- 172.21.15.26:0/513448993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd70015cc60 msgr2=0x7fd7000cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:52.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.113+0000 7fd704fb2640 1 --2- 172.21.15.26:0/513448993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd70015cc60 0x7fd7000cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:52.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.113+0000 7fd704fb2640 1 -- 172.21.15.26:0/513448993 >> v1:172.21.15.110:6789/0 conn(0x7fd7000cebd0 legacy=0x7fd7000b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:52.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.113+0000 7fd704fb2640 1 -- 172.21.15.26:0/513448993 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7000cba00 con 0x7fd700161260 2023-10-14T11:13:52.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.113+0000 7fd704fb2640 1 --2- 172.21.15.26:0/513448993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd700161260 0x7fd7000ce690 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009870 tx=0x7fd6f001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e12613d191501f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:52.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.113+0000 7fd6f7fff640 1 -- 172.21.15.26:0/513448993 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f00aa670 con 0x7fd700161260 2023-10-14T11:13:52.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.113+0000 7fd6f7fff640 1 -- 172.21.15.26:0/513448993 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f00aa7d0 con 0x7fd700161260 2023-10-14T11:13:52.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.113+0000 7fd6f7fff640 1 -- 172.21.15.26:0/513448993 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f00aab60 con 0x7fd700161260 2023-10-14T11:13:52.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd707a17640 1 -- 172.21.15.26:0/513448993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd700161260 msgr2=0x7fd7000ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:52.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd707a17640 1 --2- 172.21.15.26:0/513448993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd700161260 0x7fd7000ce690 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009870 tx=0x7fd6f001c510 comp rx=0 tx=0).stop 2023-10-14T11:13:52.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd707a17640 1 -- 172.21.15.26:0/513448993 shutdown_connections 2023-10-14T11:13:52.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd707a17640 1 --2- 172.21.15.26:0/513448993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd700161260 0x7fd7000ce690 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:52.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd707a17640 1 --2- 172.21.15.26:0/513448993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd70015cc60 0x7fd7000cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:52.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd707a17640 1 -- 172.21.15.26:0/513448993 >> 172.21.15.26:0/513448993 conn(0x7fd70006e570 msgr2=0x7fd70006e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:52.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd707a17640 1 -- 172.21.15.26:0/513448993 shutdown_connections 2023-10-14T11:13:52.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd707a17640 1 -- 172.21.15.26:0/513448993 wait complete. 2023-10-14T11:13:52.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd707a17640 1 Processor -- start 2023-10-14T11:13:52.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd707a17640 1 -- start start 2023-10-14T11:13:52.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd707a17640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7000cebd0 0x7fd700155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:52.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd707a17640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd70015cc60 0x7fd7000b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:52.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd707a17640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd700161260 0x7fd7000b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:52.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd707a17640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7000c8ca0 con 0x7fd700161260 2023-10-14T11:13:52.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd707a17640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd700155c20 con 0x7fd70015cc60 2023-10-14T11:13:52.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd707a17640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7000c8ed0 con 0x7fd7000cebd0 2023-10-14T11:13:52.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd705fb4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd700161260 0x7fd7000b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:52.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd705fb4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd700161260 0x7fd7000b12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41584/0 (socket says 172.21.15.26:41584) 2023-10-14T11:13:52.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd705fb4640 1 -- 172.21.15.26:0/1345819684 learned_addr learned my addr 172.21.15.26:0/1345819684 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:52.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd7057b3640 1 --2- 172.21.15.26:0/1345819684 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7000cebd0 0x7fd700155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:52.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd704fb2640 1 --2- 172.21.15.26:0/1345819684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd70015cc60 0x7fd7000b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:52.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd705fb4640 1 -- 172.21.15.26:0/1345819684 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7000cebd0 msgr2=0x7fd700155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:52.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd705fb4640 1 --2- 172.21.15.26:0/1345819684 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7000cebd0 0x7fd700155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:52.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd705fb4640 1 -- 172.21.15.26:0/1345819684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd70015cc60 msgr2=0x7fd7000b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:52.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd705fb4640 1 --2- 172.21.15.26:0/1345819684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd70015cc60 0x7fd7000b0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:52.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.117+0000 7fd705fb4640 1 -- 172.21.15.26:0/1345819684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f00094d0 con 0x7fd700161260 2023-10-14T11:13:52.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.121+0000 7fd705fb4640 1 --2- 172.21.15.26:0/1345819684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd700161260 0x7fd7000b12c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800c770 tx=0x7fd6f800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:52.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.121+0000 7fd6f5ffb640 1 -- 172.21.15.26:0/1345819684 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8003b80 con 0x7fd700161260 2023-10-14T11:13:52.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.121+0000 7fd6f5ffb640 1 -- 172.21.15.26:0/1345819684 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f8003ce0 con 0x7fd700161260 2023-10-14T11:13:52.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.121+0000 7fd6f5ffb640 1 -- 172.21.15.26:0/1345819684 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f800aa90 con 0x7fd700161260 2023-10-14T11:13:52.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.121+0000 7fd707a17640 1 -- 172.21.15.26:0/1345819684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7000c9170 con 0x7fd700161260 2023-10-14T11:13:52.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.121+0000 7fd707a17640 1 -- 172.21.15.26:0/1345819684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7000c9730 con 0x7fd700161260 2023-10-14T11:13:52.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.121+0000 7fd707a17640 1 -- 172.21.15.26:0/1345819684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7000c9920 con 0x7fd700161260 2023-10-14T11:13:52.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.121+0000 7fd6f5ffb640 1 -- 172.21.15.26:0/1345819684 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd6f800abf0 con 0x7fd700161260 2023-10-14T11:13:52.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.121+0000 7fd6f5ffb640 1 --2- 172.21.15.26:0/1345819684 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd6e40664a0 0x7fd6e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.121+0000 7fd6f5ffb640 1 -- 172.21.15.26:0/1345819684 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fd6f8083cd0 con 0x7fd700161260 2023-10-14T11:13:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.121+0000 7fd7057b3640 1 --2- 172.21.15.26:0/1345819684 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd6e40664a0 0x7fd6e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.125+0000 7fd7057b3640 1 --2- 172.21.15.26:0/1345819684 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd6e40664a0 0x7fd6e4068960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc007a60 tx=0x7fd6fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.129+0000 7fd6f5ffb640 1 -- 172.21.15.26:0/1345819684 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd6f80510a0 con 0x7fd700161260 2023-10-14T11:13:52.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:52.321+0000 7fd707a17640 1 -- 172.21.15.26:0/1345819684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd70004e170 con 0x7fd700161260 2023-10-14T11:13:53.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.241+0000 7fd6f5ffb640 1 -- 172.21.15.26:0/1345819684 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7fd6f80546c0 con 0x7fd700161260 2023-10-14T11:13:53.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.245+0000 7fd707a17640 1 -- 172.21.15.26:0/1345819684 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd6e40664a0 msgr2=0x7fd6e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:53.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.245+0000 7fd707a17640 1 --2- 172.21.15.26:0/1345819684 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd6e40664a0 0x7fd6e4068960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc007a60 tx=0x7fd6fc008040 comp rx=0 tx=0).stop 2023-10-14T11:13:53.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.245+0000 7fd707a17640 1 -- 172.21.15.26:0/1345819684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd700161260 msgr2=0x7fd7000b12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:53.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.245+0000 7fd707a17640 1 --2- 172.21.15.26:0/1345819684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd700161260 0x7fd7000b12c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800c770 tx=0x7fd6f800cc30 comp rx=0 tx=0).stop 2023-10-14T11:13:53.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.245+0000 7fd707a17640 1 -- 172.21.15.26:0/1345819684 shutdown_connections 2023-10-14T11:13:53.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.245+0000 7fd707a17640 1 --2- 172.21.15.26:0/1345819684 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd6e40664a0 0x7fd6e4068960 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:53.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.245+0000 7fd707a17640 1 --2- 172.21.15.26:0/1345819684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd700161260 0x7fd7000b12c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:53.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.245+0000 7fd707a17640 1 --2- 172.21.15.26:0/1345819684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd70015cc60 0x7fd7000b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:53.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.245+0000 7fd707a17640 1 --2- 172.21.15.26:0/1345819684 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7000cebd0 0x7fd700155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:53.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.245+0000 7fd707a17640 1 -- 172.21.15.26:0/1345819684 >> 172.21.15.26:0/1345819684 conn(0x7fd70006e570 msgr2=0x7fd70015fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:53.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.245+0000 7fd707a17640 1 -- 172.21.15.26:0/1345819684 shutdown_connections 2023-10-14T11:13:53.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.245+0000 7fd707a17640 1 -- 172.21.15.26:0/1345819684 wait complete. 2023-10-14T11:13:53.274 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-14T11:13:53.275 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 allow_standby_replay false 2023-10-14T11:13:53.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.425+0000 7f9a878a9640 1 Processor -- start 2023-10-14T11:13:53.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.425+0000 7f9a878a9640 1 -- start start 2023-10-14T11:13:53.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.425+0000 7f9a878a9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a8006e260 0x7f9a800b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:53.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.425+0000 7f9a878a9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a800b4600 con 0x7f9a8006a5a0 2023-10-14T11:13:53.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.425+0000 7f9a878a9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a800c8dd0 con 0x7f9a80159900 2023-10-14T11:13:53.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.425+0000 7f9a878a9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a800cd740 con 0x7f9a8006e260 2023-10-14T11:13:53.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.425+0000 7f9a84e44640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9a8006a5a0 0x7f9a800c9b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59824/0 (socket says 172.21.15.26:59824) 2023-10-14T11:13:53.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.425+0000 7f9a84e44640 1 -- 172.21.15.26:0/1138770918 learned_addr learned my addr 172.21.15.26:0/1138770918 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:53.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.425+0000 7f9a85e46640 1 --2- 172.21.15.26:0/1138770918 >> v2:172.21.15.26:3300/0 conn(0x7f9a8006e260 0x7f9a800b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:53.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.425+0000 7f9a77fff640 1 -- 172.21.15.26:0/1138770918 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786207216 0 0) 0x7f9a800b4600 con 0x7f9a8006a5a0 2023-10-14T11:13:53.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.425+0000 7f9a77fff640 1 -- 172.21.15.26:0/1138770918 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a6c003530 con 0x7f9a8006a5a0 2023-10-14T11:13:53.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.425+0000 7f9a85e46640 1 -- 172.21.15.26:0/1138770918 >> v1:172.21.15.110:6789/0 conn(0x7f9a80159900 legacy=0x7f9a80069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:53.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.425+0000 7f9a77fff640 1 -- 172.21.15.26:0/1138770918 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591692071 0 0) 0x7f9a800c8dd0 con 0x7f9a80159900 2023-10-14T11:13:53.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.425+0000 7f9a85e46640 1 -- 172.21.15.26:0/1138770918 >> v1:172.21.15.26:6789/0 conn(0x7f9a8006a5a0 legacy=0x7f9a800c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:53.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.425+0000 7f9a85e46640 1 -- 172.21.15.26:0/1138770918 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a800c90b0 con 0x7f9a8006e260 2023-10-14T11:13:53.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.429+0000 7f9a85e46640 1 --2- 172.21.15.26:0/1138770918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8006e260 0x7f9a800b3f00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009d90 tx=0x7f9a7801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218ad9713f68535e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:53.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.429+0000 7f9a77fff640 1 -- 172.21.15.26:0/1138770918 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a780a5a10 con 0x7f9a8006e260 2023-10-14T11:13:53.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.429+0000 7f9a77fff640 1 -- 172.21.15.26:0/1138770918 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a780a5b70 con 0x7f9a8006e260 2023-10-14T11:13:53.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.429+0000 7f9a77fff640 1 -- 172.21.15.26:0/1138770918 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a780ad440 con 0x7f9a8006e260 2023-10-14T11:13:53.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.429+0000 7f9a878a9640 1 -- 172.21.15.26:0/1138770918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8006e260 msgr2=0x7f9a800b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:53.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.429+0000 7f9a878a9640 1 --2- 172.21.15.26:0/1138770918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8006e260 0x7f9a800b3f00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009d90 tx=0x7f9a7801c950 comp rx=0 tx=0).stop 2023-10-14T11:13:53.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.429+0000 7f9a878a9640 1 -- 172.21.15.26:0/1138770918 shutdown_connections 2023-10-14T11:13:53.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.429+0000 7f9a878a9640 1 --2- 172.21.15.26:0/1138770918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8006e260 0x7f9a800b3f00 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:53.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.429+0000 7f9a878a9640 1 -- 172.21.15.26:0/1138770918 >> 172.21.15.26:0/1138770918 conn(0x7f9a800b0da0 msgr2=0x7f9a800ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:53.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.429+0000 7f9a878a9640 1 -- 172.21.15.26:0/1138770918 shutdown_connections 2023-10-14T11:13:53.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.429+0000 7f9a878a9640 1 -- 172.21.15.26:0/1138770918 wait complete. 2023-10-14T11:13:53.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a878a9640 1 Processor -- start 2023-10-14T11:13:53.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a878a9640 1 -- start start 2023-10-14T11:13:53.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a878a9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8006a5a0 0x7f9a800c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:53.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a878a9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a8006e260 0x7f9a800b3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:53.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a878a9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a80159900 0x7f9a800b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:53.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a878a9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a80140a50 con 0x7f9a8006a5a0 2023-10-14T11:13:53.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a878a9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a801405c0 con 0x7f9a8006e260 2023-10-14T11:13:53.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a878a9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8013f9b0 con 0x7f9a80159900 2023-10-14T11:13:53.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a85645640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8006a5a0 0x7f9a800c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:53.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a85645640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8006a5a0 0x7f9a800c4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39196/0 (socket says 172.21.15.26:39196) 2023-10-14T11:13:53.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a85645640 1 -- 172.21.15.26:0/241562942 learned_addr learned my addr 172.21.15.26:0/241562942 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:53.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a85e46640 1 --2- 172.21.15.26:0/241562942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a80159900 0x7f9a800b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:53.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a85645640 1 -- 172.21.15.26:0/241562942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a80159900 msgr2=0x7f9a800b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:53.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a84e44640 1 --2- 172.21.15.26:0/241562942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a8006e260 0x7f9a800b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:53.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a85645640 1 --2- 172.21.15.26:0/241562942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a80159900 0x7f9a800b3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:53.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a85645640 1 -- 172.21.15.26:0/241562942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a8006e260 msgr2=0x7f9a800b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:53.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a85645640 1 --2- 172.21.15.26:0/241562942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a8006e260 0x7f9a800b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:53.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a85645640 1 -- 172.21.15.26:0/241562942 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a78009a70 con 0x7f9a8006a5a0 2023-10-14T11:13:53.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a85e46640 1 --2- 172.21.15.26:0/241562942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a80159900 0x7f9a800b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:53.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a84e44640 1 --2- 172.21.15.26:0/241562942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a8006e260 0x7f9a800b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:53.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a85645640 1 --2- 172.21.15.26:0/241562942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8006a5a0 0x7f9a800c4530 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c00c410 tx=0x7f9a7c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:53.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a75ffb640 1 -- 172.21.15.26:0/241562942 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c0054e0 con 0x7f9a8006a5a0 2023-10-14T11:13:53.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a75ffb640 1 -- 172.21.15.26:0/241562942 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7c003600 con 0x7f9a8006a5a0 2023-10-14T11:13:53.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a75ffb640 1 -- 172.21.15.26:0/241562942 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c0039b0 con 0x7f9a8006a5a0 2023-10-14T11:13:53.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a878a9640 1 -- 172.21.15.26:0/241562942 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a8013fc90 con 0x7f9a8006a5a0 2023-10-14T11:13:53.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.433+0000 7f9a878a9640 1 -- 172.21.15.26:0/241562942 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a80140250 con 0x7f9a8006a5a0 2023-10-14T11:13:53.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.437+0000 7f9a878a9640 1 -- 172.21.15.26:0/241562942 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a8004e170 con 0x7f9a8006a5a0 2023-10-14T11:13:53.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.437+0000 7f9a75ffb640 1 -- 172.21.15.26:0/241562942 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9a7c003b10 con 0x7f9a8006a5a0 2023-10-14T11:13:53.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.437+0000 7f9a75ffb640 1 --2- 172.21.15.26:0/241562942 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9a640664a0 0x7f9a64068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:53.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.437+0000 7f9a75ffb640 1 -- 172.21.15.26:0/241562942 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f9a7c0835b0 con 0x7f9a8006a5a0 2023-10-14T11:13:53.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.437+0000 7f9a84e44640 1 --2- 172.21.15.26:0/241562942 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9a640664a0 0x7f9a64068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:53.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.437+0000 7f9a84e44640 1 --2- 172.21.15.26:0/241562942 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9a640664a0 0x7f9a64068960 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9a800c5c90 tx=0x7f9a70009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:53.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.441+0000 7f9a75ffb640 1 -- 172.21.15.26:0/241562942 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9a7c054340 con 0x7f9a8006a5a0 2023-10-14T11:13:53.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:53.629+0000 7f9a878a9640 1 -- 172.21.15.26:0/241562942 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9a800afe10 con 0x7f9a8006a5a0 2023-10-14T11:13:54.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.253+0000 7f9a75ffb640 1 -- 172.21.15.26:0/241562942 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 127+0+0 (secure 0 0 0) 0x7f9a7c053ed0 con 0x7f9a8006a5a0 2023-10-14T11:13:54.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.257+0000 7f9a878a9640 1 -- 172.21.15.26:0/241562942 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9a640664a0 msgr2=0x7f9a64068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:54.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.257+0000 7f9a878a9640 1 --2- 172.21.15.26:0/241562942 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9a640664a0 0x7f9a64068960 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9a800c5c90 tx=0x7f9a70009040 comp rx=0 tx=0).stop 2023-10-14T11:13:54.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.257+0000 7f9a878a9640 1 -- 172.21.15.26:0/241562942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8006a5a0 msgr2=0x7f9a800c4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:54.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.257+0000 7f9a878a9640 1 --2- 172.21.15.26:0/241562942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8006a5a0 0x7f9a800c4530 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c00c410 tx=0x7f9a7c00c8d0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.257+0000 7f9a878a9640 1 -- 172.21.15.26:0/241562942 shutdown_connections 2023-10-14T11:13:54.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.257+0000 7f9a878a9640 1 --2- 172.21.15.26:0/241562942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a80159900 0x7f9a800b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.257+0000 7f9a878a9640 1 --2- 172.21.15.26:0/241562942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a8006e260 0x7f9a800b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.257+0000 7f9a878a9640 1 --2- 172.21.15.26:0/241562942 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f9a640664a0 0x7f9a64068960 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.257+0000 7f9a878a9640 1 --2- 172.21.15.26:0/241562942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8006a5a0 0x7f9a800c4530 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.257+0000 7f9a878a9640 1 -- 172.21.15.26:0/241562942 >> 172.21.15.26:0/241562942 conn(0x7f9a800b0da0 msgr2=0x7f9a80158cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:54.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.257+0000 7f9a878a9640 1 -- 172.21.15.26:0/241562942 shutdown_connections 2023-10-14T11:13:54.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.257+0000 7f9a878a9640 1 -- 172.21.15.26:0/241562942 wait complete. 2023-10-14T11:13:54.284 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'testcephfs1' 2023-10-14T11:13:54.285 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:13:54.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.429+0000 7f3eafed6640 1 Processor -- start 2023-10-14T11:13:54.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.429+0000 7f3eafed6640 1 -- start start 2023-10-14T11:13:54.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.429+0000 7f3eafed6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ea80b21c0 0x7f3ea80b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:54.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.429+0000 7f3eafed6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea81607e0 con 0x7f3ea815ca50 2023-10-14T11:13:54.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.429+0000 7f3eafed6640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea80cf060 con 0x7f3ea815ce30 2023-10-14T11:13:54.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.429+0000 7f3eafed6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea80cb4a0 con 0x7f3ea80b21c0 2023-10-14T11:13:54.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.429+0000 7f3eadc72640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3ea815ca50 0x7f3ea806c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59838/0 (socket says 172.21.15.26:59838) 2023-10-14T11:13:54.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.429+0000 7f3eadc72640 1 -- 172.21.15.26:0/80289527 learned_addr learned my addr 172.21.15.26:0/80289527 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:54.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.429+0000 7f3eae473640 1 --2- 172.21.15.26:0/80289527 >> v2:172.21.15.26:3300/0 conn(0x7f3ea80b21c0 0x7f3ea80b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:54.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.429+0000 7f3eacc70640 1 -- 172.21.15.26:0/80289527 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496427656 0 0) 0x7f3ea81607e0 con 0x7f3ea815ca50 2023-10-14T11:13:54.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.429+0000 7f3eacc70640 1 -- 172.21.15.26:0/80289527 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e94003530 con 0x7f3ea815ca50 2023-10-14T11:13:54.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.429+0000 7f3eae473640 1 -- 172.21.15.26:0/80289527 >> v1:172.21.15.110:6789/0 conn(0x7f3ea815ce30 legacy=0x7f3ea80cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:54.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.429+0000 7f3eae473640 1 -- 172.21.15.26:0/80289527 >> v1:172.21.15.26:6789/0 conn(0x7f3ea815ca50 legacy=0x7f3ea806c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:54.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.429+0000 7f3eae473640 1 -- 172.21.15.26:0/80289527 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea80b2ae0 con 0x7f3ea80b21c0 2023-10-14T11:13:54.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.433+0000 7f3eae473640 1 --2- 172.21.15.26:0/80289527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ea80b21c0 0x7f3ea80b25a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009d90 tx=0x7f3ea001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfc00e27f4e8628 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:54.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.433+0000 7f3eacc70640 1 -- 172.21.15.26:0/80289527 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea00a5a10 con 0x7f3ea80b21c0 2023-10-14T11:13:54.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.433+0000 7f3eacc70640 1 -- 172.21.15.26:0/80289527 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea00a5b70 con 0x7f3ea80b21c0 2023-10-14T11:13:54.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.433+0000 7f3eacc70640 1 -- 172.21.15.26:0/80289527 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea00ad440 con 0x7f3ea80b21c0 2023-10-14T11:13:54.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.433+0000 7f3eafed6640 1 -- 172.21.15.26:0/80289527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ea80b21c0 msgr2=0x7f3ea80b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:54.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.433+0000 7f3eafed6640 1 --2- 172.21.15.26:0/80289527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ea80b21c0 0x7f3ea80b25a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009d90 tx=0x7f3ea001c950 comp rx=0 tx=0).stop 2023-10-14T11:13:54.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.433+0000 7f3eafed6640 1 -- 172.21.15.26:0/80289527 shutdown_connections 2023-10-14T11:13:54.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.433+0000 7f3eafed6640 1 --2- 172.21.15.26:0/80289527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ea80b21c0 0x7f3ea80b25a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.433+0000 7f3eafed6640 1 -- 172.21.15.26:0/80289527 >> 172.21.15.26:0/80289527 conn(0x7f3ea80cd1c0 msgr2=0x7f3ea80cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:54.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.433+0000 7f3eafed6640 1 -- 172.21.15.26:0/80289527 shutdown_connections 2023-10-14T11:13:54.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.433+0000 7f3eafed6640 1 -- 172.21.15.26:0/80289527 wait complete. 2023-10-14T11:13:54.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3eafed6640 1 Processor -- start 2023-10-14T11:13:54.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3eafed6640 1 -- start start 2023-10-14T11:13:54.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3eafed6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ea80b21c0 0x7f3ea81539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:54.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3eafed6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ea815ca50 0x7f3ea80b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:54.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3eafed6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ea815ce30 0x7f3ea80ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:54.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3eafed6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea80b4d10 con 0x7f3ea815ce30 2023-10-14T11:13:54.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3eafed6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea8153f00 con 0x7f3ea815ca50 2023-10-14T11:13:54.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3eafed6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea80b4100 con 0x7f3ea80b21c0 2023-10-14T11:13:54.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3eae473640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ea815ce30 0x7f3ea80ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:54.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3eae473640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ea815ce30 0x7f3ea80ca820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39212/0 (socket says 172.21.15.26:39212) 2023-10-14T11:13:54.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3eae473640 1 -- 172.21.15.26:0/251843838 learned_addr learned my addr 172.21.15.26:0/251843838 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:54.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3eadc72640 1 --2- 172.21.15.26:0/251843838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ea80b21c0 0x7f3ea81539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:54.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3ead471640 1 --2- 172.21.15.26:0/251843838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ea815ca50 0x7f3ea80b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:54.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3eae473640 1 -- 172.21.15.26:0/251843838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ea80b21c0 msgr2=0x7f3ea81539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:54.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3eae473640 1 --2- 172.21.15.26:0/251843838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ea80b21c0 0x7f3ea81539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3eae473640 1 -- 172.21.15.26:0/251843838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ea815ca50 msgr2=0x7f3ea80b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:54.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3eae473640 1 --2- 172.21.15.26:0/251843838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ea815ca50 0x7f3ea80b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3eae473640 1 -- 172.21.15.26:0/251843838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea0009a70 con 0x7f3ea815ce30 2023-10-14T11:13:54.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3ead471640 1 --2- 172.21.15.26:0/251843838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ea815ca50 0x7f3ea80b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:54.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3eae473640 1 --2- 172.21.15.26:0/251843838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ea815ce30 0x7f3ea80ca820 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009d90 tx=0x7f3ea00196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:54.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3e9e7fc640 1 -- 172.21.15.26:0/251843838 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea00add90 con 0x7f3ea815ce30 2023-10-14T11:13:54.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3e9e7fc640 1 -- 172.21.15.26:0/251843838 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea0009450 con 0x7f3ea815ce30 2023-10-14T11:13:54.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3eafed6640 1 -- 172.21.15.26:0/251843838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea80b43e0 con 0x7f3ea815ce30 2023-10-14T11:13:54.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3e9e7fc640 1 -- 172.21.15.26:0/251843838 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea00b9690 con 0x7f3ea815ce30 2023-10-14T11:13:54.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.437+0000 7f3eafed6640 1 -- 172.21.15.26:0/251843838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea80b49a0 con 0x7f3ea815ce30 2023-10-14T11:13:54.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.441+0000 7f3eafed6640 1 -- 172.21.15.26:0/251843838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea80b4ec0 con 0x7f3ea815ce30 2023-10-14T11:13:54.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.441+0000 7f3e9e7fc640 1 -- 172.21.15.26:0/251843838 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3ea00b97f0 con 0x7f3ea815ce30 2023-10-14T11:13:54.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.441+0000 7f3e9e7fc640 1 --2- 172.21.15.26:0/251843838 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3e8c0664d0 0x7f3e8c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:54.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.441+0000 7f3e9e7fc640 1 -- 172.21.15.26:0/251843838 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f3ea011f690 con 0x7f3ea815ce30 2023-10-14T11:13:54.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.441+0000 7f3eadc72640 1 --2- 172.21.15.26:0/251843838 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3e8c0664d0 0x7f3e8c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:54.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.441+0000 7f3eadc72640 1 --2- 172.21.15.26:0/251843838 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3e8c0664d0 0x7f3e8c068990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3ea40011f0 tx=0x7f3ea4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:54.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.445+0000 7f3e9e7fc640 1 -- 172.21.15.26:0/251843838 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3ea80b4ec0 con 0x7f3ea815ce30 2023-10-14T11:13:54.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.633+0000 7f3eafed6640 1 -- 172.21.15.26:0/251843838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ea80b4ec0 con 0x7f3ea815ce30 2023-10-14T11:13:54.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.633+0000 7f3e9e7fc640 1 -- 172.21.15.26:0/251843838 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f3ea80b4ec0 con 0x7f3ea815ce30 2023-10-14T11:13:54.639 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:54.639 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5425,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/1669994220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1669994220},{"type":"v1","addr":"172.21.15.110:6834","nonce":1669994220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3054425791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3054425791},{"type":"v1","addr":"172.21.15.110:6835","nonce":3054425791}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5434,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3759640340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3759640340},{"type":"v1","addr":"172.21.15.26:6837","nonce":3759640340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:13:50.622103+0000","modified":"2023-10-14T11:13:53.633604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5493":{"gid":5493,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/812681761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":812681761},{"type":"v1","addr":"172.21.15.26:6835","nonce":812681761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T11:13:54.640 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 17 2023-10-14T11:13:54.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.637+0000 7f3eafed6640 1 -- 172.21.15.26:0/251843838 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3e8c0664d0 msgr2=0x7f3e8c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:54.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.637+0000 7f3eafed6640 1 --2- 172.21.15.26:0/251843838 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3e8c0664d0 0x7f3e8c068990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3ea40011f0 tx=0x7f3ea4009040 comp rx=0 tx=0).stop 2023-10-14T11:13:54.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.637+0000 7f3eafed6640 1 -- 172.21.15.26:0/251843838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ea815ce30 msgr2=0x7f3ea80ca820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:54.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.637+0000 7f3eafed6640 1 --2- 172.21.15.26:0/251843838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ea815ce30 0x7f3ea80ca820 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009d90 tx=0x7f3ea00196f0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.637+0000 7f3eafed6640 1 -- 172.21.15.26:0/251843838 shutdown_connections 2023-10-14T11:13:54.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.637+0000 7f3eafed6640 1 --2- 172.21.15.26:0/251843838 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3e8c0664d0 0x7f3e8c068990 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.637+0000 7f3eafed6640 1 --2- 172.21.15.26:0/251843838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ea815ce30 0x7f3ea80ca820 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.637+0000 7f3eafed6640 1 --2- 172.21.15.26:0/251843838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ea815ca50 0x7f3ea80b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.637+0000 7f3eafed6640 1 --2- 172.21.15.26:0/251843838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ea80b21c0 0x7f3ea81539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.637+0000 7f3eafed6640 1 -- 172.21.15.26:0/251843838 >> 172.21.15.26:0/251843838 conn(0x7f3ea80cd1c0 msgr2=0x7f3ea806c860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:54.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.637+0000 7f3eafed6640 1 -- 172.21.15.26:0/251843838 shutdown_connections 2023-10-14T11:13:54.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.637+0000 7f3eafed6640 1 -- 172.21.15.26:0/251843838 wait complete. 2023-10-14T11:13:54.660 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:13:54.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.797+0000 7f554793e640 1 Processor -- start 2023-10-14T11:13:54.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.801+0000 7f554793e640 1 -- start start 2023-10-14T11:13:54.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.801+0000 7f554793e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55400b2ad0 0x7f554006b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:54.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.801+0000 7f554793e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f554015cf90 0x7f554006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:54.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.801+0000 7f554793e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f55400ce310 0x7f55400ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:54.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.801+0000 7f554793e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55400cece0 con 0x7f554015cf90 2023-10-14T11:13:54.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.801+0000 7f554793e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5540160580 con 0x7f55400ce310 2023-10-14T11:13:54.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.801+0000 7f554793e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554015d4e0 con 0x7f55400b2ad0 2023-10-14T11:13:54.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.801+0000 7f5544ed9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f554015cf90 0x7f554006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:54.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.801+0000 7f5544ed9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f554015cf90 0x7f554006c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39216/0 (socket says 172.21.15.26:39216) 2023-10-14T11:13:54.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.801+0000 7f5544ed9640 1 -- 172.21.15.26:0/1107526240 learned_addr learned my addr 172.21.15.26:0/1107526240 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:54.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.801+0000 7f55456da640 1 --2- 172.21.15.26:0/1107526240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55400b2ad0 0x7f554006b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:54.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.801+0000 7f5545edb640 1 --2- 172.21.15.26:0/1107526240 >> v2:172.21.15.110:3300/0 conn(0x7f55400ce310 0x7f55400ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:54.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.801+0000 7f5544ed9640 1 -- 172.21.15.26:0/1107526240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55400b2ad0 msgr2=0x7f554006b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:54.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.801+0000 7f5544ed9640 1 --2- 172.21.15.26:0/1107526240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55400b2ad0 0x7f554006b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.801+0000 7f5544ed9640 1 -- 172.21.15.26:0/1107526240 >> v2:172.21.15.110:3300/0 conn(0x7f55400ce310 msgr2=0x7f55400ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:54.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.801+0000 7f5544ed9640 1 --2- 172.21.15.26:0/1107526240 >> v2:172.21.15.110:3300/0 conn(0x7f55400ce310 0x7f55400ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.801+0000 7f5544ed9640 1 -- 172.21.15.26:0/1107526240 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554015d7c0 con 0x7f554015cf90 2023-10-14T11:13:54.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.801+0000 7f55456da640 1 --2- 172.21.15.26:0/1107526240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55400b2ad0 0x7f554006b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:54.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.801+0000 7f5545edb640 1 --2- 172.21.15.26:0/1107526240 >> v2:172.21.15.110:3300/0 conn(0x7f55400ce310 0x7f55400ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:54.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.805+0000 7f5544ed9640 1 --2- 172.21.15.26:0/1107526240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f554015cf90 0x7f554006c8f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f554006c620 tx=0x7f553001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bafae0b26d8f259 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:54.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.805+0000 7f5537fff640 1 -- 172.21.15.26:0/1107526240 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55300aa5f0 con 0x7f554015cf90 2023-10-14T11:13:54.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.805+0000 7f5537fff640 1 -- 172.21.15.26:0/1107526240 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55300aa750 con 0x7f554015cf90 2023-10-14T11:13:54.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.805+0000 7f5537fff640 1 -- 172.21.15.26:0/1107526240 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55300aaae0 con 0x7f554015cf90 2023-10-14T11:13:54.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.805+0000 7f554793e640 1 -- 172.21.15.26:0/1107526240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f554015cf90 msgr2=0x7f554006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:54.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.805+0000 7f554793e640 1 --2- 172.21.15.26:0/1107526240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f554015cf90 0x7f554006c8f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f554006c620 tx=0x7f553001c4d0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.805+0000 7f554793e640 1 -- 172.21.15.26:0/1107526240 shutdown_connections 2023-10-14T11:13:54.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.805+0000 7f554793e640 1 --2- 172.21.15.26:0/1107526240 >> v2:172.21.15.110:3300/0 conn(0x7f55400ce310 0x7f55400ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.805+0000 7f554793e640 1 --2- 172.21.15.26:0/1107526240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f554015cf90 0x7f554006c8f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.805+0000 7f554793e640 1 --2- 172.21.15.26:0/1107526240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55400b2ad0 0x7f554006b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.805+0000 7f554793e640 1 -- 172.21.15.26:0/1107526240 >> 172.21.15.26:0/1107526240 conn(0x7f55400cd1c0 msgr2=0x7f55400cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:54.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.805+0000 7f554793e640 1 -- 172.21.15.26:0/1107526240 shutdown_connections 2023-10-14T11:13:54.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.805+0000 7f554793e640 1 -- 172.21.15.26:0/1107526240 wait complete. 2023-10-14T11:13:54.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.805+0000 7f554793e640 1 Processor -- start 2023-10-14T11:13:54.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.805+0000 7f554793e640 1 -- start start 2023-10-14T11:13:54.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f554793e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55400b2ad0 0x7f55400b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:54.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f554793e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55400ce310 0x7f55400b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:54.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f554793e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f554015cf90 0x7f55400b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:54.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f554793e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5540153ef0 con 0x7f554015cf90 2023-10-14T11:13:54.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f554793e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55401541d0 con 0x7f55400ce310 2023-10-14T11:13:54.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f554793e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55401544b0 con 0x7f55400b2ad0 2023-10-14T11:13:54.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f5545edb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f554015cf90 0x7f55400b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:54.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f5545edb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f554015cf90 0x7f55400b59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39220/0 (socket says 172.21.15.26:39220) 2023-10-14T11:13:54.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f5545edb640 1 -- 172.21.15.26:0/1795681130 learned_addr learned my addr 172.21.15.26:0/1795681130 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:54.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f5544ed9640 1 --2- 172.21.15.26:0/1795681130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55400ce310 0x7f55400b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:54.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f5545edb640 1 -- 172.21.15.26:0/1795681130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55400b2ad0 msgr2=0x7f55400b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:54.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f55456da640 1 --2- 172.21.15.26:0/1795681130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55400b2ad0 0x7f55400b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:54.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f5545edb640 1 --2- 172.21.15.26:0/1795681130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55400b2ad0 0x7f55400b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f5545edb640 1 -- 172.21.15.26:0/1795681130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55400ce310 msgr2=0x7f55400b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:54.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f5545edb640 1 --2- 172.21.15.26:0/1795681130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55400ce310 0x7f55400b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f5545edb640 1 -- 172.21.15.26:0/1795681130 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55300094d0 con 0x7f554015cf90 2023-10-14T11:13:54.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f5544ed9640 1 --2- 172.21.15.26:0/1795681130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55400ce310 0x7f55400b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:54.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f55456da640 1 --2- 172.21.15.26:0/1795681130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55400b2ad0 0x7f55400b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:54.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f5545edb640 1 --2- 172.21.15.26:0/1795681130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f554015cf90 0x7f55400b59b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5538007e70 tx=0x7f553800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:54.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f5535ffb640 1 -- 172.21.15.26:0/1795681130 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5538003ba0 con 0x7f554015cf90 2023-10-14T11:13:54.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f5535ffb640 1 -- 172.21.15.26:0/1795681130 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553800f040 con 0x7f554015cf90 2023-10-14T11:13:54.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f5535ffb640 1 -- 172.21.15.26:0/1795681130 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553800de80 con 0x7f554015cf90 2023-10-14T11:13:54.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f554793e640 1 -- 172.21.15.26:0/1795681130 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5540154790 con 0x7f554015cf90 2023-10-14T11:13:54.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f554793e640 1 -- 172.21.15.26:0/1795681130 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55400b37d0 con 0x7f554015cf90 2023-10-14T11:13:54.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f554793e640 1 -- 172.21.15.26:0/1795681130 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5540154cb0 con 0x7f554015cf90 2023-10-14T11:13:54.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.809+0000 7f5535ffb640 1 -- 172.21.15.26:0/1795681130 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5538004030 con 0x7f554015cf90 2023-10-14T11:13:54.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.813+0000 7f5535ffb640 1 --2- 172.21.15.26:0/1795681130 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f55240664a0 0x7f5524068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:54.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.813+0000 7f5535ffb640 1 -- 172.21.15.26:0/1795681130 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f55380843a0 con 0x7f554015cf90 2023-10-14T11:13:54.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.813+0000 7f55456da640 1 --2- 172.21.15.26:0/1795681130 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f55240664a0 0x7f5524068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:54.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.813+0000 7f55456da640 1 --2- 172.21.15.26:0/1795681130 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f55240664a0 0x7f5524068960 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f553c009720 tx=0x7f553c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:54.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.817+0000 7f5535ffb640 1 -- 172.21.15.26:0/1795681130 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5540154cb0 con 0x7f554015cf90 2023-10-14T11:13:54.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.973+0000 7f554793e640 1 -- 172.21.15.26:0/1795681130 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5540154cb0 con 0x7f554015cf90 2023-10-14T11:13:54.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.977+0000 7f5535ffb640 1 -- 172.21.15.26:0/1795681130 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16794 (secure 0 0 0) 0x7f5540154cb0 con 0x7f554015cf90 2023-10-14T11:13:54.979 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:54.979 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":39,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:13:52.237054+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:13:48.453821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:13:49.623527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:13:54.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.977+0000 7f554793e640 1 -- 172.21.15.26:0/1795681130 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f55240664a0 msgr2=0x7f5524068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:54.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.977+0000 7f554793e640 1 --2- 172.21.15.26:0/1795681130 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f55240664a0 0x7f5524068960 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f553c009720 tx=0x7f553c008040 comp rx=0 tx=0).stop 2023-10-14T11:13:54.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.977+0000 7f554793e640 1 -- 172.21.15.26:0/1795681130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f554015cf90 msgr2=0x7f55400b59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:54.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.977+0000 7f554793e640 1 --2- 172.21.15.26:0/1795681130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f554015cf90 0x7f55400b59b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5538007e70 tx=0x7f553800d4a0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.977+0000 7f554793e640 1 -- 172.21.15.26:0/1795681130 shutdown_connections 2023-10-14T11:13:54.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.977+0000 7f554793e640 1 --2- 172.21.15.26:0/1795681130 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f55240664a0 0x7f5524068960 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.977+0000 7f554793e640 1 --2- 172.21.15.26:0/1795681130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f554015cf90 0x7f55400b59b0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.977+0000 7f554793e640 1 --2- 172.21.15.26:0/1795681130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55400ce310 0x7f55400b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.977+0000 7f554793e640 1 --2- 172.21.15.26:0/1795681130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55400b2ad0 0x7f55400b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:54.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.977+0000 7f554793e640 1 -- 172.21.15.26:0/1795681130 >> 172.21.15.26:0/1795681130 conn(0x7f55400cd1c0 msgr2=0x7f554015c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:54.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.977+0000 7f554793e640 1 -- 172.21.15.26:0/1795681130 shutdown_connections 2023-10-14T11:13:54.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:54.977+0000 7f554793e640 1 -- 172.21.15.26:0/1795681130 wait complete. 2023-10-14T11:13:55.000 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T11:13:55.001 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:13:55.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.141+0000 7f0b05101640 1 Processor -- start 2023-10-14T11:13:55.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.141+0000 7f0b05101640 1 -- start start 2023-10-14T11:13:55.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.141+0000 7f0b05101640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b0015cb90 0x7f0b000cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:55.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.141+0000 7f0b05101640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0b000d3010 0x7f0b000d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:55.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.141+0000 7f0b05101640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b000ce770 con 0x7f0b000d1400 2023-10-14T11:13:55.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.141+0000 7f0b05101640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b000d1890 con 0x7f0b000d3010 2023-10-14T11:13:55.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.141+0000 7f0b05101640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000d0600 con 0x7f0b0015cb90 2023-10-14T11:13:55.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.141+0000 7f0af7fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0b000d3010 0x7f0b000d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:55.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.141+0000 7f0af7fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0b000d3010 0x7f0b000d0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39222/0 (socket says 172.21.15.26:39222) 2023-10-14T11:13:55.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.141+0000 7f0af7fff640 1 -- 172.21.15.26:0/517798413 learned_addr learned my addr 172.21.15.26:0/517798413 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:55.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.141+0000 7f0afed9d640 1 --2- 172.21.15.26:0/517798413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b0015cb90 0x7f0b000cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:55.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.141+0000 7f0af7fff640 1 -- 172.21.15.26:0/517798413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b0015cb90 msgr2=0x7f0b000cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:55.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.141+0000 7f0af7fff640 1 --2- 172.21.15.26:0/517798413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b0015cb90 0x7f0b000cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.141+0000 7f0af7fff640 1 -- 172.21.15.26:0/517798413 >> v1:172.21.15.110:6789/0 conn(0x7f0b000d1400 legacy=0x7f0b000cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:55.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.141+0000 7f0af7fff640 1 -- 172.21.15.26:0/517798413 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b000c6450 con 0x7f0b000d3010 2023-10-14T11:13:55.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.145+0000 7f0af7fff640 1 --2- 172.21.15.26:0/517798413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b000d3010 0x7f0b000d0ec0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8009870 tx=0x7f0ae801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e9a85c64b3b419 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:55.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.145+0000 7f0afe59c640 1 -- 172.21.15.26:0/517798413 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae80ab600 con 0x7f0b000d3010 2023-10-14T11:13:55.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.145+0000 7f0afe59c640 1 -- 172.21.15.26:0/517798413 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae80ab760 con 0x7f0b000d3010 2023-10-14T11:13:55.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.145+0000 7f0afe59c640 1 -- 172.21.15.26:0/517798413 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae80abaf0 con 0x7f0b000d3010 2023-10-14T11:13:55.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.145+0000 7f0b05101640 1 -- 172.21.15.26:0/517798413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b000d3010 msgr2=0x7f0b000d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:55.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.145+0000 7f0b05101640 1 --2- 172.21.15.26:0/517798413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b000d3010 0x7f0b000d0ec0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8009870 tx=0x7f0ae801c440 comp rx=0 tx=0).stop 2023-10-14T11:13:55.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.145+0000 7f0b05101640 1 -- 172.21.15.26:0/517798413 shutdown_connections 2023-10-14T11:13:55.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.145+0000 7f0b05101640 1 --2- 172.21.15.26:0/517798413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b000d3010 0x7f0b000d0ec0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.145+0000 7f0b05101640 1 --2- 172.21.15.26:0/517798413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b0015cb90 0x7f0b000cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.145+0000 7f0b05101640 1 -- 172.21.15.26:0/517798413 >> 172.21.15.26:0/517798413 conn(0x7f0b0009bc50 msgr2=0x7f0b000d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:55.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.145+0000 7f0b05101640 1 -- 172.21.15.26:0/517798413 shutdown_connections 2023-10-14T11:13:55.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.145+0000 7f0b05101640 1 -- 172.21.15.26:0/517798413 wait complete. 2023-10-14T11:13:55.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0b05101640 1 Processor -- start 2023-10-14T11:13:55.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0b05101640 1 -- start start 2023-10-14T11:13:55.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0b05101640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b000d1400 0x7f0b00148480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:55.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0b05101640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b000d3010 0x7f0b0014aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:55.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0b05101640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b0015cb90 0x7f0b00147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:55.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0b05101640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000b5730 con 0x7f0b000d1400 2023-10-14T11:13:55.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0b05101640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b00149670 con 0x7f0b0015cb90 2023-10-14T11:13:55.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0b05101640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0014b410 con 0x7f0b000d3010 2023-10-14T11:13:55.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0afed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b000d1400 0x7f0b00148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:55.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0afed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b000d1400 0x7f0b00148480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39226/0 (socket says 172.21.15.26:39226) 2023-10-14T11:13:55.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0afed9d640 1 -- 172.21.15.26:0/4051214980 learned_addr learned my addr 172.21.15.26:0/4051214980 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:55.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0af7fff640 1 --2- 172.21.15.26:0/4051214980 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b000d3010 0x7f0b0014aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:55.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0aff59e640 1 --2- 172.21.15.26:0/4051214980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b0015cb90 0x7f0b00147ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:55.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0afed9d640 1 -- 172.21.15.26:0/4051214980 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b000d3010 msgr2=0x7f0b0014aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:55.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0afed9d640 1 --2- 172.21.15.26:0/4051214980 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b000d3010 0x7f0b0014aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0afed9d640 1 -- 172.21.15.26:0/4051214980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b0015cb90 msgr2=0x7f0b00147ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:55.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0afed9d640 1 --2- 172.21.15.26:0/4051214980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b0015cb90 0x7f0b00147ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0afed9d640 1 -- 172.21.15.26:0/4051214980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae80094d0 con 0x7f0b000d1400 2023-10-14T11:13:55.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0af7fff640 1 --2- 172.21.15.26:0/4051214980 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b000d3010 0x7f0b0014aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:55.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0afed9d640 1 --2- 172.21.15.26:0/4051214980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b000d1400 0x7f0b00148480 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0af000d800 tx=0x7f0af000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:55.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0af77fe640 1 -- 172.21.15.26:0/4051214980 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0018070 con 0x7f0b000d1400 2023-10-14T11:13:55.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0af77fe640 1 -- 172.21.15.26:0/4051214980 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af00059a0 con 0x7f0b000d1400 2023-10-14T11:13:55.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0b05101640 1 -- 172.21.15.26:0/4051214980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b00148a60 con 0x7f0b000d1400 2023-10-14T11:13:55.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0af77fe640 1 -- 172.21.15.26:0/4051214980 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0005b50 con 0x7f0b000d1400 2023-10-14T11:13:55.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.149+0000 7f0b05101640 1 -- 172.21.15.26:0/4051214980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b00149020 con 0x7f0b000d1400 2023-10-14T11:13:55.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.153+0000 7f0b05101640 1 -- 172.21.15.26:0/4051214980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b00074010 con 0x7f0b000d1400 2023-10-14T11:13:55.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.153+0000 7f0af77fe640 1 -- 172.21.15.26:0/4051214980 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0af0005cb0 con 0x7f0b000d1400 2023-10-14T11:13:55.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.153+0000 7f0af77fe640 1 --2- 172.21.15.26:0/4051214980 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0ae00664a0 0x7f0ae0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:55.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.153+0000 7f0af77fe640 1 -- 172.21.15.26:0/4051214980 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f0af0083f40 con 0x7f0b000d1400 2023-10-14T11:13:55.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.153+0000 7f0af7fff640 1 --2- 172.21.15.26:0/4051214980 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0ae00664a0 0x7f0ae0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:55.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.153+0000 7f0af7fff640 1 --2- 172.21.15.26:0/4051214980 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0ae00664a0 0x7f0ae0068960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80af000 tx=0x7f0ae80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:55.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.157+0000 7f0af77fe640 1 -- 172.21.15.26:0/4051214980 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0af00511e0 con 0x7f0b000d1400 2023-10-14T11:13:55.200 INFO:tasks.ceph.mds.a.smithi026.stderr:2023-10-14T11:13:55.197+0000 7f391bc78640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T11:13:55.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.313+0000 7f0b05101640 1 -- 172.21.15.26:0/4051214980 --> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0b0015cf70 con 0x7f0ae00664a0 2023-10-14T11:13:55.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.321+0000 7f0af77fe640 1 -- 172.21.15.26:0/4051214980 <== mgr.4101 v2:172.21.15.26:6832/4136446821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289124 (secure 0 0 0) 0x7f0ae80ab8d0 con 0x7f0ae00664a0 2023-10-14T11:13:55.328 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:55.330 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-14T11:13:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.325+0000 7f0b05101640 1 -- 172.21.15.26:0/4051214980 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0ae00664a0 msgr2=0x7f0ae0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.325+0000 7f0b05101640 1 --2- 172.21.15.26:0/4051214980 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0ae00664a0 0x7f0ae0068960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80af000 tx=0x7f0ae80a7000 comp rx=0 tx=0).stop 2023-10-14T11:13:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.325+0000 7f0b05101640 1 -- 172.21.15.26:0/4051214980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b000d1400 msgr2=0x7f0b00148480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:55.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.325+0000 7f0b05101640 1 --2- 172.21.15.26:0/4051214980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b000d1400 0x7f0b00148480 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0af000d800 tx=0x7f0af000dcc0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.325+0000 7f0b05101640 1 -- 172.21.15.26:0/4051214980 shutdown_connections 2023-10-14T11:13:55.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.325+0000 7f0b05101640 1 --2- 172.21.15.26:0/4051214980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b0015cb90 0x7f0b00147ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.325+0000 7f0b05101640 1 --2- 172.21.15.26:0/4051214980 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b000d3010 0x7f0b0014aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.325+0000 7f0b05101640 1 --2- 172.21.15.26:0/4051214980 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0ae00664a0 0x7f0ae0068960 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.325+0000 7f0b05101640 1 --2- 172.21.15.26:0/4051214980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b000d1400 0x7f0b00148480 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.325+0000 7f0b05101640 1 -- 172.21.15.26:0/4051214980 >> 172.21.15.26:0/4051214980 conn(0x7f0b0009bc50 msgr2=0x7f0b00159340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:55.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.325+0000 7f0b05101640 1 -- 172.21.15.26:0/4051214980 shutdown_connections 2023-10-14T11:13:55.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.325+0000 7f0b05101640 1 -- 172.21.15.26:0/4051214980 wait complete. 2023-10-14T11:13:55.348 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2023-10-14T11:13:54.178806+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":250024,"kb_used_data":4720,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754724696,"statfs":{"total":773094113280,"available":772838088704,"internally_reserved":0,"allocated":4833280,"data_stored":2723618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":251055672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.963886"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246441+0000","last_change":"2023-10-14T11:13:51.258265+0000","last_active":"2023-10-14T11:13:52.246441+0000","last_peered":"2023-10-14T11:13:52.246441+0000","last_clean":"2023-10-14T11:13:52.246441+0000","last_became_active":"2023-10-14T11:13:51.256249+0000","last_became_peered":"2023-10-14T11:13:51.256249+0000","last_unstale":"2023-10-14T11:13:52.246441+0000","last_undegraded":"2023-10-14T11:13:52.246441+0000","last_fullsized":"2023-10-14T11:13:52.246441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:40:55.119647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246182+0000","last_change":"2023-10-14T11:13:51.264990+0000","last_active":"2023-10-14T11:13:52.246182+0000","last_peered":"2023-10-14T11:13:52.246182+0000","last_clean":"2023-10-14T11:13:52.246182+0000","last_became_active":"2023-10-14T11:13:51.264702+0000","last_became_peered":"2023-10-14T11:13:51.264702+0000","last_unstale":"2023-10-14T11:13:52.246182+0000","last_undegraded":"2023-10-14T11:13:52.246182+0000","last_fullsized":"2023-10-14T11:13:52.246182+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:21:28.378533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365469+0000","last_change":"2023-10-14T11:13:51.265815+0000","last_active":"2023-10-14T11:13:53.365469+0000","last_peered":"2023-10-14T11:13:53.365469+0000","last_clean":"2023-10-14T11:13:53.365469+0000","last_became_active":"2023-10-14T11:13:51.265408+0000","last_became_peered":"2023-10-14T11:13:51.265408+0000","last_unstale":"2023-10-14T11:13:53.365469+0000","last_undegraded":"2023-10-14T11:13:53.365469+0000","last_fullsized":"2023-10-14T11:13:53.365469+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:48:07.899291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365517+0000","last_change":"2023-10-14T11:13:51.250180+0000","last_active":"2023-10-14T11:13:53.365517+0000","last_peered":"2023-10-14T11:13:53.365517+0000","last_clean":"2023-10-14T11:13:53.365517+0000","last_became_active":"2023-10-14T11:13:51.249461+0000","last_became_peered":"2023-10-14T11:13:51.249461+0000","last_unstale":"2023-10-14T11:13:53.365517+0000","last_undegraded":"2023-10-14T11:13:53.365517+0000","last_fullsized":"2023-10-14T11:13:53.365517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:53:39.065274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365550+0000","last_change":"2023-10-14T11:13:51.247768+0000","last_active":"2023-10-14T11:13:53.365550+0000","last_peered":"2023-10-14T11:13:53.365550+0000","last_clean":"2023-10-14T11:13:53.365550+0000","last_became_active":"2023-10-14T11:13:51.247501+0000","last_became_peered":"2023-10-14T11:13:51.247501+0000","last_unstale":"2023-10-14T11:13:53.365550+0000","last_undegraded":"2023-10-14T11:13:53.365550+0000","last_fullsized":"2023-10-14T11:13:53.365550+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:01:55.213561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.247476+0000","last_change":"2023-10-14T11:13:51.273812+0000","last_active":"2023-10-14T11:13:53.247476+0000","last_peered":"2023-10-14T11:13:53.247476+0000","last_clean":"2023-10-14T11:13:53.247476+0000","last_became_active":"2023-10-14T11:13:51.273443+0000","last_became_peered":"2023-10-14T11:13:51.273443+0000","last_unstale":"2023-10-14T11:13:53.247476+0000","last_undegraded":"2023-10-14T11:13:53.247476+0000","last_fullsized":"2023-10-14T11:13:53.247476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:34:14.998558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246478+0000","last_change":"2023-10-14T11:13:51.262079+0000","last_active":"2023-10-14T11:13:52.246478+0000","last_peered":"2023-10-14T11:13:52.246478+0000","last_clean":"2023-10-14T11:13:52.246478+0000","last_became_active":"2023-10-14T11:13:51.261798+0000","last_became_peered":"2023-10-14T11:13:51.261798+0000","last_unstale":"2023-10-14T11:13:52.246478+0000","last_undegraded":"2023-10-14T11:13:52.246478+0000","last_fullsized":"2023-10-14T11:13:52.246478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:06:25.677827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.245660+0000","last_change":"2023-10-14T11:13:51.267011+0000","last_active":"2023-10-14T11:13:52.245660+0000","last_peered":"2023-10-14T11:13:52.245660+0000","last_clean":"2023-10-14T11:13:52.245660+0000","last_became_active":"2023-10-14T11:13:51.266722+0000","last_became_peered":"2023-10-14T11:13:51.266722+0000","last_unstale":"2023-10-14T11:13:52.245660+0000","last_undegraded":"2023-10-14T11:13:52.245660+0000","last_fullsized":"2023-10-14T11:13:52.245660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:20:08.879231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365623+0000","last_change":"2023-10-14T11:13:51.269276+0000","last_active":"2023-10-14T11:13:53.365623+0000","last_peered":"2023-10-14T11:13:53.365623+0000","last_clean":"2023-10-14T11:13:53.365623+0000","last_became_active":"2023-10-14T11:13:51.268939+0000","last_became_peered":"2023-10-14T11:13:51.268939+0000","last_unstale":"2023-10-14T11:13:53.365623+0000","last_undegraded":"2023-10-14T11:13:53.365623+0000","last_fullsized":"2023-10-14T11:13:53.365623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:12:26.834537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.247147+0000","last_change":"2023-10-14T11:13:51.255564+0000","last_active":"2023-10-14T11:13:52.247147+0000","last_peered":"2023-10-14T11:13:52.247147+0000","last_clean":"2023-10-14T11:13:52.247147+0000","last_became_active":"2023-10-14T11:13:51.255298+0000","last_became_peered":"2023-10-14T11:13:51.255298+0000","last_unstale":"2023-10-14T11:13:52.247147+0000","last_undegraded":"2023-10-14T11:13:52.247147+0000","last_fullsized":"2023-10-14T11:13:52.247147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:46:46.144271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.247206+0000","last_change":"2023-10-14T11:13:51.264327+0000","last_active":"2023-10-14T11:13:52.247206+0000","last_peered":"2023-10-14T11:13:52.247206+0000","last_clean":"2023-10-14T11:13:52.247206+0000","last_became_active":"2023-10-14T11:13:51.261412+0000","last_became_peered":"2023-10-14T11:13:51.261412+0000","last_unstale":"2023-10-14T11:13:52.247206+0000","last_undegraded":"2023-10-14T11:13:52.247206+0000","last_fullsized":"2023-10-14T11:13:52.247206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:03:13.454300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.364974+0000","last_change":"2023-10-14T11:13:51.265430+0000","last_active":"2023-10-14T11:13:53.364974+0000","last_peered":"2023-10-14T11:13:53.364974+0000","last_clean":"2023-10-14T11:13:53.364974+0000","last_became_active":"2023-10-14T11:13:51.265036+0000","last_became_peered":"2023-10-14T11:13:51.265036+0000","last_unstale":"2023-10-14T11:13:53.364974+0000","last_undegraded":"2023-10-14T11:13:53.364974+0000","last_fullsized":"2023-10-14T11:13:53.364974+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:04.174333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246397+0000","last_change":"2023-10-14T11:13:51.261179+0000","last_active":"2023-10-14T11:13:52.246397+0000","last_peered":"2023-10-14T11:13:52.246397+0000","last_clean":"2023-10-14T11:13:52.246397+0000","last_became_active":"2023-10-14T11:13:51.254826+0000","last_became_peered":"2023-10-14T11:13:51.254826+0000","last_unstale":"2023-10-14T11:13:52.246397+0000","last_undegraded":"2023-10-14T11:13:52.246397+0000","last_fullsized":"2023-10-14T11:13:52.246397+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:57.586320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.374497+0000","last_change":"2023-10-14T11:13:51.250106+0000","last_active":"2023-10-14T11:13:52.374497+0000","last_peered":"2023-10-14T11:13:52.374497+0000","last_clean":"2023-10-14T11:13:52.374497+0000","last_became_active":"2023-10-14T11:13:51.248912+0000","last_became_peered":"2023-10-14T11:13:51.248912+0000","last_unstale":"2023-10-14T11:13:52.374497+0000","last_undegraded":"2023-10-14T11:13:52.374497+0000","last_fullsized":"2023-10-14T11:13:52.374497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:01.340314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246632+0000","last_change":"2023-10-14T11:13:51.255649+0000","last_active":"2023-10-14T11:13:52.246632+0000","last_peered":"2023-10-14T11:13:52.246632+0000","last_clean":"2023-10-14T11:13:52.246632+0000","last_became_active":"2023-10-14T11:13:51.255342+0000","last_became_peered":"2023-10-14T11:13:51.255342+0000","last_unstale":"2023-10-14T11:13:52.246632+0000","last_undegraded":"2023-10-14T11:13:52.246632+0000","last_fullsized":"2023-10-14T11:13:52.246632+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:20:08.879231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215109+0000","last_change":"2023-10-14T11:13:51.265493+0000","last_active":"2023-10-14T11:13:53.215109+0000","last_peered":"2023-10-14T11:13:53.215109+0000","last_clean":"2023-10-14T11:13:53.215109+0000","last_became_active":"2023-10-14T11:13:51.265171+0000","last_became_peered":"2023-10-14T11:13:51.265171+0000","last_unstale":"2023-10-14T11:13:53.215109+0000","last_undegraded":"2023-10-14T11:13:53.215109+0000","last_fullsized":"2023-10-14T11:13:53.215109+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:38:53.170393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215675+0000","last_change":"2023-10-14T11:13:51.266124+0000","last_active":"2023-10-14T11:13:53.215675+0000","last_peered":"2023-10-14T11:13:53.215675+0000","last_clean":"2023-10-14T11:13:53.215675+0000","last_became_active":"2023-10-14T11:13:51.265771+0000","last_became_peered":"2023-10-14T11:13:51.265771+0000","last_unstale":"2023-10-14T11:13:53.215675+0000","last_undegraded":"2023-10-14T11:13:53.215675+0000","last_fullsized":"2023-10-14T11:13:53.215675+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:46:46.144271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246724+0000","last_change":"2023-10-14T11:13:51.248671+0000","last_active":"2023-10-14T11:13:52.246724+0000","last_peered":"2023-10-14T11:13:52.246724+0000","last_clean":"2023-10-14T11:13:52.246724+0000","last_became_active":"2023-10-14T11:13:51.248126+0000","last_became_peered":"2023-10-14T11:13:51.248126+0000","last_unstale":"2023-10-14T11:13:52.246724+0000","last_undegraded":"2023-10-14T11:13:52.246724+0000","last_fullsized":"2023-10-14T11:13:52.246724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:00.939380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365726+0000","last_change":"2023-10-14T11:13:51.258571+0000","last_active":"2023-10-14T11:13:53.365726+0000","last_peered":"2023-10-14T11:13:53.365726+0000","last_clean":"2023-10-14T11:13:53.365726+0000","last_became_active":"2023-10-14T11:13:51.258191+0000","last_became_peered":"2023-10-14T11:13:51.258191+0000","last_unstale":"2023-10-14T11:13:53.365726+0000","last_undegraded":"2023-10-14T11:13:53.365726+0000","last_fullsized":"2023-10-14T11:13:53.365726+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:20.636866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246215+0000","last_change":"2023-10-14T11:13:51.247876+0000","last_active":"2023-10-14T11:13:52.246215+0000","last_peered":"2023-10-14T11:13:52.246215+0000","last_clean":"2023-10-14T11:13:52.246215+0000","last_became_active":"2023-10-14T11:13:51.247640+0000","last_became_peered":"2023-10-14T11:13:51.247640+0000","last_unstale":"2023-10-14T11:13:52.246215+0000","last_undegraded":"2023-10-14T11:13:52.246215+0000","last_fullsized":"2023-10-14T11:13:52.246215+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:42:13.144647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246545+0000","last_change":"2023-10-14T11:13:51.256439+0000","last_active":"2023-10-14T11:13:52.246545+0000","last_peered":"2023-10-14T11:13:52.246545+0000","last_clean":"2023-10-14T11:13:52.246545+0000","last_became_active":"2023-10-14T11:13:51.256166+0000","last_became_peered":"2023-10-14T11:13:51.256166+0000","last_unstale":"2023-10-14T11:13:52.246545+0000","last_undegraded":"2023-10-14T11:13:52.246545+0000","last_fullsized":"2023-10-14T11:13:52.246545+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:08:26.041683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.374841+0000","last_change":"2023-10-14T11:13:51.250151+0000","last_active":"2023-10-14T11:13:52.374841+0000","last_peered":"2023-10-14T11:13:52.374841+0000","last_clean":"2023-10-14T11:13:52.374841+0000","last_became_active":"2023-10-14T11:13:51.249808+0000","last_became_peered":"2023-10-14T11:13:51.249808+0000","last_unstale":"2023-10-14T11:13:52.374841+0000","last_undegraded":"2023-10-14T11:13:52.374841+0000","last_fullsized":"2023-10-14T11:13:52.374841+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:15.893881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215129+0000","last_change":"2023-10-14T11:13:51.242174+0000","last_active":"2023-10-14T11:13:53.215129+0000","last_peered":"2023-10-14T11:13:53.215129+0000","last_clean":"2023-10-14T11:13:53.215129+0000","last_became_active":"2023-10-14T11:13:51.241578+0000","last_became_peered":"2023-10-14T11:13:51.241578+0000","last_unstale":"2023-10-14T11:13:53.215129+0000","last_undegraded":"2023-10-14T11:13:53.215129+0000","last_fullsized":"2023-10-14T11:13:53.215129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:28:37.190921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365272+0000","last_change":"2023-10-14T11:13:51.238309+0000","last_active":"2023-10-14T11:13:53.365272+0000","last_peered":"2023-10-14T11:13:53.365272+0000","last_clean":"2023-10-14T11:13:53.365272+0000","last_became_active":"2023-10-14T11:13:51.237984+0000","last_became_peered":"2023-10-14T11:13:51.237984+0000","last_unstale":"2023-10-14T11:13:53.365272+0000","last_undegraded":"2023-10-14T11:13:53.365272+0000","last_fullsized":"2023-10-14T11:13:53.365272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:41:22.721947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246810+0000","last_change":"2023-10-14T11:13:51.258315+0000","last_active":"2023-10-14T11:13:52.246810+0000","last_peered":"2023-10-14T11:13:52.246810+0000","last_clean":"2023-10-14T11:13:52.246810+0000","last_became_active":"2023-10-14T11:13:51.258035+0000","last_became_peered":"2023-10-14T11:13:51.258035+0000","last_unstale":"2023-10-14T11:13:52.246810+0000","last_undegraded":"2023-10-14T11:13:52.246810+0000","last_fullsized":"2023-10-14T11:13:52.246810+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:20:58.176655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.247298+0000","last_change":"2023-10-14T11:13:51.266727+0000","last_active":"2023-10-14T11:13:53.247298+0000","last_peered":"2023-10-14T11:13:53.247298+0000","last_clean":"2023-10-14T11:13:53.247298+0000","last_became_active":"2023-10-14T11:13:51.266459+0000","last_became_peered":"2023-10-14T11:13:51.266459+0000","last_unstale":"2023-10-14T11:13:53.247298+0000","last_undegraded":"2023-10-14T11:13:53.247298+0000","last_fullsized":"2023-10-14T11:13:53.247298+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:48:07.899291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246392+0000","last_change":"2023-10-14T11:13:51.249423+0000","last_active":"2023-10-14T11:13:52.246392+0000","last_peered":"2023-10-14T11:13:52.246392+0000","last_clean":"2023-10-14T11:13:52.246392+0000","last_became_active":"2023-10-14T11:13:51.244262+0000","last_became_peered":"2023-10-14T11:13:51.244262+0000","last_unstale":"2023-10-14T11:13:52.246392+0000","last_undegraded":"2023-10-14T11:13:52.246392+0000","last_fullsized":"2023-10-14T11:13:52.246392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:16.955627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.247033+0000","last_change":"2023-10-14T11:13:51.253130+0000","last_active":"2023-10-14T11:13:52.247033+0000","last_peered":"2023-10-14T11:13:52.247033+0000","last_clean":"2023-10-14T11:13:52.247033+0000","last_became_active":"2023-10-14T11:13:51.252859+0000","last_became_peered":"2023-10-14T11:13:51.252859+0000","last_unstale":"2023-10-14T11:13:52.247033+0000","last_undegraded":"2023-10-14T11:13:52.247033+0000","last_fullsized":"2023-10-14T11:13:52.247033+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:23.174548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246392+0000","last_change":"2023-10-14T11:13:51.255477+0000","last_active":"2023-10-14T11:13:52.246392+0000","last_peered":"2023-10-14T11:13:52.246392+0000","last_clean":"2023-10-14T11:13:52.246392+0000","last_became_active":"2023-10-14T11:13:51.255161+0000","last_became_peered":"2023-10-14T11:13:51.255161+0000","last_unstale":"2023-10-14T11:13:52.246392+0000","last_undegraded":"2023-10-14T11:13:52.246392+0000","last_fullsized":"2023-10-14T11:13:52.246392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:32.925589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246543+0000","last_change":"2023-10-14T11:13:51.246889+0000","last_active":"2023-10-14T11:13:52.246543+0000","last_peered":"2023-10-14T11:13:52.246543+0000","last_clean":"2023-10-14T11:13:52.246543+0000","last_became_active":"2023-10-14T11:13:51.246565+0000","last_became_peered":"2023-10-14T11:13:51.246565+0000","last_unstale":"2023-10-14T11:13:52.246543+0000","last_undegraded":"2023-10-14T11:13:52.246543+0000","last_fullsized":"2023-10-14T11:13:52.246543+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:48:59.200774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215238+0000","last_change":"2023-10-14T11:13:51.242349+0000","last_active":"2023-10-14T11:13:53.215238+0000","last_peered":"2023-10-14T11:13:53.215238+0000","last_clean":"2023-10-14T11:13:53.215238+0000","last_became_active":"2023-10-14T11:13:51.241906+0000","last_became_peered":"2023-10-14T11:13:51.241906+0000","last_unstale":"2023-10-14T11:13:53.215238+0000","last_undegraded":"2023-10-14T11:13:53.215238+0000","last_fullsized":"2023-10-14T11:13:53.215238+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:06:25.677827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.247117+0000","last_change":"2023-10-14T11:13:51.257462+0000","last_active":"2023-10-14T11:13:53.247117+0000","last_peered":"2023-10-14T11:13:53.247117+0000","last_clean":"2023-10-14T11:13:53.247117+0000","last_became_active":"2023-10-14T11:13:51.257187+0000","last_became_peered":"2023-10-14T11:13:51.257187+0000","last_unstale":"2023-10-14T11:13:53.247117+0000","last_undegraded":"2023-10-14T11:13:53.247117+0000","last_fullsized":"2023-10-14T11:13:53.247117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:15.893881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215456+0000","last_change":"2023-10-14T11:13:51.257575+0000","last_active":"2023-10-14T11:13:53.215456+0000","last_peered":"2023-10-14T11:13:53.215456+0000","last_clean":"2023-10-14T11:13:53.215456+0000","last_became_active":"2023-10-14T11:13:51.257288+0000","last_became_peered":"2023-10-14T11:13:51.257288+0000","last_unstale":"2023-10-14T11:13:53.215456+0000","last_undegraded":"2023-10-14T11:13:53.215456+0000","last_fullsized":"2023-10-14T11:13:53.215456+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:20:08.879231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246821+0000","last_change":"2023-10-14T11:13:50.244550+0000","last_active":"2023-10-14T11:13:52.246821+0000","last_peered":"2023-10-14T11:13:52.246821+0000","last_clean":"2023-10-14T11:13:52.246821+0000","last_became_active":"2023-10-14T11:13:50.244238+0000","last_became_peered":"2023-10-14T11:13:50.244238+0000","last_unstale":"2023-10-14T11:13:52.246821+0000","last_undegraded":"2023-10-14T11:13:52.246821+0000","last_fullsized":"2023-10-14T11:13:52.246821+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:54.409746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.247534+0000","last_change":"2023-10-14T11:13:51.272678+0000","last_active":"2023-10-14T11:13:53.247534+0000","last_peered":"2023-10-14T11:13:53.247534+0000","last_clean":"2023-10-14T11:13:53.247534+0000","last_became_active":"2023-10-14T11:13:51.268997+0000","last_became_peered":"2023-10-14T11:13:51.268997+0000","last_unstale":"2023-10-14T11:13:53.247534+0000","last_undegraded":"2023-10-14T11:13:53.247534+0000","last_fullsized":"2023-10-14T11:13:53.247534+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:12:26.834537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365575+0000","last_change":"2023-10-14T11:13:50.244499+0000","last_active":"2023-10-14T11:13:53.365575+0000","last_peered":"2023-10-14T11:13:53.365575+0000","last_clean":"2023-10-14T11:13:53.365575+0000","last_became_active":"2023-10-14T11:13:50.244218+0000","last_became_peered":"2023-10-14T11:13:50.244218+0000","last_unstale":"2023-10-14T11:13:53.365575+0000","last_undegraded":"2023-10-14T11:13:53.365575+0000","last_fullsized":"2023-10-14T11:13:53.365575+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:31.916817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.375006+0000","last_change":"2023-10-14T11:13:51.245228+0000","last_active":"2023-10-14T11:13:52.375006+0000","last_peered":"2023-10-14T11:13:52.375006+0000","last_clean":"2023-10-14T11:13:52.375006+0000","last_became_active":"2023-10-14T11:13:51.244929+0000","last_became_peered":"2023-10-14T11:13:51.244929+0000","last_unstale":"2023-10-14T11:13:52.375006+0000","last_undegraded":"2023-10-14T11:13:52.375006+0000","last_fullsized":"2023-10-14T11:13:52.375006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:34:14.998558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.247665+0000","last_change":"2023-10-14T11:13:50.250350+0000","last_active":"2023-10-14T11:13:53.247665+0000","last_peered":"2023-10-14T11:13:53.247665+0000","last_clean":"2023-10-14T11:13:53.247665+0000","last_became_active":"2023-10-14T11:13:50.250066+0000","last_became_peered":"2023-10-14T11:13:50.250066+0000","last_unstale":"2023-10-14T11:13:53.247665+0000","last_undegraded":"2023-10-14T11:13:53.247665+0000","last_fullsized":"2023-10-14T11:13:53.247665+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:20:57.167883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246411+0000","last_change":"2023-10-14T11:13:51.242883+0000","last_active":"2023-10-14T11:13:52.246411+0000","last_peered":"2023-10-14T11:13:52.246411+0000","last_clean":"2023-10-14T11:13:52.246411+0000","last_became_active":"2023-10-14T11:13:51.242611+0000","last_became_peered":"2023-10-14T11:13:51.242611+0000","last_unstale":"2023-10-14T11:13:52.246411+0000","last_undegraded":"2023-10-14T11:13:52.246411+0000","last_fullsized":"2023-10-14T11:13:52.246411+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:56.165357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.374837+0000","last_change":"2023-10-14T11:13:50.250527+0000","last_active":"2023-10-14T11:13:52.374837+0000","last_peered":"2023-10-14T11:13:52.374837+0000","last_clean":"2023-10-14T11:13:52.374837+0000","last_became_active":"2023-10-14T11:13:50.250082+0000","last_became_peered":"2023-10-14T11:13:50.250082+0000","last_unstale":"2023-10-14T11:13:52.374837+0000","last_undegraded":"2023-10-14T11:13:52.374837+0000","last_fullsized":"2023-10-14T11:13:52.374837+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:59.930607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.364560+0000","last_change":"2023-10-14T11:13:51.259724+0000","last_active":"2023-10-14T11:13:53.364560+0000","last_peered":"2023-10-14T11:13:53.364560+0000","last_clean":"2023-10-14T11:13:53.364560+0000","last_became_active":"2023-10-14T11:13:51.259453+0000","last_became_peered":"2023-10-14T11:13:51.259453+0000","last_unstale":"2023-10-14T11:13:53.364560+0000","last_undegraded":"2023-10-14T11:13:53.364560+0000","last_fullsized":"2023-10-14T11:13:53.364560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:24:09.342629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246650+0000","last_change":"2023-10-14T11:13:50.238390+0000","last_active":"2023-10-14T11:13:52.246650+0000","last_peered":"2023-10-14T11:13:52.246650+0000","last_clean":"2023-10-14T11:13:52.246650+0000","last_became_active":"2023-10-14T11:13:50.237053+0000","last_became_peered":"2023-10-14T11:13:50.237053+0000","last_unstale":"2023-10-14T11:13:52.246650+0000","last_undegraded":"2023-10-14T11:13:52.246650+0000","last_fullsized":"2023-10-14T11:13:52.246650+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:52:44.246876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246778+0000","last_change":"2023-10-14T11:13:51.265150+0000","last_active":"2023-10-14T11:13:52.246778+0000","last_peered":"2023-10-14T11:13:52.246778+0000","last_clean":"2023-10-14T11:13:52.246778+0000","last_became_active":"2023-10-14T11:13:51.264858+0000","last_became_peered":"2023-10-14T11:13:51.264858+0000","last_unstale":"2023-10-14T11:13:52.246778+0000","last_undegraded":"2023-10-14T11:13:52.246778+0000","last_fullsized":"2023-10-14T11:13:52.246778+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:54:30.676855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215218+0000","last_change":"2023-10-14T11:13:50.246159+0000","last_active":"2023-10-14T11:13:53.215218+0000","last_peered":"2023-10-14T11:13:53.215218+0000","last_clean":"2023-10-14T11:13:53.215218+0000","last_became_active":"2023-10-14T11:13:50.245837+0000","last_became_peered":"2023-10-14T11:13:50.245837+0000","last_unstale":"2023-10-14T11:13:53.215218+0000","last_undegraded":"2023-10-14T11:13:53.215218+0000","last_fullsized":"2023-10-14T11:13:53.215218+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:34:13.989785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.374714+0000","last_change":"2023-10-14T11:13:51.267024+0000","last_active":"2023-10-14T11:13:52.374714+0000","last_peered":"2023-10-14T11:13:52.374714+0000","last_clean":"2023-10-14T11:13:52.374714+0000","last_became_active":"2023-10-14T11:13:51.266667+0000","last_became_peered":"2023-10-14T11:13:51.266667+0000","last_unstale":"2023-10-14T11:13:52.374714+0000","last_undegraded":"2023-10-14T11:13:52.374714+0000","last_fullsized":"2023-10-14T11:13:52.374714+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:02.076277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.247267+0000","last_change":"2023-10-14T11:13:50.250787+0000","last_active":"2023-10-14T11:13:53.247267+0000","last_peered":"2023-10-14T11:13:53.247267+0000","last_clean":"2023-10-14T11:13:53.247267+0000","last_became_active":"2023-10-14T11:13:50.250512+0000","last_became_peered":"2023-10-14T11:13:50.250512+0000","last_unstale":"2023-10-14T11:13:53.247267+0000","last_undegraded":"2023-10-14T11:13:53.247267+0000","last_fullsized":"2023-10-14T11:13:53.247267+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:00.331541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246013+0000","last_change":"2023-10-14T11:13:51.248169+0000","last_active":"2023-10-14T11:13:52.246013+0000","last_peered":"2023-10-14T11:13:52.246013+0000","last_clean":"2023-10-14T11:13:52.246013+0000","last_became_active":"2023-10-14T11:13:51.247872+0000","last_became_peered":"2023-10-14T11:13:51.247872+0000","last_unstale":"2023-10-14T11:13:52.246013+0000","last_undegraded":"2023-10-14T11:13:52.246013+0000","last_fullsized":"2023-10-14T11:13:52.246013+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:23.174548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.374452+0000","last_change":"2023-10-14T11:13:50.247750+0000","last_active":"2023-10-14T11:13:52.374452+0000","last_peered":"2023-10-14T11:13:52.374452+0000","last_clean":"2023-10-14T11:13:52.374452+0000","last_became_active":"2023-10-14T11:13:50.247479+0000","last_became_peered":"2023-10-14T11:13:50.247479+0000","last_unstale":"2023-10-14T11:13:52.374452+0000","last_undegraded":"2023-10-14T11:13:52.374452+0000","last_fullsized":"2023-10-14T11:13:52.374452+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:19.628093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365532+0000","last_change":"2023-10-14T11:13:51.250407+0000","last_active":"2023-10-14T11:13:53.365532+0000","last_peered":"2023-10-14T11:13:53.365532+0000","last_clean":"2023-10-14T11:13:53.365532+0000","last_became_active":"2023-10-14T11:13:51.249826+0000","last_became_peered":"2023-10-14T11:13:51.249826+0000","last_unstale":"2023-10-14T11:13:53.365532+0000","last_undegraded":"2023-10-14T11:13:53.365532+0000","last_fullsized":"2023-10-14T11:13:53.365532+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:39:01.507444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246493+0000","last_change":"2023-10-14T11:13:50.255725+0000","last_active":"2023-10-14T11:13:52.246493+0000","last_peered":"2023-10-14T11:13:52.246493+0000","last_clean":"2023-10-14T11:13:52.246493+0000","last_became_active":"2023-10-14T11:13:50.255501+0000","last_became_peered":"2023-10-14T11:13:50.255501+0000","last_unstale":"2023-10-14T11:13:52.246493+0000","last_undegraded":"2023-10-14T11:13:52.246493+0000","last_fullsized":"2023-10-14T11:13:52.246493+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:40:38.528214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215562+0000","last_change":"2023-10-14T11:13:51.246572+0000","last_active":"2023-10-14T11:13:53.215562+0000","last_peered":"2023-10-14T11:13:53.215562+0000","last_clean":"2023-10-14T11:13:53.215562+0000","last_became_active":"2023-10-14T11:13:51.246078+0000","last_became_peered":"2023-10-14T11:13:51.246078+0000","last_unstale":"2023-10-14T11:13:53.215562+0000","last_undegraded":"2023-10-14T11:13:53.215562+0000","last_fullsized":"2023-10-14T11:13:53.215562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:23.174548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.247245+0000","last_change":"2023-10-14T11:13:50.245742+0000","last_active":"2023-10-14T11:13:52.247245+0000","last_peered":"2023-10-14T11:13:52.247245+0000","last_clean":"2023-10-14T11:13:52.247245+0000","last_became_active":"2023-10-14T11:13:50.245490+0000","last_became_peered":"2023-10-14T11:13:50.245490+0000","last_unstale":"2023-10-14T11:13:52.247245+0000","last_undegraded":"2023-10-14T11:13:52.247245+0000","last_fullsized":"2023-10-14T11:13:52.247245+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:18:44.943441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365540+0000","last_change":"2023-10-14T11:13:51.263554+0000","last_active":"2023-10-14T11:13:53.365540+0000","last_peered":"2023-10-14T11:13:53.365540+0000","last_clean":"2023-10-14T11:13:53.365540+0000","last_became_active":"2023-10-14T11:13:51.254264+0000","last_became_peered":"2023-10-14T11:13:51.254264+0000","last_unstale":"2023-10-14T11:13:53.365540+0000","last_undegraded":"2023-10-14T11:13:53.365540+0000","last_fullsized":"2023-10-14T11:13:53.365540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:34:14.998558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.247354+0000","last_change":"2023-10-14T11:13:50.247834+0000","last_active":"2023-10-14T11:13:52.247354+0000","last_peered":"2023-10-14T11:13:52.247354+0000","last_clean":"2023-10-14T11:13:52.247354+0000","last_became_active":"2023-10-14T11:13:50.240089+0000","last_became_peered":"2023-10-14T11:13:50.240089+0000","last_unstale":"2023-10-14T11:13:52.247354+0000","last_undegraded":"2023-10-14T11:13:52.247354+0000","last_fullsized":"2023-10-14T11:13:52.247354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:40:38.528214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.374953+0000","last_change":"2023-10-14T11:13:51.263228+0000","last_active":"2023-10-14T11:13:52.374953+0000","last_peered":"2023-10-14T11:13:52.374953+0000","last_clean":"2023-10-14T11:13:52.374953+0000","last_became_active":"2023-10-14T11:13:51.262933+0000","last_became_peered":"2023-10-14T11:13:51.262933+0000","last_unstale":"2023-10-14T11:13:52.374953+0000","last_undegraded":"2023-10-14T11:13:52.374953+0000","last_fullsized":"2023-10-14T11:13:52.374953+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:04.174333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246085+0000","last_change":"2023-10-14T11:13:50.248117+0000","last_active":"2023-10-14T11:13:52.246085+0000","last_peered":"2023-10-14T11:13:52.246085+0000","last_clean":"2023-10-14T11:13:52.246085+0000","last_became_active":"2023-10-14T11:13:50.246254+0000","last_became_peered":"2023-10-14T11:13:50.246254+0000","last_unstale":"2023-10-14T11:13:52.246085+0000","last_undegraded":"2023-10-14T11:13:52.246085+0000","last_fullsized":"2023-10-14T11:13:52.246085+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:10.016235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.364559+0000","last_change":"2023-10-14T11:13:51.264064+0000","last_active":"2023-10-14T11:13:53.364559+0000","last_peered":"2023-10-14T11:13:53.364559+0000","last_clean":"2023-10-14T11:13:53.364559+0000","last_became_active":"2023-10-14T11:13:51.263799+0000","last_became_peered":"2023-10-14T11:13:51.263799+0000","last_unstale":"2023-10-14T11:13:53.364559+0000","last_undegraded":"2023-10-14T11:13:53.364559+0000","last_fullsized":"2023-10-14T11:13:53.364559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:01.340314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246107+0000","last_change":"2023-10-14T11:13:50.253106+0000","last_active":"2023-10-14T11:13:52.246107+0000","last_peered":"2023-10-14T11:13:52.246107+0000","last_clean":"2023-10-14T11:13:52.246107+0000","last_became_active":"2023-10-14T11:13:50.252839+0000","last_became_peered":"2023-10-14T11:13:50.252839+0000","last_unstale":"2023-10-14T11:13:52.246107+0000","last_undegraded":"2023-10-14T11:13:52.246107+0000","last_fullsized":"2023-10-14T11:13:52.246107+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:06:24.669054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.245961+0000","last_change":"2023-10-14T11:13:51.255306+0000","last_active":"2023-10-14T11:13:52.245961+0000","last_peered":"2023-10-14T11:13:52.245961+0000","last_clean":"2023-10-14T11:13:52.245961+0000","last_became_active":"2023-10-14T11:13:51.255016+0000","last_became_peered":"2023-10-14T11:13:51.255016+0000","last_unstale":"2023-10-14T11:13:52.245961+0000","last_undegraded":"2023-10-14T11:13:52.245961+0000","last_fullsized":"2023-10-14T11:13:52.245961+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:28:56.464057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.247431+0000","last_change":"2023-10-14T11:13:50.247705+0000","last_active":"2023-10-14T11:13:53.247431+0000","last_peered":"2023-10-14T11:13:53.247431+0000","last_clean":"2023-10-14T11:13:53.247431+0000","last_became_active":"2023-10-14T11:13:50.247419+0000","last_became_peered":"2023-10-14T11:13:50.247419+0000","last_unstale":"2023-10-14T11:13:53.247431+0000","last_undegraded":"2023-10-14T11:13:53.247431+0000","last_fullsized":"2023-10-14T11:13:53.247431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:59.930607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215181+0000","last_change":"2023-10-14T11:13:51.240765+0000","last_active":"2023-10-14T11:13:53.215181+0000","last_peered":"2023-10-14T11:13:53.215181+0000","last_clean":"2023-10-14T11:13:53.215181+0000","last_became_active":"2023-10-14T11:13:51.240462+0000","last_became_peered":"2023-10-14T11:13:51.240462+0000","last_unstale":"2023-10-14T11:13:53.215181+0000","last_undegraded":"2023-10-14T11:13:53.215181+0000","last_fullsized":"2023-10-14T11:13:53.215181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:57.586320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246032+0000","last_change":"2023-10-14T11:13:50.243962+0000","last_active":"2023-10-14T11:13:52.246032+0000","last_peered":"2023-10-14T11:13:52.246032+0000","last_clean":"2023-10-14T11:13:52.246032+0000","last_became_active":"2023-10-14T11:13:50.243606+0000","last_became_peered":"2023-10-14T11:13:50.243606+0000","last_unstale":"2023-10-14T11:13:52.246032+0000","last_undegraded":"2023-10-14T11:13:52.246032+0000","last_fullsized":"2023-10-14T11:13:52.246032+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:48:06.196004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.245955+0000","last_change":"2023-10-14T11:13:51.261283+0000","last_active":"2023-10-14T11:13:52.245955+0000","last_peered":"2023-10-14T11:13:52.245955+0000","last_clean":"2023-10-14T11:13:52.245955+0000","last_became_active":"2023-10-14T11:13:51.260914+0000","last_became_peered":"2023-10-14T11:13:51.260914+0000","last_unstale":"2023-10-14T11:13:52.245955+0000","last_undegraded":"2023-10-14T11:13:52.245955+0000","last_fullsized":"2023-10-14T11:13:52.245955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:54:30.676855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215070+0000","last_change":"2023-10-14T11:13:50.243928+0000","last_active":"2023-10-14T11:13:53.215070+0000","last_peered":"2023-10-14T11:13:53.215070+0000","last_clean":"2023-10-14T11:13:53.215070+0000","last_became_active":"2023-10-14T11:13:50.243633+0000","last_became_peered":"2023-10-14T11:13:50.243633+0000","last_unstale":"2023-10-14T11:13:53.215070+0000","last_undegraded":"2023-10-14T11:13:53.215070+0000","last_fullsized":"2023-10-14T11:13:53.215070+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:59.930607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246121+0000","last_change":"2023-10-14T11:13:51.243823+0000","last_active":"2023-10-14T11:13:52.246121+0000","last_peered":"2023-10-14T11:13:52.246121+0000","last_clean":"2023-10-14T11:13:52.246121+0000","last_became_active":"2023-10-14T11:13:51.243544+0000","last_became_peered":"2023-10-14T11:13:51.243544+0000","last_unstale":"2023-10-14T11:13:52.246121+0000","last_undegraded":"2023-10-14T11:13:52.246121+0000","last_fullsized":"2023-10-14T11:13:52.246121+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:03:13.454300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.247096+0000","last_change":"2023-10-14T11:13:50.245802+0000","last_active":"2023-10-14T11:13:52.247096+0000","last_peered":"2023-10-14T11:13:52.247096+0000","last_clean":"2023-10-14T11:13:52.247096+0000","last_became_active":"2023-10-14T11:13:50.245331+0000","last_became_peered":"2023-10-14T11:13:50.245331+0000","last_unstale":"2023-10-14T11:13:52.247096+0000","last_undegraded":"2023-10-14T11:13:52.247096+0000","last_fullsized":"2023-10-14T11:13:52.247096+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:38:52.161620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.247361+0000","last_change":"2023-10-14T11:13:51.262568+0000","last_active":"2023-10-14T11:13:52.247361+0000","last_peered":"2023-10-14T11:13:52.247361+0000","last_clean":"2023-10-14T11:13:52.247361+0000","last_became_active":"2023-10-14T11:13:51.256375+0000","last_became_peered":"2023-10-14T11:13:51.256375+0000","last_unstale":"2023-10-14T11:13:52.247361+0000","last_undegraded":"2023-10-14T11:13:52.247361+0000","last_fullsized":"2023-10-14T11:13:52.247361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:15:09.074405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.375059+0000","last_change":"2023-10-14T11:13:50.247523+0000","last_active":"2023-10-14T11:13:52.375059+0000","last_peered":"2023-10-14T11:13:52.375059+0000","last_clean":"2023-10-14T11:13:52.375059+0000","last_became_active":"2023-10-14T11:13:50.247252+0000","last_became_peered":"2023-10-14T11:13:50.247252+0000","last_unstale":"2023-10-14T11:13:52.375059+0000","last_undegraded":"2023-10-14T11:13:52.375059+0000","last_fullsized":"2023-10-14T11:13:52.375059+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:48:58.192002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.374971+0000","last_change":"2023-10-14T11:13:51.263375+0000","last_active":"2023-10-14T11:13:52.374971+0000","last_peered":"2023-10-14T11:13:52.374971+0000","last_clean":"2023-10-14T11:13:52.374971+0000","last_became_active":"2023-10-14T11:13:51.263075+0000","last_became_peered":"2023-10-14T11:13:51.263075+0000","last_unstale":"2023-10-14T11:13:52.374971+0000","last_undegraded":"2023-10-14T11:13:52.374971+0000","last_fullsized":"2023-10-14T11:13:52.374971+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:48:07.899291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365692+0000","last_change":"2023-10-14T11:13:50.247667+0000","last_active":"2023-10-14T11:13:53.365692+0000","last_peered":"2023-10-14T11:13:53.365692+0000","last_clean":"2023-10-14T11:13:53.365692+0000","last_became_active":"2023-10-14T11:13:50.247378+0000","last_became_peered":"2023-10-14T11:13:50.247378+0000","last_unstale":"2023-10-14T11:13:53.365692+0000","last_undegraded":"2023-10-14T11:13:53.365692+0000","last_fullsized":"2023-10-14T11:13:53.365692+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:59:57.120504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365815+0000","last_change":"2023-10-14T11:13:51.257314+0000","last_active":"2023-10-14T11:13:53.365815+0000","last_peered":"2023-10-14T11:13:53.365815+0000","last_clean":"2023-10-14T11:13:53.365815+0000","last_became_active":"2023-10-14T11:13:51.252233+0000","last_became_peered":"2023-10-14T11:13:51.252233+0000","last_unstale":"2023-10-14T11:13:53.365815+0000","last_undegraded":"2023-10-14T11:13:53.365815+0000","last_fullsized":"2023-10-14T11:13:53.365815+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:43:04.509850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.247281+0000","last_change":"2023-10-14T11:13:50.240681+0000","last_active":"2023-10-14T11:13:53.247281+0000","last_peered":"2023-10-14T11:13:53.247281+0000","last_clean":"2023-10-14T11:13:53.247281+0000","last_became_active":"2023-10-14T11:13:50.240426+0000","last_became_peered":"2023-10-14T11:13:50.240426+0000","last_unstale":"2023-10-14T11:13:53.247281+0000","last_undegraded":"2023-10-14T11:13:53.247281+0000","last_fullsized":"2023-10-14T11:13:53.247281+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:15.946854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215340+0000","last_change":"2023-10-14T11:13:51.248278+0000","last_active":"2023-10-14T11:13:53.215340+0000","last_peered":"2023-10-14T11:13:53.215340+0000","last_clean":"2023-10-14T11:13:53.215340+0000","last_became_active":"2023-10-14T11:13:51.241244+0000","last_became_peered":"2023-10-14T11:13:51.241244+0000","last_unstale":"2023-10-14T11:13:53.215340+0000","last_undegraded":"2023-10-14T11:13:53.215340+0000","last_fullsized":"2023-10-14T11:13:53.215340+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:08:26.041683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365412+0000","last_change":"2023-10-14T11:13:50.235126+0000","last_active":"2023-10-14T11:13:53.365412+0000","last_peered":"2023-10-14T11:13:53.365412+0000","last_clean":"2023-10-14T11:13:53.365412+0000","last_became_active":"2023-10-14T11:13:50.234835+0000","last_became_peered":"2023-10-14T11:13:50.234835+0000","last_unstale":"2023-10-14T11:13:53.365412+0000","last_undegraded":"2023-10-14T11:13:53.365412+0000","last_fullsized":"2023-10-14T11:13:53.365412+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:35:24.132945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.364697+0000","last_change":"2023-10-14T11:13:51.248550+0000","last_active":"2023-10-14T11:13:53.364697+0000","last_peered":"2023-10-14T11:13:53.364697+0000","last_clean":"2023-10-14T11:13:53.364697+0000","last_became_active":"2023-10-14T11:13:51.248288+0000","last_became_peered":"2023-10-14T11:13:51.248288+0000","last_unstale":"2023-10-14T11:13:53.364697+0000","last_undegraded":"2023-10-14T11:13:53.364697+0000","last_fullsized":"2023-10-14T11:13:53.364697+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:02.076277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365429+0000","last_change":"2023-10-14T11:13:50.242083+0000","last_active":"2023-10-14T11:13:53.365429+0000","last_peered":"2023-10-14T11:13:53.365429+0000","last_clean":"2023-10-14T11:13:53.365429+0000","last_became_active":"2023-10-14T11:13:50.241824+0000","last_became_peered":"2023-10-14T11:13:50.241824+0000","last_unstale":"2023-10-14T11:13:53.365429+0000","last_undegraded":"2023-10-14T11:13:53.365429+0000","last_fullsized":"2023-10-14T11:13:53.365429+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:03:11.865944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246902+0000","last_change":"2023-10-14T11:13:51.255306+0000","last_active":"2023-10-14T11:13:52.246902+0000","last_peered":"2023-10-14T11:13:52.246902+0000","last_clean":"2023-10-14T11:13:52.246902+0000","last_became_active":"2023-10-14T11:13:51.255012+0000","last_became_peered":"2023-10-14T11:13:51.255012+0000","last_unstale":"2023-10-14T11:13:52.246902+0000","last_undegraded":"2023-10-14T11:13:52.246902+0000","last_fullsized":"2023-10-14T11:13:52.246902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:28:56.464057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215239+0000","last_change":"2023-10-14T11:13:50.251713+0000","last_active":"2023-10-14T11:13:53.215239+0000","last_peered":"2023-10-14T11:13:53.215239+0000","last_clean":"2023-10-14T11:13:53.215239+0000","last_became_active":"2023-10-14T11:13:50.251403+0000","last_became_peered":"2023-10-14T11:13:50.251403+0000","last_unstale":"2023-10-14T11:13:53.215239+0000","last_undegraded":"2023-10-14T11:13:53.215239+0000","last_fullsized":"2023-10-14T11:13:53.215239+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:10.016235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246089+0000","last_change":"2023-10-14T11:13:51.248036+0000","last_active":"2023-10-14T11:13:52.246089+0000","last_peered":"2023-10-14T11:13:52.246089+0000","last_clean":"2023-10-14T11:13:52.246089+0000","last_became_active":"2023-10-14T11:13:51.247467+0000","last_became_peered":"2023-10-14T11:13:51.247467+0000","last_unstale":"2023-10-14T11:13:52.246089+0000","last_undegraded":"2023-10-14T11:13:52.246089+0000","last_fullsized":"2023-10-14T11:13:52.246089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:46:46.144271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365159+0000","last_change":"2023-10-14T11:13:50.241508+0000","last_active":"2023-10-14T11:13:53.365159+0000","last_peered":"2023-10-14T11:13:53.365159+0000","last_clean":"2023-10-14T11:13:53.365159+0000","last_became_active":"2023-10-14T11:13:50.241236+0000","last_became_peered":"2023-10-14T11:13:50.241236+0000","last_unstale":"2023-10-14T11:13:53.365159+0000","last_undegraded":"2023-10-14T11:13:53.365159+0000","last_fullsized":"2023-10-14T11:13:53.365159+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:42:48.310436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.247277+0000","last_change":"2023-10-14T11:13:51.268895+0000","last_active":"2023-10-14T11:13:53.247277+0000","last_peered":"2023-10-14T11:13:53.247277+0000","last_clean":"2023-10-14T11:13:53.247277+0000","last_became_active":"2023-10-14T11:13:51.268615+0000","last_became_peered":"2023-10-14T11:13:51.268615+0000","last_unstale":"2023-10-14T11:13:53.247277+0000","last_undegraded":"2023-10-14T11:13:53.247277+0000","last_fullsized":"2023-10-14T11:13:53.247277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:04.174333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.247315+0000","last_change":"2023-10-14T11:13:50.247229+0000","last_active":"2023-10-14T11:13:52.247315+0000","last_peered":"2023-10-14T11:13:52.247315+0000","last_clean":"2023-10-14T11:13:52.247315+0000","last_became_active":"2023-10-14T11:13:50.238511+0000","last_became_peered":"2023-10-14T11:13:50.238511+0000","last_unstale":"2023-10-14T11:13:52.247315+0000","last_undegraded":"2023-10-14T11:13:52.247315+0000","last_fullsized":"2023-10-14T11:13:52.247315+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:28:36.182149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215526+0000","last_change":"2023-10-14T11:13:51.246361+0000","last_active":"2023-10-14T11:13:53.215526+0000","last_peered":"2023-10-14T11:13:53.215526+0000","last_clean":"2023-10-14T11:13:53.215526+0000","last_became_active":"2023-10-14T11:13:51.245594+0000","last_became_peered":"2023-10-14T11:13:51.245594+0000","last_unstale":"2023-10-14T11:13:53.215526+0000","last_undegraded":"2023-10-14T11:13:53.215526+0000","last_fullsized":"2023-10-14T11:13:53.215526+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:28:56.464057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.383182+0000","last_change":"2023-10-14T11:13:50.244927+0000","last_active":"2023-10-14T11:13:53.383182+0000","last_peered":"2023-10-14T11:13:53.383182+0000","last_clean":"2023-10-14T11:13:53.383182+0000","last_became_active":"2023-10-14T11:13:50.244657+0000","last_became_peered":"2023-10-14T11:13:50.244657+0000","last_unstale":"2023-10-14T11:13:53.383182+0000","last_undegraded":"2023-10-14T11:13:53.383182+0000","last_fullsized":"2023-10-14T11:13:53.383182+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:52.331457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246218+0000","last_change":"2023-10-14T11:13:51.247639+0000","last_active":"2023-10-14T11:13:52.246218+0000","last_peered":"2023-10-14T11:13:52.246218+0000","last_clean":"2023-10-14T11:13:52.246218+0000","last_became_active":"2023-10-14T11:13:51.247352+0000","last_became_peered":"2023-10-14T11:13:51.247352+0000","last_unstale":"2023-10-14T11:13:52.246218+0000","last_undegraded":"2023-10-14T11:13:52.246218+0000","last_fullsized":"2023-10-14T11:13:52.246218+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:15:09.074405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365115+0000","last_change":"2023-10-14T11:13:50.241701+0000","last_active":"2023-10-14T11:13:53.365115+0000","last_peered":"2023-10-14T11:13:53.365115+0000","last_clean":"2023-10-14T11:13:53.365115+0000","last_became_active":"2023-10-14T11:13:50.241445+0000","last_became_peered":"2023-10-14T11:13:50.241445+0000","last_unstale":"2023-10-14T11:13:53.365115+0000","last_undegraded":"2023-10-14T11:13:53.365115+0000","last_fullsized":"2023-10-14T11:13:53.365115+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:48:58.192002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.364718+0000","last_change":"2023-10-14T11:13:51.247117+0000","last_active":"2023-10-14T11:13:53.364718+0000","last_peered":"2023-10-14T11:13:53.364718+0000","last_clean":"2023-10-14T11:13:53.364718+0000","last_became_active":"2023-10-14T11:13:51.246718+0000","last_became_peered":"2023-10-14T11:13:51.246718+0000","last_unstale":"2023-10-14T11:13:53.364718+0000","last_undegraded":"2023-10-14T11:13:53.364718+0000","last_fullsized":"2023-10-14T11:13:53.364718+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:15.893881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.364923+0000","last_change":"2023-10-14T11:13:50.250195+0000","last_active":"2023-10-14T11:13:53.364923+0000","last_peered":"2023-10-14T11:13:53.364923+0000","last_clean":"2023-10-14T11:13:53.364923+0000","last_became_active":"2023-10-14T11:13:50.248792+0000","last_became_peered":"2023-10-14T11:13:50.248792+0000","last_unstale":"2023-10-14T11:13:53.364923+0000","last_undegraded":"2023-10-14T11:13:53.364923+0000","last_fullsized":"2023-10-14T11:13:53.364923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:15.946854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.247107+0000","last_change":"2023-10-14T11:13:51.261550+0000","last_active":"2023-10-14T11:13:53.247107+0000","last_peered":"2023-10-14T11:13:53.247107+0000","last_clean":"2023-10-14T11:13:53.247107+0000","last_became_active":"2023-10-14T11:13:51.261263+0000","last_became_peered":"2023-10-14T11:13:51.261263+0000","last_unstale":"2023-10-14T11:13:53.247107+0000","last_undegraded":"2023-10-14T11:13:53.247107+0000","last_fullsized":"2023-10-14T11:13:53.247107+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:02.076277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246622+0000","last_change":"2023-10-14T11:13:50.237845+0000","last_active":"2023-10-14T11:13:52.246622+0000","last_peered":"2023-10-14T11:13:52.246622+0000","last_clean":"2023-10-14T11:13:52.246622+0000","last_became_active":"2023-10-14T11:13:50.236657+0000","last_became_peered":"2023-10-14T11:13:50.236657+0000","last_unstale":"2023-10-14T11:13:52.246622+0000","last_undegraded":"2023-10-14T11:13:52.246622+0000","last_fullsized":"2023-10-14T11:13:52.246622+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:06:04.673156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.374505+0000","last_change":"2023-10-14T11:13:51.250299+0000","last_active":"2023-10-14T11:13:52.374505+0000","last_peered":"2023-10-14T11:13:52.374505+0000","last_clean":"2023-10-14T11:13:52.374505+0000","last_became_active":"2023-10-14T11:13:51.249877+0000","last_became_peered":"2023-10-14T11:13:51.249877+0000","last_unstale":"2023-10-14T11:13:52.374505+0000","last_undegraded":"2023-10-14T11:13:52.374505+0000","last_fullsized":"2023-10-14T11:13:52.374505+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:24:09.342629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.374464+0000","last_change":"2023-10-14T11:13:50.250609+0000","last_active":"2023-10-14T11:13:52.374464+0000","last_peered":"2023-10-14T11:13:52.374464+0000","last_clean":"2023-10-14T11:13:52.374464+0000","last_became_active":"2023-10-14T11:13:50.249857+0000","last_became_peered":"2023-10-14T11:13:50.249857+0000","last_unstale":"2023-10-14T11:13:52.374464+0000","last_undegraded":"2023-10-14T11:13:52.374464+0000","last_fullsized":"2023-10-14T11:13:52.374464+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:15.946854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215479+0000","last_change":"2023-10-14T11:13:51.246259+0000","last_active":"2023-10-14T11:13:53.215479+0000","last_peered":"2023-10-14T11:13:53.215479+0000","last_clean":"2023-10-14T11:13:53.215479+0000","last_became_active":"2023-10-14T11:13:51.245906+0000","last_became_peered":"2023-10-14T11:13:51.245906+0000","last_unstale":"2023-10-14T11:13:53.215479+0000","last_undegraded":"2023-10-14T11:13:53.215479+0000","last_fullsized":"2023-10-14T11:13:53.215479+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:54:30.676855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.245737+0000","last_change":"2023-10-14T11:13:50.244695+0000","last_active":"2023-10-14T11:13:52.245737+0000","last_peered":"2023-10-14T11:13:52.245737+0000","last_clean":"2023-10-14T11:13:52.245737+0000","last_became_active":"2023-10-14T11:13:50.244443+0000","last_became_peered":"2023-10-14T11:13:50.244443+0000","last_unstale":"2023-10-14T11:13:52.245737+0000","last_undegraded":"2023-10-14T11:13:52.245737+0000","last_fullsized":"2023-10-14T11:13:52.245737+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:34:13.989785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.247312+0000","last_change":"2023-10-14T11:13:51.265544+0000","last_active":"2023-10-14T11:13:52.247312+0000","last_peered":"2023-10-14T11:13:52.247312+0000","last_clean":"2023-10-14T11:13:52.247312+0000","last_became_active":"2023-10-14T11:13:51.264811+0000","last_became_peered":"2023-10-14T11:13:51.264811+0000","last_unstale":"2023-10-14T11:13:52.247312+0000","last_undegraded":"2023-10-14T11:13:52.247312+0000","last_fullsized":"2023-10-14T11:13:52.247312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:21:28.378533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215462+0000","last_change":"2023-10-14T11:13:50.251288+0000","last_active":"2023-10-14T11:13:53.215462+0000","last_peered":"2023-10-14T11:13:53.215462+0000","last_clean":"2023-10-14T11:13:53.215462+0000","last_became_active":"2023-10-14T11:13:50.251008+0000","last_became_peered":"2023-10-14T11:13:50.251008+0000","last_unstale":"2023-10-14T11:13:53.215462+0000","last_undegraded":"2023-10-14T11:13:53.215462+0000","last_fullsized":"2023-10-14T11:13:53.215462+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:12:25.825764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T11:13:51.228644+0000","last_change":"2023-10-14T11:12:12.162289+0000","last_active":"2023-10-14T11:13:51.228644+0000","last_peered":"2023-10-14T11:13:51.228644+0000","last_clean":"2023-10-14T11:13:51.228644+0000","last_became_active":"2023-10-14T11:12:12.161055+0000","last_became_peered":"2023-10-14T11:12:12.161055+0000","last_unstale":"2023-10-14T11:13:51.228644+0000","last_undegraded":"2023-10-14T11:13:51.228644+0000","last_fullsized":"2023-10-14T11:13:51.228644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_clean_scrub_stamp":"2023-10-14T11:12:10.853576+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:52.154107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1060864,"data_stored":785969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.6669999999999998,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.751}]},{"osd":1,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.80100000000000005}]},{"osd":2,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":2.5779999999999998,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":1.081},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.5070000000000001,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.96599999999999997}]},{"osd":3,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.8919999999999999,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":3.5489999999999999,"5min":3.5489999999999999,"15min":3.5489999999999999},"last":1.014}]},{"osd":4,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.82699999999999996}]},{"osd":5,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.878}]},{"osd":6,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.77200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":194501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.745},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.72899999999999998}]},{"osd":1,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.64100000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.624},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.77000000000000002}]},{"osd":3,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.69299999999999995}]},{"osd":4,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.52400000000000002}]},{"osd":5,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.46200000000000002}]},{"osd":7,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.66700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31628,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340212,"statfs":{"total":96636764160,"available":96604377088,"internally_reserved":0,"allocated":458752,"data_stored":194031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.86599999999999999}]},{"osd":1,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.88300000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.622},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.76100000000000001}]},{"osd":3,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.749},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.78700000000000003}]},{"osd":4,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.66900000000000004}]},{"osd":6,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.70299999999999996}]},{"osd":7,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.73099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31628,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340212,"statfs":{"total":96636764160,"available":96604377088,"internally_reserved":0,"allocated":458752,"data_stored":194523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.53500000000000003}]},{"osd":1,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.78200000000000003}]},{"osd":2,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.59299999999999997}]},{"osd":3,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.82599999999999996}]},{"osd":5,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.69099999999999995}]},{"osd":6,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.73399999999999999}]},{"osd":7,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.87}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":466944,"data_stored":195565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.436}]},{"osd":1,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.39800000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.51400000000000001}]},{"osd":4,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.66600000000000004}]},{"osd":5,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.56100000000000005}]},{"osd":6,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.625}]},{"osd":7,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.71099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":187344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.55200000000000005}]},{"osd":1,"last update":"Sat Oct 14 11:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.63800000000000001}]},{"osd":3,"last update":"Sat Oct 14 11:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.60199999999999998}]},{"osd":4,"last update":"Sat Oct 14 11:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.80300000000000005}]},{"osd":5,"last update":"Sat Oct 14 11:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.75},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.71499999999999997}]},{"osd":6,"last update":"Sat Oct 14 11:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.58699999999999997}]},{"osd":7,"last update":"Sat Oct 14 11:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.69899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":442368,"data_stored":187364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.377},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.437}]},{"osd":2,"last update":"Sat Oct 14 11:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.60099999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.58299999999999996}]},{"osd":4,"last update":"Sat Oct 14 11:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.76400000000000001}]},{"osd":5,"last update":"Sat Oct 14 11:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":0.80000000000000004}]},{"osd":6,"last update":"Sat Oct 14 11:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.75}]},{"osd":7,"last update":"Sat Oct 14 11:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.874}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1048576,"data_stored":784321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.41999999999999998}]},{"osd":2,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.436}]},{"osd":3,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.39800000000000002}]},{"osd":4,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.64100000000000001}]},{"osd":5,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.76200000000000001}]},{"osd":7,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.749}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:13:55.356 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:13:55.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.529+0000 7fec76cd6640 1 Processor -- start 2023-10-14T11:13:55.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.529+0000 7fec76cd6640 1 -- start start 2023-10-14T11:13:55.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.529+0000 7fec76cd6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fec7015cb90 0x7fec700cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:55.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.529+0000 7fec76cd6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec700ce770 con 0x7fec700d15d0 2023-10-14T11:13:55.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.529+0000 7fec76cd6640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec700d0600 con 0x7fec700d3010 2023-10-14T11:13:55.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.529+0000 7fec76cd6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec700c6450 con 0x7fec7015cb90 2023-10-14T11:13:55.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.529+0000 7fec75273640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fec700d15d0 0x7fec700c6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59848/0 (socket says 172.21.15.26:59848) 2023-10-14T11:13:55.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.529+0000 7fec75273640 1 -- 172.21.15.26:0/3864860636 learned_addr learned my addr 172.21.15.26:0/3864860636 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:55.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.529+0000 7fec74a72640 1 --2- 172.21.15.26:0/3864860636 >> v2:172.21.15.110:3300/0 conn(0x7fec7015cb90 0x7fec700cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:55.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.529+0000 7fec6f7fe640 1 -- 172.21.15.26:0/3864860636 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 856481472 0 0) 0x7fec700ce770 con 0x7fec700d15d0 2023-10-14T11:13:55.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.529+0000 7fec6f7fe640 1 -- 172.21.15.26:0/3864860636 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec60003530 con 0x7fec700d15d0 2023-10-14T11:13:55.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.533+0000 7fec6f7fe640 1 -- 172.21.15.26:0/3864860636 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3192825905 0 0) 0x7fec60003530 con 0x7fec700d15d0 2023-10-14T11:13:55.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.533+0000 7fec6f7fe640 1 -- 172.21.15.26:0/3864860636 >> v2:172.21.15.110:3300/0 conn(0x7fec7015cb90 msgr2=0x7fec700cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:55.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.533+0000 7fec6f7fe640 1 --2- 172.21.15.26:0/3864860636 >> v2:172.21.15.110:3300/0 conn(0x7fec7015cb90 0x7fec700cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.533+0000 7fec6f7fe640 1 -- 172.21.15.26:0/3864860636 >> v1:172.21.15.110:6789/0 conn(0x7fec700d3010 legacy=0x7fec700d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:55.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.533+0000 7fec6f7fe640 1 -- 172.21.15.26:0/3864860636 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec700d08a0 con 0x7fec700d15d0 2023-10-14T11:13:55.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.533+0000 7fec6f7fe640 1 -- 172.21.15.26:0/3864860636 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7fec68001a20 con 0x7fec700d15d0 2023-10-14T11:13:55.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.533+0000 7fec6f7fe640 1 -- 172.21.15.26:0/3864860636 >> v1:172.21.15.26:6789/0 conn(0x7fec700d15d0 legacy=0x7fec700c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:55.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.533+0000 7fec6f7fe640 1 --2- 172.21.15.26:0/3864860636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec60003980 0x7fec60003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:55.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.533+0000 7fec6f7fe640 1 --2- 172.21.15.26:0/3864860636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec600047d0 0x7fec60004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:55.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.533+0000 7fec6f7fe640 1 --2- 172.21.15.26:0/3864860636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec60005190 0x7fec6000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:55.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.533+0000 7fec6f7fe640 1 -- 172.21.15.26:0/3864860636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec700c6450 con 0x7fec600047d0 2023-10-14T11:13:55.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.533+0000 7fec6f7fe640 1 -- 172.21.15.26:0/3864860636 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6000c130 con 0x7fec60005190 2023-10-14T11:13:55.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.533+0000 7fec6f7fe640 1 -- 172.21.15.26:0/3864860636 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6000c2f0 con 0x7fec60003980 2023-10-14T11:13:55.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.533+0000 7fec6ffff640 1 --2- 172.21.15.26:0/3864860636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec600047d0 0x7fec60004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:55.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.533+0000 7fec74a72640 1 --2- 172.21.15.26:0/3864860636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec60003980 0x7fec60003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:55.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.533+0000 7fec75273640 1 --2- 172.21.15.26:0/3864860636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec60005190 0x7fec6000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:55.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.533+0000 7fec6ffff640 1 -- 172.21.15.26:0/3864860636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec60003980 msgr2=0x7fec60003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:55.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.533+0000 7fec6ffff640 1 --2- 172.21.15.26:0/3864860636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec60003980 0x7fec60003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.533+0000 7fec6ffff640 1 -- 172.21.15.26:0/3864860636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec60005190 msgr2=0x7fec6000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:55.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.533+0000 7fec6ffff640 1 --2- 172.21.15.26:0/3864860636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec60005190 0x7fec6000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.533+0000 7fec6ffff640 1 -- 172.21.15.26:0/3864860636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec60003530 con 0x7fec600047d0 2023-10-14T11:13:55.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.533+0000 7fec75273640 1 -- 172.21.15.26:0/3864860636 reap_dead start 2023-10-14T11:13:55.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.537+0000 7fec6ffff640 1 --2- 172.21.15.26:0/3864860636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec600047d0 0x7fec60004c50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fec5c001780 tx=0x7fec5c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a012b30757070668 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:55.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.537+0000 7fec6f7fe640 1 -- 172.21.15.26:0/3864860636 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c0052d0 con 0x7fec600047d0 2023-10-14T11:13:55.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.537+0000 7fec6f7fe640 1 -- 172.21.15.26:0/3864860636 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c005450 con 0x7fec600047d0 2023-10-14T11:13:55.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.537+0000 7fec6f7fe640 1 -- 172.21.15.26:0/3864860636 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c003840 con 0x7fec600047d0 2023-10-14T11:13:55.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.537+0000 7fec76cd6640 1 -- 172.21.15.26:0/3864860636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec600047d0 msgr2=0x7fec60004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:55.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.537+0000 7fec76cd6640 1 --2- 172.21.15.26:0/3864860636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec600047d0 0x7fec60004c50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fec5c001780 tx=0x7fec5c01c3b0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.537+0000 7fec76cd6640 1 -- 172.21.15.26:0/3864860636 shutdown_connections 2023-10-14T11:13:55.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.537+0000 7fec76cd6640 1 --2- 172.21.15.26:0/3864860636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec600047d0 0x7fec60004c50 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.537+0000 7fec76cd6640 1 -- 172.21.15.26:0/3864860636 >> 172.21.15.26:0/3864860636 conn(0x7fec7009bc50 msgr2=0x7fec700d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:55.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.537+0000 7fec76cd6640 1 -- 172.21.15.26:0/3864860636 shutdown_connections 2023-10-14T11:13:55.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.537+0000 7fec76cd6640 1 -- 172.21.15.26:0/3864860636 wait complete. 2023-10-14T11:13:55.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.537+0000 7fec76cd6640 1 Processor -- start 2023-10-14T11:13:55.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.537+0000 7fec76cd6640 1 -- start start 2023-10-14T11:13:55.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.537+0000 7fec76cd6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec600047d0 0x7fec700b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:55.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.537+0000 7fec76cd6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec700b6160 0x7fec7015aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:55.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.537+0000 7fec76cd6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec7015b000 0x7fec701e9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:55.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.537+0000 7fec76cd6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec70158760 con 0x7fec700b6160 2023-10-14T11:13:55.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.537+0000 7fec76cd6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec70158a40 con 0x7fec600047d0 2023-10-14T11:13:55.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.537+0000 7fec76cd6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec70158d20 con 0x7fec7015b000 2023-10-14T11:13:55.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.541+0000 7fec6ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec700b6160 0x7fec7015aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:55.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.541+0000 7fec6ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec700b6160 0x7fec7015aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39244/0 (socket says 172.21.15.26:39244) 2023-10-14T11:13:55.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.541+0000 7fec6ffff640 1 -- 172.21.15.26:0/3944637706 learned_addr learned my addr 172.21.15.26:0/3944637706 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:55.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.541+0000 7fec74a72640 1 --2- 172.21.15.26:0/3944637706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec600047d0 0x7fec700b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:55.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.541+0000 7fec75273640 1 --2- 172.21.15.26:0/3944637706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec7015b000 0x7fec701e9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:55.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.541+0000 7fec6ffff640 1 -- 172.21.15.26:0/3944637706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec7015b000 msgr2=0x7fec701e9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:55.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.541+0000 7fec6ffff640 1 --2- 172.21.15.26:0/3944637706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec7015b000 0x7fec701e9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.541+0000 7fec6ffff640 1 -- 172.21.15.26:0/3944637706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec600047d0 msgr2=0x7fec700b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:55.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.541+0000 7fec6ffff640 1 --2- 172.21.15.26:0/3944637706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec600047d0 0x7fec700b5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.541+0000 7fec6ffff640 1 -- 172.21.15.26:0/3944637706 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec70159000 con 0x7fec700b6160 2023-10-14T11:13:55.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.541+0000 7fec6ffff640 1 --2- 172.21.15.26:0/3944637706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec700b6160 0x7fec7015aac0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fec5c001780 tx=0x7fec60005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:55.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.541+0000 7fec6d7fa640 1 -- 172.21.15.26:0/3944637706 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c0bb070 con 0x7fec700b6160 2023-10-14T11:13:55.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.541+0000 7fec6d7fa640 1 -- 172.21.15.26:0/3944637706 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c0052d0 con 0x7fec700b6160 2023-10-14T11:13:55.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.541+0000 7fec6d7fa640 1 -- 172.21.15.26:0/3944637706 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c007040 con 0x7fec700b6160 2023-10-14T11:13:55.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.541+0000 7fec76cd6640 1 -- 172.21.15.26:0/3944637706 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec701592e0 con 0x7fec700b6160 2023-10-14T11:13:55.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.541+0000 7fec76cd6640 1 -- 172.21.15.26:0/3944637706 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec701e9b70 con 0x7fec700b6160 2023-10-14T11:13:55.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.541+0000 7fec76cd6640 1 -- 172.21.15.26:0/3944637706 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec70159470 con 0x7fec700b6160 2023-10-14T11:13:55.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.541+0000 7fec6d7fa640 1 -- 172.21.15.26:0/3944637706 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fec5c0071a0 con 0x7fec700b6160 2023-10-14T11:13:55.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.545+0000 7fec6d7fa640 1 --2- 172.21.15.26:0/3944637706 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fec540664d0 0x7fec54068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:55.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.545+0000 7fec6d7fa640 1 -- 172.21.15.26:0/3944637706 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fec5c11cee0 con 0x7fec700b6160 2023-10-14T11:13:55.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.545+0000 7fec74a72640 1 --2- 172.21.15.26:0/3944637706 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fec540664d0 0x7fec54068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:55.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.545+0000 7fec74a72640 1 --2- 172.21.15.26:0/3944637706 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fec540664d0 0x7fec54068990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fec70068cd0 tx=0x7fec64006f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:55.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.549+0000 7fec6d7fa640 1 -- 172.21.15.26:0/3944637706 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fec5c0eddc0 con 0x7fec700b6160 2023-10-14T11:13:55.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.701+0000 7fec76cd6640 1 -- 172.21.15.26:0/3944637706 --> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fec701e9e20 con 0x7fec540664d0 2023-10-14T11:13:55.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.709+0000 7fec6d7fa640 1 -- 172.21.15.26:0/3944637706 <== mgr.4101 v2:172.21.15.26:6832/4136446821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289124 (secure 0 0 0) 0x7fec701e9e20 con 0x7fec540664d0 2023-10-14T11:13:55.716 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:55.718 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-14T11:13:55.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.713+0000 7fec76cd6640 1 -- 172.21.15.26:0/3944637706 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fec540664d0 msgr2=0x7fec54068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:55.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.713+0000 7fec76cd6640 1 --2- 172.21.15.26:0/3944637706 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fec540664d0 0x7fec54068990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fec70068cd0 tx=0x7fec64006f90 comp rx=0 tx=0).stop 2023-10-14T11:13:55.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.713+0000 7fec76cd6640 1 -- 172.21.15.26:0/3944637706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec700b6160 msgr2=0x7fec7015aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.713+0000 7fec76cd6640 1 --2- 172.21.15.26:0/3944637706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec700b6160 0x7fec7015aac0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fec5c001780 tx=0x7fec60005800 comp rx=0 tx=0).stop 2023-10-14T11:13:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.713+0000 7fec76cd6640 1 -- 172.21.15.26:0/3944637706 shutdown_connections 2023-10-14T11:13:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.713+0000 7fec76cd6640 1 --2- 172.21.15.26:0/3944637706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec7015b000 0x7fec701e9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.713+0000 7fec76cd6640 1 --2- 172.21.15.26:0/3944637706 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fec540664d0 0x7fec54068990 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.713+0000 7fec76cd6640 1 --2- 172.21.15.26:0/3944637706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec700b6160 0x7fec7015aac0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.713+0000 7fec76cd6640 1 --2- 172.21.15.26:0/3944637706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec600047d0 0x7fec700b5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.713+0000 7fec76cd6640 1 -- 172.21.15.26:0/3944637706 >> 172.21.15.26:0/3944637706 conn(0x7fec7009bc50 msgr2=0x7fec700d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:55.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.713+0000 7fec76cd6640 1 -- 172.21.15.26:0/3944637706 shutdown_connections 2023-10-14T11:13:55.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.713+0000 7fec76cd6640 1 -- 172.21.15.26:0/3944637706 wait complete. 2023-10-14T11:13:55.736 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2023-10-14T11:13:54.178806+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":250024,"kb_used_data":4720,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754724696,"statfs":{"total":773094113280,"available":772838088704,"internally_reserved":0,"allocated":4833280,"data_stored":2723618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":251055672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.963886"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246441+0000","last_change":"2023-10-14T11:13:51.258265+0000","last_active":"2023-10-14T11:13:52.246441+0000","last_peered":"2023-10-14T11:13:52.246441+0000","last_clean":"2023-10-14T11:13:52.246441+0000","last_became_active":"2023-10-14T11:13:51.256249+0000","last_became_peered":"2023-10-14T11:13:51.256249+0000","last_unstale":"2023-10-14T11:13:52.246441+0000","last_undegraded":"2023-10-14T11:13:52.246441+0000","last_fullsized":"2023-10-14T11:13:52.246441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:40:55.119647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246182+0000","last_change":"2023-10-14T11:13:51.264990+0000","last_active":"2023-10-14T11:13:52.246182+0000","last_peered":"2023-10-14T11:13:52.246182+0000","last_clean":"2023-10-14T11:13:52.246182+0000","last_became_active":"2023-10-14T11:13:51.264702+0000","last_became_peered":"2023-10-14T11:13:51.264702+0000","last_unstale":"2023-10-14T11:13:52.246182+0000","last_undegraded":"2023-10-14T11:13:52.246182+0000","last_fullsized":"2023-10-14T11:13:52.246182+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:21:28.378533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365469+0000","last_change":"2023-10-14T11:13:51.265815+0000","last_active":"2023-10-14T11:13:53.365469+0000","last_peered":"2023-10-14T11:13:53.365469+0000","last_clean":"2023-10-14T11:13:53.365469+0000","last_became_active":"2023-10-14T11:13:51.265408+0000","last_became_peered":"2023-10-14T11:13:51.265408+0000","last_unstale":"2023-10-14T11:13:53.365469+0000","last_undegraded":"2023-10-14T11:13:53.365469+0000","last_fullsized":"2023-10-14T11:13:53.365469+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:48:07.899291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365517+0000","last_change":"2023-10-14T11:13:51.250180+0000","last_active":"2023-10-14T11:13:53.365517+0000","last_peered":"2023-10-14T11:13:53.365517+0000","last_clean":"2023-10-14T11:13:53.365517+0000","last_became_active":"2023-10-14T11:13:51.249461+0000","last_became_peered":"2023-10-14T11:13:51.249461+0000","last_unstale":"2023-10-14T11:13:53.365517+0000","last_undegraded":"2023-10-14T11:13:53.365517+0000","last_fullsized":"2023-10-14T11:13:53.365517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:53:39.065274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365550+0000","last_change":"2023-10-14T11:13:51.247768+0000","last_active":"2023-10-14T11:13:53.365550+0000","last_peered":"2023-10-14T11:13:53.365550+0000","last_clean":"2023-10-14T11:13:53.365550+0000","last_became_active":"2023-10-14T11:13:51.247501+0000","last_became_peered":"2023-10-14T11:13:51.247501+0000","last_unstale":"2023-10-14T11:13:53.365550+0000","last_undegraded":"2023-10-14T11:13:53.365550+0000","last_fullsized":"2023-10-14T11:13:53.365550+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:01:55.213561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.247476+0000","last_change":"2023-10-14T11:13:51.273812+0000","last_active":"2023-10-14T11:13:53.247476+0000","last_peered":"2023-10-14T11:13:53.247476+0000","last_clean":"2023-10-14T11:13:53.247476+0000","last_became_active":"2023-10-14T11:13:51.273443+0000","last_became_peered":"2023-10-14T11:13:51.273443+0000","last_unstale":"2023-10-14T11:13:53.247476+0000","last_undegraded":"2023-10-14T11:13:53.247476+0000","last_fullsized":"2023-10-14T11:13:53.247476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:34:14.998558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246478+0000","last_change":"2023-10-14T11:13:51.262079+0000","last_active":"2023-10-14T11:13:52.246478+0000","last_peered":"2023-10-14T11:13:52.246478+0000","last_clean":"2023-10-14T11:13:52.246478+0000","last_became_active":"2023-10-14T11:13:51.261798+0000","last_became_peered":"2023-10-14T11:13:51.261798+0000","last_unstale":"2023-10-14T11:13:52.246478+0000","last_undegraded":"2023-10-14T11:13:52.246478+0000","last_fullsized":"2023-10-14T11:13:52.246478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:06:25.677827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.245660+0000","last_change":"2023-10-14T11:13:51.267011+0000","last_active":"2023-10-14T11:13:52.245660+0000","last_peered":"2023-10-14T11:13:52.245660+0000","last_clean":"2023-10-14T11:13:52.245660+0000","last_became_active":"2023-10-14T11:13:51.266722+0000","last_became_peered":"2023-10-14T11:13:51.266722+0000","last_unstale":"2023-10-14T11:13:52.245660+0000","last_undegraded":"2023-10-14T11:13:52.245660+0000","last_fullsized":"2023-10-14T11:13:52.245660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:20:08.879231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365623+0000","last_change":"2023-10-14T11:13:51.269276+0000","last_active":"2023-10-14T11:13:53.365623+0000","last_peered":"2023-10-14T11:13:53.365623+0000","last_clean":"2023-10-14T11:13:53.365623+0000","last_became_active":"2023-10-14T11:13:51.268939+0000","last_became_peered":"2023-10-14T11:13:51.268939+0000","last_unstale":"2023-10-14T11:13:53.365623+0000","last_undegraded":"2023-10-14T11:13:53.365623+0000","last_fullsized":"2023-10-14T11:13:53.365623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:12:26.834537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.247147+0000","last_change":"2023-10-14T11:13:51.255564+0000","last_active":"2023-10-14T11:13:52.247147+0000","last_peered":"2023-10-14T11:13:52.247147+0000","last_clean":"2023-10-14T11:13:52.247147+0000","last_became_active":"2023-10-14T11:13:51.255298+0000","last_became_peered":"2023-10-14T11:13:51.255298+0000","last_unstale":"2023-10-14T11:13:52.247147+0000","last_undegraded":"2023-10-14T11:13:52.247147+0000","last_fullsized":"2023-10-14T11:13:52.247147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:46:46.144271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.247206+0000","last_change":"2023-10-14T11:13:51.264327+0000","last_active":"2023-10-14T11:13:52.247206+0000","last_peered":"2023-10-14T11:13:52.247206+0000","last_clean":"2023-10-14T11:13:52.247206+0000","last_became_active":"2023-10-14T11:13:51.261412+0000","last_became_peered":"2023-10-14T11:13:51.261412+0000","last_unstale":"2023-10-14T11:13:52.247206+0000","last_undegraded":"2023-10-14T11:13:52.247206+0000","last_fullsized":"2023-10-14T11:13:52.247206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:03:13.454300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.364974+0000","last_change":"2023-10-14T11:13:51.265430+0000","last_active":"2023-10-14T11:13:53.364974+0000","last_peered":"2023-10-14T11:13:53.364974+0000","last_clean":"2023-10-14T11:13:53.364974+0000","last_became_active":"2023-10-14T11:13:51.265036+0000","last_became_peered":"2023-10-14T11:13:51.265036+0000","last_unstale":"2023-10-14T11:13:53.364974+0000","last_undegraded":"2023-10-14T11:13:53.364974+0000","last_fullsized":"2023-10-14T11:13:53.364974+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:04.174333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246397+0000","last_change":"2023-10-14T11:13:51.261179+0000","last_active":"2023-10-14T11:13:52.246397+0000","last_peered":"2023-10-14T11:13:52.246397+0000","last_clean":"2023-10-14T11:13:52.246397+0000","last_became_active":"2023-10-14T11:13:51.254826+0000","last_became_peered":"2023-10-14T11:13:51.254826+0000","last_unstale":"2023-10-14T11:13:52.246397+0000","last_undegraded":"2023-10-14T11:13:52.246397+0000","last_fullsized":"2023-10-14T11:13:52.246397+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:57.586320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.374497+0000","last_change":"2023-10-14T11:13:51.250106+0000","last_active":"2023-10-14T11:13:52.374497+0000","last_peered":"2023-10-14T11:13:52.374497+0000","last_clean":"2023-10-14T11:13:52.374497+0000","last_became_active":"2023-10-14T11:13:51.248912+0000","last_became_peered":"2023-10-14T11:13:51.248912+0000","last_unstale":"2023-10-14T11:13:52.374497+0000","last_undegraded":"2023-10-14T11:13:52.374497+0000","last_fullsized":"2023-10-14T11:13:52.374497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:01.340314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246632+0000","last_change":"2023-10-14T11:13:51.255649+0000","last_active":"2023-10-14T11:13:52.246632+0000","last_peered":"2023-10-14T11:13:52.246632+0000","last_clean":"2023-10-14T11:13:52.246632+0000","last_became_active":"2023-10-14T11:13:51.255342+0000","last_became_peered":"2023-10-14T11:13:51.255342+0000","last_unstale":"2023-10-14T11:13:52.246632+0000","last_undegraded":"2023-10-14T11:13:52.246632+0000","last_fullsized":"2023-10-14T11:13:52.246632+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:20:08.879231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215109+0000","last_change":"2023-10-14T11:13:51.265493+0000","last_active":"2023-10-14T11:13:53.215109+0000","last_peered":"2023-10-14T11:13:53.215109+0000","last_clean":"2023-10-14T11:13:53.215109+0000","last_became_active":"2023-10-14T11:13:51.265171+0000","last_became_peered":"2023-10-14T11:13:51.265171+0000","last_unstale":"2023-10-14T11:13:53.215109+0000","last_undegraded":"2023-10-14T11:13:53.215109+0000","last_fullsized":"2023-10-14T11:13:53.215109+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:38:53.170393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215675+0000","last_change":"2023-10-14T11:13:51.266124+0000","last_active":"2023-10-14T11:13:53.215675+0000","last_peered":"2023-10-14T11:13:53.215675+0000","last_clean":"2023-10-14T11:13:53.215675+0000","last_became_active":"2023-10-14T11:13:51.265771+0000","last_became_peered":"2023-10-14T11:13:51.265771+0000","last_unstale":"2023-10-14T11:13:53.215675+0000","last_undegraded":"2023-10-14T11:13:53.215675+0000","last_fullsized":"2023-10-14T11:13:53.215675+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:46:46.144271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246724+0000","last_change":"2023-10-14T11:13:51.248671+0000","last_active":"2023-10-14T11:13:52.246724+0000","last_peered":"2023-10-14T11:13:52.246724+0000","last_clean":"2023-10-14T11:13:52.246724+0000","last_became_active":"2023-10-14T11:13:51.248126+0000","last_became_peered":"2023-10-14T11:13:51.248126+0000","last_unstale":"2023-10-14T11:13:52.246724+0000","last_undegraded":"2023-10-14T11:13:52.246724+0000","last_fullsized":"2023-10-14T11:13:52.246724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:00.939380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365726+0000","last_change":"2023-10-14T11:13:51.258571+0000","last_active":"2023-10-14T11:13:53.365726+0000","last_peered":"2023-10-14T11:13:53.365726+0000","last_clean":"2023-10-14T11:13:53.365726+0000","last_became_active":"2023-10-14T11:13:51.258191+0000","last_became_peered":"2023-10-14T11:13:51.258191+0000","last_unstale":"2023-10-14T11:13:53.365726+0000","last_undegraded":"2023-10-14T11:13:53.365726+0000","last_fullsized":"2023-10-14T11:13:53.365726+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:20.636866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246215+0000","last_change":"2023-10-14T11:13:51.247876+0000","last_active":"2023-10-14T11:13:52.246215+0000","last_peered":"2023-10-14T11:13:52.246215+0000","last_clean":"2023-10-14T11:13:52.246215+0000","last_became_active":"2023-10-14T11:13:51.247640+0000","last_became_peered":"2023-10-14T11:13:51.247640+0000","last_unstale":"2023-10-14T11:13:52.246215+0000","last_undegraded":"2023-10-14T11:13:52.246215+0000","last_fullsized":"2023-10-14T11:13:52.246215+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:42:13.144647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246545+0000","last_change":"2023-10-14T11:13:51.256439+0000","last_active":"2023-10-14T11:13:52.246545+0000","last_peered":"2023-10-14T11:13:52.246545+0000","last_clean":"2023-10-14T11:13:52.246545+0000","last_became_active":"2023-10-14T11:13:51.256166+0000","last_became_peered":"2023-10-14T11:13:51.256166+0000","last_unstale":"2023-10-14T11:13:52.246545+0000","last_undegraded":"2023-10-14T11:13:52.246545+0000","last_fullsized":"2023-10-14T11:13:52.246545+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:08:26.041683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.374841+0000","last_change":"2023-10-14T11:13:51.250151+0000","last_active":"2023-10-14T11:13:52.374841+0000","last_peered":"2023-10-14T11:13:52.374841+0000","last_clean":"2023-10-14T11:13:52.374841+0000","last_became_active":"2023-10-14T11:13:51.249808+0000","last_became_peered":"2023-10-14T11:13:51.249808+0000","last_unstale":"2023-10-14T11:13:52.374841+0000","last_undegraded":"2023-10-14T11:13:52.374841+0000","last_fullsized":"2023-10-14T11:13:52.374841+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:15.893881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215129+0000","last_change":"2023-10-14T11:13:51.242174+0000","last_active":"2023-10-14T11:13:53.215129+0000","last_peered":"2023-10-14T11:13:53.215129+0000","last_clean":"2023-10-14T11:13:53.215129+0000","last_became_active":"2023-10-14T11:13:51.241578+0000","last_became_peered":"2023-10-14T11:13:51.241578+0000","last_unstale":"2023-10-14T11:13:53.215129+0000","last_undegraded":"2023-10-14T11:13:53.215129+0000","last_fullsized":"2023-10-14T11:13:53.215129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:28:37.190921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365272+0000","last_change":"2023-10-14T11:13:51.238309+0000","last_active":"2023-10-14T11:13:53.365272+0000","last_peered":"2023-10-14T11:13:53.365272+0000","last_clean":"2023-10-14T11:13:53.365272+0000","last_became_active":"2023-10-14T11:13:51.237984+0000","last_became_peered":"2023-10-14T11:13:51.237984+0000","last_unstale":"2023-10-14T11:13:53.365272+0000","last_undegraded":"2023-10-14T11:13:53.365272+0000","last_fullsized":"2023-10-14T11:13:53.365272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:41:22.721947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246810+0000","last_change":"2023-10-14T11:13:51.258315+0000","last_active":"2023-10-14T11:13:52.246810+0000","last_peered":"2023-10-14T11:13:52.246810+0000","last_clean":"2023-10-14T11:13:52.246810+0000","last_became_active":"2023-10-14T11:13:51.258035+0000","last_became_peered":"2023-10-14T11:13:51.258035+0000","last_unstale":"2023-10-14T11:13:52.246810+0000","last_undegraded":"2023-10-14T11:13:52.246810+0000","last_fullsized":"2023-10-14T11:13:52.246810+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:20:58.176655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.247298+0000","last_change":"2023-10-14T11:13:51.266727+0000","last_active":"2023-10-14T11:13:53.247298+0000","last_peered":"2023-10-14T11:13:53.247298+0000","last_clean":"2023-10-14T11:13:53.247298+0000","last_became_active":"2023-10-14T11:13:51.266459+0000","last_became_peered":"2023-10-14T11:13:51.266459+0000","last_unstale":"2023-10-14T11:13:53.247298+0000","last_undegraded":"2023-10-14T11:13:53.247298+0000","last_fullsized":"2023-10-14T11:13:53.247298+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:48:07.899291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246392+0000","last_change":"2023-10-14T11:13:51.249423+0000","last_active":"2023-10-14T11:13:52.246392+0000","last_peered":"2023-10-14T11:13:52.246392+0000","last_clean":"2023-10-14T11:13:52.246392+0000","last_became_active":"2023-10-14T11:13:51.244262+0000","last_became_peered":"2023-10-14T11:13:51.244262+0000","last_unstale":"2023-10-14T11:13:52.246392+0000","last_undegraded":"2023-10-14T11:13:52.246392+0000","last_fullsized":"2023-10-14T11:13:52.246392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:16.955627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.247033+0000","last_change":"2023-10-14T11:13:51.253130+0000","last_active":"2023-10-14T11:13:52.247033+0000","last_peered":"2023-10-14T11:13:52.247033+0000","last_clean":"2023-10-14T11:13:52.247033+0000","last_became_active":"2023-10-14T11:13:51.252859+0000","last_became_peered":"2023-10-14T11:13:51.252859+0000","last_unstale":"2023-10-14T11:13:52.247033+0000","last_undegraded":"2023-10-14T11:13:52.247033+0000","last_fullsized":"2023-10-14T11:13:52.247033+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:23.174548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246392+0000","last_change":"2023-10-14T11:13:51.255477+0000","last_active":"2023-10-14T11:13:52.246392+0000","last_peered":"2023-10-14T11:13:52.246392+0000","last_clean":"2023-10-14T11:13:52.246392+0000","last_became_active":"2023-10-14T11:13:51.255161+0000","last_became_peered":"2023-10-14T11:13:51.255161+0000","last_unstale":"2023-10-14T11:13:52.246392+0000","last_undegraded":"2023-10-14T11:13:52.246392+0000","last_fullsized":"2023-10-14T11:13:52.246392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:32.925589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246543+0000","last_change":"2023-10-14T11:13:51.246889+0000","last_active":"2023-10-14T11:13:52.246543+0000","last_peered":"2023-10-14T11:13:52.246543+0000","last_clean":"2023-10-14T11:13:52.246543+0000","last_became_active":"2023-10-14T11:13:51.246565+0000","last_became_peered":"2023-10-14T11:13:51.246565+0000","last_unstale":"2023-10-14T11:13:52.246543+0000","last_undegraded":"2023-10-14T11:13:52.246543+0000","last_fullsized":"2023-10-14T11:13:52.246543+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:48:59.200774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215238+0000","last_change":"2023-10-14T11:13:51.242349+0000","last_active":"2023-10-14T11:13:53.215238+0000","last_peered":"2023-10-14T11:13:53.215238+0000","last_clean":"2023-10-14T11:13:53.215238+0000","last_became_active":"2023-10-14T11:13:51.241906+0000","last_became_peered":"2023-10-14T11:13:51.241906+0000","last_unstale":"2023-10-14T11:13:53.215238+0000","last_undegraded":"2023-10-14T11:13:53.215238+0000","last_fullsized":"2023-10-14T11:13:53.215238+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:06:25.677827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.247117+0000","last_change":"2023-10-14T11:13:51.257462+0000","last_active":"2023-10-14T11:13:53.247117+0000","last_peered":"2023-10-14T11:13:53.247117+0000","last_clean":"2023-10-14T11:13:53.247117+0000","last_became_active":"2023-10-14T11:13:51.257187+0000","last_became_peered":"2023-10-14T11:13:51.257187+0000","last_unstale":"2023-10-14T11:13:53.247117+0000","last_undegraded":"2023-10-14T11:13:53.247117+0000","last_fullsized":"2023-10-14T11:13:53.247117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:15.893881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215456+0000","last_change":"2023-10-14T11:13:51.257575+0000","last_active":"2023-10-14T11:13:53.215456+0000","last_peered":"2023-10-14T11:13:53.215456+0000","last_clean":"2023-10-14T11:13:53.215456+0000","last_became_active":"2023-10-14T11:13:51.257288+0000","last_became_peered":"2023-10-14T11:13:51.257288+0000","last_unstale":"2023-10-14T11:13:53.215456+0000","last_undegraded":"2023-10-14T11:13:53.215456+0000","last_fullsized":"2023-10-14T11:13:53.215456+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:20:08.879231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246821+0000","last_change":"2023-10-14T11:13:50.244550+0000","last_active":"2023-10-14T11:13:52.246821+0000","last_peered":"2023-10-14T11:13:52.246821+0000","last_clean":"2023-10-14T11:13:52.246821+0000","last_became_active":"2023-10-14T11:13:50.244238+0000","last_became_peered":"2023-10-14T11:13:50.244238+0000","last_unstale":"2023-10-14T11:13:52.246821+0000","last_undegraded":"2023-10-14T11:13:52.246821+0000","last_fullsized":"2023-10-14T11:13:52.246821+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:54.409746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.247534+0000","last_change":"2023-10-14T11:13:51.272678+0000","last_active":"2023-10-14T11:13:53.247534+0000","last_peered":"2023-10-14T11:13:53.247534+0000","last_clean":"2023-10-14T11:13:53.247534+0000","last_became_active":"2023-10-14T11:13:51.268997+0000","last_became_peered":"2023-10-14T11:13:51.268997+0000","last_unstale":"2023-10-14T11:13:53.247534+0000","last_undegraded":"2023-10-14T11:13:53.247534+0000","last_fullsized":"2023-10-14T11:13:53.247534+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:12:26.834537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365575+0000","last_change":"2023-10-14T11:13:50.244499+0000","last_active":"2023-10-14T11:13:53.365575+0000","last_peered":"2023-10-14T11:13:53.365575+0000","last_clean":"2023-10-14T11:13:53.365575+0000","last_became_active":"2023-10-14T11:13:50.244218+0000","last_became_peered":"2023-10-14T11:13:50.244218+0000","last_unstale":"2023-10-14T11:13:53.365575+0000","last_undegraded":"2023-10-14T11:13:53.365575+0000","last_fullsized":"2023-10-14T11:13:53.365575+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:31.916817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.375006+0000","last_change":"2023-10-14T11:13:51.245228+0000","last_active":"2023-10-14T11:13:52.375006+0000","last_peered":"2023-10-14T11:13:52.375006+0000","last_clean":"2023-10-14T11:13:52.375006+0000","last_became_active":"2023-10-14T11:13:51.244929+0000","last_became_peered":"2023-10-14T11:13:51.244929+0000","last_unstale":"2023-10-14T11:13:52.375006+0000","last_undegraded":"2023-10-14T11:13:52.375006+0000","last_fullsized":"2023-10-14T11:13:52.375006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:34:14.998558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.247665+0000","last_change":"2023-10-14T11:13:50.250350+0000","last_active":"2023-10-14T11:13:53.247665+0000","last_peered":"2023-10-14T11:13:53.247665+0000","last_clean":"2023-10-14T11:13:53.247665+0000","last_became_active":"2023-10-14T11:13:50.250066+0000","last_became_peered":"2023-10-14T11:13:50.250066+0000","last_unstale":"2023-10-14T11:13:53.247665+0000","last_undegraded":"2023-10-14T11:13:53.247665+0000","last_fullsized":"2023-10-14T11:13:53.247665+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:20:57.167883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246411+0000","last_change":"2023-10-14T11:13:51.242883+0000","last_active":"2023-10-14T11:13:52.246411+0000","last_peered":"2023-10-14T11:13:52.246411+0000","last_clean":"2023-10-14T11:13:52.246411+0000","last_became_active":"2023-10-14T11:13:51.242611+0000","last_became_peered":"2023-10-14T11:13:51.242611+0000","last_unstale":"2023-10-14T11:13:52.246411+0000","last_undegraded":"2023-10-14T11:13:52.246411+0000","last_fullsized":"2023-10-14T11:13:52.246411+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:56.165357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.374837+0000","last_change":"2023-10-14T11:13:50.250527+0000","last_active":"2023-10-14T11:13:52.374837+0000","last_peered":"2023-10-14T11:13:52.374837+0000","last_clean":"2023-10-14T11:13:52.374837+0000","last_became_active":"2023-10-14T11:13:50.250082+0000","last_became_peered":"2023-10-14T11:13:50.250082+0000","last_unstale":"2023-10-14T11:13:52.374837+0000","last_undegraded":"2023-10-14T11:13:52.374837+0000","last_fullsized":"2023-10-14T11:13:52.374837+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:59.930607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.364560+0000","last_change":"2023-10-14T11:13:51.259724+0000","last_active":"2023-10-14T11:13:53.364560+0000","last_peered":"2023-10-14T11:13:53.364560+0000","last_clean":"2023-10-14T11:13:53.364560+0000","last_became_active":"2023-10-14T11:13:51.259453+0000","last_became_peered":"2023-10-14T11:13:51.259453+0000","last_unstale":"2023-10-14T11:13:53.364560+0000","last_undegraded":"2023-10-14T11:13:53.364560+0000","last_fullsized":"2023-10-14T11:13:53.364560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:24:09.342629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246650+0000","last_change":"2023-10-14T11:13:50.238390+0000","last_active":"2023-10-14T11:13:52.246650+0000","last_peered":"2023-10-14T11:13:52.246650+0000","last_clean":"2023-10-14T11:13:52.246650+0000","last_became_active":"2023-10-14T11:13:50.237053+0000","last_became_peered":"2023-10-14T11:13:50.237053+0000","last_unstale":"2023-10-14T11:13:52.246650+0000","last_undegraded":"2023-10-14T11:13:52.246650+0000","last_fullsized":"2023-10-14T11:13:52.246650+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:52:44.246876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246778+0000","last_change":"2023-10-14T11:13:51.265150+0000","last_active":"2023-10-14T11:13:52.246778+0000","last_peered":"2023-10-14T11:13:52.246778+0000","last_clean":"2023-10-14T11:13:52.246778+0000","last_became_active":"2023-10-14T11:13:51.264858+0000","last_became_peered":"2023-10-14T11:13:51.264858+0000","last_unstale":"2023-10-14T11:13:52.246778+0000","last_undegraded":"2023-10-14T11:13:52.246778+0000","last_fullsized":"2023-10-14T11:13:52.246778+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:54:30.676855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215218+0000","last_change":"2023-10-14T11:13:50.246159+0000","last_active":"2023-10-14T11:13:53.215218+0000","last_peered":"2023-10-14T11:13:53.215218+0000","last_clean":"2023-10-14T11:13:53.215218+0000","last_became_active":"2023-10-14T11:13:50.245837+0000","last_became_peered":"2023-10-14T11:13:50.245837+0000","last_unstale":"2023-10-14T11:13:53.215218+0000","last_undegraded":"2023-10-14T11:13:53.215218+0000","last_fullsized":"2023-10-14T11:13:53.215218+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:34:13.989785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.374714+0000","last_change":"2023-10-14T11:13:51.267024+0000","last_active":"2023-10-14T11:13:52.374714+0000","last_peered":"2023-10-14T11:13:52.374714+0000","last_clean":"2023-10-14T11:13:52.374714+0000","last_became_active":"2023-10-14T11:13:51.266667+0000","last_became_peered":"2023-10-14T11:13:51.266667+0000","last_unstale":"2023-10-14T11:13:52.374714+0000","last_undegraded":"2023-10-14T11:13:52.374714+0000","last_fullsized":"2023-10-14T11:13:52.374714+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:02.076277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.247267+0000","last_change":"2023-10-14T11:13:50.250787+0000","last_active":"2023-10-14T11:13:53.247267+0000","last_peered":"2023-10-14T11:13:53.247267+0000","last_clean":"2023-10-14T11:13:53.247267+0000","last_became_active":"2023-10-14T11:13:50.250512+0000","last_became_peered":"2023-10-14T11:13:50.250512+0000","last_unstale":"2023-10-14T11:13:53.247267+0000","last_undegraded":"2023-10-14T11:13:53.247267+0000","last_fullsized":"2023-10-14T11:13:53.247267+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:00.331541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246013+0000","last_change":"2023-10-14T11:13:51.248169+0000","last_active":"2023-10-14T11:13:52.246013+0000","last_peered":"2023-10-14T11:13:52.246013+0000","last_clean":"2023-10-14T11:13:52.246013+0000","last_became_active":"2023-10-14T11:13:51.247872+0000","last_became_peered":"2023-10-14T11:13:51.247872+0000","last_unstale":"2023-10-14T11:13:52.246013+0000","last_undegraded":"2023-10-14T11:13:52.246013+0000","last_fullsized":"2023-10-14T11:13:52.246013+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:23.174548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.374452+0000","last_change":"2023-10-14T11:13:50.247750+0000","last_active":"2023-10-14T11:13:52.374452+0000","last_peered":"2023-10-14T11:13:52.374452+0000","last_clean":"2023-10-14T11:13:52.374452+0000","last_became_active":"2023-10-14T11:13:50.247479+0000","last_became_peered":"2023-10-14T11:13:50.247479+0000","last_unstale":"2023-10-14T11:13:52.374452+0000","last_undegraded":"2023-10-14T11:13:52.374452+0000","last_fullsized":"2023-10-14T11:13:52.374452+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:19.628093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365532+0000","last_change":"2023-10-14T11:13:51.250407+0000","last_active":"2023-10-14T11:13:53.365532+0000","last_peered":"2023-10-14T11:13:53.365532+0000","last_clean":"2023-10-14T11:13:53.365532+0000","last_became_active":"2023-10-14T11:13:51.249826+0000","last_became_peered":"2023-10-14T11:13:51.249826+0000","last_unstale":"2023-10-14T11:13:53.365532+0000","last_undegraded":"2023-10-14T11:13:53.365532+0000","last_fullsized":"2023-10-14T11:13:53.365532+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:39:01.507444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246493+0000","last_change":"2023-10-14T11:13:50.255725+0000","last_active":"2023-10-14T11:13:52.246493+0000","last_peered":"2023-10-14T11:13:52.246493+0000","last_clean":"2023-10-14T11:13:52.246493+0000","last_became_active":"2023-10-14T11:13:50.255501+0000","last_became_peered":"2023-10-14T11:13:50.255501+0000","last_unstale":"2023-10-14T11:13:52.246493+0000","last_undegraded":"2023-10-14T11:13:52.246493+0000","last_fullsized":"2023-10-14T11:13:52.246493+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:40:38.528214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215562+0000","last_change":"2023-10-14T11:13:51.246572+0000","last_active":"2023-10-14T11:13:53.215562+0000","last_peered":"2023-10-14T11:13:53.215562+0000","last_clean":"2023-10-14T11:13:53.215562+0000","last_became_active":"2023-10-14T11:13:51.246078+0000","last_became_peered":"2023-10-14T11:13:51.246078+0000","last_unstale":"2023-10-14T11:13:53.215562+0000","last_undegraded":"2023-10-14T11:13:53.215562+0000","last_fullsized":"2023-10-14T11:13:53.215562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:23.174548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.247245+0000","last_change":"2023-10-14T11:13:50.245742+0000","last_active":"2023-10-14T11:13:52.247245+0000","last_peered":"2023-10-14T11:13:52.247245+0000","last_clean":"2023-10-14T11:13:52.247245+0000","last_became_active":"2023-10-14T11:13:50.245490+0000","last_became_peered":"2023-10-14T11:13:50.245490+0000","last_unstale":"2023-10-14T11:13:52.247245+0000","last_undegraded":"2023-10-14T11:13:52.247245+0000","last_fullsized":"2023-10-14T11:13:52.247245+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:18:44.943441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365540+0000","last_change":"2023-10-14T11:13:51.263554+0000","last_active":"2023-10-14T11:13:53.365540+0000","last_peered":"2023-10-14T11:13:53.365540+0000","last_clean":"2023-10-14T11:13:53.365540+0000","last_became_active":"2023-10-14T11:13:51.254264+0000","last_became_peered":"2023-10-14T11:13:51.254264+0000","last_unstale":"2023-10-14T11:13:53.365540+0000","last_undegraded":"2023-10-14T11:13:53.365540+0000","last_fullsized":"2023-10-14T11:13:53.365540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:34:14.998558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.247354+0000","last_change":"2023-10-14T11:13:50.247834+0000","last_active":"2023-10-14T11:13:52.247354+0000","last_peered":"2023-10-14T11:13:52.247354+0000","last_clean":"2023-10-14T11:13:52.247354+0000","last_became_active":"2023-10-14T11:13:50.240089+0000","last_became_peered":"2023-10-14T11:13:50.240089+0000","last_unstale":"2023-10-14T11:13:52.247354+0000","last_undegraded":"2023-10-14T11:13:52.247354+0000","last_fullsized":"2023-10-14T11:13:52.247354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:40:38.528214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.374953+0000","last_change":"2023-10-14T11:13:51.263228+0000","last_active":"2023-10-14T11:13:52.374953+0000","last_peered":"2023-10-14T11:13:52.374953+0000","last_clean":"2023-10-14T11:13:52.374953+0000","last_became_active":"2023-10-14T11:13:51.262933+0000","last_became_peered":"2023-10-14T11:13:51.262933+0000","last_unstale":"2023-10-14T11:13:52.374953+0000","last_undegraded":"2023-10-14T11:13:52.374953+0000","last_fullsized":"2023-10-14T11:13:52.374953+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:04.174333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246085+0000","last_change":"2023-10-14T11:13:50.248117+0000","last_active":"2023-10-14T11:13:52.246085+0000","last_peered":"2023-10-14T11:13:52.246085+0000","last_clean":"2023-10-14T11:13:52.246085+0000","last_became_active":"2023-10-14T11:13:50.246254+0000","last_became_peered":"2023-10-14T11:13:50.246254+0000","last_unstale":"2023-10-14T11:13:52.246085+0000","last_undegraded":"2023-10-14T11:13:52.246085+0000","last_fullsized":"2023-10-14T11:13:52.246085+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:10.016235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.364559+0000","last_change":"2023-10-14T11:13:51.264064+0000","last_active":"2023-10-14T11:13:53.364559+0000","last_peered":"2023-10-14T11:13:53.364559+0000","last_clean":"2023-10-14T11:13:53.364559+0000","last_became_active":"2023-10-14T11:13:51.263799+0000","last_became_peered":"2023-10-14T11:13:51.263799+0000","last_unstale":"2023-10-14T11:13:53.364559+0000","last_undegraded":"2023-10-14T11:13:53.364559+0000","last_fullsized":"2023-10-14T11:13:53.364559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:01.340314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246107+0000","last_change":"2023-10-14T11:13:50.253106+0000","last_active":"2023-10-14T11:13:52.246107+0000","last_peered":"2023-10-14T11:13:52.246107+0000","last_clean":"2023-10-14T11:13:52.246107+0000","last_became_active":"2023-10-14T11:13:50.252839+0000","last_became_peered":"2023-10-14T11:13:50.252839+0000","last_unstale":"2023-10-14T11:13:52.246107+0000","last_undegraded":"2023-10-14T11:13:52.246107+0000","last_fullsized":"2023-10-14T11:13:52.246107+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:06:24.669054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.245961+0000","last_change":"2023-10-14T11:13:51.255306+0000","last_active":"2023-10-14T11:13:52.245961+0000","last_peered":"2023-10-14T11:13:52.245961+0000","last_clean":"2023-10-14T11:13:52.245961+0000","last_became_active":"2023-10-14T11:13:51.255016+0000","last_became_peered":"2023-10-14T11:13:51.255016+0000","last_unstale":"2023-10-14T11:13:52.245961+0000","last_undegraded":"2023-10-14T11:13:52.245961+0000","last_fullsized":"2023-10-14T11:13:52.245961+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:28:56.464057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.247431+0000","last_change":"2023-10-14T11:13:50.247705+0000","last_active":"2023-10-14T11:13:53.247431+0000","last_peered":"2023-10-14T11:13:53.247431+0000","last_clean":"2023-10-14T11:13:53.247431+0000","last_became_active":"2023-10-14T11:13:50.247419+0000","last_became_peered":"2023-10-14T11:13:50.247419+0000","last_unstale":"2023-10-14T11:13:53.247431+0000","last_undegraded":"2023-10-14T11:13:53.247431+0000","last_fullsized":"2023-10-14T11:13:53.247431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:59.930607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215181+0000","last_change":"2023-10-14T11:13:51.240765+0000","last_active":"2023-10-14T11:13:53.215181+0000","last_peered":"2023-10-14T11:13:53.215181+0000","last_clean":"2023-10-14T11:13:53.215181+0000","last_became_active":"2023-10-14T11:13:51.240462+0000","last_became_peered":"2023-10-14T11:13:51.240462+0000","last_unstale":"2023-10-14T11:13:53.215181+0000","last_undegraded":"2023-10-14T11:13:53.215181+0000","last_fullsized":"2023-10-14T11:13:53.215181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:57.586320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246032+0000","last_change":"2023-10-14T11:13:50.243962+0000","last_active":"2023-10-14T11:13:52.246032+0000","last_peered":"2023-10-14T11:13:52.246032+0000","last_clean":"2023-10-14T11:13:52.246032+0000","last_became_active":"2023-10-14T11:13:50.243606+0000","last_became_peered":"2023-10-14T11:13:50.243606+0000","last_unstale":"2023-10-14T11:13:52.246032+0000","last_undegraded":"2023-10-14T11:13:52.246032+0000","last_fullsized":"2023-10-14T11:13:52.246032+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:48:06.196004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.245955+0000","last_change":"2023-10-14T11:13:51.261283+0000","last_active":"2023-10-14T11:13:52.245955+0000","last_peered":"2023-10-14T11:13:52.245955+0000","last_clean":"2023-10-14T11:13:52.245955+0000","last_became_active":"2023-10-14T11:13:51.260914+0000","last_became_peered":"2023-10-14T11:13:51.260914+0000","last_unstale":"2023-10-14T11:13:52.245955+0000","last_undegraded":"2023-10-14T11:13:52.245955+0000","last_fullsized":"2023-10-14T11:13:52.245955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:54:30.676855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215070+0000","last_change":"2023-10-14T11:13:50.243928+0000","last_active":"2023-10-14T11:13:53.215070+0000","last_peered":"2023-10-14T11:13:53.215070+0000","last_clean":"2023-10-14T11:13:53.215070+0000","last_became_active":"2023-10-14T11:13:50.243633+0000","last_became_peered":"2023-10-14T11:13:50.243633+0000","last_unstale":"2023-10-14T11:13:53.215070+0000","last_undegraded":"2023-10-14T11:13:53.215070+0000","last_fullsized":"2023-10-14T11:13:53.215070+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:59.930607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246121+0000","last_change":"2023-10-14T11:13:51.243823+0000","last_active":"2023-10-14T11:13:52.246121+0000","last_peered":"2023-10-14T11:13:52.246121+0000","last_clean":"2023-10-14T11:13:52.246121+0000","last_became_active":"2023-10-14T11:13:51.243544+0000","last_became_peered":"2023-10-14T11:13:51.243544+0000","last_unstale":"2023-10-14T11:13:52.246121+0000","last_undegraded":"2023-10-14T11:13:52.246121+0000","last_fullsized":"2023-10-14T11:13:52.246121+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:03:13.454300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.247096+0000","last_change":"2023-10-14T11:13:50.245802+0000","last_active":"2023-10-14T11:13:52.247096+0000","last_peered":"2023-10-14T11:13:52.247096+0000","last_clean":"2023-10-14T11:13:52.247096+0000","last_became_active":"2023-10-14T11:13:50.245331+0000","last_became_peered":"2023-10-14T11:13:50.245331+0000","last_unstale":"2023-10-14T11:13:52.247096+0000","last_undegraded":"2023-10-14T11:13:52.247096+0000","last_fullsized":"2023-10-14T11:13:52.247096+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:38:52.161620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.247361+0000","last_change":"2023-10-14T11:13:51.262568+0000","last_active":"2023-10-14T11:13:52.247361+0000","last_peered":"2023-10-14T11:13:52.247361+0000","last_clean":"2023-10-14T11:13:52.247361+0000","last_became_active":"2023-10-14T11:13:51.256375+0000","last_became_peered":"2023-10-14T11:13:51.256375+0000","last_unstale":"2023-10-14T11:13:52.247361+0000","last_undegraded":"2023-10-14T11:13:52.247361+0000","last_fullsized":"2023-10-14T11:13:52.247361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:15:09.074405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.375059+0000","last_change":"2023-10-14T11:13:50.247523+0000","last_active":"2023-10-14T11:13:52.375059+0000","last_peered":"2023-10-14T11:13:52.375059+0000","last_clean":"2023-10-14T11:13:52.375059+0000","last_became_active":"2023-10-14T11:13:50.247252+0000","last_became_peered":"2023-10-14T11:13:50.247252+0000","last_unstale":"2023-10-14T11:13:52.375059+0000","last_undegraded":"2023-10-14T11:13:52.375059+0000","last_fullsized":"2023-10-14T11:13:52.375059+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:48:58.192002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.374971+0000","last_change":"2023-10-14T11:13:51.263375+0000","last_active":"2023-10-14T11:13:52.374971+0000","last_peered":"2023-10-14T11:13:52.374971+0000","last_clean":"2023-10-14T11:13:52.374971+0000","last_became_active":"2023-10-14T11:13:51.263075+0000","last_became_peered":"2023-10-14T11:13:51.263075+0000","last_unstale":"2023-10-14T11:13:52.374971+0000","last_undegraded":"2023-10-14T11:13:52.374971+0000","last_fullsized":"2023-10-14T11:13:52.374971+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:48:07.899291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365692+0000","last_change":"2023-10-14T11:13:50.247667+0000","last_active":"2023-10-14T11:13:53.365692+0000","last_peered":"2023-10-14T11:13:53.365692+0000","last_clean":"2023-10-14T11:13:53.365692+0000","last_became_active":"2023-10-14T11:13:50.247378+0000","last_became_peered":"2023-10-14T11:13:50.247378+0000","last_unstale":"2023-10-14T11:13:53.365692+0000","last_undegraded":"2023-10-14T11:13:53.365692+0000","last_fullsized":"2023-10-14T11:13:53.365692+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:59:57.120504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365815+0000","last_change":"2023-10-14T11:13:51.257314+0000","last_active":"2023-10-14T11:13:53.365815+0000","last_peered":"2023-10-14T11:13:53.365815+0000","last_clean":"2023-10-14T11:13:53.365815+0000","last_became_active":"2023-10-14T11:13:51.252233+0000","last_became_peered":"2023-10-14T11:13:51.252233+0000","last_unstale":"2023-10-14T11:13:53.365815+0000","last_undegraded":"2023-10-14T11:13:53.365815+0000","last_fullsized":"2023-10-14T11:13:53.365815+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:43:04.509850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.247281+0000","last_change":"2023-10-14T11:13:50.240681+0000","last_active":"2023-10-14T11:13:53.247281+0000","last_peered":"2023-10-14T11:13:53.247281+0000","last_clean":"2023-10-14T11:13:53.247281+0000","last_became_active":"2023-10-14T11:13:50.240426+0000","last_became_peered":"2023-10-14T11:13:50.240426+0000","last_unstale":"2023-10-14T11:13:53.247281+0000","last_undegraded":"2023-10-14T11:13:53.247281+0000","last_fullsized":"2023-10-14T11:13:53.247281+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:15.946854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215340+0000","last_change":"2023-10-14T11:13:51.248278+0000","last_active":"2023-10-14T11:13:53.215340+0000","last_peered":"2023-10-14T11:13:53.215340+0000","last_clean":"2023-10-14T11:13:53.215340+0000","last_became_active":"2023-10-14T11:13:51.241244+0000","last_became_peered":"2023-10-14T11:13:51.241244+0000","last_unstale":"2023-10-14T11:13:53.215340+0000","last_undegraded":"2023-10-14T11:13:53.215340+0000","last_fullsized":"2023-10-14T11:13:53.215340+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:08:26.041683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365412+0000","last_change":"2023-10-14T11:13:50.235126+0000","last_active":"2023-10-14T11:13:53.365412+0000","last_peered":"2023-10-14T11:13:53.365412+0000","last_clean":"2023-10-14T11:13:53.365412+0000","last_became_active":"2023-10-14T11:13:50.234835+0000","last_became_peered":"2023-10-14T11:13:50.234835+0000","last_unstale":"2023-10-14T11:13:53.365412+0000","last_undegraded":"2023-10-14T11:13:53.365412+0000","last_fullsized":"2023-10-14T11:13:53.365412+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:35:24.132945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.364697+0000","last_change":"2023-10-14T11:13:51.248550+0000","last_active":"2023-10-14T11:13:53.364697+0000","last_peered":"2023-10-14T11:13:53.364697+0000","last_clean":"2023-10-14T11:13:53.364697+0000","last_became_active":"2023-10-14T11:13:51.248288+0000","last_became_peered":"2023-10-14T11:13:51.248288+0000","last_unstale":"2023-10-14T11:13:53.364697+0000","last_undegraded":"2023-10-14T11:13:53.364697+0000","last_fullsized":"2023-10-14T11:13:53.364697+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:02.076277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365429+0000","last_change":"2023-10-14T11:13:50.242083+0000","last_active":"2023-10-14T11:13:53.365429+0000","last_peered":"2023-10-14T11:13:53.365429+0000","last_clean":"2023-10-14T11:13:53.365429+0000","last_became_active":"2023-10-14T11:13:50.241824+0000","last_became_peered":"2023-10-14T11:13:50.241824+0000","last_unstale":"2023-10-14T11:13:53.365429+0000","last_undegraded":"2023-10-14T11:13:53.365429+0000","last_fullsized":"2023-10-14T11:13:53.365429+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:03:11.865944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246902+0000","last_change":"2023-10-14T11:13:51.255306+0000","last_active":"2023-10-14T11:13:52.246902+0000","last_peered":"2023-10-14T11:13:52.246902+0000","last_clean":"2023-10-14T11:13:52.246902+0000","last_became_active":"2023-10-14T11:13:51.255012+0000","last_became_peered":"2023-10-14T11:13:51.255012+0000","last_unstale":"2023-10-14T11:13:52.246902+0000","last_undegraded":"2023-10-14T11:13:52.246902+0000","last_fullsized":"2023-10-14T11:13:52.246902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:28:56.464057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215239+0000","last_change":"2023-10-14T11:13:50.251713+0000","last_active":"2023-10-14T11:13:53.215239+0000","last_peered":"2023-10-14T11:13:53.215239+0000","last_clean":"2023-10-14T11:13:53.215239+0000","last_became_active":"2023-10-14T11:13:50.251403+0000","last_became_peered":"2023-10-14T11:13:50.251403+0000","last_unstale":"2023-10-14T11:13:53.215239+0000","last_undegraded":"2023-10-14T11:13:53.215239+0000","last_fullsized":"2023-10-14T11:13:53.215239+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:10.016235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246089+0000","last_change":"2023-10-14T11:13:51.248036+0000","last_active":"2023-10-14T11:13:52.246089+0000","last_peered":"2023-10-14T11:13:52.246089+0000","last_clean":"2023-10-14T11:13:52.246089+0000","last_became_active":"2023-10-14T11:13:51.247467+0000","last_became_peered":"2023-10-14T11:13:51.247467+0000","last_unstale":"2023-10-14T11:13:52.246089+0000","last_undegraded":"2023-10-14T11:13:52.246089+0000","last_fullsized":"2023-10-14T11:13:52.246089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:46:46.144271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365159+0000","last_change":"2023-10-14T11:13:50.241508+0000","last_active":"2023-10-14T11:13:53.365159+0000","last_peered":"2023-10-14T11:13:53.365159+0000","last_clean":"2023-10-14T11:13:53.365159+0000","last_became_active":"2023-10-14T11:13:50.241236+0000","last_became_peered":"2023-10-14T11:13:50.241236+0000","last_unstale":"2023-10-14T11:13:53.365159+0000","last_undegraded":"2023-10-14T11:13:53.365159+0000","last_fullsized":"2023-10-14T11:13:53.365159+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:42:48.310436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.247277+0000","last_change":"2023-10-14T11:13:51.268895+0000","last_active":"2023-10-14T11:13:53.247277+0000","last_peered":"2023-10-14T11:13:53.247277+0000","last_clean":"2023-10-14T11:13:53.247277+0000","last_became_active":"2023-10-14T11:13:51.268615+0000","last_became_peered":"2023-10-14T11:13:51.268615+0000","last_unstale":"2023-10-14T11:13:53.247277+0000","last_undegraded":"2023-10-14T11:13:53.247277+0000","last_fullsized":"2023-10-14T11:13:53.247277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:04.174333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.247315+0000","last_change":"2023-10-14T11:13:50.247229+0000","last_active":"2023-10-14T11:13:52.247315+0000","last_peered":"2023-10-14T11:13:52.247315+0000","last_clean":"2023-10-14T11:13:52.247315+0000","last_became_active":"2023-10-14T11:13:50.238511+0000","last_became_peered":"2023-10-14T11:13:50.238511+0000","last_unstale":"2023-10-14T11:13:52.247315+0000","last_undegraded":"2023-10-14T11:13:52.247315+0000","last_fullsized":"2023-10-14T11:13:52.247315+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:28:36.182149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215526+0000","last_change":"2023-10-14T11:13:51.246361+0000","last_active":"2023-10-14T11:13:53.215526+0000","last_peered":"2023-10-14T11:13:53.215526+0000","last_clean":"2023-10-14T11:13:53.215526+0000","last_became_active":"2023-10-14T11:13:51.245594+0000","last_became_peered":"2023-10-14T11:13:51.245594+0000","last_unstale":"2023-10-14T11:13:53.215526+0000","last_undegraded":"2023-10-14T11:13:53.215526+0000","last_fullsized":"2023-10-14T11:13:53.215526+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:28:56.464057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.383182+0000","last_change":"2023-10-14T11:13:50.244927+0000","last_active":"2023-10-14T11:13:53.383182+0000","last_peered":"2023-10-14T11:13:53.383182+0000","last_clean":"2023-10-14T11:13:53.383182+0000","last_became_active":"2023-10-14T11:13:50.244657+0000","last_became_peered":"2023-10-14T11:13:50.244657+0000","last_unstale":"2023-10-14T11:13:53.383182+0000","last_undegraded":"2023-10-14T11:13:53.383182+0000","last_fullsized":"2023-10-14T11:13:53.383182+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:52.331457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246218+0000","last_change":"2023-10-14T11:13:51.247639+0000","last_active":"2023-10-14T11:13:52.246218+0000","last_peered":"2023-10-14T11:13:52.246218+0000","last_clean":"2023-10-14T11:13:52.246218+0000","last_became_active":"2023-10-14T11:13:51.247352+0000","last_became_peered":"2023-10-14T11:13:51.247352+0000","last_unstale":"2023-10-14T11:13:52.246218+0000","last_undegraded":"2023-10-14T11:13:52.246218+0000","last_fullsized":"2023-10-14T11:13:52.246218+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:15:09.074405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.365115+0000","last_change":"2023-10-14T11:13:50.241701+0000","last_active":"2023-10-14T11:13:53.365115+0000","last_peered":"2023-10-14T11:13:53.365115+0000","last_clean":"2023-10-14T11:13:53.365115+0000","last_became_active":"2023-10-14T11:13:50.241445+0000","last_became_peered":"2023-10-14T11:13:50.241445+0000","last_unstale":"2023-10-14T11:13:53.365115+0000","last_undegraded":"2023-10-14T11:13:53.365115+0000","last_fullsized":"2023-10-14T11:13:53.365115+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:48:58.192002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.364718+0000","last_change":"2023-10-14T11:13:51.247117+0000","last_active":"2023-10-14T11:13:53.364718+0000","last_peered":"2023-10-14T11:13:53.364718+0000","last_clean":"2023-10-14T11:13:53.364718+0000","last_became_active":"2023-10-14T11:13:51.246718+0000","last_became_peered":"2023-10-14T11:13:51.246718+0000","last_unstale":"2023-10-14T11:13:53.364718+0000","last_undegraded":"2023-10-14T11:13:53.364718+0000","last_fullsized":"2023-10-14T11:13:53.364718+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:15.893881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.364923+0000","last_change":"2023-10-14T11:13:50.250195+0000","last_active":"2023-10-14T11:13:53.364923+0000","last_peered":"2023-10-14T11:13:53.364923+0000","last_clean":"2023-10-14T11:13:53.364923+0000","last_became_active":"2023-10-14T11:13:50.248792+0000","last_became_peered":"2023-10-14T11:13:50.248792+0000","last_unstale":"2023-10-14T11:13:53.364923+0000","last_undegraded":"2023-10-14T11:13:53.364923+0000","last_fullsized":"2023-10-14T11:13:53.364923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:15.946854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.247107+0000","last_change":"2023-10-14T11:13:51.261550+0000","last_active":"2023-10-14T11:13:53.247107+0000","last_peered":"2023-10-14T11:13:53.247107+0000","last_clean":"2023-10-14T11:13:53.247107+0000","last_became_active":"2023-10-14T11:13:51.261263+0000","last_became_peered":"2023-10-14T11:13:51.261263+0000","last_unstale":"2023-10-14T11:13:53.247107+0000","last_undegraded":"2023-10-14T11:13:53.247107+0000","last_fullsized":"2023-10-14T11:13:53.247107+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:02.076277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.246622+0000","last_change":"2023-10-14T11:13:50.237845+0000","last_active":"2023-10-14T11:13:52.246622+0000","last_peered":"2023-10-14T11:13:52.246622+0000","last_clean":"2023-10-14T11:13:52.246622+0000","last_became_active":"2023-10-14T11:13:50.236657+0000","last_became_peered":"2023-10-14T11:13:50.236657+0000","last_unstale":"2023-10-14T11:13:52.246622+0000","last_undegraded":"2023-10-14T11:13:52.246622+0000","last_fullsized":"2023-10-14T11:13:52.246622+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:06:04.673156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.374505+0000","last_change":"2023-10-14T11:13:51.250299+0000","last_active":"2023-10-14T11:13:52.374505+0000","last_peered":"2023-10-14T11:13:52.374505+0000","last_clean":"2023-10-14T11:13:52.374505+0000","last_became_active":"2023-10-14T11:13:51.249877+0000","last_became_peered":"2023-10-14T11:13:51.249877+0000","last_unstale":"2023-10-14T11:13:52.374505+0000","last_undegraded":"2023-10-14T11:13:52.374505+0000","last_fullsized":"2023-10-14T11:13:52.374505+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:24:09.342629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.374464+0000","last_change":"2023-10-14T11:13:50.250609+0000","last_active":"2023-10-14T11:13:52.374464+0000","last_peered":"2023-10-14T11:13:52.374464+0000","last_clean":"2023-10-14T11:13:52.374464+0000","last_became_active":"2023-10-14T11:13:50.249857+0000","last_became_peered":"2023-10-14T11:13:50.249857+0000","last_unstale":"2023-10-14T11:13:52.374464+0000","last_undegraded":"2023-10-14T11:13:52.374464+0000","last_fullsized":"2023-10-14T11:13:52.374464+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:15.946854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215479+0000","last_change":"2023-10-14T11:13:51.246259+0000","last_active":"2023-10-14T11:13:53.215479+0000","last_peered":"2023-10-14T11:13:53.215479+0000","last_clean":"2023-10-14T11:13:53.215479+0000","last_became_active":"2023-10-14T11:13:51.245906+0000","last_became_peered":"2023-10-14T11:13:51.245906+0000","last_unstale":"2023-10-14T11:13:53.215479+0000","last_undegraded":"2023-10-14T11:13:53.215479+0000","last_fullsized":"2023-10-14T11:13:53.215479+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:54:30.676855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.245737+0000","last_change":"2023-10-14T11:13:50.244695+0000","last_active":"2023-10-14T11:13:52.245737+0000","last_peered":"2023-10-14T11:13:52.245737+0000","last_clean":"2023-10-14T11:13:52.245737+0000","last_became_active":"2023-10-14T11:13:50.244443+0000","last_became_peered":"2023-10-14T11:13:50.244443+0000","last_unstale":"2023-10-14T11:13:52.245737+0000","last_undegraded":"2023-10-14T11:13:52.245737+0000","last_fullsized":"2023-10-14T11:13:52.245737+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:34:13.989785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:52.247312+0000","last_change":"2023-10-14T11:13:51.265544+0000","last_active":"2023-10-14T11:13:52.247312+0000","last_peered":"2023-10-14T11:13:52.247312+0000","last_clean":"2023-10-14T11:13:52.247312+0000","last_became_active":"2023-10-14T11:13:51.264811+0000","last_became_peered":"2023-10-14T11:13:51.264811+0000","last_unstale":"2023-10-14T11:13:52.247312+0000","last_undegraded":"2023-10-14T11:13:52.247312+0000","last_fullsized":"2023-10-14T11:13:52.247312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:50.214513+0000","last_clean_scrub_stamp":"2023-10-14T11:13:50.214513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:21:28.378533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T11:13:53.215462+0000","last_change":"2023-10-14T11:13:50.251288+0000","last_active":"2023-10-14T11:13:53.215462+0000","last_peered":"2023-10-14T11:13:53.215462+0000","last_clean":"2023-10-14T11:13:53.215462+0000","last_became_active":"2023-10-14T11:13:50.251008+0000","last_became_peered":"2023-10-14T11:13:50.251008+0000","last_unstale":"2023-10-14T11:13:53.215462+0000","last_undegraded":"2023-10-14T11:13:53.215462+0000","last_fullsized":"2023-10-14T11:13:53.215462+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:13:49.205740+0000","last_clean_scrub_stamp":"2023-10-14T11:13:49.205740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:12:25.825764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T11:13:51.228644+0000","last_change":"2023-10-14T11:12:12.162289+0000","last_active":"2023-10-14T11:13:51.228644+0000","last_peered":"2023-10-14T11:13:51.228644+0000","last_clean":"2023-10-14T11:13:51.228644+0000","last_became_active":"2023-10-14T11:12:12.161055+0000","last_became_peered":"2023-10-14T11:12:12.161055+0000","last_unstale":"2023-10-14T11:13:51.228644+0000","last_undegraded":"2023-10-14T11:13:51.228644+0000","last_fullsized":"2023-10-14T11:13:51.228644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_clean_scrub_stamp":"2023-10-14T11:12:10.853576+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:52.154107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1060864,"data_stored":785969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.6669999999999998,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.751}]},{"osd":1,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.80100000000000005}]},{"osd":2,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":2.5779999999999998,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":1.081},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.5070000000000001,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.96599999999999997}]},{"osd":3,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.8919999999999999,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":3.5489999999999999,"5min":3.5489999999999999,"15min":3.5489999999999999},"last":1.014}]},{"osd":4,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.82699999999999996}]},{"osd":5,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.878}]},{"osd":6,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.77200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":194501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.745},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.72899999999999998}]},{"osd":1,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.64100000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.624},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.77000000000000002}]},{"osd":3,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.69299999999999995}]},{"osd":4,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.52400000000000002}]},{"osd":5,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.46200000000000002}]},{"osd":7,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.66700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31628,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340212,"statfs":{"total":96636764160,"available":96604377088,"internally_reserved":0,"allocated":458752,"data_stored":194031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.86599999999999999}]},{"osd":1,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.88300000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.622},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.76100000000000001}]},{"osd":3,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.749},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.78700000000000003}]},{"osd":4,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.66900000000000004}]},{"osd":6,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.70299999999999996}]},{"osd":7,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.73099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31628,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340212,"statfs":{"total":96636764160,"available":96604377088,"internally_reserved":0,"allocated":458752,"data_stored":194523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.53500000000000003}]},{"osd":1,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.78200000000000003}]},{"osd":2,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.59299999999999997}]},{"osd":3,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.82599999999999996}]},{"osd":5,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.69099999999999995}]},{"osd":6,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.73399999999999999}]},{"osd":7,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.87}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":466944,"data_stored":195565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.436}]},{"osd":1,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.39800000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.51400000000000001}]},{"osd":4,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.66600000000000004}]},{"osd":5,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.56100000000000005}]},{"osd":6,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.625}]},{"osd":7,"last update":"Sat Oct 14 11:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.71099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":187344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.55200000000000005}]},{"osd":1,"last update":"Sat Oct 14 11:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.63800000000000001}]},{"osd":3,"last update":"Sat Oct 14 11:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.60199999999999998}]},{"osd":4,"last update":"Sat Oct 14 11:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.80300000000000005}]},{"osd":5,"last update":"Sat Oct 14 11:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.75},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.71499999999999997}]},{"osd":6,"last update":"Sat Oct 14 11:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.58699999999999997}]},{"osd":7,"last update":"Sat Oct 14 11:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.69899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":442368,"data_stored":187364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.377},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.437}]},{"osd":2,"last update":"Sat Oct 14 11:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.60099999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.58299999999999996}]},{"osd":4,"last update":"Sat Oct 14 11:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.76400000000000001}]},{"osd":5,"last update":"Sat Oct 14 11:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":0.80000000000000004}]},{"osd":6,"last update":"Sat Oct 14 11:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.75}]},{"osd":7,"last update":"Sat Oct 14 11:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.874}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1048576,"data_stored":784321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.41999999999999998}]},{"osd":2,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.436}]},{"osd":3,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.39800000000000002}]},{"osd":4,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.64100000000000001}]},{"osd":5,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.76200000000000001}]},{"osd":7,"last update":"Sat Oct 14 11:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.749}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:13:55.743 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T11:13:55.743 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=testcephfs1' mds allow 2023-10-14T11:13:55.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.929+0000 7fc829df8640 1 Processor -- start 2023-10-14T11:13:55.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.929+0000 7fc829df8640 1 -- start start 2023-10-14T11:13:55.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.929+0000 7fc829df8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc82406dbd0 0x7fc82415ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:55.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.929+0000 7fc829df8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc8240c8e50 0x7fc82406c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:55.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.929+0000 7fc829df8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82415e5e0 con 0x7fc82406cba0 2023-10-14T11:13:55.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.929+0000 7fc829df8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc82415b320 con 0x7fc82406dbd0 2023-10-14T11:13:55.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.929+0000 7fc829df8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc82415b570 con 0x7fc8240c8e50 2023-10-14T11:13:55.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.929+0000 7fc8237fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc82406dbd0 0x7fc82415ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:55.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.929+0000 7fc8237fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc82406dbd0 0x7fc82415ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39246/0 (socket says 172.21.15.26:39246) 2023-10-14T11:13:55.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.929+0000 7fc8237fe640 1 -- 172.21.15.26:0/1383023231 learned_addr learned my addr 172.21.15.26:0/1383023231 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:55.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.929+0000 7fc822ffd640 1 --2- 172.21.15.26:0/1383023231 >> v2:172.21.15.110:3300/0 conn(0x7fc8240c8e50 0x7fc82406c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:55.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.929+0000 7fc8237fe640 1 -- 172.21.15.26:0/1383023231 >> v2:172.21.15.110:3300/0 conn(0x7fc8240c8e50 msgr2=0x7fc82406c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:55.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.929+0000 7fc8237fe640 1 --2- 172.21.15.26:0/1383023231 >> v2:172.21.15.110:3300/0 conn(0x7fc8240c8e50 0x7fc82406c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.929+0000 7fc8237fe640 1 -- 172.21.15.26:0/1383023231 >> v1:172.21.15.110:6789/0 conn(0x7fc82406cba0 legacy=0x7fc824069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:55.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.929+0000 7fc8237fe640 1 -- 172.21.15.26:0/1383023231 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82415b850 con 0x7fc82406dbd0 2023-10-14T11:13:55.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.929+0000 7fc822ffd640 1 --2- 172.21.15.26:0/1383023231 >> v2:172.21.15.110:3300/0 conn(0x7fc8240c8e50 0x7fc82406c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:55.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.933+0000 7fc8237fe640 1 --2- 172.21.15.26:0/1383023231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc82406dbd0 0x7fc82415ade0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc8240cca10 tx=0x7fc81401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0947375a201d67e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:55.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.933+0000 7fc8227fc640 1 -- 172.21.15.26:0/1383023231 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8140ab600 con 0x7fc82406dbd0 2023-10-14T11:13:55.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.933+0000 7fc8227fc640 1 -- 172.21.15.26:0/1383023231 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8140ab760 con 0x7fc82406dbd0 2023-10-14T11:13:55.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.933+0000 7fc8227fc640 1 -- 172.21.15.26:0/1383023231 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8140abaf0 con 0x7fc82406dbd0 2023-10-14T11:13:55.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.933+0000 7fc829df8640 1 -- 172.21.15.26:0/1383023231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc82406dbd0 msgr2=0x7fc82415ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:55.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.933+0000 7fc829df8640 1 --2- 172.21.15.26:0/1383023231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc82406dbd0 0x7fc82415ade0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc8240cca10 tx=0x7fc81401c400 comp rx=0 tx=0).stop 2023-10-14T11:13:55.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.933+0000 7fc829df8640 1 -- 172.21.15.26:0/1383023231 shutdown_connections 2023-10-14T11:13:55.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.933+0000 7fc829df8640 1 --2- 172.21.15.26:0/1383023231 >> v2:172.21.15.110:3300/0 conn(0x7fc8240c8e50 0x7fc82406c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.933+0000 7fc829df8640 1 --2- 172.21.15.26:0/1383023231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc82406dbd0 0x7fc82415ade0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.933+0000 7fc829df8640 1 -- 172.21.15.26:0/1383023231 >> 172.21.15.26:0/1383023231 conn(0x7fc8240b0d10 msgr2=0x7fc8240ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:55.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.933+0000 7fc829df8640 1 -- 172.21.15.26:0/1383023231 shutdown_connections 2023-10-14T11:13:55.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.933+0000 7fc829df8640 1 -- 172.21.15.26:0/1383023231 wait complete. 2023-10-14T11:13:55.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc829df8640 1 Processor -- start 2023-10-14T11:13:55.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc829df8640 1 -- start start 2023-10-14T11:13:55.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc829df8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc82406cba0 0x7fc8240c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:55.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc829df8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc82406dbd0 0x7fc824156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:55.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc829df8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8240c8e50 0x7fc82415d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:55.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc829df8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8240ae720 con 0x7fc8240c8e50 2023-10-14T11:13:55.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc829df8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc824156840 con 0x7fc82406dbd0 2023-10-14T11:13:55.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc829df8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8240adaa0 con 0x7fc82406cba0 2023-10-14T11:13:55.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc823fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8240c8e50 0x7fc82415d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:55.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc823fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8240c8e50 0x7fc82415d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39260/0 (socket says 172.21.15.26:39260) 2023-10-14T11:13:55.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc823fff640 1 -- 172.21.15.26:0/1565281575 learned_addr learned my addr 172.21.15.26:0/1565281575 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:55.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc8237fe640 1 --2- 172.21.15.26:0/1565281575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc82406cba0 0x7fc8240c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:55.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc822ffd640 1 --2- 172.21.15.26:0/1565281575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc82406dbd0 0x7fc824156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:55.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc823fff640 1 -- 172.21.15.26:0/1565281575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc82406cba0 msgr2=0x7fc8240c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:55.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc823fff640 1 --2- 172.21.15.26:0/1565281575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc82406cba0 0x7fc8240c51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc823fff640 1 -- 172.21.15.26:0/1565281575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc82406dbd0 msgr2=0x7fc824156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:55.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc823fff640 1 --2- 172.21.15.26:0/1565281575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc82406dbd0 0x7fc824156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:55.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc823fff640 1 -- 172.21.15.26:0/1565281575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8140094d0 con 0x7fc8240c8e50 2023-10-14T11:13:55.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc822ffd640 1 --2- 172.21.15.26:0/1565281575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc82406dbd0 0x7fc824156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:55.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc823fff640 1 --2- 172.21.15.26:0/1565281575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8240c8e50 0x7fc82415d280 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc81c00b970 tx=0x7fc81c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:55.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc80bfff640 1 -- 172.21.15.26:0/1565281575 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c00cb40 con 0x7fc8240c8e50 2023-10-14T11:13:55.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc80bfff640 1 -- 172.21.15.26:0/1565281575 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c00cca0 con 0x7fc8240c8e50 2023-10-14T11:13:55.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc829df8640 1 -- 172.21.15.26:0/1565281575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8240add80 con 0x7fc8240c8e50 2023-10-14T11:13:55.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc80bfff640 1 -- 172.21.15.26:0/1565281575 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c014680 con 0x7fc8240c8e50 2023-10-14T11:13:55.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.937+0000 7fc829df8640 1 -- 172.21.15.26:0/1565281575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8240ae340 con 0x7fc8240c8e50 2023-10-14T11:13:55.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.941+0000 7fc829df8640 1 -- 172.21.15.26:0/1565281575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8240ae860 con 0x7fc8240c8e50 2023-10-14T11:13:55.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.941+0000 7fc80bfff640 1 -- 172.21.15.26:0/1565281575 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc81c01d3b0 con 0x7fc8240c8e50 2023-10-14T11:13:55.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.941+0000 7fc80bfff640 1 --2- 172.21.15.26:0/1565281575 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc8100664a0 0x7fc810068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:55.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.941+0000 7fc80bfff640 1 -- 172.21.15.26:0/1565281575 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fc81c083d50 con 0x7fc8240c8e50 2023-10-14T11:13:55.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.941+0000 7fc8237fe640 1 --2- 172.21.15.26:0/1565281575 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc8100664a0 0x7fc810068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:55.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.941+0000 7fc8237fe640 1 --2- 172.21.15.26:0/1565281575 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc8100664a0 0x7fc810068960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc8140af000 tx=0x7fc8140b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:55.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:55.945+0000 7fc80bfff640 1 -- 172.21.15.26:0/1565281575 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc8240ae860 con 0x7fc8240c8e50 2023-10-14T11:13:56.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.161+0000 7fc829df8640 1 -- 172.21.15.26:0/1565281575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]} v 0) v1 -- 0x7fc8240ae860 con 0x7fc8240c8e50 2023-10-14T11:13:56.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.165+0000 7fc80bfff640 1 -- 172.21.15.26:0/1565281575 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 195+0+152 (secure 0 0 0) 0x7fc8240ae860 con 0x7fc8240c8e50 2023-10-14T11:13:56.169 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2023-10-14T11:13:56.169 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBZdyplGXdwHxAA3yn7fC60cZX9BQGuvdlfYw== 2023-10-14T11:13:56.169 INFO:teuthology.orchestra.run.smithi026.stdout: caps mds = "allow" 2023-10-14T11:13:56.169 INFO:teuthology.orchestra.run.smithi026.stdout: caps mon = "allow r" 2023-10-14T11:13:56.169 INFO:teuthology.orchestra.run.smithi026.stdout: caps osd = "allow rw tag cephfs data=testcephfs1" 2023-10-14T11:13:56.170 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-10-14T11:13:56.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.169+0000 7fc829df8640 1 -- 172.21.15.26:0/1565281575 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc8100664a0 msgr2=0x7fc810068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:56.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.169+0000 7fc829df8640 1 --2- 172.21.15.26:0/1565281575 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc8100664a0 0x7fc810068960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc8140af000 tx=0x7fc8140b6040 comp rx=0 tx=0).stop 2023-10-14T11:13:56.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.169+0000 7fc829df8640 1 -- 172.21.15.26:0/1565281575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8240c8e50 msgr2=0x7fc82415d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:56.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.169+0000 7fc829df8640 1 --2- 172.21.15.26:0/1565281575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8240c8e50 0x7fc82415d280 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc81c00b970 tx=0x7fc81c00be30 comp rx=0 tx=0).stop 2023-10-14T11:13:56.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.169+0000 7fc829df8640 1 -- 172.21.15.26:0/1565281575 shutdown_connections 2023-10-14T11:13:56.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.169+0000 7fc829df8640 1 --2- 172.21.15.26:0/1565281575 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc8100664a0 0x7fc810068960 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:56.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.169+0000 7fc829df8640 1 --2- 172.21.15.26:0/1565281575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8240c8e50 0x7fc82415d280 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:56.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.169+0000 7fc829df8640 1 --2- 172.21.15.26:0/1565281575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc82406dbd0 0x7fc824156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:56.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.169+0000 7fc829df8640 1 --2- 172.21.15.26:0/1565281575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc82406cba0 0x7fc8240c51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:56.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.169+0000 7fc829df8640 1 -- 172.21.15.26:0/1565281575 >> 172.21.15.26:0/1565281575 conn(0x7fc8240b0d10 msgr2=0x7fc8240c9530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:56.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.169+0000 7fc829df8640 1 -- 172.21.15.26:0/1565281575 shutdown_connections 2023-10-14T11:13:56.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.169+0000 7fc829df8640 1 -- 172.21.15.26:0/1565281575 wait complete. 2023-10-14T11:13:56.191 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:13:56.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.333+0000 7f1b6a9d0640 1 Processor -- start 2023-10-14T11:13:56.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.333+0000 7f1b6a9d0640 1 -- start start 2023-10-14T11:13:56.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.333+0000 7f1b6a9d0640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1b64159ba0 0x7f1b640cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:56.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.333+0000 7f1b6a9d0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b640c8cb0 0x7f1b640cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:56.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.333+0000 7f1b6a9d0640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b640723d0 con 0x7f1b641597c0 2023-10-14T11:13:56.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.333+0000 7f1b6a9d0640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b640717c0 con 0x7f1b64159ba0 2023-10-14T11:13:56.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.333+0000 7f1b6a9d0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b64071aa0 con 0x7f1b640c8cb0 2023-10-14T11:13:56.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.333+0000 7f1b637fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1b64159ba0 0x7f1b640cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:56.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.333+0000 7f1b637fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1b64159ba0 0x7f1b640cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39262/0 (socket says 172.21.15.26:39262) 2023-10-14T11:13:56.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.333+0000 7f1b637fe640 1 -- 172.21.15.26:0/3248633359 learned_addr learned my addr 172.21.15.26:0/3248633359 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:56.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.333+0000 7f1b63fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1b641597c0 0x7f1b640ad6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59864/0 (socket says 172.21.15.26:59864) 2023-10-14T11:13:56.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.333+0000 7f1b68f6d640 1 --2- 172.21.15.26:0/3248633359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b640c8cb0 0x7f1b640cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:56.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.333+0000 7f1b637fe640 1 -- 172.21.15.26:0/3248633359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b640c8cb0 msgr2=0x7f1b640cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:56.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.333+0000 7f1b637fe640 1 --2- 172.21.15.26:0/3248633359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b640c8cb0 0x7f1b640cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:56.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.333+0000 7f1b637fe640 1 -- 172.21.15.26:0/3248633359 >> v1:172.21.15.26:6789/0 conn(0x7f1b641597c0 legacy=0x7f1b640ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:56.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.333+0000 7f1b637fe640 1 -- 172.21.15.26:0/3248633359 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b64071d80 con 0x7f1b64159ba0 2023-10-14T11:13:56.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.333+0000 7f1b62ffd640 1 -- 172.21.15.26:0/3248633359 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843367166 0 0) 0x7f1b640723d0 con 0x7f1b641597c0 2023-10-14T11:13:56.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.337+0000 7f1b637fe640 1 --2- 172.21.15.26:0/3248633359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b64159ba0 0x7f1b640cae10 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800bb10 tx=0x7f1b5801ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95a8d968aa45008 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:56.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.337+0000 7f1b62ffd640 1 -- 172.21.15.26:0/3248633359 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b580a7c50 con 0x7f1b64159ba0 2023-10-14T11:13:56.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.337+0000 7f1b62ffd640 1 -- 172.21.15.26:0/3248633359 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b580a7db0 con 0x7f1b64159ba0 2023-10-14T11:13:56.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.337+0000 7f1b62ffd640 1 -- 172.21.15.26:0/3248633359 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b580af660 con 0x7f1b64159ba0 2023-10-14T11:13:56.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.337+0000 7f1b6a9d0640 1 -- 172.21.15.26:0/3248633359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b64159ba0 msgr2=0x7f1b640cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:56.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.337+0000 7f1b6a9d0640 1 --2- 172.21.15.26:0/3248633359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b64159ba0 0x7f1b640cae10 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800bb10 tx=0x7f1b5801ebe0 comp rx=0 tx=0).stop 2023-10-14T11:13:56.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.337+0000 7f1b6a9d0640 1 -- 172.21.15.26:0/3248633359 shutdown_connections 2023-10-14T11:13:56.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.337+0000 7f1b6a9d0640 1 --2- 172.21.15.26:0/3248633359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b640c8cb0 0x7f1b640cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:56.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.337+0000 7f1b6a9d0640 1 --2- 172.21.15.26:0/3248633359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b64159ba0 0x7f1b640cae10 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:56.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.337+0000 7f1b6a9d0640 1 -- 172.21.15.26:0/3248633359 >> 172.21.15.26:0/3248633359 conn(0x7f1b6406c190 msgr2=0x7f1b6406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:56.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.337+0000 7f1b6a9d0640 1 -- 172.21.15.26:0/3248633359 shutdown_connections 2023-10-14T11:13:56.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.337+0000 7f1b6a9d0640 1 -- 172.21.15.26:0/3248633359 wait complete. 2023-10-14T11:13:56.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b6a9d0640 1 Processor -- start 2023-10-14T11:13:56.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b6a9d0640 1 -- start start 2023-10-14T11:13:56.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b6a9d0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b640c8cb0 0x7f1b640ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:56.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b6a9d0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b641597c0 0x7f1b6414ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:56.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b6a9d0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b64159ba0 0x7f1b64154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:56.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b6a9d0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6414a700 con 0x7f1b640c8cb0 2023-10-14T11:13:56.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b6a9d0640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6415aeb0 con 0x7f1b64159ba0 2023-10-14T11:13:56.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b6a9d0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6414d1e0 con 0x7f1b641597c0 2023-10-14T11:13:56.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b63fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b640c8cb0 0x7f1b640ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:56.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b63fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b640c8cb0 0x7f1b640ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39270/0 (socket says 172.21.15.26:39270) 2023-10-14T11:13:56.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b63fff640 1 -- 172.21.15.26:0/783133230 learned_addr learned my addr 172.21.15.26:0/783133230 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:56.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b637fe640 1 --2- 172.21.15.26:0/783133230 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b641597c0 0x7f1b6414ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:56.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b68f6d640 1 --2- 172.21.15.26:0/783133230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b64159ba0 0x7f1b64154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:56.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b63fff640 1 -- 172.21.15.26:0/783133230 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b641597c0 msgr2=0x7f1b6414ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:56.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b63fff640 1 --2- 172.21.15.26:0/783133230 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b641597c0 0x7f1b6414ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:56.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b63fff640 1 -- 172.21.15.26:0/783133230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b64159ba0 msgr2=0x7f1b64154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:56.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b63fff640 1 --2- 172.21.15.26:0/783133230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b64159ba0 0x7f1b64154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:56.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b63fff640 1 -- 172.21.15.26:0/783133230 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5800b770 con 0x7f1b640c8cb0 2023-10-14T11:13:56.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b68f6d640 1 --2- 172.21.15.26:0/783133230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b64159ba0 0x7f1b64154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:56.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b63fff640 1 --2- 172.21.15.26:0/783133230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b640c8cb0 0x7f1b640ae890 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1b540011f0 tx=0x7f1b5400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:56.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b60ff9640 1 -- 172.21.15.26:0/783133230 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b540074e0 con 0x7f1b640c8cb0 2023-10-14T11:13:56.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b60ff9640 1 -- 172.21.15.26:0/783133230 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b54007640 con 0x7f1b640c8cb0 2023-10-14T11:13:56.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b6a9d0640 1 -- 172.21.15.26:0/783133230 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b6414d4c0 con 0x7f1b640c8cb0 2023-10-14T11:13:56.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b60ff9640 1 -- 172.21.15.26:0/783133230 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b54004a10 con 0x7f1b640c8cb0 2023-10-14T11:13:56.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.341+0000 7f1b6a9d0640 1 -- 172.21.15.26:0/783133230 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b6414ceb0 con 0x7f1b640c8cb0 2023-10-14T11:13:56.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.345+0000 7f1b6a9d0640 1 -- 172.21.15.26:0/783133230 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b64074010 con 0x7f1b640c8cb0 2023-10-14T11:13:56.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.345+0000 7f1b60ff9640 1 -- 172.21.15.26:0/783133230 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1b54004b70 con 0x7f1b640c8cb0 2023-10-14T11:13:56.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.345+0000 7f1b60ff9640 1 --2- 172.21.15.26:0/783133230 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1b500664a0 0x7f1b50068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:56.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.345+0000 7f1b60ff9640 1 -- 172.21.15.26:0/783133230 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f1b54083580 con 0x7f1b640c8cb0 2023-10-14T11:13:56.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.345+0000 7f1b637fe640 1 --2- 172.21.15.26:0/783133230 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1b500664a0 0x7f1b50068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:56.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.345+0000 7f1b637fe640 1 --2- 172.21.15.26:0/783133230 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1b500664a0 0x7f1b50068960 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1b580b1000 tx=0x7f1b580a9070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:56.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.349+0000 7f1b60ff9640 1 -- 172.21.15.26:0/783133230 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1b54050890 con 0x7f1b640c8cb0 2023-10-14T11:13:56.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.541+0000 7f1b6a9d0640 1 -- 172.21.15.26:0/783133230 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b640cd3f0 con 0x7f1b640c8cb0 2023-10-14T11:13:56.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.541+0000 7f1b60ff9640 1 -- 172.21.15.26:0/783133230 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f1b54053eb0 con 0x7f1b640c8cb0 2023-10-14T11:13:56.546 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:13:56.546 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5425,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/1669994220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1669994220},{"type":"v1","addr":"172.21.15.110:6834","nonce":1669994220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3054425791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3054425791},{"type":"v1","addr":"172.21.15.110:6835","nonce":3054425791}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5434,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3759640340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3759640340},{"type":"v1","addr":"172.21.15.26:6837","nonce":3759640340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:13:50.622103+0000","modified":"2023-10-14T11:13:53.633604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5493":{"gid":5493,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/812681761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":812681761},{"type":"v1","addr":"172.21.15.26:6835","nonce":812681761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T11:13:56.548 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 17 2023-10-14T11:13:56.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.545+0000 7f1b6a9d0640 1 -- 172.21.15.26:0/783133230 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1b500664a0 msgr2=0x7f1b50068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:56.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.545+0000 7f1b6a9d0640 1 --2- 172.21.15.26:0/783133230 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1b500664a0 0x7f1b50068960 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1b580b1000 tx=0x7f1b580a9070 comp rx=0 tx=0).stop 2023-10-14T11:13:56.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.545+0000 7f1b6a9d0640 1 -- 172.21.15.26:0/783133230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b640c8cb0 msgr2=0x7f1b640ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:56.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.545+0000 7f1b6a9d0640 1 --2- 172.21.15.26:0/783133230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b640c8cb0 0x7f1b640ae890 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1b540011f0 tx=0x7f1b5400c9b0 comp rx=0 tx=0).stop 2023-10-14T11:13:56.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.545+0000 7f1b6a9d0640 1 -- 172.21.15.26:0/783133230 shutdown_connections 2023-10-14T11:13:56.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.545+0000 7f1b6a9d0640 1 --2- 172.21.15.26:0/783133230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b64159ba0 0x7f1b64154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:56.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.545+0000 7f1b6a9d0640 1 --2- 172.21.15.26:0/783133230 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b641597c0 0x7f1b6414ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:56.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.545+0000 7f1b6a9d0640 1 --2- 172.21.15.26:0/783133230 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1b500664a0 0x7f1b50068960 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:56.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.545+0000 7f1b6a9d0640 1 --2- 172.21.15.26:0/783133230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b640c8cb0 0x7f1b640ae890 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:56.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.545+0000 7f1b6a9d0640 1 -- 172.21.15.26:0/783133230 >> 172.21.15.26:0/783133230 conn(0x7f1b6406c190 msgr2=0x7f1b640af820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:56.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.545+0000 7f1b6a9d0640 1 -- 172.21.15.26:0/783133230 shutdown_connections 2023-10-14T11:13:56.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:56.545+0000 7f1b6a9d0640 1 -- 172.21.15.26:0/783133230 wait complete. 2023-10-14T11:13:56.971 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T11:13:50.622103+0000', 'modified': '2023-10-14T11:13:53.633604+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5493}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5493': {'gid': 5493, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.26:6835/812681761', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6834', 'nonce': 812681761}, {'type': 'v1', 'addr': '172.21.15.26:6835', 'nonce': 812681761}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T11:13:56.972 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T11:13:56.972 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-14T11:13:57.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.113+0000 7f5f7feea640 1 Processor -- start 2023-10-14T11:13:57.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.113+0000 7f5f7feea640 1 -- start start 2023-10-14T11:13:57.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.117+0000 7f5f7feea640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5f780b2ad0 0x7f5f7806b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.117+0000 7f5f7feea640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5f7815cf90 0x7f5f7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.117+0000 7f5f7feea640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7815d4e0 con 0x7f5f780ce310 2023-10-14T11:13:57.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.117+0000 7f5f7feea640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f78160580 con 0x7f5f7815cf90 2023-10-14T11:13:57.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.117+0000 7f5f7feea640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7815d7c0 con 0x7f5f780b2ad0 2023-10-14T11:13:57.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.117+0000 7f5f7d485640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5f7815cf90 0x7f5f7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.117+0000 7f5f7d485640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5f7815cf90 0x7f5f7806c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39284/0 (socket says 172.21.15.26:39284) 2023-10-14T11:13:57.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.117+0000 7f5f7d485640 1 -- 172.21.15.26:0/1480953422 learned_addr learned my addr 172.21.15.26:0/1480953422 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:57.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.117+0000 7f5f7dc86640 1 --2- 172.21.15.26:0/1480953422 >> v2:172.21.15.110:3300/0 conn(0x7f5f780b2ad0 0x7f5f7806b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.117+0000 7f5f7d485640 1 -- 172.21.15.26:0/1480953422 >> v2:172.21.15.110:3300/0 conn(0x7f5f780b2ad0 msgr2=0x7f5f7806b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:57.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.117+0000 7f5f7d485640 1 --2- 172.21.15.26:0/1480953422 >> v2:172.21.15.110:3300/0 conn(0x7f5f780b2ad0 0x7f5f7806b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.117+0000 7f5f7d485640 1 -- 172.21.15.26:0/1480953422 >> v1:172.21.15.110:6789/0 conn(0x7f5f780ce310 legacy=0x7f5f781609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:57.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.117+0000 7f5f7d485640 1 -- 172.21.15.26:0/1480953422 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7815daa0 con 0x7f5f7815cf90 2023-10-14T11:13:57.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.121+0000 7f5f7d485640 1 --2- 172.21.15.26:0/1480953422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f7815cf90 0x7f5f7806c8f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009870 tx=0x7f5f6801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8073c6005fcdda3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:57.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.121+0000 7f5f7cc84640 1 -- 172.21.15.26:0/1480953422 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f680ac640 con 0x7f5f7815cf90 2023-10-14T11:13:57.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.121+0000 7f5f7cc84640 1 -- 172.21.15.26:0/1480953422 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f680ac7a0 con 0x7f5f7815cf90 2023-10-14T11:13:57.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.121+0000 7f5f7cc84640 1 -- 172.21.15.26:0/1480953422 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f680acb30 con 0x7f5f7815cf90 2023-10-14T11:13:57.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.121+0000 7f5f7feea640 1 -- 172.21.15.26:0/1480953422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f7815cf90 msgr2=0x7f5f7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:57.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.121+0000 7f5f7feea640 1 --2- 172.21.15.26:0/1480953422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f7815cf90 0x7f5f7806c8f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009870 tx=0x7f5f6801c4d0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.121+0000 7f5f7feea640 1 -- 172.21.15.26:0/1480953422 shutdown_connections 2023-10-14T11:13:57.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.121+0000 7f5f7feea640 1 --2- 172.21.15.26:0/1480953422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f7815cf90 0x7f5f7806c8f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.121+0000 7f5f7feea640 1 --2- 172.21.15.26:0/1480953422 >> v2:172.21.15.110:3300/0 conn(0x7f5f780b2ad0 0x7f5f7806b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.121+0000 7f5f7feea640 1 -- 172.21.15.26:0/1480953422 >> 172.21.15.26:0/1480953422 conn(0x7f5f780cd1c0 msgr2=0x7f5f780cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:57.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.121+0000 7f5f7feea640 1 -- 172.21.15.26:0/1480953422 shutdown_connections 2023-10-14T11:13:57.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.121+0000 7f5f7feea640 1 -- 172.21.15.26:0/1480953422 wait complete. 2023-10-14T11:13:57.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.121+0000 7f5f7feea640 1 Processor -- start 2023-10-14T11:13:57.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.121+0000 7f5f7feea640 1 -- start start 2023-10-14T11:13:57.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f7feea640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f780b2ad0 0x7f5f78149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f7feea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f780ce310 0x7f5f781523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f7feea640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f7815cf90 0x7f5f780b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f7feea640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f78157bc0 con 0x7f5f780ce310 2023-10-14T11:13:57.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f7feea640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f78151f30 con 0x7f5f7815cf90 2023-10-14T11:13:57.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f7feea640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f78151c00 con 0x7f5f780b2ad0 2023-10-14T11:13:57.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f7d485640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f780ce310 0x7f5f781523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f7d485640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f780ce310 0x7f5f781523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39288/0 (socket says 172.21.15.26:39288) 2023-10-14T11:13:57.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f7d485640 1 -- 172.21.15.26:0/160924619 learned_addr learned my addr 172.21.15.26:0/160924619 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:57.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f7dc86640 1 --2- 172.21.15.26:0/160924619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f780b2ad0 0x7f5f78149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f7e487640 1 --2- 172.21.15.26:0/160924619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f7815cf90 0x7f5f780b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f7d485640 1 -- 172.21.15.26:0/160924619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f780b2ad0 msgr2=0x7f5f78149b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:57.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f7d485640 1 --2- 172.21.15.26:0/160924619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f780b2ad0 0x7f5f78149b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f7d485640 1 -- 172.21.15.26:0/160924619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f7815cf90 msgr2=0x7f5f780b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:57.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f7d485640 1 --2- 172.21.15.26:0/160924619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f7815cf90 0x7f5f780b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f7d485640 1 -- 172.21.15.26:0/160924619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f680094d0 con 0x7f5f780ce310 2023-10-14T11:13:57.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f7e487640 1 --2- 172.21.15.26:0/160924619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f7815cf90 0x7f5f780b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:57.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f7d485640 1 --2- 172.21.15.26:0/160924619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f780ce310 0x7f5f781523c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5f6801a100 tx=0x7f5f68019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:57.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f6e7fc640 1 -- 172.21.15.26:0/160924619 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f680bd070 con 0x7f5f780ce310 2023-10-14T11:13:57.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f6e7fc640 1 -- 172.21.15.26:0/160924619 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f680b7420 con 0x7f5f780ce310 2023-10-14T11:13:57.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f6e7fc640 1 -- 172.21.15.26:0/160924619 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f680b77d0 con 0x7f5f780ce310 2023-10-14T11:13:57.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f7feea640 1 -- 172.21.15.26:0/160924619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f78157e10 con 0x7f5f780ce310 2023-10-14T11:13:57.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f7feea640 1 -- 172.21.15.26:0/160924619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7814a0d0 con 0x7f5f780ce310 2023-10-14T11:13:57.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.125+0000 7f5f6e7fc640 1 -- 172.21.15.26:0/160924619 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5f680b3040 con 0x7f5f780ce310 2023-10-14T11:13:57.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f6e7fc640 1 --2- 172.21.15.26:0/160924619 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5f5c0664a0 0x7f5f5c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f6e7fc640 1 -- 172.21.15.26:0/160924619 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f5f6811e070 con 0x7f5f780ce310 2023-10-14T11:13:57.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f7dc86640 1 --2- 172.21.15.26:0/160924619 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5f5c0664a0 0x7f5f5c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f83274000 1 Processor -- start 2023-10-14T11:13:57.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f83274000 1 -- start start 2023-10-14T11:13:57.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f7dc86640 1 --2- 172.21.15.26:0/160924619 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5f5c0664a0 0x7f5f5c068960 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009a50 tx=0x7f5f74008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:57.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f83274000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f810258a0 0x559f81025c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f83274000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f810261c0 0x559f80fdb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f83274000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x559f80fdbc50 0x559f80fdc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f83274000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f80dd0cc0 con 0x559f810258a0 2023-10-14T11:13:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f83274000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f80e33920 con 0x559f810261c0 2023-10-14T11:13:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f83274000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f80e30e50 con 0x559f80fdbc50 2023-10-14T11:13:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f7dc86640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f810258a0 0x559f81025c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f7dc86640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f810258a0 0x559f81025c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39298/0 (socket says 172.21.15.26:39298) 2023-10-14T11:13:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f7dc86640 1 -- 172.21.15.26:0/2413604568 learned_addr learned my addr 172.21.15.26:0/2413604568 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:57.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f7e487640 1 --2- 172.21.15.26:0/2413604568 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x559f80fdbc50 0x559f80fdc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f7d485640 1 --2- 172.21.15.26:0/2413604568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f810261c0 0x559f80fdb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f7dc86640 1 -- 172.21.15.26:0/2413604568 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x559f80fdbc50 msgr2=0x559f80fdc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:57.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f7dc86640 1 --2- 172.21.15.26:0/2413604568 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x559f80fdbc50 0x559f80fdc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f7dc86640 1 -- 172.21.15.26:0/2413604568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f810261c0 msgr2=0x559f80fdb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:57.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f7dc86640 1 --2- 172.21.15.26:0/2413604568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f810261c0 0x559f80fdb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f7dc86640 1 -- 172.21.15.26:0/2413604568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f80b25890 con 0x559f810258a0 2023-10-14T11:13:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f7d485640 1 --2- 172.21.15.26:0/2413604568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f810261c0 0x559f80fdb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f7dc86640 1 --2- 172.21.15.26:0/2413604568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f810258a0 0x559f81025c80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5f74011ce0 tx=0x7f5f74014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0a32065e8e84fd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f5b7fe640 1 -- 172.21.15.26:0/2413604568 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74011d10 con 0x559f810258a0 2023-10-14T11:13:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f5b7fe640 1 -- 172.21.15.26:0/2413604568 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f74011e70 con 0x559f810258a0 2023-10-14T11:13:57.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f5b7fe640 1 -- 172.21.15.26:0/2413604568 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74004230 con 0x559f810258a0 2023-10-14T11:13:57.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f83274000 1 -- 172.21.15.26:0/2413604568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f810258a0 msgr2=0x559f81025c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:57.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.129+0000 7f5f83274000 1 --2- 172.21.15.26:0/2413604568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f810258a0 0x559f81025c80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5f74011ce0 tx=0x7f5f74014000 comp rx=0 tx=0).stop 2023-10-14T11:13:57.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f83274000 1 -- 172.21.15.26:0/2413604568 shutdown_connections 2023-10-14T11:13:57.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f83274000 1 --2- 172.21.15.26:0/2413604568 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x559f80fdbc50 0x559f80fdc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f83274000 1 --2- 172.21.15.26:0/2413604568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f810261c0 0x559f80fdb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f83274000 1 --2- 172.21.15.26:0/2413604568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f810258a0 0x559f81025c80 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f83274000 1 -- 172.21.15.26:0/2413604568 >> 172.21.15.26:0/2413604568 conn(0x559f80fd2fc0 msgr2=0x559f80fd9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:57.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f83274000 1 -- 172.21.15.26:0/2413604568 shutdown_connections 2023-10-14T11:13:57.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f83274000 1 -- 172.21.15.26:0/2413604568 wait complete. 2023-10-14T11:13:57.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f83274000 1 -- start start 2023-10-14T11:13:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f83274000 1 Processor -- start 2023-10-14T11:13:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f83274000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f80fdbc50 0x559f80fe0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f83274000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f810258a0 0x559f80fe1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f83274000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x559f810261c0 0x559f81013d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f83274000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f80e2c740 con 0x559f810258a0 2023-10-14T11:13:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f83274000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f80debd10 con 0x559f80fdbc50 2023-10-14T11:13:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f83274000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f80deb9b0 con 0x559f810261c0 2023-10-14T11:13:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f83274000 10 client.0 _ll_register_callbacks cb 0x559f80fc7390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T11:13:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f7d485640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f810258a0 0x559f80fe1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f7dc86640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f80fdbc50 0x559f80fe0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f7d485640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f810258a0 0x559f80fe1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39314/0 (socket says 172.21.15.26:39314) 2023-10-14T11:13:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f7dc86640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f80fdbc50 0x559f80fe0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:59652/0 (socket says 172.21.15.26:59652) 2023-10-14T11:13:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f7d485640 1 -- 172.21.15.26:0/1501071245 learned_addr learned my addr 172.21.15.26:0/1501071245 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f7e487640 1 --2- 172.21.15.26:0/1501071245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x559f810261c0 0x559f81013d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f7d485640 1 -- 172.21.15.26:0/1501071245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x559f810261c0 msgr2=0x559f81013d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f7d485640 1 --2- 172.21.15.26:0/1501071245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x559f810261c0 0x559f81013d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f7d485640 1 -- 172.21.15.26:0/1501071245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f80fdbc50 msgr2=0x559f80fe0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:57.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f7d485640 1 --2- 172.21.15.26:0/1501071245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f80fdbc50 0x559f80fe0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f7d485640 1 -- 172.21.15.26:0/1501071245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f740119c0 con 0x559f810258a0 2023-10-14T11:13:57.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f7dc86640 1 --2- 172.21.15.26:0/1501071245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f80fdbc50 0x559f80fe0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:13:57.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f7d485640 1 --2- 172.21.15.26:0/1501071245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f810258a0 0x559f80fe1420 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5f680eecb0 tx=0x7f5f680ef770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ee2230c055482f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:57.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f58ff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-14T11:13:57.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f58ff9640 1 -- 172.21.15.26:0/1501071245 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f680f72b0 con 0x559f810258a0 2023-10-14T11:13:57.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f58ff9640 1 -- 172.21.15.26:0/1501071245 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f5f680f3e40 con 0x559f810258a0 2023-10-14T11:13:57.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f83274000 1 -- 172.21.15.26:0/1501071245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f80de0370 con 0x559f810258a0 2023-10-14T11:13:57.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f58ff9640 1 -- 172.21.15.26:0/1501071245 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f680ee4a0 con 0x559f810258a0 2023-10-14T11:13:57.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f83274000 10 client.5664 fetch_fsmap learned FSMap version 17 2023-10-14T11:13:57.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.133+0000 7f5f83274000 1 -- 172.21.15.26:0/1501071245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x559f80dee460 con 0x559f810258a0 2023-10-14T11:13:57.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f58ff9640 1 -- 172.21.15.26:0/1501071245 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559f80de0370 con 0x559f810258a0 2023-10-14T11:13:57.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f58ff9640 1 -- 172.21.15.26:0/1501071245 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f5f680f6e20 con 0x559f810258a0 2023-10-14T11:13:57.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f83274000 10 client.5664 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T11:13:57.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f83274000 10 client.5664 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T11:13:57.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f83274000 20 client.5664 populate_metadata read hostname 'smithi026' 2023-10-14T11:13:57.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f83274000 1 --2- 172.21.15.26:0/1501071245 >> [v2:172.21.15.26:6834/812681761,v1:172.21.15.26:6835/812681761] conn(0x559f81035940 0x559f81037d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f83274000 4 client.5664 mds_command: new command op to 5493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T11:13:57.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f83274000 1 -- 172.21.15.26:0/1501071245 --> [v2:172.21.15.26:6834/812681761,v1:172.21.15.26:6835/812681761] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f80dc62d0 con 0x559f81035940 2023-10-14T11:13:57.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f7dc86640 1 --2- 172.21.15.26:0/1501071245 >> [v2:172.21.15.26:6834/812681761,v1:172.21.15.26:6835/812681761] conn(0x559f81035940 0x559f81037d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f7dc86640 1 --2- 172.21.15.26:0/1501071245 >> [v2:172.21.15.26:6834/812681761,v1:172.21.15.26:6835/812681761] conn(0x559f81035940 0x559f81037d30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fb3a209f5da53d6 server_cookie=d9201575ae450551 in_seq=0 out_seq=0 2023-10-14T11:13:57.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f58ff9640 10 client.5664 ms_handle_connect on v2:172.21.15.26:6834/812681761 2023-10-14T11:13:57.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f58ff9640 1 -- 172.21.15.26:0/1501071245 <== mds.0 v2:172.21.15.26:6834/812681761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559f80dc62d0 con 0x559f81035940 2023-10-14T11:13:57.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f58ff9640 10 client.5664 handle_command_reply: tid=0 2023-10-14T11:13:57.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f83274000 1 client.5664 shutdown 2023-10-14T11:13:57.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f83274000 1 -- 172.21.15.26:0/1501071245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f810258a0 msgr2=0x559f80fe1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:57.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f83274000 1 --2- 172.21.15.26:0/1501071245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f810258a0 0x559f80fe1420 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5f680eecb0 tx=0x7f5f680ef770 comp rx=0 tx=0).stop 2023-10-14T11:13:57.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f83274000 1 -- 172.21.15.26:0/1501071245 shutdown_connections 2023-10-14T11:13:57.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f83274000 1 --2- 172.21.15.26:0/1501071245 >> [v2:172.21.15.26:6834/812681761,v1:172.21.15.26:6835/812681761] conn(0x559f81035940 0x559f81037d30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f83274000 1 --2- 172.21.15.26:0/1501071245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x559f810261c0 0x559f81013d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f83274000 1 --2- 172.21.15.26:0/1501071245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f810258a0 0x559f80fe1420 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f83274000 1 --2- 172.21.15.26:0/1501071245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f80fdbc50 0x559f80fe0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f58ff9640 0 client.5664 ms_handle_reset on v2:172.21.15.26:6834/812681761 2023-10-14T11:13:57.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f83274000 1 -- 172.21.15.26:0/1501071245 >> 172.21.15.26:0/1501071245 conn(0x559f80fd2fc0 msgr2=0x559f80fda6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:57.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f83274000 1 -- 172.21.15.26:0/1501071245 shutdown_connections 2023-10-14T11:13:57.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f83274000 1 -- 172.21.15.26:0/1501071245 wait complete. 2023-10-14T11:13:57.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.137+0000 7f5f83274000 20 client.5664 trim_cache size 0 max 16384 2023-10-14T11:13:57.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f83274000 1 Processor -- start 2023-10-14T11:13:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f83274000 1 -- start start 2023-10-14T11:13:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f83274000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f80fdbc50 0x559f81038d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f83274000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f810258a0 0x559f81039280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f83274000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x559f810261c0 0x559f8100e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f83274000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f80ae6940 con 0x559f80fdbc50 2023-10-14T11:13:57.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f83274000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f80e318b0 con 0x559f810258a0 2023-10-14T11:13:57.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f83274000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f80e245e0 con 0x559f810261c0 2023-10-14T11:13:57.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f7dc86640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f80fdbc50 0x559f81038d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f7dc86640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f80fdbc50 0x559f81038d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39326/0 (socket says 172.21.15.26:39326) 2023-10-14T11:13:57.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f7dc86640 1 -- 172.21.15.26:0/295171951 learned_addr learned my addr 172.21.15.26:0/295171951 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:57.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f7e487640 1 --2- 172.21.15.26:0/295171951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x559f810261c0 0x559f8100e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f7d485640 1 --2- 172.21.15.26:0/295171951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f810258a0 0x559f81039280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f7dc86640 1 -- 172.21.15.26:0/295171951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x559f810261c0 msgr2=0x559f8100e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:57.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f7dc86640 1 --2- 172.21.15.26:0/295171951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x559f810261c0 0x559f8100e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f7dc86640 1 -- 172.21.15.26:0/295171951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f810258a0 msgr2=0x559f81039280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:57.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f7dc86640 1 --2- 172.21.15.26:0/295171951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f810258a0 0x559f81039280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f7dc86640 1 -- 172.21.15.26:0/295171951 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f80dd4760 con 0x559f80fdbc50 2023-10-14T11:13:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f7e487640 1 --2- 172.21.15.26:0/295171951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x559f810261c0 0x559f8100e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f7d485640 1 --2- 172.21.15.26:0/295171951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f810258a0 0x559f81039280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:13:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f7dc86640 1 --2- 172.21.15.26:0/295171951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f80fdbc50 0x559f81038d40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5f74011630 tx=0x7f5f74018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221e1708427c669b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f5bfff640 1 -- 172.21.15.26:0/295171951 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74032040 con 0x559f80fdbc50 2023-10-14T11:13:57.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f5bfff640 1 -- 172.21.15.26:0/295171951 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f74004030 con 0x559f80fdbc50 2023-10-14T11:13:57.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.153+0000 7f5f5bfff640 1 -- 172.21.15.26:0/295171951 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f740342c0 con 0x559f80fdbc50 2023-10-14T11:13:57.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f83274000 1 -- 172.21.15.26:0/295171951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f80fdbc50 msgr2=0x559f81038d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:57.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f83274000 1 --2- 172.21.15.26:0/295171951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f80fdbc50 0x559f81038d40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5f74011630 tx=0x7f5f74018000 comp rx=0 tx=0).stop 2023-10-14T11:13:57.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f83274000 1 -- 172.21.15.26:0/295171951 shutdown_connections 2023-10-14T11:13:57.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f83274000 1 --2- 172.21.15.26:0/295171951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x559f810261c0 0x559f8100e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f83274000 1 --2- 172.21.15.26:0/295171951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f810258a0 0x559f81039280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f83274000 1 --2- 172.21.15.26:0/295171951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f80fdbc50 0x559f81038d40 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f83274000 1 -- 172.21.15.26:0/295171951 >> 172.21.15.26:0/295171951 conn(0x559f80fd2fc0 msgr2=0x559f81032e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:57.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f83274000 1 -- 172.21.15.26:0/295171951 shutdown_connections 2023-10-14T11:13:57.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f83274000 1 -- 172.21.15.26:0/295171951 wait complete. 2023-10-14T11:13:57.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f83274000 1 -- start start 2023-10-14T11:13:57.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f83274000 1 Processor -- start 2023-10-14T11:13:57.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f83274000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x559f80fdbc50 0x559f81084220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f83274000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f810258a0 0x559f81084760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f83274000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f810261c0 0x559f810116c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f83274000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f80fe06a0 con 0x559f810258a0 2023-10-14T11:13:57.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f83274000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f80fdff40 con 0x559f810261c0 2023-10-14T11:13:57.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f83274000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f80e2b5d0 con 0x559f80fdbc50 2023-10-14T11:13:57.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f83274000 10 client.0 _ll_register_callbacks cb 0x7f5f740096a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T11:13:57.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f7d485640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f810258a0 0x559f81084760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f7d485640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f810258a0 0x559f81084760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39338/0 (socket says 172.21.15.26:39338) 2023-10-14T11:13:57.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f7d485640 1 -- 172.21.15.26:0/773663088 learned_addr learned my addr 172.21.15.26:0/773663088 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:57.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f7dc86640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x559f80fdbc50 0x559f81084220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f7e487640 1 --2- 172.21.15.26:0/773663088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f810261c0 0x559f810116c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f7d485640 1 -- 172.21.15.26:0/773663088 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x559f80fdbc50 msgr2=0x559f81084220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:57.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f7d485640 1 --2- 172.21.15.26:0/773663088 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x559f80fdbc50 0x559f81084220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f7d485640 1 -- 172.21.15.26:0/773663088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f810261c0 msgr2=0x559f810116c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:57.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f7d485640 1 --2- 172.21.15.26:0/773663088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f810261c0 0x559f810116c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f7d485640 1 -- 172.21.15.26:0/773663088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f80b25890 con 0x559f810258a0 2023-10-14T11:13:57.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f7e487640 1 --2- 172.21.15.26:0/773663088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f810261c0 0x559f810116c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:57.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f7d485640 1 --2- 172.21.15.26:0/773663088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f810258a0 0x559f81084760 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5f680ef170 tx=0x7f5f6811c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e06dd3cf133f426 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:57.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f58ff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-14T11:13:57.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f58ff9640 1 -- 172.21.15.26:0/773663088 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6810b050 con 0x559f810258a0 2023-10-14T11:13:57.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f58ff9640 1 -- 172.21.15.26:0/773663088 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f5f680f3e40 con 0x559f810258a0 2023-10-14T11:13:57.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f83274000 1 -- 172.21.15.26:0/773663088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f80dc46f0 con 0x559f810258a0 2023-10-14T11:13:57.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f58ff9640 1 -- 172.21.15.26:0/773663088 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f680eeaf0 con 0x559f810258a0 2023-10-14T11:13:57.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f83274000 10 client.5670 fetch_fsmap learned FSMap version 17 2023-10-14T11:13:57.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.157+0000 7f5f83274000 1 -- 172.21.15.26:0/773663088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x559f80b25cc0 con 0x559f810258a0 2023-10-14T11:13:57.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f58ff9640 1 -- 172.21.15.26:0/773663088 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559f80dc46f0 con 0x559f810258a0 2023-10-14T11:13:57.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f58ff9640 1 -- 172.21.15.26:0/773663088 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f5f680eada0 con 0x559f810258a0 2023-10-14T11:13:57.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f83274000 10 client.5670 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T11:13:57.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f83274000 10 client.5670 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T11:13:57.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f83274000 20 client.5670 populate_metadata read hostname 'smithi026' 2023-10-14T11:13:57.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f83274000 1 --2- 172.21.15.26:0/773663088 >> [v2:172.21.15.26:6834/812681761,v1:172.21.15.26:6835/812681761] conn(0x559f81012050 0x559f81012430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f83274000 4 client.5670 mds_command: new command op to 5493 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T11:13:57.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f83274000 1 -- 172.21.15.26:0/773663088 --> [v2:172.21.15.26:6834/812681761,v1:172.21.15.26:6835/812681761] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559f80e25720 con 0x559f81012050 2023-10-14T11:13:57.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f7dc86640 1 --2- 172.21.15.26:0/773663088 >> [v2:172.21.15.26:6834/812681761,v1:172.21.15.26:6835/812681761] conn(0x559f81012050 0x559f81012430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f7dc86640 1 --2- 172.21.15.26:0/773663088 >> [v2:172.21.15.26:6834/812681761,v1:172.21.15.26:6835/812681761] conn(0x559f81012050 0x559f81012430 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0e06fe25a23af89 server_cookie=f99d7a6abd2df61c in_seq=0 out_seq=0 2023-10-14T11:13:57.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f58ff9640 10 client.5670 ms_handle_connect on v2:172.21.15.26:6834/812681761 2023-10-14T11:13:57.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f58ff9640 1 -- 172.21.15.26:0/773663088 <== mds.0 v2:172.21.15.26:6834/812681761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+336 (crc 0 0 0) 0x559f80e25720 con 0x559f81012050 2023-10-14T11:13:57.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f58ff9640 10 client.5670 handle_command_reply: tid=0 2023-10-14T11:13:57.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f83274000 1 client.5670 shutdown 2023-10-14T11:13:57.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f83274000 1 -- 172.21.15.26:0/773663088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f810258a0 msgr2=0x559f81084760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:57.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f83274000 1 --2- 172.21.15.26:0/773663088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f810258a0 0x559f81084760 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5f680ef170 tx=0x7f5f6811c270 comp rx=0 tx=0).stop 2023-10-14T11:13:57.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f83274000 1 -- 172.21.15.26:0/773663088 shutdown_connections 2023-10-14T11:13:57.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f83274000 1 --2- 172.21.15.26:0/773663088 >> [v2:172.21.15.26:6834/812681761,v1:172.21.15.26:6835/812681761] conn(0x559f81012050 0x559f81012430 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f83274000 1 --2- 172.21.15.26:0/773663088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f810261c0 0x559f810116c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f83274000 1 --2- 172.21.15.26:0/773663088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f810258a0 0x559f81084760 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f58ff9640 0 client.5670 ms_handle_reset on v2:172.21.15.26:6834/812681761 2023-10-14T11:13:57.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f83274000 1 --2- 172.21.15.26:0/773663088 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x559f80fdbc50 0x559f81084220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f83274000 1 -- 172.21.15.26:0/773663088 >> 172.21.15.26:0/773663088 conn(0x559f80fd2fc0 msgr2=0x559f81037d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:57.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f83274000 1 -- 172.21.15.26:0/773663088 shutdown_connections 2023-10-14T11:13:57.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f83274000 1 -- 172.21.15.26:0/773663088 wait complete. 2023-10-14T11:13:57.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f83274000 20 client.5670 trim_cache size 0 max 16384 2023-10-14T11:13:57.182 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:13:57.182 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "9730719c-9713-4147-aaa1-ca8aabbbe5ad", 2023-10-14T11:13:57.182 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-10-14T11:13:57.183 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 5493, 2023-10-14T11:13:57.183 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-10-14T11:13:57.183 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-10-14T11:13:57.183 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "testcephfs1", 2023-10-14T11:13:57.184 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 5.9392020929999996, 2023-10-14T11:13:57.184 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 17, 2023-10-14T11:13:57.184 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 39, 2023-10-14T11:13:57.184 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 39, 2023-10-14T11:13:57.184 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 13.785571472000001 2023-10-14T11:13:57.185 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:13:57.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f7feea640 1 -- 172.21.15.26:0/160924619 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5f5c0664a0 msgr2=0x7f5f5c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:57.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f7feea640 1 --2- 172.21.15.26:0/160924619 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5f5c0664a0 0x7f5f5c068960 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009a50 tx=0x7f5f74008040 comp rx=0 tx=0).stop 2023-10-14T11:13:57.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f7feea640 1 -- 172.21.15.26:0/160924619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f780ce310 msgr2=0x7f5f781523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:57.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f7feea640 1 --2- 172.21.15.26:0/160924619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f780ce310 0x7f5f781523c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5f6801a100 tx=0x7f5f68019270 comp rx=0 tx=0).stop 2023-10-14T11:13:57.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f7feea640 1 -- 172.21.15.26:0/160924619 shutdown_connections 2023-10-14T11:13:57.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f7feea640 1 --2- 172.21.15.26:0/160924619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f7815cf90 0x7f5f780b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f7feea640 1 --2- 172.21.15.26:0/160924619 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5f5c0664a0 0x7f5f5c068960 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f7feea640 1 --2- 172.21.15.26:0/160924619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f780ce310 0x7f5f781523c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f7feea640 1 --2- 172.21.15.26:0/160924619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f780b2ad0 0x7f5f78149b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f7feea640 1 -- 172.21.15.26:0/160924619 >> 172.21.15.26:0/160924619 conn(0x7f5f780cd1c0 msgr2=0x7f5f78153cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f7feea640 1 -- 172.21.15.26:0/160924619 shutdown_connections 2023-10-14T11:13:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.161+0000 7f5f7feea640 1 -- 172.21.15.26:0/160924619 wait complete. 2023-10-14T11:13:57.189 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T11:13:57.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.329+0000 7fb8d4254640 1 Processor -- start 2023-10-14T11:13:57.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.329+0000 7fb8d4254640 1 -- start start 2023-10-14T11:13:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.329+0000 7fb8d4254640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8cc070c40 0x7fb8cc15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.329+0000 7fb8d4254640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8cc15be60 con 0x7fb8cc0b4020 2023-10-14T11:13:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.329+0000 7fb8d4254640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8cc15c1f0 con 0x7fb8cc0b07f0 2023-10-14T11:13:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.329+0000 7fb8d4254640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc15b3b0 con 0x7fb8cc070c40 2023-10-14T11:13:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.329+0000 7fb8d17ef640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb8cc0b4020 0x7fb8cc0b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59868/0 (socket says 172.21.15.26:59868) 2023-10-14T11:13:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.329+0000 7fb8d17ef640 1 -- 172.21.15.26:0/1863089418 learned_addr learned my addr 172.21.15.26:0/1863089418 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:57.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.329+0000 7fb8d1ff0640 1 --2- 172.21.15.26:0/1863089418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8cc070c40 0x7fb8cc15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.329+0000 7fb8d0fee640 1 -- 172.21.15.26:0/1863089418 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524349978 0 0) 0x7fb8cc15be60 con 0x7fb8cc0b4020 2023-10-14T11:13:57.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.329+0000 7fb8d0fee640 1 -- 172.21.15.26:0/1863089418 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8b8003530 con 0x7fb8cc0b4020 2023-10-14T11:13:57.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.329+0000 7fb8d0fee640 1 -- 172.21.15.26:0/1863089418 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736156147 0 0) 0x7fb8cc15c1f0 con 0x7fb8cc0b07f0 2023-10-14T11:13:57.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.329+0000 7fb8d0fee640 1 -- 172.21.15.26:0/1863089418 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8cc15be60 con 0x7fb8cc0b07f0 2023-10-14T11:13:57.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.329+0000 7fb8d1ff0640 1 -- 172.21.15.26:0/1863089418 >> v1:172.21.15.110:6789/0 conn(0x7fb8cc0b07f0 legacy=0x7fb8cc164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:57.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.329+0000 7fb8d1ff0640 1 -- 172.21.15.26:0/1863089418 >> v1:172.21.15.26:6789/0 conn(0x7fb8cc0b4020 legacy=0x7fb8cc0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:57.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.329+0000 7fb8d0fee640 1 -- 172.21.15.26:0/1863089418 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3031646336 0 0) 0x7fb8b8003530 con 0x7fb8cc0b4020 2023-10-14T11:13:57.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.329+0000 7fb8d1ff0640 1 -- 172.21.15.26:0/1863089418 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc071020 con 0x7fb8cc070c40 2023-10-14T11:13:57.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.333+0000 7fb8d1ff0640 1 --2- 172.21.15.26:0/1863089418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8cc070c40 0x7fb8cc15ae70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb8c80097f0 tx=0x7fb8c801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24ef3edf9a55344a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:57.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.333+0000 7fb8d0fee640 1 -- 172.21.15.26:0/1863089418 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c80a7070 con 0x7fb8cc070c40 2023-10-14T11:13:57.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.333+0000 7fb8d0fee640 1 -- 172.21.15.26:0/1863089418 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c80ab430 con 0x7fb8cc070c40 2023-10-14T11:13:57.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.333+0000 7fb8d0fee640 1 -- 172.21.15.26:0/1863089418 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c80ab7c0 con 0x7fb8cc070c40 2023-10-14T11:13:57.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.333+0000 7fb8d4254640 1 -- 172.21.15.26:0/1863089418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8cc070c40 msgr2=0x7fb8cc15ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:57.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.333+0000 7fb8d4254640 1 --2- 172.21.15.26:0/1863089418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8cc070c40 0x7fb8cc15ae70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb8c80097f0 tx=0x7fb8c801c430 comp rx=0 tx=0).stop 2023-10-14T11:13:57.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.333+0000 7fb8d4254640 1 -- 172.21.15.26:0/1863089418 shutdown_connections 2023-10-14T11:13:57.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.333+0000 7fb8d4254640 1 --2- 172.21.15.26:0/1863089418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8cc070c40 0x7fb8cc15ae70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.333+0000 7fb8d4254640 1 -- 172.21.15.26:0/1863089418 >> 172.21.15.26:0/1863089418 conn(0x7fb8cc06c190 msgr2=0x7fb8cc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:57.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.333+0000 7fb8d4254640 1 -- 172.21.15.26:0/1863089418 shutdown_connections 2023-10-14T11:13:57.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.333+0000 7fb8d4254640 1 -- 172.21.15.26:0/1863089418 wait complete. 2023-10-14T11:13:57.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d4254640 1 Processor -- start 2023-10-14T11:13:57.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d4254640 1 -- start start 2023-10-14T11:13:57.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d4254640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8cc070c40 0x7fb8cc14cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d4254640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8cc0b07f0 0x7fb8cc151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d4254640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8cc0b4020 0x7fb8cc154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d4254640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc1521c0 con 0x7fb8cc0b4020 2023-10-14T11:13:57.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d4254640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc152410 con 0x7fb8cc0b07f0 2023-10-14T11:13:57.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d4254640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc165400 con 0x7fb8cc070c40 2023-10-14T11:13:57.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d27f1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8cc0b4020 0x7fb8cc154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d27f1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8cc0b4020 0x7fb8cc154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39344/0 (socket says 172.21.15.26:39344) 2023-10-14T11:13:57.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d27f1640 1 -- 172.21.15.26:0/1405288385 learned_addr learned my addr 172.21.15.26:0/1405288385 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:57.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d17ef640 1 --2- 172.21.15.26:0/1405288385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8cc0b07f0 0x7fb8cc151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d1ff0640 1 --2- 172.21.15.26:0/1405288385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8cc070c40 0x7fb8cc14cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d27f1640 1 -- 172.21.15.26:0/1405288385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8cc070c40 msgr2=0x7fb8cc14cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:57.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d27f1640 1 --2- 172.21.15.26:0/1405288385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8cc070c40 0x7fb8cc14cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d27f1640 1 -- 172.21.15.26:0/1405288385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8cc0b07f0 msgr2=0x7fb8cc151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:57.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d27f1640 1 --2- 172.21.15.26:0/1405288385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8cc0b07f0 0x7fb8cc151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d27f1640 1 -- 172.21.15.26:0/1405288385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c8009420 con 0x7fb8cc0b4020 2023-10-14T11:13:57.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d17ef640 1 --2- 172.21.15.26:0/1405288385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8cc0b07f0 0x7fb8cc151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:57.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d1ff0640 1 --2- 172.21.15.26:0/1405288385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8cc070c40 0x7fb8cc14cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:13:57.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d27f1640 1 --2- 172.21.15.26:0/1405288385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8cc0b4020 0x7fb8cc154a90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb8c400c680 tx=0x7fb8c400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:57.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8c27fc640 1 -- 172.21.15.26:0/1405288385 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4003b80 con 0x7fb8cc0b4020 2023-10-14T11:13:57.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8c27fc640 1 -- 172.21.15.26:0/1405288385 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c4003ce0 con 0x7fb8cc0b4020 2023-10-14T11:13:57.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8c27fc640 1 -- 172.21.15.26:0/1405288385 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4005310 con 0x7fb8cc0b4020 2023-10-14T11:13:57.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d4254640 1 -- 172.21.15.26:0/1405288385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8cc1656e0 con 0x7fb8cc0b4020 2023-10-14T11:13:57.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.337+0000 7fb8d4254640 1 -- 172.21.15.26:0/1405288385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8cc1526f0 con 0x7fb8cc0b4020 2023-10-14T11:13:57.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.341+0000 7fb8d4254640 1 -- 172.21.15.26:0/1405288385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8cc074010 con 0x7fb8cc0b4020 2023-10-14T11:13:57.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.341+0000 7fb8c27fc640 1 -- 172.21.15.26:0/1405288385 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb8c4005470 con 0x7fb8cc0b4020 2023-10-14T11:13:57.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.341+0000 7fb8c27fc640 1 --2- 172.21.15.26:0/1405288385 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb8b00664f0 0x7fb8b00689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:57.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.341+0000 7fb8c27fc640 1 -- 172.21.15.26:0/1405288385 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fb8c4083db0 con 0x7fb8cc0b4020 2023-10-14T11:13:57.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.341+0000 7fb8d1ff0640 1 --2- 172.21.15.26:0/1405288385 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb8b00664f0 0x7fb8b00689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:57.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.341+0000 7fb8d1ff0640 1 --2- 172.21.15.26:0/1405288385 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb8b00664f0 0x7fb8b00689b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb8c80af000 tx=0x7fb8c80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:57.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.345+0000 7fb8c27fc640 1 -- 172.21.15.26:0/1405288385 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb8c4088070 con 0x7fb8cc0b4020 2023-10-14T11:13:57.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.537+0000 7fb8d4254640 1 -- 172.21.15.26:0/1405288385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb8cc14e060 con 0x7fb8cc0b4020 2023-10-14T11:13:57.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.537+0000 7fb8c27fc640 1 -- 172.21.15.26:0/1405288385 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb8c40510b0 con 0x7fb8cc0b4020 2023-10-14T11:13:57.540 INFO:teuthology.orchestra.run.smithi026.stdout:name: testcephfs1, metadata pool: testcephfs1_metadata, data pools: [testcephfs1_data ] 2023-10-14T11:13:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.537+0000 7fb8d4254640 1 -- 172.21.15.26:0/1405288385 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb8b00664f0 msgr2=0x7fb8b00689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.537+0000 7fb8d4254640 1 --2- 172.21.15.26:0/1405288385 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb8b00664f0 0x7fb8b00689b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb8c80af000 tx=0x7fb8c80a7000 comp rx=0 tx=0).stop 2023-10-14T11:13:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.537+0000 7fb8d4254640 1 -- 172.21.15.26:0/1405288385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8cc0b4020 msgr2=0x7fb8cc154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:57.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.537+0000 7fb8d4254640 1 --2- 172.21.15.26:0/1405288385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8cc0b4020 0x7fb8cc154a90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb8c400c680 tx=0x7fb8c400cb40 comp rx=0 tx=0).stop 2023-10-14T11:13:57.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.537+0000 7fb8d4254640 1 -- 172.21.15.26:0/1405288385 shutdown_connections 2023-10-14T11:13:57.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.537+0000 7fb8d4254640 1 --2- 172.21.15.26:0/1405288385 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb8b00664f0 0x7fb8b00689b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.537+0000 7fb8d4254640 1 --2- 172.21.15.26:0/1405288385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8cc0b4020 0x7fb8cc154a90 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.537+0000 7fb8d4254640 1 --2- 172.21.15.26:0/1405288385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8cc0b07f0 0x7fb8cc151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.537+0000 7fb8d4254640 1 --2- 172.21.15.26:0/1405288385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8cc070c40 0x7fb8cc14cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:57.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.537+0000 7fb8d4254640 1 -- 172.21.15.26:0/1405288385 >> 172.21.15.26:0/1405288385 conn(0x7fb8cc06c190 msgr2=0x7fb8cc0ce5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:57.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.537+0000 7fb8d4254640 1 -- 172.21.15.26:0/1405288385 shutdown_connections 2023-10-14T11:13:57.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:57.537+0000 7fb8d4254640 1 -- 172.21.15.26:0/1405288385 wait complete. 2023-10-14T11:13:57.561 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T11:13:57.562 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T11:13:57.562 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-14T11:13:57.562 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T11:13:57.563 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T11:13:57.563 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T11:13:57.563 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T11:13:57.564 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T11:13:57.564 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:13:57.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:57.565 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-14T11:13:57.575 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:13:57.575 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:13:57.575 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:13:57.575 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:57.576 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-14T11:13:57.576 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:57.576 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:13:57.576 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:57.576 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-14T11:13:57.577 INFO:teuthology.orchestra.run.smithi026.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T11:13:57.577 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:57.577 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-14T11:13:57.577 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-14T11:13:57.577 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42340sec preferred_lft 42340sec 2023-10-14T11:13:57.577 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-14T11:13:57.578 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:57.578 INFO:teuthology.orchestra.run.smithi026.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:13:57.578 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:57.578 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-14T11:13:57.578 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:13:57.579 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:57.579 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-14T11:13:57.579 INFO:teuthology.orchestra.run.smithi026.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-14T11:13:57.579 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 02:42:e1:29:12:f0 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:57.580 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-14T11:13:57.580 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:57.581 INFO:teuthology.orchestra.run.smithi026.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T11:13:57.581 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-14T11:13:57.581 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T11:13:57.581 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:57.581 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-14T11:13:57.582 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:57.582 INFO:teuthology.orchestra.run.smithi026.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T11:13:57.582 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:13:57.582 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-14T11:13:57.582 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:57.583 INFO:teuthology.orchestra.run.smithi026.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T11:13:57.583 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:13:57.583 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-14T11:13:57.583 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:13:57.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:57.584 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T11:13:57.641 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-14T11:13:57.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:57.644 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-14T11:13:57.696 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-14T11:13:57.697 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T11:13:57.697 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-14T11:13:57.697 INFO:teuthology.orchestra.run.smithi026.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-14T11:13:57.697 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-14T11:13:57.697 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T11:13:57.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:57.698 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-14T11:13:57.699 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-14T11:13:57.699 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T11:13:57.699 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T11:13:57.700 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T11:13:57.700 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-14T11:13:57.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:57.795 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-14T11:13:57.805 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T11:13:57.805 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T11:13:57.806 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:13:57.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:57.807 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-10-14T11:13:57.872 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-14T11:13:57.872 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:13:57.872 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T11:13:57.927 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:13:57.927 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:13:57.928 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T11:13:57.983 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-10-14T11:13:58.052 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:13:58.104 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2023-10-14T11:13:58.105 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2023-10-14T11:13:58.105 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2023-10-14T11:13:58.105 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2023-10-14T11:13:58.105 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2023-10-14T11:13:58.106 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2023-10-14T11:13:58.106 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2023-10-14T11:13:58.106 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2023-10-14T11:13:58.106 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2023-10-14T11:13:58.106 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2023-10-14T11:13:58.107 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2023-10-14T11:13:58.107 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2023-10-14T11:13:58.107 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:13:58.107 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2023-10-14T11:13:58.107 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2023-10-14T11:13:58.108 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2023-10-14T11:13:58.108 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2023-10-14T11:13:58.108 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2023-10-14T11:13:58.108 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2023-10-14T11:13:58.108 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2023-10-14T11:13:58.109 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:13:58.109 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2023-10-14T11:13:58.109 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2023-10-14T11:13:58.109 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2023-10-14T11:13:58.109 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T11:13:58.110 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T11:13:58.110 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T11:13:58.110 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T11:13:58.110 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2023-10-14T11:13:58.110 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:13:58.111 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:13:58.111 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:13:58.111 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:13:58.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:58.112 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-10-14T11:13:58.163 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-14T11:13:58.163 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-14T11:13:58.210 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-10-14T11:13:58.242 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:13:58.314 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2023-10-14T11:13:58.316 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2023-10-14T11:13:58.316 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2023-10-14T11:13:58.317 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2023-10-14T11:13:58.318 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2023-10-14T11:13:58.318 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2023-10-14T11:13:58.319 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2023-10-14T11:13:58.320 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2023-10-14T11:13:58.320 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2023-10-14T11:13:58.321 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2023-10-14T11:13:58.321 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2023-10-14T11:13:58.322 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2023-10-14T11:13:58.322 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:13:58.324 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2023-10-14T11:13:58.325 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2023-10-14T11:13:58.325 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2023-10-14T11:13:58.326 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2023-10-14T11:13:58.326 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2023-10-14T11:13:58.327 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2023-10-14T11:13:58.327 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2023-10-14T11:13:58.328 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:13:58.328 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2023-10-14T11:13:58.328 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2023-10-14T11:13:58.329 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2023-10-14T11:13:58.329 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T11:13:58.330 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T11:13:58.330 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T11:13:58.331 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T11:13:58.332 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2023-10-14T11:13:58.332 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:13:58.332 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:13:58.332 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:13:58.332 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:13:58.333 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:2023-10-14T11:13:58.309+0000 7f1eca163580 -1 init, newargv = 0x56289319df10 newargc=15 2023-10-14T11:13:58.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:58.334 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-10-14T11:13:58.335 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[48259]: starting ceph client 2023-10-14T11:13:58.336 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[48259]: starting fuse 2023-10-14T11:13:58.397 INFO:teuthology.orchestra.run.smithi026.stdout:43 2023-10-14T11:13:58.397 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-10-14T11:13:58.398 DEBUG:teuthology.orchestra.run.smithi026:> sudo stdin-killer -- python3 -c ' 2023-10-14T11:13:58.398 DEBUG:teuthology.orchestra.run.smithi026:> import glob 2023-10-14T11:13:58.399 DEBUG:teuthology.orchestra.run.smithi026:> import re 2023-10-14T11:13:58.399 DEBUG:teuthology.orchestra.run.smithi026:> import os 2023-10-14T11:13:58.400 DEBUG:teuthology.orchestra.run.smithi026:> import subprocess 2023-10-14T11:13:58.400 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:13:58.400 DEBUG:teuthology.orchestra.run.smithi026:> def _find_admin_socket(client_name): 2023-10-14T11:13:58.401 DEBUG:teuthology.orchestra.run.smithi026:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-14T11:13:58.401 DEBUG:teuthology.orchestra.run.smithi026:> files = glob.glob(asok_path) 2023-10-14T11:13:58.401 DEBUG:teuthology.orchestra.run.smithi026:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-14T11:13:58.402 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:13:58.402 DEBUG:teuthology.orchestra.run.smithi026:> # Given a non-glob path, it better be there 2023-10-14T11:13:58.403 DEBUG:teuthology.orchestra.run.smithi026:> if "*" not in asok_path: 2023-10-14T11:13:58.403 DEBUG:teuthology.orchestra.run.smithi026:> assert(len(files) == 1) 2023-10-14T11:13:58.403 DEBUG:teuthology.orchestra.run.smithi026:> return files[0] 2023-10-14T11:13:58.404 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:13:58.404 DEBUG:teuthology.orchestra.run.smithi026:> for f in files: 2023-10-14T11:13:58.405 DEBUG:teuthology.orchestra.run.smithi026:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-14T11:13:58.405 DEBUG:teuthology.orchestra.run.smithi026:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-14T11:13:58.406 DEBUG:teuthology.orchestra.run.smithi026:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-14T11:13:58.406 DEBUG:teuthology.orchestra.run.smithi026:> contents = proc_f.read() 2023-10-14T11:13:58.406 DEBUG:teuthology.orchestra.run.smithi026:> if mountpoint in contents: 2023-10-14T11:13:58.407 DEBUG:teuthology.orchestra.run.smithi026:> return f 2023-10-14T11:13:58.407 DEBUG:teuthology.orchestra.run.smithi026:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-14T11:13:58.408 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:13:58.408 DEBUG:teuthology.orchestra.run.smithi026:> print(_find_admin_socket("client.0")) 2023-10-14T11:13:58.408 DEBUG:teuthology.orchestra.run.smithi026:> ' 2023-10-14T11:13:58.532 INFO:teuthology.orchestra.run.smithi026.stdout:/var/run/ceph/ceph-client.0.48259.asok 2023-10-14T11:13:58.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-14T11:13:58.543 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48259.asok 2023-10-14T11:13:58.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:58.544 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48259.asok status 2023-10-14T11:13:58.734 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:13:58.735 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": { 2023-10-14T11:13:58.735 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-14T11:13:58.735 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T11:13:58.735 INFO:teuthology.orchestra.run.smithi026.stdout: "entity_id": "0", 2023-10-14T11:13:58.736 INFO:teuthology.orchestra.run.smithi026.stdout: "hostname": "smithi026", 2023-10-14T11:13:58.736 INFO:teuthology.orchestra.run.smithi026.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-14T11:13:58.736 INFO:teuthology.orchestra.run.smithi026.stdout: "pid": "48259", 2023-10-14T11:13:58.736 INFO:teuthology.orchestra.run.smithi026.stdout: "root": "/" 2023-10-14T11:13:58.737 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:58.737 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_count": 0, 2023-10-14T11:13:58.737 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_pinned_count": 0, 2023-10-14T11:13:58.737 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 5682, 2023-10-14T11:13:58.737 INFO:teuthology.orchestra.run.smithi026.stdout: "inst": { 2023-10-14T11:13:58.738 INFO:teuthology.orchestra.run.smithi026.stdout: "name": { 2023-10-14T11:13:58.738 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "client", 2023-10-14T11:13:58.738 INFO:teuthology.orchestra.run.smithi026.stdout: "num": 5682 2023-10-14T11:13:58.738 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:58.738 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-10-14T11:13:58.739 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-14T11:13:58.739 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2023-10-14T11:13:58.739 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 2301847089 2023-10-14T11:13:58.739 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:13:58.739 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:58.740 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-10-14T11:13:58.740 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-14T11:13:58.740 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2023-10-14T11:13:58.740 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 2301847089 2023-10-14T11:13:58.740 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:13:58.741 INFO:teuthology.orchestra.run.smithi026.stdout: "inst_str": "client.5682 192.168.0.1:0/2301847089", 2023-10-14T11:13:58.741 INFO:teuthology.orchestra.run.smithi026.stdout: "addr_str": "192.168.0.1:0/2301847089", 2023-10-14T11:13:58.741 INFO:teuthology.orchestra.run.smithi026.stdout: "inode_count": 1, 2023-10-14T11:13:58.741 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_epoch": 17, 2023-10-14T11:13:58.741 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch": 39, 2023-10-14T11:13:58.742 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch_barrier": 0, 2023-10-14T11:13:58.742 INFO:teuthology.orchestra.run.smithi026.stdout: "blocklisted": false, 2023-10-14T11:13:58.742 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "testcephfs1" 2023-10-14T11:13:58.742 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:13:58.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:58.750 DEBUG:teuthology.orchestra.run.smithi026:> stat --file-system '--printf=%T 2023-10-14T11:13:58.750 DEBUG:teuthology.orchestra.run.smithi026:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-14T11:13:58.762 INFO:teuthology.orchestra.run.smithi026.stdout:fuseblk 2023-10-14T11:13:58.762 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-14T11:13:58.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:13:58.763 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T11:13:58.827 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create data_new --pg_num_min 64 2023-10-14T11:13:59.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2ddd50f640 1 Processor -- start 2023-10-14T11:13:59.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2ddd50f640 1 -- start start 2023-10-14T11:13:59.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2ddd50f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80cdc80 0x7f2dd80cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:59.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2ddd50f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd80ce460 con 0x7f2dd815dec0 2023-10-14T11:13:59.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2ddd50f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd815da30 con 0x7f2dd80d2570 2023-10-14T11:13:59.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2ddd50f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd80cd830 con 0x7f2dd80cdc80 2023-10-14T11:13:59.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2dd77fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2dd815dec0 0x7f2dd80d0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59882/0 (socket says 172.21.15.26:59882) 2023-10-14T11:13:59.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2dd77fe640 1 -- 172.21.15.26:0/1442801886 learned_addr learned my addr 172.21.15.26:0/1442801886 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:13:59.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2dce7fc640 1 --2- 172.21.15.26:0/1442801886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80cdc80 0x7f2dd80cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:59.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2dd67fc640 1 -- 172.21.15.26:0/1442801886 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222825479 0 0) 0x7f2dd80ce460 con 0x7f2dd815dec0 2023-10-14T11:13:59.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2dd67fc640 1 -- 172.21.15.26:0/1442801886 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dc4003530 con 0x7f2dd815dec0 2023-10-14T11:13:59.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2dd67fc640 1 -- 172.21.15.26:0/1442801886 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2428248893 0 0) 0x7f2dd815da30 con 0x7f2dd80d2570 2023-10-14T11:13:59.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2dd67fc640 1 -- 172.21.15.26:0/1442801886 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd80ce460 con 0x7f2dd80d2570 2023-10-14T11:13:59.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2dd67fc640 1 -- 172.21.15.26:0/1442801886 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1828201062 0 0) 0x7f2dc4003530 con 0x7f2dd815dec0 2023-10-14T11:13:59.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2dd67fc640 1 -- 172.21.15.26:0/1442801886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80cdc80 msgr2=0x7f2dd80cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:59.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2dd67fc640 1 --2- 172.21.15.26:0/1442801886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80cdc80 0x7f2dd80cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:59.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2dd67fc640 1 -- 172.21.15.26:0/1442801886 >> v1:172.21.15.110:6789/0 conn(0x7f2dd80d2570 legacy=0x7f2dd8161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:59.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2dd67fc640 1 -- 172.21.15.26:0/1442801886 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd80ce180 con 0x7f2dd815dec0 2023-10-14T11:13:59.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2dd67fc640 1 -- 172.21.15.26:0/1442801886 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f2dd0001680 con 0x7f2dd815dec0 2023-10-14T11:13:59.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2dd67fc640 1 -- 172.21.15.26:0/1442801886 >> v1:172.21.15.26:6789/0 conn(0x7f2dd815dec0 legacy=0x7f2dd80d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:59.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2dd67fc640 1 --2- 172.21.15.26:0/1442801886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc4003b40 0x7f2dc4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:59.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2dd67fc640 1 --2- 172.21.15.26:0/1442801886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dc40047d0 0x7f2dc4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:59.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2dd67fc640 1 --2- 172.21.15.26:0/1442801886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80cdc80 0x7f2dc4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:59.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2dd67fc640 1 -- 172.21.15.26:0/1442801886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd80cd830 con 0x7f2dc40047d0 2023-10-14T11:13:59.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2dd67fc640 1 -- 172.21.15.26:0/1442801886 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc400ba40 con 0x7f2dc4003b40 2023-10-14T11:13:59.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.021+0000 7f2dd67fc640 1 -- 172.21.15.26:0/1442801886 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc400bbd0 con 0x7f2dd80cdc80 2023-10-14T11:13:59.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.025+0000 7f2dce7fc640 1 --2- 172.21.15.26:0/1442801886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dc40047d0 0x7f2dc4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:59.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.025+0000 7f2dd6ffd640 1 --2- 172.21.15.26:0/1442801886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc4003b40 0x7f2dc4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:59.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.025+0000 7f2dd77fe640 1 --2- 172.21.15.26:0/1442801886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80cdc80 0x7f2dc4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:59.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.025+0000 7f2dce7fc640 1 -- 172.21.15.26:0/1442801886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80cdc80 msgr2=0x7f2dc4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:59.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.025+0000 7f2dce7fc640 1 --2- 172.21.15.26:0/1442801886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80cdc80 0x7f2dc4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:59.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.025+0000 7f2dce7fc640 1 -- 172.21.15.26:0/1442801886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc4003b40 msgr2=0x7f2dc4003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:59.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.025+0000 7f2dce7fc640 1 --2- 172.21.15.26:0/1442801886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc4003b40 0x7f2dc4003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:59.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.025+0000 7f2dce7fc640 1 -- 172.21.15.26:0/1442801886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc4003530 con 0x7f2dc40047d0 2023-10-14T11:13:59.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.025+0000 7f2dce7fc640 1 --2- 172.21.15.26:0/1442801886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dc40047d0 0x7f2dc4004c50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009fc0 tx=0x7f2dc001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24596de44516187d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:59.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.025+0000 7f2dd67fc640 1 -- 172.21.15.26:0/1442801886 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc00a5c10 con 0x7f2dc40047d0 2023-10-14T11:13:59.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.025+0000 7f2dd67fc640 1 -- 172.21.15.26:0/1442801886 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc000f040 con 0x7f2dc40047d0 2023-10-14T11:13:59.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.025+0000 7f2dd67fc640 1 -- 172.21.15.26:0/1442801886 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc00ad440 con 0x7f2dc40047d0 2023-10-14T11:13:59.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2ddd50f640 1 -- 172.21.15.26:0/1442801886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dc40047d0 msgr2=0x7f2dc4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:59.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2ddd50f640 1 --2- 172.21.15.26:0/1442801886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dc40047d0 0x7f2dc4004c50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009fc0 tx=0x7f2dc001cc00 comp rx=0 tx=0).stop 2023-10-14T11:13:59.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2dd77fe640 1 -- 172.21.15.26:0/1442801886 reap_dead start 2023-10-14T11:13:59.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2ddd50f640 1 -- 172.21.15.26:0/1442801886 shutdown_connections 2023-10-14T11:13:59.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2ddd50f640 1 -- 172.21.15.26:0/1442801886 >> 172.21.15.26:0/1442801886 conn(0x7f2dd80715c0 msgr2=0x7f2dd80719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:59.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2ddd50f640 1 -- 172.21.15.26:0/1442801886 shutdown_connections 2023-10-14T11:13:59.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2ddd50f640 1 -- 172.21.15.26:0/1442801886 wait complete. 2023-10-14T11:13:59.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2ddd50f640 1 Processor -- start 2023-10-14T11:13:59.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2ddd50f640 1 -- start start 2023-10-14T11:13:59.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2ddd50f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc40047d0 0x7f2dd814fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:59.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2ddd50f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dd80cb4d0 0x7f2dd81587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:59.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2ddd50f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80cb930 0x7f2dd8158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:59.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2ddd50f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd8150270 con 0x7f2dd80cb4d0 2023-10-14T11:13:59.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2ddd50f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd80c67f0 con 0x7f2dc40047d0 2023-10-14T11:13:59.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2ddd50f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd80c7c90 con 0x7f2dd80cb930 2023-10-14T11:13:59.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2dce7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dd80cb4d0 0x7f2dd81587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:59.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2dce7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dd80cb4d0 0x7f2dd81587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39366/0 (socket says 172.21.15.26:39366) 2023-10-14T11:13:59.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2dce7fc640 1 -- 172.21.15.26:0/3056773240 learned_addr learned my addr 172.21.15.26:0/3056773240 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:59.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2dd77fe640 1 --2- 172.21.15.26:0/3056773240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80cb930 0x7f2dd8158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:59.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2dd6ffd640 1 --2- 172.21.15.26:0/3056773240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc40047d0 0x7f2dd814fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:59.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2dce7fc640 1 -- 172.21.15.26:0/3056773240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80cb930 msgr2=0x7f2dd8158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:59.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2dce7fc640 1 --2- 172.21.15.26:0/3056773240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80cb930 0x7f2dd8158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:59.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2dce7fc640 1 -- 172.21.15.26:0/3056773240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc40047d0 msgr2=0x7f2dd814fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:59.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2dce7fc640 1 --2- 172.21.15.26:0/3056773240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc40047d0 0x7f2dd814fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:59.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.029+0000 7f2dce7fc640 1 -- 172.21.15.26:0/3056773240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd80c7f70 con 0x7f2dd80cb4d0 2023-10-14T11:13:59.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.033+0000 7f2dce7fc640 1 --2- 172.21.15.26:0/3056773240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dd80cb4d0 0x7f2dd81587c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00b0040 tx=0x7f2dc0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:59.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.033+0000 7f2dcffff640 1 -- 172.21.15.26:0/3056773240 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc00bd070 con 0x7f2dd80cb4d0 2023-10-14T11:13:59.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.033+0000 7f2dcffff640 1 -- 172.21.15.26:0/3056773240 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc00039a0 con 0x7f2dd80cb4d0 2023-10-14T11:13:59.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.033+0000 7f2dcffff640 1 -- 172.21.15.26:0/3056773240 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0003d30 con 0x7f2dd80cb4d0 2023-10-14T11:13:59.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.033+0000 7f2ddd50f640 1 -- 172.21.15.26:0/3056773240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd80c6a90 con 0x7f2dd80cb4d0 2023-10-14T11:13:59.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.033+0000 7f2ddd50f640 1 -- 172.21.15.26:0/3056773240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd80c6fb0 con 0x7f2dd80cb4d0 2023-10-14T11:13:59.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.033+0000 7f2ddd50f640 1 -- 172.21.15.26:0/3056773240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd804e170 con 0x7f2dd80cb4d0 2023-10-14T11:13:59.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.033+0000 7f2dcffff640 1 -- 172.21.15.26:0/3056773240 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2dc00b4040 con 0x7f2dd80cb4d0 2023-10-14T11:13:59.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.033+0000 7f2dcffff640 1 --2- 172.21.15.26:0/3056773240 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2db80664d0 0x7f2db8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:59.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.033+0000 7f2dcffff640 1 -- 172.21.15.26:0/3056773240 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f2dc8001d30 con 0x7f2dd80cb4d0 2023-10-14T11:13:59.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.037+0000 7f2dd6ffd640 1 --2- 172.21.15.26:0/3056773240 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2db80664d0 0x7f2db8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:59.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.037+0000 7f2dd6ffd640 1 --2- 172.21.15.26:0/3056773240 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2db80664d0 0x7f2db8068990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8005630 tx=0x7f2dc8001490 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:59.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.037+0000 7f2dcffff640 1 -- 172.21.15.26:0/3056773240 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2dc00eb350 con 0x7f2dd80cb4d0 2023-10-14T11:13:59.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.197+0000 7f2ddd50f640 1 -- 172.21.15.26:0/3056773240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64} v 0) v1 -- 0x7f2dd80d0de0 con 0x7f2dd80cb4d0 2023-10-14T11:13:59.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.269+0000 7f2dcffff640 1 -- 172.21.15.26:0/3056773240 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64}]=0 pool 'data_new' created v40) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2dc00b20a0 con 0x7f2dd80cb4d0 2023-10-14T11:13:59.273 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'data_new' created 2023-10-14T11:13:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.273+0000 7f2ddd50f640 1 -- 172.21.15.26:0/3056773240 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2db80664d0 msgr2=0x7f2db8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.273+0000 7f2ddd50f640 1 --2- 172.21.15.26:0/3056773240 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2db80664d0 0x7f2db8068990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8005630 tx=0x7f2dc8001490 comp rx=0 tx=0).stop 2023-10-14T11:13:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.273+0000 7f2ddd50f640 1 -- 172.21.15.26:0/3056773240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dd80cb4d0 msgr2=0x7f2dd81587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.273+0000 7f2ddd50f640 1 --2- 172.21.15.26:0/3056773240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dd80cb4d0 0x7f2dd81587c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00b0040 tx=0x7f2dc0009750 comp rx=0 tx=0).stop 2023-10-14T11:13:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.273+0000 7f2ddd50f640 1 -- 172.21.15.26:0/3056773240 shutdown_connections 2023-10-14T11:13:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.273+0000 7f2ddd50f640 1 --2- 172.21.15.26:0/3056773240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80cb930 0x7f2dd8158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.273+0000 7f2ddd50f640 1 --2- 172.21.15.26:0/3056773240 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2db80664d0 0x7f2db8068990 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.273+0000 7f2ddd50f640 1 --2- 172.21.15.26:0/3056773240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dd80cb4d0 0x7f2dd81587c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.273+0000 7f2ddd50f640 1 --2- 172.21.15.26:0/3056773240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc40047d0 0x7f2dd814fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:59.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.273+0000 7f2ddd50f640 1 -- 172.21.15.26:0/3056773240 >> 172.21.15.26:0/3056773240 conn(0x7f2dd80715c0 msgr2=0x7f2dd815c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:59.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.273+0000 7f2ddd50f640 1 -- 172.21.15.26:0/3056773240 shutdown_connections 2023-10-14T11:13:59.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.273+0000 7f2ddd50f640 1 -- 172.21.15.26:0/3056773240 wait complete. 2023-10-14T11:13:59.303 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool testcephfs1 data_new 2023-10-14T11:13:59.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.445+0000 7f980913e640 1 Processor -- start 2023-10-14T11:13:59.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.445+0000 7f980913e640 1 -- start start 2023-10-14T11:13:59.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.445+0000 7f980913e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9804069e90 0x7f980406d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:59.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.445+0000 7f980913e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f980406a270 0x7f98040c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:59.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.445+0000 7f980913e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980415ae30 con 0x7f98040702f0 2023-10-14T11:13:59.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.445+0000 7f980913e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98040cb090 con 0x7f9804069e90 2023-10-14T11:13:59.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.445+0000 7f980913e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98040ca510 con 0x7f980406a270 2023-10-14T11:13:59.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.449+0000 7f9802d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9804069e90 0x7f980406d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:59.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.449+0000 7f9802d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9804069e90 0x7f980406d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39380/0 (socket says 172.21.15.26:39380) 2023-10-14T11:13:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.449+0000 7f980359e640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f98040702f0 0x7f9804070780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59884/0 (socket says 172.21.15.26:59884) 2023-10-14T11:13:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.449+0000 7f9802d9d640 1 -- 172.21.15.26:0/1905477171 learned_addr learned my addr 172.21.15.26:0/1905477171 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.449+0000 7f97fbfff640 1 --2- 172.21.15.26:0/1905477171 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f980406a270 0x7f98040c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.449+0000 7f9802d9d640 1 -- 172.21.15.26:0/1905477171 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f980406a270 msgr2=0x7f98040c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:13:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.449+0000 7f9802d9d640 1 --2- 172.21.15.26:0/1905477171 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f980406a270 0x7f98040c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.449+0000 7f9802d9d640 1 -- 172.21.15.26:0/1905477171 >> v1:172.21.15.26:6789/0 conn(0x7f98040702f0 legacy=0x7f9804070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.449+0000 7f9802d9d640 1 -- 172.21.15.26:0/1905477171 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98040ca7f0 con 0x7f9804069e90 2023-10-14T11:13:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.449+0000 7f9802d9d640 1 --2- 172.21.15.26:0/1905477171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9804069e90 0x7f980406d010 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f97f4009870 tx=0x7f97f401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132c54f13a4877a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:59.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f980259c640 1 -- 172.21.15.26:0/1905477171 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f40aa670 con 0x7f9804069e90 2023-10-14T11:13:59.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f980259c640 1 -- 172.21.15.26:0/1905477171 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f40aa7d0 con 0x7f9804069e90 2023-10-14T11:13:59.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f980259c640 1 -- 172.21.15.26:0/1905477171 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f40aab60 con 0x7f9804069e90 2023-10-14T11:13:59.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f980913e640 1 -- 172.21.15.26:0/1905477171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9804069e90 msgr2=0x7f980406d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:59.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f980913e640 1 --2- 172.21.15.26:0/1905477171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9804069e90 0x7f980406d010 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f97f4009870 tx=0x7f97f401c510 comp rx=0 tx=0).stop 2023-10-14T11:13:59.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f980913e640 1 -- 172.21.15.26:0/1905477171 shutdown_connections 2023-10-14T11:13:59.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f980913e640 1 --2- 172.21.15.26:0/1905477171 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f980406a270 0x7f98040c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:59.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f980913e640 1 --2- 172.21.15.26:0/1905477171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9804069e90 0x7f980406d010 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:59.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f980913e640 1 -- 172.21.15.26:0/1905477171 >> 172.21.15.26:0/1905477171 conn(0x7f98040b0da0 msgr2=0x7f98040ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:13:59.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f980913e640 1 -- 172.21.15.26:0/1905477171 shutdown_connections 2023-10-14T11:13:59.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f980913e640 1 -- 172.21.15.26:0/1905477171 wait complete. 2023-10-14T11:13:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f980913e640 1 Processor -- start 2023-10-14T11:13:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f980913e640 1 -- start start 2023-10-14T11:13:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f980913e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9804069e90 0x7f9804152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f980913e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f980406a270 0x7f98041588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f980913e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98040702f0 0x7f9804153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f980913e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980415c810 con 0x7f980406a270 2023-10-14T11:13:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f980913e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9804157c80 con 0x7f98040702f0 2023-10-14T11:13:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f980913e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980415c1c0 con 0x7f9804069e90 2023-10-14T11:13:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f97fbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f980406a270 0x7f98041588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f97fbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f980406a270 0x7f98041588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39396/0 (socket says 172.21.15.26:39396) 2023-10-14T11:13:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f97fbfff640 1 -- 172.21.15.26:0/2614614557 learned_addr learned my addr 172.21.15.26:0/2614614557 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:13:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f980359e640 1 --2- 172.21.15.26:0/2614614557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98040702f0 0x7f9804153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.453+0000 7f9802d9d640 1 --2- 172.21.15.26:0/2614614557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9804069e90 0x7f9804152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.457+0000 7f97fbfff640 1 -- 172.21.15.26:0/2614614557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9804069e90 msgr2=0x7f9804152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.457+0000 7f97fbfff640 1 --2- 172.21.15.26:0/2614614557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9804069e90 0x7f9804152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.457+0000 7f97fbfff640 1 -- 172.21.15.26:0/2614614557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98040702f0 msgr2=0x7f9804153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:13:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.457+0000 7f97fbfff640 1 --2- 172.21.15.26:0/2614614557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98040702f0 0x7f9804153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:13:59.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.457+0000 7f97fbfff640 1 -- 172.21.15.26:0/2614614557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f40094d0 con 0x7f980406a270 2023-10-14T11:13:59.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.457+0000 7f97fbfff640 1 --2- 172.21.15.26:0/2614614557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f980406a270 0x7f98041588e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00d800 tx=0x7f97ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:59.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.457+0000 7f97fb7fe640 1 -- 172.21.15.26:0/2614614557 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec00b6c0 con 0x7f980406a270 2023-10-14T11:13:59.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.457+0000 7f97fb7fe640 1 -- 172.21.15.26:0/2614614557 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ec00b820 con 0x7f980406a270 2023-10-14T11:13:59.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.457+0000 7f97fb7fe640 1 -- 172.21.15.26:0/2614614557 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec00bb90 con 0x7f980406a270 2023-10-14T11:13:59.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.457+0000 7f980913e640 1 -- 172.21.15.26:0/2614614557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f980415c4a0 con 0x7f980406a270 2023-10-14T11:13:59.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.457+0000 7f980913e640 1 -- 172.21.15.26:0/2614614557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9804157470 con 0x7f980406a270 2023-10-14T11:13:59.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.457+0000 7f980913e640 1 -- 172.21.15.26:0/2614614557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980415c980 con 0x7f980406a270 2023-10-14T11:13:59.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.457+0000 7f97fb7fe640 1 -- 172.21.15.26:0/2614614557 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f97ec00bcf0 con 0x7f980406a270 2023-10-14T11:13:59.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.461+0000 7f97fb7fe640 1 --2- 172.21.15.26:0/2614614557 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f97e40664a0 0x7f97e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:13:59.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.461+0000 7f97fb7fe640 1 -- 172.21.15.26:0/2614614557 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6412+0+0 (secure 0 0 0) 0x7f97ec085230 con 0x7f980406a270 2023-10-14T11:13:59.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.461+0000 7f9802d9d640 1 --2- 172.21.15.26:0/2614614557 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f97e40664a0 0x7f97e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:13:59.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.461+0000 7f9802d9d640 1 --2- 172.21.15.26:0/2614614557 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f97e40664a0 0x7f97e4068960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f97f40ae000 tx=0x7f97f40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:13:59.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.461+0000 7f97fb7fe640 1 -- 172.21.15.26:0/2614614557 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f97ec0523d0 con 0x7f980406a270 2023-10-14T11:13:59.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:13:59.653+0000 7f980913e640 1 -- 172.21.15.26:0/2614614557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "testcephfs1", "pool": "data_new"} v 0) v1 -- 0x7f980404e170 con 0x7f980406a270 2023-10-14T11:14:00.295 INFO:teuthology.orchestra.run.smithi026.stderr:added data pool 7 to fsmap 2023-10-14T11:14:00.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.289+0000 7f97fb7fe640 1 -- 172.21.15.26:0/2614614557 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "testcephfs1", "pool": "data_new"}]=0 added data pool 7 to fsmap v18) v1 ==== 136+0+0 (secure 0 0 0) 0x7f97ec0559f0 con 0x7f980406a270 2023-10-14T11:14:00.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.297+0000 7f980913e640 1 -- 172.21.15.26:0/2614614557 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f97e40664a0 msgr2=0x7f97e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:00.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.297+0000 7f980913e640 1 --2- 172.21.15.26:0/2614614557 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f97e40664a0 0x7f97e4068960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f97f40ae000 tx=0x7f97f40a7000 comp rx=0 tx=0).stop 2023-10-14T11:14:00.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.297+0000 7f980913e640 1 -- 172.21.15.26:0/2614614557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f980406a270 msgr2=0x7f98041588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:00.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.297+0000 7f980913e640 1 --2- 172.21.15.26:0/2614614557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f980406a270 0x7f98041588e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00d800 tx=0x7f97ec00dcc0 comp rx=0 tx=0).stop 2023-10-14T11:14:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.301+0000 7f980913e640 1 -- 172.21.15.26:0/2614614557 shutdown_connections 2023-10-14T11:14:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.301+0000 7f980913e640 1 --2- 172.21.15.26:0/2614614557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98040702f0 0x7f9804153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.301+0000 7f980913e640 1 --2- 172.21.15.26:0/2614614557 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f97e40664a0 0x7f97e4068960 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.301+0000 7f980913e640 1 --2- 172.21.15.26:0/2614614557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f980406a270 0x7f98041588e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:00.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.301+0000 7f980913e640 1 --2- 172.21.15.26:0/2614614557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9804069e90 0x7f9804152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:00.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.301+0000 7f980913e640 1 -- 172.21.15.26:0/2614614557 >> 172.21.15.26:0/2614614557 conn(0x7f98040b0da0 msgr2=0x7f98040ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:00.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.305+0000 7f980913e640 1 -- 172.21.15.26:0/2614614557 shutdown_connections 2023-10-14T11:14:00.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.305+0000 7f980913e640 1 -- 172.21.15.26:0/2614614557 wait complete. 2023-10-14T11:14:00.333 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:14:00.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.477+0000 7f07df59e640 1 Processor -- start 2023-10-14T11:14:00.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.477+0000 7f07df59e640 1 -- start start 2023-10-14T11:14:00.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.477+0000 7f07df59e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f07e015c910 0x7f07e00d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:00.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.477+0000 7f07df59e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f07e00d3170 0x7f07e00cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:00.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.477+0000 7f07df59e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e00ce730 con 0x7f07e00cefe0 2023-10-14T11:14:00.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.477+0000 7f07df59e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e00d17a0 con 0x7f07e00d3170 2023-10-14T11:14:00.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.477+0000 7f07df59e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e00d0dd0 con 0x7f07e015c910 2023-10-14T11:14:00.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.477+0000 7f07ddd9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f07e00d3170 0x7f07e00cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:00.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.477+0000 7f07ddd9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f07e00d3170 0x7f07e00cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39402/0 (socket says 172.21.15.26:39402) 2023-10-14T11:14:00.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.477+0000 7f07ddd9b640 1 -- 172.21.15.26:0/137514743 learned_addr learned my addr 172.21.15.26:0/137514743 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:00.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.477+0000 7f07de59c640 1 --2- 172.21.15.26:0/137514743 >> v2:172.21.15.110:3300/0 conn(0x7f07e015c910 0x7f07e00d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:00.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.477+0000 7f07ddd9b640 1 -- 172.21.15.26:0/137514743 >> v2:172.21.15.110:3300/0 conn(0x7f07e015c910 msgr2=0x7f07e00d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:00.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.477+0000 7f07ddd9b640 1 --2- 172.21.15.26:0/137514743 >> v2:172.21.15.110:3300/0 conn(0x7f07e015c910 0x7f07e00d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:00.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.477+0000 7f07ddd9b640 1 -- 172.21.15.26:0/137514743 >> v1:172.21.15.110:6789/0 conn(0x7f07e00cefe0 legacy=0x7f07e006b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:00.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.477+0000 7f07ddd9b640 1 -- 172.21.15.26:0/137514743 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e00d04a0 con 0x7f07e00d3170 2023-10-14T11:14:00.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.481+0000 7f07ddd9b640 1 --2- 172.21.15.26:0/137514743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07e00d3170 0x7f07e00cde30 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f07e008b8d0 tx=0x7f07d401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6cd68cc7404bfe8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:00.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.481+0000 7f07dd59a640 1 -- 172.21.15.26:0/137514743 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d40ab640 con 0x7f07e00d3170 2023-10-14T11:14:00.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.481+0000 7f07dd59a640 1 -- 172.21.15.26:0/137514743 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d40a7070 con 0x7f07e00d3170 2023-10-14T11:14:00.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.481+0000 7f07dd59a640 1 -- 172.21.15.26:0/137514743 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d40ab9c0 con 0x7f07e00d3170 2023-10-14T11:14:00.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.481+0000 7f07df59e640 1 -- 172.21.15.26:0/137514743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07e00d3170 msgr2=0x7f07e00cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:00.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.481+0000 7f07df59e640 1 --2- 172.21.15.26:0/137514743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07e00d3170 0x7f07e00cde30 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f07e008b8d0 tx=0x7f07d401c440 comp rx=0 tx=0).stop 2023-10-14T11:14:00.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.481+0000 7f07df59e640 1 -- 172.21.15.26:0/137514743 shutdown_connections 2023-10-14T11:14:00.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.481+0000 7f07df59e640 1 --2- 172.21.15.26:0/137514743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07e00d3170 0x7f07e00cde30 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:00.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.481+0000 7f07df59e640 1 --2- 172.21.15.26:0/137514743 >> v2:172.21.15.110:3300/0 conn(0x7f07e015c910 0x7f07e00d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:00.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.481+0000 7f07df59e640 1 -- 172.21.15.26:0/137514743 >> 172.21.15.26:0/137514743 conn(0x7f07e009bb50 msgr2=0x7f07e00d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:00.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.481+0000 7f07df59e640 1 -- 172.21.15.26:0/137514743 shutdown_connections 2023-10-14T11:14:00.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.481+0000 7f07df59e640 1 -- 172.21.15.26:0/137514743 wait complete. 2023-10-14T11:14:00.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07df59e640 1 Processor -- start 2023-10-14T11:14:00.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07df59e640 1 -- start start 2023-10-14T11:14:00.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07df59e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e00cefe0 0x7f07e014c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:00.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07df59e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07e00d3170 0x7f07e015a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:00.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07df59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07e015c910 0x7f07e015ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:00.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07df59e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e0154e40 con 0x7f07e015c910 2023-10-14T11:14:00.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07df59e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e00b2fc0 con 0x7f07e00d3170 2023-10-14T11:14:00.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07df59e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e00b3b00 con 0x7f07e00cefe0 2023-10-14T11:14:00.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07ded9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07e015c910 0x7f07e015ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:00.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07de59c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e00cefe0 0x7f07e014c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:00.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07de59c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e00cefe0 0x7f07e014c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:56296/0 (socket says 172.21.15.26:56296) 2023-10-14T11:14:00.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07de59c640 1 -- 172.21.15.26:0/2485605509 learned_addr learned my addr 172.21.15.26:0/2485605509 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:00.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07ddd9b640 1 --2- 172.21.15.26:0/2485605509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07e00d3170 0x7f07e015a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:00.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07ded9d640 1 -- 172.21.15.26:0/2485605509 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e00cefe0 msgr2=0x7f07e014c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:00.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07ded9d640 1 --2- 172.21.15.26:0/2485605509 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e00cefe0 0x7f07e014c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:00.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07ded9d640 1 -- 172.21.15.26:0/2485605509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07e00d3170 msgr2=0x7f07e015a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:00.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07ded9d640 1 --2- 172.21.15.26:0/2485605509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07e00d3170 0x7f07e015a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:00.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07ded9d640 1 -- 172.21.15.26:0/2485605509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d40094d0 con 0x7f07e015c910 2023-10-14T11:14:00.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07de59c640 1 --2- 172.21.15.26:0/2485605509 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e00cefe0 0x7f07e014c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:14:00.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07ddd9b640 1 --2- 172.21.15.26:0/2485605509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07e00d3170 0x7f07e015a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:14:00.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07ded9d640 1 --2- 172.21.15.26:0/2485605509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07e015c910 0x7f07e015ac50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f07d800c700 tx=0x7f07d800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:00.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07ceffd640 1 -- 172.21.15.26:0/2485605509 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8003b80 con 0x7f07e015c910 2023-10-14T11:14:00.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07ceffd640 1 -- 172.21.15.26:0/2485605509 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d8003ce0 con 0x7f07e015c910 2023-10-14T11:14:00.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07df59e640 1 -- 172.21.15.26:0/2485605509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e00b31d0 con 0x7f07e015c910 2023-10-14T11:14:00.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07ceffd640 1 -- 172.21.15.26:0/2485605509 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8005310 con 0x7f07e015c910 2023-10-14T11:14:00.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07df59e640 1 -- 172.21.15.26:0/2485605509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e00b3790 con 0x7f07e015c910 2023-10-14T11:14:00.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.485+0000 7f07df59e640 1 -- 172.21.15.26:0/2485605509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e00b3c90 con 0x7f07e015c910 2023-10-14T11:14:00.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.489+0000 7f07ceffd640 1 -- 172.21.15.26:0/2485605509 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f07d8005470 con 0x7f07e015c910 2023-10-14T11:14:00.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.489+0000 7f07ceffd640 1 --2- 172.21.15.26:0/2485605509 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f07c00664d0 0x7f07c0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:00.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.489+0000 7f07ceffd640 1 -- 172.21.15.26:0/2485605509 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f07d8083e30 con 0x7f07e015c910 2023-10-14T11:14:00.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.489+0000 7f07de59c640 1 --2- 172.21.15.26:0/2485605509 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f07c00664d0 0x7f07c0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:00.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.489+0000 7f07de59c640 1 --2- 172.21.15.26:0/2485605509 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f07c00664d0 0x7f07c0068990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f07d00112c0 tx=0x7f07d0006f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:00.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.493+0000 7f07ceffd640 1 -- 172.21.15.26:0/2485605509 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f07d8050f40 con 0x7f07e015c910 2023-10-14T11:14:00.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.681+0000 7f07df59e640 1 -- 172.21.15.26:0/2485605509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07e004e9c0 con 0x7f07e015c910 2023-10-14T11:14:00.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.681+0000 7f07ceffd640 1 -- 172.21.15.26:0/2485605509 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f07d8054560 con 0x7f07e015c910 2023-10-14T11:14:00.686 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:00.686 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5425,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/1669994220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1669994220},{"type":"v1","addr":"172.21.15.110:6834","nonce":1669994220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3054425791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3054425791},{"type":"v1","addr":"172.21.15.110:6835","nonce":3054425791}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5434,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3759640340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3759640340},{"type":"v1","addr":"172.21.15.26:6837","nonce":3759640340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:13:50.622103+0000","modified":"2023-10-14T11:13:59.658132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5493":{"gid":5493,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/812681761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":812681761},{"type":"v1","addr":"172.21.15.26:6835","nonce":812681761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T11:14:00.687 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 18 2023-10-14T11:14:00.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.685+0000 7f07df59e640 1 -- 172.21.15.26:0/2485605509 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f07c00664d0 msgr2=0x7f07c0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:00.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.685+0000 7f07df59e640 1 --2- 172.21.15.26:0/2485605509 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f07c00664d0 0x7f07c0068990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f07d00112c0 tx=0x7f07d0006f90 comp rx=0 tx=0).stop 2023-10-14T11:14:00.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.685+0000 7f07df59e640 1 -- 172.21.15.26:0/2485605509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07e015c910 msgr2=0x7f07e015ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:00.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.685+0000 7f07df59e640 1 --2- 172.21.15.26:0/2485605509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07e015c910 0x7f07e015ac50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f07d800c700 tx=0x7f07d800cbc0 comp rx=0 tx=0).stop 2023-10-14T11:14:00.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.685+0000 7f07df59e640 1 -- 172.21.15.26:0/2485605509 shutdown_connections 2023-10-14T11:14:00.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.685+0000 7f07df59e640 1 --2- 172.21.15.26:0/2485605509 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f07c00664d0 0x7f07c0068990 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:00.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.685+0000 7f07df59e640 1 --2- 172.21.15.26:0/2485605509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07e015c910 0x7f07e015ac50 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:00.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.685+0000 7f07df59e640 1 --2- 172.21.15.26:0/2485605509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07e00d3170 0x7f07e015a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:00.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.685+0000 7f07df59e640 1 --2- 172.21.15.26:0/2485605509 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e00cefe0 0x7f07e014c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:00.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.685+0000 7f07df59e640 1 -- 172.21.15.26:0/2485605509 >> 172.21.15.26:0/2485605509 conn(0x7f07e009bb50 msgr2=0x7f07e0155010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:00.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.685+0000 7f07df59e640 1 -- 172.21.15.26:0/2485605509 shutdown_connections 2023-10-14T11:14:00.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.685+0000 7f07df59e640 1 -- 172.21.15.26:0/2485605509 wait complete. 2023-10-14T11:14:00.707 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:14:00.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.845+0000 7f4db166b640 1 Processor -- start 2023-10-14T11:14:00.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.845+0000 7f4db166b640 1 -- start start 2023-10-14T11:14:00.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.849+0000 7f4db166b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dac15cb90 0x7f4dac0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:00.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.849+0000 7f4db166b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4dac0d15d0 0x7f4dac0c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:00.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.849+0000 7f4db166b640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dac0ce770 con 0x7f4dac0d3010 2023-10-14T11:14:00.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.849+0000 7f4db166b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dac0d0600 con 0x7f4dac0d15d0 2023-10-14T11:14:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.849+0000 7f4db166b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac0c6450 con 0x7f4dac15cb90 2023-10-14T11:14:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.849+0000 7f4dab7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4dac0d15d0 0x7f4dac0c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.849+0000 7f4dab7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4dac0d15d0 0x7f4dac0c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39424/0 (socket says 172.21.15.26:39424) 2023-10-14T11:14:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.849+0000 7f4dab7fe640 1 -- 172.21.15.26:0/3106937870 learned_addr learned my addr 172.21.15.26:0/3106937870 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.849+0000 7f4daa7fc640 1 --1- 172.21.15.26:0/3106937870 >> v1:172.21.15.26:6789/0 conn(0x7f4dac0d3010 0x7f4dac0d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59894/0 (socket says 172.21.15.26:59894) 2023-10-14T11:14:00.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.849+0000 7f4daaffd640 1 --2- 172.21.15.26:0/3106937870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dac15cb90 0x7f4dac0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:00.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.849+0000 7f4dab7fe640 1 -- 172.21.15.26:0/3106937870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dac15cb90 msgr2=0x7f4dac0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:00.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.849+0000 7f4dab7fe640 1 --2- 172.21.15.26:0/3106937870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dac15cb90 0x7f4dac0cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:00.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.849+0000 7f4dab7fe640 1 -- 172.21.15.26:0/3106937870 >> v1:172.21.15.26:6789/0 conn(0x7f4dac0d3010 legacy=0x7f4dac0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:00.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.849+0000 7f4dab7fe640 1 -- 172.21.15.26:0/3106937870 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac0d08a0 con 0x7f4dac0d15d0 2023-10-14T11:14:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.853+0000 7f4dab7fe640 1 --2- 172.21.15.26:0/3106937870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac0d15d0 0x7f4dac0c6c10 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4da4009e50 tx=0x7f4da401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1950f0b93c94ddbe server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.853+0000 7f4da9ffb640 1 -- 172.21.15.26:0/3106937870 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da40a5810 con 0x7f4dac0d15d0 2023-10-14T11:14:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.853+0000 7f4da9ffb640 1 -- 172.21.15.26:0/3106937870 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da40a5970 con 0x7f4dac0d15d0 2023-10-14T11:14:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.853+0000 7f4da9ffb640 1 -- 172.21.15.26:0/3106937870 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da40a5d00 con 0x7f4dac0d15d0 2023-10-14T11:14:00.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.853+0000 7f4db166b640 1 -- 172.21.15.26:0/3106937870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac0d15d0 msgr2=0x7f4dac0c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:00.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.853+0000 7f4db166b640 1 --2- 172.21.15.26:0/3106937870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac0d15d0 0x7f4dac0c6c10 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4da4009e50 tx=0x7f4da401c950 comp rx=0 tx=0).stop 2023-10-14T11:14:00.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.853+0000 7f4db166b640 1 -- 172.21.15.26:0/3106937870 shutdown_connections 2023-10-14T11:14:00.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.853+0000 7f4db166b640 1 --2- 172.21.15.26:0/3106937870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac0d15d0 0x7f4dac0c6c10 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:00.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.853+0000 7f4db166b640 1 --2- 172.21.15.26:0/3106937870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dac15cb90 0x7f4dac0cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:00.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.853+0000 7f4db166b640 1 -- 172.21.15.26:0/3106937870 >> 172.21.15.26:0/3106937870 conn(0x7f4dac09bc50 msgr2=0x7f4dac0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:00.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.853+0000 7f4db166b640 1 -- 172.21.15.26:0/3106937870 shutdown_connections 2023-10-14T11:14:00.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.853+0000 7f4db166b640 1 -- 172.21.15.26:0/3106937870 wait complete. 2023-10-14T11:14:00.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.853+0000 7f4db166b640 1 Processor -- start 2023-10-14T11:14:00.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.853+0000 7f4db166b640 1 -- start start 2023-10-14T11:14:00.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4db166b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dac0d15d0 0x7f4dac14d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:00.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4db166b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dac0d3010 0x7f4dac0cc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:00.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4db166b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac15cb90 0x7f4dac154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:00.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4db166b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac0cbfe0 con 0x7f4dac15cb90 2023-10-14T11:14:00.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4db166b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac0caa20 con 0x7f4dac0d15d0 2023-10-14T11:14:00.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4db166b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac0cb940 con 0x7f4dac0d3010 2023-10-14T11:14:00.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4dab7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac15cb90 0x7f4dac154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:00.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4dab7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac15cb90 0x7f4dac154860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39428/0 (socket says 172.21.15.26:39428) 2023-10-14T11:14:00.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4dab7fe640 1 -- 172.21.15.26:0/25905118 learned_addr learned my addr 172.21.15.26:0/25905118 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:00.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4daaffd640 1 --2- 172.21.15.26:0/25905118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dac0d15d0 0x7f4dac14d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:00.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4daa7fc640 1 --2- 172.21.15.26:0/25905118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dac0d3010 0x7f4dac0cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:00.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4dab7fe640 1 -- 172.21.15.26:0/25905118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dac0d3010 msgr2=0x7f4dac0cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:00.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4dab7fe640 1 --2- 172.21.15.26:0/25905118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dac0d3010 0x7f4dac0cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:00.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4dab7fe640 1 -- 172.21.15.26:0/25905118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dac0d15d0 msgr2=0x7f4dac14d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:00.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4dab7fe640 1 --2- 172.21.15.26:0/25905118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dac0d15d0 0x7f4dac14d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:00.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4dab7fe640 1 -- 172.21.15.26:0/25905118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da4009b30 con 0x7f4dac15cb90 2023-10-14T11:14:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4dab7fe640 1 --2- 172.21.15.26:0/25905118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac15cb90 0x7f4dac154860 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4da401a580 tx=0x7f4da40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4d937fe640 1 -- 172.21.15.26:0/25905118 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da40b8670 con 0x7f4dac15cb90 2023-10-14T11:14:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4d937fe640 1 -- 172.21.15.26:0/25905118 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da40b87d0 con 0x7f4dac15cb90 2023-10-14T11:14:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4db166b640 1 -- 172.21.15.26:0/25905118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dac0cac30 con 0x7f4dac15cb90 2023-10-14T11:14:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4d937fe640 1 -- 172.21.15.26:0/25905118 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da40b8b80 con 0x7f4dac15cb90 2023-10-14T11:14:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4db166b640 1 -- 172.21.15.26:0/25905118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dac159100 con 0x7f4dac15cb90 2023-10-14T11:14:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4db166b640 1 -- 172.21.15.26:0/25905118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dac0cc120 con 0x7f4dac15cb90 2023-10-14T11:14:00.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.857+0000 7f4d937fe640 1 -- 172.21.15.26:0/25905118 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4da40b8ce0 con 0x7f4dac15cb90 2023-10-14T11:14:00.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.861+0000 7f4d937fe640 1 --2- 172.21.15.26:0/25905118 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4d980664a0 0x7f4d98068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:00.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.861+0000 7f4d937fe640 1 -- 172.21.15.26:0/25905118 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f4da411f750 con 0x7f4dac15cb90 2023-10-14T11:14:00.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.861+0000 7f4daaffd640 1 --2- 172.21.15.26:0/25905118 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4d980664a0 0x7f4d98068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:00.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.861+0000 7f4daaffd640 1 --2- 172.21.15.26:0/25905118 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4d980664a0 0x7f4d98068960 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c009a30 tx=0x7f4d9c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:00.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:00.865+0000 7f4d937fe640 1 -- 172.21.15.26:0/25905118 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4dac0cc120 con 0x7f4dac15cb90 2023-10-14T11:14:01.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.025+0000 7f4db166b640 1 -- 172.21.15.26:0/25905118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4dac0cc120 con 0x7f4dac15cb90 2023-10-14T11:14:01.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.025+0000 7f4d937fe640 1 -- 172.21.15.26:0/25905118 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18591 (secure 0 0 0) 0x7f4dac0cc120 con 0x7f4dac15cb90 2023-10-14T11:14:01.028 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:01.029 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":41,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:13:59.657881+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:13:48.453821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:13:49.623527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-10-14T11:13:59.245615+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:14:01.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.025+0000 7f4db166b640 1 -- 172.21.15.26:0/25905118 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4d980664a0 msgr2=0x7f4d98068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:01.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.025+0000 7f4db166b640 1 --2- 172.21.15.26:0/25905118 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4d980664a0 0x7f4d98068960 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c009a30 tx=0x7f4d9c008040 comp rx=0 tx=0).stop 2023-10-14T11:14:01.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.025+0000 7f4db166b640 1 -- 172.21.15.26:0/25905118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac15cb90 msgr2=0x7f4dac154860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:01.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.025+0000 7f4db166b640 1 --2- 172.21.15.26:0/25905118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac15cb90 0x7f4dac154860 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4da401a580 tx=0x7f4da40196f0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.025+0000 7f4db166b640 1 -- 172.21.15.26:0/25905118 shutdown_connections 2023-10-14T11:14:01.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.025+0000 7f4db166b640 1 --2- 172.21.15.26:0/25905118 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4d980664a0 0x7f4d98068960 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.025+0000 7f4db166b640 1 --2- 172.21.15.26:0/25905118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac15cb90 0x7f4dac154860 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.025+0000 7f4db166b640 1 --2- 172.21.15.26:0/25905118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dac0d3010 0x7f4dac0cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.025+0000 7f4db166b640 1 --2- 172.21.15.26:0/25905118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dac0d15d0 0x7f4dac14d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.025+0000 7f4db166b640 1 -- 172.21.15.26:0/25905118 >> 172.21.15.26:0/25905118 conn(0x7f4dac09bc50 msgr2=0x7f4dac0d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:01.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.025+0000 7f4db166b640 1 -- 172.21.15.26:0/25905118 shutdown_connections 2023-10-14T11:14:01.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.025+0000 7f4db166b640 1 -- 172.21.15.26:0/25905118 wait complete. 2023-10-14T11:14:01.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:01.050 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch layoutfile) 2023-10-14T11:14:01.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:01.068 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir layoutdir) 2023-10-14T11:14:01.123 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rw' mon 'allow r' osd 'allow rw pool=testcephfs1_data,allow rw pool=data_new' 2023-10-14T11:14:01.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.313+0000 7f6b19ba3640 1 Processor -- start 2023-10-14T11:14:01.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.313+0000 7f6b19ba3640 1 -- start start 2023-10-14T11:14:01.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.313+0000 7f6b19ba3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b14160090 0x7f6b140b3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:01.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.313+0000 7f6b19ba3640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6b140cf7a0 0x7f6b140cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:01.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.313+0000 7f6b19ba3640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b140cd460 con 0x7f6b140b3a80 2023-10-14T11:14:01.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.313+0000 7f6b19ba3640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b140b2af0 con 0x7f6b140cf7a0 2023-10-14T11:14:01.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.313+0000 7f6b19ba3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140d32c0 con 0x7f6b14160090 2023-10-14T11:14:01.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b13fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6b140b3a80 0x7f6b140cf090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59910/0 (socket says 172.21.15.26:59910) 2023-10-14T11:14:01.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b13fff640 1 -- 172.21.15.26:0/694073603 learned_addr learned my addr 172.21.15.26:0/694073603 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:01.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b18ba1640 1 --2- 172.21.15.26:0/694073603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b14160090 0x7f6b140b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:01.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b193a2640 1 --2- 172.21.15.26:0/694073603 >> v2:172.21.15.110:3300/0 conn(0x7f6b140cf7a0 0x7f6b140cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:01.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b137fe640 1 -- 172.21.15.26:0/694073603 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794762120 0 0) 0x7f6b140cd460 con 0x7f6b140b3a80 2023-10-14T11:14:01.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b137fe640 1 -- 172.21.15.26:0/694073603 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b04003530 con 0x7f6b140b3a80 2023-10-14T11:14:01.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b137fe640 1 -- 172.21.15.26:0/694073603 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3927665618 0 0) 0x7f6b04003530 con 0x7f6b140b3a80 2023-10-14T11:14:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b137fe640 1 -- 172.21.15.26:0/694073603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b14160090 msgr2=0x7f6b140b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b137fe640 1 --2- 172.21.15.26:0/694073603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b14160090 0x7f6b140b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b137fe640 1 -- 172.21.15.26:0/694073603 >> v2:172.21.15.110:3300/0 conn(0x7f6b140cf7a0 msgr2=0x7f6b140cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b137fe640 1 --2- 172.21.15.26:0/694073603 >> v2:172.21.15.110:3300/0 conn(0x7f6b140cf7a0 0x7f6b140cd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b137fe640 1 -- 172.21.15.26:0/694073603 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b140b38d0 con 0x7f6b140b3a80 2023-10-14T11:14:01.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b137fe640 1 -- 172.21.15.26:0/694073603 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f6b00001680 con 0x7f6b140b3a80 2023-10-14T11:14:01.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b137fe640 1 -- 172.21.15.26:0/694073603 >> v1:172.21.15.26:6789/0 conn(0x7f6b140b3a80 legacy=0x7f6b140cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:01.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b137fe640 1 --2- 172.21.15.26:0/694073603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b14160090 0x7f6b04003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:01.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b137fe640 1 --2- 172.21.15.26:0/694073603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b04003f00 0x7f6b040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:01.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b137fe640 1 --2- 172.21.15.26:0/694073603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b04004d10 0x7f6b04005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:01.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b137fe640 1 -- 172.21.15.26:0/694073603 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140b2af0 con 0x7f6b04004d10 2023-10-14T11:14:01.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b137fe640 1 -- 172.21.15.26:0/694073603 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140d32c0 con 0x7f6b04003f00 2023-10-14T11:14:01.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b137fe640 1 -- 172.21.15.26:0/694073603 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0400b990 con 0x7f6b14160090 2023-10-14T11:14:01.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b18ba1640 1 --2- 172.21.15.26:0/694073603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b14160090 0x7f6b04003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:01.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b193a2640 1 --2- 172.21.15.26:0/694073603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b04004d10 0x7f6b04005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:01.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b13fff640 1 --2- 172.21.15.26:0/694073603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b04003f00 0x7f6b040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:01.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b18ba1640 1 -- 172.21.15.26:0/694073603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b04003f00 msgr2=0x7f6b040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:01.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b18ba1640 1 --2- 172.21.15.26:0/694073603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b04003f00 0x7f6b040047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b18ba1640 1 -- 172.21.15.26:0/694073603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b04004d10 msgr2=0x7f6b04005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:01.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b18ba1640 1 --2- 172.21.15.26:0/694073603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b04004d10 0x7f6b04005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b18ba1640 1 -- 172.21.15.26:0/694073603 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b04003530 con 0x7f6b14160090 2023-10-14T11:14:01.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.317+0000 7f6b193a2640 1 --2- 172.21.15.26:0/694073603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b04004d10 0x7f6b04005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:14:01.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.321+0000 7f6b18ba1640 1 --2- 172.21.15.26:0/694073603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b14160090 0x7f6b04003980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6b08009ac0 tx=0x7f6b0801ca70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=420ed7e0b0c392c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:01.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.321+0000 7f6b137fe640 1 -- 172.21.15.26:0/694073603 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b080059a0 con 0x7f6b14160090 2023-10-14T11:14:01.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.321+0000 7f6b137fe640 1 -- 172.21.15.26:0/694073603 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b08005b00 con 0x7f6b14160090 2023-10-14T11:14:01.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.321+0000 7f6b137fe640 1 -- 172.21.15.26:0/694073603 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b080a5660 con 0x7f6b14160090 2023-10-14T11:14:01.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.321+0000 7f6b19ba3640 1 -- 172.21.15.26:0/694073603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b14160090 msgr2=0x7f6b04003980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:01.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.321+0000 7f6b19ba3640 1 --2- 172.21.15.26:0/694073603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b14160090 0x7f6b04003980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6b08009ac0 tx=0x7f6b0801ca70 comp rx=0 tx=0).stop 2023-10-14T11:14:01.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.321+0000 7f6b193a2640 1 -- 172.21.15.26:0/694073603 reap_dead start 2023-10-14T11:14:01.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.321+0000 7f6b19ba3640 1 -- 172.21.15.26:0/694073603 shutdown_connections 2023-10-14T11:14:01.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.321+0000 7f6b19ba3640 1 -- 172.21.15.26:0/694073603 >> 172.21.15.26:0/694073603 conn(0x7f6b140d27a0 msgr2=0x7f6b140d2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:01.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.321+0000 7f6b19ba3640 1 -- 172.21.15.26:0/694073603 shutdown_connections 2023-10-14T11:14:01.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.321+0000 7f6b19ba3640 1 -- 172.21.15.26:0/694073603 wait complete. 2023-10-14T11:14:01.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.321+0000 7f6b19ba3640 1 Processor -- start 2023-10-14T11:14:01.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.321+0000 7f6b19ba3640 1 -- start start 2023-10-14T11:14:01.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b19ba3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b14160090 0x7f6b140cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:01.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b19ba3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b141f5900 0x7f6b14155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:01.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b19ba3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b140c7830 0x7f6b140c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:01.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b19ba3640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140c8220 con 0x7f6b141f5900 2023-10-14T11:14:01.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b19ba3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b141562a0 con 0x7f6b14160090 2023-10-14T11:14:01.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b19ba3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b141f6830 con 0x7f6b140c7830 2023-10-14T11:14:01.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b13fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b141f5900 0x7f6b14155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:01.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b13fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b141f5900 0x7f6b14155d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39452/0 (socket says 172.21.15.26:39452) 2023-10-14T11:14:01.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b13fff640 1 -- 172.21.15.26:0/1907503751 learned_addr learned my addr 172.21.15.26:0/1907503751 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:01.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b18ba1640 1 --2- 172.21.15.26:0/1907503751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b14160090 0x7f6b140cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:01.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b193a2640 1 --2- 172.21.15.26:0/1907503751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b140c7830 0x7f6b140c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:01.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b13fff640 1 -- 172.21.15.26:0/1907503751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b140c7830 msgr2=0x7f6b140c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:01.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b13fff640 1 --2- 172.21.15.26:0/1907503751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b140c7830 0x7f6b140c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b13fff640 1 -- 172.21.15.26:0/1907503751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b14160090 msgr2=0x7f6b140cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:01.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b13fff640 1 --2- 172.21.15.26:0/1907503751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b14160090 0x7f6b140cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b13fff640 1 -- 172.21.15.26:0/1907503751 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b140ca4f0 con 0x7f6b141f5900 2023-10-14T11:14:01.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b13fff640 1 --2- 172.21.15.26:0/1907503751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b141f5900 0x7f6b14155d60 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6b00007370 tx=0x7f6b00007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:01.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b117fa640 1 -- 172.21.15.26:0/1907503751 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0000f960 con 0x7f6b141f5900 2023-10-14T11:14:01.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b117fa640 1 -- 172.21.15.26:0/1907503751 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0000fac0 con 0x7f6b141f5900 2023-10-14T11:14:01.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b117fa640 1 -- 172.21.15.26:0/1907503751 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0000fe50 con 0x7f6b141f5900 2023-10-14T11:14:01.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b19ba3640 1 -- 172.21.15.26:0/1907503751 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b141f5f90 con 0x7f6b141f5900 2023-10-14T11:14:01.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b19ba3640 1 -- 172.21.15.26:0/1907503751 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b141f6550 con 0x7f6b141f5900 2023-10-14T11:14:01.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.325+0000 7f6b19ba3640 1 -- 172.21.15.26:0/1907503751 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1404e9c0 con 0x7f6b141f5900 2023-10-14T11:14:01.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.329+0000 7f6b117fa640 1 -- 172.21.15.26:0/1907503751 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6b0001d460 con 0x7f6b141f5900 2023-10-14T11:14:01.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.329+0000 7f6b117fa640 1 --2- 172.21.15.26:0/1907503751 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6af80664d0 0x7f6af8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:01.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.329+0000 7f6b117fa640 1 -- 172.21.15.26:0/1907503751 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f6b000841e0 con 0x7f6b141f5900 2023-10-14T11:14:01.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.329+0000 7f6b18ba1640 1 --2- 172.21.15.26:0/1907503751 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6af80664d0 0x7f6af8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:01.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.329+0000 7f6b18ba1640 1 --2- 172.21.15.26:0/1907503751 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6af80664d0 0x7f6af8068990 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6b080ae000 tx=0x7f6b080046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:01.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.333+0000 7f6b117fa640 1 -- 172.21.15.26:0/1907503751 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6b00051380 con 0x7f6b141f5900 2023-10-14T11:14:01.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.545+0000 7f6b19ba3640 1 -- 172.21.15.26:0/1907503751 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=testcephfs1_data,allow rw pool=data_new"]} v 0) v1 -- 0x7f6b140c5d80 con 0x7f6b141f5900 2023-10-14T11:14:01.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.549+0000 7f6b117fa640 1 -- 172.21.15.26:0/1907503751 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=testcephfs1_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v12) v1 ==== 215+0+172 (secure 0 0 0) 0x7f6b000549a0 con 0x7f6b141f5900 2023-10-14T11:14:01.554 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2023-10-14T11:14:01.554 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBZdyplGXdwHxAA3yn7fC60cZX9BQGuvdlfYw== 2023-10-14T11:14:01.554 INFO:teuthology.orchestra.run.smithi026.stdout: caps mds = "allow rw" 2023-10-14T11:14:01.554 INFO:teuthology.orchestra.run.smithi026.stdout: caps mon = "allow r" 2023-10-14T11:14:01.554 INFO:teuthology.orchestra.run.smithi026.stdout: caps osd = "allow rw pool=testcephfs1_data,allow rw pool=data_new" 2023-10-14T11:14:01.555 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-10-14T11:14:01.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.553+0000 7f6b19ba3640 1 -- 172.21.15.26:0/1907503751 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6af80664d0 msgr2=0x7f6af8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:01.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.553+0000 7f6b19ba3640 1 --2- 172.21.15.26:0/1907503751 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6af80664d0 0x7f6af8068990 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6b080ae000 tx=0x7f6b080046d0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.553+0000 7f6b19ba3640 1 -- 172.21.15.26:0/1907503751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b141f5900 msgr2=0x7f6b14155d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:01.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.553+0000 7f6b19ba3640 1 --2- 172.21.15.26:0/1907503751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b141f5900 0x7f6b14155d60 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6b00007370 tx=0x7f6b00007830 comp rx=0 tx=0).stop 2023-10-14T11:14:01.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.553+0000 7f6b19ba3640 1 -- 172.21.15.26:0/1907503751 shutdown_connections 2023-10-14T11:14:01.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.553+0000 7f6b19ba3640 1 --2- 172.21.15.26:0/1907503751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b140c7830 0x7f6b140c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.553+0000 7f6b19ba3640 1 --2- 172.21.15.26:0/1907503751 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6af80664d0 0x7f6af8068990 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.553+0000 7f6b19ba3640 1 --2- 172.21.15.26:0/1907503751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b141f5900 0x7f6b14155d60 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.553+0000 7f6b19ba3640 1 --2- 172.21.15.26:0/1907503751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b14160090 0x7f6b140cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.553+0000 7f6b19ba3640 1 -- 172.21.15.26:0/1907503751 >> 172.21.15.26:0/1907503751 conn(0x7f6b140d27a0 msgr2=0x7f6b1406b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:01.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.553+0000 7f6b19ba3640 1 -- 172.21.15.26:0/1907503751 shutdown_connections 2023-10-14T11:14:01.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.553+0000 7f6b19ba3640 1 -- 172.21.15.26:0/1907503751 wait complete. 2023-10-14T11:14:01.575 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:14:01.576 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:14:01.585 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:14:01.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.765+0000 7fd4ecaa9640 1 Processor -- start 2023-10-14T11:14:01.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.765+0000 7fd4ecaa9640 1 -- start start 2023-10-14T11:14:01.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.765+0000 7fd4ecaa9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4e80ad960 0x7fd4e80ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:01.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.765+0000 7fd4ecaa9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e80c96f0 con 0x7fd4e80b07f0 2023-10-14T11:14:01.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.765+0000 7fd4ecaa9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e80cb950 con 0x7fd4e8164520 2023-10-14T11:14:01.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.765+0000 7fd4ecaa9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e8164900 con 0x7fd4e80ad960 2023-10-14T11:14:01.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.765+0000 7fd4e6d9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd4e80b07f0 0x7fd4e80cc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59914/0 (socket says 172.21.15.26:59914) 2023-10-14T11:14:01.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.765+0000 7fd4e6d9d640 1 -- 172.21.15.26:0/359942044 learned_addr learned my addr 172.21.15.26:0/359942044 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:01.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.765+0000 7fd4dffff640 1 --2- 172.21.15.26:0/359942044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4e80ad960 0x7fd4e80ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:01.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.765+0000 7fd4e5d9b640 1 -- 172.21.15.26:0/359942044 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943591924 0 0) 0x7fd4e80c96f0 con 0x7fd4e80b07f0 2023-10-14T11:14:01.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.765+0000 7fd4e5d9b640 1 -- 172.21.15.26:0/359942044 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4d4003530 con 0x7fd4e80b07f0 2023-10-14T11:14:01.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.765+0000 7fd4e5d9b640 1 -- 172.21.15.26:0/359942044 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544936496 0 0) 0x7fd4e80cb950 con 0x7fd4e8164520 2023-10-14T11:14:01.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.769+0000 7fd4e5d9b640 1 -- 172.21.15.26:0/359942044 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4e80c96f0 con 0x7fd4e8164520 2023-10-14T11:14:01.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.769+0000 7fd4dffff640 1 -- 172.21.15.26:0/359942044 >> v1:172.21.15.110:6789/0 conn(0x7fd4e8164520 legacy=0x7fd4e80b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:01.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.769+0000 7fd4dffff640 1 -- 172.21.15.26:0/359942044 >> v1:172.21.15.26:6789/0 conn(0x7fd4e80b07f0 legacy=0x7fd4e80cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:01.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.769+0000 7fd4dffff640 1 -- 172.21.15.26:0/359942044 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e80cbed0 con 0x7fd4e80ad960 2023-10-14T11:14:01.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.769+0000 7fd4dffff640 1 --2- 172.21.15.26:0/359942044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4e80ad960 0x7fd4e80ce010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd4d00097f0 tx=0x7fd4d001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7da636886029332 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:01.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.769+0000 7fd4e5d9b640 1 -- 172.21.15.26:0/359942044 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d00aa610 con 0x7fd4e80ad960 2023-10-14T11:14:01.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.769+0000 7fd4e5d9b640 1 -- 172.21.15.26:0/359942044 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d00a6040 con 0x7fd4e80ad960 2023-10-14T11:14:01.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.769+0000 7fd4e5d9b640 1 -- 172.21.15.26:0/359942044 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d00aa990 con 0x7fd4e80ad960 2023-10-14T11:14:01.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.769+0000 7fd4ecaa9640 1 -- 172.21.15.26:0/359942044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4e80ad960 msgr2=0x7fd4e80ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:01.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.769+0000 7fd4ecaa9640 1 --2- 172.21.15.26:0/359942044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4e80ad960 0x7fd4e80ce010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd4d00097f0 tx=0x7fd4d001c490 comp rx=0 tx=0).stop 2023-10-14T11:14:01.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.769+0000 7fd4ecaa9640 1 -- 172.21.15.26:0/359942044 shutdown_connections 2023-10-14T11:14:01.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.769+0000 7fd4ecaa9640 1 --2- 172.21.15.26:0/359942044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4e80ad960 0x7fd4e80ce010 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.769+0000 7fd4ecaa9640 1 -- 172.21.15.26:0/359942044 >> 172.21.15.26:0/359942044 conn(0x7fd4e806c190 msgr2=0x7fd4e806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:01.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.769+0000 7fd4ecaa9640 1 -- 172.21.15.26:0/359942044 shutdown_connections 2023-10-14T11:14:01.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.773+0000 7fd4ecaa9640 1 -- 172.21.15.26:0/359942044 wait complete. 2023-10-14T11:14:01.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.773+0000 7fd4ecaa9640 1 Processor -- start 2023-10-14T11:14:01.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.773+0000 7fd4ecaa9640 1 -- start start 2023-10-14T11:14:01.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.773+0000 7fd4ecaa9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4e80ad960 0x7fd4e815a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:01.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.773+0000 7fd4ecaa9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4e80b07f0 0x7fd4e8159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:01.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.773+0000 7fd4ecaa9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4e8164520 0x7fd4e80c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:01.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.773+0000 7fd4ecaa9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80c5730 con 0x7fd4e8164520 2023-10-14T11:14:01.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.773+0000 7fd4ecaa9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80c5980 con 0x7fd4e80b07f0 2023-10-14T11:14:01.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.773+0000 7fd4ecaa9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80c5c60 con 0x7fd4e80ad960 2023-10-14T11:14:01.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.773+0000 7fd4e6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4e8164520 0x7fd4e80c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:01.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.773+0000 7fd4e6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4e8164520 0x7fd4e80c2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39460/0 (socket says 172.21.15.26:39460) 2023-10-14T11:14:01.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.773+0000 7fd4e6d9d640 1 -- 172.21.15.26:0/655604515 learned_addr learned my addr 172.21.15.26:0/655604515 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:01.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.773+0000 7fd4dffff640 1 --2- 172.21.15.26:0/655604515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4e80b07f0 0x7fd4e8159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:01.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.773+0000 7fd4e659c640 1 --2- 172.21.15.26:0/655604515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4e80ad960 0x7fd4e815a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:01.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.773+0000 7fd4e6d9d640 1 -- 172.21.15.26:0/655604515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4e80ad960 msgr2=0x7fd4e815a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:01.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.773+0000 7fd4e6d9d640 1 --2- 172.21.15.26:0/655604515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4e80ad960 0x7fd4e815a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.773+0000 7fd4e6d9d640 1 -- 172.21.15.26:0/655604515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4e80b07f0 msgr2=0x7fd4e8159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:01.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.773+0000 7fd4e6d9d640 1 --2- 172.21.15.26:0/655604515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4e80b07f0 0x7fd4e8159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.773+0000 7fd4e6d9d640 1 -- 172.21.15.26:0/655604515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d0009420 con 0x7fd4e8164520 2023-10-14T11:14:01.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.777+0000 7fd4e6d9d640 1 --2- 172.21.15.26:0/655604515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4e8164520 0x7fd4e80c2b30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd4e000ca80 tx=0x7fd4e000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:01.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.777+0000 7fd4deffd640 1 -- 172.21.15.26:0/655604515 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e000abd0 con 0x7fd4e8164520 2023-10-14T11:14:01.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.777+0000 7fd4deffd640 1 -- 172.21.15.26:0/655604515 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e000ad30 con 0x7fd4e8164520 2023-10-14T11:14:01.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.777+0000 7fd4ecaa9640 1 -- 172.21.15.26:0/655604515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e80c5f40 con 0x7fd4e8164520 2023-10-14T11:14:01.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.777+0000 7fd4deffd640 1 -- 172.21.15.26:0/655604515 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e000aea0 con 0x7fd4e8164520 2023-10-14T11:14:01.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.777+0000 7fd4ecaa9640 1 -- 172.21.15.26:0/655604515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e80c6500 con 0x7fd4e8164520 2023-10-14T11:14:01.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.777+0000 7fd4ecaa9640 1 -- 172.21.15.26:0/655604515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e80c66f0 con 0x7fd4e8164520 2023-10-14T11:14:01.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.777+0000 7fd4deffd640 1 -- 172.21.15.26:0/655604515 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd4e0007070 con 0x7fd4e8164520 2023-10-14T11:14:01.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.777+0000 7fd4deffd640 1 --2- 172.21.15.26:0/655604515 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd4c80664a0 0x7fd4c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:01.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.777+0000 7fd4deffd640 1 -- 172.21.15.26:0/655604515 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7fd4e0084000 con 0x7fd4e8164520 2023-10-14T11:14:01.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.777+0000 7fd4e659c640 1 --2- 172.21.15.26:0/655604515 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd4c80664a0 0x7fd4c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:01.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.781+0000 7fd4e659c640 1 --2- 172.21.15.26:0/655604515 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd4c80664a0 0x7fd4c8068960 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80011f0 tx=0x7fd4d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:01.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.781+0000 7fd4deffd640 1 -- 172.21.15.26:0/655604515 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd4e00511a0 con 0x7fd4e8164520 2023-10-14T11:14:01.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.941+0000 7fd4ecaa9640 1 -- 172.21.15.26:0/655604515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4e8074010 con 0x7fd4e8164520 2023-10-14T11:14:01.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.945+0000 7fd4deffd640 1 -- 172.21.15.26:0/655604515 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18578 (secure 0 0 0) 0x7fd4e0017090 con 0x7fd4e8164520 2023-10-14T11:14:01.948 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:01.948 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":42,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:14:01.292164+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:13:48.453821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:13:49.623527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-10-14T11:13:59.245615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:14:01.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.945+0000 7fd4ecaa9640 1 -- 172.21.15.26:0/655604515 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd4c80664a0 msgr2=0x7fd4c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:01.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.945+0000 7fd4ecaa9640 1 --2- 172.21.15.26:0/655604515 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd4c80664a0 0x7fd4c8068960 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80011f0 tx=0x7fd4d8009040 comp rx=0 tx=0).stop 2023-10-14T11:14:01.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.945+0000 7fd4ecaa9640 1 -- 172.21.15.26:0/655604515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4e8164520 msgr2=0x7fd4e80c2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:01.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.945+0000 7fd4ecaa9640 1 --2- 172.21.15.26:0/655604515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4e8164520 0x7fd4e80c2b30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd4e000ca80 tx=0x7fd4e000cf40 comp rx=0 tx=0).stop 2023-10-14T11:14:01.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.945+0000 7fd4ecaa9640 1 -- 172.21.15.26:0/655604515 shutdown_connections 2023-10-14T11:14:01.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.945+0000 7fd4ecaa9640 1 --2- 172.21.15.26:0/655604515 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd4c80664a0 0x7fd4c8068960 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.945+0000 7fd4ecaa9640 1 --2- 172.21.15.26:0/655604515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4e8164520 0x7fd4e80c2b30 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.945+0000 7fd4ecaa9640 1 --2- 172.21.15.26:0/655604515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4e80b07f0 0x7fd4e8159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.945+0000 7fd4ecaa9640 1 --2- 172.21.15.26:0/655604515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4e80ad960 0x7fd4e815a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:01.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.945+0000 7fd4ecaa9640 1 -- 172.21.15.26:0/655604515 >> 172.21.15.26:0/655604515 conn(0x7fd4e806c190 msgr2=0x7fd4e80aff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:01.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.945+0000 7fd4ecaa9640 1 -- 172.21.15.26:0/655604515 shutdown_connections 2023-10-14T11:14:01.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:01.945+0000 7fd4ecaa9640 1 -- 172.21.15.26:0/655604515 wait complete. 2023-10-14T11:14:01.970 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'testcephfs1_metadata', 'create_time': '2023-10-14T11:13:48.453821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'testcephfs1_data', 'create_time': '2023-10-14T11:13:49.623527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-10-14T11:13:59.245615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:14:01.971 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:14:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.113+0000 7f8afb73e640 1 Processor -- start 2023-10-14T11:14:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.113+0000 7f8afb73e640 1 -- start start 2023-10-14T11:14:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.113+0000 7f8afb73e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8af415cba0 0x7f8af40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.113+0000 7f8afb73e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8af40d0210 0x7f8af40b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.113+0000 7f8afb73e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af40d1670 con 0x7f8af40b84e0 2023-10-14T11:14:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.113+0000 7f8afb73e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af40d1460 con 0x7f8af40d0210 2023-10-14T11:14:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.113+0000 7f8afb73e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af40d1950 con 0x7f8af415cba0 2023-10-14T11:14:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.113+0000 7f8af8cd9640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8af40b84e0 0x7f8af40cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59928/0 (socket says 172.21.15.26:59928) 2023-10-14T11:14:02.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.113+0000 7f8af8cd9640 1 -- 172.21.15.26:0/2816561831 learned_addr learned my addr 172.21.15.26:0/2816561831 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:02.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8af9cdb640 1 --2- 172.21.15.26:0/2816561831 >> v2:172.21.15.110:3300/0 conn(0x7f8af40d0210 0x7f8af40b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:02.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8af94da640 1 --2- 172.21.15.26:0/2816561831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8af415cba0 0x7f8af40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:02.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8aebfff640 1 -- 172.21.15.26:0/2816561831 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135348709 0 0) 0x7f8af40d1670 con 0x7f8af40b84e0 2023-10-14T11:14:02.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8aebfff640 1 -- 172.21.15.26:0/2816561831 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ae0003530 con 0x7f8af40b84e0 2023-10-14T11:14:02.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8aebfff640 1 -- 172.21.15.26:0/2816561831 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3617799466 0 0) 0x7f8ae0003530 con 0x7f8af40b84e0 2023-10-14T11:14:02.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8aebfff640 1 -- 172.21.15.26:0/2816561831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8af415cba0 msgr2=0x7f8af40d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8aebfff640 1 --2- 172.21.15.26:0/2816561831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8af415cba0 0x7f8af40d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8aebfff640 1 -- 172.21.15.26:0/2816561831 >> v2:172.21.15.110:3300/0 conn(0x7f8af40d0210 msgr2=0x7f8af40b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8aebfff640 1 --2- 172.21.15.26:0/2816561831 >> v2:172.21.15.110:3300/0 conn(0x7f8af40d0210 0x7f8af40b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8aebfff640 1 -- 172.21.15.26:0/2816561831 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af40d1c30 con 0x7f8af40b84e0 2023-10-14T11:14:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8aebfff640 1 -- 172.21.15.26:0/2816561831 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f8ae4001680 con 0x7f8af40b84e0 2023-10-14T11:14:02.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8aebfff640 1 -- 172.21.15.26:0/2816561831 >> v1:172.21.15.26:6789/0 conn(0x7f8af40b84e0 legacy=0x7f8af40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:02.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8aebfff640 1 --2- 172.21.15.26:0/2816561831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ae0003980 0x7f8ae0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:02.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8aebfff640 1 --2- 172.21.15.26:0/2816561831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ae00047d0 0x7f8ae0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:02.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8aebfff640 1 --2- 172.21.15.26:0/2816561831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8af415cba0 0x7f8ae0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:02.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8aebfff640 1 -- 172.21.15.26:0/2816561831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af40d1460 con 0x7f8ae00047d0 2023-10-14T11:14:02.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8aebfff640 1 -- 172.21.15.26:0/2816561831 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af40d1950 con 0x7f8ae0003980 2023-10-14T11:14:02.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8aebfff640 1 -- 172.21.15.26:0/2816561831 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae000b990 con 0x7f8af415cba0 2023-10-14T11:14:02.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8af8cd9640 1 --2- 172.21.15.26:0/2816561831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ae00047d0 0x7f8ae0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:02.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8af94da640 1 --2- 172.21.15.26:0/2816561831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ae0003980 0x7f8ae0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:02.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8af9cdb640 1 --2- 172.21.15.26:0/2816561831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8af415cba0 0x7f8ae0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:02.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8af8cd9640 1 -- 172.21.15.26:0/2816561831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8af415cba0 msgr2=0x7f8ae0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:02.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8af8cd9640 1 --2- 172.21.15.26:0/2816561831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8af415cba0 0x7f8ae0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8af8cd9640 1 -- 172.21.15.26:0/2816561831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ae0003980 msgr2=0x7f8ae0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:02.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8af8cd9640 1 --2- 172.21.15.26:0/2816561831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ae0003980 0x7f8ae0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8af8cd9640 1 -- 172.21.15.26:0/2816561831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae0003530 con 0x7f8ae00047d0 2023-10-14T11:14:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.117+0000 7f8af94da640 1 --2- 172.21.15.26:0/2816561831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ae0003980 0x7f8ae0003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.121+0000 7f8af8cd9640 1 --2- 172.21.15.26:0/2816561831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ae00047d0 0x7f8ae0004c50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400c240 tx=0x7f8ae401f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cbb69f93567adbf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.121+0000 7f8aebfff640 1 -- 172.21.15.26:0/2816561831 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae40a8d00 con 0x7f8ae00047d0 2023-10-14T11:14:02.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.121+0000 7f8aebfff640 1 -- 172.21.15.26:0/2816561831 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae40a8e60 con 0x7f8ae00047d0 2023-10-14T11:14:02.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.121+0000 7f8aebfff640 1 -- 172.21.15.26:0/2816561831 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4005ae0 con 0x7f8ae00047d0 2023-10-14T11:14:02.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.121+0000 7f8afb73e640 1 -- 172.21.15.26:0/2816561831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ae00047d0 msgr2=0x7f8ae0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:02.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.121+0000 7f8afb73e640 1 --2- 172.21.15.26:0/2816561831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ae00047d0 0x7f8ae0004c50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400c240 tx=0x7f8ae401f3d0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.121+0000 7f8af9cdb640 1 -- 172.21.15.26:0/2816561831 reap_dead start 2023-10-14T11:14:02.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.121+0000 7f8afb73e640 1 -- 172.21.15.26:0/2816561831 shutdown_connections 2023-10-14T11:14:02.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.121+0000 7f8afb73e640 1 -- 172.21.15.26:0/2816561831 >> 172.21.15.26:0/2816561831 conn(0x7f8af40719c0 msgr2=0x7f8af4071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:02.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.121+0000 7f8afb73e640 1 -- 172.21.15.26:0/2816561831 shutdown_connections 2023-10-14T11:14:02.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.121+0000 7f8afb73e640 1 -- 172.21.15.26:0/2816561831 wait complete. 2023-10-14T11:14:02.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.121+0000 7f8afb73e640 1 Processor -- start 2023-10-14T11:14:02.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.121+0000 7f8afb73e640 1 -- start start 2023-10-14T11:14:02.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.121+0000 7f8afb73e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ae00047d0 0x7f8af414f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:02.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.121+0000 7f8afb73e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8af40c7830 0x7f8af40c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:02.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.121+0000 7f8afb73e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8af40c92a0 0x7f8af4151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.121+0000 7f8afb73e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af40c7cc0 con 0x7f8ae00047d0 2023-10-14T11:14:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.121+0000 7f8afb73e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af40c7fa0 con 0x7f8af40c7830 2023-10-14T11:14:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.121+0000 7f8afb73e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af40c8280 con 0x7f8af40c92a0 2023-10-14T11:14:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.121+0000 7f8af94da640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ae00047d0 0x7f8af414f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:02.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.121+0000 7f8af94da640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ae00047d0 0x7f8af414f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39482/0 (socket says 172.21.15.26:39482) 2023-10-14T11:14:02.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.121+0000 7f8af94da640 1 -- 172.21.15.26:0/513107940 learned_addr learned my addr 172.21.15.26:0/513107940 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:02.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.125+0000 7f8af8cd9640 1 --2- 172.21.15.26:0/513107940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8af40c7830 0x7f8af40c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:02.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.125+0000 7f8af9cdb640 1 --2- 172.21.15.26:0/513107940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8af40c92a0 0x7f8af4151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:02.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.125+0000 7f8af94da640 1 -- 172.21.15.26:0/513107940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8af40c92a0 msgr2=0x7f8af4151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:02.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.125+0000 7f8af94da640 1 --2- 172.21.15.26:0/513107940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8af40c92a0 0x7f8af4151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.125+0000 7f8af94da640 1 -- 172.21.15.26:0/513107940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8af40c7830 msgr2=0x7f8af40c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:02.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.125+0000 7f8af94da640 1 --2- 172.21.15.26:0/513107940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8af40c7830 0x7f8af40c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.125+0000 7f8af94da640 1 -- 172.21.15.26:0/513107940 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af40c8560 con 0x7f8ae00047d0 2023-10-14T11:14:02.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.125+0000 7f8af8cd9640 1 --2- 172.21.15.26:0/513107940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8af40c7830 0x7f8af40c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:02.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.125+0000 7f8af94da640 1 --2- 172.21.15.26:0/513107940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ae00047d0 0x7f8af414f1c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8af0009160 tx=0x7f8af0011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:02.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.125+0000 7f8ae9ffb640 1 -- 172.21.15.26:0/513107940 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af0004220 con 0x7f8ae00047d0 2023-10-14T11:14:02.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.125+0000 7f8ae9ffb640 1 -- 172.21.15.26:0/513107940 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af0004380 con 0x7f8ae00047d0 2023-10-14T11:14:02.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.125+0000 7f8afb73e640 1 -- 172.21.15.26:0/513107940 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af40c8840 con 0x7f8ae00047d0 2023-10-14T11:14:02.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.125+0000 7f8ae9ffb640 1 -- 172.21.15.26:0/513107940 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af0015890 con 0x7f8ae00047d0 2023-10-14T11:14:02.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.125+0000 7f8afb73e640 1 -- 172.21.15.26:0/513107940 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af4151580 con 0x7f8ae00047d0 2023-10-14T11:14:02.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.125+0000 7f8afb73e640 1 -- 172.21.15.26:0/513107940 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af4151830 con 0x7f8ae00047d0 2023-10-14T11:14:02.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.125+0000 7f8ae9ffb640 1 -- 172.21.15.26:0/513107940 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8af00159f0 con 0x7f8ae00047d0 2023-10-14T11:14:02.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.129+0000 7f8ae9ffb640 1 --2- 172.21.15.26:0/513107940 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8ad80664a0 0x7f8ad8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:02.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.129+0000 7f8ae9ffb640 1 -- 172.21.15.26:0/513107940 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f8af0084610 con 0x7f8ae00047d0 2023-10-14T11:14:02.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.129+0000 7f8af8cd9640 1 --2- 172.21.15.26:0/513107940 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8ad80664a0 0x7f8ad8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:02.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.129+0000 7f8af8cd9640 1 --2- 172.21.15.26:0/513107940 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8ad80664a0 0x7f8ad8068960 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40ad000 tx=0x7f8ae4001a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:02.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.133+0000 7f8ae9ffb640 1 -- 172.21.15.26:0/513107940 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8af00517a0 con 0x7f8ae00047d0 2023-10-14T11:14:02.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.297+0000 7f8afb73e640 1 -- 172.21.15.26:0/513107940 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8af404e170 con 0x7f8ae00047d0 2023-10-14T11:14:02.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.297+0000 7f8ae9ffb640 1 -- 172.21.15.26:0/513107940 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8af0054dc0 con 0x7f8ae00047d0 2023-10-14T11:14:02.300 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:14:02.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.297+0000 7f8afb73e640 1 -- 172.21.15.26:0/513107940 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8ad80664a0 msgr2=0x7f8ad8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:02.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.297+0000 7f8afb73e640 1 --2- 172.21.15.26:0/513107940 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8ad80664a0 0x7f8ad8068960 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40ad000 tx=0x7f8ae4001a80 comp rx=0 tx=0).stop 2023-10-14T11:14:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.297+0000 7f8afb73e640 1 -- 172.21.15.26:0/513107940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ae00047d0 msgr2=0x7f8af414f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.297+0000 7f8afb73e640 1 --2- 172.21.15.26:0/513107940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ae00047d0 0x7f8af414f1c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8af0009160 tx=0x7f8af0011a60 comp rx=0 tx=0).stop 2023-10-14T11:14:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.297+0000 7f8afb73e640 1 -- 172.21.15.26:0/513107940 shutdown_connections 2023-10-14T11:14:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.297+0000 7f8afb73e640 1 --2- 172.21.15.26:0/513107940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8af40c92a0 0x7f8af4151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.297+0000 7f8afb73e640 1 --2- 172.21.15.26:0/513107940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8af40c7830 0x7f8af40c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.297+0000 7f8afb73e640 1 --2- 172.21.15.26:0/513107940 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8ad80664a0 0x7f8ad8068960 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.297+0000 7f8afb73e640 1 --2- 172.21.15.26:0/513107940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ae00047d0 0x7f8af414f1c0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.297+0000 7f8afb73e640 1 -- 172.21.15.26:0/513107940 >> 172.21.15.26:0/513107940 conn(0x7f8af40719c0 msgr2=0x7f8af415acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.297+0000 7f8afb73e640 1 -- 172.21.15.26:0/513107940 shutdown_connections 2023-10-14T11:14:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.297+0000 7f8afb73e640 1 -- 172.21.15.26:0/513107940 wait complete. 2023-10-14T11:14:02.322 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_metadata pg_num 2023-10-14T11:14:02.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.465+0000 7fb0b6972640 1 Processor -- start 2023-10-14T11:14:02.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.465+0000 7fb0b6972640 1 -- start start 2023-10-14T11:14:02.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.465+0000 7fb0b6972640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb0b00d0210 0x7fb0b00d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:02.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.465+0000 7fb0b6972640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0b00b84e0 0x7fb0b00b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:02.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.465+0000 7fb0b6972640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b00d1670 con 0x7fb0b015cba0 2023-10-14T11:14:02.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.465+0000 7fb0b6972640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b00d1460 con 0x7fb0b00d0210 2023-10-14T11:14:02.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.465+0000 7fb0b6972640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00d1950 con 0x7fb0b00b84e0 2023-10-14T11:14:02.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.465+0000 7fb0af7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb0b00d0210 0x7fb0b00d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:02.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.465+0000 7fb0af7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb0b00d0210 0x7fb0b00d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35008/0 (socket says 172.21.15.26:35008) 2023-10-14T11:14:02.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.465+0000 7fb0af7fe640 1 -- 172.21.15.26:0/4249444482 learned_addr learned my addr 172.21.15.26:0/4249444482 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:02.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.465+0000 7fb0b4f0f640 1 --2- 172.21.15.26:0/4249444482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0b00b84e0 0x7fb0b00b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:02.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.465+0000 7fb0af7fe640 1 -- 172.21.15.26:0/4249444482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0b00b84e0 msgr2=0x7fb0b00b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:02.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.465+0000 7fb0af7fe640 1 --2- 172.21.15.26:0/4249444482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0b00b84e0 0x7fb0b00b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.465+0000 7fb0af7fe640 1 -- 172.21.15.26:0/4249444482 >> v1:172.21.15.110:6789/0 conn(0x7fb0b015cba0 legacy=0x7fb0b00cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:02.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.465+0000 7fb0af7fe640 1 -- 172.21.15.26:0/4249444482 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b00d1c30 con 0x7fb0b00d0210 2023-10-14T11:14:02.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.465+0000 7fb0b4f0f640 1 --2- 172.21.15.26:0/4249444482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0b00b84e0 0x7fb0b00b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:02.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.469+0000 7fb0af7fe640 1 --2- 172.21.15.26:0/4249444482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0b00d0210 0x7fb0b00d0f20 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009870 tx=0x7fb0a401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4fb27ba35f0602f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:02.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.469+0000 7fb0aeffd640 1 -- 172.21.15.26:0/4249444482 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a40aa620 con 0x7fb0b00d0210 2023-10-14T11:14:02.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.469+0000 7fb0aeffd640 1 -- 172.21.15.26:0/4249444482 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a40aa780 con 0x7fb0b00d0210 2023-10-14T11:14:02.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.469+0000 7fb0aeffd640 1 -- 172.21.15.26:0/4249444482 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a40aab10 con 0x7fb0b00d0210 2023-10-14T11:14:02.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.469+0000 7fb0b6972640 1 -- 172.21.15.26:0/4249444482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0b00d0210 msgr2=0x7fb0b00d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:02.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.469+0000 7fb0b6972640 1 --2- 172.21.15.26:0/4249444482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0b00d0210 0x7fb0b00d0f20 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009870 tx=0x7fb0a401c500 comp rx=0 tx=0).stop 2023-10-14T11:14:02.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.469+0000 7fb0b6972640 1 -- 172.21.15.26:0/4249444482 shutdown_connections 2023-10-14T11:14:02.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.469+0000 7fb0b6972640 1 --2- 172.21.15.26:0/4249444482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0b00b84e0 0x7fb0b00b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.469+0000 7fb0b6972640 1 --2- 172.21.15.26:0/4249444482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0b00d0210 0x7fb0b00d0f20 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.469+0000 7fb0b6972640 1 -- 172.21.15.26:0/4249444482 >> 172.21.15.26:0/4249444482 conn(0x7fb0b00719c0 msgr2=0x7fb0b0071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:02.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.469+0000 7fb0b6972640 1 -- 172.21.15.26:0/4249444482 shutdown_connections 2023-10-14T11:14:02.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.469+0000 7fb0b6972640 1 -- 172.21.15.26:0/4249444482 wait complete. 2023-10-14T11:14:02.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0b6972640 1 Processor -- start 2023-10-14T11:14:02.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0b6972640 1 -- start start 2023-10-14T11:14:02.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0b6972640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0b00b84e0 0x7fb0b0147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:02.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0b6972640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0b00d0210 0x7fb0b0156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:02.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0b6972640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0b015cba0 0x7fb0b01572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:02.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0b6972640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b01588b0 con 0x7fb0b015cba0 2023-10-14T11:14:02.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0b6972640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b01555b0 con 0x7fb0b00b84e0 2023-10-14T11:14:02.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0b6972640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b014f0f0 con 0x7fb0b00d0210 2023-10-14T11:14:02.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0b4f0f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0b015cba0 0x7fb0b01572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:02.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0b4f0f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0b015cba0 0x7fb0b01572b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35016/0 (socket says 172.21.15.26:35016) 2023-10-14T11:14:02.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0b4f0f640 1 -- 172.21.15.26:0/4089350482 learned_addr learned my addr 172.21.15.26:0/4089350482 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:02.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0affff640 1 --2- 172.21.15.26:0/4089350482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0b00b84e0 0x7fb0b0147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:02.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0af7fe640 1 --2- 172.21.15.26:0/4089350482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0b00d0210 0x7fb0b0156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:02.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0b4f0f640 1 -- 172.21.15.26:0/4089350482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0b00d0210 msgr2=0x7fb0b0156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:02.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0b4f0f640 1 --2- 172.21.15.26:0/4089350482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0b00d0210 0x7fb0b0156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0b4f0f640 1 -- 172.21.15.26:0/4089350482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0b00b84e0 msgr2=0x7fb0b0147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:02.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0b4f0f640 1 --2- 172.21.15.26:0/4089350482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0b00b84e0 0x7fb0b0147ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0b4f0f640 1 -- 172.21.15.26:0/4089350482 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a40094d0 con 0x7fb0b015cba0 2023-10-14T11:14:02.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0b4f0f640 1 --2- 172.21.15.26:0/4089350482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0b015cba0 0x7fb0b01572b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800cea0 tx=0x7fb0a800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:02.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0acff9640 1 -- 172.21.15.26:0/4089350482 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8003ba0 con 0x7fb0b015cba0 2023-10-14T11:14:02.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0acff9640 1 -- 172.21.15.26:0/4089350482 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a8003d20 con 0x7fb0b015cba0 2023-10-14T11:14:02.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0acff9640 1 -- 172.21.15.26:0/4089350482 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a800d880 con 0x7fb0b015cba0 2023-10-14T11:14:02.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0b6972640 1 -- 172.21.15.26:0/4089350482 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b0157dd0 con 0x7fb0b015cba0 2023-10-14T11:14:02.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.473+0000 7fb0b6972640 1 -- 172.21.15.26:0/4089350482 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b0158390 con 0x7fb0b015cba0 2023-10-14T11:14:02.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.477+0000 7fb0b6972640 1 -- 172.21.15.26:0/4089350482 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b0157c30 con 0x7fb0b015cba0 2023-10-14T11:14:02.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.477+0000 7fb0acff9640 1 -- 172.21.15.26:0/4089350482 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb0a800d9e0 con 0x7fb0b015cba0 2023-10-14T11:14:02.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.477+0000 7fb0acff9640 1 --2- 172.21.15.26:0/4089350482 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb09c0664a0 0x7fb09c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:02.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.477+0000 7fb0acff9640 1 -- 172.21.15.26:0/4089350482 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7fb0a8084a00 con 0x7fb0b015cba0 2023-10-14T11:14:02.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.477+0000 7fb0affff640 1 --2- 172.21.15.26:0/4089350482 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb09c0664a0 0x7fb09c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:02.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.477+0000 7fb0affff640 1 --2- 172.21.15.26:0/4089350482 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb09c0664a0 0x7fb09c068960 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00098e0 tx=0x7fb0a0009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:02.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.481+0000 7fb0acff9640 1 -- 172.21.15.26:0/4089350482 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb0b0157c30 con 0x7fb0b015cba0 2023-10-14T11:14:02.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.637+0000 7fb0b6972640 1 -- 172.21.15.26:0/4089350482 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb0b0157c30 con 0x7fb0b015cba0 2023-10-14T11:14:02.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.637+0000 7fb0acff9640 1 -- 172.21.15.26:0/4089350482 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"}]=0 v42) v1 ==== 109+0+11 (secure 0 0 0) 0x7fb0b0157c30 con 0x7fb0b015cba0 2023-10-14T11:14:02.641 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:14:02.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.637+0000 7fb0b6972640 1 -- 172.21.15.26:0/4089350482 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb09c0664a0 msgr2=0x7fb09c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:02.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.637+0000 7fb0b6972640 1 --2- 172.21.15.26:0/4089350482 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb09c0664a0 0x7fb09c068960 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00098e0 tx=0x7fb0a0009060 comp rx=0 tx=0).stop 2023-10-14T11:14:02.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.637+0000 7fb0b6972640 1 -- 172.21.15.26:0/4089350482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0b015cba0 msgr2=0x7fb0b01572b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:02.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.637+0000 7fb0b6972640 1 --2- 172.21.15.26:0/4089350482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0b015cba0 0x7fb0b01572b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800cea0 tx=0x7fb0a800cf90 comp rx=0 tx=0).stop 2023-10-14T11:14:02.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.637+0000 7fb0b6972640 1 -- 172.21.15.26:0/4089350482 shutdown_connections 2023-10-14T11:14:02.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.637+0000 7fb0b6972640 1 --2- 172.21.15.26:0/4089350482 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb09c0664a0 0x7fb09c068960 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.637+0000 7fb0b6972640 1 --2- 172.21.15.26:0/4089350482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0b015cba0 0x7fb0b01572b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.637+0000 7fb0b6972640 1 --2- 172.21.15.26:0/4089350482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0b00d0210 0x7fb0b0156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.637+0000 7fb0b6972640 1 --2- 172.21.15.26:0/4089350482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0b00b84e0 0x7fb0b0147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.637+0000 7fb0b6972640 1 -- 172.21.15.26:0/4089350482 >> 172.21.15.26:0/4089350482 conn(0x7fb0b00719c0 msgr2=0x7fb0b0072820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:02.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.637+0000 7fb0b6972640 1 -- 172.21.15.26:0/4089350482 shutdown_connections 2023-10-14T11:14:02.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.637+0000 7fb0b6972640 1 -- 172.21.15.26:0/4089350482 wait complete. 2023-10-14T11:14:02.662 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_data pg_num 2023-10-14T11:14:02.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.805+0000 7f4185a09640 1 Processor -- start 2023-10-14T11:14:02.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.805+0000 7f4185a09640 1 -- start start 2023-10-14T11:14:02.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.805+0000 7f4185a09640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f418015cba0 0x7f41800d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:02.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.805+0000 7f4185a09640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41800d0210 0x7f41800b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:02.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.805+0000 7f4185a09640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41800d1670 con 0x7f41800b84e0 2023-10-14T11:14:02.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.805+0000 7f4185a09640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41800d1460 con 0x7f418015cba0 2023-10-14T11:14:02.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.805+0000 7f4185a09640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41800d1950 con 0x7f41800d0210 2023-10-14T11:14:02.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.805+0000 7f4177fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f41800b84e0 0x7f41800cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33276/0 (socket says 172.21.15.26:33276) 2023-10-14T11:14:02.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.805+0000 7f4177fff640 1 -- 172.21.15.26:0/320210104 learned_addr learned my addr 172.21.15.26:0/320210104 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:02.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.805+0000 7f417effd640 1 --2- 172.21.15.26:0/320210104 >> v2:172.21.15.110:3300/0 conn(0x7f418015cba0 0x7f41800d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:02.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.805+0000 7f417f7fe640 1 --2- 172.21.15.26:0/320210104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41800d0210 0x7f41800b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:02.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.805+0000 7f417e7fc640 1 -- 172.21.15.26:0/320210104 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999161789 0 0) 0x7f41800d1670 con 0x7f41800b84e0 2023-10-14T11:14:02.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.805+0000 7f417e7fc640 1 -- 172.21.15.26:0/320210104 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f416c003530 con 0x7f41800b84e0 2023-10-14T11:14:02.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.805+0000 7f417effd640 1 -- 172.21.15.26:0/320210104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41800d0210 msgr2=0x7f41800b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:02.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.805+0000 7f417effd640 1 --2- 172.21.15.26:0/320210104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41800d0210 0x7f41800b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.805+0000 7f417effd640 1 -- 172.21.15.26:0/320210104 >> v1:172.21.15.26:6789/0 conn(0x7f41800b84e0 legacy=0x7f41800cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:02.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.805+0000 7f417effd640 1 -- 172.21.15.26:0/320210104 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41800d1c30 con 0x7f418015cba0 2023-10-14T11:14:02.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.809+0000 7f417effd640 1 --2- 172.21.15.26:0/320210104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f418015cba0 0x7f41800d0f20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f41700097c0 tx=0x7f417001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4746378108b45dff server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:02.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.809+0000 7f417e7fc640 1 -- 172.21.15.26:0/320210104 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41700ab680 con 0x7f418015cba0 2023-10-14T11:14:02.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.809+0000 7f417e7fc640 1 -- 172.21.15.26:0/320210104 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41700ab7e0 con 0x7f418015cba0 2023-10-14T11:14:02.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.809+0000 7f417e7fc640 1 -- 172.21.15.26:0/320210104 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41700abb50 con 0x7f418015cba0 2023-10-14T11:14:02.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.809+0000 7f4185a09640 1 -- 172.21.15.26:0/320210104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f418015cba0 msgr2=0x7f41800d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:02.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.809+0000 7f4185a09640 1 --2- 172.21.15.26:0/320210104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f418015cba0 0x7f41800d0f20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f41700097c0 tx=0x7f417001c480 comp rx=0 tx=0).stop 2023-10-14T11:14:02.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.809+0000 7f4185a09640 1 -- 172.21.15.26:0/320210104 shutdown_connections 2023-10-14T11:14:02.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.809+0000 7f4185a09640 1 --2- 172.21.15.26:0/320210104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41800d0210 0x7f41800b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.809+0000 7f4185a09640 1 --2- 172.21.15.26:0/320210104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f418015cba0 0x7f41800d0f20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.809+0000 7f4185a09640 1 -- 172.21.15.26:0/320210104 >> 172.21.15.26:0/320210104 conn(0x7f41800719c0 msgr2=0x7f4180071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:02.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.809+0000 7f4185a09640 1 -- 172.21.15.26:0/320210104 shutdown_connections 2023-10-14T11:14:02.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f4185a09640 1 -- 172.21.15.26:0/320210104 wait complete. 2023-10-14T11:14:02.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f4185a09640 1 Processor -- start 2023-10-14T11:14:02.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f4185a09640 1 -- start start 2023-10-14T11:14:02.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f4185a09640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41800b84e0 0x7f418014e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:02.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f4185a09640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41800d0210 0x7f418014afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:02.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f4185a09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f418015cba0 0x7f4180147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:02.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f4185a09640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41801499e0 con 0x7f418015cba0 2023-10-14T11:14:02.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f4185a09640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4180148940 con 0x7f41800b84e0 2023-10-14T11:14:02.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f4185a09640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4180148c20 con 0x7f41800d0210 2023-10-14T11:14:02.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f417f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f418015cba0 0x7f4180147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:02.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f417f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f418015cba0 0x7f4180147860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35018/0 (socket says 172.21.15.26:35018) 2023-10-14T11:14:02.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f417f7fe640 1 -- 172.21.15.26:0/530368075 learned_addr learned my addr 172.21.15.26:0/530368075 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:02.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f4177fff640 1 --2- 172.21.15.26:0/530368075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41800d0210 0x7f418014afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:02.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f417effd640 1 --2- 172.21.15.26:0/530368075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41800b84e0 0x7f418014e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:02.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f417f7fe640 1 -- 172.21.15.26:0/530368075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41800d0210 msgr2=0x7f418014afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:02.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f417f7fe640 1 --2- 172.21.15.26:0/530368075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41800d0210 0x7f418014afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f417f7fe640 1 -- 172.21.15.26:0/530368075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41800b84e0 msgr2=0x7f418014e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:02.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f417f7fe640 1 --2- 172.21.15.26:0/530368075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41800b84e0 0x7f418014e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f417f7fe640 1 -- 172.21.15.26:0/530368075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4170009420 con 0x7f418015cba0 2023-10-14T11:14:02.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f417effd640 1 --2- 172.21.15.26:0/530368075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41800b84e0 0x7f418014e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:02.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f417f7fe640 1 --2- 172.21.15.26:0/530368075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f418015cba0 0x7f4180147860 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f417800efc0 tx=0x7f417800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:02.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f417cff9640 1 -- 172.21.15.26:0/530368075 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4178009ca0 con 0x7f418015cba0 2023-10-14T11:14:02.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f417cff9640 1 -- 172.21.15.26:0/530368075 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417800f040 con 0x7f418015cba0 2023-10-14T11:14:02.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f417cff9640 1 -- 172.21.15.26:0/530368075 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41780146c0 con 0x7f418015cba0 2023-10-14T11:14:02.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.813+0000 7f4185a09640 1 -- 172.21.15.26:0/530368075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4180148f00 con 0x7f418015cba0 2023-10-14T11:14:02.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.817+0000 7f4185a09640 1 -- 172.21.15.26:0/530368075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41801494c0 con 0x7f418015cba0 2023-10-14T11:14:02.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.817+0000 7f4185a09640 1 -- 172.21.15.26:0/530368075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418004e170 con 0x7f418015cba0 2023-10-14T11:14:02.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.817+0000 7f417cff9640 1 -- 172.21.15.26:0/530368075 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4178014820 con 0x7f418015cba0 2023-10-14T11:14:02.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.817+0000 7f417cff9640 1 --2- 172.21.15.26:0/530368075 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41600664d0 0x7f4160068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:02.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.817+0000 7f417cff9640 1 -- 172.21.15.26:0/530368075 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f4178085170 con 0x7f418015cba0 2023-10-14T11:14:02.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.817+0000 7f417effd640 1 --2- 172.21.15.26:0/530368075 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41600664d0 0x7f4160068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:02.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.817+0000 7f417effd640 1 --2- 172.21.15.26:0/530368075 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41600664d0 0x7f4160068990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f41700af000 tx=0x7f41700a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:02.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.821+0000 7f417cff9640 1 -- 172.21.15.26:0/530368075 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4178052260 con 0x7f418015cba0 2023-10-14T11:14:02.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.981+0000 7f4185a09640 1 -- 172.21.15.26:0/530368075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"} v 0) v1 -- 0x7f4180072120 con 0x7f418015cba0 2023-10-14T11:14:02.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.981+0000 7f417cff9640 1 -- 172.21.15.26:0/530368075 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"}]=0 v42) v1 ==== 105+0+11 (secure 0 0 0) 0x7f4178055880 con 0x7f418015cba0 2023-10-14T11:14:02.985 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:14:02.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.985+0000 7f4185a09640 1 -- 172.21.15.26:0/530368075 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41600664d0 msgr2=0x7f4160068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:02.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.985+0000 7f4185a09640 1 --2- 172.21.15.26:0/530368075 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41600664d0 0x7f4160068990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f41700af000 tx=0x7f41700a7000 comp rx=0 tx=0).stop 2023-10-14T11:14:02.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.985+0000 7f4185a09640 1 -- 172.21.15.26:0/530368075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f418015cba0 msgr2=0x7f4180147860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:02.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.985+0000 7f4185a09640 1 --2- 172.21.15.26:0/530368075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f418015cba0 0x7f4180147860 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f417800efc0 tx=0x7f417800c490 comp rx=0 tx=0).stop 2023-10-14T11:14:02.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.985+0000 7f4185a09640 1 -- 172.21.15.26:0/530368075 shutdown_connections 2023-10-14T11:14:02.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.985+0000 7f4185a09640 1 --2- 172.21.15.26:0/530368075 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41600664d0 0x7f4160068990 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.985+0000 7f4185a09640 1 --2- 172.21.15.26:0/530368075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f418015cba0 0x7f4180147860 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.985+0000 7f4185a09640 1 --2- 172.21.15.26:0/530368075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41800d0210 0x7f418014afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.985+0000 7f4185a09640 1 --2- 172.21.15.26:0/530368075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41800b84e0 0x7f418014e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:02.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.985+0000 7f4185a09640 1 -- 172.21.15.26:0/530368075 >> 172.21.15.26:0/530368075 conn(0x7f41800719c0 msgr2=0x7f418015a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:02.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.985+0000 7f4185a09640 1 -- 172.21.15.26:0/530368075 shutdown_connections 2023-10-14T11:14:02.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:02.985+0000 7f4185a09640 1 -- 172.21.15.26:0/530368075 wait complete. 2023-10-14T11:14:03.006 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-10-14T11:14:03.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff7038ea640 1 Processor -- start 2023-10-14T11:14:03.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff7038ea640 1 -- start start 2023-10-14T11:14:03.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff7038ea640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6fc0cb040 0x7ff6fc0ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:03.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff7038ea640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc0cc330 con 0x7ff6fc15cc60 2023-10-14T11:14:03.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff7038ea640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc0cb4a0 con 0x7ff6fc0cebd0 2023-10-14T11:14:03.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff7038ea640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0cefe0 con 0x7ff6fc0cb040 2023-10-14T11:14:03.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff701686640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff6fc15cc60 0x7ff6fc161260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33286/0 (socket says 172.21.15.26:33286) 2023-10-14T11:14:03.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff701686640 1 -- 172.21.15.26:0/3425250343 learned_addr learned my addr 172.21.15.26:0/3425250343 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:03.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff6f3fff640 1 -- 172.21.15.26:0/3425250343 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977597908 0 0) 0x7ff6fc0cc330 con 0x7ff6fc15cc60 2023-10-14T11:14:03.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff6f3fff640 1 -- 172.21.15.26:0/3425250343 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6e8003530 con 0x7ff6fc15cc60 2023-10-14T11:14:03.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff700e85640 1 --2- 172.21.15.26:0/3425250343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6fc0cb040 0x7ff6fc0ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:03.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff6f3fff640 1 -- 172.21.15.26:0/3425250343 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2174306830 0 0) 0x7ff6e8003530 con 0x7ff6fc15cc60 2023-10-14T11:14:03.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff6f3fff640 1 -- 172.21.15.26:0/3425250343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6fc0cb040 msgr2=0x7ff6fc0ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:03.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff6f3fff640 1 --2- 172.21.15.26:0/3425250343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6fc0cb040 0x7ff6fc0ce690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff6f3fff640 1 -- 172.21.15.26:0/3425250343 >> v1:172.21.15.110:6789/0 conn(0x7ff6fc0cebd0 legacy=0x7ff6fc0cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:03.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff6f3fff640 1 -- 172.21.15.26:0/3425250343 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc0cb720 con 0x7ff6fc15cc60 2023-10-14T11:14:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff6f3fff640 1 -- 172.21.15.26:0/3425250343 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7ff6f8001680 con 0x7ff6fc15cc60 2023-10-14T11:14:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff6f3fff640 1 -- 172.21.15.26:0/3425250343 >> v1:172.21.15.26:6789/0 conn(0x7ff6fc15cc60 legacy=0x7ff6fc161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff6f3fff640 1 --2- 172.21.15.26:0/3425250343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6fc0cb040 0x7ff6e80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff6f3fff640 1 --2- 172.21.15.26:0/3425250343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6e8003fe0 0x7ff6e80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff6f3fff640 1 --2- 172.21.15.26:0/3425250343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6e8004d10 0x7ff6e8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:03.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff6f3fff640 1 -- 172.21.15.26:0/3425250343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0cefe0 con 0x7ff6e8004d10 2023-10-14T11:14:03.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff6f3fff640 1 -- 172.21.15.26:0/3425250343 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e800bb50 con 0x7ff6e8003fe0 2023-10-14T11:14:03.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff6f3fff640 1 -- 172.21.15.26:0/3425250343 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e800bd10 con 0x7ff6fc0cb040 2023-10-14T11:14:03.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff701e87640 1 --2- 172.21.15.26:0/3425250343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6e8004d10 0x7ff6e8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:03.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff700e85640 1 --2- 172.21.15.26:0/3425250343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6e8003fe0 0x7ff6e80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:03.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.149+0000 7ff701686640 1 --2- 172.21.15.26:0/3425250343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6fc0cb040 0x7ff6e80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:03.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.153+0000 7ff701e87640 1 -- 172.21.15.26:0/3425250343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6fc0cb040 msgr2=0x7ff6e80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:03.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.153+0000 7ff701e87640 1 --2- 172.21.15.26:0/3425250343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6fc0cb040 0x7ff6e80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.153+0000 7ff701e87640 1 -- 172.21.15.26:0/3425250343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6e8003fe0 msgr2=0x7ff6e80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:03.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.153+0000 7ff701e87640 1 --2- 172.21.15.26:0/3425250343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6e8003fe0 0x7ff6e80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.153+0000 7ff701e87640 1 -- 172.21.15.26:0/3425250343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e8003530 con 0x7ff6e8004d10 2023-10-14T11:14:03.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.153+0000 7ff701e87640 1 --2- 172.21.15.26:0/3425250343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6e8004d10 0x7ff6e8005190 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4001e70 tx=0x7ff6f401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1f444aeafe8b64 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:03.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.153+0000 7ff6f3fff640 1 -- 172.21.15.26:0/3425250343 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4003b80 con 0x7ff6e8004d10 2023-10-14T11:14:03.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.153+0000 7ff6f3fff640 1 -- 172.21.15.26:0/3425250343 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f4003ce0 con 0x7ff6e8004d10 2023-10-14T11:14:03.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.153+0000 7ff6f3fff640 1 -- 172.21.15.26:0/3425250343 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f40052c0 con 0x7ff6e8004d10 2023-10-14T11:14:03.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.153+0000 7ff7038ea640 1 -- 172.21.15.26:0/3425250343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6e8004d10 msgr2=0x7ff6e8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:03.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.153+0000 7ff7038ea640 1 --2- 172.21.15.26:0/3425250343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6e8004d10 0x7ff6e8005190 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4001e70 tx=0x7ff6f401c760 comp rx=0 tx=0).stop 2023-10-14T11:14:03.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.153+0000 7ff701e87640 1 -- 172.21.15.26:0/3425250343 reap_dead start 2023-10-14T11:14:03.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff7038ea640 1 -- 172.21.15.26:0/3425250343 shutdown_connections 2023-10-14T11:14:03.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff7038ea640 1 -- 172.21.15.26:0/3425250343 >> 172.21.15.26:0/3425250343 conn(0x7ff6fc06e570 msgr2=0x7ff6fc06e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:03.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff7038ea640 1 -- 172.21.15.26:0/3425250343 shutdown_connections 2023-10-14T11:14:03.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff7038ea640 1 -- 172.21.15.26:0/3425250343 wait complete. 2023-10-14T11:14:03.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff7038ea640 1 Processor -- start 2023-10-14T11:14:03.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff7038ea640 1 -- start start 2023-10-14T11:14:03.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff7038ea640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6e8004d10 0x7ff6fc0b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:03.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff7038ea640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6fc144a90 0x7ff6fc0b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:03.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff7038ea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6fc0b2020 0x7ff6fc143da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:03.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff7038ea640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0b5f80 con 0x7ff6fc0b2020 2023-10-14T11:14:03.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff7038ea640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0b2510 con 0x7ff6e8004d10 2023-10-14T11:14:03.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff7038ea640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0b27f0 con 0x7ff6fc144a90 2023-10-14T11:14:03.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff701e87640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6fc0b2020 0x7ff6fc143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:03.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff701e87640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6fc0b2020 0x7ff6fc143da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35036/0 (socket says 172.21.15.26:35036) 2023-10-14T11:14:03.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff701e87640 1 -- 172.21.15.26:0/908508326 learned_addr learned my addr 172.21.15.26:0/908508326 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:03.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff701686640 1 --2- 172.21.15.26:0/908508326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6e8004d10 0x7ff6fc0b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:03.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff700e85640 1 --2- 172.21.15.26:0/908508326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6fc144a90 0x7ff6fc0b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:03.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff701e87640 1 -- 172.21.15.26:0/908508326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6fc144a90 msgr2=0x7ff6fc0b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:03.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff701e87640 1 --2- 172.21.15.26:0/908508326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6fc144a90 0x7ff6fc0b1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff701e87640 1 -- 172.21.15.26:0/908508326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6e8004d10 msgr2=0x7ff6fc0b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff701e87640 1 --2- 172.21.15.26:0/908508326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6e8004d10 0x7ff6fc0b5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff701e87640 1 -- 172.21.15.26:0/908508326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc157f80 con 0x7ff6fc0b2020 2023-10-14T11:14:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff700e85640 1 --2- 172.21.15.26:0/908508326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6fc144a90 0x7ff6fc0b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.157+0000 7ff701e87640 1 --2- 172.21.15.26:0/908508326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6fc0b2020 0x7ff6fc143da0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff6f401cc40 tx=0x7ff6e8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.161+0000 7ff6f1ffb640 1 -- 172.21.15.26:0/908508326 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4003e50 con 0x7ff6fc0b2020 2023-10-14T11:14:03.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.161+0000 7ff6f1ffb640 1 -- 172.21.15.26:0/908508326 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f4003980 con 0x7ff6fc0b2020 2023-10-14T11:14:03.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.161+0000 7ff6f1ffb640 1 -- 172.21.15.26:0/908508326 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f40a6680 con 0x7ff6fc0b2020 2023-10-14T11:14:03.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.161+0000 7ff7038ea640 1 -- 172.21.15.26:0/908508326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6fc158260 con 0x7ff6fc0b2020 2023-10-14T11:14:03.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.161+0000 7ff7038ea640 1 -- 172.21.15.26:0/908508326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc1442e0 con 0x7ff6fc0b2020 2023-10-14T11:14:03.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.161+0000 7ff7038ea640 1 -- 172.21.15.26:0/908508326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc158450 con 0x7ff6fc0b2020 2023-10-14T11:14:03.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.161+0000 7ff6f1ffb640 1 -- 172.21.15.26:0/908508326 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff6f40a67e0 con 0x7ff6fc0b2020 2023-10-14T11:14:03.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.161+0000 7ff6f1ffb640 1 --2- 172.21.15.26:0/908508326 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff6e00664a0 0x7ff6e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:03.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.161+0000 7ff6f1ffb640 1 -- 172.21.15.26:0/908508326 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7ff6f411e910 con 0x7ff6fc0b2020 2023-10-14T11:14:03.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.161+0000 7ff701686640 1 --2- 172.21.15.26:0/908508326 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff6e00664a0 0x7ff6e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:03.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.161+0000 7ff701686640 1 --2- 172.21.15.26:0/908508326 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff6e00664a0 0x7ff6e0068960 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc15d770 tx=0x7ff6f8001720 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:03.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.165+0000 7ff6f1ffb640 1 -- 172.21.15.26:0/908508326 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff6f40eba90 con 0x7ff6fc0b2020 2023-10-14T11:14:03.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.325+0000 7ff7038ea640 1 -- 172.21.15.26:0/908508326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7ff6fc0b5f80 con 0x7ff6fc0b2020 2023-10-14T11:14:03.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.325+0000 7ff6f1ffb640 1 -- 172.21.15.26:0/908508326 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v42) v1 ==== 97+0+11 (secure 0 0 0) 0x7ff6f40ef0b0 con 0x7ff6fc0b2020 2023-10-14T11:14:03.329 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:14:03.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.329+0000 7ff7038ea640 1 -- 172.21.15.26:0/908508326 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff6e00664a0 msgr2=0x7ff6e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:03.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.329+0000 7ff7038ea640 1 --2- 172.21.15.26:0/908508326 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff6e00664a0 0x7ff6e0068960 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc15d770 tx=0x7ff6f8001720 comp rx=0 tx=0).stop 2023-10-14T11:14:03.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.329+0000 7ff7038ea640 1 -- 172.21.15.26:0/908508326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6fc0b2020 msgr2=0x7ff6fc143da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:03.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.329+0000 7ff7038ea640 1 --2- 172.21.15.26:0/908508326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6fc0b2020 0x7ff6fc143da0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff6f401cc40 tx=0x7ff6e8005800 comp rx=0 tx=0).stop 2023-10-14T11:14:03.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.329+0000 7ff7038ea640 1 -- 172.21.15.26:0/908508326 shutdown_connections 2023-10-14T11:14:03.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.329+0000 7ff7038ea640 1 --2- 172.21.15.26:0/908508326 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff6e00664a0 0x7ff6e0068960 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.329+0000 7ff7038ea640 1 --2- 172.21.15.26:0/908508326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6fc0b2020 0x7ff6fc143da0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.329+0000 7ff7038ea640 1 --2- 172.21.15.26:0/908508326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6fc144a90 0x7ff6fc0b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.329+0000 7ff7038ea640 1 --2- 172.21.15.26:0/908508326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6e8004d10 0x7ff6fc0b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.329+0000 7ff7038ea640 1 -- 172.21.15.26:0/908508326 >> 172.21.15.26:0/908508326 conn(0x7ff6fc06e570 msgr2=0x7ff6fc072920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:03.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.329+0000 7ff7038ea640 1 -- 172.21.15.26:0/908508326 shutdown_connections 2023-10-14T11:14:03.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.329+0000 7ff7038ea640 1 -- 172.21.15.26:0/908508326 wait complete. 2023-10-14T11:14:03.350 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:14:03.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41edb9d640 1 Processor -- start 2023-10-14T11:14:03.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41edb9d640 1 -- start start 2023-10-14T11:14:03.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41edb9d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f41e815cf90 0x7f41e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:03.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41edb9d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e815d4e0 con 0x7f41e80b2ad0 2023-10-14T11:14:03.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41edb9d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e815d7c0 con 0x7f41e80ce310 2023-10-14T11:14:03.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41edb9d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e8160580 con 0x7f41e815cf90 2023-10-14T11:14:03.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41e77fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f41e80b2ad0 0x7f41e806b4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33302/0 (socket says 172.21.15.26:33302) 2023-10-14T11:14:03.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41e77fe640 1 -- 172.21.15.26:0/931039519 learned_addr learned my addr 172.21.15.26:0/931039519 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:03.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41e67fc640 1 -- 172.21.15.26:0/931039519 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723673532 0 0) 0x7f41e815d4e0 con 0x7f41e80b2ad0 2023-10-14T11:14:03.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41e6ffd640 1 --2- 172.21.15.26:0/931039519 >> v2:172.21.15.110:3300/0 conn(0x7f41e815cf90 0x7f41e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:03.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41e67fc640 1 -- 172.21.15.26:0/931039519 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41d0003530 con 0x7f41e80b2ad0 2023-10-14T11:14:03.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41e67fc640 1 -- 172.21.15.26:0/931039519 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3713699960 0 0) 0x7f41d0003530 con 0x7f41e80b2ad0 2023-10-14T11:14:03.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41e67fc640 1 -- 172.21.15.26:0/931039519 >> v2:172.21.15.110:3300/0 conn(0x7f41e815cf90 msgr2=0x7f41e806c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:03.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41e67fc640 1 --2- 172.21.15.26:0/931039519 >> v2:172.21.15.110:3300/0 conn(0x7f41e815cf90 0x7f41e806c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41e67fc640 1 -- 172.21.15.26:0/931039519 >> v1:172.21.15.110:6789/0 conn(0x7f41e80ce310 legacy=0x7f41e81609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41e67fc640 1 -- 172.21.15.26:0/931039519 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e815daa0 con 0x7f41e80b2ad0 2023-10-14T11:14:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41e67fc640 1 -- 172.21.15.26:0/931039519 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f41d8001680 con 0x7f41e80b2ad0 2023-10-14T11:14:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41e67fc640 1 -- 172.21.15.26:0/931039519 >> v1:172.21.15.26:6789/0 conn(0x7f41e80b2ad0 legacy=0x7f41e806b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41e67fc640 1 --2- 172.21.15.26:0/931039519 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41d00039b0 0x7f41d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41e67fc640 1 --2- 172.21.15.26:0/931039519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41d00047d0 0x7f41d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41e67fc640 1 --2- 172.21.15.26:0/931039519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41d0005190 0x7f41d000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41e67fc640 1 -- 172.21.15.26:0/931039519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e8160580 con 0x7f41d0005190 2023-10-14T11:14:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41e67fc640 1 -- 172.21.15.26:0/931039519 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d000bfe0 con 0x7f41d00047d0 2023-10-14T11:14:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41e67fc640 1 -- 172.21.15.26:0/931039519 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d000c1a0 con 0x7f41d00039b0 2023-10-14T11:14:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41e7fff640 1 --2- 172.21.15.26:0/931039519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41d0005190 0x7f41d000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41e77fe640 1 --2- 172.21.15.26:0/931039519 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41d00039b0 0x7f41d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.493+0000 7f41e6ffd640 1 --2- 172.21.15.26:0/931039519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41d00047d0 0x7f41d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.497+0000 7f41e7fff640 1 -- 172.21.15.26:0/931039519 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41d00039b0 msgr2=0x7f41d0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.497+0000 7f41e7fff640 1 --2- 172.21.15.26:0/931039519 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41d00039b0 0x7f41d0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.497+0000 7f41e7fff640 1 -- 172.21.15.26:0/931039519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41d00047d0 msgr2=0x7f41d0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.497+0000 7f41e7fff640 1 --2- 172.21.15.26:0/931039519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41d00047d0 0x7f41d0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.497+0000 7f41e7fff640 1 -- 172.21.15.26:0/931039519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d0003530 con 0x7f41d0005190 2023-10-14T11:14:03.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.497+0000 7f41e7fff640 1 -- 172.21.15.26:0/931039519 reap_dead start 2023-10-14T11:14:03.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.497+0000 7f41e7fff640 1 --2- 172.21.15.26:0/931039519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41d0005190 0x7f41d000b990 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f41e0001e70 tx=0x7f41e001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2992f7963cf4c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:03.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.497+0000 7f41e67fc640 1 -- 172.21.15.26:0/931039519 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e0003b80 con 0x7f41d0005190 2023-10-14T11:14:03.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.497+0000 7f41e67fc640 1 -- 172.21.15.26:0/931039519 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e0003d20 con 0x7f41d0005190 2023-10-14T11:14:03.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.497+0000 7f41e67fc640 1 -- 172.21.15.26:0/931039519 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e0005260 con 0x7f41d0005190 2023-10-14T11:14:03.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.497+0000 7f41edb9d640 1 -- 172.21.15.26:0/931039519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41d0005190 msgr2=0x7f41d000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:03.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.497+0000 7f41edb9d640 1 --2- 172.21.15.26:0/931039519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41d0005190 0x7f41d000b990 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f41e0001e70 tx=0x7f41e001c760 comp rx=0 tx=0).stop 2023-10-14T11:14:03.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.497+0000 7f41edb9d640 1 -- 172.21.15.26:0/931039519 shutdown_connections 2023-10-14T11:14:03.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.497+0000 7f41edb9d640 1 --2- 172.21.15.26:0/931039519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41d0005190 0x7f41d000b990 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.497+0000 7f41edb9d640 1 -- 172.21.15.26:0/931039519 >> 172.21.15.26:0/931039519 conn(0x7f41e80cd1c0 msgr2=0x7f41e80cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:03.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.501+0000 7f41edb9d640 1 -- 172.21.15.26:0/931039519 shutdown_connections 2023-10-14T11:14:03.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.501+0000 7f41edb9d640 1 -- 172.21.15.26:0/931039519 wait complete. 2023-10-14T11:14:03.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.501+0000 7f41edb9d640 1 Processor -- start 2023-10-14T11:14:03.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.501+0000 7f41edb9d640 1 -- start start 2023-10-14T11:14:03.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.501+0000 7f41edb9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41d0005190 0x7f41e80ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:03.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.501+0000 7f41edb9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41e81583f0 0x7f41e8158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:03.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.501+0000 7f41edb9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41e80b0e10 0x7f41e80b1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:03.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.501+0000 7f41edb9d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e80af370 con 0x7f41e81583f0 2023-10-14T11:14:03.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.501+0000 7f41edb9d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e8158db0 con 0x7f41d0005190 2023-10-14T11:14:03.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.501+0000 7f41edb9d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e80b17d0 con 0x7f41e80b0e10 2023-10-14T11:14:03.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.501+0000 7f41e6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41e81583f0 0x7f41e8158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:03.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.501+0000 7f41e6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41e81583f0 0x7f41e8158870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35058/0 (socket says 172.21.15.26:35058) 2023-10-14T11:14:03.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.501+0000 7f41e6ffd640 1 -- 172.21.15.26:0/470498893 learned_addr learned my addr 172.21.15.26:0/470498893 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:03.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.501+0000 7f41e7fff640 1 --2- 172.21.15.26:0/470498893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41e80b0e10 0x7f41e80b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:03.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.501+0000 7f41e77fe640 1 --2- 172.21.15.26:0/470498893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41d0005190 0x7f41e80ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:03.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.501+0000 7f41e6ffd640 1 -- 172.21.15.26:0/470498893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41e80b0e10 msgr2=0x7f41e80b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:03.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.501+0000 7f41e6ffd640 1 --2- 172.21.15.26:0/470498893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41e80b0e10 0x7f41e80b1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.501+0000 7f41e6ffd640 1 -- 172.21.15.26:0/470498893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41d0005190 msgr2=0x7f41e80ac2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:03.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.501+0000 7f41e6ffd640 1 --2- 172.21.15.26:0/470498893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41d0005190 0x7f41e80ac2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.501+0000 7f41e6ffd640 1 -- 172.21.15.26:0/470498893 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e80b1a60 con 0x7f41e81583f0 2023-10-14T11:14:03.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.505+0000 7f41e6ffd640 1 --2- 172.21.15.26:0/470498893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41e81583f0 0x7f41e8158870 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f41dc011960 tx=0x7f41dc011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:03.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.505+0000 7f41cffff640 1 -- 172.21.15.26:0/470498893 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc00fa90 con 0x7f41e81583f0 2023-10-14T11:14:03.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.505+0000 7f41cffff640 1 -- 172.21.15.26:0/470498893 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41dc00fbf0 con 0x7f41e81583f0 2023-10-14T11:14:03.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.505+0000 7f41edb9d640 1 -- 172.21.15.26:0/470498893 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e80b1d40 con 0x7f41e81583f0 2023-10-14T11:14:03.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.505+0000 7f41cffff640 1 -- 172.21.15.26:0/470498893 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc014440 con 0x7f41e81583f0 2023-10-14T11:14:03.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.505+0000 7f41edb9d640 1 -- 172.21.15.26:0/470498893 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e80b4010 con 0x7f41e81583f0 2023-10-14T11:14:03.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.505+0000 7f41edb9d640 1 -- 172.21.15.26:0/470498893 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e8074010 con 0x7f41e81583f0 2023-10-14T11:14:03.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.505+0000 7f41cffff640 1 -- 172.21.15.26:0/470498893 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f41dc0145a0 con 0x7f41e81583f0 2023-10-14T11:14:03.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.505+0000 7f41cffff640 1 --2- 172.21.15.26:0/470498893 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41d40664d0 0x7f41d4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:03.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.505+0000 7f41cffff640 1 -- 172.21.15.26:0/470498893 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f41dc0848c0 con 0x7f41e81583f0 2023-10-14T11:14:03.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.505+0000 7f41e77fe640 1 --2- 172.21.15.26:0/470498893 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41d40664d0 0x7f41d4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:03.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.509+0000 7f41e77fe640 1 --2- 172.21.15.26:0/470498893 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41d40664d0 0x7f41d4068990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f41d8001ab0 tx=0x7f41d8008c70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:03.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.509+0000 7f41cffff640 1 -- 172.21.15.26:0/470498893 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f41dc051a60 con 0x7f41e81583f0 2023-10-14T11:14:03.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.677+0000 7f41edb9d640 1 -- 172.21.15.26:0/470498893 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f41e80cddb0 con 0x7f41e81583f0 2023-10-14T11:14:03.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.681+0000 7f41cffff640 1 -- 172.21.15.26:0/470498893 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7f41dc055080 con 0x7f41e81583f0 2023-10-14T11:14:03.683 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-10-14T11:14:03.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.681+0000 7f41edb9d640 1 -- 172.21.15.26:0/470498893 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41d40664d0 msgr2=0x7f41d4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:03.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.681+0000 7f41edb9d640 1 --2- 172.21.15.26:0/470498893 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41d40664d0 0x7f41d4068990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f41d8001ab0 tx=0x7f41d8008c70 comp rx=0 tx=0).stop 2023-10-14T11:14:03.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.681+0000 7f41edb9d640 1 -- 172.21.15.26:0/470498893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41e81583f0 msgr2=0x7f41e8158870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:03.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.681+0000 7f41edb9d640 1 --2- 172.21.15.26:0/470498893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41e81583f0 0x7f41e8158870 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f41dc011960 tx=0x7f41dc011e20 comp rx=0 tx=0).stop 2023-10-14T11:14:03.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.681+0000 7f41edb9d640 1 -- 172.21.15.26:0/470498893 shutdown_connections 2023-10-14T11:14:03.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.681+0000 7f41edb9d640 1 --2- 172.21.15.26:0/470498893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41e80b0e10 0x7f41e80b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.681+0000 7f41edb9d640 1 --2- 172.21.15.26:0/470498893 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f41d40664d0 0x7f41d4068990 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.681+0000 7f41edb9d640 1 --2- 172.21.15.26:0/470498893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41e81583f0 0x7f41e8158870 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.681+0000 7f41edb9d640 1 --2- 172.21.15.26:0/470498893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41d0005190 0x7f41e80ac2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.681+0000 7f41edb9d640 1 -- 172.21.15.26:0/470498893 >> 172.21.15.26:0/470498893 conn(0x7f41e80cd1c0 msgr2=0x7f41e815b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:03.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.681+0000 7f41edb9d640 1 -- 172.21.15.26:0/470498893 shutdown_connections 2023-10-14T11:14:03.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.681+0000 7f41edb9d640 1 -- 172.21.15.26:0/470498893 wait complete. 2023-10-14T11:14:03.706 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:14:03.706 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:14:03.716 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:14:03.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.897+0000 7f4292809640 1 Processor -- start 2023-10-14T11:14:03.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.897+0000 7f4292809640 1 -- start start 2023-10-14T11:14:03.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.897+0000 7f4292809640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f428c070c40 0x7f428c15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:03.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.897+0000 7f4292809640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f428c0b07f0 0x7f428c164490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:03.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.897+0000 7f4292809640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f428c15be60 con 0x7f428c0b4020 2023-10-14T11:14:03.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.897+0000 7f4292809640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f428c15b3b0 con 0x7f428c0b07f0 2023-10-14T11:14:03.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.897+0000 7f4292809640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c15c1f0 con 0x7f428c070c40 2023-10-14T11:14:03.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.901+0000 7f4290da6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f428c0b07f0 0x7f428c164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:03.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.901+0000 7f4290da6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f428c0b07f0 0x7f428c164490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35060/0 (socket says 172.21.15.26:35060) 2023-10-14T11:14:03.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.901+0000 7f4290da6640 1 -- 172.21.15.26:0/1510361141 learned_addr learned my addr 172.21.15.26:0/1510361141 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:03.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.901+0000 7f428bfff640 1 --2- 172.21.15.26:0/1510361141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f428c070c40 0x7f428c15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:03.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.901+0000 7f4290da6640 1 -- 172.21.15.26:0/1510361141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f428c070c40 msgr2=0x7f428c15ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:03.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.901+0000 7f4290da6640 1 --2- 172.21.15.26:0/1510361141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f428c070c40 0x7f428c15ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.901+0000 7f4290da6640 1 -- 172.21.15.26:0/1510361141 >> v1:172.21.15.110:6789/0 conn(0x7f428c0b4020 legacy=0x7f428c0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:03.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.901+0000 7f4290da6640 1 -- 172.21.15.26:0/1510361141 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c071020 con 0x7f428c0b07f0 2023-10-14T11:14:03.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.901+0000 7f4290da6640 1 --2- 172.21.15.26:0/1510361141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f428c0b07f0 0x7f428c164490 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4284009e50 tx=0x7f428401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770e5689c06f6442 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:03.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.901+0000 7f428affd640 1 -- 172.21.15.26:0/1510361141 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42840a5840 con 0x7f428c0b07f0 2023-10-14T11:14:03.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.901+0000 7f428affd640 1 -- 172.21.15.26:0/1510361141 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42840a59a0 con 0x7f428c0b07f0 2023-10-14T11:14:03.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.901+0000 7f428affd640 1 -- 172.21.15.26:0/1510361141 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42840a5d30 con 0x7f428c0b07f0 2023-10-14T11:14:03.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4292809640 1 -- 172.21.15.26:0/1510361141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f428c0b07f0 msgr2=0x7f428c164490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:03.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4292809640 1 --2- 172.21.15.26:0/1510361141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f428c0b07f0 0x7f428c164490 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4284009e50 tx=0x7f428401c980 comp rx=0 tx=0).stop 2023-10-14T11:14:03.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4292809640 1 -- 172.21.15.26:0/1510361141 shutdown_connections 2023-10-14T11:14:03.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4292809640 1 --2- 172.21.15.26:0/1510361141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f428c0b07f0 0x7f428c164490 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4292809640 1 --2- 172.21.15.26:0/1510361141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f428c070c40 0x7f428c15ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4292809640 1 -- 172.21.15.26:0/1510361141 >> 172.21.15.26:0/1510361141 conn(0x7f428c06c190 msgr2=0x7f428c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:03.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4292809640 1 -- 172.21.15.26:0/1510361141 shutdown_connections 2023-10-14T11:14:03.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4292809640 1 -- 172.21.15.26:0/1510361141 wait complete. 2023-10-14T11:14:03.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4292809640 1 Processor -- start 2023-10-14T11:14:03.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4292809640 1 -- start start 2023-10-14T11:14:03.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4292809640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f428c070c40 0x7f428c14d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:03.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4292809640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f428c0b07f0 0x7f428c0c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:03.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4292809640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f428c0b4020 0x7f428c1441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:03.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4292809640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c0c4c40 con 0x7f428c0b4020 2023-10-14T11:14:03.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4292809640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c0c4f20 con 0x7f428c070c40 2023-10-14T11:14:03.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4292809640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c1436e0 con 0x7f428c0b07f0 2023-10-14T11:14:03.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4290da6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f428c0b4020 0x7f428c1441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:03.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4290da6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f428c0b4020 0x7f428c1441c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35068/0 (socket says 172.21.15.26:35068) 2023-10-14T11:14:03.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4290da6640 1 -- 172.21.15.26:0/2286967803 learned_addr learned my addr 172.21.15.26:0/2286967803 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:03.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f428b7fe640 1 --2- 172.21.15.26:0/2286967803 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f428c0b07f0 0x7f428c0c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:03.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f428bfff640 1 --2- 172.21.15.26:0/2286967803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f428c070c40 0x7f428c14d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:03.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4290da6640 1 -- 172.21.15.26:0/2286967803 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f428c0b07f0 msgr2=0x7f428c0c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:03.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4290da6640 1 --2- 172.21.15.26:0/2286967803 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f428c0b07f0 0x7f428c0c2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4290da6640 1 -- 172.21.15.26:0/2286967803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f428c070c40 msgr2=0x7f428c14d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:03.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4290da6640 1 --2- 172.21.15.26:0/2286967803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f428c070c40 0x7f428c14d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:03.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.905+0000 7f4290da6640 1 -- 172.21.15.26:0/2286967803 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4284009b30 con 0x7f428c0b4020 2023-10-14T11:14:03.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.909+0000 7f4290da6640 1 --2- 172.21.15.26:0/2286967803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f428c0b4020 0x7f428c1441c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f42840af040 tx=0x7f4284019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:03.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.909+0000 7f4288ff9640 1 -- 172.21.15.26:0/2286967803 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42840b8670 con 0x7f428c0b4020 2023-10-14T11:14:03.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.909+0000 7f4288ff9640 1 -- 172.21.15.26:0/2286967803 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42840b87d0 con 0x7f428c0b4020 2023-10-14T11:14:03.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.909+0000 7f4288ff9640 1 -- 172.21.15.26:0/2286967803 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42840b8b60 con 0x7f428c0b4020 2023-10-14T11:14:03.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.909+0000 7f4292809640 1 -- 172.21.15.26:0/2286967803 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428c1439c0 con 0x7f428c0b4020 2023-10-14T11:14:03.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.909+0000 7f4292809640 1 -- 172.21.15.26:0/2286967803 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428c0c4930 con 0x7f428c0b4020 2023-10-14T11:14:03.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.909+0000 7f4292809640 1 -- 172.21.15.26:0/2286967803 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428c143ee0 con 0x7f428c0b4020 2023-10-14T11:14:03.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.909+0000 7f4288ff9640 1 -- 172.21.15.26:0/2286967803 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f42840b8cc0 con 0x7f428c0b4020 2023-10-14T11:14:03.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.909+0000 7f4288ff9640 1 --2- 172.21.15.26:0/2286967803 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f42780664d0 0x7f4278068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:03.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.909+0000 7f4288ff9640 1 -- 172.21.15.26:0/2286967803 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f428411f5e0 con 0x7f428c0b4020 2023-10-14T11:14:03.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.909+0000 7f428bfff640 1 --2- 172.21.15.26:0/2286967803 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f42780664d0 0x7f4278068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:03.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.913+0000 7f428bfff640 1 --2- 172.21.15.26:0/2286967803 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f42780664d0 0x7f4278068990 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f427c006aa0 tx=0x7f427c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:03.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:03.913+0000 7f4288ff9640 1 -- 172.21.15.26:0/2286967803 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f428c143ee0 con 0x7f428c0b4020 2023-10-14T11:14:04.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.073+0000 7f4292809640 1 -- 172.21.15.26:0/2286967803 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f428c143ee0 con 0x7f428c0b4020 2023-10-14T11:14:04.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.073+0000 7f4288ff9640 1 -- 172.21.15.26:0/2286967803 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18578 (secure 0 0 0) 0x7f428c143ee0 con 0x7f428c0b4020 2023-10-14T11:14:04.079 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:04.079 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":42,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:14:01.292164+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:13:48.453821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:13:49.623527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-10-14T11:13:59.245615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:14:04.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.077+0000 7f4292809640 1 -- 172.21.15.26:0/2286967803 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f42780664d0 msgr2=0x7f4278068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:04.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.077+0000 7f4292809640 1 --2- 172.21.15.26:0/2286967803 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f42780664d0 0x7f4278068990 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f427c006aa0 tx=0x7f427c008040 comp rx=0 tx=0).stop 2023-10-14T11:14:04.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.077+0000 7f4292809640 1 -- 172.21.15.26:0/2286967803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f428c0b4020 msgr2=0x7f428c1441c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:04.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.077+0000 7f4292809640 1 --2- 172.21.15.26:0/2286967803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f428c0b4020 0x7f428c1441c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f42840af040 tx=0x7f4284019720 comp rx=0 tx=0).stop 2023-10-14T11:14:04.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.077+0000 7f4292809640 1 -- 172.21.15.26:0/2286967803 shutdown_connections 2023-10-14T11:14:04.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.077+0000 7f4292809640 1 --2- 172.21.15.26:0/2286967803 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f42780664d0 0x7f4278068990 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.077+0000 7f4292809640 1 --2- 172.21.15.26:0/2286967803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f428c0b4020 0x7f428c1441c0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.077+0000 7f4292809640 1 --2- 172.21.15.26:0/2286967803 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f428c0b07f0 0x7f428c0c2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.077+0000 7f4292809640 1 --2- 172.21.15.26:0/2286967803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f428c070c40 0x7f428c14d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.077+0000 7f4292809640 1 -- 172.21.15.26:0/2286967803 >> 172.21.15.26:0/2286967803 conn(0x7f428c06c190 msgr2=0x7f428c06c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:04.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.077+0000 7f4292809640 1 -- 172.21.15.26:0/2286967803 shutdown_connections 2023-10-14T11:14:04.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.077+0000 7f4292809640 1 -- 172.21.15.26:0/2286967803 wait complete. 2023-10-14T11:14:04.100 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'testcephfs1_metadata', 'create_time': '2023-10-14T11:13:48.453821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'testcephfs1_data', 'create_time': '2023-10-14T11:13:49.623527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-10-14T11:13:59.245615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:14:04.101 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:14:04.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.245+0000 7f7c61b2a640 1 Processor -- start 2023-10-14T11:14:04.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.245+0000 7f7c61b2a640 1 -- start start 2023-10-14T11:14:04.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.245+0000 7f7c61b2a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c5c15cba0 0x7f7c5c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:04.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.245+0000 7f7c61b2a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7c5c0d0210 0x7f7c5c0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:04.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.245+0000 7f7c61b2a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5c0d1670 con 0x7f7c5c0b84e0 2023-10-14T11:14:04.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.245+0000 7f7c61b2a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5c0d1460 con 0x7f7c5c0d0210 2023-10-14T11:14:04.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.245+0000 7f7c61b2a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c0d1950 con 0x7f7c5c15cba0 2023-10-14T11:14:04.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.245+0000 7f7c5bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7c5c0d0210 0x7f7c5c0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:04.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.245+0000 7f7c5affd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7c5c0b84e0 0x7f7c5c0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33304/0 (socket says 172.21.15.26:33304) 2023-10-14T11:14:04.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.245+0000 7f7c5affd640 1 -- 172.21.15.26:0/1286419841 learned_addr learned my addr 172.21.15.26:0/1286419841 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:04.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.245+0000 7f7c5b7fe640 1 --2- 172.21.15.26:0/1286419841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c5c15cba0 0x7f7c5c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:04.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.245+0000 7f7c5bfff640 1 -- 172.21.15.26:0/1286419841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c5c15cba0 msgr2=0x7f7c5c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:04.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.245+0000 7f7c5bfff640 1 --2- 172.21.15.26:0/1286419841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c5c15cba0 0x7f7c5c0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.245+0000 7f7c5bfff640 1 -- 172.21.15.26:0/1286419841 >> v1:172.21.15.26:6789/0 conn(0x7f7c5c0b84e0 legacy=0x7f7c5c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:04.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.245+0000 7f7c5bfff640 1 -- 172.21.15.26:0/1286419841 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c0d1c30 con 0x7f7c5c0d0210 2023-10-14T11:14:04.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.249+0000 7f7c5bfff640 1 --2- 172.21.15.26:0/1286419841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c5c0d0210 0x7f7c5c0b5cf0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009d90 tx=0x7f7c5401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff12bac85113df6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:04.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.249+0000 7f7c5a7fc640 1 -- 172.21.15.26:0/1286419841 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c540a5a10 con 0x7f7c5c0d0210 2023-10-14T11:14:04.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.249+0000 7f7c5a7fc640 1 -- 172.21.15.26:0/1286419841 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c540a5b70 con 0x7f7c5c0d0210 2023-10-14T11:14:04.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.249+0000 7f7c5a7fc640 1 -- 172.21.15.26:0/1286419841 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c540ad440 con 0x7f7c5c0d0210 2023-10-14T11:14:04.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.249+0000 7f7c61b2a640 1 -- 172.21.15.26:0/1286419841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c5c0d0210 msgr2=0x7f7c5c0b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:04.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.249+0000 7f7c61b2a640 1 --2- 172.21.15.26:0/1286419841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c5c0d0210 0x7f7c5c0b5cf0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009d90 tx=0x7f7c5401c950 comp rx=0 tx=0).stop 2023-10-14T11:14:04.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.249+0000 7f7c61b2a640 1 -- 172.21.15.26:0/1286419841 shutdown_connections 2023-10-14T11:14:04.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.249+0000 7f7c61b2a640 1 --2- 172.21.15.26:0/1286419841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c5c0d0210 0x7f7c5c0b5cf0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.249+0000 7f7c61b2a640 1 --2- 172.21.15.26:0/1286419841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c5c15cba0 0x7f7c5c0d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.249+0000 7f7c61b2a640 1 -- 172.21.15.26:0/1286419841 >> 172.21.15.26:0/1286419841 conn(0x7f7c5c0719c0 msgr2=0x7f7c5c071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:04.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.249+0000 7f7c61b2a640 1 -- 172.21.15.26:0/1286419841 shutdown_connections 2023-10-14T11:14:04.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.249+0000 7f7c61b2a640 1 -- 172.21.15.26:0/1286419841 wait complete. 2023-10-14T11:14:04.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.249+0000 7f7c61b2a640 1 Processor -- start 2023-10-14T11:14:04.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c61b2a640 1 -- start start 2023-10-14T11:14:04.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c61b2a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c5c0b84e0 0x7f7c5c15b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:04.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c61b2a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c5c0d0210 0x7f7c5c0c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:04.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c61b2a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c5c15cba0 0x7f7c5c0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:04.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c61b2a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c1563c0 con 0x7f7c5c0d0210 2023-10-14T11:14:04.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c61b2a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c155ab0 con 0x7f7c5c0b84e0 2023-10-14T11:14:04.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c61b2a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c157160 con 0x7f7c5c15cba0 2023-10-14T11:14:04.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c5affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c5c0d0210 0x7f7c5c0c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:04.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c5affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c5c0d0210 0x7f7c5c0c6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35088/0 (socket says 172.21.15.26:35088) 2023-10-14T11:14:04.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c5affd640 1 -- 172.21.15.26:0/4039062828 learned_addr learned my addr 172.21.15.26:0/4039062828 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:04.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c5b7fe640 1 --2- 172.21.15.26:0/4039062828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c5c0b84e0 0x7f7c5c15b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:04.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c5bfff640 1 --2- 172.21.15.26:0/4039062828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c5c15cba0 0x7f7c5c0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:04.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c5affd640 1 -- 172.21.15.26:0/4039062828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c5c15cba0 msgr2=0x7f7c5c0c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:04.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c5affd640 1 --2- 172.21.15.26:0/4039062828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c5c15cba0 0x7f7c5c0c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c5affd640 1 -- 172.21.15.26:0/4039062828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c5c0b84e0 msgr2=0x7f7c5c15b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:04.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c5affd640 1 --2- 172.21.15.26:0/4039062828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c5c0b84e0 0x7f7c5c15b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c5affd640 1 -- 172.21.15.26:0/4039062828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c54009a70 con 0x7f7c5c0d0210 2023-10-14T11:14:04.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c5bfff640 1 --2- 172.21.15.26:0/4039062828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c5c15cba0 0x7f7c5c0c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:04.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c5affd640 1 --2- 172.21.15.26:0/4039062828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c5c0d0210 0x7f7c5c0c6830 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000c500 tx=0x7f7c5000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:04.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c43fff640 1 -- 172.21.15.26:0/4039062828 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c50005cf0 con 0x7f7c5c0d0210 2023-10-14T11:14:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c43fff640 1 -- 172.21.15.26:0/4039062828 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c50005e50 con 0x7f7c5c0d0210 2023-10-14T11:14:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c43fff640 1 -- 172.21.15.26:0/4039062828 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c500072f0 con 0x7f7c5c0d0210 2023-10-14T11:14:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c61b2a640 1 -- 172.21.15.26:0/4039062828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5c155d70 con 0x7f7c5c0d0210 2023-10-14T11:14:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c61b2a640 1 -- 172.21.15.26:0/4039062828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5c156e10 con 0x7f7c5c0d0210 2023-10-14T11:14:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.253+0000 7f7c61b2a640 1 -- 172.21.15.26:0/4039062828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c5c04e170 con 0x7f7c5c0d0210 2023-10-14T11:14:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.257+0000 7f7c43fff640 1 -- 172.21.15.26:0/4039062828 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7c50007450 con 0x7f7c5c0d0210 2023-10-14T11:14:04.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.257+0000 7f7c43fff640 1 --2- 172.21.15.26:0/4039062828 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7c480664d0 0x7f7c48068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:04.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.257+0000 7f7c43fff640 1 -- 172.21.15.26:0/4039062828 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f7c500835b0 con 0x7f7c5c0d0210 2023-10-14T11:14:04.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.257+0000 7f7c5b7fe640 1 --2- 172.21.15.26:0/4039062828 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7c480664d0 0x7f7c48068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:04.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.257+0000 7f7c5b7fe640 1 --2- 172.21.15.26:0/4039062828 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7c480664d0 0x7f7c48068990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c009ac0 tx=0x7f7c4c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:04.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.261+0000 7f7c43fff640 1 -- 172.21.15.26:0/4039062828 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7c50050880 con 0x7f7c5c0d0210 2023-10-14T11:14:04.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.417+0000 7f7c61b2a640 1 -- 172.21.15.26:0/4039062828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7c5c0c62c0 con 0x7f7c5c0d0210 2023-10-14T11:14:04.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.417+0000 7f7c43fff640 1 -- 172.21.15.26:0/4039062828 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7c50053ea0 con 0x7f7c5c0d0210 2023-10-14T11:14:04.422 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:14:04.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.421+0000 7f7c61b2a640 1 -- 172.21.15.26:0/4039062828 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7c480664d0 msgr2=0x7f7c48068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:04.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.421+0000 7f7c61b2a640 1 --2- 172.21.15.26:0/4039062828 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7c480664d0 0x7f7c48068990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c009ac0 tx=0x7f7c4c009190 comp rx=0 tx=0).stop 2023-10-14T11:14:04.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.421+0000 7f7c61b2a640 1 -- 172.21.15.26:0/4039062828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c5c0d0210 msgr2=0x7f7c5c0c6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:04.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.421+0000 7f7c61b2a640 1 --2- 172.21.15.26:0/4039062828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c5c0d0210 0x7f7c5c0c6830 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000c500 tx=0x7f7c5000c9c0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.421+0000 7f7c61b2a640 1 -- 172.21.15.26:0/4039062828 shutdown_connections 2023-10-14T11:14:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.421+0000 7f7c61b2a640 1 --2- 172.21.15.26:0/4039062828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c5c15cba0 0x7f7c5c0c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.421+0000 7f7c61b2a640 1 --2- 172.21.15.26:0/4039062828 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7c480664d0 0x7f7c48068990 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.421+0000 7f7c61b2a640 1 --2- 172.21.15.26:0/4039062828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c5c0d0210 0x7f7c5c0c6830 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.421+0000 7f7c61b2a640 1 --2- 172.21.15.26:0/4039062828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c5c0b84e0 0x7f7c5c15b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.421+0000 7f7c61b2a640 1 -- 172.21.15.26:0/4039062828 >> 172.21.15.26:0/4039062828 conn(0x7f7c5c0719c0 msgr2=0x7f7c5c071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:04.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.421+0000 7f7c61b2a640 1 -- 172.21.15.26:0/4039062828 shutdown_connections 2023-10-14T11:14:04.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.421+0000 7f7c61b2a640 1 -- 172.21.15.26:0/4039062828 wait complete. 2023-10-14T11:14:04.443 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_metadata pg_num 2023-10-14T11:14:04.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.585+0000 7f2e1fb65640 1 Processor -- start 2023-10-14T11:14:04.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.585+0000 7f2e1fb65640 1 -- start start 2023-10-14T11:14:04.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1fb65640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e1806d010 0x7f2e180c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:04.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1fb65640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1815ae30 con 0x7f2e18069e90 2023-10-14T11:14:04.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1fb65640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e180ca510 con 0x7f2e180c26b0 2023-10-14T11:14:04.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1fb65640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e180cb090 con 0x7f2e1806d010 2023-10-14T11:14:04.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1d901640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2e18069e90 0x7f2e1806a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33318/0 (socket says 172.21.15.26:33318) 2023-10-14T11:14:04.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1d901640 1 -- 172.21.15.26:0/1344891957 learned_addr learned my addr 172.21.15.26:0/1344891957 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:04.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1d100640 1 --2- 172.21.15.26:0/1344891957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e1806d010 0x7f2e180c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:04.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1c8ff640 1 -- 172.21.15.26:0/1344891957 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530211540 0 0) 0x7f2e1815ae30 con 0x7f2e18069e90 2023-10-14T11:14:04.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1c8ff640 1 -- 172.21.15.26:0/1344891957 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e04003530 con 0x7f2e18069e90 2023-10-14T11:14:04.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1c8ff640 1 -- 172.21.15.26:0/1344891957 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2812343358 0 0) 0x7f2e04003530 con 0x7f2e18069e90 2023-10-14T11:14:04.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1c8ff640 1 -- 172.21.15.26:0/1344891957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e1806d010 msgr2=0x7f2e180c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:04.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1c8ff640 1 --2- 172.21.15.26:0/1344891957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e1806d010 0x7f2e180c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1c8ff640 1 -- 172.21.15.26:0/1344891957 >> v1:172.21.15.110:6789/0 conn(0x7f2e180c26b0 legacy=0x7f2e180c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:04.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1c8ff640 1 -- 172.21.15.26:0/1344891957 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e180ca7f0 con 0x7f2e18069e90 2023-10-14T11:14:04.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1c8ff640 1 -- 172.21.15.26:0/1344891957 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f2e14001680 con 0x7f2e18069e90 2023-10-14T11:14:04.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1c8ff640 1 -- 172.21.15.26:0/1344891957 >> v1:172.21.15.26:6789/0 conn(0x7f2e18069e90 legacy=0x7f2e1806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:04.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1c8ff640 1 --2- 172.21.15.26:0/1344891957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e040039b0 0x7f2e04003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:04.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1c8ff640 1 --2- 172.21.15.26:0/1344891957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e04004310 0x7f2e040047f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:04.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1c8ff640 1 --2- 172.21.15.26:0/1344891957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e04004ff0 0x7f2e0400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:04.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1c8ff640 1 -- 172.21.15.26:0/1344891957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e180cb090 con 0x7f2e04004ff0 2023-10-14T11:14:04.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1c8ff640 1 -- 172.21.15.26:0/1344891957 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0400bed0 con 0x7f2e04004310 2023-10-14T11:14:04.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1c8ff640 1 -- 172.21.15.26:0/1344891957 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0400c040 con 0x7f2e040039b0 2023-10-14T11:14:04.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1e102640 1 --2- 172.21.15.26:0/1344891957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e04004ff0 0x7f2e0400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:04.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1d901640 1 --2- 172.21.15.26:0/1344891957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e040039b0 0x7f2e04003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:04.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1d100640 1 --2- 172.21.15.26:0/1344891957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e04004310 0x7f2e040047f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:04.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1e102640 1 -- 172.21.15.26:0/1344891957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e040039b0 msgr2=0x7f2e04003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:04.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1e102640 1 --2- 172.21.15.26:0/1344891957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e040039b0 0x7f2e04003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1e102640 1 -- 172.21.15.26:0/1344891957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e04004310 msgr2=0x7f2e040047f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:04.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1e102640 1 --2- 172.21.15.26:0/1344891957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e04004310 0x7f2e040047f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.589+0000 7f2e1e102640 1 -- 172.21.15.26:0/1344891957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e04003530 con 0x7f2e04004ff0 2023-10-14T11:14:04.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.593+0000 7f2e1e102640 1 --2- 172.21.15.26:0/1344891957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e04004ff0 0x7f2e0400b990 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2e10002010 tx=0x7f2e1001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554a1df394c1a0f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:04.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.593+0000 7f2e1c8ff640 1 -- 172.21.15.26:0/1344891957 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e100a57b0 con 0x7f2e04004ff0 2023-10-14T11:14:04.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.593+0000 7f2e1c8ff640 1 -- 172.21.15.26:0/1344891957 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e100a5930 con 0x7f2e04004ff0 2023-10-14T11:14:04.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.593+0000 7f2e1c8ff640 1 -- 172.21.15.26:0/1344891957 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e100a5ce0 con 0x7f2e04004ff0 2023-10-14T11:14:04.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.593+0000 7f2e1fb65640 1 -- 172.21.15.26:0/1344891957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e04004ff0 msgr2=0x7f2e0400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:04.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.593+0000 7f2e1fb65640 1 --2- 172.21.15.26:0/1344891957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e04004ff0 0x7f2e0400b990 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2e10002010 tx=0x7f2e1001c8c0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.593+0000 7f2e1e102640 1 -- 172.21.15.26:0/1344891957 reap_dead start 2023-10-14T11:14:04.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.593+0000 7f2e1fb65640 1 -- 172.21.15.26:0/1344891957 shutdown_connections 2023-10-14T11:14:04.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.593+0000 7f2e1fb65640 1 -- 172.21.15.26:0/1344891957 >> 172.21.15.26:0/1344891957 conn(0x7f2e180b0da0 msgr2=0x7f2e180ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:04.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.593+0000 7f2e1fb65640 1 -- 172.21.15.26:0/1344891957 shutdown_connections 2023-10-14T11:14:04.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.593+0000 7f2e1fb65640 1 -- 172.21.15.26:0/1344891957 wait complete. 2023-10-14T11:14:04.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.593+0000 7f2e1fb65640 1 Processor -- start 2023-10-14T11:14:04.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.593+0000 7f2e1fb65640 1 -- start start 2023-10-14T11:14:04.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e1fb65640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e04004ff0 0x7f2e18150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:04.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e1fb65640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e18157870 0x7f2e180c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:04.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e1fb65640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e181556b0 0x7f2e18155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:04.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e1fb65640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e181560a0 con 0x7f2e18157870 2023-10-14T11:14:04.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e1fb65640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e180c7ed0 con 0x7f2e04004ff0 2023-10-14T11:14:04.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e1fb65640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e180c81b0 con 0x7f2e181556b0 2023-10-14T11:14:04.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e1d100640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e18157870 0x7f2e180c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:04.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e1d100640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e18157870 0x7f2e180c7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35118/0 (socket says 172.21.15.26:35118) 2023-10-14T11:14:04.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e1d100640 1 -- 172.21.15.26:0/3344120206 learned_addr learned my addr 172.21.15.26:0/3344120206 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:04.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e1d901640 1 --2- 172.21.15.26:0/3344120206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e04004ff0 0x7f2e18150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:04.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e1e102640 1 --2- 172.21.15.26:0/3344120206 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e181556b0 0x7f2e18155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:04.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e1d100640 1 -- 172.21.15.26:0/3344120206 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e181556b0 msgr2=0x7f2e18155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:04.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e1d100640 1 --2- 172.21.15.26:0/3344120206 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e181556b0 0x7f2e18155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e1d100640 1 -- 172.21.15.26:0/3344120206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e04004ff0 msgr2=0x7f2e18150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:04.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e1d100640 1 --2- 172.21.15.26:0/3344120206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e04004ff0 0x7f2e18150fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e1d100640 1 -- 172.21.15.26:0/3344120206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e180c8490 con 0x7f2e18157870 2023-10-14T11:14:04.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e1d901640 1 --2- 172.21.15.26:0/3344120206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e04004ff0 0x7f2e18150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:04.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e1e102640 1 --2- 172.21.15.26:0/3344120206 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e181556b0 0x7f2e18155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:04.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e1d100640 1 --2- 172.21.15.26:0/3344120206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e18157870 0x7f2e180c7670 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2e08011860 tx=0x7f2e08011d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:04.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e0e7fc640 1 -- 172.21.15.26:0/3344120206 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08004240 con 0x7f2e18157870 2023-10-14T11:14:04.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e0e7fc640 1 -- 172.21.15.26:0/3344120206 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e080043a0 con 0x7f2e18157870 2023-10-14T11:14:04.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e0e7fc640 1 -- 172.21.15.26:0/3344120206 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0800fa60 con 0x7f2e18157870 2023-10-14T11:14:04.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e1fb65640 1 -- 172.21.15.26:0/3344120206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e180c3790 con 0x7f2e18157870 2023-10-14T11:14:04.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e1fb65640 1 -- 172.21.15.26:0/3344120206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e180c7bb0 con 0x7f2e18157870 2023-10-14T11:14:04.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.597+0000 7f2e1fb65640 1 -- 172.21.15.26:0/3344120206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e1804e170 con 0x7f2e18157870 2023-10-14T11:14:04.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.601+0000 7f2e0e7fc640 1 -- 172.21.15.26:0/3344120206 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2e0800fbc0 con 0x7f2e18157870 2023-10-14T11:14:04.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.601+0000 7f2e0e7fc640 1 --2- 172.21.15.26:0/3344120206 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2dfc0664a0 0x7f2dfc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:04.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.601+0000 7f2e0e7fc640 1 -- 172.21.15.26:0/3344120206 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f2e08084940 con 0x7f2e18157870 2023-10-14T11:14:04.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.601+0000 7f2e1d901640 1 --2- 172.21.15.26:0/3344120206 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2dfc0664a0 0x7f2dfc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:04.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.601+0000 7f2e1d901640 1 --2- 172.21.15.26:0/3344120206 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2dfc0664a0 0x7f2dfc068960 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2e18154b00 tx=0x7f2e14009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:04.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.605+0000 7f2e0e7fc640 1 -- 172.21.15.26:0/3344120206 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2e08051a30 con 0x7f2e18157870 2023-10-14T11:14:04.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.761+0000 7f2e1fb65640 1 -- 172.21.15.26:0/3344120206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2e180c8a90 con 0x7f2e18157870 2023-10-14T11:14:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.761+0000 7f2e0e7fc640 1 -- 172.21.15.26:0/3344120206 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"}]=0 v42) v1 ==== 109+0+11 (secure 0 0 0) 0x7f2e080190b0 con 0x7f2e18157870 2023-10-14T11:14:04.764 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:14:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.761+0000 7f2e1fb65640 1 -- 172.21.15.26:0/3344120206 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2dfc0664a0 msgr2=0x7f2dfc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.761+0000 7f2e1fb65640 1 --2- 172.21.15.26:0/3344120206 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2dfc0664a0 0x7f2dfc068960 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2e18154b00 tx=0x7f2e14009040 comp rx=0 tx=0).stop 2023-10-14T11:14:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.761+0000 7f2e1fb65640 1 -- 172.21.15.26:0/3344120206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e18157870 msgr2=0x7f2e180c7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.761+0000 7f2e1fb65640 1 --2- 172.21.15.26:0/3344120206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e18157870 0x7f2e180c7670 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2e08011860 tx=0x7f2e08011d20 comp rx=0 tx=0).stop 2023-10-14T11:14:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.761+0000 7f2e1fb65640 1 -- 172.21.15.26:0/3344120206 shutdown_connections 2023-10-14T11:14:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.761+0000 7f2e1fb65640 1 --2- 172.21.15.26:0/3344120206 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e181556b0 0x7f2e18155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.761+0000 7f2e1fb65640 1 --2- 172.21.15.26:0/3344120206 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2dfc0664a0 0x7f2dfc068960 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.761+0000 7f2e1fb65640 1 --2- 172.21.15.26:0/3344120206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e18157870 0x7f2e180c7670 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.761+0000 7f2e1fb65640 1 --2- 172.21.15.26:0/3344120206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e04004ff0 0x7f2e18150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.761+0000 7f2e1fb65640 1 -- 172.21.15.26:0/3344120206 >> 172.21.15.26:0/3344120206 conn(0x7f2e180b0da0 msgr2=0x7f2e180ae2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.761+0000 7f2e1fb65640 1 -- 172.21.15.26:0/3344120206 shutdown_connections 2023-10-14T11:14:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.761+0000 7f2e1fb65640 1 -- 172.21.15.26:0/3344120206 wait complete. 2023-10-14T11:14:04.785 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_data pg_num 2023-10-14T11:14:04.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.929+0000 7f37f6794640 1 Processor -- start 2023-10-14T11:14:04.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.929+0000 7f37f6794640 1 -- start start 2023-10-14T11:14:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.929+0000 7f37f6794640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37f006df40 0x7f37f00702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.929+0000 7f37f6794640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f37f0070830 0x7f37f00cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.929+0000 7f37f6794640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f00c9600 con 0x7f37f01590d0 2023-10-14T11:14:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.929+0000 7f37f6794640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f0070ca0 con 0x7f37f0070830 2023-10-14T11:14:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.929+0000 7f37f6794640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f00c98e0 con 0x7f37f006df40 2023-10-14T11:14:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.929+0000 7f37f4d31640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f37f0070830 0x7f37f00cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.929+0000 7f37f4d31640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f37f0070830 0x7f37f00cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35132/0 (socket says 172.21.15.26:35132) 2023-10-14T11:14:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.929+0000 7f37f4d31640 1 -- 172.21.15.26:0/3390504317 learned_addr learned my addr 172.21.15.26:0/3390504317 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.929+0000 7f37ef7fe640 1 --2- 172.21.15.26:0/3390504317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37f006df40 0x7f37f00702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:04.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.929+0000 7f37f4d31640 1 -- 172.21.15.26:0/3390504317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37f006df40 msgr2=0x7f37f00702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:04.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.929+0000 7f37f4d31640 1 --2- 172.21.15.26:0/3390504317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37f006df40 0x7f37f00702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.929+0000 7f37f4d31640 1 -- 172.21.15.26:0/3390504317 >> v1:172.21.15.110:6789/0 conn(0x7f37f01590d0 legacy=0x7f37f00c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:04.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.929+0000 7f37f4d31640 1 -- 172.21.15.26:0/3390504317 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f00c9bc0 con 0x7f37f0070830 2023-10-14T11:14:04.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.933+0000 7f37f4d31640 1 --2- 172.21.15.26:0/3390504317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37f0070830 0x7f37f00cc350 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009e50 tx=0x7f37e801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a2731937dbb91a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:04.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.933+0000 7f37eeffd640 1 -- 172.21.15.26:0/3390504317 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e80a6410 con 0x7f37f0070830 2023-10-14T11:14:04.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.933+0000 7f37eeffd640 1 -- 172.21.15.26:0/3390504317 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e80a6570 con 0x7f37f0070830 2023-10-14T11:14:04.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.933+0000 7f37eeffd640 1 -- 172.21.15.26:0/3390504317 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e80a6900 con 0x7f37f0070830 2023-10-14T11:14:04.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.933+0000 7f37f6794640 1 -- 172.21.15.26:0/3390504317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37f0070830 msgr2=0x7f37f00cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:04.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.933+0000 7f37f6794640 1 --2- 172.21.15.26:0/3390504317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37f0070830 0x7f37f00cc350 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009e50 tx=0x7f37e801ca10 comp rx=0 tx=0).stop 2023-10-14T11:14:04.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.933+0000 7f37f6794640 1 -- 172.21.15.26:0/3390504317 shutdown_connections 2023-10-14T11:14:04.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.933+0000 7f37f6794640 1 --2- 172.21.15.26:0/3390504317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37f006df40 0x7f37f00702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.933+0000 7f37f6794640 1 --2- 172.21.15.26:0/3390504317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37f0070830 0x7f37f00cc350 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.933+0000 7f37f6794640 1 -- 172.21.15.26:0/3390504317 >> 172.21.15.26:0/3390504317 conn(0x7f37f00b0da0 msgr2=0x7f37f00ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:04.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.933+0000 7f37f6794640 1 -- 172.21.15.26:0/3390504317 shutdown_connections 2023-10-14T11:14:04.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.933+0000 7f37f6794640 1 -- 172.21.15.26:0/3390504317 wait complete. 2023-10-14T11:14:04.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.933+0000 7f37f6794640 1 Processor -- start 2023-10-14T11:14:04.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.933+0000 7f37f6794640 1 -- start start 2023-10-14T11:14:04.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37f6794640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37f006df40 0x7f37f00af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:04.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37f6794640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37f0070830 0x7f37f00c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:04.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37f6794640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37f01590d0 0x7f37f00c4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:04.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37f6794640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f00c7150 con 0x7f37f01590d0 2023-10-14T11:14:04.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37f6794640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f00c6540 con 0x7f37f0070830 2023-10-14T11:14:04.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37f6794640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f00c6820 con 0x7f37f006df40 2023-10-14T11:14:04.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37f4d31640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37f01590d0 0x7f37f00c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:04.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37f4d31640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37f01590d0 0x7f37f00c4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35144/0 (socket says 172.21.15.26:35144) 2023-10-14T11:14:04.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37f4d31640 1 -- 172.21.15.26:0/3256350239 learned_addr learned my addr 172.21.15.26:0/3256350239 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:04.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37effff640 1 --2- 172.21.15.26:0/3256350239 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37f006df40 0x7f37f00af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:04.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37ef7fe640 1 --2- 172.21.15.26:0/3256350239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37f0070830 0x7f37f00c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:04.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37f4d31640 1 -- 172.21.15.26:0/3256350239 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37f006df40 msgr2=0x7f37f00af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:04.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37f4d31640 1 --2- 172.21.15.26:0/3256350239 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37f006df40 0x7f37f00af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37f4d31640 1 -- 172.21.15.26:0/3256350239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37f0070830 msgr2=0x7f37f00c3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:04.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37f4d31640 1 --2- 172.21.15.26:0/3256350239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37f0070830 0x7f37f00c3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:04.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37f4d31640 1 -- 172.21.15.26:0/3256350239 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e8009b30 con 0x7f37f01590d0 2023-10-14T11:14:04.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37ef7fe640 1 --2- 172.21.15.26:0/3256350239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37f0070830 0x7f37f00c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:04.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37f4d31640 1 --2- 172.21.15.26:0/3256350239 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37f01590d0 0x7f37f00c4450 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f37e801a640 tx=0x7f37e80197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:04.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37ecff9640 1 -- 172.21.15.26:0/3256350239 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e80a6410 con 0x7f37f01590d0 2023-10-14T11:14:04.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37ecff9640 1 -- 172.21.15.26:0/3256350239 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e80b5070 con 0x7f37f01590d0 2023-10-14T11:14:04.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37f6794640 1 -- 172.21.15.26:0/3256350239 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f00ca820 con 0x7f37f01590d0 2023-10-14T11:14:04.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37ecff9640 1 -- 172.21.15.26:0/3256350239 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e80b18a0 con 0x7f37f01590d0 2023-10-14T11:14:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37f6794640 1 -- 172.21.15.26:0/3256350239 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f00c6de0 con 0x7f37f01590d0 2023-10-14T11:14:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.937+0000 7f37f6794640 1 -- 172.21.15.26:0/3256350239 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f00c72c0 con 0x7f37f01590d0 2023-10-14T11:14:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.941+0000 7f37ecff9640 1 -- 172.21.15.26:0/3256350239 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f37e80b1a00 con 0x7f37f01590d0 2023-10-14T11:14:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.941+0000 7f37ecff9640 1 --2- 172.21.15.26:0/3256350239 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37dc0664a0 0x7f37dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.941+0000 7f37ecff9640 1 -- 172.21.15.26:0/3256350239 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f37e811d8c0 con 0x7f37f01590d0 2023-10-14T11:14:04.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.941+0000 7f37effff640 1 --2- 172.21.15.26:0/3256350239 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37dc0664a0 0x7f37dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:04.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.941+0000 7f37effff640 1 --2- 172.21.15.26:0/3256350239 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37dc0664a0 0x7f37dc068960 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f37e0007fd0 tx=0x7f37e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:04.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:04.945+0000 7f37ecff9640 1 -- 172.21.15.26:0/3256350239 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f37e80eaa70 con 0x7f37f01590d0 2023-10-14T11:14:05.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.101+0000 7f37f6794640 1 -- 172.21.15.26:0/3256350239 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"} v 0) v1 -- 0x7f37f004e170 con 0x7f37f01590d0 2023-10-14T11:14:05.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.101+0000 7f37ecff9640 1 -- 172.21.15.26:0/3256350239 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"}]=0 v42) v1 ==== 105+0+11 (secure 0 0 0) 0x7f37e8009510 con 0x7f37f01590d0 2023-10-14T11:14:05.105 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:14:05.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.101+0000 7f37f6794640 1 -- 172.21.15.26:0/3256350239 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37dc0664a0 msgr2=0x7f37dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:05.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.101+0000 7f37f6794640 1 --2- 172.21.15.26:0/3256350239 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37dc0664a0 0x7f37dc068960 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f37e0007fd0 tx=0x7f37e0009040 comp rx=0 tx=0).stop 2023-10-14T11:14:05.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.101+0000 7f37f6794640 1 -- 172.21.15.26:0/3256350239 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37f01590d0 msgr2=0x7f37f00c4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:05.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.101+0000 7f37f6794640 1 --2- 172.21.15.26:0/3256350239 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37f01590d0 0x7f37f00c4450 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f37e801a640 tx=0x7f37e80197b0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.101+0000 7f37f6794640 1 -- 172.21.15.26:0/3256350239 shutdown_connections 2023-10-14T11:14:05.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.101+0000 7f37f6794640 1 --2- 172.21.15.26:0/3256350239 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37dc0664a0 0x7f37dc068960 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.101+0000 7f37f6794640 1 --2- 172.21.15.26:0/3256350239 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37f01590d0 0x7f37f00c4450 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.101+0000 7f37f6794640 1 --2- 172.21.15.26:0/3256350239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37f0070830 0x7f37f00c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.101+0000 7f37f6794640 1 --2- 172.21.15.26:0/3256350239 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37f006df40 0x7f37f00af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.101+0000 7f37f6794640 1 -- 172.21.15.26:0/3256350239 >> 172.21.15.26:0/3256350239 conn(0x7f37f00b0da0 msgr2=0x7f37f00cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:05.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.105+0000 7f37f6794640 1 -- 172.21.15.26:0/3256350239 shutdown_connections 2023-10-14T11:14:05.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.105+0000 7f37f6794640 1 -- 172.21.15.26:0/3256350239 wait complete. 2023-10-14T11:14:05.126 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-10-14T11:14:05.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.269+0000 7f660a10e640 1 Processor -- start 2023-10-14T11:14:05.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.269+0000 7f660a10e640 1 -- start start 2023-10-14T11:14:05.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.269+0000 7f660a10e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f660415cba0 0x7f66040d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:05.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.269+0000 7f660a10e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66040d0210 0x7f66040b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:05.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.269+0000 7f660a10e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66040d1670 con 0x7f66040b84e0 2023-10-14T11:14:05.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.269+0000 7f660a10e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66040d1460 con 0x7f660415cba0 2023-10-14T11:14:05.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.269+0000 7f660a10e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66040d1950 con 0x7f66040d0210 2023-10-14T11:14:05.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.269+0000 7f66037fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f660415cba0 0x7f66040d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:05.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.269+0000 7f6603fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66040d0210 0x7f66040b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:05.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.269+0000 7f66037fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f660415cba0 0x7f66040d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:34708/0 (socket says 172.21.15.26:34708) 2023-10-14T11:14:05.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.269+0000 7f66037fe640 1 -- 172.21.15.26:0/2750345550 learned_addr learned my addr 172.21.15.26:0/2750345550 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:05.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.269+0000 7f66037fe640 1 -- 172.21.15.26:0/2750345550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66040d0210 msgr2=0x7f66040b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:05.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.269+0000 7f66037fe640 1 --2- 172.21.15.26:0/2750345550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66040d0210 0x7f66040b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.269+0000 7f66037fe640 1 -- 172.21.15.26:0/2750345550 >> v1:172.21.15.110:6789/0 conn(0x7f66040b84e0 legacy=0x7f66040cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.269+0000 7f66037fe640 1 -- 172.21.15.26:0/2750345550 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66040d1c30 con 0x7f660415cba0 2023-10-14T11:14:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.273+0000 7f66037fe640 1 --2- 172.21.15.26:0/2750345550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f660415cba0 0x7f66040d0f20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009870 tx=0x7f65f401c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6021a74582549571 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:05.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.273+0000 7f6602ffd640 1 -- 172.21.15.26:0/2750345550 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f40a9400 con 0x7f660415cba0 2023-10-14T11:14:05.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.273+0000 7f6602ffd640 1 -- 172.21.15.26:0/2750345550 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f40a9560 con 0x7f660415cba0 2023-10-14T11:14:05.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.273+0000 7f6602ffd640 1 -- 172.21.15.26:0/2750345550 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f40a98f0 con 0x7f660415cba0 2023-10-14T11:14:05.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.273+0000 7f660a10e640 1 -- 172.21.15.26:0/2750345550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f660415cba0 msgr2=0x7f66040d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:05.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.273+0000 7f660a10e640 1 --2- 172.21.15.26:0/2750345550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f660415cba0 0x7f66040d0f20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009870 tx=0x7f65f401c540 comp rx=0 tx=0).stop 2023-10-14T11:14:05.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.273+0000 7f660a10e640 1 -- 172.21.15.26:0/2750345550 shutdown_connections 2023-10-14T11:14:05.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.273+0000 7f660a10e640 1 --2- 172.21.15.26:0/2750345550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66040d0210 0x7f66040b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.273+0000 7f660a10e640 1 --2- 172.21.15.26:0/2750345550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f660415cba0 0x7f66040d0f20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.273+0000 7f660a10e640 1 -- 172.21.15.26:0/2750345550 >> 172.21.15.26:0/2750345550 conn(0x7f66040719c0 msgr2=0x7f6604071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:05.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.273+0000 7f660a10e640 1 -- 172.21.15.26:0/2750345550 shutdown_connections 2023-10-14T11:14:05.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.273+0000 7f660a10e640 1 -- 172.21.15.26:0/2750345550 wait complete. 2023-10-14T11:14:05.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f660a10e640 1 Processor -- start 2023-10-14T11:14:05.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f660a10e640 1 -- start start 2023-10-14T11:14:05.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f660a10e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66040b84e0 0x7f66040c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:05.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f660a10e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66040d0210 0x7f660415ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:05.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f660a10e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f660415cba0 0x7f660415d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:05.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f660a10e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660414aad0 con 0x7f660415cba0 2023-10-14T11:14:05.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f660a10e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660415e830 con 0x7f66040d0210 2023-10-14T11:14:05.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f660a10e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660415dc20 con 0x7f66040b84e0 2023-10-14T11:14:05.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f6603fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f660415cba0 0x7f660415d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:05.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f6603fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f660415cba0 0x7f660415d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35160/0 (socket says 172.21.15.26:35160) 2023-10-14T11:14:05.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f66037fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66040b84e0 0x7f66040c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:05.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f6603fff640 1 -- 172.21.15.26:0/785422207 learned_addr learned my addr 172.21.15.26:0/785422207 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:05.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f65fbfff640 1 --2- 172.21.15.26:0/785422207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66040d0210 0x7f660415ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:05.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f6603fff640 1 -- 172.21.15.26:0/785422207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66040b84e0 msgr2=0x7f66040c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:05.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f6603fff640 1 --2- 172.21.15.26:0/785422207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66040b84e0 0x7f66040c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f6603fff640 1 -- 172.21.15.26:0/785422207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66040d0210 msgr2=0x7f660415ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:05.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f6603fff640 1 --2- 172.21.15.26:0/785422207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66040d0210 0x7f660415ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f6603fff640 1 -- 172.21.15.26:0/785422207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f40094d0 con 0x7f660415cba0 2023-10-14T11:14:05.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f6603fff640 1 --2- 172.21.15.26:0/785422207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f660415cba0 0x7f660415d280 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00efc0 tx=0x7f65fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:05.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f6600ff9640 1 -- 172.21.15.26:0/785422207 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc009ca0 con 0x7f660415cba0 2023-10-14T11:14:05.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f6600ff9640 1 -- 172.21.15.26:0/785422207 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65fc00f040 con 0x7f660415cba0 2023-10-14T11:14:05.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f6600ff9640 1 -- 172.21.15.26:0/785422207 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0146c0 con 0x7f660415cba0 2023-10-14T11:14:05.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.277+0000 7f660a10e640 1 -- 172.21.15.26:0/785422207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660415df00 con 0x7f660415cba0 2023-10-14T11:14:05.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.281+0000 7f660a10e640 1 -- 172.21.15.26:0/785422207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660415e4c0 con 0x7f660415cba0 2023-10-14T11:14:05.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.281+0000 7f660a10e640 1 -- 172.21.15.26:0/785422207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660415e9c0 con 0x7f660415cba0 2023-10-14T11:14:05.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.281+0000 7f6600ff9640 1 -- 172.21.15.26:0/785422207 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f65fc014820 con 0x7f660415cba0 2023-10-14T11:14:05.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.281+0000 7f6600ff9640 1 --2- 172.21.15.26:0/785422207 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f65e40664a0 0x7f65e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:05.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.281+0000 7f6600ff9640 1 -- 172.21.15.26:0/785422207 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f65fc084f40 con 0x7f660415cba0 2023-10-14T11:14:05.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.281+0000 7f66037fe640 1 --2- 172.21.15.26:0/785422207 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f65e40664a0 0x7f65e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:05.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.281+0000 7f66037fe640 1 --2- 172.21.15.26:0/785422207 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f65e40664a0 0x7f65e4068960 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f65f40ae000 tx=0x7f65f40b3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:05.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.285+0000 7f6600ff9640 1 -- 172.21.15.26:0/785422207 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f65fc052210 con 0x7f660415cba0 2023-10-14T11:14:05.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.441+0000 7f660a10e640 1 -- 172.21.15.26:0/785422207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f660404e170 con 0x7f660415cba0 2023-10-14T11:14:05.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.445+0000 7f6600ff9640 1 -- 172.21.15.26:0/785422207 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v42) v1 ==== 97+0+11 (secure 0 0 0) 0x7f65fc0180a0 con 0x7f660415cba0 2023-10-14T11:14:05.448 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:14:05.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.445+0000 7f660a10e640 1 -- 172.21.15.26:0/785422207 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f65e40664a0 msgr2=0x7f65e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:05.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.445+0000 7f660a10e640 1 --2- 172.21.15.26:0/785422207 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f65e40664a0 0x7f65e4068960 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f65f40ae000 tx=0x7f65f40b3040 comp rx=0 tx=0).stop 2023-10-14T11:14:05.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.445+0000 7f660a10e640 1 -- 172.21.15.26:0/785422207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f660415cba0 msgr2=0x7f660415d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:05.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.445+0000 7f660a10e640 1 --2- 172.21.15.26:0/785422207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f660415cba0 0x7f660415d280 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00efc0 tx=0x7f65fc00c490 comp rx=0 tx=0).stop 2023-10-14T11:14:05.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.445+0000 7f660a10e640 1 -- 172.21.15.26:0/785422207 shutdown_connections 2023-10-14T11:14:05.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.445+0000 7f660a10e640 1 --2- 172.21.15.26:0/785422207 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f65e40664a0 0x7f65e4068960 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.445+0000 7f660a10e640 1 --2- 172.21.15.26:0/785422207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f660415cba0 0x7f660415d280 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.445+0000 7f660a10e640 1 --2- 172.21.15.26:0/785422207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66040d0210 0x7f660415ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.445+0000 7f660a10e640 1 --2- 172.21.15.26:0/785422207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66040b84e0 0x7f66040c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.445+0000 7f660a10e640 1 -- 172.21.15.26:0/785422207 >> 172.21.15.26:0/785422207 conn(0x7f66040719c0 msgr2=0x7f660406b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:05.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.445+0000 7f660a10e640 1 -- 172.21.15.26:0/785422207 shutdown_connections 2023-10-14T11:14:05.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.445+0000 7f660a10e640 1 -- 172.21.15.26:0/785422207 wait complete. 2023-10-14T11:14:05.469 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:14:05.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff1359e640 1 Processor -- start 2023-10-14T11:14:05.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff1359e640 1 -- start start 2023-10-14T11:14:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff1359e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff1415c910 0x7eff140d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff1359e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7eff140d3170 0x7eff140cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff1359e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff140ce730 con 0x7eff140cefe0 2023-10-14T11:14:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff1359e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff140d17a0 con 0x7eff140d3170 2023-10-14T11:14:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff1359e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff140d0dd0 con 0x7eff1415c910 2023-10-14T11:14:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff12d9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7eff140cefe0 0x7eff1406b050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33334/0 (socket says 172.21.15.26:33334) 2023-10-14T11:14:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff12d9d640 1 -- 172.21.15.26:0/1395343821 learned_addr learned my addr 172.21.15.26:0/1395343821 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:05.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff1259c640 1 --2- 172.21.15.26:0/1395343821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff1415c910 0x7eff140d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff0bfff640 1 --2- 172.21.15.26:0/1395343821 >> v2:172.21.15.110:3300/0 conn(0x7eff140d3170 0x7eff140cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff11d9b640 1 -- 172.21.15.26:0/1395343821 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745960159 0 0) 0x7eff140ce730 con 0x7eff140cefe0 2023-10-14T11:14:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff11d9b640 1 -- 172.21.15.26:0/1395343821 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff00003530 con 0x7eff140cefe0 2023-10-14T11:14:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff11d9b640 1 -- 172.21.15.26:0/1395343821 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 596829086 0 0) 0x7eff00003530 con 0x7eff140cefe0 2023-10-14T11:14:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff11d9b640 1 -- 172.21.15.26:0/1395343821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff1415c910 msgr2=0x7eff140d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:05.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff11d9b640 1 --2- 172.21.15.26:0/1395343821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff1415c910 0x7eff140d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff11d9b640 1 -- 172.21.15.26:0/1395343821 >> v2:172.21.15.110:3300/0 conn(0x7eff140d3170 msgr2=0x7eff140cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:05.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff11d9b640 1 --2- 172.21.15.26:0/1395343821 >> v2:172.21.15.110:3300/0 conn(0x7eff140d3170 0x7eff140cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff11d9b640 1 -- 172.21.15.26:0/1395343821 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff140d04a0 con 0x7eff140cefe0 2023-10-14T11:14:05.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff11d9b640 1 -- 172.21.15.26:0/1395343821 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7eff0c001a00 con 0x7eff140cefe0 2023-10-14T11:14:05.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff11d9b640 1 -- 172.21.15.26:0/1395343821 >> v1:172.21.15.26:6789/0 conn(0x7eff140cefe0 legacy=0x7eff1406b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:05.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff11d9b640 1 --2- 172.21.15.26:0/1395343821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff00003a60 0x7eff00003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:05.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff11d9b640 1 --2- 172.21.15.26:0/1395343821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff1415c910 0x7eff000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:05.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff11d9b640 1 --2- 172.21.15.26:0/1395343821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff00004d10 0x7eff00005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:05.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff11d9b640 1 -- 172.21.15.26:0/1395343821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff140d17a0 con 0x7eff00003a60 2023-10-14T11:14:05.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff11d9b640 1 -- 172.21.15.26:0/1395343821 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff140d0dd0 con 0x7eff00004d10 2023-10-14T11:14:05.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.609+0000 7eff11d9b640 1 -- 172.21.15.26:0/1395343821 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0000ba60 con 0x7eff1415c910 2023-10-14T11:14:05.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.613+0000 7eff1259c640 1 --2- 172.21.15.26:0/1395343821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff00003a60 0x7eff00003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:05.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.613+0000 7eff12d9d640 1 --2- 172.21.15.26:0/1395343821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff00004d10 0x7eff00005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:05.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.613+0000 7eff0bfff640 1 --2- 172.21.15.26:0/1395343821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff1415c910 0x7eff000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:05.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.613+0000 7eff1259c640 1 -- 172.21.15.26:0/1395343821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff1415c910 msgr2=0x7eff000047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:05.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.613+0000 7eff1259c640 1 --2- 172.21.15.26:0/1395343821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff1415c910 0x7eff000047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.613+0000 7eff1259c640 1 -- 172.21.15.26:0/1395343821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff00004d10 msgr2=0x7eff00005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:05.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.613+0000 7eff1259c640 1 --2- 172.21.15.26:0/1395343821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff00004d10 0x7eff00005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.613+0000 7eff1259c640 1 -- 172.21.15.26:0/1395343821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff00003530 con 0x7eff00003a60 2023-10-14T11:14:05.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.613+0000 7eff1259c640 1 --2- 172.21.15.26:0/1395343821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff00003a60 0x7eff00003e80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7eff04009ac0 tx=0x7eff0401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832cba304e36b3f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:05.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.613+0000 7eff11d9b640 1 -- 172.21.15.26:0/1395343821 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff040059a0 con 0x7eff00003a60 2023-10-14T11:14:05.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.613+0000 7eff11d9b640 1 -- 172.21.15.26:0/1395343821 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff04005b00 con 0x7eff00003a60 2023-10-14T11:14:05.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.613+0000 7eff11d9b640 1 -- 172.21.15.26:0/1395343821 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff04006030 con 0x7eff00003a60 2023-10-14T11:14:05.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff1359e640 1 -- 172.21.15.26:0/1395343821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff00003a60 msgr2=0x7eff00003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:05.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff1359e640 1 --2- 172.21.15.26:0/1395343821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff00003a60 0x7eff00003e80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7eff04009ac0 tx=0x7eff0401c940 comp rx=0 tx=0).stop 2023-10-14T11:14:05.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff12d9d640 1 -- 172.21.15.26:0/1395343821 reap_dead start 2023-10-14T11:14:05.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff1359e640 1 -- 172.21.15.26:0/1395343821 shutdown_connections 2023-10-14T11:14:05.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff1359e640 1 -- 172.21.15.26:0/1395343821 >> 172.21.15.26:0/1395343821 conn(0x7eff1409bb50 msgr2=0x7eff140d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:05.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff1359e640 1 -- 172.21.15.26:0/1395343821 shutdown_connections 2023-10-14T11:14:05.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff1359e640 1 -- 172.21.15.26:0/1395343821 wait complete. 2023-10-14T11:14:05.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff1359e640 1 Processor -- start 2023-10-14T11:14:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff1359e640 1 -- start start 2023-10-14T11:14:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff1359e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff00003a60 0x7eff140cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff1359e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff14158480 0x7eff14158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff1359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff14165b80 0x7eff14166030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff1359e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff14158e40 con 0x7eff14165b80 2023-10-14T11:14:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff1359e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff141668f0 con 0x7eff14158480 2023-10-14T11:14:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff1359e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff140b5dc0 con 0x7eff00003a60 2023-10-14T11:14:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff12d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff14165b80 0x7eff14166030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff12d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff14165b80 0x7eff14166030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35180/0 (socket says 172.21.15.26:35180) 2023-10-14T11:14:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff12d9d640 1 -- 172.21.15.26:0/4092935989 learned_addr learned my addr 172.21.15.26:0/4092935989 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:05.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff1259c640 1 --2- 172.21.15.26:0/4092935989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff00003a60 0x7eff140cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:05.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff0bfff640 1 --2- 172.21.15.26:0/4092935989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff14158480 0x7eff14158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:05.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff12d9d640 1 -- 172.21.15.26:0/4092935989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff00003a60 msgr2=0x7eff140cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:05.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff12d9d640 1 --2- 172.21.15.26:0/4092935989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff00003a60 0x7eff140cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff12d9d640 1 -- 172.21.15.26:0/4092935989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff14158480 msgr2=0x7eff14158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:05.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff12d9d640 1 --2- 172.21.15.26:0/4092935989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff14158480 0x7eff14158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff12d9d640 1 -- 172.21.15.26:0/4092935989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff140b60a0 con 0x7eff14165b80 2023-10-14T11:14:05.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.617+0000 7eff12d9d640 1 --2- 172.21.15.26:0/4092935989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff14165b80 0x7eff14166030 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7eff1408b8d0 tx=0x7eff0c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:05.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.621+0000 7eff0affd640 1 -- 172.21.15.26:0/4092935989 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c00ab60 con 0x7eff14165b80 2023-10-14T11:14:05.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.621+0000 7eff0affd640 1 -- 172.21.15.26:0/4092935989 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c00ad00 con 0x7eff14165b80 2023-10-14T11:14:05.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.621+0000 7eff0affd640 1 -- 172.21.15.26:0/4092935989 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c013630 con 0x7eff14165b80 2023-10-14T11:14:05.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.621+0000 7eff1359e640 1 -- 172.21.15.26:0/4092935989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff140b6380 con 0x7eff14165b80 2023-10-14T11:14:05.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.621+0000 7eff1359e640 1 -- 172.21.15.26:0/4092935989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff14166570 con 0x7eff14165b80 2023-10-14T11:14:05.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.621+0000 7eff1359e640 1 -- 172.21.15.26:0/4092935989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1404e9c0 con 0x7eff14165b80 2023-10-14T11:14:05.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.621+0000 7eff0affd640 1 -- 172.21.15.26:0/4092935989 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7eff0c013790 con 0x7eff14165b80 2023-10-14T11:14:05.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.621+0000 7eff0affd640 1 --2- 172.21.15.26:0/4092935989 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efef40664a0 0x7efef4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:05.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.621+0000 7eff0affd640 1 -- 172.21.15.26:0/4092935989 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7eff0c0846c0 con 0x7eff14165b80 2023-10-14T11:14:05.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.621+0000 7eff1259c640 1 --2- 172.21.15.26:0/4092935989 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efef40664a0 0x7efef4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:05.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.625+0000 7eff1259c640 1 --2- 172.21.15.26:0/4092935989 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efef40664a0 0x7efef4068960 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7eff040ab000 tx=0x7eff040046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:05.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.625+0000 7eff0affd640 1 -- 172.21.15.26:0/4092935989 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7eff0c051840 con 0x7eff14165b80 2023-10-14T11:14:05.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.793+0000 7eff1359e640 1 -- 172.21.15.26:0/4092935989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7eff140cfe20 con 0x7eff14165b80 2023-10-14T11:14:05.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.797+0000 7eff0affd640 1 -- 172.21.15.26:0/4092935989 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7eff0c054e60 con 0x7eff14165b80 2023-10-14T11:14:05.799 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-10-14T11:14:05.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.797+0000 7eff1359e640 1 -- 172.21.15.26:0/4092935989 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efef40664a0 msgr2=0x7efef4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:05.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.797+0000 7eff1359e640 1 --2- 172.21.15.26:0/4092935989 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efef40664a0 0x7efef4068960 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7eff040ab000 tx=0x7eff040046d0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.797+0000 7eff1359e640 1 -- 172.21.15.26:0/4092935989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff14165b80 msgr2=0x7eff14166030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:05.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.797+0000 7eff1359e640 1 --2- 172.21.15.26:0/4092935989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff14165b80 0x7eff14166030 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7eff1408b8d0 tx=0x7eff0c007a40 comp rx=0 tx=0).stop 2023-10-14T11:14:05.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.797+0000 7eff1359e640 1 -- 172.21.15.26:0/4092935989 shutdown_connections 2023-10-14T11:14:05.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.797+0000 7eff1359e640 1 --2- 172.21.15.26:0/4092935989 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efef40664a0 0x7efef4068960 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.797+0000 7eff1359e640 1 --2- 172.21.15.26:0/4092935989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff14165b80 0x7eff14166030 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.797+0000 7eff1359e640 1 --2- 172.21.15.26:0/4092935989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff14158480 0x7eff14158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.797+0000 7eff1359e640 1 --2- 172.21.15.26:0/4092935989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff00003a60 0x7eff140cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:05.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.797+0000 7eff1359e640 1 -- 172.21.15.26:0/4092935989 >> 172.21.15.26:0/4092935989 conn(0x7eff1409bb50 msgr2=0x7eff1415bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:05.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.797+0000 7eff1359e640 1 -- 172.21.15.26:0/4092935989 shutdown_connections 2023-10-14T11:14:05.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:05.797+0000 7eff1359e640 1 -- 172.21.15.26:0/4092935989 wait complete. 2023-10-14T11:14:05.820 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi026.front.sepia.ceph.com... 2023-10-14T11:14:05.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:05.821 DEBUG:teuthology.orchestra.run.smithi026:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-14T11:14:05.840 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[48259]: fuse finished with error 0 and tester_r 0 2023-10-14T11:14:05.844 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:14:05.903 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T11:14:05.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:05.905 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T11:14:05.915 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T11:14:06.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.101+0000 7efc88c6b640 1 Processor -- start 2023-10-14T11:14:06.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.101+0000 7efc88c6b640 1 -- start start 2023-10-14T11:14:06.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.101+0000 7efc88c6b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc8415ca70 0x7efc840d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:06.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.101+0000 7efc88c6b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efc840cf7a0 0x7efc840c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:06.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.101+0000 7efc88c6b640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc840c65f0 con 0x7efc840d3550 2023-10-14T11:14:06.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.101+0000 7efc88c6b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc840ce820 con 0x7efc840cf7a0 2023-10-14T11:14:06.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.101+0000 7efc88c6b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc840cdf80 con 0x7efc8415ca70 2023-10-14T11:14:06.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.105+0000 7efc82d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efc840cf7a0 0x7efc840c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:06.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.105+0000 7efc7bfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efc840d3550 0x7efc840cf090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33350/0 (socket says 172.21.15.26:33350) 2023-10-14T11:14:06.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.105+0000 7efc7bfff640 1 -- 172.21.15.26:0/2155023746 learned_addr learned my addr 172.21.15.26:0/2155023746 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:06.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.105+0000 7efc8259c640 1 --2- 172.21.15.26:0/2155023746 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc8415ca70 0x7efc840d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:06.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.105+0000 7efc82d9d640 1 -- 172.21.15.26:0/2155023746 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc8415ca70 msgr2=0x7efc840d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:06.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.105+0000 7efc82d9d640 1 --2- 172.21.15.26:0/2155023746 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc8415ca70 0x7efc840d3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:06.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.105+0000 7efc82d9d640 1 -- 172.21.15.26:0/2155023746 >> v1:172.21.15.26:6789/0 conn(0x7efc840d3550 legacy=0x7efc840cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:06.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.105+0000 7efc82d9d640 1 -- 172.21.15.26:0/2155023746 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc840ce260 con 0x7efc840cf7a0 2023-10-14T11:14:06.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.105+0000 7efc81d9b640 1 -- 172.21.15.26:0/2155023746 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315557032 0 0) 0x7efc840c65f0 con 0x7efc840d3550 2023-10-14T11:14:06.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.105+0000 7efc82d9d640 1 --2- 172.21.15.26:0/2155023746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc840cf7a0 0x7efc840c6ad0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009d90 tx=0x7efc7c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8052e59b839ebe8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:06.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.105+0000 7efc81d9b640 1 -- 172.21.15.26:0/2155023746 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c0a5940 con 0x7efc840cf7a0 2023-10-14T11:14:06.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.105+0000 7efc81d9b640 1 -- 172.21.15.26:0/2155023746 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c0a5aa0 con 0x7efc840cf7a0 2023-10-14T11:14:06.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.105+0000 7efc81d9b640 1 -- 172.21.15.26:0/2155023746 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c0a5e30 con 0x7efc840cf7a0 2023-10-14T11:14:06.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.109+0000 7efc88c6b640 1 -- 172.21.15.26:0/2155023746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc840cf7a0 msgr2=0x7efc840c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:06.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.109+0000 7efc88c6b640 1 --2- 172.21.15.26:0/2155023746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc840cf7a0 0x7efc840c6ad0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009d90 tx=0x7efc7c01c920 comp rx=0 tx=0).stop 2023-10-14T11:14:06.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.109+0000 7efc88c6b640 1 -- 172.21.15.26:0/2155023746 shutdown_connections 2023-10-14T11:14:06.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.109+0000 7efc88c6b640 1 --2- 172.21.15.26:0/2155023746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc840cf7a0 0x7efc840c6ad0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:06.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.109+0000 7efc88c6b640 1 --2- 172.21.15.26:0/2155023746 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc8415ca70 0x7efc840d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:06.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.109+0000 7efc88c6b640 1 -- 172.21.15.26:0/2155023746 >> 172.21.15.26:0/2155023746 conn(0x7efc8409bc50 msgr2=0x7efc840d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:06.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.109+0000 7efc88c6b640 1 -- 172.21.15.26:0/2155023746 shutdown_connections 2023-10-14T11:14:06.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.109+0000 7efc88c6b640 1 -- 172.21.15.26:0/2155023746 wait complete. 2023-10-14T11:14:06.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.109+0000 7efc88c6b640 1 Processor -- start 2023-10-14T11:14:06.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.109+0000 7efc88c6b640 1 -- start start 2023-10-14T11:14:06.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.109+0000 7efc88c6b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc840cf7a0 0x7efc8414fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:06.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.109+0000 7efc88c6b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc840d3550 0x7efc8415d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:06.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.109+0000 7efc88c6b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc8415ca70 0x7efc840cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:06.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.109+0000 7efc88c6b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc840cc860 con 0x7efc840d3550 2023-10-14T11:14:06.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.109+0000 7efc88c6b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8415d870 con 0x7efc8415ca70 2023-10-14T11:14:06.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.109+0000 7efc88c6b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8415db50 con 0x7efc840cf7a0 2023-10-14T11:14:06.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.109+0000 7efc7bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc840d3550 0x7efc8415d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:06.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.109+0000 7efc7bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc840d3550 0x7efc8415d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35186/0 (socket says 172.21.15.26:35186) 2023-10-14T11:14:06.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.109+0000 7efc7bfff640 1 -- 172.21.15.26:0/3436398225 learned_addr learned my addr 172.21.15.26:0/3436398225 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:06.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.109+0000 7efc8259c640 1 --2- 172.21.15.26:0/3436398225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc840cf7a0 0x7efc8414fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:06.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.109+0000 7efc82d9d640 1 --2- 172.21.15.26:0/3436398225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc8415ca70 0x7efc840cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:06.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.113+0000 7efc7bfff640 1 -- 172.21.15.26:0/3436398225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc840cf7a0 msgr2=0x7efc8414fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:06.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.113+0000 7efc7bfff640 1 --2- 172.21.15.26:0/3436398225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc840cf7a0 0x7efc8414fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:06.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.113+0000 7efc7bfff640 1 -- 172.21.15.26:0/3436398225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc8415ca70 msgr2=0x7efc840cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:06.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.113+0000 7efc7bfff640 1 --2- 172.21.15.26:0/3436398225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc8415ca70 0x7efc840cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:06.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.113+0000 7efc7bfff640 1 -- 172.21.15.26:0/3436398225 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7c009a70 con 0x7efc840d3550 2023-10-14T11:14:06.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.113+0000 7efc7bfff640 1 --2- 172.21.15.26:0/3436398225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc840d3550 0x7efc8415d170 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0011f0 tx=0x7efc6c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:06.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.113+0000 7efc7affd640 1 -- 172.21.15.26:0/3436398225 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c0074e0 con 0x7efc840d3550 2023-10-14T11:14:06.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.113+0000 7efc7affd640 1 -- 172.21.15.26:0/3436398225 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6c007640 con 0x7efc840d3550 2023-10-14T11:14:06.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.113+0000 7efc7affd640 1 -- 172.21.15.26:0/3436398225 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c004a10 con 0x7efc840d3550 2023-10-14T11:14:06.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.113+0000 7efc88c6b640 1 -- 172.21.15.26:0/3436398225 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc841f4a10 con 0x7efc840d3550 2023-10-14T11:14:06.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.113+0000 7efc88c6b640 1 -- 172.21.15.26:0/3436398225 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc8415de30 con 0x7efc840d3550 2023-10-14T11:14:06.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.113+0000 7efc88c6b640 1 -- 172.21.15.26:0/3436398225 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc84074010 con 0x7efc840d3550 2023-10-14T11:14:06.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.113+0000 7efc7affd640 1 -- 172.21.15.26:0/3436398225 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efc6c004b70 con 0x7efc840d3550 2023-10-14T11:14:06.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.117+0000 7efc7affd640 1 --2- 172.21.15.26:0/3436398225 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efc640664d0 0x7efc64068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:06.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.117+0000 7efc7affd640 1 -- 172.21.15.26:0/3436398225 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7efc6c0832d0 con 0x7efc840d3550 2023-10-14T11:14:06.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.117+0000 7efc8259c640 1 --2- 172.21.15.26:0/3436398225 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efc640664d0 0x7efc64068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:06.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.117+0000 7efc8259c640 1 --2- 172.21.15.26:0/3436398225 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efc640664d0 0x7efc64068990 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efc8406c6a0 tx=0x7efc74006f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:06.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.121+0000 7efc7affd640 1 -- 172.21.15.26:0/3436398225 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efc6c050470 con 0x7efc840d3550 2023-10-14T11:14:06.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.313+0000 7efc88c6b640 1 -- 172.21.15.26:0/3436398225 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efc8408c950 con 0x7efc840d3550 2023-10-14T11:14:06.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.313+0000 7efc7affd640 1 -- 172.21.15.26:0/3436398225 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+97 (secure 0 0 0) 0x7efc6c053a90 con 0x7efc840d3550 2023-10-14T11:14:06.318 INFO:teuthology.orchestra.run.smithi026.stdout:name: testcephfs1, metadata pool: testcephfs1_metadata, data pools: [testcephfs1_data data_new ] 2023-10-14T11:14:06.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.317+0000 7efc88c6b640 1 -- 172.21.15.26:0/3436398225 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efc640664d0 msgr2=0x7efc64068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:06.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.317+0000 7efc88c6b640 1 --2- 172.21.15.26:0/3436398225 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efc640664d0 0x7efc64068990 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efc8406c6a0 tx=0x7efc74006f90 comp rx=0 tx=0).stop 2023-10-14T11:14:06.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.317+0000 7efc88c6b640 1 -- 172.21.15.26:0/3436398225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc840d3550 msgr2=0x7efc8415d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:06.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.317+0000 7efc88c6b640 1 --2- 172.21.15.26:0/3436398225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc840d3550 0x7efc8415d170 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0011f0 tx=0x7efc6c00c9b0 comp rx=0 tx=0).stop 2023-10-14T11:14:06.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.317+0000 7efc88c6b640 1 -- 172.21.15.26:0/3436398225 shutdown_connections 2023-10-14T11:14:06.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.317+0000 7efc88c6b640 1 --2- 172.21.15.26:0/3436398225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc8415ca70 0x7efc840cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:06.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.317+0000 7efc88c6b640 1 --2- 172.21.15.26:0/3436398225 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efc640664d0 0x7efc64068990 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:06.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.317+0000 7efc88c6b640 1 --2- 172.21.15.26:0/3436398225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc840d3550 0x7efc8415d170 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:06.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.317+0000 7efc88c6b640 1 --2- 172.21.15.26:0/3436398225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc840cf7a0 0x7efc8414fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:06.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.317+0000 7efc88c6b640 1 -- 172.21.15.26:0/3436398225 >> 172.21.15.26:0/3436398225 conn(0x7efc8409bc50 msgr2=0x7efc8406c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:06.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.317+0000 7efc88c6b640 1 -- 172.21.15.26:0/3436398225 shutdown_connections 2023-10-14T11:14:06.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:06.317+0000 7efc88c6b640 1 -- 172.21.15.26:0/3436398225 wait complete. 2023-10-14T11:14:06.340 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T11:14:06.340 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T11:14:06.341 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-14T11:14:06.341 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T11:14:06.341 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T11:14:06.342 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T11:14:06.342 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T11:14:06.342 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T11:14:06.343 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:14:06.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:06.344 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-14T11:14:06.355 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:14:06.355 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:14:06.355 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:14:06.356 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:06.356 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-14T11:14:06.356 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:06.356 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:14:06.356 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-14T11:14:06.357 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-14T11:14:06.357 INFO:teuthology.orchestra.run.smithi026.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T11:14:06.357 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:14:06.357 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-14T11:14:06.357 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-14T11:14:06.358 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42331sec preferred_lft 42331sec 2023-10-14T11:14:06.358 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-14T11:14:06.358 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:06.358 INFO:teuthology.orchestra.run.smithi026.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:14:06.358 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-14T11:14:06.359 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-14T11:14:06.359 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:14:06.359 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:14:06.359 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-14T11:14:06.359 INFO:teuthology.orchestra.run.smithi026.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-14T11:14:06.360 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 02:42:e1:29:12:f0 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:14:06.360 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-14T11:14:06.360 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:06.360 INFO:teuthology.orchestra.run.smithi026.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T11:14:06.360 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-14T11:14:06.361 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T11:14:06.361 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:06.361 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-14T11:14:06.361 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:06.361 INFO:teuthology.orchestra.run.smithi026.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T11:14:06.362 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:14:06.362 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-14T11:14:06.362 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:06.362 INFO:teuthology.orchestra.run.smithi026.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T11:14:06.362 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:14:06.363 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-14T11:14:06.363 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:06.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:06.365 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T11:14:06.418 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-14T11:14:06.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:06.420 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-14T11:14:06.477 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-14T11:14:06.477 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T11:14:06.477 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-14T11:14:06.477 INFO:teuthology.orchestra.run.smithi026.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-14T11:14:06.478 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-14T11:14:06.478 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T11:14:06.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:06.479 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-14T11:14:06.479 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-14T11:14:06.479 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T11:14:06.480 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T11:14:06.480 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T11:14:06.480 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-14T11:14:06.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:06.575 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-14T11:14:06.584 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T11:14:06.585 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T11:14:06.585 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:14:06.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:06.586 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-10-14T11:14:06.647 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-14T11:14:06.648 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:14:06.648 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T11:14:06.699 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:14:06.699 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:14:06.700 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T11:14:06.754 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-10-14T11:14:06.820 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:14:06.877 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2023-10-14T11:14:06.877 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2023-10-14T11:14:06.877 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2023-10-14T11:14:06.878 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2023-10-14T11:14:06.878 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2023-10-14T11:14:06.878 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2023-10-14T11:14:06.878 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2023-10-14T11:14:06.878 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2023-10-14T11:14:06.879 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2023-10-14T11:14:06.879 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2023-10-14T11:14:06.879 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2023-10-14T11:14:06.879 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2023-10-14T11:14:06.879 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:14:06.880 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2023-10-14T11:14:06.880 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2023-10-14T11:14:06.880 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2023-10-14T11:14:06.880 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2023-10-14T11:14:06.880 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2023-10-14T11:14:06.881 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2023-10-14T11:14:06.881 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2023-10-14T11:14:06.881 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:14:06.881 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2023-10-14T11:14:06.881 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2023-10-14T11:14:06.882 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2023-10-14T11:14:06.882 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T11:14:06.882 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T11:14:06.882 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T11:14:06.882 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T11:14:06.882 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2023-10-14T11:14:06.883 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:14:06.883 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:14:06.883 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:14:06.883 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:14:06.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:06.885 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-10-14T11:14:06.935 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-14T11:14:06.935 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-14T11:14:06.982 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-10-14T11:14:07.004 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:14:07.061 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2023-10-14T11:14:07.061 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2023-10-14T11:14:07.061 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2023-10-14T11:14:07.061 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2023-10-14T11:14:07.062 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2023-10-14T11:14:07.062 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2023-10-14T11:14:07.062 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2023-10-14T11:14:07.062 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2023-10-14T11:14:07.062 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2023-10-14T11:14:07.063 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2023-10-14T11:14:07.063 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2023-10-14T11:14:07.063 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2023-10-14T11:14:07.063 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:14:07.063 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2023-10-14T11:14:07.064 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2023-10-14T11:14:07.064 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2023-10-14T11:14:07.064 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2023-10-14T11:14:07.064 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2023-10-14T11:14:07.064 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2023-10-14T11:14:07.065 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2023-10-14T11:14:07.065 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:14:07.065 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2023-10-14T11:14:07.065 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2023-10-14T11:14:07.065 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2023-10-14T11:14:07.066 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T11:14:07.066 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T11:14:07.066 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T11:14:07.066 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T11:14:07.066 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2023-10-14T11:14:07.067 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:14:07.067 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:14:07.067 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:14:07.067 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:14:07.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:07.069 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-10-14T11:14:07.080 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:2023-10-14T11:14:07.077+0000 7f6b221d0580 -1 init, newargv = 0x55b34a0afbe0 newargc=15 2023-10-14T11:14:07.080 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[48817]: starting ceph client 2023-10-14T11:14:07.087 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[48817]: starting fuse 2023-10-14T11:14:07.089 INFO:teuthology.orchestra.run.smithi026.stdout:43 2023-10-14T11:14:07.089 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-10-14T11:14:07.090 DEBUG:teuthology.orchestra.run.smithi026:> sudo stdin-killer -- python3 -c ' 2023-10-14T11:14:07.090 DEBUG:teuthology.orchestra.run.smithi026:> import glob 2023-10-14T11:14:07.090 DEBUG:teuthology.orchestra.run.smithi026:> import re 2023-10-14T11:14:07.091 DEBUG:teuthology.orchestra.run.smithi026:> import os 2023-10-14T11:14:07.091 DEBUG:teuthology.orchestra.run.smithi026:> import subprocess 2023-10-14T11:14:07.091 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:14:07.092 DEBUG:teuthology.orchestra.run.smithi026:> def _find_admin_socket(client_name): 2023-10-14T11:14:07.092 DEBUG:teuthology.orchestra.run.smithi026:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-14T11:14:07.093 DEBUG:teuthology.orchestra.run.smithi026:> files = glob.glob(asok_path) 2023-10-14T11:14:07.093 DEBUG:teuthology.orchestra.run.smithi026:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-14T11:14:07.093 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:14:07.094 DEBUG:teuthology.orchestra.run.smithi026:> # Given a non-glob path, it better be there 2023-10-14T11:14:07.094 DEBUG:teuthology.orchestra.run.smithi026:> if "*" not in asok_path: 2023-10-14T11:14:07.094 DEBUG:teuthology.orchestra.run.smithi026:> assert(len(files) == 1) 2023-10-14T11:14:07.095 DEBUG:teuthology.orchestra.run.smithi026:> return files[0] 2023-10-14T11:14:07.095 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:14:07.095 DEBUG:teuthology.orchestra.run.smithi026:> for f in files: 2023-10-14T11:14:07.096 DEBUG:teuthology.orchestra.run.smithi026:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-14T11:14:07.096 DEBUG:teuthology.orchestra.run.smithi026:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-14T11:14:07.096 DEBUG:teuthology.orchestra.run.smithi026:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-14T11:14:07.097 DEBUG:teuthology.orchestra.run.smithi026:> contents = proc_f.read() 2023-10-14T11:14:07.097 DEBUG:teuthology.orchestra.run.smithi026:> if mountpoint in contents: 2023-10-14T11:14:07.098 DEBUG:teuthology.orchestra.run.smithi026:> return f 2023-10-14T11:14:07.098 DEBUG:teuthology.orchestra.run.smithi026:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-14T11:14:07.098 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:14:07.099 DEBUG:teuthology.orchestra.run.smithi026:> print(_find_admin_socket("client.0")) 2023-10-14T11:14:07.099 DEBUG:teuthology.orchestra.run.smithi026:> ' 2023-10-14T11:14:07.214 INFO:teuthology.orchestra.run.smithi026.stdout:/var/run/ceph/ceph-client.0.48817.asok 2023-10-14T11:14:07.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-14T11:14:07.226 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48817.asok 2023-10-14T11:14:07.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:07.227 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48817.asok status 2023-10-14T11:14:07.405 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:14:07.406 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": { 2023-10-14T11:14:07.406 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-14T11:14:07.406 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T11:14:07.407 INFO:teuthology.orchestra.run.smithi026.stdout: "entity_id": "0", 2023-10-14T11:14:07.407 INFO:teuthology.orchestra.run.smithi026.stdout: "hostname": "smithi026", 2023-10-14T11:14:07.407 INFO:teuthology.orchestra.run.smithi026.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-14T11:14:07.407 INFO:teuthology.orchestra.run.smithi026.stdout: "pid": "48817", 2023-10-14T11:14:07.407 INFO:teuthology.orchestra.run.smithi026.stdout: "root": "/" 2023-10-14T11:14:07.408 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:07.408 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_count": 0, 2023-10-14T11:14:07.408 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_pinned_count": 0, 2023-10-14T11:14:07.408 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 5808, 2023-10-14T11:14:07.408 INFO:teuthology.orchestra.run.smithi026.stdout: "inst": { 2023-10-14T11:14:07.409 INFO:teuthology.orchestra.run.smithi026.stdout: "name": { 2023-10-14T11:14:07.409 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "client", 2023-10-14T11:14:07.409 INFO:teuthology.orchestra.run.smithi026.stdout: "num": 5808 2023-10-14T11:14:07.409 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:07.409 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-10-14T11:14:07.410 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-14T11:14:07.410 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2023-10-14T11:14:07.410 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 4084783555 2023-10-14T11:14:07.411 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:07.411 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:07.411 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-10-14T11:14:07.411 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-14T11:14:07.412 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2023-10-14T11:14:07.412 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 4084783555 2023-10-14T11:14:07.412 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:07.412 INFO:teuthology.orchestra.run.smithi026.stdout: "inst_str": "client.5808 192.168.0.1:0/4084783555", 2023-10-14T11:14:07.413 INFO:teuthology.orchestra.run.smithi026.stdout: "addr_str": "192.168.0.1:0/4084783555", 2023-10-14T11:14:07.413 INFO:teuthology.orchestra.run.smithi026.stdout: "inode_count": 1, 2023-10-14T11:14:07.413 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_epoch": 18, 2023-10-14T11:14:07.413 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch": 42, 2023-10-14T11:14:07.414 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch_barrier": 0, 2023-10-14T11:14:07.414 INFO:teuthology.orchestra.run.smithi026.stdout: "blocklisted": false, 2023-10-14T11:14:07.414 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "testcephfs1" 2023-10-14T11:14:07.414 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:14:07.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:07.421 DEBUG:teuthology.orchestra.run.smithi026:> stat --file-system '--printf=%T 2023-10-14T11:14:07.421 DEBUG:teuthology.orchestra.run.smithi026:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-14T11:14:07.431 INFO:teuthology.orchestra.run.smithi026.stdout:fuseblk 2023-10-14T11:14:07.432 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-14T11:14:07.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:07.433 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T11:14:07.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:07.495 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2023-10-14T11:14:07.549 INFO:teuthology.orchestra.run.smithi026.stderr:setfattr: layoutfile: Permission denied 2023-10-14T11:14:07.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:14:07.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:07.551 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2023-10-14T11:14:07.605 INFO:teuthology.orchestra.run.smithi026.stderr:setfattr: layoutdir: Permission denied 2023-10-14T11:14:07.605 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:14:07.606 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:14:07.607 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:14:07.659 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:14:07.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.841+0000 7f5de0817640 1 Processor -- start 2023-10-14T11:14:07.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.841+0000 7f5de0817640 1 -- start start 2023-10-14T11:14:07.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.841+0000 7f5de0817640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5ddc1591e0 0x7f5ddc0c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:07.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.841+0000 7f5de0817640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5ddc0ca430 0x7f5ddc071c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:07.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.841+0000 7f5de0817640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ddc071020 con 0x7f5ddc0721b0 2023-10-14T11:14:07.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.841+0000 7f5de0817640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ddc0c8e50 con 0x7f5ddc1591e0 2023-10-14T11:14:07.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.841+0000 7f5de0817640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ddc0c9130 con 0x7f5ddc0ca430 2023-10-14T11:14:07.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.841+0000 7f5dda59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5ddc1591e0 0x7f5ddc0c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:07.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.841+0000 7f5dda59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5ddc1591e0 0x7f5ddc0c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35202/0 (socket says 172.21.15.26:35202) 2023-10-14T11:14:07.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.841+0000 7f5dda59c640 1 -- 172.21.15.26:0/3874082198 learned_addr learned my addr 172.21.15.26:0/3874082198 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:07.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.841+0000 7f5dda59c640 1 -- 172.21.15.26:0/3874082198 >> v2:172.21.15.110:3300/0 conn(0x7f5ddc0ca430 msgr2=0x7f5ddc071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:07.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.841+0000 7f5dda59c640 1 --2- 172.21.15.26:0/3874082198 >> v2:172.21.15.110:3300/0 conn(0x7f5ddc0ca430 0x7f5ddc071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:07.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.841+0000 7f5dda59c640 1 -- 172.21.15.26:0/3874082198 >> v1:172.21.15.110:6789/0 conn(0x7f5ddc0721b0 legacy=0x7f5ddc0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:07.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.841+0000 7f5dda59c640 1 -- 172.21.15.26:0/3874082198 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc0c9410 con 0x7f5ddc1591e0 2023-10-14T11:14:07.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.845+0000 7f5dda59c640 1 --2- 172.21.15.26:0/3874082198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ddc1591e0 0x7f5ddc0c9ef0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc15dc70 tx=0x7f5dcc01d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd66710cab8d668 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:07.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.845+0000 7f5dd9d9b640 1 -- 172.21.15.26:0/3874082198 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc0a6830 con 0x7f5ddc1591e0 2023-10-14T11:14:07.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.845+0000 7f5dd9d9b640 1 -- 172.21.15.26:0/3874082198 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dcc0a6990 con 0x7f5ddc1591e0 2023-10-14T11:14:07.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.845+0000 7f5dd9d9b640 1 -- 172.21.15.26:0/3874082198 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc0a6d20 con 0x7f5ddc1591e0 2023-10-14T11:14:07.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.845+0000 7f5de0817640 1 -- 172.21.15.26:0/3874082198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ddc1591e0 msgr2=0x7f5ddc0c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:07.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.845+0000 7f5de0817640 1 --2- 172.21.15.26:0/3874082198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ddc1591e0 0x7f5ddc0c9ef0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc15dc70 tx=0x7f5dcc01d890 comp rx=0 tx=0).stop 2023-10-14T11:14:07.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.845+0000 7f5de0817640 1 -- 172.21.15.26:0/3874082198 shutdown_connections 2023-10-14T11:14:07.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.845+0000 7f5de0817640 1 --2- 172.21.15.26:0/3874082198 >> v2:172.21.15.110:3300/0 conn(0x7f5ddc0ca430 0x7f5ddc071c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:07.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.845+0000 7f5de0817640 1 --2- 172.21.15.26:0/3874082198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ddc1591e0 0x7f5ddc0c9ef0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:07.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.845+0000 7f5de0817640 1 -- 172.21.15.26:0/3874082198 >> 172.21.15.26:0/3874082198 conn(0x7f5ddc06c190 msgr2=0x7f5ddc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:07.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.845+0000 7f5de0817640 1 -- 172.21.15.26:0/3874082198 shutdown_connections 2023-10-14T11:14:07.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.845+0000 7f5de0817640 1 -- 172.21.15.26:0/3874082198 wait complete. 2023-10-14T11:14:07.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5de0817640 1 Processor -- start 2023-10-14T11:14:07.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5de0817640 1 -- start start 2023-10-14T11:14:07.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5de0817640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ddc0721b0 0x7f5ddc0af240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:07.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5de0817640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ddc0ca430 0x7f5ddc0ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:07.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5de0817640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ddc1591e0 0x7f5ddc0ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:07.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5de0817640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc15c5b0 con 0x7f5ddc0ca430 2023-10-14T11:14:07.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5de0817640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc14e430 con 0x7f5ddc1591e0 2023-10-14T11:14:07.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5de0817640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc0b1870 con 0x7f5ddc0721b0 2023-10-14T11:14:07.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5dd3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ddc0ca430 0x7f5ddc0ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:07.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5dd3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ddc0ca430 0x7f5ddc0ae270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35216/0 (socket says 172.21.15.26:35216) 2023-10-14T11:14:07.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5dd3fff640 1 -- 172.21.15.26:0/3587998655 learned_addr learned my addr 172.21.15.26:0/3587998655 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:07.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5dda59c640 1 --2- 172.21.15.26:0/3587998655 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ddc0721b0 0x7f5ddc0af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:07.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5ddad9d640 1 --2- 172.21.15.26:0/3587998655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ddc1591e0 0x7f5ddc0ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:07.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5dd3fff640 1 -- 172.21.15.26:0/3587998655 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ddc0721b0 msgr2=0x7f5ddc0af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:07.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5dd3fff640 1 --2- 172.21.15.26:0/3587998655 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ddc0721b0 0x7f5ddc0af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:07.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5dd3fff640 1 -- 172.21.15.26:0/3587998655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ddc1591e0 msgr2=0x7f5ddc0ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:07.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5dd3fff640 1 --2- 172.21.15.26:0/3587998655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ddc1591e0 0x7f5ddc0ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:07.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5dd3fff640 1 -- 172.21.15.26:0/3587998655 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dcc00a670 con 0x7f5ddc0ca430 2023-10-14T11:14:07.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5dda59c640 1 --2- 172.21.15.26:0/3587998655 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ddc0721b0 0x7f5ddc0af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:07.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5dd3fff640 1 --2- 172.21.15.26:0/3587998655 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ddc0ca430 0x7f5ddc0ae270 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400b4b0 tx=0x7f5dc400b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:07.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5dd2ffd640 1 -- 172.21.15.26:0/3587998655 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4010610 con 0x7f5ddc0ca430 2023-10-14T11:14:07.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5dd2ffd640 1 -- 172.21.15.26:0/3587998655 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc4010770 con 0x7f5ddc0ca430 2023-10-14T11:14:07.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5dd2ffd640 1 -- 172.21.15.26:0/3587998655 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4010b20 con 0x7f5ddc0ca430 2023-10-14T11:14:07.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5de0817640 1 -- 172.21.15.26:0/3587998655 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ddc15c2d0 con 0x7f5ddc0ca430 2023-10-14T11:14:07.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.849+0000 7f5de0817640 1 -- 172.21.15.26:0/3587998655 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ddc0b1500 con 0x7f5ddc0ca430 2023-10-14T11:14:07.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.853+0000 7f5de0817640 1 -- 172.21.15.26:0/3587998655 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ddc0b1060 con 0x7f5ddc0ca430 2023-10-14T11:14:07.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.853+0000 7f5dd2ffd640 1 -- 172.21.15.26:0/3587998655 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5dc4010c80 con 0x7f5ddc0ca430 2023-10-14T11:14:07.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.853+0000 7f5dd2ffd640 1 --2- 172.21.15.26:0/3587998655 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5dbc0664a0 0x7f5dbc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:07.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.853+0000 7f5dd2ffd640 1 -- 172.21.15.26:0/3587998655 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f5dc4083d10 con 0x7f5ddc0ca430 2023-10-14T11:14:07.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.853+0000 7f5dda59c640 1 --2- 172.21.15.26:0/3587998655 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5dbc0664a0 0x7f5dbc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:07.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.853+0000 7f5dda59c640 1 --2- 172.21.15.26:0/3587998655 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5dbc0664a0 0x7f5dbc068960 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc0b0000 tx=0x7f5dcc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:07.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:07.857+0000 7f5dd2ffd640 1 -- 172.21.15.26:0/3587998655 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5dc4050ea0 con 0x7f5ddc0ca430 2023-10-14T11:14:08.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.017+0000 7f5de0817640 1 -- 172.21.15.26:0/3587998655 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ddc074010 con 0x7f5ddc0ca430 2023-10-14T11:14:08.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.017+0000 7f5dd2ffd640 1 -- 172.21.15.26:0/3587998655 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18578 (secure 0 0 0) 0x7f5dc4014090 con 0x7f5ddc0ca430 2023-10-14T11:14:08.022 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:08.022 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":42,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:14:01.292164+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:13:48.453821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:13:49.623527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-10-14T11:13:59.245615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:14:08.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.021+0000 7f5de0817640 1 -- 172.21.15.26:0/3587998655 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5dbc0664a0 msgr2=0x7f5dbc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:08.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.021+0000 7f5de0817640 1 --2- 172.21.15.26:0/3587998655 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5dbc0664a0 0x7f5dbc068960 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc0b0000 tx=0x7f5dcc008040 comp rx=0 tx=0).stop 2023-10-14T11:14:08.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.021+0000 7f5de0817640 1 -- 172.21.15.26:0/3587998655 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ddc0ca430 msgr2=0x7f5ddc0ae270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:08.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.021+0000 7f5de0817640 1 --2- 172.21.15.26:0/3587998655 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ddc0ca430 0x7f5ddc0ae270 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400b4b0 tx=0x7f5dc400b970 comp rx=0 tx=0).stop 2023-10-14T11:14:08.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.021+0000 7f5de0817640 1 -- 172.21.15.26:0/3587998655 shutdown_connections 2023-10-14T11:14:08.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.021+0000 7f5de0817640 1 --2- 172.21.15.26:0/3587998655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ddc1591e0 0x7f5ddc0ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.021+0000 7f5de0817640 1 --2- 172.21.15.26:0/3587998655 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5dbc0664a0 0x7f5dbc068960 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.021+0000 7f5de0817640 1 --2- 172.21.15.26:0/3587998655 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ddc0ca430 0x7f5ddc0ae270 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.021+0000 7f5de0817640 1 --2- 172.21.15.26:0/3587998655 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ddc0721b0 0x7f5ddc0af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.021+0000 7f5de0817640 1 -- 172.21.15.26:0/3587998655 >> 172.21.15.26:0/3587998655 conn(0x7f5ddc06c190 msgr2=0x7f5ddc154ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:08.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.021+0000 7f5de0817640 1 -- 172.21.15.26:0/3587998655 shutdown_connections 2023-10-14T11:14:08.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.021+0000 7f5de0817640 1 -- 172.21.15.26:0/3587998655 wait complete. 2023-10-14T11:14:08.044 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'testcephfs1_metadata', 'create_time': '2023-10-14T11:13:48.453821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'testcephfs1_data', 'create_time': '2023-10-14T11:13:49.623527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-10-14T11:13:59.245615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:14:08.045 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:14:08.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.189+0000 7f511a372640 1 Processor -- start 2023-10-14T11:14:08.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.189+0000 7f511a372640 1 -- start start 2023-10-14T11:14:08.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.189+0000 7f511a372640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f511415cc60 0x7f51140cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:08.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.189+0000 7f511a372640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5114161260 0x7f51140ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:08.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.189+0000 7f511a372640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f51140cebd0 0x7f51140b2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:08.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.189+0000 7f511a372640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51140cc330 con 0x7f51140cebd0 2023-10-14T11:14:08.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.189+0000 7f511a372640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51140cefe0 con 0x7f511415cc60 2023-10-14T11:14:08.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.189+0000 7f511a372640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51140cb720 con 0x7f5114161260 2023-10-14T11:14:08.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.189+0000 7f511890f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f51140cebd0 0x7f51140b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:08.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.189+0000 7f511890f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f51140cebd0 0x7f51140b2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35230/0 (socket says 172.21.15.26:35230) 2023-10-14T11:14:08.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.189+0000 7f511890f640 1 -- 172.21.15.26:0/2193965621 learned_addr learned my addr 172.21.15.26:0/2193965621 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:08.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.189+0000 7f51137fe640 1 --2- 172.21.15.26:0/2193965621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5114161260 0x7f51140ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:08.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.189+0000 7f5113fff640 1 --2- 172.21.15.26:0/2193965621 >> v2:172.21.15.110:3300/0 conn(0x7f511415cc60 0x7f51140cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:08.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.189+0000 7f511890f640 1 -- 172.21.15.26:0/2193965621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5114161260 msgr2=0x7f51140ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:08.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.189+0000 7f511890f640 1 --2- 172.21.15.26:0/2193965621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5114161260 0x7f51140ce690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.189+0000 7f511890f640 1 -- 172.21.15.26:0/2193965621 >> v2:172.21.15.110:3300/0 conn(0x7f511415cc60 msgr2=0x7f51140cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:08.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.189+0000 7f511890f640 1 --2- 172.21.15.26:0/2193965621 >> v2:172.21.15.110:3300/0 conn(0x7f511415cc60 0x7f51140cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.189+0000 7f511890f640 1 -- 172.21.15.26:0/2193965621 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51140cba00 con 0x7f51140cebd0 2023-10-14T11:14:08.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.189+0000 7f5113fff640 1 --2- 172.21.15.26:0/2193965621 >> v2:172.21.15.110:3300/0 conn(0x7f511415cc60 0x7f51140cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:08.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.193+0000 7f511890f640 1 --2- 172.21.15.26:0/2193965621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51140cebd0 0x7f51140b2330 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f51140d0810 tx=0x7f510c01c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfcd6092c9cc998c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:08.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.193+0000 7f5112ffd640 1 -- 172.21.15.26:0/2193965621 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c0a5560 con 0x7f51140cebd0 2023-10-14T11:14:08.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.193+0000 7f5112ffd640 1 -- 172.21.15.26:0/2193965621 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c0a56c0 con 0x7f51140cebd0 2023-10-14T11:14:08.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.193+0000 7f5112ffd640 1 -- 172.21.15.26:0/2193965621 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c0a5a50 con 0x7f51140cebd0 2023-10-14T11:14:08.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.193+0000 7f511a372640 1 -- 172.21.15.26:0/2193965621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51140cebd0 msgr2=0x7f51140b2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:08.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.193+0000 7f511a372640 1 --2- 172.21.15.26:0/2193965621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51140cebd0 0x7f51140b2330 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f51140d0810 tx=0x7f510c01c6e0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.193+0000 7f511a372640 1 -- 172.21.15.26:0/2193965621 shutdown_connections 2023-10-14T11:14:08.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.193+0000 7f511a372640 1 --2- 172.21.15.26:0/2193965621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51140cebd0 0x7f51140b2330 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.193+0000 7f511a372640 1 --2- 172.21.15.26:0/2193965621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5114161260 0x7f51140ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.193+0000 7f511a372640 1 --2- 172.21.15.26:0/2193965621 >> v2:172.21.15.110:3300/0 conn(0x7f511415cc60 0x7f51140cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.193+0000 7f511a372640 1 -- 172.21.15.26:0/2193965621 >> 172.21.15.26:0/2193965621 conn(0x7f511406e570 msgr2=0x7f511406e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:08.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.193+0000 7f511a372640 1 -- 172.21.15.26:0/2193965621 shutdown_connections 2023-10-14T11:14:08.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.193+0000 7f511a372640 1 -- 172.21.15.26:0/2193965621 wait complete. 2023-10-14T11:14:08.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f511a372640 1 Processor -- start 2023-10-14T11:14:08.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f511a372640 1 -- start start 2023-10-14T11:14:08.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f511a372640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51140cebd0 0x7f511414fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:08.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f511a372640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f511415cc60 0x7f511415b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:08.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f511a372640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5114161260 0x7f51140c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:08.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f511a372640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511415be70 con 0x7f511415cc60 2023-10-14T11:14:08.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f511a372640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511415c150 con 0x7f51140cebd0 2023-10-14T11:14:08.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f511a372640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51140c4390 con 0x7f5114161260 2023-10-14T11:14:08.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f51137fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f511415cc60 0x7f511415b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:08.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f51137fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f511415cc60 0x7f511415b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35240/0 (socket says 172.21.15.26:35240) 2023-10-14T11:14:08.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f51137fe640 1 -- 172.21.15.26:0/777510737 learned_addr learned my addr 172.21.15.26:0/777510737 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:08.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f5113fff640 1 --2- 172.21.15.26:0/777510737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51140cebd0 0x7f511414fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:08.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f511890f640 1 --2- 172.21.15.26:0/777510737 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5114161260 0x7f51140c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:08.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f51137fe640 1 -- 172.21.15.26:0/777510737 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5114161260 msgr2=0x7f51140c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:08.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f51137fe640 1 --2- 172.21.15.26:0/777510737 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5114161260 0x7f51140c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f51137fe640 1 -- 172.21.15.26:0/777510737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51140cebd0 msgr2=0x7f511414fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:08.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f51137fe640 1 --2- 172.21.15.26:0/777510737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51140cebd0 0x7f511414fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f51137fe640 1 -- 172.21.15.26:0/777510737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c009b30 con 0x7f511415cc60 2023-10-14T11:14:08.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f5113fff640 1 --2- 172.21.15.26:0/777510737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51140cebd0 0x7f511414fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:08.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f51137fe640 1 --2- 172.21.15.26:0/777510737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f511415cc60 0x7f511415b3d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f510800e870 tx=0x7f510800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:08.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f5110ff9640 1 -- 172.21.15.26:0/777510737 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108009510 con 0x7f511415cc60 2023-10-14T11:14:08.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f5110ff9640 1 -- 172.21.15.26:0/777510737 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510800eec0 con 0x7f511415cc60 2023-10-14T11:14:08.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f511a372640 1 -- 172.21.15.26:0/777510737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51140c4670 con 0x7f511415cc60 2023-10-14T11:14:08.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f5110ff9640 1 -- 172.21.15.26:0/777510737 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510800cb40 con 0x7f511415cc60 2023-10-14T11:14:08.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f511a372640 1 -- 172.21.15.26:0/777510737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51140ca3c0 con 0x7f511415cc60 2023-10-14T11:14:08.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.197+0000 7f511a372640 1 -- 172.21.15.26:0/777510737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5114150120 con 0x7f511415cc60 2023-10-14T11:14:08.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.201+0000 7f5110ff9640 1 -- 172.21.15.26:0/777510737 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f510800cca0 con 0x7f511415cc60 2023-10-14T11:14:08.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.201+0000 7f5110ff9640 1 --2- 172.21.15.26:0/777510737 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f51000664a0 0x7f5100068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:08.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.201+0000 7f5110ff9640 1 -- 172.21.15.26:0/777510737 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f5108084340 con 0x7f511415cc60 2023-10-14T11:14:08.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.201+0000 7f5113fff640 1 --2- 172.21.15.26:0/777510737 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f51000664a0 0x7f5100068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:08.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.201+0000 7f5113fff640 1 --2- 172.21.15.26:0/777510737 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f51000664a0 0x7f5100068960 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f510400c940 tx=0x7f5104008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:08.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.205+0000 7f5110ff9640 1 -- 172.21.15.26:0/777510737 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5108051430 con 0x7f511415cc60 2023-10-14T11:14:08.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.365+0000 7f511a372640 1 -- 172.21.15.26:0/777510737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f511415bfb0 con 0x7f511415cc60 2023-10-14T11:14:08.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.365+0000 7f5110ff9640 1 -- 172.21.15.26:0/777510737 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f511415bfb0 con 0x7f511415cc60 2023-10-14T11:14:08.370 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:14:08.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.369+0000 7f511a372640 1 -- 172.21.15.26:0/777510737 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f51000664a0 msgr2=0x7f5100068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:08.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.369+0000 7f511a372640 1 --2- 172.21.15.26:0/777510737 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f51000664a0 0x7f5100068960 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f510400c940 tx=0x7f5104008040 comp rx=0 tx=0).stop 2023-10-14T11:14:08.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.369+0000 7f511a372640 1 -- 172.21.15.26:0/777510737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f511415cc60 msgr2=0x7f511415b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:08.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.369+0000 7f511a372640 1 --2- 172.21.15.26:0/777510737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f511415cc60 0x7f511415b3d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f510800e870 tx=0x7f510800ec70 comp rx=0 tx=0).stop 2023-10-14T11:14:08.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.369+0000 7f511a372640 1 -- 172.21.15.26:0/777510737 shutdown_connections 2023-10-14T11:14:08.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.369+0000 7f511a372640 1 --2- 172.21.15.26:0/777510737 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5114161260 0x7f51140c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.369+0000 7f511a372640 1 --2- 172.21.15.26:0/777510737 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f51000664a0 0x7f5100068960 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.369+0000 7f511a372640 1 --2- 172.21.15.26:0/777510737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f511415cc60 0x7f511415b3d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.369+0000 7f511a372640 1 --2- 172.21.15.26:0/777510737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51140cebd0 0x7f511414fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.369+0000 7f511a372640 1 -- 172.21.15.26:0/777510737 >> 172.21.15.26:0/777510737 conn(0x7f511406e570 msgr2=0x7f51140b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:08.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.369+0000 7f511a372640 1 -- 172.21.15.26:0/777510737 shutdown_connections 2023-10-14T11:14:08.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.369+0000 7f511a372640 1 -- 172.21.15.26:0/777510737 wait complete. 2023-10-14T11:14:08.391 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_metadata pg_num 2023-10-14T11:14:08.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.533+0000 7fa76b93e640 1 Processor -- start 2023-10-14T11:14:08.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.533+0000 7fa76b93e640 1 -- start start 2023-10-14T11:14:08.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.537+0000 7fa76b93e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa76406a4d0 0x7fa7640c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:08.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.537+0000 7fa76b93e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76406c6d0 con 0x7fa76406a0f0 2023-10-14T11:14:08.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.537+0000 7fa76b93e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76406c950 con 0x7fa7640ade00 2023-10-14T11:14:08.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.537+0000 7fa76b93e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7641654f0 con 0x7fa76406a4d0 2023-10-14T11:14:08.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.537+0000 7fa7696da640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa76406a0f0 0x7fa7640ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33358/0 (socket says 172.21.15.26:33358) 2023-10-14T11:14:08.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.537+0000 7fa7696da640 1 -- 172.21.15.26:0/240346398 learned_addr learned my addr 172.21.15.26:0/240346398 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:08.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.537+0000 7fa769edb640 1 --2- 172.21.15.26:0/240346398 >> v2:172.21.15.26:3300/0 conn(0x7fa76406a4d0 0x7fa7640c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:08.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.537+0000 7fa75bfff640 1 -- 172.21.15.26:0/240346398 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579937664 0 0) 0x7fa76406c6d0 con 0x7fa76406a0f0 2023-10-14T11:14:08.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.537+0000 7fa75bfff640 1 -- 172.21.15.26:0/240346398 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa750003530 con 0x7fa76406a0f0 2023-10-14T11:14:08.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.537+0000 7fa769edb640 1 -- 172.21.15.26:0/240346398 >> v1:172.21.15.110:6789/0 conn(0x7fa7640ade00 legacy=0x7fa76406ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:08.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.537+0000 7fa769edb640 1 -- 172.21.15.26:0/240346398 >> v1:172.21.15.26:6789/0 conn(0x7fa76406a0f0 legacy=0x7fa7640ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:08.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.537+0000 7fa769edb640 1 -- 172.21.15.26:0/240346398 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7641657d0 con 0x7fa76406a4d0 2023-10-14T11:14:08.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.541+0000 7fa769edb640 1 --2- 172.21.15.26:0/240346398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa76406a4d0 0x7fa7640c8dd0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa75c009d90 tx=0x7fa75c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50233efb336bfe5a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:08.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.541+0000 7fa75bfff640 1 -- 172.21.15.26:0/240346398 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0a59f0 con 0x7fa76406a4d0 2023-10-14T11:14:08.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.541+0000 7fa75bfff640 1 -- 172.21.15.26:0/240346398 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c0a5b50 con 0x7fa76406a4d0 2023-10-14T11:14:08.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.541+0000 7fa75bfff640 1 -- 172.21.15.26:0/240346398 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0ad440 con 0x7fa76406a4d0 2023-10-14T11:14:08.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.541+0000 7fa76b93e640 1 -- 172.21.15.26:0/240346398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa76406a4d0 msgr2=0x7fa7640c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:08.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.541+0000 7fa76b93e640 1 --2- 172.21.15.26:0/240346398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa76406a4d0 0x7fa7640c8dd0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa75c009d90 tx=0x7fa75c01c910 comp rx=0 tx=0).stop 2023-10-14T11:14:08.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.541+0000 7fa76b93e640 1 -- 172.21.15.26:0/240346398 shutdown_connections 2023-10-14T11:14:08.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.541+0000 7fa76b93e640 1 --2- 172.21.15.26:0/240346398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa76406a4d0 0x7fa7640c8dd0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.541+0000 7fa76b93e640 1 -- 172.21.15.26:0/240346398 >> 172.21.15.26:0/240346398 conn(0x7fa7640b0da0 msgr2=0x7fa7640ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:08.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.541+0000 7fa76b93e640 1 -- 172.21.15.26:0/240346398 shutdown_connections 2023-10-14T11:14:08.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.541+0000 7fa76b93e640 1 -- 172.21.15.26:0/240346398 wait complete. 2023-10-14T11:14:08.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.541+0000 7fa76b93e640 1 Processor -- start 2023-10-14T11:14:08.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.541+0000 7fa76b93e640 1 -- start start 2023-10-14T11:14:08.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.545+0000 7fa76b93e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa76406a0f0 0x7fa764160570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:08.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.545+0000 7fa76b93e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa76406a4d0 0x7fa7640b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:08.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.545+0000 7fa76b93e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7640ade00 0x7fa7640b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:08.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.545+0000 7fa76b93e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7640b1960 con 0x7fa7640ade00 2023-10-14T11:14:08.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.545+0000 7fa76b93e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7640c60b0 con 0x7fa76406a0f0 2023-10-14T11:14:08.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.545+0000 7fa76b93e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7640b2430 con 0x7fa76406a4d0 2023-10-14T11:14:08.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.545+0000 7fa769edb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7640ade00 0x7fa7640b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:08.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.545+0000 7fa769edb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7640ade00 0x7fa7640b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35262/0 (socket says 172.21.15.26:35262) 2023-10-14T11:14:08.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.545+0000 7fa769edb640 1 -- 172.21.15.26:0/55156808 learned_addr learned my addr 172.21.15.26:0/55156808 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:08.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.545+0000 7fa769edb640 1 -- 172.21.15.26:0/55156808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa76406a4d0 msgr2=0x7fa7640b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:08.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.545+0000 7fa769edb640 1 --2- 172.21.15.26:0/55156808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa76406a4d0 0x7fa7640b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.545+0000 7fa769edb640 1 -- 172.21.15.26:0/55156808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa76406a0f0 msgr2=0x7fa764160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:08.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.545+0000 7fa769edb640 1 --2- 172.21.15.26:0/55156808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa76406a0f0 0x7fa764160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.545+0000 7fa769edb640 1 -- 172.21.15.26:0/55156808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c009a70 con 0x7fa7640ade00 2023-10-14T11:14:08.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.545+0000 7fa769edb640 1 --2- 172.21.15.26:0/55156808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7640ade00 0x7fa7640b2c50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa75c01a540 tx=0x7fa75c0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:08.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.545+0000 7fa759ffb640 1 -- 172.21.15.26:0/55156808 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0add90 con 0x7fa7640ade00 2023-10-14T11:14:08.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.545+0000 7fa759ffb640 1 -- 172.21.15.26:0/55156808 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c009450 con 0x7fa7640ade00 2023-10-14T11:14:08.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.545+0000 7fa759ffb640 1 -- 172.21.15.26:0/55156808 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0b9670 con 0x7fa7640ade00 2023-10-14T11:14:08.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.545+0000 7fa76b93e640 1 -- 172.21.15.26:0/55156808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7640b1b90 con 0x7fa7640ade00 2023-10-14T11:14:08.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.545+0000 7fa76b93e640 1 -- 172.21.15.26:0/55156808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7640b2150 con 0x7fa7640ade00 2023-10-14T11:14:08.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.545+0000 7fa76b93e640 1 -- 172.21.15.26:0/55156808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7640c5e80 con 0x7fa7640ade00 2023-10-14T11:14:08.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.545+0000 7fa759ffb640 1 -- 172.21.15.26:0/55156808 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa75c0b97d0 con 0x7fa7640ade00 2023-10-14T11:14:08.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.549+0000 7fa759ffb640 1 --2- 172.21.15.26:0/55156808 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa7480664a0 0x7fa748068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:08.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.549+0000 7fa759ffb640 1 -- 172.21.15.26:0/55156808 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7fa75c11f9d0 con 0x7fa7640ade00 2023-10-14T11:14:08.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.549+0000 7fa7696da640 1 --2- 172.21.15.26:0/55156808 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa7480664a0 0x7fa748068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:08.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.549+0000 7fa7696da640 1 --2- 172.21.15.26:0/55156808 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa7480664a0 0x7fa748068960 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa760007fd0 tx=0x7fa760007940 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:08.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.553+0000 7fa759ffb640 1 -- 172.21.15.26:0/55156808 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa7640c5e80 con 0x7fa7640ade00 2023-10-14T11:14:08.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.709+0000 7fa76b93e640 1 -- 172.21.15.26:0/55156808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa7640c5e80 con 0x7fa7640ade00 2023-10-14T11:14:08.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.709+0000 7fa759ffb640 1 -- 172.21.15.26:0/55156808 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"}]=0 v42) v1 ==== 109+0+11 (secure 0 0 0) 0x7fa7640c5e80 con 0x7fa7640ade00 2023-10-14T11:14:08.712 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:14:08.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.709+0000 7fa76b93e640 1 -- 172.21.15.26:0/55156808 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa7480664a0 msgr2=0x7fa748068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:08.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.709+0000 7fa76b93e640 1 --2- 172.21.15.26:0/55156808 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa7480664a0 0x7fa748068960 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa760007fd0 tx=0x7fa760007940 comp rx=0 tx=0).stop 2023-10-14T11:14:08.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.709+0000 7fa76b93e640 1 -- 172.21.15.26:0/55156808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7640ade00 msgr2=0x7fa7640b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:08.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.709+0000 7fa76b93e640 1 --2- 172.21.15.26:0/55156808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7640ade00 0x7fa7640b2c50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa75c01a540 tx=0x7fa75c0196b0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.709+0000 7fa76b93e640 1 -- 172.21.15.26:0/55156808 shutdown_connections 2023-10-14T11:14:08.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.709+0000 7fa76b93e640 1 --2- 172.21.15.26:0/55156808 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa7480664a0 0x7fa748068960 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.709+0000 7fa76b93e640 1 --2- 172.21.15.26:0/55156808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7640ade00 0x7fa7640b2c50 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.709+0000 7fa76b93e640 1 --2- 172.21.15.26:0/55156808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa76406a4d0 0x7fa7640b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.709+0000 7fa76b93e640 1 --2- 172.21.15.26:0/55156808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa76406a0f0 0x7fa764160570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.709+0000 7fa76b93e640 1 -- 172.21.15.26:0/55156808 >> 172.21.15.26:0/55156808 conn(0x7fa7640b0da0 msgr2=0x7fa7640707b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:08.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.709+0000 7fa76b93e640 1 -- 172.21.15.26:0/55156808 shutdown_connections 2023-10-14T11:14:08.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.709+0000 7fa76b93e640 1 -- 172.21.15.26:0/55156808 wait complete. 2023-10-14T11:14:08.733 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_data pg_num 2023-10-14T11:14:08.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.877+0000 7fa38be6b640 1 Processor -- start 2023-10-14T11:14:08.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.877+0000 7fa38be6b640 1 -- start start 2023-10-14T11:14:08.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.877+0000 7fa38be6b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa38406a0f0 0x7fa3840c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:08.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.877+0000 7fa38be6b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3840ade00 0x7fa3840ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:08.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.877+0000 7fa38be6b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38406c6d0 con 0x7fa38406a4d0 2023-10-14T11:14:08.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.877+0000 7fa38be6b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa38406c950 con 0x7fa38406a0f0 2023-10-14T11:14:08.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.877+0000 7fa38be6b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3841654f0 con 0x7fa3840ade00 2023-10-14T11:14:08.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.877+0000 7fa389c07640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa38406a0f0 0x7fa3840c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:08.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.877+0000 7fa38a408640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3840ade00 0x7fa3840ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:08.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.877+0000 7fa389406640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa38406a4d0 0x7fa3840ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:53184/0 (socket says 172.21.15.26:53184) 2023-10-14T11:14:08.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.877+0000 7fa38a408640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3840ade00 0x7fa3840ccd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:54822/0 (socket says 172.21.15.26:54822) 2023-10-14T11:14:08.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.877+0000 7fa38a408640 1 -- 172.21.15.26:0/168095061 learned_addr learned my addr 172.21.15.26:0/168095061 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:08.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.877+0000 7fa389c07640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa38406a0f0 0x7fa3840c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:34798/0 (socket says 172.21.15.26:34798) 2023-10-14T11:14:08.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.877+0000 7fa389c07640 1 -- 172.21.15.26:0/168095061 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3840ade00 msgr2=0x7fa3840ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:08.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.877+0000 7fa389c07640 1 --2- 172.21.15.26:0/168095061 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3840ade00 0x7fa3840ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.877+0000 7fa389c07640 1 -- 172.21.15.26:0/168095061 >> v1:172.21.15.110:6789/0 conn(0x7fa38406a4d0 legacy=0x7fa3840ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:08.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.877+0000 7fa389c07640 1 -- 172.21.15.26:0/168095061 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3841657d0 con 0x7fa38406a0f0 2023-10-14T11:14:08.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.881+0000 7fa389c07640 1 --2- 172.21.15.26:0/168095061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa38406a0f0 0x7fa3840c8dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa3800097c0 tx=0x7fa38001cee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5903bf5a26020191 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:08.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.881+0000 7fa388c05640 1 -- 172.21.15.26:0/168095061 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3800a6040 con 0x7fa38406a0f0 2023-10-14T11:14:08.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.881+0000 7fa388c05640 1 -- 172.21.15.26:0/168095061 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3800aa600 con 0x7fa38406a0f0 2023-10-14T11:14:08.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.881+0000 7fa388c05640 1 -- 172.21.15.26:0/168095061 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3800aa990 con 0x7fa38406a0f0 2023-10-14T11:14:08.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.881+0000 7fa38be6b640 1 -- 172.21.15.26:0/168095061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa38406a0f0 msgr2=0x7fa3840c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:08.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.881+0000 7fa38be6b640 1 --2- 172.21.15.26:0/168095061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa38406a0f0 0x7fa3840c8dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa3800097c0 tx=0x7fa38001cee0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.881+0000 7fa38be6b640 1 -- 172.21.15.26:0/168095061 shutdown_connections 2023-10-14T11:14:08.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.881+0000 7fa38be6b640 1 --2- 172.21.15.26:0/168095061 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3840ade00 0x7fa3840ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.881+0000 7fa38be6b640 1 --2- 172.21.15.26:0/168095061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa38406a0f0 0x7fa3840c8dd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.881+0000 7fa38be6b640 1 -- 172.21.15.26:0/168095061 >> 172.21.15.26:0/168095061 conn(0x7fa3840b0da0 msgr2=0x7fa3840ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:08.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.881+0000 7fa38be6b640 1 -- 172.21.15.26:0/168095061 shutdown_connections 2023-10-14T11:14:08.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.881+0000 7fa38be6b640 1 -- 172.21.15.26:0/168095061 wait complete. 2023-10-14T11:14:08.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa38be6b640 1 Processor -- start 2023-10-14T11:14:08.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa38be6b640 1 -- start start 2023-10-14T11:14:08.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa38be6b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa38406a0f0 0x7fa3840c1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:08.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa38be6b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa38406a4d0 0x7fa384160090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:08.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa38be6b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3840ade00 0x7fa3840c3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:08.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa38be6b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3841f96a0 con 0x7fa38406a0f0 2023-10-14T11:14:08.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa38be6b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3841605d0 con 0x7fa38406a4d0 2023-10-14T11:14:08.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa38be6b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3840c30e0 con 0x7fa3840ade00 2023-10-14T11:14:08.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa389c07640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa38406a0f0 0x7fa3840c1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:08.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa389c07640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa38406a0f0 0x7fa3840c1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35266/0 (socket says 172.21.15.26:35266) 2023-10-14T11:14:08.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa389c07640 1 -- 172.21.15.26:0/3734115073 learned_addr learned my addr 172.21.15.26:0/3734115073 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:08.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa389c07640 1 -- 172.21.15.26:0/3734115073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3840ade00 msgr2=0x7fa3840c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:08.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa389c07640 1 --2- 172.21.15.26:0/3734115073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3840ade00 0x7fa3840c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa389c07640 1 -- 172.21.15.26:0/3734115073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa38406a4d0 msgr2=0x7fa384160090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:08.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa389406640 1 --2- 172.21.15.26:0/3734115073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa38406a4d0 0x7fa384160090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:08.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa389c07640 1 --2- 172.21.15.26:0/3734115073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa38406a4d0 0x7fa384160090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:08.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa389c07640 1 -- 172.21.15.26:0/3734115073 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa380009420 con 0x7fa38406a0f0 2023-10-14T11:14:08.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa389406640 1 --2- 172.21.15.26:0/3734115073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa38406a4d0 0x7fa384160090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:08.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa389c07640 1 --2- 172.21.15.26:0/3734115073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa38406a0f0 0x7fa3840c1dd0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa3800097c0 tx=0x7fa38001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:08.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa37a7fc640 1 -- 172.21.15.26:0/3734115073 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3800b3600 con 0x7fa38406a0f0 2023-10-14T11:14:08.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa37a7fc640 1 -- 172.21.15.26:0/3734115073 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3800b3780 con 0x7fa38406a0f0 2023-10-14T11:14:08.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa37a7fc640 1 -- 172.21.15.26:0/3734115073 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3800b3b30 con 0x7fa38406a0f0 2023-10-14T11:14:08.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa38be6b640 1 -- 172.21.15.26:0/3734115073 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3840c3ab0 con 0x7fa38406a0f0 2023-10-14T11:14:08.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.885+0000 7fa38be6b640 1 -- 172.21.15.26:0/3734115073 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3840c27b0 con 0x7fa38406a0f0 2023-10-14T11:14:08.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.889+0000 7fa38be6b640 1 -- 172.21.15.26:0/3734115073 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38404e170 con 0x7fa38406a0f0 2023-10-14T11:14:08.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.889+0000 7fa37a7fc640 1 -- 172.21.15.26:0/3734115073 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa3800b3c90 con 0x7fa38406a0f0 2023-10-14T11:14:08.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.889+0000 7fa37a7fc640 1 --2- 172.21.15.26:0/3734115073 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa3680664a0 0x7fa368068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:08.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.889+0000 7fa37a7fc640 1 -- 172.21.15.26:0/3734115073 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7fa38011e0a0 con 0x7fa38406a0f0 2023-10-14T11:14:08.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.889+0000 7fa389406640 1 --2- 172.21.15.26:0/3734115073 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa3680664a0 0x7fa368068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:08.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.889+0000 7fa389406640 1 --2- 172.21.15.26:0/3734115073 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa3680664a0 0x7fa368068960 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa3840ad6c0 tx=0x7fa374009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:08.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:08.893+0000 7fa37a7fc640 1 -- 172.21.15.26:0/3734115073 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa3800eb240 con 0x7fa38406a0f0 2023-10-14T11:14:09.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.049+0000 7fa38be6b640 1 -- 172.21.15.26:0/3734115073 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"} v 0) v1 -- 0x7fa3840cc5d0 con 0x7fa38406a0f0 2023-10-14T11:14:09.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.049+0000 7fa37a7fc640 1 -- 172.21.15.26:0/3734115073 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"}]=0 v42) v1 ==== 105+0+11 (secure 0 0 0) 0x7fa3800ee860 con 0x7fa38406a0f0 2023-10-14T11:14:09.053 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:14:09.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.049+0000 7fa38be6b640 1 -- 172.21.15.26:0/3734115073 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa3680664a0 msgr2=0x7fa368068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:09.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.049+0000 7fa38be6b640 1 --2- 172.21.15.26:0/3734115073 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa3680664a0 0x7fa368068960 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa3840ad6c0 tx=0x7fa374009040 comp rx=0 tx=0).stop 2023-10-14T11:14:09.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.049+0000 7fa38be6b640 1 -- 172.21.15.26:0/3734115073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa38406a0f0 msgr2=0x7fa3840c1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:09.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.049+0000 7fa38be6b640 1 --2- 172.21.15.26:0/3734115073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa38406a0f0 0x7fa3840c1dd0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa3800097c0 tx=0x7fa38001acc0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.049+0000 7fa38be6b640 1 -- 172.21.15.26:0/3734115073 shutdown_connections 2023-10-14T11:14:09.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.049+0000 7fa38be6b640 1 --2- 172.21.15.26:0/3734115073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3840ade00 0x7fa3840c3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.049+0000 7fa38be6b640 1 --2- 172.21.15.26:0/3734115073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa38406a4d0 0x7fa384160090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.049+0000 7fa38be6b640 1 --2- 172.21.15.26:0/3734115073 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa3680664a0 0x7fa368068960 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.049+0000 7fa38be6b640 1 --2- 172.21.15.26:0/3734115073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa38406a0f0 0x7fa3840c1dd0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.049+0000 7fa38be6b640 1 -- 172.21.15.26:0/3734115073 >> 172.21.15.26:0/3734115073 conn(0x7fa3840b0da0 msgr2=0x7fa384070480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:09.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.049+0000 7fa38be6b640 1 -- 172.21.15.26:0/3734115073 shutdown_connections 2023-10-14T11:14:09.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.049+0000 7fa38be6b640 1 -- 172.21.15.26:0/3734115073 wait complete. 2023-10-14T11:14:09.074 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-10-14T11:14:09.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.217+0000 7f8b8a9c5640 1 Processor -- start 2023-10-14T11:14:09.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.217+0000 7f8b8a9c5640 1 -- start start 2023-10-14T11:14:09.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.217+0000 7f8b8a9c5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8b8415cbc0 0x7f8b840ab870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:09.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.217+0000 7f8b8a9c5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b8406a5a0 0x7f8b84160cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:09.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.217+0000 7f8b8a9c5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b84161390 con 0x7f8b84160860 2023-10-14T11:14:09.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.217+0000 7f8b8a9c5640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b840ccda0 con 0x7f8b8406a5a0 2023-10-14T11:14:09.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.217+0000 7f8b8a9c5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b840cd080 con 0x7f8b8415cbc0 2023-10-14T11:14:09.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.217+0000 7f8b88f62640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b8406a5a0 0x7f8b84160cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:09.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.217+0000 7f8b88f62640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b8406a5a0 0x7f8b84160cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35276/0 (socket says 172.21.15.26:35276) 2023-10-14T11:14:09.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.217+0000 7f8b88f62640 1 -- 172.21.15.26:0/4117874688 learned_addr learned my addr 172.21.15.26:0/4117874688 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:09.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.217+0000 7f8b83fff640 1 --2- 172.21.15.26:0/4117874688 >> v2:172.21.15.110:3300/0 conn(0x7f8b8415cbc0 0x7f8b840ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:09.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.217+0000 7f8b88f62640 1 -- 172.21.15.26:0/4117874688 >> v2:172.21.15.110:3300/0 conn(0x7f8b8415cbc0 msgr2=0x7f8b840ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:09.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.217+0000 7f8b88f62640 1 --2- 172.21.15.26:0/4117874688 >> v2:172.21.15.110:3300/0 conn(0x7f8b8415cbc0 0x7f8b840ab870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.217+0000 7f8b88f62640 1 -- 172.21.15.26:0/4117874688 >> v1:172.21.15.110:6789/0 conn(0x7f8b84160860 legacy=0x7f8b84069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:09.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.217+0000 7f8b88f62640 1 -- 172.21.15.26:0/4117874688 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b840cd360 con 0x7f8b8406a5a0 2023-10-14T11:14:09.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.221+0000 7f8b88f62640 1 --2- 172.21.15.26:0/4117874688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b8406a5a0 0x7f8b84160cf0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8b840713e0 tx=0x7f8b7c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04e33ef3b31b63e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:09.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.221+0000 7f8b82ffd640 1 -- 172.21.15.26:0/4117874688 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c0a57a0 con 0x7f8b8406a5a0 2023-10-14T11:14:09.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.221+0000 7f8b82ffd640 1 -- 172.21.15.26:0/4117874688 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7c0a5900 con 0x7f8b8406a5a0 2023-10-14T11:14:09.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.221+0000 7f8b82ffd640 1 -- 172.21.15.26:0/4117874688 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c0a5c90 con 0x7f8b8406a5a0 2023-10-14T11:14:09.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.221+0000 7f8b8a9c5640 1 -- 172.21.15.26:0/4117874688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b8406a5a0 msgr2=0x7f8b84160cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:09.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.221+0000 7f8b8a9c5640 1 --2- 172.21.15.26:0/4117874688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b8406a5a0 0x7f8b84160cf0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8b840713e0 tx=0x7f8b7c01c940 comp rx=0 tx=0).stop 2023-10-14T11:14:09.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.221+0000 7f8b8a9c5640 1 -- 172.21.15.26:0/4117874688 shutdown_connections 2023-10-14T11:14:09.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.221+0000 7f8b8a9c5640 1 --2- 172.21.15.26:0/4117874688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b8406a5a0 0x7f8b84160cf0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.221+0000 7f8b8a9c5640 1 --2- 172.21.15.26:0/4117874688 >> v2:172.21.15.110:3300/0 conn(0x7f8b8415cbc0 0x7f8b840ab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.221+0000 7f8b8a9c5640 1 -- 172.21.15.26:0/4117874688 >> 172.21.15.26:0/4117874688 conn(0x7f8b840b0da0 msgr2=0x7f8b840ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:09.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.221+0000 7f8b8a9c5640 1 -- 172.21.15.26:0/4117874688 shutdown_connections 2023-10-14T11:14:09.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.221+0000 7f8b8a9c5640 1 -- 172.21.15.26:0/4117874688 wait complete. 2023-10-14T11:14:09.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b8a9c5640 1 Processor -- start 2023-10-14T11:14:09.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b8a9c5640 1 -- start start 2023-10-14T11:14:09.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b8a9c5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b8406a5a0 0x7f8b84147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:09.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b8a9c5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b8415cbc0 0x7f8b8415b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:09.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b8a9c5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b84160860 0x7f8b8415f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:09.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b8a9c5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8415c180 con 0x7f8b8415cbc0 2023-10-14T11:14:09.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b8a9c5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b840c67f0 con 0x7f8b8406a5a0 2023-10-14T11:14:09.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b8a9c5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8415bbc0 con 0x7f8b84160860 2023-10-14T11:14:09.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b837fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b8415cbc0 0x7f8b8415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:09.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b837fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b8415cbc0 0x7f8b8415b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35282/0 (socket says 172.21.15.26:35282) 2023-10-14T11:14:09.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b837fe640 1 -- 172.21.15.26:0/634209416 learned_addr learned my addr 172.21.15.26:0/634209416 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:09.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b83fff640 1 --2- 172.21.15.26:0/634209416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b8406a5a0 0x7f8b84147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:09.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b88f62640 1 --2- 172.21.15.26:0/634209416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b84160860 0x7f8b8415f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:09.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b837fe640 1 -- 172.21.15.26:0/634209416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b84160860 msgr2=0x7f8b8415f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:09.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b837fe640 1 --2- 172.21.15.26:0/634209416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b84160860 0x7f8b8415f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b837fe640 1 -- 172.21.15.26:0/634209416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b8406a5a0 msgr2=0x7f8b84147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:09.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b837fe640 1 --2- 172.21.15.26:0/634209416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b8406a5a0 0x7f8b84147c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b837fe640 1 -- 172.21.15.26:0/634209416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7c009b30 con 0x7f8b8415cbc0 2023-10-14T11:14:09.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b837fe640 1 --2- 172.21.15.26:0/634209416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b8415cbc0 0x7f8b8415b200 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8b7800c3c0 tx=0x7f8b7800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:09.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b80ff9640 1 -- 172.21.15.26:0/634209416 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b780052d0 con 0x7f8b8415cbc0 2023-10-14T11:14:09.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b80ff9640 1 -- 172.21.15.26:0/634209416 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b78005430 con 0x7f8b8415cbc0 2023-10-14T11:14:09.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b80ff9640 1 -- 172.21.15.26:0/634209416 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b78003840 con 0x7f8b8415cbc0 2023-10-14T11:14:09.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b8a9c5640 1 -- 172.21.15.26:0/634209416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8415bea0 con 0x7f8b8415cbc0 2023-10-14T11:14:09.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.225+0000 7f8b8a9c5640 1 -- 172.21.15.26:0/634209416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b8415dd00 con 0x7f8b8415cbc0 2023-10-14T11:14:09.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.229+0000 7f8b8a9c5640 1 -- 172.21.15.26:0/634209416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b840c6960 con 0x7f8b8415cbc0 2023-10-14T11:14:09.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.229+0000 7f8b80ff9640 1 -- 172.21.15.26:0/634209416 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8b780039a0 con 0x7f8b8415cbc0 2023-10-14T11:14:09.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.229+0000 7f8b80ff9640 1 --2- 172.21.15.26:0/634209416 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8b700664a0 0x7f8b70068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:09.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.229+0000 7f8b80ff9640 1 -- 172.21.15.26:0/634209416 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f8b78083650 con 0x7f8b8415cbc0 2023-10-14T11:14:09.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.229+0000 7f8b83fff640 1 --2- 172.21.15.26:0/634209416 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8b700664a0 0x7f8b70068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:09.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.229+0000 7f8b83fff640 1 --2- 172.21.15.26:0/634209416 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8b700664a0 0x7f8b70068960 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009b60 tx=0x7f8b74009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:09.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.233+0000 7f8b80ff9640 1 -- 172.21.15.26:0/634209416 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8b78050880 con 0x7f8b8415cbc0 2023-10-14T11:14:09.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.393+0000 7f8b8a9c5640 1 -- 172.21.15.26:0/634209416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f8b8404e170 con 0x7f8b8415cbc0 2023-10-14T11:14:09.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.393+0000 7f8b80ff9640 1 -- 172.21.15.26:0/634209416 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v42) v1 ==== 97+0+11 (secure 0 0 0) 0x7f8b78053ea0 con 0x7f8b8415cbc0 2023-10-14T11:14:09.397 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:14:09.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.397+0000 7f8b8a9c5640 1 -- 172.21.15.26:0/634209416 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8b700664a0 msgr2=0x7f8b70068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:09.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.397+0000 7f8b8a9c5640 1 --2- 172.21.15.26:0/634209416 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8b700664a0 0x7f8b70068960 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009b60 tx=0x7f8b74009190 comp rx=0 tx=0).stop 2023-10-14T11:14:09.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.397+0000 7f8b8a9c5640 1 -- 172.21.15.26:0/634209416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b8415cbc0 msgr2=0x7f8b8415b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:09.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.397+0000 7f8b8a9c5640 1 --2- 172.21.15.26:0/634209416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b8415cbc0 0x7f8b8415b200 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8b7800c3c0 tx=0x7f8b7800c880 comp rx=0 tx=0).stop 2023-10-14T11:14:09.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.397+0000 7f8b8a9c5640 1 -- 172.21.15.26:0/634209416 shutdown_connections 2023-10-14T11:14:09.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.397+0000 7f8b8a9c5640 1 --2- 172.21.15.26:0/634209416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b84160860 0x7f8b8415f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.397+0000 7f8b8a9c5640 1 --2- 172.21.15.26:0/634209416 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8b700664a0 0x7f8b70068960 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.397+0000 7f8b8a9c5640 1 --2- 172.21.15.26:0/634209416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b8415cbc0 0x7f8b8415b200 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.397+0000 7f8b8a9c5640 1 --2- 172.21.15.26:0/634209416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b8406a5a0 0x7f8b84147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.397+0000 7f8b8a9c5640 1 -- 172.21.15.26:0/634209416 >> 172.21.15.26:0/634209416 conn(0x7f8b840b0da0 msgr2=0x7f8b840c4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:09.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.397+0000 7f8b8a9c5640 1 -- 172.21.15.26:0/634209416 shutdown_connections 2023-10-14T11:14:09.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.397+0000 7f8b8a9c5640 1 -- 172.21.15.26:0/634209416 wait complete. 2023-10-14T11:14:09.419 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:14:09.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.561+0000 7fdbf2d94640 1 Processor -- start 2023-10-14T11:14:09.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.561+0000 7fdbf2d94640 1 -- start start 2023-10-14T11:14:09.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.561+0000 7fdbf2d94640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbec0d15d0 0x7fdbec0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:09.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.561+0000 7fdbf2d94640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdbec0d3010 0x7fdbec0c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:09.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.561+0000 7fdbf2d94640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbec0ce770 con 0x7fdbec15cb90 2023-10-14T11:14:09.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.561+0000 7fdbf2d94640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbec0d0600 con 0x7fdbec0d3010 2023-10-14T11:14:09.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.561+0000 7fdbf2d94640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec0c6450 con 0x7fdbec0d15d0 2023-10-14T11:14:09.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.561+0000 7fdbf0b30640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdbec15cb90 0x7fdbec0d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33360/0 (socket says 172.21.15.26:33360) 2023-10-14T11:14:09.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.561+0000 7fdbf0b30640 1 -- 172.21.15.26:0/724123399 learned_addr learned my addr 172.21.15.26:0/724123399 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:09.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.561+0000 7fdbeb7fe640 1 -- 172.21.15.26:0/724123399 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735444737 0 0) 0x7fdbec0ce770 con 0x7fdbec15cb90 2023-10-14T11:14:09.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.561+0000 7fdbebfff640 1 --2- 172.21.15.26:0/724123399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbec0d15d0 0x7fdbec0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:09.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.561+0000 7fdbeb7fe640 1 -- 172.21.15.26:0/724123399 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbdc003530 con 0x7fdbec15cb90 2023-10-14T11:14:09.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.561+0000 7fdbf1331640 1 --2- 172.21.15.26:0/724123399 >> v2:172.21.15.110:3300/0 conn(0x7fdbec0d3010 0x7fdbec0c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:09.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbeb7fe640 1 -- 172.21.15.26:0/724123399 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2364430715 0 0) 0x7fdbdc003530 con 0x7fdbec15cb90 2023-10-14T11:14:09.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbeb7fe640 1 -- 172.21.15.26:0/724123399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbec0d15d0 msgr2=0x7fdbec0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:09.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbeb7fe640 1 --2- 172.21.15.26:0/724123399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbec0d15d0 0x7fdbec0cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbeb7fe640 1 -- 172.21.15.26:0/724123399 >> v2:172.21.15.110:3300/0 conn(0x7fdbec0d3010 msgr2=0x7fdbec0c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:09.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbeb7fe640 1 --2- 172.21.15.26:0/724123399 >> v2:172.21.15.110:3300/0 conn(0x7fdbec0d3010 0x7fdbec0c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbeb7fe640 1 -- 172.21.15.26:0/724123399 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbec0d08a0 con 0x7fdbec15cb90 2023-10-14T11:14:09.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbeb7fe640 1 -- 172.21.15.26:0/724123399 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7fdbe0001800 con 0x7fdbec15cb90 2023-10-14T11:14:09.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbeb7fe640 1 -- 172.21.15.26:0/724123399 >> v1:172.21.15.26:6789/0 conn(0x7fdbec15cb90 legacy=0x7fdbec0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:09.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbeb7fe640 1 --2- 172.21.15.26:0/724123399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbdc003980 0x7fdbdc003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbeb7fe640 1 --2- 172.21.15.26:0/724123399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbdc004330 0x7fdbdc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbeb7fe640 1 --2- 172.21.15.26:0/724123399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbec0d15d0 0x7fdbdc004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbeb7fe640 1 -- 172.21.15.26:0/724123399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec0d0600 con 0x7fdbdc003980 2023-10-14T11:14:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbeb7fe640 1 -- 172.21.15.26:0/724123399 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec0c6450 con 0x7fdbdc004330 2023-10-14T11:14:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbeb7fe640 1 -- 172.21.15.26:0/724123399 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc00b990 con 0x7fdbec0d15d0 2023-10-14T11:14:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbf0b30640 1 --2- 172.21.15.26:0/724123399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbdc003980 0x7fdbdc003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbebfff640 1 --2- 172.21.15.26:0/724123399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbdc004330 0x7fdbdc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbf1331640 1 --2- 172.21.15.26:0/724123399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbec0d15d0 0x7fdbdc004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbf0b30640 1 -- 172.21.15.26:0/724123399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbec0d15d0 msgr2=0x7fdbdc004f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbf0b30640 1 --2- 172.21.15.26:0/724123399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbec0d15d0 0x7fdbdc004f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbf0b30640 1 -- 172.21.15.26:0/724123399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbdc004330 msgr2=0x7fdbdc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:09.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbf0b30640 1 --2- 172.21.15.26:0/724123399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbdc004330 0x7fdbdc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbf0b30640 1 -- 172.21.15.26:0/724123399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc003530 con 0x7fdbdc003980 2023-10-14T11:14:09.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.565+0000 7fdbf0b30640 1 --2- 172.21.15.26:0/724123399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbdc003980 0x7fdbdc003d60 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0003e20 tx=0x7fdbe001d270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da3ec29f33c2232 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:09.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.569+0000 7fdbeb7fe640 1 -- 172.21.15.26:0/724123399 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe00082d0 con 0x7fdbdc003980 2023-10-14T11:14:09.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.569+0000 7fdbeb7fe640 1 -- 172.21.15.26:0/724123399 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe00a8020 con 0x7fdbdc003980 2023-10-14T11:14:09.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.569+0000 7fdbeb7fe640 1 -- 172.21.15.26:0/724123399 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0008650 con 0x7fdbdc003980 2023-10-14T11:14:09.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.569+0000 7fdbf2d94640 1 -- 172.21.15.26:0/724123399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbdc003980 msgr2=0x7fdbdc003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:09.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.569+0000 7fdbf2d94640 1 --2- 172.21.15.26:0/724123399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbdc003980 0x7fdbdc003d60 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0003e20 tx=0x7fdbe001d270 comp rx=0 tx=0).stop 2023-10-14T11:14:09.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.569+0000 7fdbf1331640 1 -- 172.21.15.26:0/724123399 reap_dead start 2023-10-14T11:14:09.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.569+0000 7fdbf2d94640 1 -- 172.21.15.26:0/724123399 shutdown_connections 2023-10-14T11:14:09.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.569+0000 7fdbf2d94640 1 -- 172.21.15.26:0/724123399 >> 172.21.15.26:0/724123399 conn(0x7fdbec09bc50 msgr2=0x7fdbec0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:09.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.569+0000 7fdbf2d94640 1 -- 172.21.15.26:0/724123399 shutdown_connections 2023-10-14T11:14:09.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.569+0000 7fdbf2d94640 1 -- 172.21.15.26:0/724123399 wait complete. 2023-10-14T11:14:09.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.569+0000 7fdbf2d94640 1 Processor -- start 2023-10-14T11:14:09.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.569+0000 7fdbf2d94640 1 -- start start 2023-10-14T11:14:09.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.569+0000 7fdbf2d94640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbdc003980 0x7fdbec153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:09.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.569+0000 7fdbf2d94640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbec0b6740 0x7fdbec154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:09.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.569+0000 7fdbf2d94640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbec157d30 0x7fdbec1581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:09.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.569+0000 7fdbf2d94640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec1586f0 con 0x7fdbec0b6740 2023-10-14T11:14:09.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.569+0000 7fdbf2d94640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec0cad60 con 0x7fdbdc003980 2023-10-14T11:14:09.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.569+0000 7fdbf2d94640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec154d20 con 0x7fdbec157d30 2023-10-14T11:14:09.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.569+0000 7fdbebfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbec0b6740 0x7fdbec154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:09.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.569+0000 7fdbebfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbec0b6740 0x7fdbec154420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35308/0 (socket says 172.21.15.26:35308) 2023-10-14T11:14:09.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.569+0000 7fdbebfff640 1 -- 172.21.15.26:0/1501406667 learned_addr learned my addr 172.21.15.26:0/1501406667 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:09.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.573+0000 7fdbebfff640 1 -- 172.21.15.26:0/1501406667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbec157d30 msgr2=0x7fdbec1581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:09.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.573+0000 7fdbebfff640 1 --2- 172.21.15.26:0/1501406667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbec157d30 0x7fdbec1581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.573+0000 7fdbebfff640 1 -- 172.21.15.26:0/1501406667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbdc003980 msgr2=0x7fdbec153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:09.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.573+0000 7fdbebfff640 1 --2- 172.21.15.26:0/1501406667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbdc003980 0x7fdbec153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.573+0000 7fdbebfff640 1 -- 172.21.15.26:0/1501406667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbec155000 con 0x7fdbec0b6740 2023-10-14T11:14:09.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.573+0000 7fdbebfff640 1 --2- 172.21.15.26:0/1501406667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbec0b6740 0x7fdbec154420 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8011990 tx=0x7fdbd8011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:09.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.573+0000 7fdbe97fa640 1 -- 172.21.15.26:0/1501406667 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8004240 con 0x7fdbec0b6740 2023-10-14T11:14:09.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.573+0000 7fdbe97fa640 1 -- 172.21.15.26:0/1501406667 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd80043a0 con 0x7fdbec0b6740 2023-10-14T11:14:09.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.573+0000 7fdbf2d94640 1 -- 172.21.15.26:0/1501406667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbec1552e0 con 0x7fdbec0b6740 2023-10-14T11:14:09.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.573+0000 7fdbe97fa640 1 -- 172.21.15.26:0/1501406667 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd800f9a0 con 0x7fdbec0b6740 2023-10-14T11:14:09.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.573+0000 7fdbf2d94640 1 -- 172.21.15.26:0/1501406667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbec154960 con 0x7fdbec0b6740 2023-10-14T11:14:09.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.573+0000 7fdbf2d94640 1 -- 172.21.15.26:0/1501406667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbec074010 con 0x7fdbec0b6740 2023-10-14T11:14:09.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.573+0000 7fdbe97fa640 1 -- 172.21.15.26:0/1501406667 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdbd800fb00 con 0x7fdbec0b6740 2023-10-14T11:14:09.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.577+0000 7fdbe97fa640 1 --2- 172.21.15.26:0/1501406667 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdbd00664d0 0x7fdbd0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:09.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.577+0000 7fdbe97fa640 1 -- 172.21.15.26:0/1501406667 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7fdbd8084660 con 0x7fdbec0b6740 2023-10-14T11:14:09.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.577+0000 7fdbf0b30640 1 --2- 172.21.15.26:0/1501406667 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdbd00664d0 0x7fdbd0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:09.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.577+0000 7fdbf0b30640 1 --2- 172.21.15.26:0/1501406667 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdbd00664d0 0x7fdbd0068990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0003df0 tx=0x7fdbe0003820 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:09.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.581+0000 7fdbe97fa640 1 -- 172.21.15.26:0/1501406667 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdbd8051880 con 0x7fdbec0b6740 2023-10-14T11:14:09.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.749+0000 7fdbf2d94640 1 -- 172.21.15.26:0/1501406667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdbec0cf600 con 0x7fdbec0b6740 2023-10-14T11:14:09.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.749+0000 7fdbe97fa640 1 -- 172.21.15.26:0/1501406667 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdbd8054ea0 con 0x7fdbec0b6740 2023-10-14T11:14:09.754 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-10-14T11:14:09.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.753+0000 7fdbf2d94640 1 -- 172.21.15.26:0/1501406667 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdbd00664d0 msgr2=0x7fdbd0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:09.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.753+0000 7fdbf2d94640 1 --2- 172.21.15.26:0/1501406667 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdbd00664d0 0x7fdbd0068990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0003df0 tx=0x7fdbe0003820 comp rx=0 tx=0).stop 2023-10-14T11:14:09.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.753+0000 7fdbf2d94640 1 -- 172.21.15.26:0/1501406667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbec0b6740 msgr2=0x7fdbec154420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:09.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.753+0000 7fdbf2d94640 1 --2- 172.21.15.26:0/1501406667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbec0b6740 0x7fdbec154420 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8011990 tx=0x7fdbd8011e50 comp rx=0 tx=0).stop 2023-10-14T11:14:09.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.753+0000 7fdbf2d94640 1 -- 172.21.15.26:0/1501406667 shutdown_connections 2023-10-14T11:14:09.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.753+0000 7fdbf2d94640 1 --2- 172.21.15.26:0/1501406667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbec157d30 0x7fdbec1581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.753+0000 7fdbf2d94640 1 --2- 172.21.15.26:0/1501406667 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdbd00664d0 0x7fdbd0068990 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.753+0000 7fdbf2d94640 1 --2- 172.21.15.26:0/1501406667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbec0b6740 0x7fdbec154420 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.753+0000 7fdbf2d94640 1 --2- 172.21.15.26:0/1501406667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbdc003980 0x7fdbec153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.753+0000 7fdbf2d94640 1 -- 172.21.15.26:0/1501406667 >> 172.21.15.26:0/1501406667 conn(0x7fdbec09bc50 msgr2=0x7fdbec15a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:09.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.753+0000 7fdbf2d94640 1 -- 172.21.15.26:0/1501406667 shutdown_connections 2023-10-14T11:14:09.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.753+0000 7fdbf2d94640 1 -- 172.21.15.26:0/1501406667 wait complete. 2023-10-14T11:14:09.775 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:14:09.775 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:14:09.785 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:14:09.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.965+0000 7fa6079d9640 1 Processor -- start 2023-10-14T11:14:09.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.965+0000 7fa6079d9640 1 -- start start 2023-10-14T11:14:09.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.965+0000 7fa6079d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa600164520 0x7fa6000ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:09.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.965+0000 7fa6079d9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa6000b07f0 0x7fa6000cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:09.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.965+0000 7fa6079d9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6000c96f0 con 0x7fa6000ad960 2023-10-14T11:14:09.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.965+0000 7fa6079d9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa600164900 con 0x7fa6000b07f0 2023-10-14T11:14:09.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.965+0000 7fa6079d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000cb950 con 0x7fa600164520 2023-10-14T11:14:09.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.965+0000 7fa605f76640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa6000b07f0 0x7fa6000cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:09.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.965+0000 7fa605f76640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa6000b07f0 0x7fa6000cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35314/0 (socket says 172.21.15.26:35314) 2023-10-14T11:14:09.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.965+0000 7fa605f76640 1 -- 172.21.15.26:0/1014001810 learned_addr learned my addr 172.21.15.26:0/1014001810 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:09.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.965+0000 7fa605775640 1 --2- 172.21.15.26:0/1014001810 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa600164520 0x7fa6000ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:09.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.965+0000 7fa605f76640 1 -- 172.21.15.26:0/1014001810 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa600164520 msgr2=0x7fa6000ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:09.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.965+0000 7fa605f76640 1 --2- 172.21.15.26:0/1014001810 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa600164520 0x7fa6000ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.965+0000 7fa605f76640 1 -- 172.21.15.26:0/1014001810 >> v1:172.21.15.110:6789/0 conn(0x7fa6000ad960 legacy=0x7fa6000b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:09.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.965+0000 7fa605f76640 1 -- 172.21.15.26:0/1014001810 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6000cbed0 con 0x7fa6000b07f0 2023-10-14T11:14:09.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.969+0000 7fa605f76640 1 --2- 172.21.15.26:0/1014001810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6000b07f0 0x7fa6000cc870 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009e50 tx=0x7fa5f801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16af7c24db412a9e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:09.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.969+0000 7fa5f7fff640 1 -- 172.21.15.26:0/1014001810 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80a58d0 con 0x7fa6000b07f0 2023-10-14T11:14:09.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.969+0000 7fa5f7fff640 1 -- 172.21.15.26:0/1014001810 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f80a5a30 con 0x7fa6000b07f0 2023-10-14T11:14:09.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.969+0000 7fa5f7fff640 1 -- 172.21.15.26:0/1014001810 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80a5dc0 con 0x7fa6000b07f0 2023-10-14T11:14:09.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.969+0000 7fa6079d9640 1 -- 172.21.15.26:0/1014001810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6000b07f0 msgr2=0x7fa6000cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:09.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.969+0000 7fa6079d9640 1 --2- 172.21.15.26:0/1014001810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6000b07f0 0x7fa6000cc870 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009e50 tx=0x7fa5f801c9e0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.969+0000 7fa6079d9640 1 -- 172.21.15.26:0/1014001810 shutdown_connections 2023-10-14T11:14:09.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.969+0000 7fa6079d9640 1 --2- 172.21.15.26:0/1014001810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6000b07f0 0x7fa6000cc870 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.969+0000 7fa6079d9640 1 --2- 172.21.15.26:0/1014001810 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa600164520 0x7fa6000ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.969+0000 7fa6079d9640 1 -- 172.21.15.26:0/1014001810 >> 172.21.15.26:0/1014001810 conn(0x7fa60006c190 msgr2=0x7fa60006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:09.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.969+0000 7fa6079d9640 1 -- 172.21.15.26:0/1014001810 shutdown_connections 2023-10-14T11:14:09.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.969+0000 7fa6079d9640 1 -- 172.21.15.26:0/1014001810 wait complete. 2023-10-14T11:14:09.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa6079d9640 1 Processor -- start 2023-10-14T11:14:09.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa6079d9640 1 -- start start 2023-10-14T11:14:09.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa6079d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6000ad960 0x7fa6001484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:09.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa6079d9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6000b07f0 0x7fa60015eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:09.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa6079d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa600164520 0x7fa60015d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:09.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa6079d9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000c3870 con 0x7fa6000b07f0 2023-10-14T11:14:09.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa6079d9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000c3b50 con 0x7fa6000ad960 2023-10-14T11:14:09.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa6079d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000c3e30 con 0x7fa600164520 2023-10-14T11:14:09.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa604f74640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6000b07f0 0x7fa60015eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:09.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa604f74640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6000b07f0 0x7fa60015eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35320/0 (socket says 172.21.15.26:35320) 2023-10-14T11:14:09.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa604f74640 1 -- 172.21.15.26:0/1707987471 learned_addr learned my addr 172.21.15.26:0/1707987471 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:09.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa605f76640 1 --2- 172.21.15.26:0/1707987471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa600164520 0x7fa60015d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:09.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa605775640 1 --2- 172.21.15.26:0/1707987471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6000ad960 0x7fa6001484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:09.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa604f74640 1 -- 172.21.15.26:0/1707987471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa600164520 msgr2=0x7fa60015d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:09.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa604f74640 1 --2- 172.21.15.26:0/1707987471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa600164520 0x7fa60015d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa604f74640 1 -- 172.21.15.26:0/1707987471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6000ad960 msgr2=0x7fa6001484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:09.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa604f74640 1 --2- 172.21.15.26:0/1707987471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6000ad960 0x7fa6001484e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:09.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa604f74640 1 -- 172.21.15.26:0/1707987471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f8009b30 con 0x7fa6000b07f0 2023-10-14T11:14:09.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa604f74640 1 --2- 172.21.15.26:0/1707987471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6000b07f0 0x7fa60015eb80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000c3c0 tx=0x7fa5f000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:09.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa5f5ffb640 1 -- 172.21.15.26:0/1707987471 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00052d0 con 0x7fa6000b07f0 2023-10-14T11:14:09.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa5f5ffb640 1 -- 172.21.15.26:0/1707987471 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f0005430 con 0x7fa6000b07f0 2023-10-14T11:14:09.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa5f5ffb640 1 -- 172.21.15.26:0/1707987471 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0003840 con 0x7fa6000b07f0 2023-10-14T11:14:09.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa6079d9640 1 -- 172.21.15.26:0/1707987471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6000c4110 con 0x7fa6000b07f0 2023-10-14T11:14:09.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa6079d9640 1 -- 172.21.15.26:0/1707987471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa600148a20 con 0x7fa6000b07f0 2023-10-14T11:14:09.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.973+0000 7fa6079d9640 1 -- 172.21.15.26:0/1707987471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa600074010 con 0x7fa6000b07f0 2023-10-14T11:14:09.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.977+0000 7fa5f5ffb640 1 -- 172.21.15.26:0/1707987471 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa5f00039a0 con 0x7fa6000b07f0 2023-10-14T11:14:09.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.977+0000 7fa5f5ffb640 1 --2- 172.21.15.26:0/1707987471 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5e40664a0 0x7fa5e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:09.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.977+0000 7fa5f5ffb640 1 -- 172.21.15.26:0/1707987471 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7fa5f0083680 con 0x7fa6000b07f0 2023-10-14T11:14:09.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.977+0000 7fa605775640 1 --2- 172.21.15.26:0/1707987471 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5e40664a0 0x7fa5e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:09.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.977+0000 7fa605775640 1 --2- 172.21.15.26:0/1707987471 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5e40664a0 0x7fa5e4068960 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc009b60 tx=0x7fa5fc009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:09.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:09.981+0000 7fa5f5ffb640 1 -- 172.21.15.26:0/1707987471 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa5f0050820 con 0x7fa6000b07f0 2023-10-14T11:14:10.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.141+0000 7fa6079d9640 1 -- 172.21.15.26:0/1707987471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6000c45c0 con 0x7fa6000b07f0 2023-10-14T11:14:10.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.141+0000 7fa5f5ffb640 1 -- 172.21.15.26:0/1707987471 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18578 (secure 0 0 0) 0x7fa5f0053e40 con 0x7fa6000b07f0 2023-10-14T11:14:10.146 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:10.147 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":42,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:14:01.292164+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:13:48.453821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:13:49.623527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-10-14T11:13:59.245615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:14:10.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.145+0000 7fa6079d9640 1 -- 172.21.15.26:0/1707987471 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5e40664a0 msgr2=0x7fa5e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:10.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.145+0000 7fa6079d9640 1 --2- 172.21.15.26:0/1707987471 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5e40664a0 0x7fa5e4068960 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc009b60 tx=0x7fa5fc009190 comp rx=0 tx=0).stop 2023-10-14T11:14:10.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.145+0000 7fa6079d9640 1 -- 172.21.15.26:0/1707987471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6000b07f0 msgr2=0x7fa60015eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:10.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.145+0000 7fa6079d9640 1 --2- 172.21.15.26:0/1707987471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6000b07f0 0x7fa60015eb80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000c3c0 tx=0x7fa5f000c880 comp rx=0 tx=0).stop 2023-10-14T11:14:10.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.145+0000 7fa6079d9640 1 -- 172.21.15.26:0/1707987471 shutdown_connections 2023-10-14T11:14:10.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.145+0000 7fa6079d9640 1 --2- 172.21.15.26:0/1707987471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa600164520 0x7fa60015d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.145+0000 7fa6079d9640 1 --2- 172.21.15.26:0/1707987471 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5e40664a0 0x7fa5e4068960 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.145+0000 7fa6079d9640 1 --2- 172.21.15.26:0/1707987471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6000b07f0 0x7fa60015eb80 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.145+0000 7fa6079d9640 1 --2- 172.21.15.26:0/1707987471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6000ad960 0x7fa6001484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.145+0000 7fa6079d9640 1 -- 172.21.15.26:0/1707987471 >> 172.21.15.26:0/1707987471 conn(0x7fa60006c190 msgr2=0x7fa6000ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:10.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.145+0000 7fa6079d9640 1 -- 172.21.15.26:0/1707987471 shutdown_connections 2023-10-14T11:14:10.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.145+0000 7fa6079d9640 1 -- 172.21.15.26:0/1707987471 wait complete. 2023-10-14T11:14:10.168 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'testcephfs1_metadata', 'create_time': '2023-10-14T11:13:48.453821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'testcephfs1_data', 'create_time': '2023-10-14T11:13:49.623527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-10-14T11:13:59.245615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:14:10.169 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:14:10.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.313+0000 7fe6f66c9640 1 Processor -- start 2023-10-14T11:14:10.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.313+0000 7fe6f66c9640 1 -- start start 2023-10-14T11:14:10.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.313+0000 7fe6f66c9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe6f015cf40 0x7fe6f0071b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:10.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.313+0000 7fe6f66c9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f006ac10 con 0x7fe6f015cb60 2023-10-14T11:14:10.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.313+0000 7fe6f66c9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f0072110 con 0x7fe6f006f560 2023-10-14T11:14:10.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.313+0000 7fe6f66c9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f00723f0 con 0x7fe6f015cf40 2023-10-14T11:14:10.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.313+0000 7fe6effff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe6f015cb60 0x7fe6f006ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33368/0 (socket says 172.21.15.26:33368) 2023-10-14T11:14:10.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.313+0000 7fe6effff640 1 -- 172.21.15.26:0/904861657 learned_addr learned my addr 172.21.15.26:0/904861657 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:10.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.313+0000 7fe6f4c66640 1 --2- 172.21.15.26:0/904861657 >> v2:172.21.15.110:3300/0 conn(0x7fe6f015cf40 0x7fe6f0071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:10.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.313+0000 7fe6eeffd640 1 -- 172.21.15.26:0/904861657 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 284354418 0 0) 0x7fe6f006ac10 con 0x7fe6f015cb60 2023-10-14T11:14:10.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.313+0000 7fe6eeffd640 1 -- 172.21.15.26:0/904861657 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6d8003530 con 0x7fe6f015cb60 2023-10-14T11:14:10.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.313+0000 7fe6f4c66640 1 -- 172.21.15.26:0/904861657 >> v1:172.21.15.110:6789/0 conn(0x7fe6f006f560 legacy=0x7fe6f0071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:10.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.313+0000 7fe6f4c66640 1 -- 172.21.15.26:0/904861657 >> v1:172.21.15.26:6789/0 conn(0x7fe6f015cb60 legacy=0x7fe6f006ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:10.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.313+0000 7fe6f4c66640 1 -- 172.21.15.26:0/904861657 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f006a5c0 con 0x7fe6f015cf40 2023-10-14T11:14:10.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.317+0000 7fe6f4c66640 1 --2- 172.21.15.26:0/904861657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6f015cf40 0x7fe6f0071b10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8009d90 tx=0x7fe6e801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c4beb36c754402 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:10.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.317+0000 7fe6eeffd640 1 -- 172.21.15.26:0/904861657 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e80a58f0 con 0x7fe6f015cf40 2023-10-14T11:14:10.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.317+0000 7fe6eeffd640 1 -- 172.21.15.26:0/904861657 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e80a5a50 con 0x7fe6f015cf40 2023-10-14T11:14:10.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.317+0000 7fe6eeffd640 1 -- 172.21.15.26:0/904861657 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e80a5de0 con 0x7fe6f015cf40 2023-10-14T11:14:10.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.317+0000 7fe6f66c9640 1 -- 172.21.15.26:0/904861657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6f015cf40 msgr2=0x7fe6f0071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:10.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.317+0000 7fe6f66c9640 1 --2- 172.21.15.26:0/904861657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6f015cf40 0x7fe6f0071b10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8009d90 tx=0x7fe6e801c920 comp rx=0 tx=0).stop 2023-10-14T11:14:10.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.317+0000 7fe6f66c9640 1 -- 172.21.15.26:0/904861657 shutdown_connections 2023-10-14T11:14:10.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.317+0000 7fe6f66c9640 1 --2- 172.21.15.26:0/904861657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6f015cf40 0x7fe6f0071b10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.317+0000 7fe6f66c9640 1 -- 172.21.15.26:0/904861657 >> 172.21.15.26:0/904861657 conn(0x7fe6f00cf7a0 msgr2=0x7fe6f00cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:10.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.317+0000 7fe6f66c9640 1 -- 172.21.15.26:0/904861657 shutdown_connections 2023-10-14T11:14:10.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.317+0000 7fe6f66c9640 1 -- 172.21.15.26:0/904861657 wait complete. 2023-10-14T11:14:10.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6f66c9640 1 Processor -- start 2023-10-14T11:14:10.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6f66c9640 1 -- start start 2023-10-14T11:14:10.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6f66c9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6f006f560 0x7fe6f0157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:10.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6f66c9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6f015cb60 0x7fe6f00b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:10.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6f66c9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6f015cf40 0x7fe6f0150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:10.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6f66c9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f00b36b0 con 0x7fe6f015cf40 2023-10-14T11:14:10.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6f66c9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f00b2aa0 con 0x7fe6f006f560 2023-10-14T11:14:10.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6f66c9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f00b2d80 con 0x7fe6f015cb60 2023-10-14T11:14:10.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6f4c66640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6f015cf40 0x7fe6f0150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:10.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6f4c66640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6f015cf40 0x7fe6f0150bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35322/0 (socket says 172.21.15.26:35322) 2023-10-14T11:14:10.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6f4c66640 1 -- 172.21.15.26:0/2938200011 learned_addr learned my addr 172.21.15.26:0/2938200011 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:10.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6effff640 1 --2- 172.21.15.26:0/2938200011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6f006f560 0x7fe6f0157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:10.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6ef7fe640 1 --2- 172.21.15.26:0/2938200011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6f015cb60 0x7fe6f00b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:10.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6f4c66640 1 -- 172.21.15.26:0/2938200011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6f015cb60 msgr2=0x7fe6f00b23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:10.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6f4c66640 1 --2- 172.21.15.26:0/2938200011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6f015cb60 0x7fe6f00b23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6f4c66640 1 -- 172.21.15.26:0/2938200011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6f006f560 msgr2=0x7fe6f0157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:10.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6f4c66640 1 --2- 172.21.15.26:0/2938200011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6f006f560 0x7fe6f0157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6f4c66640 1 -- 172.21.15.26:0/2938200011 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e8009a70 con 0x7fe6f015cf40 2023-10-14T11:14:10.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6f4c66640 1 --2- 172.21.15.26:0/2938200011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6f015cf40 0x7fe6f0150bb0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8009d90 tx=0x7fe6e80196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:10.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6ecff9640 1 -- 172.21.15.26:0/2938200011 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e80ad850 con 0x7fe6f015cf40 2023-10-14T11:14:10.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6ecff9640 1 -- 172.21.15.26:0/2938200011 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e80ad9b0 con 0x7fe6f015cf40 2023-10-14T11:14:10.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6f66c9640 1 -- 172.21.15.26:0/2938200011 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f00b3060 con 0x7fe6f015cf40 2023-10-14T11:14:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6ecff9640 1 -- 172.21.15.26:0/2938200011 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e80add80 con 0x7fe6f015cf40 2023-10-14T11:14:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.321+0000 7fe6f66c9640 1 -- 172.21.15.26:0/2938200011 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f01510f0 con 0x7fe6f015cf40 2023-10-14T11:14:10.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.325+0000 7fe6f66c9640 1 -- 172.21.15.26:0/2938200011 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f00b3820 con 0x7fe6f015cf40 2023-10-14T11:14:10.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.325+0000 7fe6ecff9640 1 -- 172.21.15.26:0/2938200011 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe6e80b4070 con 0x7fe6f015cf40 2023-10-14T11:14:10.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.325+0000 7fe6ecff9640 1 --2- 172.21.15.26:0/2938200011 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe6dc0664d0 0x7fe6dc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:10.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.325+0000 7fe6ecff9640 1 -- 172.21.15.26:0/2938200011 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7fe6e811f2a0 con 0x7fe6f015cf40 2023-10-14T11:14:10.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.325+0000 7fe6effff640 1 --2- 172.21.15.26:0/2938200011 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe6dc0664d0 0x7fe6dc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:10.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.325+0000 7fe6effff640 1 --2- 172.21.15.26:0/2938200011 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe6dc0664d0 0x7fe6dc068990 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe6e00011f0 tx=0x7fe6e0007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:10.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.329+0000 7fe6ecff9640 1 -- 172.21.15.26:0/2938200011 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe6e80ec560 con 0x7fe6f015cf40 2023-10-14T11:14:10.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.485+0000 7fe6f66c9640 1 -- 172.21.15.26:0/2938200011 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe6f004e170 con 0x7fe6f015cf40 2023-10-14T11:14:10.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.489+0000 7fe6ecff9640 1 -- 172.21.15.26:0/2938200011 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe6e80efb80 con 0x7fe6f015cf40 2023-10-14T11:14:10.492 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:14:10.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.489+0000 7fe6f66c9640 1 -- 172.21.15.26:0/2938200011 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe6dc0664d0 msgr2=0x7fe6dc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:10.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.489+0000 7fe6f66c9640 1 --2- 172.21.15.26:0/2938200011 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe6dc0664d0 0x7fe6dc068990 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe6e00011f0 tx=0x7fe6e0007d40 comp rx=0 tx=0).stop 2023-10-14T11:14:10.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.489+0000 7fe6f66c9640 1 -- 172.21.15.26:0/2938200011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6f015cf40 msgr2=0x7fe6f0150bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:10.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.489+0000 7fe6f66c9640 1 --2- 172.21.15.26:0/2938200011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6f015cf40 0x7fe6f0150bb0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8009d90 tx=0x7fe6e80196c0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.489+0000 7fe6f66c9640 1 -- 172.21.15.26:0/2938200011 shutdown_connections 2023-10-14T11:14:10.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.489+0000 7fe6f66c9640 1 --2- 172.21.15.26:0/2938200011 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe6dc0664d0 0x7fe6dc068990 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.489+0000 7fe6f66c9640 1 --2- 172.21.15.26:0/2938200011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6f015cf40 0x7fe6f0150bb0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.489+0000 7fe6f66c9640 1 --2- 172.21.15.26:0/2938200011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6f015cb60 0x7fe6f00b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.489+0000 7fe6f66c9640 1 --2- 172.21.15.26:0/2938200011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6f006f560 0x7fe6f0157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.489+0000 7fe6f66c9640 1 -- 172.21.15.26:0/2938200011 >> 172.21.15.26:0/2938200011 conn(0x7fe6f00cf7a0 msgr2=0x7fe6f015eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:10.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.489+0000 7fe6f66c9640 1 -- 172.21.15.26:0/2938200011 shutdown_connections 2023-10-14T11:14:10.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.489+0000 7fe6f66c9640 1 -- 172.21.15.26:0/2938200011 wait complete. 2023-10-14T11:14:10.513 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_metadata pg_num 2023-10-14T11:14:10.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.657+0000 7f91e3291640 1 Processor -- start 2023-10-14T11:14:10.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.657+0000 7f91e3291640 1 -- start start 2023-10-14T11:14:10.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.657+0000 7f91e3291640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91dc15cba0 0x7f91dc0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:10.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.657+0000 7f91e3291640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f91dc0b84e0 0x7f91dc0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:10.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.657+0000 7f91e3291640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91dc0d0040 0x7f91dc0d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:10.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.657+0000 7f91e3291640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91dc0d1460 con 0x7f91dc15cba0 2023-10-14T11:14:10.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.657+0000 7f91e3291640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91dc0d04b0 con 0x7f91dc0b84e0 2023-10-14T11:14:10.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.657+0000 7f91e3291640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc0d1670 con 0x7f91dc0d0040 2023-10-14T11:14:10.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.657+0000 7f91e102d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91dc15cba0 0x7f91dc0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:10.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.657+0000 7f91e102d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91dc15cba0 0x7f91dc0d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35324/0 (socket says 172.21.15.26:35324) 2023-10-14T11:14:10.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.657+0000 7f91e102d640 1 -- 172.21.15.26:0/2018818295 learned_addr learned my addr 172.21.15.26:0/2018818295 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:10.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.657+0000 7f91e182e640 1 --2- 172.21.15.26:0/2018818295 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91dc0d0040 0x7f91dc0d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:10.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.657+0000 7f91e082c640 1 --2- 172.21.15.26:0/2018818295 >> v2:172.21.15.110:3300/0 conn(0x7f91dc0b84e0 0x7f91dc0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:10.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.657+0000 7f91e102d640 1 -- 172.21.15.26:0/2018818295 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91dc0d0040 msgr2=0x7f91dc0d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:10.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.657+0000 7f91e102d640 1 --2- 172.21.15.26:0/2018818295 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91dc0d0040 0x7f91dc0d2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.657+0000 7f91e102d640 1 -- 172.21.15.26:0/2018818295 >> v2:172.21.15.110:3300/0 conn(0x7f91dc0b84e0 msgr2=0x7f91dc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:10.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.657+0000 7f91e102d640 1 --2- 172.21.15.26:0/2018818295 >> v2:172.21.15.110:3300/0 conn(0x7f91dc0b84e0 0x7f91dc0cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.657+0000 7f91e102d640 1 -- 172.21.15.26:0/2018818295 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc0d1950 con 0x7f91dc15cba0 2023-10-14T11:14:10.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.661+0000 7f91e102d640 1 --2- 172.21.15.26:0/2018818295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91dc15cba0 0x7f91dc0d0f20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0cf2f0 tx=0x7f91d801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fbf42852c550450 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:10.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.661+0000 7f91d3fff640 1 -- 172.21.15.26:0/2018818295 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d80ab600 con 0x7f91dc15cba0 2023-10-14T11:14:10.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.661+0000 7f91d3fff640 1 -- 172.21.15.26:0/2018818295 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d80a7050 con 0x7f91dc15cba0 2023-10-14T11:14:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.661+0000 7f91d3fff640 1 -- 172.21.15.26:0/2018818295 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d80ab980 con 0x7f91dc15cba0 2023-10-14T11:14:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.661+0000 7f91e3291640 1 -- 172.21.15.26:0/2018818295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91dc15cba0 msgr2=0x7f91dc0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.661+0000 7f91e3291640 1 --2- 172.21.15.26:0/2018818295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91dc15cba0 0x7f91dc0d0f20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0cf2f0 tx=0x7f91d801c240 comp rx=0 tx=0).stop 2023-10-14T11:14:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.661+0000 7f91e3291640 1 -- 172.21.15.26:0/2018818295 shutdown_connections 2023-10-14T11:14:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.661+0000 7f91e3291640 1 --2- 172.21.15.26:0/2018818295 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91dc0d0040 0x7f91dc0d2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.661+0000 7f91e3291640 1 --2- 172.21.15.26:0/2018818295 >> v2:172.21.15.110:3300/0 conn(0x7f91dc0b84e0 0x7f91dc0cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.661+0000 7f91e3291640 1 --2- 172.21.15.26:0/2018818295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91dc15cba0 0x7f91dc0d0f20 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.661+0000 7f91e3291640 1 -- 172.21.15.26:0/2018818295 >> 172.21.15.26:0/2018818295 conn(0x7f91dc0719c0 msgr2=0x7f91dc071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:10.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.661+0000 7f91e3291640 1 -- 172.21.15.26:0/2018818295 shutdown_connections 2023-10-14T11:14:10.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.661+0000 7f91e3291640 1 -- 172.21.15.26:0/2018818295 wait complete. 2023-10-14T11:14:10.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91e3291640 1 Processor -- start 2023-10-14T11:14:10.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91e3291640 1 -- start start 2023-10-14T11:14:10.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91e3291640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91dc0b84e0 0x7f91dc14f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:10.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91e3291640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91dc0d0040 0x7f91dc15f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:10.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91e3291640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91dc15cba0 0x7f91dc0c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:10.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91e3291640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc160470 con 0x7f91dc0d0040 2023-10-14T11:14:10.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91e3291640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc0c9fd0 con 0x7f91dc15cba0 2023-10-14T11:14:10.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91e3291640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc15fbd0 con 0x7f91dc0b84e0 2023-10-14T11:14:10.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91e082c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91dc0d0040 0x7f91dc15f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:10.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91e082c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91dc0d0040 0x7f91dc15f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35340/0 (socket says 172.21.15.26:35340) 2023-10-14T11:14:10.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91e082c640 1 -- 172.21.15.26:0/3581341850 learned_addr learned my addr 172.21.15.26:0/3581341850 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:10.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91e102d640 1 --2- 172.21.15.26:0/3581341850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91dc0b84e0 0x7f91dc14f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:10.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91e182e640 1 --2- 172.21.15.26:0/3581341850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91dc15cba0 0x7f91dc0c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:10.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91e082c640 1 -- 172.21.15.26:0/3581341850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91dc0b84e0 msgr2=0x7f91dc14f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:10.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91e082c640 1 --2- 172.21.15.26:0/3581341850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91dc0b84e0 0x7f91dc14f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91e082c640 1 -- 172.21.15.26:0/3581341850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91dc15cba0 msgr2=0x7f91dc0c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:10.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91e082c640 1 --2- 172.21.15.26:0/3581341850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91dc15cba0 0x7f91dc0c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91e082c640 1 -- 172.21.15.26:0/3581341850 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d80094d0 con 0x7f91dc0d0040 2023-10-14T11:14:10.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91e082c640 1 --2- 172.21.15.26:0/3581341850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91dc0d0040 0x7f91dc15f120 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f91cc00d800 tx=0x7f91cc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:10.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91d1ffb640 1 -- 172.21.15.26:0/3581341850 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc0096a0 con 0x7f91dc0d0040 2023-10-14T11:14:10.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91d1ffb640 1 -- 172.21.15.26:0/3581341850 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91cc009800 con 0x7f91dc0d0040 2023-10-14T11:14:10.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91e3291640 1 -- 172.21.15.26:0/3581341850 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91dc15feb0 con 0x7f91dc0d0040 2023-10-14T11:14:10.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.665+0000 7f91d1ffb640 1 -- 172.21.15.26:0/3581341850 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc009b70 con 0x7f91dc0d0040 2023-10-14T11:14:10.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.669+0000 7f91e3291640 1 -- 172.21.15.26:0/3581341850 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91dc150440 con 0x7f91dc0d0040 2023-10-14T11:14:10.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.669+0000 7f91e3291640 1 -- 172.21.15.26:0/3581341850 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91dc04e170 con 0x7f91dc0d0040 2023-10-14T11:14:10.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.669+0000 7f91d1ffb640 1 -- 172.21.15.26:0/3581341850 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f91cc009cd0 con 0x7f91dc0d0040 2023-10-14T11:14:10.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.669+0000 7f91d1ffb640 1 --2- 172.21.15.26:0/3581341850 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f91c00664a0 0x7f91c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:10.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.669+0000 7f91d1ffb640 1 -- 172.21.15.26:0/3581341850 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f91cc0847a0 con 0x7f91dc0d0040 2023-10-14T11:14:10.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.669+0000 7f91e102d640 1 --2- 172.21.15.26:0/3581341850 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f91c00664a0 0x7f91c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:10.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.669+0000 7f91e102d640 1 --2- 172.21.15.26:0/3581341850 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f91c00664a0 0x7f91c0068960 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f91d80ad000 tx=0x7f91d80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:10.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.673+0000 7f91d1ffb640 1 -- 172.21.15.26:0/3581341850 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f91cc0519d0 con 0x7f91dc0d0040 2023-10-14T11:14:10.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.829+0000 7f91e3291640 1 -- 172.21.15.26:0/3581341850 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"} v 0) v1 -- 0x7f91dc15b520 con 0x7f91dc0d0040 2023-10-14T11:14:10.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.829+0000 7f91d1ffb640 1 -- 172.21.15.26:0/3581341850 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"}]=0 v42) v1 ==== 109+0+11 (secure 0 0 0) 0x7f91cc054ff0 con 0x7f91dc0d0040 2023-10-14T11:14:10.833 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:14:10.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.829+0000 7f91e3291640 1 -- 172.21.15.26:0/3581341850 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f91c00664a0 msgr2=0x7f91c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:10.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.829+0000 7f91e3291640 1 --2- 172.21.15.26:0/3581341850 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f91c00664a0 0x7f91c0068960 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f91d80ad000 tx=0x7f91d80a6000 comp rx=0 tx=0).stop 2023-10-14T11:14:10.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.829+0000 7f91e3291640 1 -- 172.21.15.26:0/3581341850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91dc0d0040 msgr2=0x7f91dc15f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:10.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.829+0000 7f91e3291640 1 --2- 172.21.15.26:0/3581341850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91dc0d0040 0x7f91dc15f120 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f91cc00d800 tx=0x7f91cc00dcc0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.829+0000 7f91e3291640 1 -- 172.21.15.26:0/3581341850 shutdown_connections 2023-10-14T11:14:10.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.829+0000 7f91e3291640 1 --2- 172.21.15.26:0/3581341850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91dc15cba0 0x7f91dc0c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.829+0000 7f91e3291640 1 --2- 172.21.15.26:0/3581341850 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f91c00664a0 0x7f91c0068960 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.829+0000 7f91e3291640 1 --2- 172.21.15.26:0/3581341850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91dc0d0040 0x7f91dc15f120 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.829+0000 7f91e3291640 1 --2- 172.21.15.26:0/3581341850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91dc0b84e0 0x7f91dc14f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:10.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.829+0000 7f91e3291640 1 -- 172.21.15.26:0/3581341850 >> 172.21.15.26:0/3581341850 conn(0x7f91dc0719c0 msgr2=0x7f91dc06b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:10.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.829+0000 7f91e3291640 1 -- 172.21.15.26:0/3581341850 shutdown_connections 2023-10-14T11:14:10.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.829+0000 7f91e3291640 1 -- 172.21.15.26:0/3581341850 wait complete. 2023-10-14T11:14:10.854 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_data pg_num 2023-10-14T11:14:11.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.997+0000 7fa994605640 1 Processor -- start 2023-10-14T11:14:11.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:10.997+0000 7fa994605640 1 -- start start 2023-10-14T11:14:11.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.001+0000 7fa994605640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa98c069e90 0x7fa98c06d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:11.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.001+0000 7fa994605640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa98c06a270 0x7fa98c0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:11.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.001+0000 7fa994605640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa98c0702f0 0x7fa98c070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:11.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.001+0000 7fa994605640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98c0cb090 con 0x7fa98c069e90 2023-10-14T11:14:11.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.001+0000 7fa994605640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98c15ae30 con 0x7fa98c0702f0 2023-10-14T11:14:11.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.001+0000 7fa994605640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0ca510 con 0x7fa98c06a270 2023-10-14T11:14:11.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.001+0000 7fa9923a1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa98c069e90 0x7fa98c06d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:11.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.001+0000 7fa9923a1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa98c069e90 0x7fa98c06d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35356/0 (socket says 172.21.15.26:35356) 2023-10-14T11:14:11.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.001+0000 7fa9923a1640 1 -- 172.21.15.26:0/3978373796 learned_addr learned my addr 172.21.15.26:0/3978373796 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:11.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.001+0000 7fa992ba2640 1 --2- 172.21.15.26:0/3978373796 >> v2:172.21.15.110:3300/0 conn(0x7fa98c0702f0 0x7fa98c070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:11.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.001+0000 7fa991ba0640 1 --2- 172.21.15.26:0/3978373796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa98c06a270 0x7fa98c0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:11.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.001+0000 7fa9923a1640 1 -- 172.21.15.26:0/3978373796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa98c06a270 msgr2=0x7fa98c0c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:11.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.001+0000 7fa9923a1640 1 --2- 172.21.15.26:0/3978373796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa98c06a270 0x7fa98c0c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.001+0000 7fa9923a1640 1 -- 172.21.15.26:0/3978373796 >> v2:172.21.15.110:3300/0 conn(0x7fa98c0702f0 msgr2=0x7fa98c070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:11.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.001+0000 7fa9923a1640 1 --2- 172.21.15.26:0/3978373796 >> v2:172.21.15.110:3300/0 conn(0x7fa98c0702f0 0x7fa98c070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.001+0000 7fa9923a1640 1 -- 172.21.15.26:0/3978373796 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c0ca7f0 con 0x7fa98c069e90 2023-10-14T11:14:11.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.001+0000 7fa992ba2640 1 --2- 172.21.15.26:0/3978373796 >> v2:172.21.15.110:3300/0 conn(0x7fa98c0702f0 0x7fa98c070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:11.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.001+0000 7fa991ba0640 1 --2- 172.21.15.26:0/3978373796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa98c06a270 0x7fa98c0c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:11.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.001+0000 7fa9923a1640 1 --2- 172.21.15.26:0/3978373796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa98c069e90 0x7fa98c06d010 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0b16e0 tx=0x7fa98801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2704417674bb3b13 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:11.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.005+0000 7fa99139f640 1 -- 172.21.15.26:0/3978373796 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9880aa5f0 con 0x7fa98c069e90 2023-10-14T11:14:11.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.005+0000 7fa99139f640 1 -- 172.21.15.26:0/3978373796 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9880aa750 con 0x7fa98c069e90 2023-10-14T11:14:11.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.005+0000 7fa99139f640 1 -- 172.21.15.26:0/3978373796 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9880aaae0 con 0x7fa98c069e90 2023-10-14T11:14:11.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.005+0000 7fa994605640 1 -- 172.21.15.26:0/3978373796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa98c069e90 msgr2=0x7fa98c06d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:11.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.005+0000 7fa994605640 1 --2- 172.21.15.26:0/3978373796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa98c069e90 0x7fa98c06d010 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0b16e0 tx=0x7fa98801c4d0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.005+0000 7fa994605640 1 -- 172.21.15.26:0/3978373796 shutdown_connections 2023-10-14T11:14:11.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.005+0000 7fa994605640 1 --2- 172.21.15.26:0/3978373796 >> v2:172.21.15.110:3300/0 conn(0x7fa98c0702f0 0x7fa98c070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.005+0000 7fa994605640 1 --2- 172.21.15.26:0/3978373796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa98c06a270 0x7fa98c0c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.005+0000 7fa994605640 1 --2- 172.21.15.26:0/3978373796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa98c069e90 0x7fa98c06d010 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.005+0000 7fa994605640 1 -- 172.21.15.26:0/3978373796 >> 172.21.15.26:0/3978373796 conn(0x7fa98c0b0da0 msgr2=0x7fa98c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:11.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.005+0000 7fa994605640 1 -- 172.21.15.26:0/3978373796 shutdown_connections 2023-10-14T11:14:11.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.005+0000 7fa994605640 1 -- 172.21.15.26:0/3978373796 wait complete. 2023-10-14T11:14:11.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.005+0000 7fa994605640 1 Processor -- start 2023-10-14T11:14:11.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.005+0000 7fa994605640 1 -- start start 2023-10-14T11:14:11.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.005+0000 7fa994605640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa98c069e90 0x7fa98c156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:11.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.005+0000 7fa994605640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa98c06a270 0x7fa98c152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:11.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.005+0000 7fa994605640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa98c0702f0 0x7fa98c154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:11.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.005+0000 7fa994605640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c15ca50 con 0x7fa98c06a270 2023-10-14T11:14:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.005+0000 7fa994605640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c15c120 con 0x7fa98c0702f0 2023-10-14T11:14:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.005+0000 7fa994605640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c15c400 con 0x7fa98c069e90 2023-10-14T11:14:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.009+0000 7fa991ba0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa98c06a270 0x7fa98c152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.009+0000 7fa991ba0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa98c06a270 0x7fa98c152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35360/0 (socket says 172.21.15.26:35360) 2023-10-14T11:14:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.009+0000 7fa991ba0640 1 -- 172.21.15.26:0/1346899284 learned_addr learned my addr 172.21.15.26:0/1346899284 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.009+0000 7fa9923a1640 1 --2- 172.21.15.26:0/1346899284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa98c069e90 0x7fa98c156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.009+0000 7fa992ba2640 1 --2- 172.21.15.26:0/1346899284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa98c0702f0 0x7fa98c154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.009+0000 7fa991ba0640 1 -- 172.21.15.26:0/1346899284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa98c069e90 msgr2=0x7fa98c156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.009+0000 7fa991ba0640 1 --2- 172.21.15.26:0/1346899284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa98c069e90 0x7fa98c156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.009+0000 7fa991ba0640 1 -- 172.21.15.26:0/1346899284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa98c0702f0 msgr2=0x7fa98c154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.009+0000 7fa991ba0640 1 --2- 172.21.15.26:0/1346899284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa98c0702f0 0x7fa98c154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.009+0000 7fa991ba0640 1 -- 172.21.15.26:0/1346899284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9880094d0 con 0x7fa98c06a270 2023-10-14T11:14:11.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.009+0000 7fa991ba0640 1 --2- 172.21.15.26:0/1346899284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa98c06a270 0x7fa98c152f00 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00c7c0 tx=0x7fa97c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:11.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.009+0000 7fa982ffd640 1 -- 172.21.15.26:0/1346899284 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c007a30 con 0x7fa98c06a270 2023-10-14T11:14:11.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.009+0000 7fa982ffd640 1 -- 172.21.15.26:0/1346899284 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c007b90 con 0x7fa98c06a270 2023-10-14T11:14:11.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.009+0000 7fa982ffd640 1 -- 172.21.15.26:0/1346899284 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c00ce70 con 0x7fa98c06a270 2023-10-14T11:14:11.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.009+0000 7fa994605640 1 -- 172.21.15.26:0/1346899284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98c15c6e0 con 0x7fa98c06a270 2023-10-14T11:14:11.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.009+0000 7fa994605640 1 -- 172.21.15.26:0/1346899284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98c153440 con 0x7fa98c06a270 2023-10-14T11:14:11.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.009+0000 7fa994605640 1 -- 172.21.15.26:0/1346899284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa98c15c870 con 0x7fa98c06a270 2023-10-14T11:14:11.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.009+0000 7fa982ffd640 1 -- 172.21.15.26:0/1346899284 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa97c0113f0 con 0x7fa98c06a270 2023-10-14T11:14:11.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.009+0000 7fa982ffd640 1 --2- 172.21.15.26:0/1346899284 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa9700664d0 0x7fa970068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:11.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.013+0000 7fa982ffd640 1 -- 172.21.15.26:0/1346899284 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7fa97c084220 con 0x7fa98c06a270 2023-10-14T11:14:11.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.013+0000 7fa9923a1640 1 --2- 172.21.15.26:0/1346899284 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa9700664d0 0x7fa970068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:11.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.013+0000 7fa9923a1640 1 --2- 172.21.15.26:0/1346899284 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa9700664d0 0x7fa970068990 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa9880ae000 tx=0x7fa9880b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:11.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.013+0000 7fa982ffd640 1 -- 172.21.15.26:0/1346899284 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa97c051450 con 0x7fa98c06a270 2023-10-14T11:14:11.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.169+0000 7fa994605640 1 -- 172.21.15.26:0/1346899284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"} v 0) v1 -- 0x7fa98c04e170 con 0x7fa98c06a270 2023-10-14T11:14:11.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.173+0000 7fa982ffd640 1 -- 172.21.15.26:0/1346899284 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"}]=0 v42) v1 ==== 105+0+11 (secure 0 0 0) 0x7fa97c054a70 con 0x7fa98c06a270 2023-10-14T11:14:11.176 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:14:11.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.173+0000 7fa994605640 1 -- 172.21.15.26:0/1346899284 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa9700664d0 msgr2=0x7fa970068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:11.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.173+0000 7fa994605640 1 --2- 172.21.15.26:0/1346899284 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa9700664d0 0x7fa970068990 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa9880ae000 tx=0x7fa9880b5040 comp rx=0 tx=0).stop 2023-10-14T11:14:11.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.173+0000 7fa994605640 1 -- 172.21.15.26:0/1346899284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa98c06a270 msgr2=0x7fa98c152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:11.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.173+0000 7fa994605640 1 --2- 172.21.15.26:0/1346899284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa98c06a270 0x7fa98c152f00 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00c7c0 tx=0x7fa97c00cc80 comp rx=0 tx=0).stop 2023-10-14T11:14:11.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.173+0000 7fa994605640 1 -- 172.21.15.26:0/1346899284 shutdown_connections 2023-10-14T11:14:11.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.173+0000 7fa994605640 1 --2- 172.21.15.26:0/1346899284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa98c0702f0 0x7fa98c154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.173+0000 7fa994605640 1 --2- 172.21.15.26:0/1346899284 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa9700664d0 0x7fa970068990 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.173+0000 7fa994605640 1 --2- 172.21.15.26:0/1346899284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa98c06a270 0x7fa98c152f00 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.173+0000 7fa994605640 1 --2- 172.21.15.26:0/1346899284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa98c069e90 0x7fa98c156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.173+0000 7fa994605640 1 -- 172.21.15.26:0/1346899284 >> 172.21.15.26:0/1346899284 conn(0x7fa98c0b0da0 msgr2=0x7fa98c0aecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:11.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.173+0000 7fa994605640 1 -- 172.21.15.26:0/1346899284 shutdown_connections 2023-10-14T11:14:11.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.173+0000 7fa994605640 1 -- 172.21.15.26:0/1346899284 wait complete. 2023-10-14T11:14:11.197 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-10-14T11:14:11.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.341+0000 7f590e7c5640 1 Processor -- start 2023-10-14T11:14:11.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.341+0000 7f590e7c5640 1 -- start start 2023-10-14T11:14:11.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.341+0000 7f590e7c5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f590815cba0 0x7f59080d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:11.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.341+0000 7f590e7c5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f59080b84e0 0x7f59080cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:11.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.341+0000 7f590e7c5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f59080d0040 0x7f59080d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:11.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.341+0000 7f590e7c5640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59080d1460 con 0x7f59080d0040 2023-10-14T11:14:11.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.341+0000 7f590e7c5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59080d04b0 con 0x7f59080b84e0 2023-10-14T11:14:11.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.341+0000 7f590e7c5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59080d1670 con 0x7f590815cba0 2023-10-14T11:14:11.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.341+0000 7f590cd62640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f59080d0040 0x7f59080d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:11.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.341+0000 7f590cd62640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f59080d0040 0x7f59080d2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35370/0 (socket says 172.21.15.26:35370) 2023-10-14T11:14:11.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.341+0000 7f590cd62640 1 -- 172.21.15.26:0/3507555279 learned_addr learned my addr 172.21.15.26:0/3507555279 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:11.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.341+0000 7f59077fe640 1 --2- 172.21.15.26:0/3507555279 >> v2:172.21.15.110:3300/0 conn(0x7f59080b84e0 0x7f59080cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:11.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.341+0000 7f5907fff640 1 --2- 172.21.15.26:0/3507555279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f590815cba0 0x7f59080d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:11.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.341+0000 7f590cd62640 1 -- 172.21.15.26:0/3507555279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f590815cba0 msgr2=0x7f59080d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:11.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.341+0000 7f590cd62640 1 --2- 172.21.15.26:0/3507555279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f590815cba0 0x7f59080d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.341+0000 7f590cd62640 1 -- 172.21.15.26:0/3507555279 >> v2:172.21.15.110:3300/0 conn(0x7f59080b84e0 msgr2=0x7f59080cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:11.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.341+0000 7f590cd62640 1 --2- 172.21.15.26:0/3507555279 >> v2:172.21.15.110:3300/0 conn(0x7f59080b84e0 0x7f59080cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.341+0000 7f590cd62640 1 -- 172.21.15.26:0/3507555279 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59080d1950 con 0x7f59080d0040 2023-10-14T11:14:11.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.345+0000 7f590cd62640 1 --2- 172.21.15.26:0/3507555279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59080d0040 0x7f59080d2ae0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f59080d3bb0 tx=0x7f590001c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c586cf5c15175fb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:11.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.345+0000 7f5906ffd640 1 -- 172.21.15.26:0/3507555279 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59000a5590 con 0x7f59080d0040 2023-10-14T11:14:11.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.345+0000 7f5906ffd640 1 -- 172.21.15.26:0/3507555279 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59000a56f0 con 0x7f59080d0040 2023-10-14T11:14:11.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.345+0000 7f5906ffd640 1 -- 172.21.15.26:0/3507555279 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59000a5a80 con 0x7f59080d0040 2023-10-14T11:14:11.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.345+0000 7f590e7c5640 1 -- 172.21.15.26:0/3507555279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59080d0040 msgr2=0x7f59080d2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:11.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.345+0000 7f590e7c5640 1 --2- 172.21.15.26:0/3507555279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59080d0040 0x7f59080d2ae0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f59080d3bb0 tx=0x7f590001c710 comp rx=0 tx=0).stop 2023-10-14T11:14:11.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.345+0000 7f590e7c5640 1 -- 172.21.15.26:0/3507555279 shutdown_connections 2023-10-14T11:14:11.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.345+0000 7f590e7c5640 1 --2- 172.21.15.26:0/3507555279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59080d0040 0x7f59080d2ae0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.345+0000 7f590e7c5640 1 --2- 172.21.15.26:0/3507555279 >> v2:172.21.15.110:3300/0 conn(0x7f59080b84e0 0x7f59080cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.345+0000 7f590e7c5640 1 --2- 172.21.15.26:0/3507555279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f590815cba0 0x7f59080d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.345+0000 7f590e7c5640 1 -- 172.21.15.26:0/3507555279 >> 172.21.15.26:0/3507555279 conn(0x7f59080719c0 msgr2=0x7f5908071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.345+0000 7f590e7c5640 1 -- 172.21.15.26:0/3507555279 shutdown_connections 2023-10-14T11:14:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.345+0000 7f590e7c5640 1 -- 172.21.15.26:0/3507555279 wait complete. 2023-10-14T11:14:11.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.345+0000 7f590e7c5640 1 Processor -- start 2023-10-14T11:14:11.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f590e7c5640 1 -- start start 2023-10-14T11:14:11.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f590e7c5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59080b84e0 0x7f59081526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:11.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f590e7c5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59080d0040 0x7f5908154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:11.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f590e7c5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f590815cba0 0x7f590814c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f590e7c5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5908156cf0 con 0x7f590815cba0 2023-10-14T11:14:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f590e7c5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5908156f40 con 0x7f59080b84e0 2023-10-14T11:14:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f590e7c5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59080cc5f0 con 0x7f59080d0040 2023-10-14T11:14:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f590cd62640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f590815cba0 0x7f590814c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f5907fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59080b84e0 0x7f59081526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:11.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f5907fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59080b84e0 0x7f59081526e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:34930/0 (socket says 172.21.15.26:34930) 2023-10-14T11:14:11.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f590cd62640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f590815cba0 0x7f590814c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35374/0 (socket says 172.21.15.26:35374) 2023-10-14T11:14:11.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f5907fff640 1 -- 172.21.15.26:0/894314008 learned_addr learned my addr 172.21.15.26:0/894314008 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:11.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f59077fe640 1 --2- 172.21.15.26:0/894314008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59080d0040 0x7f5908154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:11.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f590cd62640 1 -- 172.21.15.26:0/894314008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59080d0040 msgr2=0x7f5908154300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:11.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f590cd62640 1 --2- 172.21.15.26:0/894314008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59080d0040 0x7f5908154300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f590cd62640 1 -- 172.21.15.26:0/894314008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59080b84e0 msgr2=0x7f59081526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:11.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f590cd62640 1 --2- 172.21.15.26:0/894314008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59080b84e0 0x7f59081526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f590cd62640 1 -- 172.21.15.26:0/894314008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5900009b30 con 0x7f590815cba0 2023-10-14T11:14:11.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f5907fff640 1 --2- 172.21.15.26:0/894314008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59080b84e0 0x7f59081526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:14:11.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f590cd62640 1 --2- 172.21.15.26:0/894314008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f590815cba0 0x7f590814c9d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f59000ab000 tx=0x7f59000194b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:11.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f5904ff9640 1 -- 172.21.15.26:0/894314008 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59000bd070 con 0x7f590815cba0 2023-10-14T11:14:11.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f5904ff9640 1 -- 172.21.15.26:0/894314008 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5900009510 con 0x7f590815cba0 2023-10-14T11:14:11.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f5904ff9640 1 -- 172.21.15.26:0/894314008 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59000a5590 con 0x7f590815cba0 2023-10-14T11:14:11.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f590e7c5640 1 -- 172.21.15.26:0/894314008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59080cc8d0 con 0x7f590815cba0 2023-10-14T11:14:11.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f590e7c5640 1 -- 172.21.15.26:0/894314008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5908154840 con 0x7f590815cba0 2023-10-14T11:14:11.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.349+0000 7f590e7c5640 1 -- 172.21.15.26:0/894314008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5908154a30 con 0x7f590815cba0 2023-10-14T11:14:11.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.353+0000 7f5904ff9640 1 -- 172.21.15.26:0/894314008 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f59000b86b0 con 0x7f590815cba0 2023-10-14T11:14:11.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.353+0000 7f5904ff9640 1 --2- 172.21.15.26:0/894314008 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f58f40664a0 0x7f58f4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:11.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.353+0000 7f5904ff9640 1 -- 172.21.15.26:0/894314008 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f590011e8c0 con 0x7f590815cba0 2023-10-14T11:14:11.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.353+0000 7f5907fff640 1 --2- 172.21.15.26:0/894314008 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f58f40664a0 0x7f58f4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:11.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.353+0000 7f5907fff640 1 --2- 172.21.15.26:0/894314008 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f58f40664a0 0x7f58f4068960 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f59080b6d80 tx=0x7f58f8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:11.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.357+0000 7f5904ff9640 1 -- 172.21.15.26:0/894314008 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5908154a30 con 0x7f590815cba0 2023-10-14T11:14:11.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.513+0000 7f590e7c5640 1 -- 172.21.15.26:0/894314008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f5908154a30 con 0x7f590815cba0 2023-10-14T11:14:11.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.513+0000 7f5904ff9640 1 -- 172.21.15.26:0/894314008 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v42) v1 ==== 97+0+11 (secure 0 0 0) 0x7f5908154a30 con 0x7f590815cba0 2023-10-14T11:14:11.519 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:14:11.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.517+0000 7f590e7c5640 1 -- 172.21.15.26:0/894314008 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f58f40664a0 msgr2=0x7f58f4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:11.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.517+0000 7f590e7c5640 1 --2- 172.21.15.26:0/894314008 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f58f40664a0 0x7f58f4068960 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f59080b6d80 tx=0x7f58f8009190 comp rx=0 tx=0).stop 2023-10-14T11:14:11.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.517+0000 7f590e7c5640 1 -- 172.21.15.26:0/894314008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f590815cba0 msgr2=0x7f590814c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:11.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.517+0000 7f590e7c5640 1 --2- 172.21.15.26:0/894314008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f590815cba0 0x7f590814c9d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f59000ab000 tx=0x7f59000194b0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.517+0000 7f590e7c5640 1 -- 172.21.15.26:0/894314008 shutdown_connections 2023-10-14T11:14:11.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.517+0000 7f590e7c5640 1 --2- 172.21.15.26:0/894314008 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f58f40664a0 0x7f58f4068960 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.517+0000 7f590e7c5640 1 --2- 172.21.15.26:0/894314008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f590815cba0 0x7f590814c9d0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.517+0000 7f590e7c5640 1 --2- 172.21.15.26:0/894314008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59080d0040 0x7f5908154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.517+0000 7f590e7c5640 1 --2- 172.21.15.26:0/894314008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59080b84e0 0x7f59081526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.517+0000 7f590e7c5640 1 -- 172.21.15.26:0/894314008 >> 172.21.15.26:0/894314008 conn(0x7f59080719c0 msgr2=0x7f59080b72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:11.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.517+0000 7f590e7c5640 1 -- 172.21.15.26:0/894314008 shutdown_connections 2023-10-14T11:14:11.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.517+0000 7f590e7c5640 1 -- 172.21.15.26:0/894314008 wait complete. 2023-10-14T11:14:11.540 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:14:11.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.680+0000 7f6d2f5d9640 1 Processor -- start 2023-10-14T11:14:11.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.680+0000 7f6d2f5d9640 1 -- start start 2023-10-14T11:14:11.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.680+0000 7f6d2f5d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d28164520 0x7f6d280ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:11.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.680+0000 7f6d2f5d9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6d280ad960 0x7f6d280b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:11.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.680+0000 7f6d2f5d9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6d280c9b80 0x7f6d280b0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:11.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.680+0000 7f6d2f5d9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d28164900 con 0x7f6d280ad960 2023-10-14T11:14:11.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.680+0000 7f6d2f5d9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d280c96f0 con 0x7f6d280c9b80 2023-10-14T11:14:11.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.680+0000 7f6d2f5d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d280cb950 con 0x7f6d28164520 2023-10-14T11:14:11.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.680+0000 7f6d2cb74640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6d280ad960 0x7f6d280b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:11.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.680+0000 7f6d2cb74640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6d280ad960 0x7f6d280b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35388/0 (socket says 172.21.15.26:35388) 2023-10-14T11:14:11.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.680+0000 7f6d2cb74640 1 -- 172.21.15.26:0/3876515114 learned_addr learned my addr 172.21.15.26:0/3876515114 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:11.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.680+0000 7f6d2d375640 1 --2- 172.21.15.26:0/3876515114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d28164520 0x7f6d280ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:11.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.680+0000 7f6d2db76640 1 --2- 172.21.15.26:0/3876515114 >> v2:172.21.15.110:3300/0 conn(0x7f6d280c9b80 0x7f6d280b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:11.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.680+0000 7f6d2cb74640 1 -- 172.21.15.26:0/3876515114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d28164520 msgr2=0x7f6d280ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:11.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.680+0000 7f6d2cb74640 1 --2- 172.21.15.26:0/3876515114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d28164520 0x7f6d280ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.680+0000 7f6d2cb74640 1 -- 172.21.15.26:0/3876515114 >> v2:172.21.15.110:3300/0 conn(0x7f6d280c9b80 msgr2=0x7f6d280b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:11.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.680+0000 7f6d2cb74640 1 --2- 172.21.15.26:0/3876515114 >> v2:172.21.15.110:3300/0 conn(0x7f6d280c9b80 0x7f6d280b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.680+0000 7f6d2cb74640 1 -- 172.21.15.26:0/3876515114 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d280cbed0 con 0x7f6d280ad960 2023-10-14T11:14:11.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.680+0000 7f6d2d375640 1 --2- 172.21.15.26:0/3876515114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d28164520 0x7f6d280ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:11.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.680+0000 7f6d2db76640 1 --2- 172.21.15.26:0/3876515114 >> v2:172.21.15.110:3300/0 conn(0x7f6d280c9b80 0x7f6d280b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:11.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.684+0000 7f6d2cb74640 1 --2- 172.21.15.26:0/3876515114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d280ad960 0x7f6d280b00e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6d280c9360 tx=0x7f6d1801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f401e03b7e4c8ce server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:11.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.684+0000 7f6d1ffff640 1 -- 172.21.15.26:0/3876515114 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d180aa640 con 0x7f6d280ad960 2023-10-14T11:14:11.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.684+0000 7f6d1ffff640 1 -- 172.21.15.26:0/3876515114 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d180aa7a0 con 0x7f6d280ad960 2023-10-14T11:14:11.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.684+0000 7f6d1ffff640 1 -- 172.21.15.26:0/3876515114 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d180aab30 con 0x7f6d280ad960 2023-10-14T11:14:11.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.684+0000 7f6d2f5d9640 1 -- 172.21.15.26:0/3876515114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d280ad960 msgr2=0x7f6d280b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:11.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.684+0000 7f6d2f5d9640 1 --2- 172.21.15.26:0/3876515114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d280ad960 0x7f6d280b00e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6d280c9360 tx=0x7f6d1801c500 comp rx=0 tx=0).stop 2023-10-14T11:14:11.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.684+0000 7f6d2f5d9640 1 -- 172.21.15.26:0/3876515114 shutdown_connections 2023-10-14T11:14:11.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.684+0000 7f6d2f5d9640 1 --2- 172.21.15.26:0/3876515114 >> v2:172.21.15.110:3300/0 conn(0x7f6d280c9b80 0x7f6d280b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.684+0000 7f6d2f5d9640 1 --2- 172.21.15.26:0/3876515114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d280ad960 0x7f6d280b00e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.684+0000 7f6d2f5d9640 1 --2- 172.21.15.26:0/3876515114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d28164520 0x7f6d280ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.684+0000 7f6d2f5d9640 1 -- 172.21.15.26:0/3876515114 >> 172.21.15.26:0/3876515114 conn(0x7f6d2806c190 msgr2=0x7f6d2806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:11.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.684+0000 7f6d2f5d9640 1 -- 172.21.15.26:0/3876515114 shutdown_connections 2023-10-14T11:14:11.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.684+0000 7f6d2f5d9640 1 -- 172.21.15.26:0/3876515114 wait complete. 2023-10-14T11:14:11.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2f5d9640 1 Processor -- start 2023-10-14T11:14:11.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2f5d9640 1 -- start start 2023-10-14T11:14:11.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2f5d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d280ad960 0x7f6d280c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:11.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2f5d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d280c9b80 0x7f6d281559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:11.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2f5d9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d28164520 0x7f6d28151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:11.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2f5d9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d280aed20 con 0x7f6d28164520 2023-10-14T11:14:11.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2f5d9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d280af000 con 0x7f6d280ad960 2023-10-14T11:14:11.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2f5d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d280af2e0 con 0x7f6d280c9b80 2023-10-14T11:14:11.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2db76640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d28164520 0x7f6d28151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:11.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2db76640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d28164520 0x7f6d28151da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35394/0 (socket says 172.21.15.26:35394) 2023-10-14T11:14:11.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2db76640 1 -- 172.21.15.26:0/802742548 learned_addr learned my addr 172.21.15.26:0/802742548 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:11.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2d375640 1 --2- 172.21.15.26:0/802742548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d280ad960 0x7f6d280c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:11.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2cb74640 1 --2- 172.21.15.26:0/802742548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d280c9b80 0x7f6d281559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:11.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2db76640 1 -- 172.21.15.26:0/802742548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d280c9b80 msgr2=0x7f6d281559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:11.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2db76640 1 --2- 172.21.15.26:0/802742548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d280c9b80 0x7f6d281559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2db76640 1 -- 172.21.15.26:0/802742548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d280ad960 msgr2=0x7f6d280c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:11.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2db76640 1 --2- 172.21.15.26:0/802742548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d280ad960 0x7f6d280c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2db76640 1 -- 172.21.15.26:0/802742548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d180094d0 con 0x7f6d28164520 2023-10-14T11:14:11.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2d375640 1 --2- 172.21.15.26:0/802742548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d280ad960 0x7f6d280c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:11.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2db76640 1 --2- 172.21.15.26:0/802742548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d28164520 0x7f6d28151da0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6d20007d30 tx=0x7f6d2000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:11.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d1dffb640 1 -- 172.21.15.26:0/802742548 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d200039a0 con 0x7f6d28164520 2023-10-14T11:14:11.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d1dffb640 1 -- 172.21.15.26:0/802742548 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2000f040 con 0x7f6d28164520 2023-10-14T11:14:11.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d1dffb640 1 -- 172.21.15.26:0/802742548 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d20003d40 con 0x7f6d28164520 2023-10-14T11:14:11.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2f5d9640 1 -- 172.21.15.26:0/802742548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d280af5c0 con 0x7f6d28164520 2023-10-14T11:14:11.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2f5d9640 1 -- 172.21.15.26:0/802742548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d280ae940 con 0x7f6d28164520 2023-10-14T11:14:11.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.688+0000 7f6d2f5d9640 1 -- 172.21.15.26:0/802742548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d280af7b0 con 0x7f6d28164520 2023-10-14T11:14:11.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.692+0000 7f6d1dffb640 1 -- 172.21.15.26:0/802742548 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6d20004030 con 0x7f6d28164520 2023-10-14T11:14:11.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.692+0000 7f6d1dffb640 1 --2- 172.21.15.26:0/802742548 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6d0c0664a0 0x7f6d0c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:11.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.692+0000 7f6d1dffb640 1 -- 172.21.15.26:0/802742548 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f6d200843b0 con 0x7f6d28164520 2023-10-14T11:14:11.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.692+0000 7f6d2d375640 1 --2- 172.21.15.26:0/802742548 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6d0c0664a0 0x7f6d0c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:11.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.692+0000 7f6d2d375640 1 --2- 172.21.15.26:0/802742548 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6d0c0664a0 0x7f6d0c068960 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6d2400b990 tx=0x7f6d24008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:11.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.696+0000 7f6d1dffb640 1 -- 172.21.15.26:0/802742548 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6d20051550 con 0x7f6d28164520 2023-10-14T11:14:11.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.864+0000 7f6d2f5d9640 1 -- 172.21.15.26:0/802742548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6d28074010 con 0x7f6d28164520 2023-10-14T11:14:11.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.864+0000 7f6d1dffb640 1 -- 172.21.15.26:0/802742548 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6d20054b70 con 0x7f6d28164520 2023-10-14T11:14:11.870 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-10-14T11:14:11.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.868+0000 7f6d2f5d9640 1 -- 172.21.15.26:0/802742548 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6d0c0664a0 msgr2=0x7f6d0c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:11.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.868+0000 7f6d2f5d9640 1 --2- 172.21.15.26:0/802742548 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6d0c0664a0 0x7f6d0c068960 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6d2400b990 tx=0x7f6d24008040 comp rx=0 tx=0).stop 2023-10-14T11:14:11.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.868+0000 7f6d2f5d9640 1 -- 172.21.15.26:0/802742548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d28164520 msgr2=0x7f6d28151da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:11.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.868+0000 7f6d2f5d9640 1 --2- 172.21.15.26:0/802742548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d28164520 0x7f6d28151da0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6d20007d30 tx=0x7f6d2000d4a0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.868+0000 7f6d2f5d9640 1 -- 172.21.15.26:0/802742548 shutdown_connections 2023-10-14T11:14:11.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.868+0000 7f6d2f5d9640 1 --2- 172.21.15.26:0/802742548 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6d0c0664a0 0x7f6d0c068960 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.868+0000 7f6d2f5d9640 1 --2- 172.21.15.26:0/802742548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d28164520 0x7f6d28151da0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.868+0000 7f6d2f5d9640 1 --2- 172.21.15.26:0/802742548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d280c9b80 0x7f6d281559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.868+0000 7f6d2f5d9640 1 --2- 172.21.15.26:0/802742548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d280ad960 0x7f6d280c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:11.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.868+0000 7f6d2f5d9640 1 -- 172.21.15.26:0/802742548 >> 172.21.15.26:0/802742548 conn(0x7f6d2806c190 msgr2=0x7f6d280ae0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:11.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.868+0000 7f6d2f5d9640 1 -- 172.21.15.26:0/802742548 shutdown_connections 2023-10-14T11:14:11.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:11.868+0000 7f6d2f5d9640 1 -- 172.21.15.26:0/802742548 wait complete. 2023-10-14T11:14:11.891 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi026.front.sepia.ceph.com... 2023-10-14T11:14:11.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:11.892 DEBUG:teuthology.orchestra.run.smithi026:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-14T11:14:11.912 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[48817]: fuse finished with error 0 and tester_r 0 2023-10-14T11:14:11.915 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:14:18.017 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T11:14:18.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:18.018 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T11:14:18.031 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rwp' mon 'allow r' osd 'allow rw pool=testcephfs1_data,allow rw pool=data_new' 2023-10-14T11:14:18.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.232+0000 7fa384765640 1 Processor -- start 2023-10-14T11:14:18.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.232+0000 7fa384765640 1 -- start start 2023-10-14T11:14:18.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.236+0000 7fa384765640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa37c06dbd0 0x7fa37c15ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:18.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.236+0000 7fa384765640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa37c069e90 0x7fa37c06a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:18.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.236+0000 7fa384765640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa37c15e5e0 con 0x7fa37c0c8e50 2023-10-14T11:14:18.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.236+0000 7fa384765640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa37c06a860 con 0x7fa37c069e90 2023-10-14T11:14:18.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.236+0000 7fa384765640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c15b320 con 0x7fa37c06dbd0 2023-10-14T11:14:18.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.236+0000 7fa381d00640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa37c0c8e50 0x7fa37c06c660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56580/0 (socket says 172.21.15.26:56580) 2023-10-14T11:14:18.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.236+0000 7fa381d00640 1 -- 172.21.15.26:0/3868065484 learned_addr learned my addr 172.21.15.26:0/3868065484 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:18.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.236+0000 7fa382501640 1 --2- 172.21.15.26:0/3868065484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa37c06dbd0 0x7fa37c15ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:18.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.236+0000 7fa382d02640 1 --2- 172.21.15.26:0/3868065484 >> v2:172.21.15.110:3300/0 conn(0x7fa37c069e90 0x7fa37c06a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:18.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.236+0000 7fa3814ff640 1 -- 172.21.15.26:0/3868065484 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263184141 0 0) 0x7fa37c15e5e0 con 0x7fa37c0c8e50 2023-10-14T11:14:18.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.236+0000 7fa3814ff640 1 -- 172.21.15.26:0/3868065484 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa368003530 con 0x7fa37c0c8e50 2023-10-14T11:14:18.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.236+0000 7fa382501640 1 -- 172.21.15.26:0/3868065484 >> v2:172.21.15.110:3300/0 conn(0x7fa37c069e90 msgr2=0x7fa37c06a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:18.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.236+0000 7fa382501640 1 --2- 172.21.15.26:0/3868065484 >> v2:172.21.15.110:3300/0 conn(0x7fa37c069e90 0x7fa37c06a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:18.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.236+0000 7fa382501640 1 -- 172.21.15.26:0/3868065484 >> v1:172.21.15.26:6789/0 conn(0x7fa37c0c8e50 legacy=0x7fa37c06c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:18.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.236+0000 7fa382501640 1 -- 172.21.15.26:0/3868065484 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37c15b570 con 0x7fa37c06dbd0 2023-10-14T11:14:18.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.236+0000 7fa382d02640 1 --2- 172.21.15.26:0/3868065484 >> v2:172.21.15.110:3300/0 conn(0x7fa37c069e90 0x7fa37c06a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:14:18.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.240+0000 7fa382501640 1 --2- 172.21.15.26:0/3868065484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa37c06dbd0 0x7fa37c15ade0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa3780097c0 tx=0x7fa37801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab8b42ac59624884 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:18.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.240+0000 7fa3814ff640 1 -- 172.21.15.26:0/3868065484 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3780ab650 con 0x7fa37c06dbd0 2023-10-14T11:14:18.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.240+0000 7fa3814ff640 1 -- 172.21.15.26:0/3868065484 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3780ab7b0 con 0x7fa37c06dbd0 2023-10-14T11:14:18.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.240+0000 7fa3814ff640 1 -- 172.21.15.26:0/3868065484 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3780abb40 con 0x7fa37c06dbd0 2023-10-14T11:14:18.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.240+0000 7fa384765640 1 -- 172.21.15.26:0/3868065484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa37c06dbd0 msgr2=0x7fa37c15ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:18.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.240+0000 7fa384765640 1 --2- 172.21.15.26:0/3868065484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa37c06dbd0 0x7fa37c15ade0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa3780097c0 tx=0x7fa37801c450 comp rx=0 tx=0).stop 2023-10-14T11:14:18.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.240+0000 7fa384765640 1 -- 172.21.15.26:0/3868065484 shutdown_connections 2023-10-14T11:14:18.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.240+0000 7fa384765640 1 --2- 172.21.15.26:0/3868065484 >> v2:172.21.15.110:3300/0 conn(0x7fa37c069e90 0x7fa37c06a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:18.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.240+0000 7fa384765640 1 --2- 172.21.15.26:0/3868065484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa37c06dbd0 0x7fa37c15ade0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:18.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.240+0000 7fa384765640 1 -- 172.21.15.26:0/3868065484 >> 172.21.15.26:0/3868065484 conn(0x7fa37c0b0d10 msgr2=0x7fa37c0ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:18.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.240+0000 7fa384765640 1 -- 172.21.15.26:0/3868065484 shutdown_connections 2023-10-14T11:14:18.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.240+0000 7fa384765640 1 -- 172.21.15.26:0/3868065484 wait complete. 2023-10-14T11:14:18.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa384765640 1 Processor -- start 2023-10-14T11:14:18.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa384765640 1 -- start start 2023-10-14T11:14:18.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa384765640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa37c069e90 0x7fa37c141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:18.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa384765640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa37c06dbd0 0x7fa37c1f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:18.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa384765640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa37c0c8e50 0x7fa37c1f8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:18.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa384765640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c1f4f00 con 0x7fa37c069e90 2023-10-14T11:14:18.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa384765640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c1f93f0 con 0x7fa37c0c8e50 2023-10-14T11:14:18.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa384765640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c1f8e30 con 0x7fa37c06dbd0 2023-10-14T11:14:18.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa382501640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa37c069e90 0x7fa37c141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:18.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa382501640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa37c069e90 0x7fa37c141260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38422/0 (socket says 172.21.15.26:38422) 2023-10-14T11:14:18.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa382501640 1 -- 172.21.15.26:0/2142434053 learned_addr learned my addr 172.21.15.26:0/2142434053 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:18.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa381d00640 1 --2- 172.21.15.26:0/2142434053 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa37c06dbd0 0x7fa37c1f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:18.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa382d02640 1 --2- 172.21.15.26:0/2142434053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa37c0c8e50 0x7fa37c1f8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:18.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa382501640 1 -- 172.21.15.26:0/2142434053 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa37c06dbd0 msgr2=0x7fa37c1f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:18.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa382501640 1 --2- 172.21.15.26:0/2142434053 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa37c06dbd0 0x7fa37c1f58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:18.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa382501640 1 -- 172.21.15.26:0/2142434053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa37c0c8e50 msgr2=0x7fa37c1f8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:18.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa382501640 1 --2- 172.21.15.26:0/2142434053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa37c0c8e50 0x7fa37c1f8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:18.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa382501640 1 -- 172.21.15.26:0/2142434053 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa374009a70 con 0x7fa37c069e90 2023-10-14T11:14:18.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa382d02640 1 --2- 172.21.15.26:0/2142434053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa37c0c8e50 0x7fa37c1f8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:18.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa382501640 1 --2- 172.21.15.26:0/2142434053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa37c069e90 0x7fa37c141260 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa3780ad040 tx=0x7fa37801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:18.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa372ffd640 1 -- 172.21.15.26:0/2142434053 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3780bf610 con 0x7fa37c069e90 2023-10-14T11:14:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa372ffd640 1 -- 172.21.15.26:0/2142434053 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3780bf770 con 0x7fa37c069e90 2023-10-14T11:14:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa372ffd640 1 -- 172.21.15.26:0/2142434053 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3780bfb20 con 0x7fa37c069e90 2023-10-14T11:14:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa384765640 1 -- 172.21.15.26:0/2142434053 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa378009420 con 0x7fa37c069e90 2023-10-14T11:14:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa384765640 1 -- 172.21.15.26:0/2142434053 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37c1f50e0 con 0x7fa37c069e90 2023-10-14T11:14:18.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.244+0000 7fa384765640 1 -- 172.21.15.26:0/2142434053 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa37c0c9230 con 0x7fa37c069e90 2023-10-14T11:14:18.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.248+0000 7fa372ffd640 1 -- 172.21.15.26:0/2142434053 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa3780bfc80 con 0x7fa37c069e90 2023-10-14T11:14:18.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.248+0000 7fa372ffd640 1 --2- 172.21.15.26:0/2142434053 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa3600664a0 0x7fa360068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:18.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.248+0000 7fa372ffd640 1 -- 172.21.15.26:0/2142434053 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7fa37811ebe0 con 0x7fa37c069e90 2023-10-14T11:14:18.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.248+0000 7fa381d00640 1 --2- 172.21.15.26:0/2142434053 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa3600664a0 0x7fa360068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:18.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.248+0000 7fa381d00640 1 --2- 172.21.15.26:0/2142434053 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa3600664a0 0x7fa360068960 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0ce0a0 tx=0x7fa36c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:18.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.252+0000 7fa372ffd640 1 -- 172.21.15.26:0/2142434053 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa37c0c9230 con 0x7fa37c069e90 2023-10-14T11:14:18.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.468+0000 7fa384765640 1 -- 172.21.15.26:0/2142434053 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=testcephfs1_data,allow rw pool=data_new"]} v 0) v1 -- 0x7fa37c0c9230 con 0x7fa37c069e90 2023-10-14T11:14:18.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.472+0000 7fa372ffd640 1 -- 172.21.15.26:0/2142434053 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=testcephfs1_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v13) v1 ==== 216+0+173 (secure 0 0 0) 0x7fa37c0c9230 con 0x7fa37c069e90 2023-10-14T11:14:18.476 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2023-10-14T11:14:18.476 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBZdyplGXdwHxAA3yn7fC60cZX9BQGuvdlfYw== 2023-10-14T11:14:18.477 INFO:teuthology.orchestra.run.smithi026.stdout: caps mds = "allow rwp" 2023-10-14T11:14:18.477 INFO:teuthology.orchestra.run.smithi026.stdout: caps mon = "allow r" 2023-10-14T11:14:18.477 INFO:teuthology.orchestra.run.smithi026.stdout: caps osd = "allow rw pool=testcephfs1_data,allow rw pool=data_new" 2023-10-14T11:14:18.478 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-10-14T11:14:18.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.472+0000 7fa384765640 1 -- 172.21.15.26:0/2142434053 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa3600664a0 msgr2=0x7fa360068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:18.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.472+0000 7fa384765640 1 --2- 172.21.15.26:0/2142434053 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa3600664a0 0x7fa360068960 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0ce0a0 tx=0x7fa36c009040 comp rx=0 tx=0).stop 2023-10-14T11:14:18.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.472+0000 7fa384765640 1 -- 172.21.15.26:0/2142434053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa37c069e90 msgr2=0x7fa37c141260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:18.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.472+0000 7fa384765640 1 --2- 172.21.15.26:0/2142434053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa37c069e90 0x7fa37c141260 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa3780ad040 tx=0x7fa37801ac90 comp rx=0 tx=0).stop 2023-10-14T11:14:18.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.472+0000 7fa384765640 1 -- 172.21.15.26:0/2142434053 shutdown_connections 2023-10-14T11:14:18.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.472+0000 7fa384765640 1 --2- 172.21.15.26:0/2142434053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa37c0c8e50 0x7fa37c1f8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:18.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.472+0000 7fa384765640 1 --2- 172.21.15.26:0/2142434053 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa37c06dbd0 0x7fa37c1f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:18.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.472+0000 7fa384765640 1 --2- 172.21.15.26:0/2142434053 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa3600664a0 0x7fa360068960 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:18.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.472+0000 7fa384765640 1 --2- 172.21.15.26:0/2142434053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa37c069e90 0x7fa37c141260 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:18.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.472+0000 7fa384765640 1 -- 172.21.15.26:0/2142434053 >> 172.21.15.26:0/2142434053 conn(0x7fa37c0b0d10 msgr2=0x7fa37c158590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:18.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.472+0000 7fa384765640 1 -- 172.21.15.26:0/2142434053 shutdown_connections 2023-10-14T11:14:18.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.472+0000 7fa384765640 1 -- 172.21.15.26:0/2142434053 wait complete. 2023-10-14T11:14:18.497 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T11:14:18.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.636+0000 7f49722c9640 1 Processor -- start 2023-10-14T11:14:18.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.636+0000 7f49722c9640 1 -- start start 2023-10-14T11:14:18.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.636+0000 7f49722c9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f496c0cf090 0x7f496c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:18.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.636+0000 7f49722c9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f496c0c6ad0 0x7f496c0c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:18.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.636+0000 7f49722c9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f496c0cfa30 con 0x7f496c15ca70 2023-10-14T11:14:18.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.636+0000 7f49722c9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496c0ce820 con 0x7f496c0c6ad0 2023-10-14T11:14:18.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.636+0000 7f49722c9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496c0c65f0 con 0x7f496c0cf090 2023-10-14T11:14:18.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.636+0000 7f496bfff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f496c15ca70 0x7f496c0d3010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:57360/0 (socket says 172.21.15.26:57360) 2023-10-14T11:14:18.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.636+0000 7f496bfff640 1 -- 172.21.15.26:0/642227106 learned_addr learned my addr 172.21.15.26:0/642227106 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:18.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.636+0000 7f496b7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f496c0cf090 0x7f496c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:18.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.636+0000 7f4970866640 1 --2- 172.21.15.26:0/642227106 >> v2:172.21.15.110:3300/0 conn(0x7f496c0c6ad0 0x7f496c0c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:18.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.636+0000 7f496affd640 1 -- 172.21.15.26:0/642227106 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376080045 0 0) 0x7f496c0cfa30 con 0x7f496c15ca70 2023-10-14T11:14:18.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.636+0000 7f496affd640 1 -- 172.21.15.26:0/642227106 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4954003530 con 0x7f496c15ca70 2023-10-14T11:14:18.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.636+0000 7f496b7fe640 1 -- 172.21.15.26:0/642227106 >> v2:172.21.15.110:3300/0 conn(0x7f496c0c6ad0 msgr2=0x7f496c0c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:18.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.636+0000 7f496b7fe640 1 --2- 172.21.15.26:0/642227106 >> v2:172.21.15.110:3300/0 conn(0x7f496c0c6ad0 0x7f496c0c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:18.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.636+0000 7f496b7fe640 1 -- 172.21.15.26:0/642227106 >> v1:172.21.15.110:6789/0 conn(0x7f496c15ca70 legacy=0x7f496c0d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:18.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.636+0000 7f496b7fe640 1 -- 172.21.15.26:0/642227106 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c0cdf80 con 0x7f496c0cf090 2023-10-14T11:14:18.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.636+0000 7f4970866640 1 --2- 172.21.15.26:0/642227106 >> v2:172.21.15.110:3300/0 conn(0x7f496c0c6ad0 0x7f496c0c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:14:18.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.640+0000 7f496b7fe640 1 --2- 172.21.15.26:0/642227106 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f496c0cf090 0x7f496c0cf4f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f49600097c0 tx=0x7f496001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e11b2ef97ae8b803 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:18.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.640+0000 7f496affd640 1 -- 172.21.15.26:0/642227106 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49600ab650 con 0x7f496c0cf090 2023-10-14T11:14:18.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.640+0000 7f496affd640 1 -- 172.21.15.26:0/642227106 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49600ab7b0 con 0x7f496c0cf090 2023-10-14T11:14:18.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.640+0000 7f496affd640 1 -- 172.21.15.26:0/642227106 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49600abb40 con 0x7f496c0cf090 2023-10-14T11:14:18.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.640+0000 7f49722c9640 1 -- 172.21.15.26:0/642227106 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f496c0cf090 msgr2=0x7f496c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:18.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.640+0000 7f49722c9640 1 --2- 172.21.15.26:0/642227106 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f496c0cf090 0x7f496c0cf4f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f49600097c0 tx=0x7f496001c450 comp rx=0 tx=0).stop 2023-10-14T11:14:18.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.640+0000 7f49722c9640 1 -- 172.21.15.26:0/642227106 shutdown_connections 2023-10-14T11:14:18.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.640+0000 7f49722c9640 1 --2- 172.21.15.26:0/642227106 >> v2:172.21.15.110:3300/0 conn(0x7f496c0c6ad0 0x7f496c0c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:18.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.640+0000 7f49722c9640 1 --2- 172.21.15.26:0/642227106 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f496c0cf090 0x7f496c0cf4f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:18.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.640+0000 7f49722c9640 1 -- 172.21.15.26:0/642227106 >> 172.21.15.26:0/642227106 conn(0x7f496c09bc50 msgr2=0x7f496c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:18.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.640+0000 7f49722c9640 1 -- 172.21.15.26:0/642227106 shutdown_connections 2023-10-14T11:14:18.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.640+0000 7f49722c9640 1 -- 172.21.15.26:0/642227106 wait complete. 2023-10-14T11:14:18.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f49722c9640 1 Processor -- start 2023-10-14T11:14:18.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f49722c9640 1 -- start start 2023-10-14T11:14:18.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f49722c9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f496c0c6ad0 0x7f496c144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:18.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f49722c9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f496c0cf090 0x7f496c157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:18.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f49722c9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f496c15ca70 0x7f496c06b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:18.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f49722c9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c0c9d00 con 0x7f496c0c6ad0 2023-10-14T11:14:18.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f49722c9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c144d60 con 0x7f496c0cf090 2023-10-14T11:14:18.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f49722c9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496c0cbd90 con 0x7f496c15ca70 2023-10-14T11:14:18.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f496bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f496c0c6ad0 0x7f496c144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:18.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f496bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f496c0c6ad0 0x7f496c144820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38430/0 (socket says 172.21.15.26:38430) 2023-10-14T11:14:18.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f496bfff640 1 -- 172.21.15.26:0/1804537204 learned_addr learned my addr 172.21.15.26:0/1804537204 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:18.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f496b7fe640 1 --2- 172.21.15.26:0/1804537204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f496c0cf090 0x7f496c157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:18.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f4970866640 1 --2- 172.21.15.26:0/1804537204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f496c15ca70 0x7f496c06b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:18.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f496bfff640 1 -- 172.21.15.26:0/1804537204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f496c15ca70 msgr2=0x7f496c06b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:18.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f496bfff640 1 --2- 172.21.15.26:0/1804537204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f496c15ca70 0x7f496c06b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:18.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f496bfff640 1 -- 172.21.15.26:0/1804537204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f496c0cf090 msgr2=0x7f496c157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:18.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f496bfff640 1 --2- 172.21.15.26:0/1804537204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f496c0cf090 0x7f496c157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:18.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f496bfff640 1 -- 172.21.15.26:0/1804537204 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4964009a70 con 0x7f496c0c6ad0 2023-10-14T11:14:18.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f496bfff640 1 --2- 172.21.15.26:0/1804537204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f496c0c6ad0 0x7f496c144820 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f495c001140 tx=0x7f495c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:18.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f4968ff9640 1 -- 172.21.15.26:0/1804537204 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c005d40 con 0x7f496c0c6ad0 2023-10-14T11:14:18.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f4968ff9640 1 -- 172.21.15.26:0/1804537204 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495c0070d0 con 0x7f496c0c6ad0 2023-10-14T11:14:18.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f49722c9640 1 -- 172.21.15.26:0/1804537204 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4960009420 con 0x7f496c0c6ad0 2023-10-14T11:14:18.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f4968ff9640 1 -- 172.21.15.26:0/1804537204 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c005ea0 con 0x7f496c0c6ad0 2023-10-14T11:14:18.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.644+0000 7f49722c9640 1 -- 172.21.15.26:0/1804537204 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496c0d38a0 con 0x7f496c0c6ad0 2023-10-14T11:14:18.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.648+0000 7f49722c9640 1 -- 172.21.15.26:0/1804537204 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496c074010 con 0x7f496c0c6ad0 2023-10-14T11:14:18.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.648+0000 7f4968ff9640 1 -- 172.21.15.26:0/1804537204 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f495c007480 con 0x7f496c0c6ad0 2023-10-14T11:14:18.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.648+0000 7f4968ff9640 1 --2- 172.21.15.26:0/1804537204 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f49580664a0 0x7f4958068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:18.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.648+0000 7f4968ff9640 1 -- 172.21.15.26:0/1804537204 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f495c0836b0 con 0x7f496c0c6ad0 2023-10-14T11:14:18.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.648+0000 7f496b7fe640 1 --2- 172.21.15.26:0/1804537204 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f49580664a0 0x7f4958068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:18.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.648+0000 7f496b7fe640 1 --2- 172.21.15.26:0/1804537204 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f49580664a0 0x7f4958068960 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f49600af000 tx=0x7f49600a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:18.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.652+0000 7f4968ff9640 1 -- 172.21.15.26:0/1804537204 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f495c0508e0 con 0x7f496c0c6ad0 2023-10-14T11:14:18.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.844+0000 7f49722c9640 1 -- 172.21.15.26:0/1804537204 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f496c142f50 con 0x7f496c0c6ad0 2023-10-14T11:14:18.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.844+0000 7f4968ff9640 1 -- 172.21.15.26:0/1804537204 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+97 (secure 0 0 0) 0x7f495c053f00 con 0x7f496c0c6ad0 2023-10-14T11:14:18.849 INFO:teuthology.orchestra.run.smithi026.stdout:name: testcephfs1, metadata pool: testcephfs1_metadata, data pools: [testcephfs1_data data_new ] 2023-10-14T11:14:18.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.844+0000 7f49722c9640 1 -- 172.21.15.26:0/1804537204 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f49580664a0 msgr2=0x7f4958068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:18.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.844+0000 7f49722c9640 1 --2- 172.21.15.26:0/1804537204 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f49580664a0 0x7f4958068960 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f49600af000 tx=0x7f49600a7000 comp rx=0 tx=0).stop 2023-10-14T11:14:18.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.844+0000 7f49722c9640 1 -- 172.21.15.26:0/1804537204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f496c0c6ad0 msgr2=0x7f496c144820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:18.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.844+0000 7f49722c9640 1 --2- 172.21.15.26:0/1804537204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f496c0c6ad0 0x7f496c144820 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f495c001140 tx=0x7f495c00c8c0 comp rx=0 tx=0).stop 2023-10-14T11:14:18.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.844+0000 7f49722c9640 1 -- 172.21.15.26:0/1804537204 shutdown_connections 2023-10-14T11:14:18.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.844+0000 7f49722c9640 1 --2- 172.21.15.26:0/1804537204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f496c15ca70 0x7f496c06b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:18.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.844+0000 7f49722c9640 1 --2- 172.21.15.26:0/1804537204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f496c0cf090 0x7f496c157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:18.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.844+0000 7f49722c9640 1 --2- 172.21.15.26:0/1804537204 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f49580664a0 0x7f4958068960 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:18.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.844+0000 7f49722c9640 1 --2- 172.21.15.26:0/1804537204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f496c0c6ad0 0x7f496c144820 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:18.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.844+0000 7f49722c9640 1 -- 172.21.15.26:0/1804537204 >> 172.21.15.26:0/1804537204 conn(0x7f496c09bc50 msgr2=0x7f496c0b7500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:18.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.844+0000 7f49722c9640 1 -- 172.21.15.26:0/1804537204 shutdown_connections 2023-10-14T11:14:18.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:18.844+0000 7f49722c9640 1 -- 172.21.15.26:0/1804537204 wait complete. 2023-10-14T11:14:18.873 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T11:14:18.873 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T11:14:18.874 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-14T11:14:18.876 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T11:14:18.877 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T11:14:18.878 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T11:14:18.878 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T11:14:18.878 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T11:14:18.879 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:14:18.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:18.879 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-14T11:14:18.890 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:14:19.683 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:14:19.683 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:14:19.684 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:19.684 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-14T11:14:19.684 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:19.684 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:14:19.684 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-14T11:14:19.685 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-14T11:14:19.685 INFO:teuthology.orchestra.run.smithi026.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T11:14:19.685 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:14:19.685 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-14T11:14:19.685 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-14T11:14:19.686 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42318sec preferred_lft 42318sec 2023-10-14T11:14:19.686 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-14T11:14:19.686 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:19.686 INFO:teuthology.orchestra.run.smithi026.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:14:19.686 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-14T11:14:19.687 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-14T11:14:19.687 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:14:19.687 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:14:19.687 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-14T11:14:19.687 INFO:teuthology.orchestra.run.smithi026.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-14T11:14:19.688 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 02:42:e1:29:12:f0 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:14:19.688 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-14T11:14:19.688 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:19.688 INFO:teuthology.orchestra.run.smithi026.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T11:14:19.688 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-14T11:14:19.688 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T11:14:19.689 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:19.689 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-14T11:14:19.689 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:19.689 INFO:teuthology.orchestra.run.smithi026.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T11:14:19.689 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:14:19.690 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-14T11:14:19.690 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:19.690 INFO:teuthology.orchestra.run.smithi026.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T11:14:19.690 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:14:19.690 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-14T11:14:19.690 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:19.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:19.691 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T11:14:19.692 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:14:19.702 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:14:19.717 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-14T11:14:19.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:19.720 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-14T11:14:19.803 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-14T11:14:19.803 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T11:14:19.804 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-14T11:14:19.804 INFO:teuthology.orchestra.run.smithi026.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-14T11:14:19.804 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-14T11:14:19.804 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T11:14:19.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:19.805 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-14T11:14:19.805 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-14T11:14:19.806 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T11:14:19.806 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T11:14:19.807 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T11:14:19.807 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-14T11:14:19.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:19.911 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-14T11:14:19.923 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T11:14:19.923 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T11:14:19.923 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:14:19.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:19.924 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-10-14T11:14:19.989 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-14T11:14:19.990 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:14:19.990 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T11:14:20.043 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:14:20.044 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:14:20.044 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T11:14:20.095 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-10-14T11:14:20.161 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:14:20.213 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2023-10-14T11:14:20.214 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2023-10-14T11:14:20.214 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2023-10-14T11:14:20.214 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2023-10-14T11:14:20.214 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2023-10-14T11:14:20.214 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2023-10-14T11:14:20.215 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2023-10-14T11:14:20.215 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2023-10-14T11:14:20.215 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2023-10-14T11:14:20.215 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2023-10-14T11:14:20.215 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2023-10-14T11:14:20.215 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2023-10-14T11:14:20.216 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:14:20.216 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2023-10-14T11:14:20.216 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2023-10-14T11:14:20.216 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2023-10-14T11:14:20.216 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2023-10-14T11:14:20.217 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2023-10-14T11:14:20.217 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2023-10-14T11:14:20.217 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2023-10-14T11:14:20.217 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:14:20.217 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2023-10-14T11:14:20.217 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2023-10-14T11:14:20.218 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2023-10-14T11:14:20.218 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T11:14:20.218 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T11:14:20.218 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T11:14:20.218 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T11:14:20.219 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2023-10-14T11:14:20.219 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:14:20.219 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:14:20.219 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:14:20.219 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:14:20.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:20.221 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-10-14T11:14:20.271 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-14T11:14:20.272 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-14T11:14:20.318 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-10-14T11:14:20.341 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:14:20.393 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2023-10-14T11:14:20.393 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2023-10-14T11:14:20.393 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2023-10-14T11:14:20.394 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2023-10-14T11:14:20.394 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2023-10-14T11:14:20.394 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2023-10-14T11:14:20.394 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2023-10-14T11:14:20.394 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2023-10-14T11:14:20.395 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2023-10-14T11:14:20.395 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2023-10-14T11:14:20.395 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2023-10-14T11:14:20.395 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2023-10-14T11:14:20.395 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:14:20.395 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2023-10-14T11:14:20.396 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2023-10-14T11:14:20.396 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2023-10-14T11:14:20.396 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2023-10-14T11:14:20.396 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2023-10-14T11:14:20.396 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2023-10-14T11:14:20.397 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2023-10-14T11:14:20.397 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:14:20.397 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2023-10-14T11:14:20.397 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2023-10-14T11:14:20.397 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2023-10-14T11:14:20.398 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T11:14:20.398 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T11:14:20.398 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T11:14:20.398 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T11:14:20.398 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2023-10-14T11:14:20.399 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:14:20.399 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:14:20.399 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:14:20.399 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:14:20.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:20.401 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-10-14T11:14:20.417 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:2023-10-14T11:14:20.412+0000 7fe093a46580 -1 init, newargv = 0x556c7a4bfe80 newargc=15 2023-10-14T11:14:20.417 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[49272]: starting ceph client 2023-10-14T11:14:20.424 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[49272]: starting fuse 2023-10-14T11:14:20.427 INFO:teuthology.orchestra.run.smithi026.stdout:43 2023-10-14T11:14:20.427 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-10-14T11:14:20.428 DEBUG:teuthology.orchestra.run.smithi026:> sudo stdin-killer -- python3 -c ' 2023-10-14T11:14:20.428 DEBUG:teuthology.orchestra.run.smithi026:> import glob 2023-10-14T11:14:20.429 DEBUG:teuthology.orchestra.run.smithi026:> import re 2023-10-14T11:14:20.429 DEBUG:teuthology.orchestra.run.smithi026:> import os 2023-10-14T11:14:20.430 DEBUG:teuthology.orchestra.run.smithi026:> import subprocess 2023-10-14T11:14:20.430 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:14:20.430 DEBUG:teuthology.orchestra.run.smithi026:> def _find_admin_socket(client_name): 2023-10-14T11:14:20.431 DEBUG:teuthology.orchestra.run.smithi026:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-14T11:14:20.431 DEBUG:teuthology.orchestra.run.smithi026:> files = glob.glob(asok_path) 2023-10-14T11:14:20.431 DEBUG:teuthology.orchestra.run.smithi026:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-14T11:14:20.432 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:14:20.432 DEBUG:teuthology.orchestra.run.smithi026:> # Given a non-glob path, it better be there 2023-10-14T11:14:20.433 DEBUG:teuthology.orchestra.run.smithi026:> if "*" not in asok_path: 2023-10-14T11:14:20.433 DEBUG:teuthology.orchestra.run.smithi026:> assert(len(files) == 1) 2023-10-14T11:14:20.433 DEBUG:teuthology.orchestra.run.smithi026:> return files[0] 2023-10-14T11:14:20.434 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:14:20.434 DEBUG:teuthology.orchestra.run.smithi026:> for f in files: 2023-10-14T11:14:20.435 DEBUG:teuthology.orchestra.run.smithi026:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-14T11:14:20.435 DEBUG:teuthology.orchestra.run.smithi026:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-14T11:14:20.435 DEBUG:teuthology.orchestra.run.smithi026:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-14T11:14:20.436 DEBUG:teuthology.orchestra.run.smithi026:> contents = proc_f.read() 2023-10-14T11:14:20.436 DEBUG:teuthology.orchestra.run.smithi026:> if mountpoint in contents: 2023-10-14T11:14:20.436 DEBUG:teuthology.orchestra.run.smithi026:> return f 2023-10-14T11:14:20.437 DEBUG:teuthology.orchestra.run.smithi026:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-14T11:14:20.437 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:14:20.437 DEBUG:teuthology.orchestra.run.smithi026:> print(_find_admin_socket("client.0")) 2023-10-14T11:14:20.438 DEBUG:teuthology.orchestra.run.smithi026:> ' 2023-10-14T11:14:20.558 INFO:teuthology.orchestra.run.smithi026.stdout:/var/run/ceph/ceph-client.0.49272.asok 2023-10-14T11:14:20.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-14T11:14:20.570 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49272.asok 2023-10-14T11:14:20.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:20.571 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49272.asok status 2023-10-14T11:14:20.743 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:14:20.743 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": { 2023-10-14T11:14:20.743 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-14T11:14:20.744 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T11:14:20.744 INFO:teuthology.orchestra.run.smithi026.stdout: "entity_id": "0", 2023-10-14T11:14:20.744 INFO:teuthology.orchestra.run.smithi026.stdout: "hostname": "smithi026", 2023-10-14T11:14:20.744 INFO:teuthology.orchestra.run.smithi026.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-14T11:14:20.744 INFO:teuthology.orchestra.run.smithi026.stdout: "pid": "49272", 2023-10-14T11:14:20.745 INFO:teuthology.orchestra.run.smithi026.stdout: "root": "/" 2023-10-14T11:14:20.745 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:20.745 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_count": 0, 2023-10-14T11:14:20.745 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_pinned_count": 0, 2023-10-14T11:14:20.746 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 5895, 2023-10-14T11:14:20.746 INFO:teuthology.orchestra.run.smithi026.stdout: "inst": { 2023-10-14T11:14:20.746 INFO:teuthology.orchestra.run.smithi026.stdout: "name": { 2023-10-14T11:14:20.746 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "client", 2023-10-14T11:14:20.746 INFO:teuthology.orchestra.run.smithi026.stdout: "num": 5895 2023-10-14T11:14:20.746 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:20.747 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-10-14T11:14:20.747 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-14T11:14:20.747 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2023-10-14T11:14:20.747 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 1820487774 2023-10-14T11:14:20.747 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:20.748 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:20.748 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-10-14T11:14:20.748 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-14T11:14:20.748 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2023-10-14T11:14:20.748 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 1820487774 2023-10-14T11:14:20.749 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:20.749 INFO:teuthology.orchestra.run.smithi026.stdout: "inst_str": "client.5895 192.168.0.1:0/1820487774", 2023-10-14T11:14:20.749 INFO:teuthology.orchestra.run.smithi026.stdout: "addr_str": "192.168.0.1:0/1820487774", 2023-10-14T11:14:20.749 INFO:teuthology.orchestra.run.smithi026.stdout: "inode_count": 1, 2023-10-14T11:14:20.749 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_epoch": 18, 2023-10-14T11:14:20.749 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch": 42, 2023-10-14T11:14:20.750 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch_barrier": 0, 2023-10-14T11:14:20.750 INFO:teuthology.orchestra.run.smithi026.stdout: "blocklisted": false, 2023-10-14T11:14:20.750 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "testcephfs1" 2023-10-14T11:14:20.750 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:14:20.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:20.760 DEBUG:teuthology.orchestra.run.smithi026:> stat --file-system '--printf=%T 2023-10-14T11:14:20.760 DEBUG:teuthology.orchestra.run.smithi026:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-14T11:14:20.770 INFO:teuthology.orchestra.run.smithi026.stdout:fuseblk 2023-10-14T11:14:20.770 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-14T11:14:20.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:20.771 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T11:14:20.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:20.831 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2023-10-14T11:14:20.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:20.891 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2023-10-14T11:14:20.950 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:14:20.950 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:14:21.000 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:14:21.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.180+0000 7f73e6ed6640 1 Processor -- start 2023-10-14T11:14:21.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.180+0000 7f73e6ed6640 1 -- start start 2023-10-14T11:14:21.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.180+0000 7f73e6ed6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f73e015ce30 0x7f73e00cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:21.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.180+0000 7f73e6ed6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f73e00b21c0 0x7f73e00b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:21.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.180+0000 7f73e6ed6640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e01607e0 con 0x7f73e015ca50 2023-10-14T11:14:21.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.180+0000 7f73e6ed6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e00cf060 con 0x7f73e015ce30 2023-10-14T11:14:21.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.180+0000 7f73e6ed6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e00b2ae0 con 0x7f73e00b21c0 2023-10-14T11:14:21.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.180+0000 7f73dffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f73e015ce30 0x7f73e00cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:21.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.180+0000 7f73dffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f73e015ce30 0x7f73e00cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38444/0 (socket says 172.21.15.26:38444) 2023-10-14T11:14:21.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.180+0000 7f73dffff640 1 -- 172.21.15.26:0/4258394383 learned_addr learned my addr 172.21.15.26:0/4258394383 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:21.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.180+0000 7f73dffff640 1 -- 172.21.15.26:0/4258394383 >> v2:172.21.15.110:3300/0 conn(0x7f73e00b21c0 msgr2=0x7f73e00b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:21.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.180+0000 7f73e5473640 1 --2- 172.21.15.26:0/4258394383 >> v2:172.21.15.110:3300/0 conn(0x7f73e00b21c0 0x7f73e00b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:21.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.184+0000 7f73dffff640 1 --2- 172.21.15.26:0/4258394383 >> v2:172.21.15.110:3300/0 conn(0x7f73e00b21c0 0x7f73e00b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.184+0000 7f73dffff640 1 -- 172.21.15.26:0/4258394383 >> v1:172.21.15.110:6789/0 conn(0x7f73e015ca50 legacy=0x7f73e006c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:21.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.184+0000 7f73dffff640 1 -- 172.21.15.26:0/4258394383 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e0070210 con 0x7f73e015ce30 2023-10-14T11:14:21.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.184+0000 7f73e5473640 1 --2- 172.21.15.26:0/4258394383 >> v2:172.21.15.110:3300/0 conn(0x7f73e00b21c0 0x7f73e00b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:21.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.184+0000 7f73dffff640 1 --2- 172.21.15.26:0/4258394383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73e015ce30 0x7f73e00cad90 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f73e00c4210 tx=0x7f73cc01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e9e56f9e07246a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:21.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.184+0000 7f73df7fe640 1 -- 172.21.15.26:0/4258394383 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc0aa620 con 0x7f73e015ce30 2023-10-14T11:14:21.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.184+0000 7f73df7fe640 1 -- 172.21.15.26:0/4258394383 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73cc0aa780 con 0x7f73e015ce30 2023-10-14T11:14:21.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.184+0000 7f73df7fe640 1 -- 172.21.15.26:0/4258394383 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc0aab10 con 0x7f73e015ce30 2023-10-14T11:14:21.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.184+0000 7f73e6ed6640 1 -- 172.21.15.26:0/4258394383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73e015ce30 msgr2=0x7f73e00cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:21.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.184+0000 7f73e6ed6640 1 --2- 172.21.15.26:0/4258394383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73e015ce30 0x7f73e00cad90 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f73e00c4210 tx=0x7f73cc01c4c0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.184+0000 7f73e6ed6640 1 -- 172.21.15.26:0/4258394383 shutdown_connections 2023-10-14T11:14:21.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.184+0000 7f73e6ed6640 1 --2- 172.21.15.26:0/4258394383 >> v2:172.21.15.110:3300/0 conn(0x7f73e00b21c0 0x7f73e00b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.184+0000 7f73e6ed6640 1 --2- 172.21.15.26:0/4258394383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73e015ce30 0x7f73e00cad90 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.184+0000 7f73e6ed6640 1 -- 172.21.15.26:0/4258394383 >> 172.21.15.26:0/4258394383 conn(0x7f73e00cd1c0 msgr2=0x7f73e00cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:21.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.184+0000 7f73e6ed6640 1 -- 172.21.15.26:0/4258394383 shutdown_connections 2023-10-14T11:14:21.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.184+0000 7f73e6ed6640 1 -- 172.21.15.26:0/4258394383 wait complete. 2023-10-14T11:14:21.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73e6ed6640 1 Processor -- start 2023-10-14T11:14:21.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73e6ed6640 1 -- start start 2023-10-14T11:14:21.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73e6ed6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73e00b21c0 0x7f73e00c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:21.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73e6ed6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73e015ca50 0x7f73e01559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:21.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73e6ed6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73e015ce30 0x7f73e00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:21.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73e6ed6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e0155f20 con 0x7f73e015ce30 2023-10-14T11:14:21.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73e6ed6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e00b5280 con 0x7f73e00b21c0 2023-10-14T11:14:21.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73e6ed6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e00c8b20 con 0x7f73e015ca50 2023-10-14T11:14:21.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73e5473640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73e015ce30 0x7f73e00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:21.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73e5473640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73e015ce30 0x7f73e00b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38450/0 (socket says 172.21.15.26:38450) 2023-10-14T11:14:21.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73e5473640 1 -- 172.21.15.26:0/3673377236 learned_addr learned my addr 172.21.15.26:0/3673377236 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:21.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73e4c72640 1 --2- 172.21.15.26:0/3673377236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73e00b21c0 0x7f73e00c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:21.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73dffff640 1 --2- 172.21.15.26:0/3673377236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73e015ca50 0x7f73e01559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:21.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73e5473640 1 -- 172.21.15.26:0/3673377236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73e015ca50 msgr2=0x7f73e01559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:21.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73e5473640 1 --2- 172.21.15.26:0/3673377236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73e015ca50 0x7f73e01559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73e5473640 1 -- 172.21.15.26:0/3673377236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73e00b21c0 msgr2=0x7f73e00c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:21.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73e5473640 1 --2- 172.21.15.26:0/3673377236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73e00b21c0 0x7f73e00c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73e5473640 1 -- 172.21.15.26:0/3673377236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73cc0094d0 con 0x7f73e015ce30 2023-10-14T11:14:21.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73dffff640 1 --2- 172.21.15.26:0/3673377236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73e015ca50 0x7f73e01559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:21.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73e5473640 1 --2- 172.21.15.26:0/3673377236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73e015ce30 0x7f73e00b4d40 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f73d800cef0 tx=0x7f73d800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:21.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73dd7fa640 1 -- 172.21.15.26:0/3673377236 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d800d840 con 0x7f73e015ce30 2023-10-14T11:14:21.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73dd7fa640 1 -- 172.21.15.26:0/3673377236 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d800d9c0 con 0x7f73e015ce30 2023-10-14T11:14:21.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73dd7fa640 1 -- 172.21.15.26:0/3673377236 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d800dd70 con 0x7f73e015ce30 2023-10-14T11:14:21.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.188+0000 7f73e6ed6640 1 -- 172.21.15.26:0/3673377236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e00c7f10 con 0x7f73e015ce30 2023-10-14T11:14:21.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.192+0000 7f73e6ed6640 1 -- 172.21.15.26:0/3673377236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e00c84d0 con 0x7f73e015ce30 2023-10-14T11:14:21.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.192+0000 7f73e6ed6640 1 -- 172.21.15.26:0/3673377236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e00c8c90 con 0x7f73e015ce30 2023-10-14T11:14:21.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.192+0000 7f73dd7fa640 1 -- 172.21.15.26:0/3673377236 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f73d801e3b0 con 0x7f73e015ce30 2023-10-14T11:14:21.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.192+0000 7f73dd7fa640 1 --2- 172.21.15.26:0/3673377236 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73c40664d0 0x7f73c4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:21.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.192+0000 7f73dd7fa640 1 -- 172.21.15.26:0/3673377236 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f73d8084c80 con 0x7f73e015ce30 2023-10-14T11:14:21.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.192+0000 7f73e4c72640 1 --2- 172.21.15.26:0/3673377236 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73c40664d0 0x7f73c4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:21.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.192+0000 7f73e4c72640 1 --2- 172.21.15.26:0/3673377236 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73c40664d0 0x7f73c4068990 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f73e0167920 tx=0x7f73d4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:21.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.196+0000 7f73dd7fa640 1 -- 172.21.15.26:0/3673377236 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f73d8051e30 con 0x7f73e015ce30 2023-10-14T11:14:21.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.352+0000 7f73e6ed6640 1 -- 172.21.15.26:0/3673377236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73e0074010 con 0x7f73e015ce30 2023-10-14T11:14:21.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.356+0000 7f73dd7fa640 1 -- 172.21.15.26:0/3673377236 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18578 (secure 0 0 0) 0x7f73d801a020 con 0x7f73e015ce30 2023-10-14T11:14:21.360 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:21.361 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":42,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:14:01.292164+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:13:48.453821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:13:49.623527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-10-14T11:13:59.245615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:14:21.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.356+0000 7f73e6ed6640 1 -- 172.21.15.26:0/3673377236 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73c40664d0 msgr2=0x7f73c4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:21.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.356+0000 7f73e6ed6640 1 --2- 172.21.15.26:0/3673377236 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73c40664d0 0x7f73c4068990 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f73e0167920 tx=0x7f73d4009040 comp rx=0 tx=0).stop 2023-10-14T11:14:21.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.356+0000 7f73e6ed6640 1 -- 172.21.15.26:0/3673377236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73e015ce30 msgr2=0x7f73e00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:21.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.356+0000 7f73e6ed6640 1 --2- 172.21.15.26:0/3673377236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73e015ce30 0x7f73e00b4d40 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f73d800cef0 tx=0x7f73d800a710 comp rx=0 tx=0).stop 2023-10-14T11:14:21.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.356+0000 7f73e6ed6640 1 -- 172.21.15.26:0/3673377236 shutdown_connections 2023-10-14T11:14:21.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.356+0000 7f73e6ed6640 1 --2- 172.21.15.26:0/3673377236 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73c40664d0 0x7f73c4068990 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.356+0000 7f73e6ed6640 1 --2- 172.21.15.26:0/3673377236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73e015ce30 0x7f73e00b4d40 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.356+0000 7f73e6ed6640 1 --2- 172.21.15.26:0/3673377236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73e015ca50 0x7f73e01559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.356+0000 7f73e6ed6640 1 --2- 172.21.15.26:0/3673377236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73e00b21c0 0x7f73e00c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.356+0000 7f73e6ed6640 1 -- 172.21.15.26:0/3673377236 >> 172.21.15.26:0/3673377236 conn(0x7f73e00cd1c0 msgr2=0x7f73e00b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:21.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.356+0000 7f73e6ed6640 1 -- 172.21.15.26:0/3673377236 shutdown_connections 2023-10-14T11:14:21.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.356+0000 7f73e6ed6640 1 -- 172.21.15.26:0/3673377236 wait complete. 2023-10-14T11:14:21.382 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'testcephfs1_metadata', 'create_time': '2023-10-14T11:13:48.453821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'testcephfs1_data', 'create_time': '2023-10-14T11:13:49.623527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-10-14T11:13:59.245615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:14:21.383 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:14:21.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.524+0000 7fe137c79640 1 Processor -- start 2023-10-14T11:14:21.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.524+0000 7fe137c79640 1 -- start start 2023-10-14T11:14:21.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.524+0000 7fe137c79640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe13006afa0 0x7fe13006b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:21.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.524+0000 7fe137c79640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe1300b52b0 0x7fe1300ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:21.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.528+0000 7fe137c79640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1300cf430 con 0x7fe13006f9d0 2023-10-14T11:14:21.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.528+0000 7fe137c79640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe13006b8c0 con 0x7fe1300b52b0 2023-10-14T11:14:21.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.528+0000 7fe137c79640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1300cf150 con 0x7fe13006afa0 2023-10-14T11:14:21.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.528+0000 7fe135214640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe1300b52b0 0x7fe1300ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:21.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.528+0000 7fe136216640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe13006f9d0 0x7fe1300cd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56592/0 (socket says 172.21.15.26:56592) 2023-10-14T11:14:21.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.528+0000 7fe136216640 1 -- 172.21.15.26:0/646542721 learned_addr learned my addr 172.21.15.26:0/646542721 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:21.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.528+0000 7fe135a15640 1 --2- 172.21.15.26:0/646542721 >> v2:172.21.15.110:3300/0 conn(0x7fe13006afa0 0x7fe13006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:21.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.528+0000 7fe135214640 1 -- 172.21.15.26:0/646542721 >> v2:172.21.15.110:3300/0 conn(0x7fe13006afa0 msgr2=0x7fe13006b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:21.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.528+0000 7fe135214640 1 --2- 172.21.15.26:0/646542721 >> v2:172.21.15.110:3300/0 conn(0x7fe13006afa0 0x7fe13006b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.528+0000 7fe135214640 1 -- 172.21.15.26:0/646542721 >> v1:172.21.15.26:6789/0 conn(0x7fe13006f9d0 legacy=0x7fe1300cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:21.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.528+0000 7fe135214640 1 -- 172.21.15.26:0/646542721 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13006eef0 con 0x7fe1300b52b0 2023-10-14T11:14:21.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.528+0000 7fe135214640 1 --2- 172.21.15.26:0/646542721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1300b52b0 0x7fe1300ce850 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe1300d08a0 tx=0x7fe120020e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964ec6f04294f8be server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:21.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.528+0000 7fe134a13640 1 -- 172.21.15.26:0/646542721 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1200aab60 con 0x7fe1300b52b0 2023-10-14T11:14:21.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.528+0000 7fe134a13640 1 -- 172.21.15.26:0/646542721 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1200aacc0 con 0x7fe1300b52b0 2023-10-14T11:14:21.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe134a13640 1 -- 172.21.15.26:0/646542721 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1200b2660 con 0x7fe1300b52b0 2023-10-14T11:14:21.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe137c79640 1 -- 172.21.15.26:0/646542721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1300b52b0 msgr2=0x7fe1300ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:21.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe137c79640 1 --2- 172.21.15.26:0/646542721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1300b52b0 0x7fe1300ce850 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe1300d08a0 tx=0x7fe120020e60 comp rx=0 tx=0).stop 2023-10-14T11:14:21.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe137c79640 1 -- 172.21.15.26:0/646542721 shutdown_connections 2023-10-14T11:14:21.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe137c79640 1 --2- 172.21.15.26:0/646542721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1300b52b0 0x7fe1300ce850 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe137c79640 1 --2- 172.21.15.26:0/646542721 >> v2:172.21.15.110:3300/0 conn(0x7fe13006afa0 0x7fe13006b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe137c79640 1 -- 172.21.15.26:0/646542721 >> 172.21.15.26:0/646542721 conn(0x7fe1300cf7a0 msgr2=0x7fe1300cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:21.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe137c79640 1 -- 172.21.15.26:0/646542721 shutdown_connections 2023-10-14T11:14:21.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe137c79640 1 -- 172.21.15.26:0/646542721 wait complete. 2023-10-14T11:14:21.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe137c79640 1 Processor -- start 2023-10-14T11:14:21.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe137c79640 1 -- start start 2023-10-14T11:14:21.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe137c79640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe13006afa0 0x7fe1300c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:21.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe137c79640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe13006f9d0 0x7fe1300c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:21.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe137c79640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1300b52b0 0x7fe1300c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:21.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe137c79640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1300c7420 con 0x7fe13006afa0 2023-10-14T11:14:21.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe137c79640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1301f22f0 con 0x7fe13006f9d0 2023-10-14T11:14:21.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe137c79640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe13015c7a0 con 0x7fe1300b52b0 2023-10-14T11:14:21.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe135a15640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe13006afa0 0x7fe1300c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:21.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe135a15640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe13006afa0 0x7fe1300c7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38480/0 (socket says 172.21.15.26:38480) 2023-10-14T11:14:21.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe135a15640 1 -- 172.21.15.26:0/299602888 learned_addr learned my addr 172.21.15.26:0/299602888 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:21.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe135214640 1 --2- 172.21.15.26:0/299602888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe13006f9d0 0x7fe1300c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:21.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe135a15640 1 -- 172.21.15.26:0/299602888 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1300b52b0 msgr2=0x7fe1300c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:21.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.532+0000 7fe136216640 1 --2- 172.21.15.26:0/299602888 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1300b52b0 0x7fe1300c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:21.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.536+0000 7fe135a15640 1 --2- 172.21.15.26:0/299602888 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1300b52b0 0x7fe1300c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.536+0000 7fe135a15640 1 -- 172.21.15.26:0/299602888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe13006f9d0 msgr2=0x7fe1300c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:21.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.536+0000 7fe135a15640 1 --2- 172.21.15.26:0/299602888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe13006f9d0 0x7fe1300c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.536+0000 7fe135a15640 1 -- 172.21.15.26:0/299602888 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe120009420 con 0x7fe13006afa0 2023-10-14T11:14:21.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.536+0000 7fe135214640 1 --2- 172.21.15.26:0/299602888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe13006f9d0 0x7fe1300c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:21.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.536+0000 7fe136216640 1 --2- 172.21.15.26:0/299602888 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1300b52b0 0x7fe1300c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:21.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.536+0000 7fe135a15640 1 --2- 172.21.15.26:0/299602888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe13006afa0 0x7fe1300c7840 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe12c00d800 tx=0x7fe12c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:21.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.536+0000 7fe1267fc640 1 -- 172.21.15.26:0/299602888 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c00b6c0 con 0x7fe13006afa0 2023-10-14T11:14:21.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.536+0000 7fe1267fc640 1 -- 172.21.15.26:0/299602888 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12c00b820 con 0x7fe13006afa0 2023-10-14T11:14:21.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.536+0000 7fe1267fc640 1 -- 172.21.15.26:0/299602888 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c00bb90 con 0x7fe13006afa0 2023-10-14T11:14:21.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.536+0000 7fe137c79640 1 -- 172.21.15.26:0/299602888 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe13015bf80 con 0x7fe13006afa0 2023-10-14T11:14:21.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.536+0000 7fe137c79640 1 -- 172.21.15.26:0/299602888 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe13015cd20 con 0x7fe13006afa0 2023-10-14T11:14:21.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.536+0000 7fe137c79640 1 -- 172.21.15.26:0/299602888 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe13004e170 con 0x7fe13006afa0 2023-10-14T11:14:21.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.536+0000 7fe1267fc640 1 -- 172.21.15.26:0/299602888 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe12c00bcf0 con 0x7fe13006afa0 2023-10-14T11:14:21.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.536+0000 7fe1267fc640 1 --2- 172.21.15.26:0/299602888 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe1140664a0 0x7fe114068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:21.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.536+0000 7fe1267fc640 1 -- 172.21.15.26:0/299602888 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7fe12c084740 con 0x7fe13006afa0 2023-10-14T11:14:21.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.536+0000 7fe135214640 1 --2- 172.21.15.26:0/299602888 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe1140664a0 0x7fe114068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:21.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.540+0000 7fe135214640 1 --2- 172.21.15.26:0/299602888 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe1140664a0 0x7fe114068960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe1200b4000 tx=0x7fe1200ac070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:21.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.544+0000 7fe1267fc640 1 -- 172.21.15.26:0/299602888 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe12c051830 con 0x7fe13006afa0 2023-10-14T11:14:21.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.700+0000 7fe137c79640 1 -- 172.21.15.26:0/299602888 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1300b5720 con 0x7fe13006afa0 2023-10-14T11:14:21.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.700+0000 7fe1267fc640 1 -- 172.21.15.26:0/299602888 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe12c054e50 con 0x7fe13006afa0 2023-10-14T11:14:21.705 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:14:21.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.700+0000 7fe137c79640 1 -- 172.21.15.26:0/299602888 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe1140664a0 msgr2=0x7fe114068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:21.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.700+0000 7fe137c79640 1 --2- 172.21.15.26:0/299602888 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe1140664a0 0x7fe114068960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe1200b4000 tx=0x7fe1200ac070 comp rx=0 tx=0).stop 2023-10-14T11:14:21.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.700+0000 7fe137c79640 1 -- 172.21.15.26:0/299602888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe13006afa0 msgr2=0x7fe1300c7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:21.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.700+0000 7fe137c79640 1 --2- 172.21.15.26:0/299602888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe13006afa0 0x7fe1300c7840 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe12c00d800 tx=0x7fe12c00dcc0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.700+0000 7fe137c79640 1 -- 172.21.15.26:0/299602888 shutdown_connections 2023-10-14T11:14:21.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.700+0000 7fe137c79640 1 --2- 172.21.15.26:0/299602888 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1300b52b0 0x7fe1300c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.700+0000 7fe137c79640 1 --2- 172.21.15.26:0/299602888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe13006f9d0 0x7fe1300c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.700+0000 7fe137c79640 1 --2- 172.21.15.26:0/299602888 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe1140664a0 0x7fe114068960 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.700+0000 7fe137c79640 1 --2- 172.21.15.26:0/299602888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe13006afa0 0x7fe1300c7840 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.700+0000 7fe137c79640 1 -- 172.21.15.26:0/299602888 >> 172.21.15.26:0/299602888 conn(0x7fe1300cf7a0 msgr2=0x7fe1300b39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:21.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.700+0000 7fe137c79640 1 -- 172.21.15.26:0/299602888 shutdown_connections 2023-10-14T11:14:21.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.700+0000 7fe137c79640 1 -- 172.21.15.26:0/299602888 wait complete. 2023-10-14T11:14:21.726 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_metadata pg_num 2023-10-14T11:14:21.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.868+0000 7f37b14d6640 1 Processor -- start 2023-10-14T11:14:21.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.868+0000 7f37b14d6640 1 -- start start 2023-10-14T11:14:21.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.868+0000 7f37b14d6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f37ac0b84e0 0x7f37ac0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:21.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.868+0000 7f37b14d6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ac0d1670 con 0x7f37ac0d0210 2023-10-14T11:14:21.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.868+0000 7f37b14d6640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ac0d1950 con 0x7f37ac15cba0 2023-10-14T11:14:21.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.868+0000 7f37b14d6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37ac0d1460 con 0x7f37ac0b84e0 2023-10-14T11:14:21.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.868+0000 7f37a3fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f37ac0d0210 0x7f37ac0b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56602/0 (socket says 172.21.15.26:56602) 2023-10-14T11:14:21.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.868+0000 7f37a3fff640 1 -- 172.21.15.26:0/25320791 learned_addr learned my addr 172.21.15.26:0/25320791 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:21.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.868+0000 7f37ab7fe640 1 --2- 172.21.15.26:0/25320791 >> v2:172.21.15.110:3300/0 conn(0x7f37ac0b84e0 0x7f37ac0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:21.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.868+0000 7f37aa7fc640 1 -- 172.21.15.26:0/25320791 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360062966 0 0) 0x7f37ac0d1670 con 0x7f37ac0d0210 2023-10-14T11:14:21.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.868+0000 7f37aa7fc640 1 -- 172.21.15.26:0/25320791 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3798003530 con 0x7f37ac0d0210 2023-10-14T11:14:21.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.868+0000 7f37ab7fe640 1 -- 172.21.15.26:0/25320791 >> v1:172.21.15.110:6789/0 conn(0x7f37ac15cba0 legacy=0x7f37ac0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:21.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.868+0000 7f37ab7fe640 1 -- 172.21.15.26:0/25320791 >> v1:172.21.15.26:6789/0 conn(0x7f37ac0d0210 legacy=0x7f37ac0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:21.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.868+0000 7f37ab7fe640 1 -- 172.21.15.26:0/25320791 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ac0d1c30 con 0x7f37ac0b84e0 2023-10-14T11:14:21.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.872+0000 7f37ab7fe640 1 --2- 172.21.15.26:0/25320791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37ac0b84e0 0x7f37ac0d0f20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009d90 tx=0x7f37a401c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=520c1533e65917ca server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:21.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.872+0000 7f37aa7fc640 1 -- 172.21.15.26:0/25320791 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a40a5980 con 0x7f37ac0b84e0 2023-10-14T11:14:21.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.872+0000 7f37aa7fc640 1 -- 172.21.15.26:0/25320791 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a40a5ae0 con 0x7f37ac0b84e0 2023-10-14T11:14:21.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.872+0000 7f37aa7fc640 1 -- 172.21.15.26:0/25320791 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a40a5e70 con 0x7f37ac0b84e0 2023-10-14T11:14:21.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.872+0000 7f37b14d6640 1 -- 172.21.15.26:0/25320791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37ac0b84e0 msgr2=0x7f37ac0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:21.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.872+0000 7f37b14d6640 1 --2- 172.21.15.26:0/25320791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37ac0b84e0 0x7f37ac0d0f20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009d90 tx=0x7f37a401c8c0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.872+0000 7f37b14d6640 1 -- 172.21.15.26:0/25320791 shutdown_connections 2023-10-14T11:14:21.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.872+0000 7f37b14d6640 1 --2- 172.21.15.26:0/25320791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37ac0b84e0 0x7f37ac0d0f20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.872+0000 7f37b14d6640 1 -- 172.21.15.26:0/25320791 >> 172.21.15.26:0/25320791 conn(0x7f37ac0719c0 msgr2=0x7f37ac071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:21.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.872+0000 7f37b14d6640 1 -- 172.21.15.26:0/25320791 shutdown_connections 2023-10-14T11:14:21.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.872+0000 7f37b14d6640 1 -- 172.21.15.26:0/25320791 wait complete. 2023-10-14T11:14:21.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37b14d6640 1 Processor -- start 2023-10-14T11:14:21.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37b14d6640 1 -- start start 2023-10-14T11:14:21.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37b14d6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37ac0b84e0 0x7f37ac152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:21.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37b14d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37ac0d0210 0x7f37ac15f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:21.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37b14d6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37ac15cba0 0x7f37ac149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:21.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37b14d6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac152ad0 con 0x7f37ac0d0210 2023-10-14T11:14:21.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37b14d6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac15e8b0 con 0x7f37ac0b84e0 2023-10-14T11:14:21.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37b14d6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac15eb90 con 0x7f37ac15cba0 2023-10-14T11:14:21.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37a3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37ac0d0210 0x7f37ac15f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:21.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37a3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37ac0d0210 0x7f37ac15f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38496/0 (socket says 172.21.15.26:38496) 2023-10-14T11:14:21.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37a3fff640 1 -- 172.21.15.26:0/1377267600 learned_addr learned my addr 172.21.15.26:0/1377267600 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:21.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37aaffd640 1 --2- 172.21.15.26:0/1377267600 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37ac0b84e0 0x7f37ac152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:21.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37ab7fe640 1 --2- 172.21.15.26:0/1377267600 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37ac15cba0 0x7f37ac149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:21.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37a3fff640 1 -- 172.21.15.26:0/1377267600 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37ac15cba0 msgr2=0x7f37ac149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:21.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37a3fff640 1 --2- 172.21.15.26:0/1377267600 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37ac15cba0 0x7f37ac149900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37a3fff640 1 -- 172.21.15.26:0/1377267600 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37ac0b84e0 msgr2=0x7f37ac152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:21.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37a3fff640 1 --2- 172.21.15.26:0/1377267600 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37ac0b84e0 0x7f37ac152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:21.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37a3fff640 1 -- 172.21.15.26:0/1377267600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a4009a70 con 0x7f37ac0d0210 2023-10-14T11:14:21.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37a3fff640 1 --2- 172.21.15.26:0/1377267600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37ac0d0210 0x7f37ac15f950 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3794001ec0 tx=0x7f379400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:21.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37a37fe640 1 -- 172.21.15.26:0/1377267600 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3794005d50 con 0x7f37ac0d0210 2023-10-14T11:14:21.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37a37fe640 1 -- 172.21.15.26:0/1377267600 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3794007070 con 0x7f37ac0d0210 2023-10-14T11:14:21.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37b14d6640 1 -- 172.21.15.26:0/1377267600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37ac15ee70 con 0x7f37ac0d0210 2023-10-14T11:14:21.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37a37fe640 1 -- 172.21.15.26:0/1377267600 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3794007420 con 0x7f37ac0d0210 2023-10-14T11:14:21.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.876+0000 7f37b14d6640 1 -- 172.21.15.26:0/1377267600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37ac15f430 con 0x7f37ac0d0210 2023-10-14T11:14:21.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.880+0000 7f37b14d6640 1 -- 172.21.15.26:0/1377267600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37ac154170 con 0x7f37ac0d0210 2023-10-14T11:14:21.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.880+0000 7f37a37fe640 1 -- 172.21.15.26:0/1377267600 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3794007580 con 0x7f37ac0d0210 2023-10-14T11:14:21.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.880+0000 7f37a37fe640 1 --2- 172.21.15.26:0/1377267600 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f378c0664d0 0x7f378c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:21.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.880+0000 7f37a37fe640 1 -- 172.21.15.26:0/1377267600 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f3794083730 con 0x7f37ac0d0210 2023-10-14T11:14:21.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.880+0000 7f37aaffd640 1 --2- 172.21.15.26:0/1377267600 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f378c0664d0 0x7f378c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:21.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.880+0000 7f37aaffd640 1 --2- 172.21.15.26:0/1377267600 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f378c0664d0 0x7f378c068990 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f37ac152cb0 tx=0x7f379c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:21.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:21.884+0000 7f37a37fe640 1 -- 172.21.15.26:0/1377267600 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3794050990 con 0x7f37ac0d0210 2023-10-14T11:14:22.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.040+0000 7f37b14d6640 1 -- 172.21.15.26:0/1377267600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"} v 0) v1 -- 0x7f37ac15f620 con 0x7f37ac0d0210 2023-10-14T11:14:22.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.044+0000 7f37a37fe640 1 -- 172.21.15.26:0/1377267600 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"}]=0 v42) v1 ==== 109+0+11 (secure 0 0 0) 0x7f3794053fb0 con 0x7f37ac0d0210 2023-10-14T11:14:22.048 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:14:22.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.044+0000 7f37b14d6640 1 -- 172.21.15.26:0/1377267600 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f378c0664d0 msgr2=0x7f378c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:22.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.044+0000 7f37b14d6640 1 --2- 172.21.15.26:0/1377267600 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f378c0664d0 0x7f378c068990 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f37ac152cb0 tx=0x7f379c009040 comp rx=0 tx=0).stop 2023-10-14T11:14:22.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.044+0000 7f37b14d6640 1 -- 172.21.15.26:0/1377267600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37ac0d0210 msgr2=0x7f37ac15f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:22.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.044+0000 7f37b14d6640 1 --2- 172.21.15.26:0/1377267600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37ac0d0210 0x7f37ac15f950 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3794001ec0 tx=0x7f379400c960 comp rx=0 tx=0).stop 2023-10-14T11:14:22.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.044+0000 7f37b14d6640 1 -- 172.21.15.26:0/1377267600 shutdown_connections 2023-10-14T11:14:22.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.044+0000 7f37b14d6640 1 --2- 172.21.15.26:0/1377267600 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37ac15cba0 0x7f37ac149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.044+0000 7f37b14d6640 1 --2- 172.21.15.26:0/1377267600 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f378c0664d0 0x7f378c068990 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.044+0000 7f37b14d6640 1 --2- 172.21.15.26:0/1377267600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37ac0d0210 0x7f37ac15f950 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.044+0000 7f37b14d6640 1 --2- 172.21.15.26:0/1377267600 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37ac0b84e0 0x7f37ac152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.044+0000 7f37b14d6640 1 -- 172.21.15.26:0/1377267600 >> 172.21.15.26:0/1377267600 conn(0x7f37ac0719c0 msgr2=0x7f37ac0cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:22.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.044+0000 7f37b14d6640 1 -- 172.21.15.26:0/1377267600 shutdown_connections 2023-10-14T11:14:22.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.044+0000 7f37b14d6640 1 -- 172.21.15.26:0/1377267600 wait complete. 2023-10-14T11:14:22.069 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_data pg_num 2023-10-14T11:14:22.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.212+0000 7fbb25ed6640 1 Processor -- start 2023-10-14T11:14:22.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.212+0000 7fbb25ed6640 1 -- start start 2023-10-14T11:14:22.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.212+0000 7fbb25ed6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbb201590d0 0x7fbb2006df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:22.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.212+0000 7fbb25ed6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb200c9600 con 0x7fbb200c8dd0 2023-10-14T11:14:22.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.212+0000 7fbb25ed6640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb200c98e0 con 0x7fbb20070a00 2023-10-14T11:14:22.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.212+0000 7fbb25ed6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb200c9bc0 con 0x7fbb201590d0 2023-10-14T11:14:22.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.212+0000 7fbb1f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbb201590d0 0x7fbb2006df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:22.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.212+0000 7fbb1f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbb201590d0 0x7fbb2006df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38508/0 (socket says 172.21.15.26:38508) 2023-10-14T11:14:22.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.212+0000 7fbb1effd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbb200c8dd0 0x7fbb200702f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56608/0 (socket says 172.21.15.26:56608) 2023-10-14T11:14:22.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.212+0000 7fbb1f7fe640 1 -- 172.21.15.26:0/2197717059 learned_addr learned my addr 172.21.15.26:0/2197717059 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:22.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.212+0000 7fbb1f7fe640 1 -- 172.21.15.26:0/2197717059 >> v1:172.21.15.110:6789/0 conn(0x7fbb20070a00 legacy=0x7fbb200cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:22.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.212+0000 7fbb1f7fe640 1 -- 172.21.15.26:0/2197717059 >> v1:172.21.15.26:6789/0 conn(0x7fbb200c8dd0 legacy=0x7fbb200702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:22.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.212+0000 7fbb1f7fe640 1 -- 172.21.15.26:0/2197717059 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb200c9ea0 con 0x7fbb201590d0 2023-10-14T11:14:22.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.216+0000 7fbb1f7fe640 1 --2- 172.21.15.26:0/2197717059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb201590d0 0x7fbb2006df40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbb10009870 tx=0x7fbb1001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ac6e998071e359 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:22.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.216+0000 7fbb1e7fc640 1 -- 172.21.15.26:0/2197717059 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb100a93f0 con 0x7fbb201590d0 2023-10-14T11:14:22.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.216+0000 7fbb1e7fc640 1 -- 172.21.15.26:0/2197717059 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb100a9550 con 0x7fbb201590d0 2023-10-14T11:14:22.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.216+0000 7fbb1e7fc640 1 -- 172.21.15.26:0/2197717059 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb100a98e0 con 0x7fbb201590d0 2023-10-14T11:14:22.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.216+0000 7fbb25ed6640 1 -- 172.21.15.26:0/2197717059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb201590d0 msgr2=0x7fbb2006df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:22.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.216+0000 7fbb25ed6640 1 --2- 172.21.15.26:0/2197717059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb201590d0 0x7fbb2006df40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbb10009870 tx=0x7fbb1001c510 comp rx=0 tx=0).stop 2023-10-14T11:14:22.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.216+0000 7fbb25ed6640 1 -- 172.21.15.26:0/2197717059 shutdown_connections 2023-10-14T11:14:22.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.216+0000 7fbb25ed6640 1 --2- 172.21.15.26:0/2197717059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb201590d0 0x7fbb2006df40 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.216+0000 7fbb25ed6640 1 -- 172.21.15.26:0/2197717059 >> 172.21.15.26:0/2197717059 conn(0x7fbb200b0da0 msgr2=0x7fbb200ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:22.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.216+0000 7fbb25ed6640 1 -- 172.21.15.26:0/2197717059 shutdown_connections 2023-10-14T11:14:22.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.216+0000 7fbb25ed6640 1 -- 172.21.15.26:0/2197717059 wait complete. 2023-10-14T11:14:22.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.216+0000 7fbb25ed6640 1 Processor -- start 2023-10-14T11:14:22.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb25ed6640 1 -- start start 2023-10-14T11:14:22.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb25ed6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb20070a00 0x7fbb20143ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:22.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb25ed6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb200c8dd0 0x7fbb2015b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:22.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb25ed6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb201590d0 0x7fbb200cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:22.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb25ed6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb20144010 con 0x7fbb200c8dd0 2023-10-14T11:14:22.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb25ed6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2015c190 con 0x7fbb201590d0 2023-10-14T11:14:22.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb25ed6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2015c470 con 0x7fbb20070a00 2023-10-14T11:14:22.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb1effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb200c8dd0 0x7fbb2015b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:22.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb1effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb200c8dd0 0x7fbb2015b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38524/0 (socket says 172.21.15.26:38524) 2023-10-14T11:14:22.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb1effd640 1 -- 172.21.15.26:0/413175602 learned_addr learned my addr 172.21.15.26:0/413175602 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:22.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb1effd640 1 -- 172.21.15.26:0/413175602 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb20070a00 msgr2=0x7fbb20143ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:22.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb1effd640 1 --2- 172.21.15.26:0/413175602 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb20070a00 0x7fbb20143ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb1effd640 1 -- 172.21.15.26:0/413175602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb201590d0 msgr2=0x7fbb200cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:22.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb1ffff640 1 --2- 172.21.15.26:0/413175602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb201590d0 0x7fbb200cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:22.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb1effd640 1 --2- 172.21.15.26:0/413175602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb201590d0 0x7fbb200cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb1effd640 1 -- 172.21.15.26:0/413175602 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb100094d0 con 0x7fbb200c8dd0 2023-10-14T11:14:22.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb1ffff640 1 --2- 172.21.15.26:0/413175602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb201590d0 0x7fbb200cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:22.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb1effd640 1 --2- 172.21.15.26:0/413175602 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb200c8dd0 0x7fbb2015b890 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400c490 tx=0x7fbb1400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:22.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb07fff640 1 -- 172.21.15.26:0/413175602 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14007480 con 0x7fbb200c8dd0 2023-10-14T11:14:22.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb07fff640 1 -- 172.21.15.26:0/413175602 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb140075e0 con 0x7fbb200c8dd0 2023-10-14T11:14:22.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb07fff640 1 -- 172.21.15.26:0/413175602 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14004a10 con 0x7fbb200c8dd0 2023-10-14T11:14:22.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb25ed6640 1 -- 172.21.15.26:0/413175602 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb200ca820 con 0x7fbb200c8dd0 2023-10-14T11:14:22.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb25ed6640 1 -- 172.21.15.26:0/413175602 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb200b14c0 con 0x7fbb200c8dd0 2023-10-14T11:14:22.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.220+0000 7fbb25ed6640 1 -- 172.21.15.26:0/413175602 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2004e170 con 0x7fbb200c8dd0 2023-10-14T11:14:22.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.224+0000 7fbb07fff640 1 -- 172.21.15.26:0/413175602 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbb14004b70 con 0x7fbb200c8dd0 2023-10-14T11:14:22.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.224+0000 7fbb07fff640 1 --2- 172.21.15.26:0/413175602 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbb0c0664a0 0x7fbb0c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:22.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.224+0000 7fbb07fff640 1 -- 172.21.15.26:0/413175602 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7fbb140833e0 con 0x7fbb200c8dd0 2023-10-14T11:14:22.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.224+0000 7fbb1f7fe640 1 --2- 172.21.15.26:0/413175602 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbb0c0664a0 0x7fbb0c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:22.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.224+0000 7fbb1f7fe640 1 --2- 172.21.15.26:0/413175602 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbb0c0664a0 0x7fbb0c068960 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbb100ae000 tx=0x7fbb10004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:22.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.228+0000 7fbb07fff640 1 -- 172.21.15.26:0/413175602 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbb140504d0 con 0x7fbb200c8dd0 2023-10-14T11:14:22.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.388+0000 7fbb25ed6640 1 -- 172.21.15.26:0/413175602 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"} v 0) v1 -- 0x7fbb20071270 con 0x7fbb200c8dd0 2023-10-14T11:14:22.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.388+0000 7fbb07fff640 1 -- 172.21.15.26:0/413175602 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"}]=0 v42) v1 ==== 105+0+11 (secure 0 0 0) 0x7fbb14018020 con 0x7fbb200c8dd0 2023-10-14T11:14:22.393 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:14:22.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.388+0000 7fbb25ed6640 1 -- 172.21.15.26:0/413175602 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbb0c0664a0 msgr2=0x7fbb0c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:22.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.388+0000 7fbb25ed6640 1 --2- 172.21.15.26:0/413175602 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbb0c0664a0 0x7fbb0c068960 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbb100ae000 tx=0x7fbb10004740 comp rx=0 tx=0).stop 2023-10-14T11:14:22.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.388+0000 7fbb25ed6640 1 -- 172.21.15.26:0/413175602 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb200c8dd0 msgr2=0x7fbb2015b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:22.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.388+0000 7fbb25ed6640 1 --2- 172.21.15.26:0/413175602 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb200c8dd0 0x7fbb2015b890 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400c490 tx=0x7fbb1400c950 comp rx=0 tx=0).stop 2023-10-14T11:14:22.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.388+0000 7fbb25ed6640 1 -- 172.21.15.26:0/413175602 shutdown_connections 2023-10-14T11:14:22.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.388+0000 7fbb25ed6640 1 --2- 172.21.15.26:0/413175602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb201590d0 0x7fbb200cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.388+0000 7fbb25ed6640 1 --2- 172.21.15.26:0/413175602 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbb0c0664a0 0x7fbb0c068960 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.388+0000 7fbb25ed6640 1 --2- 172.21.15.26:0/413175602 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb200c8dd0 0x7fbb2015b890 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.388+0000 7fbb25ed6640 1 --2- 172.21.15.26:0/413175602 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb20070a00 0x7fbb20143ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.388+0000 7fbb25ed6640 1 -- 172.21.15.26:0/413175602 >> 172.21.15.26:0/413175602 conn(0x7fbb200b0da0 msgr2=0x7fbb200701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:22.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.388+0000 7fbb25ed6640 1 -- 172.21.15.26:0/413175602 shutdown_connections 2023-10-14T11:14:22.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.388+0000 7fbb25ed6640 1 -- 172.21.15.26:0/413175602 wait complete. 2023-10-14T11:14:22.414 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-10-14T11:14:22.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.556+0000 7f7a283c4640 1 Processor -- start 2023-10-14T11:14:22.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.556+0000 7f7a283c4640 1 -- start start 2023-10-14T11:14:22.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.556+0000 7f7a283c4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7a200b84e0 0x7f7a200d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:22.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.556+0000 7f7a283c4640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a200d1670 con 0x7f7a200d0210 2023-10-14T11:14:22.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.556+0000 7f7a283c4640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a200d1950 con 0x7f7a2015cba0 2023-10-14T11:14:22.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.556+0000 7f7a283c4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a200d1460 con 0x7f7a200b84e0 2023-10-14T11:14:22.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.556+0000 7f7a26961640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7a200b84e0 0x7f7a200d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:22.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.556+0000 7f7a26961640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7a200b84e0 0x7f7a200d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38134/0 (socket says 172.21.15.26:38134) 2023-10-14T11:14:22.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.556+0000 7f7a26961640 1 -- 172.21.15.26:0/3735732311 learned_addr learned my addr 172.21.15.26:0/3735732311 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:22.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.556+0000 7f7a2595f640 1 --1- 172.21.15.26:0/3735732311 >> v1:172.21.15.26:6789/0 conn(0x7f7a200d0210 0x7f7a200b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57068/0 (socket says 172.21.15.26:57068) 2023-10-14T11:14:22.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.556+0000 7f7a26961640 1 -- 172.21.15.26:0/3735732311 >> v1:172.21.15.110:6789/0 conn(0x7f7a2015cba0 legacy=0x7f7a200cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:22.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.556+0000 7f7a26961640 1 -- 172.21.15.26:0/3735732311 >> v1:172.21.15.26:6789/0 conn(0x7f7a200d0210 legacy=0x7f7a200b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:22.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.556+0000 7f7a26961640 1 -- 172.21.15.26:0/3735732311 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a200d1c30 con 0x7f7a200b84e0 2023-10-14T11:14:22.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.556+0000 7f7a2515e640 1 -- 172.21.15.26:0/3735732311 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979261649 0 0) 0x7f7a200d1670 con 0x7f7a200d0210 2023-10-14T11:14:22.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.560+0000 7f7a26961640 1 --2- 172.21.15.26:0/3735732311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a200b84e0 0x7f7a200d0f20 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7a18009e50 tx=0x7f7a1801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def471c988e6b794 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:22.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.560+0000 7f7a2515e640 1 -- 172.21.15.26:0/3735732311 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a180a5840 con 0x7f7a200b84e0 2023-10-14T11:14:22.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.560+0000 7f7a2515e640 1 -- 172.21.15.26:0/3735732311 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a180a59a0 con 0x7f7a200b84e0 2023-10-14T11:14:22.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.560+0000 7f7a2515e640 1 -- 172.21.15.26:0/3735732311 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a180a5d30 con 0x7f7a200b84e0 2023-10-14T11:14:22.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.560+0000 7f7a283c4640 1 -- 172.21.15.26:0/3735732311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a200b84e0 msgr2=0x7f7a200d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:22.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.560+0000 7f7a283c4640 1 --2- 172.21.15.26:0/3735732311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a200b84e0 0x7f7a200d0f20 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7a18009e50 tx=0x7f7a1801c980 comp rx=0 tx=0).stop 2023-10-14T11:14:22.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.560+0000 7f7a283c4640 1 -- 172.21.15.26:0/3735732311 shutdown_connections 2023-10-14T11:14:22.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.560+0000 7f7a283c4640 1 --2- 172.21.15.26:0/3735732311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a200b84e0 0x7f7a200d0f20 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.560+0000 7f7a283c4640 1 -- 172.21.15.26:0/3735732311 >> 172.21.15.26:0/3735732311 conn(0x7f7a200719c0 msgr2=0x7f7a20071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:22.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.560+0000 7f7a283c4640 1 -- 172.21.15.26:0/3735732311 shutdown_connections 2023-10-14T11:14:22.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.560+0000 7f7a283c4640 1 -- 172.21.15.26:0/3735732311 wait complete. 2023-10-14T11:14:22.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a283c4640 1 Processor -- start 2023-10-14T11:14:22.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a283c4640 1 -- start start 2023-10-14T11:14:22.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a283c4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a200b84e0 0x7f7a2015feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:22.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a283c4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a200d0210 0x7f7a2014c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:22.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a283c4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a2015cba0 0x7f7a2015d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:22.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a283c4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2014f350 con 0x7f7a2015cba0 2023-10-14T11:14:22.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a283c4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2015e340 con 0x7f7a200d0210 2023-10-14T11:14:22.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a283c4640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2014e0a0 con 0x7f7a200b84e0 2023-10-14T11:14:22.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a26961640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a2015cba0 0x7f7a2015d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:22.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a26961640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a2015cba0 0x7f7a2015d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38142/0 (socket says 172.21.15.26:38142) 2023-10-14T11:14:22.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a26961640 1 -- 172.21.15.26:0/3050043556 learned_addr learned my addr 172.21.15.26:0/3050043556 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:22.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a2595f640 1 --2- 172.21.15.26:0/3050043556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a200d0210 0x7f7a2014c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:22.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a26160640 1 --2- 172.21.15.26:0/3050043556 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a200b84e0 0x7f7a2015feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:22.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a26961640 1 -- 172.21.15.26:0/3050043556 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a200b84e0 msgr2=0x7f7a2015feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:22.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a26961640 1 --2- 172.21.15.26:0/3050043556 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a200b84e0 0x7f7a2015feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a26961640 1 -- 172.21.15.26:0/3050043556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a200d0210 msgr2=0x7f7a2014c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:22.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a26961640 1 --2- 172.21.15.26:0/3050043556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a200d0210 0x7f7a2014c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a26961640 1 -- 172.21.15.26:0/3050043556 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a18009b30 con 0x7f7a2015cba0 2023-10-14T11:14:22.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a26961640 1 --2- 172.21.15.26:0/3050043556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a2015cba0 0x7f7a2015d770 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7a180af040 tx=0x7f7a18019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:22.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a16ffd640 1 -- 172.21.15.26:0/3050043556 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a180b8670 con 0x7f7a2015cba0 2023-10-14T11:14:22.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a16ffd640 1 -- 172.21.15.26:0/3050043556 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a180b87d0 con 0x7f7a2015cba0 2023-10-14T11:14:22.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a16ffd640 1 -- 172.21.15.26:0/3050043556 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a180b8b80 con 0x7f7a2015cba0 2023-10-14T11:14:22.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a283c4640 1 -- 172.21.15.26:0/3050043556 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a2015a010 con 0x7f7a2015cba0 2023-10-14T11:14:22.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.564+0000 7f7a283c4640 1 -- 172.21.15.26:0/3050043556 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2015e890 con 0x7f7a2015cba0 2023-10-14T11:14:22.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.568+0000 7f7a283c4640 1 -- 172.21.15.26:0/3050043556 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a2015ea80 con 0x7f7a2015cba0 2023-10-14T11:14:22.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.568+0000 7f7a16ffd640 1 -- 172.21.15.26:0/3050043556 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7a180b8ce0 con 0x7f7a2015cba0 2023-10-14T11:14:22.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.568+0000 7f7a16ffd640 1 --2- 172.21.15.26:0/3050043556 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7a040664a0 0x7f7a04068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:22.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.568+0000 7f7a16ffd640 1 -- 172.21.15.26:0/3050043556 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f7a1811f8a0 con 0x7f7a2015cba0 2023-10-14T11:14:22.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.568+0000 7f7a26160640 1 --2- 172.21.15.26:0/3050043556 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7a040664a0 0x7f7a04068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:22.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.568+0000 7f7a26160640 1 --2- 172.21.15.26:0/3050043556 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7a040664a0 0x7f7a04068960 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7a20071f10 tx=0x7f7a1c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:22.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.572+0000 7f7a16ffd640 1 -- 172.21.15.26:0/3050043556 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7a180ec990 con 0x7f7a2015cba0 2023-10-14T11:14:22.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.728+0000 7f7a283c4640 1 -- 172.21.15.26:0/3050043556 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f7a2004e170 con 0x7f7a2015cba0 2023-10-14T11:14:22.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.728+0000 7f7a16ffd640 1 -- 172.21.15.26:0/3050043556 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v42) v1 ==== 97+0+11 (secure 0 0 0) 0x7f7a1811de60 con 0x7f7a2015cba0 2023-10-14T11:14:22.734 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:14:22.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.732+0000 7f7a283c4640 1 -- 172.21.15.26:0/3050043556 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7a040664a0 msgr2=0x7f7a04068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:22.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.732+0000 7f7a283c4640 1 --2- 172.21.15.26:0/3050043556 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7a040664a0 0x7f7a04068960 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7a20071f10 tx=0x7f7a1c009040 comp rx=0 tx=0).stop 2023-10-14T11:14:22.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.732+0000 7f7a283c4640 1 -- 172.21.15.26:0/3050043556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a2015cba0 msgr2=0x7f7a2015d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:22.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.732+0000 7f7a283c4640 1 --2- 172.21.15.26:0/3050043556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a2015cba0 0x7f7a2015d770 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7a180af040 tx=0x7f7a18019720 comp rx=0 tx=0).stop 2023-10-14T11:14:22.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.732+0000 7f7a283c4640 1 -- 172.21.15.26:0/3050043556 shutdown_connections 2023-10-14T11:14:22.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.732+0000 7f7a283c4640 1 --2- 172.21.15.26:0/3050043556 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7a040664a0 0x7f7a04068960 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.732+0000 7f7a283c4640 1 --2- 172.21.15.26:0/3050043556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a2015cba0 0x7f7a2015d770 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.732+0000 7f7a283c4640 1 --2- 172.21.15.26:0/3050043556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a200d0210 0x7f7a2014c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.732+0000 7f7a283c4640 1 --2- 172.21.15.26:0/3050043556 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a200b84e0 0x7f7a2015feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.732+0000 7f7a283c4640 1 -- 172.21.15.26:0/3050043556 >> 172.21.15.26:0/3050043556 conn(0x7f7a200719c0 msgr2=0x7f7a200b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:22.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.732+0000 7f7a283c4640 1 -- 172.21.15.26:0/3050043556 shutdown_connections 2023-10-14T11:14:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.732+0000 7f7a283c4640 1 -- 172.21.15.26:0/3050043556 wait complete. 2023-10-14T11:14:22.755 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:14:22.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.896+0000 7ff0e133e640 1 Processor -- start 2023-10-14T11:14:22.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.896+0000 7ff0e133e640 1 -- start start 2023-10-14T11:14:22.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.896+0000 7ff0e133e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0dc15cb90 0x7ff0dc0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:22.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.896+0000 7ff0e133e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff0dc0d3010 0x7ff0dc0d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:22.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.896+0000 7ff0e133e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0dc0ce770 con 0x7ff0dc0d1400 2023-10-14T11:14:22.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.896+0000 7ff0e133e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0dc0d1890 con 0x7ff0dc0d3010 2023-10-14T11:14:22.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.896+0000 7ff0e133e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0d0600 con 0x7ff0dc15cb90 2023-10-14T11:14:22.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.896+0000 7ff0db7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff0dc0d1400 0x7ff0dc0cd3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57070/0 (socket says 172.21.15.26:57070) 2023-10-14T11:14:22.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.896+0000 7ff0db7fe640 1 -- 172.21.15.26:0/1763191264 learned_addr learned my addr 172.21.15.26:0/1763191264 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:22.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.896+0000 7ff0daffd640 1 --2- 172.21.15.26:0/1763191264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0dc15cb90 0x7ff0dc0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:22.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.896+0000 7ff0d3fff640 1 --2- 172.21.15.26:0/1763191264 >> v2:172.21.15.110:3300/0 conn(0x7ff0dc0d3010 0x7ff0dc0d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:22.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.900+0000 7ff0da7fc640 1 -- 172.21.15.26:0/1763191264 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293545219 0 0) 0x7ff0dc0ce770 con 0x7ff0dc0d1400 2023-10-14T11:14:22.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.900+0000 7ff0da7fc640 1 -- 172.21.15.26:0/1763191264 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0c8003530 con 0x7ff0dc0d1400 2023-10-14T11:14:22.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.900+0000 7ff0daffd640 1 -- 172.21.15.26:0/1763191264 >> v2:172.21.15.110:3300/0 conn(0x7ff0dc0d3010 msgr2=0x7ff0dc0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:22.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.900+0000 7ff0daffd640 1 --2- 172.21.15.26:0/1763191264 >> v2:172.21.15.110:3300/0 conn(0x7ff0dc0d3010 0x7ff0dc0d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.900+0000 7ff0daffd640 1 -- 172.21.15.26:0/1763191264 >> v1:172.21.15.26:6789/0 conn(0x7ff0dc0d1400 legacy=0x7ff0dc0cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:22.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.900+0000 7ff0daffd640 1 -- 172.21.15.26:0/1763191264 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc0c6450 con 0x7ff0dc15cb90 2023-10-14T11:14:22.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.900+0000 7ff0d3fff640 1 --2- 172.21.15.26:0/1763191264 >> v2:172.21.15.110:3300/0 conn(0x7ff0dc0d3010 0x7ff0dc0d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:14:22.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.900+0000 7ff0daffd640 1 --2- 172.21.15.26:0/1763191264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0dc15cb90 0x7ff0dc0cfb10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0097a0 tx=0x7ff0cc01c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79e8ae8f4e97a946 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.900+0000 7ff0da7fc640 1 -- 172.21.15.26:0/1763191264 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc0ac600 con 0x7ff0dc15cb90 2023-10-14T11:14:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.900+0000 7ff0da7fc640 1 -- 172.21.15.26:0/1763191264 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0cc0a8050 con 0x7ff0dc15cb90 2023-10-14T11:14:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.900+0000 7ff0da7fc640 1 -- 172.21.15.26:0/1763191264 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc0ac980 con 0x7ff0dc15cb90 2023-10-14T11:14:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0e133e640 1 -- 172.21.15.26:0/1763191264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0dc15cb90 msgr2=0x7ff0dc0cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:22.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0e133e640 1 --2- 172.21.15.26:0/1763191264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0dc15cb90 0x7ff0dc0cfb10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0097a0 tx=0x7ff0cc01c3a0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0e133e640 1 -- 172.21.15.26:0/1763191264 shutdown_connections 2023-10-14T11:14:22.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0e133e640 1 --2- 172.21.15.26:0/1763191264 >> v2:172.21.15.110:3300/0 conn(0x7ff0dc0d3010 0x7ff0dc0d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0e133e640 1 --2- 172.21.15.26:0/1763191264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0dc15cb90 0x7ff0dc0cfb10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0e133e640 1 -- 172.21.15.26:0/1763191264 >> 172.21.15.26:0/1763191264 conn(0x7ff0dc09bc50 msgr2=0x7ff0dc0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:22.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0e133e640 1 -- 172.21.15.26:0/1763191264 shutdown_connections 2023-10-14T11:14:22.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0e133e640 1 -- 172.21.15.26:0/1763191264 wait complete. 2023-10-14T11:14:22.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0e133e640 1 Processor -- start 2023-10-14T11:14:22.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0e133e640 1 -- start start 2023-10-14T11:14:22.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0e133e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0dc0d1400 0x7ff0dc0b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0e133e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0dc0d3010 0x7ff0dc0c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0e133e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0dc15cb90 0x7ff0dc0c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0e133e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0b6f00 con 0x7ff0dc0d1400 2023-10-14T11:14:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0e133e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0b62f0 con 0x7ff0dc15cb90 2023-10-14T11:14:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0e133e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0b65d0 con 0x7ff0dc0d3010 2023-10-14T11:14:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0daffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0dc0d1400 0x7ff0dc0b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:22.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0daffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0dc0d1400 0x7ff0dc0b4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38148/0 (socket says 172.21.15.26:38148) 2023-10-14T11:14:22.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0daffd640 1 -- 172.21.15.26:0/2847004957 learned_addr learned my addr 172.21.15.26:0/2847004957 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:22.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0d3fff640 1 --2- 172.21.15.26:0/2847004957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0dc0d3010 0x7ff0dc0c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:22.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0daffd640 1 -- 172.21.15.26:0/2847004957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0dc0d3010 msgr2=0x7ff0dc0c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:22.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0daffd640 1 --2- 172.21.15.26:0/2847004957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0dc0d3010 0x7ff0dc0c99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0daffd640 1 -- 172.21.15.26:0/2847004957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0dc15cb90 msgr2=0x7ff0dc0c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:22.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0daffd640 1 --2- 172.21.15.26:0/2847004957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0dc15cb90 0x7ff0dc0c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:22.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0daffd640 1 -- 172.21.15.26:0/2847004957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c4009420 con 0x7ff0dc0d1400 2023-10-14T11:14:22.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0daffd640 1 --2- 172.21.15.26:0/2847004957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0dc0d1400 0x7ff0dc0b4c20 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0af040 tx=0x7ff0cc01abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:22.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.904+0000 7ff0d37fe640 1 -- 172.21.15.26:0/2847004957 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc0b7420 con 0x7ff0dc0d1400 2023-10-14T11:14:22.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.908+0000 7ff0d37fe640 1 -- 172.21.15.26:0/2847004957 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0cc0b7580 con 0x7ff0dc0d1400 2023-10-14T11:14:22.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.908+0000 7ff0d37fe640 1 -- 172.21.15.26:0/2847004957 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc0b7930 con 0x7ff0dc0d1400 2023-10-14T11:14:22.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.908+0000 7ff0e133e640 1 -- 172.21.15.26:0/2847004957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0cc0093b0 con 0x7ff0dc0d1400 2023-10-14T11:14:22.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.908+0000 7ff0e133e640 1 -- 172.21.15.26:0/2847004957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0dc0b6b90 con 0x7ff0dc0d1400 2023-10-14T11:14:22.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.908+0000 7ff0e133e640 1 -- 172.21.15.26:0/2847004957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0dc074010 con 0x7ff0dc0d1400 2023-10-14T11:14:22.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.908+0000 7ff0d37fe640 1 -- 172.21.15.26:0/2847004957 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff0cc0b3040 con 0x7ff0dc0d1400 2023-10-14T11:14:22.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.908+0000 7ff0d37fe640 1 --2- 172.21.15.26:0/2847004957 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff0bc0664d0 0x7ff0bc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:22.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.908+0000 7ff0d37fe640 1 -- 172.21.15.26:0/2847004957 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7ff0cc11e480 con 0x7ff0dc0d1400 2023-10-14T11:14:22.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.908+0000 7ff0d3fff640 1 --2- 172.21.15.26:0/2847004957 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff0bc0664d0 0x7ff0bc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:22.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.908+0000 7ff0d3fff640 1 --2- 172.21.15.26:0/2847004957 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff0bc0664d0 0x7ff0bc068990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc15baf0 tx=0x7ff0c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:22.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:22.912+0000 7ff0d37fe640 1 -- 172.21.15.26:0/2847004957 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff0cc0eb720 con 0x7ff0dc0d1400 2023-10-14T11:14:23.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.080+0000 7ff0e133e640 1 -- 172.21.15.26:0/2847004957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff0dc155a40 con 0x7ff0dc0d1400 2023-10-14T11:14:23.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.080+0000 7ff0d37fe640 1 -- 172.21.15.26:0/2847004957 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff0cc0eed40 con 0x7ff0dc0d1400 2023-10-14T11:14:23.087 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-10-14T11:14:23.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.084+0000 7ff0e133e640 1 -- 172.21.15.26:0/2847004957 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff0bc0664d0 msgr2=0x7ff0bc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:23.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.084+0000 7ff0e133e640 1 --2- 172.21.15.26:0/2847004957 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff0bc0664d0 0x7ff0bc068990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc15baf0 tx=0x7ff0c4008040 comp rx=0 tx=0).stop 2023-10-14T11:14:23.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.084+0000 7ff0e133e640 1 -- 172.21.15.26:0/2847004957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0dc0d1400 msgr2=0x7ff0dc0b4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:23.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.084+0000 7ff0e133e640 1 --2- 172.21.15.26:0/2847004957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0dc0d1400 0x7ff0dc0b4c20 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0af040 tx=0x7ff0cc01abe0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.084+0000 7ff0e133e640 1 -- 172.21.15.26:0/2847004957 shutdown_connections 2023-10-14T11:14:23.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.084+0000 7ff0e133e640 1 --2- 172.21.15.26:0/2847004957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0dc15cb90 0x7ff0dc0c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.084+0000 7ff0e133e640 1 --2- 172.21.15.26:0/2847004957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0dc0d3010 0x7ff0dc0c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.084+0000 7ff0e133e640 1 --2- 172.21.15.26:0/2847004957 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7ff0bc0664d0 0x7ff0bc068990 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.084+0000 7ff0e133e640 1 --2- 172.21.15.26:0/2847004957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0dc0d1400 0x7ff0dc0b4c20 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.084+0000 7ff0e133e640 1 -- 172.21.15.26:0/2847004957 >> 172.21.15.26:0/2847004957 conn(0x7ff0dc09bc50 msgr2=0x7ff0dc155f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:23.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.084+0000 7ff0e133e640 1 -- 172.21.15.26:0/2847004957 shutdown_connections 2023-10-14T11:14:23.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.084+0000 7ff0e133e640 1 -- 172.21.15.26:0/2847004957 wait complete. 2023-10-14T11:14:23.108 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:14:23.109 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:14:23.119 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:14:23.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.308+0000 7f3757f94640 1 Processor -- start 2023-10-14T11:14:23.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.308+0000 7f3757f94640 1 -- start start 2023-10-14T11:14:23.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.308+0000 7f3757f94640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f375015cb90 0x7f37500cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:23.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.308+0000 7f3757f94640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37500d3010 0x7f37500d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:23.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.308+0000 7f3757f94640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37500ce770 con 0x7f37500d1400 2023-10-14T11:14:23.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.308+0000 7f3757f94640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37500d1890 con 0x7f375015cb90 2023-10-14T11:14:23.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.308+0000 7f3757f94640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37500d0600 con 0x7f37500d3010 2023-10-14T11:14:23.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.308+0000 7f3755d30640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f375015cb90 0x7f37500cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:23.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.308+0000 7f3755d30640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f375015cb90 0x7f37500cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38160/0 (socket says 172.21.15.26:38160) 2023-10-14T11:14:23.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.308+0000 7f3755d30640 1 -- 172.21.15.26:0/3039340915 learned_addr learned my addr 172.21.15.26:0/3039340915 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:23.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.308+0000 7f375552f640 1 --2- 172.21.15.26:0/3039340915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37500d3010 0x7f37500d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:23.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.308+0000 7f3755d30640 1 -- 172.21.15.26:0/3039340915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37500d3010 msgr2=0x7f37500d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:23.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.308+0000 7f3755d30640 1 --2- 172.21.15.26:0/3039340915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37500d3010 0x7f37500d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.308+0000 7f3755d30640 1 -- 172.21.15.26:0/3039340915 >> v1:172.21.15.110:6789/0 conn(0x7f37500d1400 legacy=0x7f37500cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:23.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.308+0000 7f3755d30640 1 -- 172.21.15.26:0/3039340915 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37500c6450 con 0x7f375015cb90 2023-10-14T11:14:23.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.308+0000 7f375552f640 1 --2- 172.21.15.26:0/3039340915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37500d3010 0x7f37500d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:23.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.312+0000 7f3755d30640 1 --2- 172.21.15.26:0/3039340915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f375015cb90 0x7f37500cfb10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f374c009860 tx=0x7f374c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687fd07d1ca3ee91 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:23.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.312+0000 7f3754d2e640 1 -- 172.21.15.26:0/3039340915 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c0ac640 con 0x7f375015cb90 2023-10-14T11:14:23.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.312+0000 7f3754d2e640 1 -- 172.21.15.26:0/3039340915 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c0ac7a0 con 0x7f375015cb90 2023-10-14T11:14:23.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.312+0000 7f3754d2e640 1 -- 172.21.15.26:0/3039340915 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c0acb30 con 0x7f375015cb90 2023-10-14T11:14:23.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.312+0000 7f3757f94640 1 -- 172.21.15.26:0/3039340915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f375015cb90 msgr2=0x7f37500cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:23.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.312+0000 7f3757f94640 1 --2- 172.21.15.26:0/3039340915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f375015cb90 0x7f37500cfb10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f374c009860 tx=0x7f374c01c420 comp rx=0 tx=0).stop 2023-10-14T11:14:23.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.312+0000 7f3757f94640 1 -- 172.21.15.26:0/3039340915 shutdown_connections 2023-10-14T11:14:23.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.312+0000 7f3757f94640 1 --2- 172.21.15.26:0/3039340915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37500d3010 0x7f37500d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.312+0000 7f3757f94640 1 --2- 172.21.15.26:0/3039340915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f375015cb90 0x7f37500cfb10 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.312+0000 7f3757f94640 1 -- 172.21.15.26:0/3039340915 >> 172.21.15.26:0/3039340915 conn(0x7f375009bc50 msgr2=0x7f37500d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:23.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.312+0000 7f3757f94640 1 -- 172.21.15.26:0/3039340915 shutdown_connections 2023-10-14T11:14:23.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.312+0000 7f3757f94640 1 -- 172.21.15.26:0/3039340915 wait complete. 2023-10-14T11:14:23.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f3757f94640 1 Processor -- start 2023-10-14T11:14:23.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f3757f94640 1 -- start start 2023-10-14T11:14:23.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f3757f94640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37500d1400 0x7f37500cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:23.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f3757f94640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37500d3010 0x7f37500cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:23.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f3757f94640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f375015cb90 0x7f3750155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:23.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f3757f94640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37500cb340 con 0x7f37500d3010 2023-10-14T11:14:23.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f3757f94640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37500ccd10 con 0x7f37500d1400 2023-10-14T11:14:23.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f3757f94640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375015ab60 con 0x7f375015cb90 2023-10-14T11:14:23.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f375552f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37500d3010 0x7f37500cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:23.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f375552f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37500d3010 0x7f37500cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38164/0 (socket says 172.21.15.26:38164) 2023-10-14T11:14:23.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f375552f640 1 -- 172.21.15.26:0/1729776958 learned_addr learned my addr 172.21.15.26:0/1729776958 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:23.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f3755d30640 1 --2- 172.21.15.26:0/1729776958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37500d1400 0x7f37500cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:23.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f3756531640 1 --2- 172.21.15.26:0/1729776958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f375015cb90 0x7f3750155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:23.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f375552f640 1 -- 172.21.15.26:0/1729776958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f375015cb90 msgr2=0x7f3750155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:23.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f375552f640 1 --2- 172.21.15.26:0/1729776958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f375015cb90 0x7f3750155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f375552f640 1 -- 172.21.15.26:0/1729776958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37500d1400 msgr2=0x7f37500cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:23.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f375552f640 1 --2- 172.21.15.26:0/1729776958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37500d1400 0x7f37500cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f375552f640 1 -- 172.21.15.26:0/1729776958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c009470 con 0x7f37500d3010 2023-10-14T11:14:23.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f375552f640 1 --2- 172.21.15.26:0/1729776958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37500d3010 0x7f37500cc7d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f374000c7f0 tx=0x7f374000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:23.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f37467fc640 1 -- 172.21.15.26:0/1729776958 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740007820 con 0x7f37500d3010 2023-10-14T11:14:23.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f37467fc640 1 -- 172.21.15.26:0/1729776958 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3740007980 con 0x7f37500d3010 2023-10-14T11:14:23.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f37467fc640 1 -- 172.21.15.26:0/1729776958 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740007d30 con 0x7f37500d3010 2023-10-14T11:14:23.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f3757f94640 1 -- 172.21.15.26:0/1729776958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375015ae40 con 0x7f37500d3010 2023-10-14T11:14:23.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f3757f94640 1 -- 172.21.15.26:0/1729776958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375015b400 con 0x7f37500d3010 2023-10-14T11:14:23.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.316+0000 7f3757f94640 1 -- 172.21.15.26:0/1729776958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375015b620 con 0x7f37500d3010 2023-10-14T11:14:23.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.320+0000 7f37467fc640 1 -- 172.21.15.26:0/1729776958 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f37400113f0 con 0x7f37500d3010 2023-10-14T11:14:23.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.320+0000 7f37467fc640 1 --2- 172.21.15.26:0/1729776958 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37340664a0 0x7f3734068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:23.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.320+0000 7f37467fc640 1 -- 172.21.15.26:0/1729776958 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f37400843d0 con 0x7f37500d3010 2023-10-14T11:14:23.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.320+0000 7f3755d30640 1 --2- 172.21.15.26:0/1729776958 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37340664a0 0x7f3734068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:23.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.320+0000 7f3755d30640 1 --2- 172.21.15.26:0/1729776958 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37340664a0 0x7f3734068960 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f374c0ae000 tx=0x7f374c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:23.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.324+0000 7f37467fc640 1 -- 172.21.15.26:0/1729776958 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3740051600 con 0x7f37500d3010 2023-10-14T11:14:23.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.484+0000 7f3757f94640 1 -- 172.21.15.26:0/1729776958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3750074010 con 0x7f37500d3010 2023-10-14T11:14:23.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.484+0000 7f37467fc640 1 -- 172.21.15.26:0/1729776958 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18578 (secure 0 0 0) 0x7f3740054c20 con 0x7f37500d3010 2023-10-14T11:14:23.491 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:23.491 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":42,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:14:01.292164+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:13:48.453821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:13:49.623527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-10-14T11:13:59.245615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:14:23.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.488+0000 7f3757f94640 1 -- 172.21.15.26:0/1729776958 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37340664a0 msgr2=0x7f3734068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:23.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.488+0000 7f3757f94640 1 --2- 172.21.15.26:0/1729776958 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37340664a0 0x7f3734068960 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f374c0ae000 tx=0x7f374c0a7000 comp rx=0 tx=0).stop 2023-10-14T11:14:23.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.488+0000 7f3757f94640 1 -- 172.21.15.26:0/1729776958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37500d3010 msgr2=0x7f37500cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:23.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.488+0000 7f3757f94640 1 --2- 172.21.15.26:0/1729776958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37500d3010 0x7f37500cc7d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f374000c7f0 tx=0x7f374000ccb0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.488+0000 7f3757f94640 1 -- 172.21.15.26:0/1729776958 shutdown_connections 2023-10-14T11:14:23.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.488+0000 7f3757f94640 1 --2- 172.21.15.26:0/1729776958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f375015cb90 0x7f3750155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.488+0000 7f3757f94640 1 --2- 172.21.15.26:0/1729776958 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37340664a0 0x7f3734068960 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.488+0000 7f3757f94640 1 --2- 172.21.15.26:0/1729776958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37500d3010 0x7f37500cc7d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.488+0000 7f3757f94640 1 --2- 172.21.15.26:0/1729776958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37500d1400 0x7f37500cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.488+0000 7f3757f94640 1 -- 172.21.15.26:0/1729776958 >> 172.21.15.26:0/1729776958 conn(0x7f375009bc50 msgr2=0x7f375006b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:23.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.488+0000 7f3757f94640 1 -- 172.21.15.26:0/1729776958 shutdown_connections 2023-10-14T11:14:23.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.488+0000 7f3757f94640 1 -- 172.21.15.26:0/1729776958 wait complete. 2023-10-14T11:14:23.512 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'testcephfs1_metadata', 'create_time': '2023-10-14T11:13:48.453821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'testcephfs1_data', 'create_time': '2023-10-14T11:13:49.623527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-10-14T11:13:59.245615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:14:23.513 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:14:23.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.652+0000 7f985ffd9640 1 Processor -- start 2023-10-14T11:14:23.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.652+0000 7f985ffd9640 1 -- start start 2023-10-14T11:14:23.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.656+0000 7f985ffd9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f98580cb040 0x7f98580ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:23.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.656+0000 7f985ffd9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98580cebd0 0x7f98580cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:23.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.656+0000 7f985ffd9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98580cf020 con 0x7f985815cc60 2023-10-14T11:14:23.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.656+0000 7f985ffd9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98580cc330 con 0x7f98580cb040 2023-10-14T11:14:23.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.656+0000 7f985ffd9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98580cb4d0 con 0x7f98580cebd0 2023-10-14T11:14:23.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.656+0000 7f985dd75640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f985815cc60 0x7f9858161260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57072/0 (socket says 172.21.15.26:57072) 2023-10-14T11:14:23.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.656+0000 7f985dd75640 1 -- 172.21.15.26:0/333909675 learned_addr learned my addr 172.21.15.26:0/333909675 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:23.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.656+0000 7f985e576640 1 --2- 172.21.15.26:0/333909675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98580cebd0 0x7f98580cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:23.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.656+0000 7f985d574640 1 --2- 172.21.15.26:0/333909675 >> v2:172.21.15.110:3300/0 conn(0x7f98580cb040 0x7f98580ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:23.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.656+0000 7f985cd73640 1 -- 172.21.15.26:0/333909675 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001451138 0 0) 0x7f9854001120 con 0x7f985815cc60 2023-10-14T11:14:23.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.656+0000 7f985cd73640 1 -- 172.21.15.26:0/333909675 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9844003530 con 0x7f985815cc60 2023-10-14T11:14:23.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.656+0000 7f985e576640 1 -- 172.21.15.26:0/333909675 >> v2:172.21.15.110:3300/0 conn(0x7f98580cb040 msgr2=0x7f98580ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:23.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.656+0000 7f985e576640 1 --2- 172.21.15.26:0/333909675 >> v2:172.21.15.110:3300/0 conn(0x7f98580cb040 0x7f98580ce690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.656+0000 7f985e576640 1 -- 172.21.15.26:0/333909675 >> v1:172.21.15.26:6789/0 conn(0x7f985815cc60 legacy=0x7f9858161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:23.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.656+0000 7f985e576640 1 -- 172.21.15.26:0/333909675 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98580cb720 con 0x7f98580cebd0 2023-10-14T11:14:23.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.660+0000 7f985e576640 1 --2- 172.21.15.26:0/333909675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98580cebd0 0x7f98580cc990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9850009d90 tx=0x7f985001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e87a3a59bf34ee5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:23.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.660+0000 7f985cd73640 1 -- 172.21.15.26:0/333909675 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98500a59e0 con 0x7f98580cebd0 2023-10-14T11:14:23.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.660+0000 7f985cd73640 1 -- 172.21.15.26:0/333909675 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98500a5b40 con 0x7f98580cebd0 2023-10-14T11:14:23.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.660+0000 7f985cd73640 1 -- 172.21.15.26:0/333909675 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98500ad440 con 0x7f98580cebd0 2023-10-14T11:14:23.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.660+0000 7f985ffd9640 1 -- 172.21.15.26:0/333909675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98580cebd0 msgr2=0x7f98580cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:23.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.660+0000 7f985ffd9640 1 --2- 172.21.15.26:0/333909675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98580cebd0 0x7f98580cc990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9850009d90 tx=0x7f985001c920 comp rx=0 tx=0).stop 2023-10-14T11:14:23.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.660+0000 7f985ffd9640 1 -- 172.21.15.26:0/333909675 shutdown_connections 2023-10-14T11:14:23.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.660+0000 7f985ffd9640 1 --2- 172.21.15.26:0/333909675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98580cebd0 0x7f98580cc990 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.660+0000 7f985ffd9640 1 --2- 172.21.15.26:0/333909675 >> v2:172.21.15.110:3300/0 conn(0x7f98580cb040 0x7f98580ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.660+0000 7f985ffd9640 1 -- 172.21.15.26:0/333909675 >> 172.21.15.26:0/333909675 conn(0x7f985806e570 msgr2=0x7f985806e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:23.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.660+0000 7f985ffd9640 1 -- 172.21.15.26:0/333909675 shutdown_connections 2023-10-14T11:14:23.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.660+0000 7f985ffd9640 1 -- 172.21.15.26:0/333909675 wait complete. 2023-10-14T11:14:23.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.660+0000 7f985ffd9640 1 Processor -- start 2023-10-14T11:14:23.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.660+0000 7f985ffd9640 1 -- start start 2023-10-14T11:14:23.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f985ffd9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98580cb040 0x7f98581561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:23.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f985ffd9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98580cebd0 0x7f985815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:23.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f985ffd9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f985815cc60 0x7f985815a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:23.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f985ffd9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98580c6a30 con 0x7f98580cebd0 2023-10-14T11:14:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f985ffd9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98580c6d10 con 0x7f985815cc60 2023-10-14T11:14:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f985ffd9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98580c6ff0 con 0x7f98580cb040 2023-10-14T11:14:23.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f985d574640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98580cebd0 0x7f985815a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:23.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f985d574640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98580cebd0 0x7f985815a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38166/0 (socket says 172.21.15.26:38166) 2023-10-14T11:14:23.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f985d574640 1 -- 172.21.15.26:0/3735643685 learned_addr learned my addr 172.21.15.26:0/3735643685 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:23.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f985dd75640 1 --2- 172.21.15.26:0/3735643685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98580cb040 0x7f98581561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:23.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f985e576640 1 --2- 172.21.15.26:0/3735643685 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f985815cc60 0x7f985815a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:23.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f985d574640 1 -- 172.21.15.26:0/3735643685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98580cb040 msgr2=0x7f98581561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:23.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f985d574640 1 --2- 172.21.15.26:0/3735643685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98580cb040 0x7f98581561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f985d574640 1 -- 172.21.15.26:0/3735643685 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f985815cc60 msgr2=0x7f985815a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:23.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f985d574640 1 --2- 172.21.15.26:0/3735643685 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f985815cc60 0x7f985815a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f985d574640 1 -- 172.21.15.26:0/3735643685 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9850009a70 con 0x7f98580cebd0 2023-10-14T11:14:23.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f985d574640 1 --2- 172.21.15.26:0/3735643685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98580cebd0 0x7f985815a4a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f984800e930 tx=0x7f984800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:23.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f984e7fc640 1 -- 172.21.15.26:0/3735643685 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848009690 con 0x7f98580cebd0 2023-10-14T11:14:23.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f984e7fc640 1 -- 172.21.15.26:0/3735643685 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984800ca00 con 0x7f98580cebd0 2023-10-14T11:14:23.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f985ffd9640 1 -- 172.21.15.26:0/3735643685 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9858152140 con 0x7f98580cebd0 2023-10-14T11:14:23.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f984e7fc640 1 -- 172.21.15.26:0/3735643685 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984800cd70 con 0x7f98580cebd0 2023-10-14T11:14:23.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f985ffd9640 1 -- 172.21.15.26:0/3735643685 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9858156720 con 0x7f98580cebd0 2023-10-14T11:14:23.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.664+0000 7f985ffd9640 1 -- 172.21.15.26:0/3735643685 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985804e170 con 0x7f98580cebd0 2023-10-14T11:14:23.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.668+0000 7f984e7fc640 1 -- 172.21.15.26:0/3735643685 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9848013470 con 0x7f98580cebd0 2023-10-14T11:14:23.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.668+0000 7f984e7fc640 1 --2- 172.21.15.26:0/3735643685 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f983c0664a0 0x7f983c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:23.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.668+0000 7f984e7fc640 1 -- 172.21.15.26:0/3735643685 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f9848084390 con 0x7f98580cebd0 2023-10-14T11:14:23.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.668+0000 7f985dd75640 1 --2- 172.21.15.26:0/3735643685 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f983c0664a0 0x7f983c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:23.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.668+0000 7f985dd75640 1 --2- 172.21.15.26:0/3735643685 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f983c0664a0 0x7f983c068960 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9854001280 tx=0x7f9854007bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:23.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.672+0000 7f984e7fc640 1 -- 172.21.15.26:0/3735643685 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9848051690 con 0x7f98580cebd0 2023-10-14T11:14:23.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.828+0000 7f985ffd9640 1 -- 172.21.15.26:0/3735643685 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f98580b6830 con 0x7f98580cebd0 2023-10-14T11:14:23.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.828+0000 7f984e7fc640 1 -- 172.21.15.26:0/3735643685 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9848054cb0 con 0x7f98580cebd0 2023-10-14T11:14:23.832 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:14:23.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.828+0000 7f985ffd9640 1 -- 172.21.15.26:0/3735643685 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f983c0664a0 msgr2=0x7f983c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:23.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.828+0000 7f985ffd9640 1 --2- 172.21.15.26:0/3735643685 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f983c0664a0 0x7f983c068960 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9854001280 tx=0x7f9854007bc0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.828+0000 7f985ffd9640 1 -- 172.21.15.26:0/3735643685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98580cebd0 msgr2=0x7f985815a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:23.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.828+0000 7f985ffd9640 1 --2- 172.21.15.26:0/3735643685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98580cebd0 0x7f985815a4a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f984800e930 tx=0x7f984800edf0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.828+0000 7f985ffd9640 1 -- 172.21.15.26:0/3735643685 shutdown_connections 2023-10-14T11:14:23.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.828+0000 7f985ffd9640 1 --2- 172.21.15.26:0/3735643685 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f985815cc60 0x7f985815a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.828+0000 7f985ffd9640 1 --2- 172.21.15.26:0/3735643685 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f983c0664a0 0x7f983c068960 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.828+0000 7f985ffd9640 1 --2- 172.21.15.26:0/3735643685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98580cebd0 0x7f985815a4a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.828+0000 7f985ffd9640 1 --2- 172.21.15.26:0/3735643685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98580cb040 0x7f98581561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:23.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.828+0000 7f985ffd9640 1 -- 172.21.15.26:0/3735643685 >> 172.21.15.26:0/3735643685 conn(0x7f985806e570 msgr2=0x7f985815d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:23.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.828+0000 7f985ffd9640 1 -- 172.21.15.26:0/3735643685 shutdown_connections 2023-10-14T11:14:23.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.828+0000 7f985ffd9640 1 -- 172.21.15.26:0/3735643685 wait complete. 2023-10-14T11:14:23.853 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_metadata pg_num 2023-10-14T11:14:24.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.996+0000 7fd6e3291640 1 Processor -- start 2023-10-14T11:14:24.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.996+0000 7fd6e3291640 1 -- start start 2023-10-14T11:14:24.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.996+0000 7fd6e3291640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd6dc0ade00 0x7fd6dc0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:24.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.996+0000 7fd6e3291640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6dc06a4d0 0x7fd6dc0ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:24.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.996+0000 7fd6e3291640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6dc06c6d0 con 0x7fd6dc06a0f0 2023-10-14T11:14:24.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.996+0000 7fd6e3291640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6dc06c950 con 0x7fd6dc0ade00 2023-10-14T11:14:24.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.996+0000 7fd6e3291640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc1654f0 con 0x7fd6dc06a4d0 2023-10-14T11:14:24.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.996+0000 7fd6e082c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd6dc0ade00 0x7fd6dc0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:24.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.996+0000 7fd6e182e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6dc06a4d0 0x7fd6dc0ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:24.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.996+0000 7fd6e102d640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd6dc06a0f0 0x7fd6dc0ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:52070/0 (socket says 172.21.15.26:52070) 2023-10-14T11:14:24.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.996+0000 7fd6e102d640 1 -- 172.21.15.26:0/3507313257 learned_addr learned my addr 172.21.15.26:0/3507313257 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:24.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.996+0000 7fd6e182e640 1 -- 172.21.15.26:0/3507313257 >> v2:172.21.15.110:3300/0 conn(0x7fd6dc0ade00 msgr2=0x7fd6dc0c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:24.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.996+0000 7fd6d3fff640 1 -- 172.21.15.26:0/3507313257 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181663513 0 0) 0x7fd6dc06c6d0 con 0x7fd6dc06a0f0 2023-10-14T11:14:24.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.996+0000 7fd6e182e640 1 --2- 172.21.15.26:0/3507313257 >> v2:172.21.15.110:3300/0 conn(0x7fd6dc0ade00 0x7fd6dc0c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.996+0000 7fd6e182e640 1 -- 172.21.15.26:0/3507313257 >> v1:172.21.15.110:6789/0 conn(0x7fd6dc06a0f0 legacy=0x7fd6dc0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:24.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:23.996+0000 7fd6e182e640 1 -- 172.21.15.26:0/3507313257 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc1657d0 con 0x7fd6dc06a4d0 2023-10-14T11:14:24.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.000+0000 7fd6e182e640 1 --2- 172.21.15.26:0/3507313257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6dc06a4d0 0x7fd6dc0ccd00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009d90 tx=0x7fd6d401d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5de66f200faf368 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:24.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.000+0000 7fd6d3fff640 1 -- 172.21.15.26:0/3507313257 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d40a5a30 con 0x7fd6dc06a4d0 2023-10-14T11:14:24.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.000+0000 7fd6d3fff640 1 -- 172.21.15.26:0/3507313257 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d40a5b90 con 0x7fd6dc06a4d0 2023-10-14T11:14:24.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.000+0000 7fd6d3fff640 1 -- 172.21.15.26:0/3507313257 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d40ad440 con 0x7fd6dc06a4d0 2023-10-14T11:14:24.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.000+0000 7fd6e3291640 1 -- 172.21.15.26:0/3507313257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6dc06a4d0 msgr2=0x7fd6dc0ccd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:24.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.000+0000 7fd6e3291640 1 --2- 172.21.15.26:0/3507313257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6dc06a4d0 0x7fd6dc0ccd00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009d90 tx=0x7fd6d401d3b0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.000+0000 7fd6e3291640 1 -- 172.21.15.26:0/3507313257 shutdown_connections 2023-10-14T11:14:24.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.000+0000 7fd6e3291640 1 --2- 172.21.15.26:0/3507313257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6dc06a4d0 0x7fd6dc0ccd00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.000+0000 7fd6e3291640 1 --2- 172.21.15.26:0/3507313257 >> v2:172.21.15.110:3300/0 conn(0x7fd6dc0ade00 0x7fd6dc0c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.000+0000 7fd6e3291640 1 -- 172.21.15.26:0/3507313257 >> 172.21.15.26:0/3507313257 conn(0x7fd6dc0b0da0 msgr2=0x7fd6dc0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:24.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.000+0000 7fd6e3291640 1 -- 172.21.15.26:0/3507313257 shutdown_connections 2023-10-14T11:14:24.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.000+0000 7fd6e3291640 1 -- 172.21.15.26:0/3507313257 wait complete. 2023-10-14T11:14:24.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6e3291640 1 Processor -- start 2023-10-14T11:14:24.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6e3291640 1 -- start start 2023-10-14T11:14:24.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6e3291640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc06a0f0 0x7fd6dc1f97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:24.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6e3291640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6dc06a4d0 0x7fd6dc1fd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:24.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6e3291640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6dc0ade00 0x7fd6dc0c3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:24.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6e3291640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0b2c70 con 0x7fd6dc06a0f0 2023-10-14T11:14:24.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6e3291640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc1fdd00 con 0x7fd6dc06a4d0 2023-10-14T11:14:24.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6e3291640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0c2250 con 0x7fd6dc0ade00 2023-10-14T11:14:24.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6e102d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc06a0f0 0x7fd6dc1f97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:24.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6e102d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc06a0f0 0x7fd6dc1f97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38176/0 (socket says 172.21.15.26:38176) 2023-10-14T11:14:24.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6e102d640 1 -- 172.21.15.26:0/2229824952 learned_addr learned my addr 172.21.15.26:0/2229824952 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:24.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6e082c640 1 --2- 172.21.15.26:0/2229824952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6dc06a4d0 0x7fd6dc1fd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:24.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6e182e640 1 --2- 172.21.15.26:0/2229824952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6dc0ade00 0x7fd6dc0c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:24.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6e102d640 1 -- 172.21.15.26:0/2229824952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6dc0ade00 msgr2=0x7fd6dc0c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:24.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6e102d640 1 --2- 172.21.15.26:0/2229824952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6dc0ade00 0x7fd6dc0c3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6e102d640 1 -- 172.21.15.26:0/2229824952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6dc06a4d0 msgr2=0x7fd6dc1fd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6e102d640 1 --2- 172.21.15.26:0/2229824952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6dc06a4d0 0x7fd6dc1fd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6e102d640 1 -- 172.21.15.26:0/2229824952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d4009a70 con 0x7fd6dc06a0f0 2023-10-14T11:14:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6e102d640 1 --2- 172.21.15.26:0/2229824952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc06a0f0 0x7fd6dc1f97f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8007fd0 tx=0x7fd6d800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6d1ffb640 1 -- 172.21.15.26:0/2229824952 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8005cf0 con 0x7fd6dc06a0f0 2023-10-14T11:14:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6d1ffb640 1 -- 172.21.15.26:0/2229824952 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d8005e70 con 0x7fd6dc06a0f0 2023-10-14T11:14:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6e3291640 1 -- 172.21.15.26:0/2229824952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6dc1f9e10 con 0x7fd6dc06a0f0 2023-10-14T11:14:24.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6d1ffb640 1 -- 172.21.15.26:0/2229824952 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d80072f0 con 0x7fd6dc06a0f0 2023-10-14T11:14:24.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.004+0000 7fd6e3291640 1 -- 172.21.15.26:0/2229824952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6dc1fa3d0 con 0x7fd6dc06a0f0 2023-10-14T11:14:24.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.008+0000 7fd6e3291640 1 -- 172.21.15.26:0/2229824952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6dc04e170 con 0x7fd6dc06a0f0 2023-10-14T11:14:24.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.008+0000 7fd6d1ffb640 1 -- 172.21.15.26:0/2229824952 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd6d8007450 con 0x7fd6dc06a0f0 2023-10-14T11:14:24.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.008+0000 7fd6d1ffb640 1 --2- 172.21.15.26:0/2229824952 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd6c00664a0 0x7fd6c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:24.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.008+0000 7fd6d1ffb640 1 -- 172.21.15.26:0/2229824952 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7fd6d80836e0 con 0x7fd6dc06a0f0 2023-10-14T11:14:24.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.008+0000 7fd6e082c640 1 --2- 172.21.15.26:0/2229824952 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd6c00664a0 0x7fd6c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:24.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.008+0000 7fd6e082c640 1 --2- 172.21.15.26:0/2229824952 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd6c00664a0 0x7fd6c0068960 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0c5150 tx=0x7fd6cc009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:24.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.012+0000 7fd6d1ffb640 1 -- 172.21.15.26:0/2229824952 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd6d8050930 con 0x7fd6dc06a0f0 2023-10-14T11:14:24.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.168+0000 7fd6e3291640 1 -- 172.21.15.26:0/2229824952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd6dc0cc5d0 con 0x7fd6dc06a0f0 2023-10-14T11:14:24.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.168+0000 7fd6d1ffb640 1 -- 172.21.15.26:0/2229824952 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"}]=0 v42) v1 ==== 109+0+11 (secure 0 0 0) 0x7fd6d8053f50 con 0x7fd6dc06a0f0 2023-10-14T11:14:24.173 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:14:24.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.168+0000 7fd6e3291640 1 -- 172.21.15.26:0/2229824952 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd6c00664a0 msgr2=0x7fd6c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:24.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.168+0000 7fd6e3291640 1 --2- 172.21.15.26:0/2229824952 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd6c00664a0 0x7fd6c0068960 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0c5150 tx=0x7fd6cc009190 comp rx=0 tx=0).stop 2023-10-14T11:14:24.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.168+0000 7fd6e3291640 1 -- 172.21.15.26:0/2229824952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc06a0f0 msgr2=0x7fd6dc1f97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:24.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.168+0000 7fd6e3291640 1 --2- 172.21.15.26:0/2229824952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc06a0f0 0x7fd6dc1f97f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8007fd0 tx=0x7fd6d800c8e0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.168+0000 7fd6e3291640 1 -- 172.21.15.26:0/2229824952 shutdown_connections 2023-10-14T11:14:24.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.168+0000 7fd6e3291640 1 --2- 172.21.15.26:0/2229824952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6dc0ade00 0x7fd6dc0c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.168+0000 7fd6e3291640 1 --2- 172.21.15.26:0/2229824952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6dc06a4d0 0x7fd6dc1fd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.168+0000 7fd6e3291640 1 --2- 172.21.15.26:0/2229824952 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd6c00664a0 0x7fd6c0068960 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.168+0000 7fd6e3291640 1 --2- 172.21.15.26:0/2229824952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc06a0f0 0x7fd6dc1f97f0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.168+0000 7fd6e3291640 1 -- 172.21.15.26:0/2229824952 >> 172.21.15.26:0/2229824952 conn(0x7fd6dc0b0da0 msgr2=0x7fd6dc0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:24.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.168+0000 7fd6e3291640 1 -- 172.21.15.26:0/2229824952 shutdown_connections 2023-10-14T11:14:24.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.168+0000 7fd6e3291640 1 -- 172.21.15.26:0/2229824952 wait complete. 2023-10-14T11:14:24.194 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_data pg_num 2023-10-14T11:14:24.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.336+0000 7f8f21a2f640 1 Processor -- start 2023-10-14T11:14:24.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.336+0000 7f8f21a2f640 1 -- start start 2023-10-14T11:14:24.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.340+0000 7f8f21a2f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8f1c0cd910 0x7f8f1c0d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:24.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.340+0000 7f8f21a2f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8f1c0d2b80 0x7f8f1c06ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:24.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.340+0000 7f8f21a2f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f1c15ce60 con 0x7f8f1c15ca80 2023-10-14T11:14:24.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.340+0000 7f8f21a2f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1c06b310 con 0x7f8f1c0cd910 2023-10-14T11:14:24.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.340+0000 7f8f21a2f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1c06b5f0 con 0x7f8f1c0d2b80 2023-10-14T11:14:24.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.340+0000 7f8f20a2d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8f1c15ca80 0x7f8f1c0cd200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57078/0 (socket says 172.21.15.26:57078) 2023-10-14T11:14:24.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.340+0000 7f8f20a2d640 1 -- 172.21.15.26:0/4080888136 learned_addr learned my addr 172.21.15.26:0/4080888136 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:24.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.340+0000 7f8f1bfff640 1 --2- 172.21.15.26:0/4080888136 >> v2:172.21.15.26:3300/0 conn(0x7f8f1c0cd910 0x7f8f1c0d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:24.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.340+0000 7f8f2122e640 1 --2- 172.21.15.26:0/4080888136 >> v2:172.21.15.110:3300/0 conn(0x7f8f1c0d2b80 0x7f8f1c06ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:24.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.340+0000 7f8f1b7fe640 1 -- 172.21.15.26:0/4080888136 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776893828 0 0) 0x7f8f100012a0 con 0x7f8f1c15ca80 2023-10-14T11:14:24.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.340+0000 7f8f1b7fe640 1 -- 172.21.15.26:0/4080888136 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f0c003530 con 0x7f8f1c15ca80 2023-10-14T11:14:24.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.340+0000 7f8f1bfff640 1 -- 172.21.15.26:0/4080888136 >> v2:172.21.15.110:3300/0 conn(0x7f8f1c0d2b80 msgr2=0x7f8f1c06ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:24.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.340+0000 7f8f1bfff640 1 --2- 172.21.15.26:0/4080888136 >> v2:172.21.15.110:3300/0 conn(0x7f8f1c0d2b80 0x7f8f1c06ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.340+0000 7f8f1bfff640 1 -- 172.21.15.26:0/4080888136 >> v1:172.21.15.26:6789/0 conn(0x7f8f1c15ca80 legacy=0x7f8f1c0cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:24.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.340+0000 7f8f1bfff640 1 -- 172.21.15.26:0/4080888136 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c0cf160 con 0x7f8f1c0cd910 2023-10-14T11:14:24.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.344+0000 7f8f1bfff640 1 --2- 172.21.15.26:0/4080888136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c0cd910 0x7f8f1c0d2640 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c08c060 tx=0x7f8f0801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49470d218a4341f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:24.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.344+0000 7f8f1b7fe640 1 -- 172.21.15.26:0/4080888136 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f080ac630 con 0x7f8f1c0cd910 2023-10-14T11:14:24.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.344+0000 7f8f1b7fe640 1 -- 172.21.15.26:0/4080888136 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f080ac790 con 0x7f8f1c0cd910 2023-10-14T11:14:24.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.344+0000 7f8f1b7fe640 1 -- 172.21.15.26:0/4080888136 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f080acb20 con 0x7f8f1c0cd910 2023-10-14T11:14:24.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.344+0000 7f8f21a2f640 1 -- 172.21.15.26:0/4080888136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c0cd910 msgr2=0x7f8f1c0d2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:24.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.344+0000 7f8f21a2f640 1 --2- 172.21.15.26:0/4080888136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c0cd910 0x7f8f1c0d2640 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c08c060 tx=0x7f8f0801c3d0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.344+0000 7f8f21a2f640 1 -- 172.21.15.26:0/4080888136 shutdown_connections 2023-10-14T11:14:24.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.344+0000 7f8f21a2f640 1 --2- 172.21.15.26:0/4080888136 >> v2:172.21.15.110:3300/0 conn(0x7f8f1c0d2b80 0x7f8f1c06ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.344+0000 7f8f21a2f640 1 --2- 172.21.15.26:0/4080888136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c0cd910 0x7f8f1c0d2640 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.344+0000 7f8f21a2f640 1 -- 172.21.15.26:0/4080888136 >> 172.21.15.26:0/4080888136 conn(0x7f8f1c08c230 msgr2=0x7f8f1c09bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:24.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.344+0000 7f8f21a2f640 1 -- 172.21.15.26:0/4080888136 shutdown_connections 2023-10-14T11:14:24.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.344+0000 7f8f21a2f640 1 -- 172.21.15.26:0/4080888136 wait complete. 2023-10-14T11:14:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.344+0000 7f8f21a2f640 1 Processor -- start 2023-10-14T11:14:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.344+0000 7f8f21a2f640 1 -- start start 2023-10-14T11:14:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.344+0000 7f8f21a2f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f1c0cd910 0x7f8f1c15e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.344+0000 7f8f21a2f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c0d2b80 0x7f8f1c152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:24.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.344+0000 7f8f21a2f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f1c15ca80 0x7f8f1c15ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:24.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.344+0000 7f8f21a2f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0c9150 con 0x7f8f1c0d2b80 2023-10-14T11:14:24.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.344+0000 7f8f21a2f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c153220 con 0x7f8f1c15ca80 2023-10-14T11:14:24.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.344+0000 7f8f21a2f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c15fab0 con 0x7f8f1c0cd910 2023-10-14T11:14:24.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.348+0000 7f8f1bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c0d2b80 0x7f8f1c152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:24.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.348+0000 7f8f1bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c0d2b80 0x7f8f1c152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38194/0 (socket says 172.21.15.26:38194) 2023-10-14T11:14:24.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.348+0000 7f8f1bfff640 1 -- 172.21.15.26:0/3291040241 learned_addr learned my addr 172.21.15.26:0/3291040241 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:24.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.348+0000 7f8f20a2d640 1 --2- 172.21.15.26:0/3291040241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f1c0cd910 0x7f8f1c15e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:24.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.348+0000 7f8f2122e640 1 --2- 172.21.15.26:0/3291040241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f1c15ca80 0x7f8f1c15ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:24.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.348+0000 7f8f1bfff640 1 -- 172.21.15.26:0/3291040241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f1c0cd910 msgr2=0x7f8f1c15e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:24.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.348+0000 7f8f1bfff640 1 --2- 172.21.15.26:0/3291040241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f1c0cd910 0x7f8f1c15e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.348+0000 7f8f1bfff640 1 -- 172.21.15.26:0/3291040241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f1c15ca80 msgr2=0x7f8f1c15ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:24.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.348+0000 7f8f1bfff640 1 --2- 172.21.15.26:0/3291040241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f1c15ca80 0x7f8f1c15ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.348+0000 7f8f1bfff640 1 -- 172.21.15.26:0/3291040241 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f08009420 con 0x7f8f1c0d2b80 2023-10-14T11:14:24.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.348+0000 7f8f2122e640 1 --2- 172.21.15.26:0/3291040241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f1c15ca80 0x7f8f1c15ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:24.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.348+0000 7f8f20a2d640 1 --2- 172.21.15.26:0/3291040241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f1c0cd910 0x7f8f1c15e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:24.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.348+0000 7f8f1bfff640 1 --2- 172.21.15.26:0/3291040241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c0d2b80 0x7f8f1c152ce0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8f080af040 tx=0x7f8f08019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:24.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.348+0000 7f8f197fa640 1 -- 172.21.15.26:0/3291040241 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f080b5610 con 0x7f8f1c0d2b80 2023-10-14T11:14:24.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.348+0000 7f8f197fa640 1 -- 172.21.15.26:0/3291040241 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f080b5790 con 0x7f8f1c0d2b80 2023-10-14T11:14:24.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.348+0000 7f8f21a2f640 1 -- 172.21.15.26:0/3291040241 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f1c0c8e70 con 0x7f8f1c0d2b80 2023-10-14T11:14:24.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.348+0000 7f8f197fa640 1 -- 172.21.15.26:0/3291040241 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f080b5b40 con 0x7f8f1c0d2b80 2023-10-14T11:14:24.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.348+0000 7f8f21a2f640 1 -- 172.21.15.26:0/3291040241 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f1c160030 con 0x7f8f1c0d2b80 2023-10-14T11:14:24.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.348+0000 7f8f21a2f640 1 -- 172.21.15.26:0/3291040241 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f1c04e9c0 con 0x7f8f1c0d2b80 2023-10-14T11:14:24.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.348+0000 7f8f197fa640 1 -- 172.21.15.26:0/3291040241 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8f080b3040 con 0x7f8f1c0d2b80 2023-10-14T11:14:24.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.352+0000 7f8f197fa640 1 --2- 172.21.15.26:0/3291040241 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8f000664a0 0x7f8f00068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:24.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.352+0000 7f8f197fa640 1 -- 172.21.15.26:0/3291040241 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f8f0811e350 con 0x7f8f1c0d2b80 2023-10-14T11:14:24.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.352+0000 7f8f20a2d640 1 --2- 172.21.15.26:0/3291040241 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8f000664a0 0x7f8f00068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:24.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.352+0000 7f8f20a2d640 1 --2- 172.21.15.26:0/3291040241 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8f000664a0 0x7f8f00068960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8f10001400 tx=0x7f8f10009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:24.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.356+0000 7f8f197fa640 1 -- 172.21.15.26:0/3291040241 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8f080eb440 con 0x7f8f1c0d2b80 2023-10-14T11:14:24.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.512+0000 7f8f21a2f640 1 -- 172.21.15.26:0/3291040241 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"} v 0) v1 -- 0x7f8f1c0b1af0 con 0x7f8f1c0d2b80 2023-10-14T11:14:24.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.512+0000 7f8f197fa640 1 -- 172.21.15.26:0/3291040241 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"}]=0 v42) v1 ==== 105+0+11 (secure 0 0 0) 0x7f8f080eea60 con 0x7f8f1c0d2b80 2023-10-14T11:14:24.518 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:14:24.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.512+0000 7f8f21a2f640 1 -- 172.21.15.26:0/3291040241 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8f000664a0 msgr2=0x7f8f00068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:24.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.512+0000 7f8f21a2f640 1 --2- 172.21.15.26:0/3291040241 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8f000664a0 0x7f8f00068960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8f10001400 tx=0x7f8f10009040 comp rx=0 tx=0).stop 2023-10-14T11:14:24.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.512+0000 7f8f21a2f640 1 -- 172.21.15.26:0/3291040241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c0d2b80 msgr2=0x7f8f1c152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:24.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.512+0000 7f8f21a2f640 1 --2- 172.21.15.26:0/3291040241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c0d2b80 0x7f8f1c152ce0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8f080af040 tx=0x7f8f08019170 comp rx=0 tx=0).stop 2023-10-14T11:14:24.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.512+0000 7f8f21a2f640 1 -- 172.21.15.26:0/3291040241 shutdown_connections 2023-10-14T11:14:24.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.512+0000 7f8f21a2f640 1 --2- 172.21.15.26:0/3291040241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f1c15ca80 0x7f8f1c15ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.512+0000 7f8f21a2f640 1 --2- 172.21.15.26:0/3291040241 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8f000664a0 0x7f8f00068960 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.512+0000 7f8f21a2f640 1 --2- 172.21.15.26:0/3291040241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c0d2b80 0x7f8f1c152ce0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.512+0000 7f8f21a2f640 1 --2- 172.21.15.26:0/3291040241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f1c0cd910 0x7f8f1c15e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.512+0000 7f8f21a2f640 1 -- 172.21.15.26:0/3291040241 >> 172.21.15.26:0/3291040241 conn(0x7f8f1c08c230 msgr2=0x7f8f1c158d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:24.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.516+0000 7f8f21a2f640 1 -- 172.21.15.26:0/3291040241 shutdown_connections 2023-10-14T11:14:24.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.516+0000 7f8f21a2f640 1 -- 172.21.15.26:0/3291040241 wait complete. 2023-10-14T11:14:24.539 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-10-14T11:14:24.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.680+0000 7f84b050f640 1 Processor -- start 2023-10-14T11:14:24.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.680+0000 7f84b050f640 1 -- start start 2023-10-14T11:14:24.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.680+0000 7f84b050f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84a806e260 0x7f84a80b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:24.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.680+0000 7f84b050f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a80b4600 con 0x7f84a806a5a0 2023-10-14T11:14:24.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.680+0000 7f84b050f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a80c8dd0 con 0x7f84a8159900 2023-10-14T11:14:24.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.680+0000 7f84b050f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80cd740 con 0x7f84a806e260 2023-10-14T11:14:24.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.680+0000 7f84adaaa640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f84a806a5a0 0x7f84a80c9b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57092/0 (socket says 172.21.15.26:57092) 2023-10-14T11:14:24.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.680+0000 7f84adaaa640 1 -- 172.21.15.26:0/1187329885 learned_addr learned my addr 172.21.15.26:0/1187329885 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:24.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.684+0000 7f84aeaac640 1 --2- 172.21.15.26:0/1187329885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84a806e260 0x7f84a80b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:24.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.684+0000 7f84ad2a9640 1 -- 172.21.15.26:0/1187329885 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654180559 0 0) 0x7f84a80b4600 con 0x7f84a806a5a0 2023-10-14T11:14:24.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.684+0000 7f84ad2a9640 1 -- 172.21.15.26:0/1187329885 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8494003530 con 0x7f84a806a5a0 2023-10-14T11:14:24.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.684+0000 7f84ad2a9640 1 -- 172.21.15.26:0/1187329885 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361898307 0 0) 0x7f84a80c8dd0 con 0x7f84a8159900 2023-10-14T11:14:24.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.684+0000 7f84aeaac640 1 -- 172.21.15.26:0/1187329885 >> v1:172.21.15.110:6789/0 conn(0x7f84a8159900 legacy=0x7f84a8069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:24.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.684+0000 7f84aeaac640 1 -- 172.21.15.26:0/1187329885 >> v1:172.21.15.26:6789/0 conn(0x7f84a806a5a0 legacy=0x7f84a80c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:24.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.684+0000 7f84aeaac640 1 -- 172.21.15.26:0/1187329885 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a80c90b0 con 0x7f84a806e260 2023-10-14T11:14:24.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.684+0000 7f84aeaac640 1 --2- 172.21.15.26:0/1187329885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84a806e260 0x7f84a80b3f00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f84a80cd880 tx=0x7f84a001c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a894cdaae060e3e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:24.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.684+0000 7f84ad2a9640 1 -- 172.21.15.26:0/1187329885 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8498001600 con 0x7f84a806e260 2023-10-14T11:14:24.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.684+0000 7f84ad2a9640 1 -- 172.21.15.26:0/1187329885 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a00a5630 con 0x7f84a806e260 2023-10-14T11:14:24.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.684+0000 7f84ad2a9640 1 -- 172.21.15.26:0/1187329885 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a00a59c0 con 0x7f84a806e260 2023-10-14T11:14:24.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.688+0000 7f84b050f640 1 -- 172.21.15.26:0/1187329885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84a806e260 msgr2=0x7f84a80b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:24.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.688+0000 7f84b050f640 1 --2- 172.21.15.26:0/1187329885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84a806e260 0x7f84a80b3f00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f84a80cd880 tx=0x7f84a001c7b0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.688+0000 7f84b050f640 1 -- 172.21.15.26:0/1187329885 shutdown_connections 2023-10-14T11:14:24.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.688+0000 7f84b050f640 1 --2- 172.21.15.26:0/1187329885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84a806e260 0x7f84a80b3f00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.688+0000 7f84b050f640 1 -- 172.21.15.26:0/1187329885 >> 172.21.15.26:0/1187329885 conn(0x7f84a80b0da0 msgr2=0x7f84a80ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:24.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.688+0000 7f84b050f640 1 -- 172.21.15.26:0/1187329885 shutdown_connections 2023-10-14T11:14:24.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.688+0000 7f84b050f640 1 -- 172.21.15.26:0/1187329885 wait complete. 2023-10-14T11:14:24.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.688+0000 7f84b050f640 1 Processor -- start 2023-10-14T11:14:24.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.688+0000 7f84b050f640 1 -- start start 2023-10-14T11:14:24.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.688+0000 7f84b050f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84a806a5a0 0x7f84a80c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:24.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.688+0000 7f84b050f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84a806e260 0x7f84a80c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:24.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.688+0000 7f84b050f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84a8159900 0x7f84a81559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:24.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.688+0000 7f84b050f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a8157230 con 0x7f84a806a5a0 2023-10-14T11:14:24.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.688+0000 7f84b050f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80c85b0 con 0x7f84a8159900 2023-10-14T11:14:24.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.688+0000 7f84b050f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a8156890 con 0x7f84a806e260 2023-10-14T11:14:24.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.688+0000 7f84ae2ab640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84a806a5a0 0x7f84a80c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:24.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.688+0000 7f84ae2ab640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84a806a5a0 0x7f84a80c7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38210/0 (socket says 172.21.15.26:38210) 2023-10-14T11:14:24.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.688+0000 7f84ae2ab640 1 -- 172.21.15.26:0/3235761466 learned_addr learned my addr 172.21.15.26:0/3235761466 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.688+0000 7f84adaaa640 1 --2- 172.21.15.26:0/3235761466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84a806e260 0x7f84a80c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.688+0000 7f84aeaac640 1 --2- 172.21.15.26:0/3235761466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84a8159900 0x7f84a81559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.692+0000 7f84ae2ab640 1 -- 172.21.15.26:0/3235761466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84a806e260 msgr2=0x7f84a80c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.692+0000 7f84ae2ab640 1 --2- 172.21.15.26:0/3235761466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84a806e260 0x7f84a80c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.692+0000 7f84ae2ab640 1 -- 172.21.15.26:0/3235761466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84a8159900 msgr2=0x7f84a81559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:24.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.692+0000 7f84ae2ab640 1 --2- 172.21.15.26:0/3235761466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84a8159900 0x7f84a81559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.692+0000 7f84ae2ab640 1 -- 172.21.15.26:0/3235761466 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a0009a70 con 0x7f84a806a5a0 2023-10-14T11:14:24.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.692+0000 7f84ae2ab640 1 --2- 172.21.15.26:0/3235761466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84a806a5a0 0x7f84a80c7f20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f84a400c4a0 tx=0x7f84a400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:24.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.692+0000 7f849effd640 1 -- 172.21.15.26:0/3235761466 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4005480 con 0x7f84a806a5a0 2023-10-14T11:14:24.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.692+0000 7f849effd640 1 -- 172.21.15.26:0/3235761466 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a4003600 con 0x7f84a806a5a0 2023-10-14T11:14:24.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.692+0000 7f849effd640 1 -- 172.21.15.26:0/3235761466 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a40039b0 con 0x7f84a806a5a0 2023-10-14T11:14:24.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.692+0000 7f84b050f640 1 -- 172.21.15.26:0/3235761466 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a8156b70 con 0x7f84a806a5a0 2023-10-14T11:14:24.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.692+0000 7f84b050f640 1 -- 172.21.15.26:0/3235761466 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a80c5f50 con 0x7f84a806a5a0 2023-10-14T11:14:24.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.692+0000 7f84b050f640 1 -- 172.21.15.26:0/3235761466 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a804e170 con 0x7f84a806a5a0 2023-10-14T11:14:24.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.692+0000 7f849effd640 1 -- 172.21.15.26:0/3235761466 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f84a4003b10 con 0x7f84a806a5a0 2023-10-14T11:14:24.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.692+0000 7f849effd640 1 --2- 172.21.15.26:0/3235761466 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f848c0664d0 0x7f848c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:24.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.692+0000 7f849effd640 1 -- 172.21.15.26:0/3235761466 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f84a40836d0 con 0x7f84a806a5a0 2023-10-14T11:14:24.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.692+0000 7f84adaaa640 1 --2- 172.21.15.26:0/3235761466 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f848c0664d0 0x7f848c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:24.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.696+0000 7f84adaaa640 1 --2- 172.21.15.26:0/3235761466 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f848c0664d0 0x7f848c068990 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f84a8152d50 tx=0x7f84980015a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:24.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.696+0000 7f849effd640 1 -- 172.21.15.26:0/3235761466 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f84a4050870 con 0x7f84a806a5a0 2023-10-14T11:14:24.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.856+0000 7f84b050f640 1 -- 172.21.15.26:0/3235761466 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f84a806b380 con 0x7f84a806a5a0 2023-10-14T11:14:24.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.856+0000 7f849effd640 1 -- 172.21.15.26:0/3235761466 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v42) v1 ==== 97+0+11 (secure 0 0 0) 0x7f84a40170a0 con 0x7f84a806a5a0 2023-10-14T11:14:24.861 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:14:24.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.856+0000 7f84b050f640 1 -- 172.21.15.26:0/3235761466 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f848c0664d0 msgr2=0x7f848c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:24.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.856+0000 7f84b050f640 1 --2- 172.21.15.26:0/3235761466 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f848c0664d0 0x7f848c068990 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f84a8152d50 tx=0x7f84980015a0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.856+0000 7f84b050f640 1 -- 172.21.15.26:0/3235761466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84a806a5a0 msgr2=0x7f84a80c7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:24.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.856+0000 7f84b050f640 1 --2- 172.21.15.26:0/3235761466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84a806a5a0 0x7f84a80c7f20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f84a400c4a0 tx=0x7f84a400c960 comp rx=0 tx=0).stop 2023-10-14T11:14:24.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.856+0000 7f84b050f640 1 -- 172.21.15.26:0/3235761466 shutdown_connections 2023-10-14T11:14:24.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.856+0000 7f84b050f640 1 --2- 172.21.15.26:0/3235761466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84a8159900 0x7f84a81559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.856+0000 7f84b050f640 1 --2- 172.21.15.26:0/3235761466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84a806e260 0x7f84a80c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.856+0000 7f84b050f640 1 --2- 172.21.15.26:0/3235761466 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f848c0664d0 0x7f848c068990 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.856+0000 7f84b050f640 1 --2- 172.21.15.26:0/3235761466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84a806a5a0 0x7f84a80c7f20 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:24.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.856+0000 7f84b050f640 1 -- 172.21.15.26:0/3235761466 >> 172.21.15.26:0/3235761466 conn(0x7f84a80b0da0 msgr2=0x7f84a80ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:24.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.856+0000 7f84b050f640 1 -- 172.21.15.26:0/3235761466 shutdown_connections 2023-10-14T11:14:24.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:24.856+0000 7f84b050f640 1 -- 172.21.15.26:0/3235761466 wait complete. 2023-10-14T11:14:24.883 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:14:25.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.020+0000 7fce45009640 1 Processor -- start 2023-10-14T11:14:25.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.020+0000 7fce45009640 1 -- start start 2023-10-14T11:14:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.024+0000 7fce45009640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce40070c40 0x7fce4015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.024+0000 7fce45009640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4015be60 con 0x7fce400b07f0 2023-10-14T11:14:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.024+0000 7fce45009640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4015c1f0 con 0x7fce400b4020 2023-10-14T11:14:25.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.024+0000 7fce45009640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4015b3b0 con 0x7fce40070c40 2023-10-14T11:14:25.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.024+0000 7fce3f59e640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fce400b07f0 0x7fce40164490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57098/0 (socket says 172.21.15.26:57098) 2023-10-14T11:14:25.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.024+0000 7fce3f59e640 1 -- 172.21.15.26:0/4061204477 learned_addr learned my addr 172.21.15.26:0/4061204477 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:25.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.024+0000 7fce3ed9d640 1 --2- 172.21.15.26:0/4061204477 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce40070c40 0x7fce4015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.024+0000 7fce3e59c640 1 -- 172.21.15.26:0/4061204477 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513141964 0 0) 0x7fce4015be60 con 0x7fce400b07f0 2023-10-14T11:14:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.024+0000 7fce3e59c640 1 -- 172.21.15.26:0/4061204477 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce2c003530 con 0x7fce400b07f0 2023-10-14T11:14:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.024+0000 7fce3e59c640 1 -- 172.21.15.26:0/4061204477 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821179484 0 0) 0x7fce4015c1f0 con 0x7fce400b4020 2023-10-14T11:14:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.024+0000 7fce3e59c640 1 -- 172.21.15.26:0/4061204477 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce4015be60 con 0x7fce400b4020 2023-10-14T11:14:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.024+0000 7fce3e59c640 1 -- 172.21.15.26:0/4061204477 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 903234202 0 0) 0x7fce2c003530 con 0x7fce400b07f0 2023-10-14T11:14:25.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.024+0000 7fce3ed9d640 1 -- 172.21.15.26:0/4061204477 >> v1:172.21.15.110:6789/0 conn(0x7fce400b4020 legacy=0x7fce400b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:25.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.024+0000 7fce3ed9d640 1 -- 172.21.15.26:0/4061204477 >> v1:172.21.15.26:6789/0 conn(0x7fce400b07f0 legacy=0x7fce40164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:25.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.024+0000 7fce3ed9d640 1 -- 172.21.15.26:0/4061204477 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce40071020 con 0x7fce40070c40 2023-10-14T11:14:25.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.028+0000 7fce3ed9d640 1 --2- 172.21.15.26:0/4061204477 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce40070c40 0x7fce4015ae70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fce300097f0 tx=0x7fce3001c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba59f1206466213c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:25.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.028+0000 7fce3e59c640 1 -- 172.21.15.26:0/4061204477 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce38001a00 con 0x7fce40070c40 2023-10-14T11:14:25.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.028+0000 7fce3e59c640 1 -- 172.21.15.26:0/4061204477 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce300a7050 con 0x7fce40070c40 2023-10-14T11:14:25.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.028+0000 7fce3e59c640 1 -- 172.21.15.26:0/4061204477 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce300ab620 con 0x7fce40070c40 2023-10-14T11:14:25.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.028+0000 7fce45009640 1 -- 172.21.15.26:0/4061204477 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce40070c40 msgr2=0x7fce4015ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:25.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.028+0000 7fce45009640 1 --2- 172.21.15.26:0/4061204477 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce40070c40 0x7fce4015ae70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fce300097f0 tx=0x7fce3001c350 comp rx=0 tx=0).stop 2023-10-14T11:14:25.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.028+0000 7fce45009640 1 -- 172.21.15.26:0/4061204477 shutdown_connections 2023-10-14T11:14:25.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.028+0000 7fce45009640 1 --2- 172.21.15.26:0/4061204477 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce40070c40 0x7fce4015ae70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:25.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.028+0000 7fce45009640 1 -- 172.21.15.26:0/4061204477 >> 172.21.15.26:0/4061204477 conn(0x7fce4006c190 msgr2=0x7fce4006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:25.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.028+0000 7fce45009640 1 -- 172.21.15.26:0/4061204477 shutdown_connections 2023-10-14T11:14:25.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.028+0000 7fce45009640 1 -- 172.21.15.26:0/4061204477 wait complete. 2023-10-14T11:14:25.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.028+0000 7fce45009640 1 Processor -- start 2023-10-14T11:14:25.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.028+0000 7fce45009640 1 -- start start 2023-10-14T11:14:25.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce45009640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce40070c40 0x7fce4014efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:25.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce45009640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce400b07f0 0x7fce401f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:25.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce45009640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce400b4020 0x7fce401528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:25.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce45009640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce400af110 con 0x7fce400b4020 2023-10-14T11:14:25.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce45009640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce400ae900 con 0x7fce400b07f0 2023-10-14T11:14:25.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce45009640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce400aeb50 con 0x7fce40070c40 2023-10-14T11:14:25.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce3f59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce400b4020 0x7fce401528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:25.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce3f59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce400b4020 0x7fce401528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38226/0 (socket says 172.21.15.26:38226) 2023-10-14T11:14:25.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce3f59e640 1 -- 172.21.15.26:0/3886654377 learned_addr learned my addr 172.21.15.26:0/3886654377 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:25.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce3ed9d640 1 --2- 172.21.15.26:0/3886654377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce40070c40 0x7fce4014efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:25.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce37fff640 1 --2- 172.21.15.26:0/3886654377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce400b07f0 0x7fce401f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:25.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce3f59e640 1 -- 172.21.15.26:0/3886654377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce40070c40 msgr2=0x7fce4014efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:25.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce3f59e640 1 --2- 172.21.15.26:0/3886654377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce40070c40 0x7fce4014efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:25.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce3f59e640 1 -- 172.21.15.26:0/3886654377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce400b07f0 msgr2=0x7fce401f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:25.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce3f59e640 1 --2- 172.21.15.26:0/3886654377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce400b07f0 0x7fce401f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:25.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce3f59e640 1 -- 172.21.15.26:0/3886654377 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce30009420 con 0x7fce400b4020 2023-10-14T11:14:25.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce3f59e640 1 --2- 172.21.15.26:0/3886654377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce400b4020 0x7fce401528f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fce3800cbf0 tx=0x7fce3800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:25.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce377fe640 1 -- 172.21.15.26:0/3886654377 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3800ad50 con 0x7fce400b4020 2023-10-14T11:14:25.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce377fe640 1 -- 172.21.15.26:0/3886654377 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce38012400 con 0x7fce400b4020 2023-10-14T11:14:25.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce377fe640 1 -- 172.21.15.26:0/3886654377 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce38012790 con 0x7fce400b4020 2023-10-14T11:14:25.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce45009640 1 -- 172.21.15.26:0/3886654377 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce400aee30 con 0x7fce400b4020 2023-10-14T11:14:25.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce45009640 1 -- 172.21.15.26:0/3886654377 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4014f650 con 0x7fce400b4020 2023-10-14T11:14:25.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce45009640 1 -- 172.21.15.26:0/3886654377 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce40152230 con 0x7fce400b4020 2023-10-14T11:14:25.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.032+0000 7fce377fe640 1 -- 172.21.15.26:0/3886654377 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fce38007070 con 0x7fce400b4020 2023-10-14T11:14:25.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.036+0000 7fce377fe640 1 --2- 172.21.15.26:0/3886654377 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fce200664d0 0x7fce20068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:25.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.036+0000 7fce377fe640 1 -- 172.21.15.26:0/3886654377 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7fce38084200 con 0x7fce400b4020 2023-10-14T11:14:25.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.036+0000 7fce3ed9d640 1 --2- 172.21.15.26:0/3886654377 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fce200664d0 0x7fce20068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:25.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.036+0000 7fce3ed9d640 1 --2- 172.21.15.26:0/3886654377 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fce200664d0 0x7fce20068990 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fce300ad000 tx=0x7fce30008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:25.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.040+0000 7fce377fe640 1 -- 172.21.15.26:0/3886654377 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fce40152230 con 0x7fce400b4020 2023-10-14T11:14:25.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.208+0000 7fce45009640 1 -- 172.21.15.26:0/3886654377 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fce40152230 con 0x7fce400b4020 2023-10-14T11:14:25.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.208+0000 7fce377fe640 1 -- 172.21.15.26:0/3886654377 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7fce40152230 con 0x7fce400b4020 2023-10-14T11:14:25.214 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-10-14T11:14:25.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.208+0000 7fce45009640 1 -- 172.21.15.26:0/3886654377 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fce200664d0 msgr2=0x7fce20068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:25.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.208+0000 7fce45009640 1 --2- 172.21.15.26:0/3886654377 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fce200664d0 0x7fce20068990 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fce300ad000 tx=0x7fce30008040 comp rx=0 tx=0).stop 2023-10-14T11:14:25.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.208+0000 7fce45009640 1 -- 172.21.15.26:0/3886654377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce400b4020 msgr2=0x7fce401528f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:25.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.208+0000 7fce45009640 1 --2- 172.21.15.26:0/3886654377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce400b4020 0x7fce401528f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fce3800cbf0 tx=0x7fce3800a430 comp rx=0 tx=0).stop 2023-10-14T11:14:25.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.208+0000 7fce45009640 1 -- 172.21.15.26:0/3886654377 shutdown_connections 2023-10-14T11:14:25.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.208+0000 7fce45009640 1 --2- 172.21.15.26:0/3886654377 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fce200664d0 0x7fce20068990 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:25.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.208+0000 7fce45009640 1 --2- 172.21.15.26:0/3886654377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce400b4020 0x7fce401528f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:25.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.208+0000 7fce45009640 1 --2- 172.21.15.26:0/3886654377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce400b07f0 0x7fce401f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:25.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.208+0000 7fce45009640 1 --2- 172.21.15.26:0/3886654377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce40070c40 0x7fce4014efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:25.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.208+0000 7fce45009640 1 -- 172.21.15.26:0/3886654377 >> 172.21.15.26:0/3886654377 conn(0x7fce4006c190 msgr2=0x7fce400b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:25.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.208+0000 7fce45009640 1 -- 172.21.15.26:0/3886654377 shutdown_connections 2023-10-14T11:14:25.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:25.208+0000 7fce45009640 1 -- 172.21.15.26:0/3886654377 wait complete. 2023-10-14T11:14:25.234 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi026.front.sepia.ceph.com... 2023-10-14T11:14:25.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:25.235 DEBUG:teuthology.orchestra.run.smithi026:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-14T11:14:25.255 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[49272]: fuse finished with error 0 and tester_r 0 2023-10-14T11:14:25.257 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:14:31.359 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T11:14:31.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:31.360 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T11:14:31.371 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=testcephfs1_data' 2023-10-14T11:14:31.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.572+0000 7f81613d9640 1 Processor -- start 2023-10-14T11:14:31.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.572+0000 7f81613d9640 1 -- start start 2023-10-14T11:14:31.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.576+0000 7f81613d9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f815c06dbd0 0x7f815c15ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:31.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.576+0000 7f81613d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f815c0c8e50 0x7f815c06c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:31.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.576+0000 7f81613d9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f815c15e5e0 con 0x7f815c06cba0 2023-10-14T11:14:31.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.576+0000 7f81613d9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f815c15b320 con 0x7f815c06dbd0 2023-10-14T11:14:31.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.576+0000 7f81613d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815c15b570 con 0x7f815c0c8e50 2023-10-14T11:14:31.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.576+0000 7f815b7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f815c06cba0 0x7f815c069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57100/0 (socket says 172.21.15.26:57100) 2023-10-14T11:14:31.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.576+0000 7f815b7fe640 1 -- 172.21.15.26:0/862272244 learned_addr learned my addr 172.21.15.26:0/862272244 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:31.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.576+0000 7f8153fff640 1 --2- 172.21.15.26:0/862272244 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f815c0c8e50 0x7f815c06c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:31.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.576+0000 7f815affd640 1 --2- 172.21.15.26:0/862272244 >> v2:172.21.15.110:3300/0 conn(0x7f815c06dbd0 0x7f815c15ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:31.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.576+0000 7f815a7fc640 1 -- 172.21.15.26:0/862272244 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4075094054 0 0) 0x7f815c15e5e0 con 0x7f815c06cba0 2023-10-14T11:14:31.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.576+0000 7f815a7fc640 1 -- 172.21.15.26:0/862272244 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8148003530 con 0x7f815c06cba0 2023-10-14T11:14:31.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.576+0000 7f8153fff640 1 -- 172.21.15.26:0/862272244 >> v2:172.21.15.110:3300/0 conn(0x7f815c06dbd0 msgr2=0x7f815c15ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:31.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.576+0000 7f8153fff640 1 --2- 172.21.15.26:0/862272244 >> v2:172.21.15.110:3300/0 conn(0x7f815c06dbd0 0x7f815c15ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:31.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.576+0000 7f8153fff640 1 -- 172.21.15.26:0/862272244 >> v1:172.21.15.26:6789/0 conn(0x7f815c06cba0 legacy=0x7f815c069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:31.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.576+0000 7f8153fff640 1 -- 172.21.15.26:0/862272244 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815c15b850 con 0x7f815c0c8e50 2023-10-14T11:14:31.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.576+0000 7f815affd640 1 --2- 172.21.15.26:0/862272244 >> v2:172.21.15.110:3300/0 conn(0x7f815c06dbd0 0x7f815c15ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:14:31.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.580+0000 7f8153fff640 1 --2- 172.21.15.26:0/862272244 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f815c0c8e50 0x7f815c06c660 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f81440097c0 tx=0x7f814401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5afa9e548b7865d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:31.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.580+0000 7f815a7fc640 1 -- 172.21.15.26:0/862272244 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81440ab650 con 0x7f815c0c8e50 2023-10-14T11:14:31.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.580+0000 7f815a7fc640 1 -- 172.21.15.26:0/862272244 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81440ab7b0 con 0x7f815c0c8e50 2023-10-14T11:14:31.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.580+0000 7f815a7fc640 1 -- 172.21.15.26:0/862272244 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81440abb40 con 0x7f815c0c8e50 2023-10-14T11:14:31.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.580+0000 7f81613d9640 1 -- 172.21.15.26:0/862272244 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f815c0c8e50 msgr2=0x7f815c06c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:31.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.580+0000 7f81613d9640 1 --2- 172.21.15.26:0/862272244 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f815c0c8e50 0x7f815c06c660 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f81440097c0 tx=0x7f814401c450 comp rx=0 tx=0).stop 2023-10-14T11:14:31.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.580+0000 7f81613d9640 1 -- 172.21.15.26:0/862272244 shutdown_connections 2023-10-14T11:14:31.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.580+0000 7f81613d9640 1 --2- 172.21.15.26:0/862272244 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f815c0c8e50 0x7f815c06c660 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:31.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.580+0000 7f81613d9640 1 --2- 172.21.15.26:0/862272244 >> v2:172.21.15.110:3300/0 conn(0x7f815c06dbd0 0x7f815c15ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:31.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.580+0000 7f81613d9640 1 -- 172.21.15.26:0/862272244 >> 172.21.15.26:0/862272244 conn(0x7f815c0b0d10 msgr2=0x7f815c0ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:31.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.580+0000 7f81613d9640 1 -- 172.21.15.26:0/862272244 shutdown_connections 2023-10-14T11:14:31.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.580+0000 7f81613d9640 1 -- 172.21.15.26:0/862272244 wait complete. 2023-10-14T11:14:31.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.580+0000 7f81613d9640 1 Processor -- start 2023-10-14T11:14:31.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.580+0000 7f81613d9640 1 -- start start 2023-10-14T11:14:31.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f81613d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f815c06cba0 0x7f815c1f89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:31.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f81613d9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f815c06dbd0 0x7f815c0afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:31.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f81613d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f815c0c8e50 0x7f815c158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:31.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f81613d9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c0adb80 con 0x7f815c06dbd0 2023-10-14T11:14:31.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f81613d9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c1f8f80 con 0x7f815c06cba0 2023-10-14T11:14:31.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f81613d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815c1f9260 con 0x7f815c0c8e50 2023-10-14T11:14:31.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f8153fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f815c06dbd0 0x7f815c0afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:31.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f8153fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f815c06dbd0 0x7f815c0afaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38230/0 (socket says 172.21.15.26:38230) 2023-10-14T11:14:31.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f8153fff640 1 -- 172.21.15.26:0/4229313778 learned_addr learned my addr 172.21.15.26:0/4229313778 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:31.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f815affd640 1 --2- 172.21.15.26:0/4229313778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f815c06cba0 0x7f815c1f89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:31.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f815b7fe640 1 --2- 172.21.15.26:0/4229313778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f815c0c8e50 0x7f815c158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:31.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f8153fff640 1 -- 172.21.15.26:0/4229313778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f815c0c8e50 msgr2=0x7f815c158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:31.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f8153fff640 1 --2- 172.21.15.26:0/4229313778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f815c0c8e50 0x7f815c158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:31.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f8153fff640 1 -- 172.21.15.26:0/4229313778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f815c06cba0 msgr2=0x7f815c1f89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:31.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f8153fff640 1 --2- 172.21.15.26:0/4229313778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f815c06cba0 0x7f815c1f89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:31.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f8153fff640 1 -- 172.21.15.26:0/4229313778 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c009420 con 0x7f815c06dbd0 2023-10-14T11:14:31.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f8153fff640 1 --2- 172.21.15.26:0/4229313778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f815c06dbd0 0x7f815c0afaa0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f81440ad040 tx=0x7f814401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:31.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f81537fe640 1 -- 172.21.15.26:0/4229313778 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81440bf610 con 0x7f815c06dbd0 2023-10-14T11:14:31.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f81537fe640 1 -- 172.21.15.26:0/4229313778 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81440bf7b0 con 0x7f815c06dbd0 2023-10-14T11:14:31.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f81537fe640 1 -- 172.21.15.26:0/4229313778 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81440bfb60 con 0x7f815c06dbd0 2023-10-14T11:14:31.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f81613d9640 1 -- 172.21.15.26:0/4229313778 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8144009420 con 0x7f815c06dbd0 2023-10-14T11:14:31.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f81613d9640 1 -- 172.21.15.26:0/4229313778 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f815c0affe0 con 0x7f815c06dbd0 2023-10-14T11:14:31.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.584+0000 7f81613d9640 1 -- 172.21.15.26:0/4229313778 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f815c04e170 con 0x7f815c06dbd0 2023-10-14T11:14:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.588+0000 7f81537fe640 1 -- 172.21.15.26:0/4229313778 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f81440b5400 con 0x7f815c06dbd0 2023-10-14T11:14:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.588+0000 7f81537fe640 1 --2- 172.21.15.26:0/4229313778 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f813c0664a0 0x7f813c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.588+0000 7f81537fe640 1 -- 172.21.15.26:0/4229313778 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f814411efe0 con 0x7f815c06dbd0 2023-10-14T11:14:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.588+0000 7f815affd640 1 --2- 172.21.15.26:0/4229313778 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f813c0664a0 0x7f813c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.588+0000 7f815affd640 1 --2- 172.21.15.26:0/4229313778 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f813c0664a0 0x7f813c068960 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f814c009cf0 tx=0x7f814c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.592+0000 7f81537fe640 1 -- 172.21.15.26:0/4229313778 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f81440ec330 con 0x7f815c06dbd0 2023-10-14T11:14:31.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.800+0000 7f81613d9640 1 -- 172.21.15.26:0/4229313778 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=testcephfs1_data"]} v 0) v1 -- 0x7f815c0cc530 con 0x7f815c06dbd0 2023-10-14T11:14:31.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.804+0000 7f81537fe640 1 -- 172.21.15.26:0/4229313778 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=testcephfs1_data"]}]=0 updated caps for client.0 v14) v1 ==== 189+0+146 (secure 0 0 0) 0x7f81440c40b0 con 0x7f815c06dbd0 2023-10-14T11:14:31.811 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2023-10-14T11:14:31.811 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBZdyplGXdwHxAA3yn7fC60cZX9BQGuvdlfYw== 2023-10-14T11:14:31.811 INFO:teuthology.orchestra.run.smithi026.stdout: caps mds = "allow" 2023-10-14T11:14:31.812 INFO:teuthology.orchestra.run.smithi026.stdout: caps mon = "allow r" 2023-10-14T11:14:31.812 INFO:teuthology.orchestra.run.smithi026.stdout: caps osd = "allow rw pool=testcephfs1_data" 2023-10-14T11:14:31.813 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-10-14T11:14:31.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.808+0000 7f81613d9640 1 -- 172.21.15.26:0/4229313778 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f813c0664a0 msgr2=0x7f813c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:31.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.808+0000 7f81613d9640 1 --2- 172.21.15.26:0/4229313778 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f813c0664a0 0x7f813c068960 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f814c009cf0 tx=0x7f814c009190 comp rx=0 tx=0).stop 2023-10-14T11:14:31.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.808+0000 7f81613d9640 1 -- 172.21.15.26:0/4229313778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f815c06dbd0 msgr2=0x7f815c0afaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:31.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.808+0000 7f81613d9640 1 --2- 172.21.15.26:0/4229313778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f815c06dbd0 0x7f815c0afaa0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f81440ad040 tx=0x7f814401ac90 comp rx=0 tx=0).stop 2023-10-14T11:14:31.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.808+0000 7f81613d9640 1 -- 172.21.15.26:0/4229313778 shutdown_connections 2023-10-14T11:14:31.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.808+0000 7f81613d9640 1 --2- 172.21.15.26:0/4229313778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f815c0c8e50 0x7f815c158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:31.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.808+0000 7f81613d9640 1 --2- 172.21.15.26:0/4229313778 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f813c0664a0 0x7f813c068960 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:31.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.808+0000 7f81613d9640 1 --2- 172.21.15.26:0/4229313778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f815c06dbd0 0x7f815c0afaa0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:31.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.808+0000 7f81613d9640 1 --2- 172.21.15.26:0/4229313778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f815c06cba0 0x7f815c1f89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:31.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.808+0000 7f81613d9640 1 -- 172.21.15.26:0/4229313778 >> 172.21.15.26:0/4229313778 conn(0x7f815c0b0d10 msgr2=0x7f815c0c4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:31.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.808+0000 7f81613d9640 1 -- 172.21.15.26:0/4229313778 shutdown_connections 2023-10-14T11:14:31.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:31.808+0000 7f81613d9640 1 -- 172.21.15.26:0/4229313778 wait complete. 2023-10-14T11:14:31.832 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T11:14:31.833 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T11:14:31.895 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T11:14:31.985 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T11:14:31.985 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:14:31.986 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:14:31.995 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357764k,nr_inodes=4089441,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7700 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-14T11:14:31.996 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T11:14:31.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:31.996 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T11:14:32.047 INFO:teuthology.orchestra.run.smithi026.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-14T11:14:32.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:14:32.049 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:14:32.049 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:14:32.059 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7574 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-14T11:14:32.060 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2023-10-14T11:14:32.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:32.060 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T11:14:32.110 INFO:teuthology.orchestra.run.smithi110.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-14T11:14:32.111 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:14:32.112 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:14:32.112 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:14:32.121 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357764k,nr_inodes=4089441,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7700 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-14T11:14:32.122 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T11:14:32.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:32.123 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-14T11:14:32.171 INFO:teuthology.orchestra.run.smithi026.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-14T11:14:32.172 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:14:32.173 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:14:32.173 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:14:32.184 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7574 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-14T11:14:32.185 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2023-10-14T11:14:32.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:32.186 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-14T11:14:32.238 INFO:teuthology.orchestra.run.smithi110.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-14T11:14:32.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:14:32.240 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:14:32.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.380+0000 7fa5bb46b640 1 Processor -- start 2023-10-14T11:14:32.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.380+0000 7fa5bb46b640 1 -- start start 2023-10-14T11:14:32.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.384+0000 7fa5bb46b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa5b40cf090 0x7fa5b40cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:32.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.384+0000 7fa5bb46b640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b40c65f0 con 0x7fa5b415ca70 2023-10-14T11:14:32.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.384+0000 7fa5bb46b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b40cdf80 con 0x7fa5b40c6ad0 2023-10-14T11:14:32.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.384+0000 7fa5bb46b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b40cfa60 con 0x7fa5b40cf090 2023-10-14T11:14:32.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.384+0000 7fa5b8a06640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa5b40cf090 0x7fa5b40cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:32.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.384+0000 7fa5b9207640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa5b415ca70 0x7fa5b40d3010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36514/0 (socket says 172.21.15.26:36514) 2023-10-14T11:14:32.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.384+0000 7fa5b9207640 1 -- 172.21.15.26:0/798037879 learned_addr learned my addr 172.21.15.26:0/798037879 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:32.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.384+0000 7fa5b8a06640 1 -- 172.21.15.26:0/798037879 >> v1:172.21.15.110:6789/0 conn(0x7fa5b40c6ad0 legacy=0x7fa5b40c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:32.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.384+0000 7fa5b8a06640 1 -- 172.21.15.26:0/798037879 >> v1:172.21.15.26:6789/0 conn(0x7fa5b415ca70 legacy=0x7fa5b40d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:32.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.384+0000 7fa5abfff640 1 -- 172.21.15.26:0/798037879 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1881077886 0 0) 0x7fa5b40c65f0 con 0x7fa5b415ca70 2023-10-14T11:14:32.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.384+0000 7fa5b8a06640 1 -- 172.21.15.26:0/798037879 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b40ce260 con 0x7fa5b40cf090 2023-10-14T11:14:32.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.388+0000 7fa5b8a06640 1 --2- 172.21.15.26:0/798037879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5b40cf090 0x7fa5b40cf520 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40097c0 tx=0x7fa5a401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9e82f118d3cc4b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:32.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.388+0000 7fa5abfff640 1 -- 172.21.15.26:0/798037879 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a40ab600 con 0x7fa5b40cf090 2023-10-14T11:14:32.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.388+0000 7fa5abfff640 1 -- 172.21.15.26:0/798037879 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a40a7050 con 0x7fa5b40cf090 2023-10-14T11:14:32.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.388+0000 7fa5abfff640 1 -- 172.21.15.26:0/798037879 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a40ab980 con 0x7fa5b40cf090 2023-10-14T11:14:32.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.388+0000 7fa5bb46b640 1 -- 172.21.15.26:0/798037879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5b40cf090 msgr2=0x7fa5b40cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:32.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.388+0000 7fa5bb46b640 1 --2- 172.21.15.26:0/798037879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5b40cf090 0x7fa5b40cf520 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40097c0 tx=0x7fa5a401c440 comp rx=0 tx=0).stop 2023-10-14T11:14:32.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.388+0000 7fa5bb46b640 1 -- 172.21.15.26:0/798037879 shutdown_connections 2023-10-14T11:14:32.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.388+0000 7fa5bb46b640 1 --2- 172.21.15.26:0/798037879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5b40cf090 0x7fa5b40cf520 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:32.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.388+0000 7fa5bb46b640 1 -- 172.21.15.26:0/798037879 >> 172.21.15.26:0/798037879 conn(0x7fa5b409bc50 msgr2=0x7fa5b40d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:32.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.388+0000 7fa5bb46b640 1 -- 172.21.15.26:0/798037879 shutdown_connections 2023-10-14T11:14:32.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.388+0000 7fa5bb46b640 1 -- 172.21.15.26:0/798037879 wait complete. 2023-10-14T11:14:32.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.388+0000 7fa5bb46b640 1 Processor -- start 2023-10-14T11:14:32.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.388+0000 7fa5bb46b640 1 -- start start 2023-10-14T11:14:32.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.388+0000 7fa5bb46b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5b40c6ad0 0x7fa5b40affc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:32.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.388+0000 7fa5bb46b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5b40cf090 0x7fa5b4153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:32.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.388+0000 7fa5bb46b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5b415ca70 0x7fa5b40cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:32.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.388+0000 7fa5bb46b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40ca870 con 0x7fa5b415ca70 2023-10-14T11:14:32.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.388+0000 7fa5bb46b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40cb0a0 con 0x7fa5b40c6ad0 2023-10-14T11:14:32.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.388+0000 7fa5bb46b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40cc6a0 con 0x7fa5b40cf090 2023-10-14T11:14:32.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.392+0000 7fa5b9a08640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5b415ca70 0x7fa5b40cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:32.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.392+0000 7fa5b9a08640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5b415ca70 0x7fa5b40cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42792/0 (socket says 172.21.15.26:42792) 2023-10-14T11:14:32.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.392+0000 7fa5b9a08640 1 -- 172.21.15.26:0/2473909774 learned_addr learned my addr 172.21.15.26:0/2473909774 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:32.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.392+0000 7fa5b9207640 1 --2- 172.21.15.26:0/2473909774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5b40c6ad0 0x7fa5b40affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:32.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.392+0000 7fa5b8a06640 1 --2- 172.21.15.26:0/2473909774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5b40cf090 0x7fa5b4153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:32.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.392+0000 7fa5b9a08640 1 -- 172.21.15.26:0/2473909774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5b40cf090 msgr2=0x7fa5b4153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:32.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.392+0000 7fa5b9a08640 1 --2- 172.21.15.26:0/2473909774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5b40cf090 0x7fa5b4153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:32.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.392+0000 7fa5b9a08640 1 -- 172.21.15.26:0/2473909774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5b40c6ad0 msgr2=0x7fa5b40affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:32.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.392+0000 7fa5b9a08640 1 --2- 172.21.15.26:0/2473909774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5b40c6ad0 0x7fa5b40affc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:32.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.392+0000 7fa5b9a08640 1 -- 172.21.15.26:0/2473909774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a4009420 con 0x7fa5b415ca70 2023-10-14T11:14:32.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.392+0000 7fa5b9a08640 1 --2- 172.21.15.26:0/2473909774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5b415ca70 0x7fa5b40cb530 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac00b970 tx=0x7fa5ac00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:32.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.392+0000 7fa5a9ffb640 1 -- 172.21.15.26:0/2473909774 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac00cb40 con 0x7fa5b415ca70 2023-10-14T11:14:32.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.392+0000 7fa5a9ffb640 1 -- 172.21.15.26:0/2473909774 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac00cca0 con 0x7fa5b415ca70 2023-10-14T11:14:32.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.392+0000 7fa5a9ffb640 1 -- 172.21.15.26:0/2473909774 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac014680 con 0x7fa5b415ca70 2023-10-14T11:14:32.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.392+0000 7fa5bb46b640 1 -- 172.21.15.26:0/2473909774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b40d38a0 con 0x7fa5b415ca70 2023-10-14T11:14:32.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.392+0000 7fa5bb46b640 1 -- 172.21.15.26:0/2473909774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b40caa50 con 0x7fa5b415ca70 2023-10-14T11:14:32.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.392+0000 7fa5bb46b640 1 -- 172.21.15.26:0/2473909774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b4074010 con 0x7fa5b415ca70 2023-10-14T11:14:32.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.392+0000 7fa5a9ffb640 1 -- 172.21.15.26:0/2473909774 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa5ac01d3b0 con 0x7fa5b415ca70 2023-10-14T11:14:32.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.396+0000 7fa5a9ffb640 1 --2- 172.21.15.26:0/2473909774 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5980664a0 0x7fa598068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:32.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.396+0000 7fa5a9ffb640 1 -- 172.21.15.26:0/2473909774 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7fa5ac083f30 con 0x7fa5b415ca70 2023-10-14T11:14:32.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.396+0000 7fa5b9207640 1 --2- 172.21.15.26:0/2473909774 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5980664a0 0x7fa598068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:32.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.396+0000 7fa5b9207640 1 --2- 172.21.15.26:0/2473909774 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5980664a0 0x7fa598068960 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40ce9a0 tx=0x7fa5b0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:32.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.400+0000 7fa5a9ffb640 1 -- 172.21.15.26:0/2473909774 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa5ac051170 con 0x7fa5b415ca70 2023-10-14T11:14:32.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.592+0000 7fa5bb46b640 1 -- 172.21.15.26:0/2473909774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5b40cb1e0 con 0x7fa5b415ca70 2023-10-14T11:14:32.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.592+0000 7fa5a9ffb640 1 -- 172.21.15.26:0/2473909774 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4923 (secure 0 0 0) 0x7fa5ac054790 con 0x7fa5b415ca70 2023-10-14T11:14:32.597 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:32.597 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5425,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/1669994220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1669994220},{"type":"v1","addr":"172.21.15.110:6834","nonce":1669994220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3054425791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3054425791},{"type":"v1","addr":"172.21.15.110:6835","nonce":3054425791}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5434,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3759640340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3759640340},{"type":"v1","addr":"172.21.15.26:6837","nonce":3759640340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:13:50.622103+0000","modified":"2023-10-14T11:13:59.658132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5493":{"gid":5493,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/812681761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":812681761},{"type":"v1","addr":"172.21.15.26:6835","nonce":812681761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T11:14:32.597 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 18 2023-10-14T11:14:32.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.592+0000 7fa5bb46b640 1 -- 172.21.15.26:0/2473909774 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5980664a0 msgr2=0x7fa598068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:32.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.592+0000 7fa5bb46b640 1 --2- 172.21.15.26:0/2473909774 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5980664a0 0x7fa598068960 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40ce9a0 tx=0x7fa5b0009040 comp rx=0 tx=0).stop 2023-10-14T11:14:32.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.592+0000 7fa5bb46b640 1 -- 172.21.15.26:0/2473909774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5b415ca70 msgr2=0x7fa5b40cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:32.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.592+0000 7fa5bb46b640 1 --2- 172.21.15.26:0/2473909774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5b415ca70 0x7fa5b40cb530 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac00b970 tx=0x7fa5ac00be30 comp rx=0 tx=0).stop 2023-10-14T11:14:32.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.592+0000 7fa5bb46b640 1 -- 172.21.15.26:0/2473909774 shutdown_connections 2023-10-14T11:14:32.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.592+0000 7fa5bb46b640 1 --2- 172.21.15.26:0/2473909774 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa5980664a0 0x7fa598068960 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:32.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.592+0000 7fa5bb46b640 1 --2- 172.21.15.26:0/2473909774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5b415ca70 0x7fa5b40cb530 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:32.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.592+0000 7fa5bb46b640 1 --2- 172.21.15.26:0/2473909774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5b40cf090 0x7fa5b4153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:32.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.592+0000 7fa5bb46b640 1 --2- 172.21.15.26:0/2473909774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5b40c6ad0 0x7fa5b40affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:32.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.592+0000 7fa5bb46b640 1 -- 172.21.15.26:0/2473909774 >> 172.21.15.26:0/2473909774 conn(0x7fa5b409bc50 msgr2=0x7fa5b406c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:32.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.592+0000 7fa5bb46b640 1 -- 172.21.15.26:0/2473909774 shutdown_connections 2023-10-14T11:14:32.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.592+0000 7fa5bb46b640 1 -- 172.21.15.26:0/2473909774 wait complete. 2023-10-14T11:14:32.619 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:14:32.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.756+0000 7fc21d565640 1 Processor -- start 2023-10-14T11:14:32.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.756+0000 7fc21d565640 1 -- start start 2023-10-14T11:14:32.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.756+0000 7fc21d565640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc21815cd10 0x7fc21815de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:32.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.756+0000 7fc21d565640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc21806a340 0x7fc218071990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:32.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.756+0000 7fc21d565640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21815e390 con 0x7fc218069e90 2023-10-14T11:14:32.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.756+0000 7fc21d565640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc218161990 con 0x7fc21815cd10 2023-10-14T11:14:32.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.756+0000 7fc21d565640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2180ca150 con 0x7fc21806a340 2023-10-14T11:14:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.760+0000 7fc216ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc21815cd10 0x7fc21815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.760+0000 7fc20ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc218069e90 0x7fc218071280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36526/0 (socket says 172.21.15.26:36526) 2023-10-14T11:14:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.760+0000 7fc20ffff640 1 -- 172.21.15.26:0/165574069 learned_addr learned my addr 172.21.15.26:0/165574069 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.760+0000 7fc2177fe640 1 --2- 172.21.15.26:0/165574069 >> v2:172.21.15.110:3300/0 conn(0x7fc21806a340 0x7fc218071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.760+0000 7fc216ffd640 1 -- 172.21.15.26:0/165574069 >> v2:172.21.15.110:3300/0 conn(0x7fc21806a340 msgr2=0x7fc218071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:32.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.760+0000 7fc216ffd640 1 --2- 172.21.15.26:0/165574069 >> v2:172.21.15.110:3300/0 conn(0x7fc21806a340 0x7fc218071990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:32.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.760+0000 7fc216ffd640 1 -- 172.21.15.26:0/165574069 >> v1:172.21.15.26:6789/0 conn(0x7fc218069e90 legacy=0x7fc218071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:32.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.760+0000 7fc216ffd640 1 -- 172.21.15.26:0/165574069 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21806a790 con 0x7fc21815cd10 2023-10-14T11:14:32.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.760+0000 7fc216ffd640 1 --2- 172.21.15.26:0/165574069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21815cd10 0x7fc21815de50 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc2180b1580 tx=0x7fc20801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b9b879c516cfca server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:32.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.760+0000 7fc2167fc640 1 -- 172.21.15.26:0/165574069 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2080ab660 con 0x7fc21815cd10 2023-10-14T11:14:32.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.760+0000 7fc2167fc640 1 -- 172.21.15.26:0/165574069 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2080ab7c0 con 0x7fc21815cd10 2023-10-14T11:14:32.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.760+0000 7fc2167fc640 1 -- 172.21.15.26:0/165574069 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2080abb50 con 0x7fc21815cd10 2023-10-14T11:14:32.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc21d565640 1 -- 172.21.15.26:0/165574069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21815cd10 msgr2=0x7fc21815de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:32.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc21d565640 1 --2- 172.21.15.26:0/165574069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21815cd10 0x7fc21815de50 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc2180b1580 tx=0x7fc20801c460 comp rx=0 tx=0).stop 2023-10-14T11:14:32.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc21d565640 1 -- 172.21.15.26:0/165574069 shutdown_connections 2023-10-14T11:14:32.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc21d565640 1 --2- 172.21.15.26:0/165574069 >> v2:172.21.15.110:3300/0 conn(0x7fc21806a340 0x7fc218071990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:32.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc21d565640 1 --2- 172.21.15.26:0/165574069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21815cd10 0x7fc21815de50 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:32.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc21d565640 1 -- 172.21.15.26:0/165574069 >> 172.21.15.26:0/165574069 conn(0x7fc21806d310 msgr2=0x7fc21806d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:32.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc21d565640 1 -- 172.21.15.26:0/165574069 shutdown_connections 2023-10-14T11:14:32.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc21d565640 1 -- 172.21.15.26:0/165574069 wait complete. 2023-10-14T11:14:32.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc21d565640 1 Processor -- start 2023-10-14T11:14:32.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc21d565640 1 -- start start 2023-10-14T11:14:32.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc21d565640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc218069e90 0x7fc2180b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:32.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc21d565640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21806a340 0x7fc2180c31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:32.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc21d565640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc21815cd10 0x7fc2180c3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:32.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc21d565640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2181537d0 con 0x7fc21806a340 2023-10-14T11:14:32.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc21d565640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2180b0170 con 0x7fc21815cd10 2023-10-14T11:14:32.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc21d565640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21815a9b0 con 0x7fc218069e90 2023-10-14T11:14:32.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc20ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21806a340 0x7fc2180c31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:32.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc20ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21806a340 0x7fc2180c31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42812/0 (socket says 172.21.15.26:42812) 2023-10-14T11:14:32.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc20ffff640 1 -- 172.21.15.26:0/2095645653 learned_addr learned my addr 172.21.15.26:0/2095645653 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:32.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc216ffd640 1 --2- 172.21.15.26:0/2095645653 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc218069e90 0x7fc2180b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:32.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc2177fe640 1 --2- 172.21.15.26:0/2095645653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc21815cd10 0x7fc2180c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:32.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc20ffff640 1 -- 172.21.15.26:0/2095645653 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc218069e90 msgr2=0x7fc2180b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:32.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc20ffff640 1 --2- 172.21.15.26:0/2095645653 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc218069e90 0x7fc2180b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:32.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc20ffff640 1 -- 172.21.15.26:0/2095645653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc21815cd10 msgr2=0x7fc2180c3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:32.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc20ffff640 1 --2- 172.21.15.26:0/2095645653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc21815cd10 0x7fc2180c3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:32.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc20ffff640 1 -- 172.21.15.26:0/2095645653 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc208009420 con 0x7fc21806a340 2023-10-14T11:14:32.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.764+0000 7fc2177fe640 1 --2- 172.21.15.26:0/2095645653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc21815cd10 0x7fc2180c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:32.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.768+0000 7fc20ffff640 1 --2- 172.21.15.26:0/2095645653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21806a340 0x7fc2180c31c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc20000c400 tx=0x7fc20000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:32.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.768+0000 7fc20f7fe640 1 -- 172.21.15.26:0/2095645653 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc200005cf0 con 0x7fc21806a340 2023-10-14T11:14:32.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.768+0000 7fc20f7fe640 1 -- 172.21.15.26:0/2095645653 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc200005e50 con 0x7fc21806a340 2023-10-14T11:14:32.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.768+0000 7fc20f7fe640 1 -- 172.21.15.26:0/2095645653 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2000072d0 con 0x7fc21806a340 2023-10-14T11:14:32.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.768+0000 7fc21d565640 1 -- 172.21.15.26:0/2095645653 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21815ac90 con 0x7fc21806a340 2023-10-14T11:14:32.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.768+0000 7fc21d565640 1 -- 172.21.15.26:0/2095645653 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2180afaf0 con 0x7fc21806a340 2023-10-14T11:14:32.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.768+0000 7fc21d565640 1 -- 172.21.15.26:0/2095645653 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21815ae80 con 0x7fc21806a340 2023-10-14T11:14:32.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.768+0000 7fc20f7fe640 1 -- 172.21.15.26:0/2095645653 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc200007430 con 0x7fc21806a340 2023-10-14T11:14:32.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.768+0000 7fc20f7fe640 1 --2- 172.21.15.26:0/2095645653 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc1f80664a0 0x7fc1f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:32.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.768+0000 7fc20f7fe640 1 -- 172.21.15.26:0/2095645653 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7fc200083600 con 0x7fc21806a340 2023-10-14T11:14:32.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.768+0000 7fc216ffd640 1 --2- 172.21.15.26:0/2095645653 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc1f80664a0 0x7fc1f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:32.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.772+0000 7fc216ffd640 1 --2- 172.21.15.26:0/2095645653 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc1f80664a0 0x7fc1f8068960 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc2080af000 tx=0x7fc2080a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:32.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.772+0000 7fc20f7fe640 1 -- 172.21.15.26:0/2095645653 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc21815ae80 con 0x7fc21806a340 2023-10-14T11:14:32.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.936+0000 7fc21d565640 1 -- 172.21.15.26:0/2095645653 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc21815ae80 con 0x7fc21806a340 2023-10-14T11:14:32.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.936+0000 7fc20f7fe640 1 -- 172.21.15.26:0/2095645653 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18578 (secure 0 0 0) 0x7fc21815ae80 con 0x7fc21806a340 2023-10-14T11:14:32.942 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:32.943 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":42,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:14:01.292164+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:13:48.453821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:13:49.623527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-10-14T11:13:59.245615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:14:32.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.940+0000 7fc21d565640 1 -- 172.21.15.26:0/2095645653 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc1f80664a0 msgr2=0x7fc1f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:32.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.940+0000 7fc21d565640 1 --2- 172.21.15.26:0/2095645653 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc1f80664a0 0x7fc1f8068960 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc2080af000 tx=0x7fc2080a7000 comp rx=0 tx=0).stop 2023-10-14T11:14:32.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.940+0000 7fc21d565640 1 -- 172.21.15.26:0/2095645653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21806a340 msgr2=0x7fc2180c31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:32.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.940+0000 7fc21d565640 1 --2- 172.21.15.26:0/2095645653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21806a340 0x7fc2180c31c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc20000c400 tx=0x7fc20000c8c0 comp rx=0 tx=0).stop 2023-10-14T11:14:32.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.940+0000 7fc21d565640 1 -- 172.21.15.26:0/2095645653 shutdown_connections 2023-10-14T11:14:32.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.940+0000 7fc21d565640 1 --2- 172.21.15.26:0/2095645653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc21815cd10 0x7fc2180c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:32.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.940+0000 7fc21d565640 1 --2- 172.21.15.26:0/2095645653 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc1f80664a0 0x7fc1f8068960 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:32.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.940+0000 7fc21d565640 1 --2- 172.21.15.26:0/2095645653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21806a340 0x7fc2180c31c0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:32.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.940+0000 7fc21d565640 1 --2- 172.21.15.26:0/2095645653 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc218069e90 0x7fc2180b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:32.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.940+0000 7fc21d565640 1 -- 172.21.15.26:0/2095645653 >> 172.21.15.26:0/2095645653 conn(0x7fc21806d310 msgr2=0x7fc2180cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:32.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.940+0000 7fc21d565640 1 -- 172.21.15.26:0/2095645653 shutdown_connections 2023-10-14T11:14:32.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:32.940+0000 7fc21d565640 1 -- 172.21.15.26:0/2095645653 wait complete. 2023-10-14T11:14:32.964 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'testcephfs1_metadata', 'create_time': '2023-10-14T11:13:48.453821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'testcephfs1_data', 'create_time': '2023-10-14T11:13:49.623527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-10-14T11:13:59.245615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:14:32.965 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:14:33.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.104+0000 7f664c99d640 1 Processor -- start 2023-10-14T11:14:33.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f664c99d640 1 -- start start 2023-10-14T11:14:33.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f664c99d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f664806a5a0 0x7f664806e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:33.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f664c99d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66480b4370 con 0x7f6648159900 2023-10-14T11:14:33.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f664c99d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66480b4600 con 0x7f66480b3f00 2023-10-14T11:14:33.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f664c99d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66480cd740 con 0x7f664806a5a0 2023-10-14T11:14:33.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f664659c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6648159900 0x7f6648069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36528/0 (socket says 172.21.15.26:36528) 2023-10-14T11:14:33.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f664659c640 1 -- 172.21.15.26:0/2954193822 learned_addr learned my addr 172.21.15.26:0/2954193822 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:33.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f6645d9b640 1 -- 172.21.15.26:0/2954193822 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 866007181 0 0) 0x7f66480b4370 con 0x7f6648159900 2023-10-14T11:14:33.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f6645d9b640 1 -- 172.21.15.26:0/2954193822 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6634003530 con 0x7f6648159900 2023-10-14T11:14:33.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f663ffff640 1 --2- 172.21.15.26:0/2954193822 >> v2:172.21.15.110:3300/0 conn(0x7f664806a5a0 0x7f664806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:33.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f6645d9b640 1 -- 172.21.15.26:0/2954193822 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3302212242 0 0) 0x7f6634003530 con 0x7f6648159900 2023-10-14T11:14:33.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f6645d9b640 1 -- 172.21.15.26:0/2954193822 >> v2:172.21.15.110:3300/0 conn(0x7f664806a5a0 msgr2=0x7f664806e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:33.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f6645d9b640 1 --2- 172.21.15.26:0/2954193822 >> v2:172.21.15.110:3300/0 conn(0x7f664806a5a0 0x7f664806e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f6645d9b640 1 -- 172.21.15.26:0/2954193822 >> v1:172.21.15.110:6789/0 conn(0x7f66480b3f00 legacy=0x7f66480c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:33.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f6645d9b640 1 -- 172.21.15.26:0/2954193822 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66480c8dd0 con 0x7f6648159900 2023-10-14T11:14:33.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f6645d9b640 1 -- 172.21.15.26:0/2954193822 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f6638001680 con 0x7f6648159900 2023-10-14T11:14:33.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f6645d9b640 1 -- 172.21.15.26:0/2954193822 >> v1:172.21.15.26:6789/0 conn(0x7f6648159900 legacy=0x7f6648069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:33.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f6645d9b640 1 --2- 172.21.15.26:0/2954193822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6634003980 0x7f6634003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:33.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f6645d9b640 1 --2- 172.21.15.26:0/2954193822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66340047d0 0x7f6634004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:33.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f6645d9b640 1 --2- 172.21.15.26:0/2954193822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6634005190 0x7f663400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:33.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f6645d9b640 1 -- 172.21.15.26:0/2954193822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66480cd740 con 0x7f6634003980 2023-10-14T11:14:33.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f6645d9b640 1 -- 172.21.15.26:0/2954193822 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663400c030 con 0x7f66340047d0 2023-10-14T11:14:33.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f6645d9b640 1 -- 172.21.15.26:0/2954193822 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663400c1f0 con 0x7f6634005190 2023-10-14T11:14:33.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f664659c640 1 --2- 172.21.15.26:0/2954193822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6634003980 0x7f6634003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:33.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f663ffff640 1 --2- 172.21.15.26:0/2954193822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66340047d0 0x7f6634004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:33.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f6646d9d640 1 --2- 172.21.15.26:0/2954193822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6634005190 0x7f663400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:33.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f664659c640 1 -- 172.21.15.26:0/2954193822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6634005190 msgr2=0x7f663400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:33.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f664659c640 1 --2- 172.21.15.26:0/2954193822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6634005190 0x7f663400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f664659c640 1 -- 172.21.15.26:0/2954193822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66340047d0 msgr2=0x7f6634004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:33.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f664659c640 1 --2- 172.21.15.26:0/2954193822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66340047d0 0x7f6634004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f664659c640 1 -- 172.21.15.26:0/2954193822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6634003530 con 0x7f6634003980 2023-10-14T11:14:33.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.108+0000 7f6646d9d640 1 -- 172.21.15.26:0/2954193822 reap_dead start 2023-10-14T11:14:33.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.112+0000 7f664659c640 1 --2- 172.21.15.26:0/2954193822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6634003980 0x7f6634003da0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f663800c1c0 tx=0x7f663801cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2940681fe1e726dd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:33.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.112+0000 7f6645d9b640 1 -- 172.21.15.26:0/2954193822 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6638005ae0 con 0x7f6634003980 2023-10-14T11:14:33.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.112+0000 7f6645d9b640 1 -- 172.21.15.26:0/2954193822 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6638005c40 con 0x7f6634003980 2023-10-14T11:14:33.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.112+0000 7f6645d9b640 1 -- 172.21.15.26:0/2954193822 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66380a59f0 con 0x7f6634003980 2023-10-14T11:14:33.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.112+0000 7f664c99d640 1 -- 172.21.15.26:0/2954193822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6634003980 msgr2=0x7f6634003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:33.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.112+0000 7f664c99d640 1 --2- 172.21.15.26:0/2954193822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6634003980 0x7f6634003da0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f663800c1c0 tx=0x7f663801cbf0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.112+0000 7f664c99d640 1 -- 172.21.15.26:0/2954193822 shutdown_connections 2023-10-14T11:14:33.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.112+0000 7f664c99d640 1 --2- 172.21.15.26:0/2954193822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6634003980 0x7f6634003da0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.112+0000 7f664c99d640 1 -- 172.21.15.26:0/2954193822 >> 172.21.15.26:0/2954193822 conn(0x7f66480b0da0 msgr2=0x7f66480ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:33.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.112+0000 7f664c99d640 1 -- 172.21.15.26:0/2954193822 shutdown_connections 2023-10-14T11:14:33.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.112+0000 7f664c99d640 1 -- 172.21.15.26:0/2954193822 wait complete. 2023-10-14T11:14:33.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f664c99d640 1 Processor -- start 2023-10-14T11:14:33.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f664c99d640 1 -- start start 2023-10-14T11:14:33.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f664c99d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6634003980 0x7f66481565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:33.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f664c99d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66480c7270 0x7f66480ac940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:33.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f664c99d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66481f5be0 0x7f66481f6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:33.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f664c99d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6648157830 con 0x7f6634003980 2023-10-14T11:14:33.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f664c99d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66480c76f0 con 0x7f66480c7270 2023-10-14T11:14:33.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f664c99d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6648156bb0 con 0x7f66481f5be0 2023-10-14T11:14:33.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f664659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6634003980 0x7f66481565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:33.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f664659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6634003980 0x7f66481565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42842/0 (socket says 172.21.15.26:42842) 2023-10-14T11:14:33.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f664659c640 1 -- 172.21.15.26:0/354881787 learned_addr learned my addr 172.21.15.26:0/354881787 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:33.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f6646d9d640 1 --2- 172.21.15.26:0/354881787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66481f5be0 0x7f66481f6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:33.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f663ffff640 1 --2- 172.21.15.26:0/354881787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66480c7270 0x7f66480ac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:33.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f664659c640 1 -- 172.21.15.26:0/354881787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66481f5be0 msgr2=0x7f66481f6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:33.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f664659c640 1 --2- 172.21.15.26:0/354881787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66481f5be0 0x7f66481f6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f664659c640 1 -- 172.21.15.26:0/354881787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66480c7270 msgr2=0x7f66480ac940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:33.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f664659c640 1 --2- 172.21.15.26:0/354881787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66480c7270 0x7f66480ac940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f664659c640 1 -- 172.21.15.26:0/354881787 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6648156e90 con 0x7f6634003980 2023-10-14T11:14:33.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f664659c640 1 --2- 172.21.15.26:0/354881787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6634003980 0x7f66481565d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f663800c1c0 tx=0x7f6634005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:33.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f663effd640 1 -- 172.21.15.26:0/354881787 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66380b4070 con 0x7f6634003980 2023-10-14T11:14:33.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f663effd640 1 -- 172.21.15.26:0/354881787 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6638001440 con 0x7f6634003980 2023-10-14T11:14:33.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f664c99d640 1 -- 172.21.15.26:0/354881787 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6648157170 con 0x7f6634003980 2023-10-14T11:14:33.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f663effd640 1 -- 172.21.15.26:0/354881787 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66380a57b0 con 0x7f6634003980 2023-10-14T11:14:33.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.116+0000 7f664c99d640 1 -- 172.21.15.26:0/354881787 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66480ace80 con 0x7f6634003980 2023-10-14T11:14:33.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.120+0000 7f664c99d640 1 -- 172.21.15.26:0/354881787 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6648073010 con 0x7f6634003980 2023-10-14T11:14:33.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.120+0000 7f663effd640 1 -- 172.21.15.26:0/354881787 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f66380a5910 con 0x7f6634003980 2023-10-14T11:14:33.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.120+0000 7f663effd640 1 --2- 172.21.15.26:0/354881787 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6628066490 0x7f6628068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:33.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.120+0000 7f663effd640 1 -- 172.21.15.26:0/354881787 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f663811dde0 con 0x7f6634003980 2023-10-14T11:14:33.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.120+0000 7f663ffff640 1 --2- 172.21.15.26:0/354881787 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6628066490 0x7f6628068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:33.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.120+0000 7f663ffff640 1 --2- 172.21.15.26:0/354881787 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6628066490 0x7f6628068950 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f664814b3d0 tx=0x7f6630009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:33.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.124+0000 7f663effd640 1 -- 172.21.15.26:0/354881787 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f66380eaf60 con 0x7f6634003980 2023-10-14T11:14:33.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.280+0000 7f664c99d640 1 -- 172.21.15.26:0/354881787 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f664804e170 con 0x7f6634003980 2023-10-14T11:14:33.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.280+0000 7f663effd640 1 -- 172.21.15.26:0/354881787 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f66380ee580 con 0x7f6634003980 2023-10-14T11:14:33.286 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:14:33.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.280+0000 7f664c99d640 1 -- 172.21.15.26:0/354881787 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6628066490 msgr2=0x7f6628068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:33.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.280+0000 7f664c99d640 1 --2- 172.21.15.26:0/354881787 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6628066490 0x7f6628068950 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f664814b3d0 tx=0x7f6630009190 comp rx=0 tx=0).stop 2023-10-14T11:14:33.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.280+0000 7f664c99d640 1 -- 172.21.15.26:0/354881787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6634003980 msgr2=0x7f66481565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:33.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.280+0000 7f664c99d640 1 --2- 172.21.15.26:0/354881787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6634003980 0x7f66481565d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f663800c1c0 tx=0x7f6634005800 comp rx=0 tx=0).stop 2023-10-14T11:14:33.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.280+0000 7f664c99d640 1 -- 172.21.15.26:0/354881787 shutdown_connections 2023-10-14T11:14:33.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.280+0000 7f664c99d640 1 --2- 172.21.15.26:0/354881787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66481f5be0 0x7f66481f6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.280+0000 7f664c99d640 1 --2- 172.21.15.26:0/354881787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66480c7270 0x7f66480ac940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.280+0000 7f664c99d640 1 --2- 172.21.15.26:0/354881787 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6628066490 0x7f6628068950 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.280+0000 7f664c99d640 1 --2- 172.21.15.26:0/354881787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6634003980 0x7f66481565d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.280+0000 7f664c99d640 1 -- 172.21.15.26:0/354881787 >> 172.21.15.26:0/354881787 conn(0x7f66480b0da0 msgr2=0x7f66480c9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:33.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.284+0000 7f664c99d640 1 -- 172.21.15.26:0/354881787 shutdown_connections 2023-10-14T11:14:33.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.284+0000 7f664c99d640 1 -- 172.21.15.26:0/354881787 wait complete. 2023-10-14T11:14:33.307 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_metadata pg_num 2023-10-14T11:14:33.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.448+0000 7fa6aee32640 1 Processor -- start 2023-10-14T11:14:33.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.448+0000 7fa6aee32640 1 -- start start 2023-10-14T11:14:33.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.448+0000 7fa6aee32640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa6a806d010 0x7fa6a80c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:33.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.448+0000 7fa6aee32640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a815ae30 con 0x7fa6a80c26b0 2023-10-14T11:14:33.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.448+0000 7fa6aee32640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a80ca510 con 0x7fa6a8069e90 2023-10-14T11:14:33.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.448+0000 7fa6aee32640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a80cb090 con 0x7fa6a806d010 2023-10-14T11:14:33.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.448+0000 7fa6a7fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa6a806d010 0x7fa6a80c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:33.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.448+0000 7fa6a7fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa6a806d010 0x7fa6a80c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42850/0 (socket says 172.21.15.26:42850) 2023-10-14T11:14:33.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.448+0000 7fa6a7fff640 1 -- 172.21.15.26:0/481712339 learned_addr learned my addr 172.21.15.26:0/481712339 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:33.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.448+0000 7fa6ad3cf640 1 --1- 172.21.15.26:0/481712339 >> v1:172.21.15.26:6789/0 conn(0x7fa6a80c26b0 0x7fa6a80c2b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36534/0 (socket says 172.21.15.26:36534) 2023-10-14T11:14:33.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.448+0000 7fa6a7fff640 1 -- 172.21.15.26:0/481712339 >> v1:172.21.15.110:6789/0 conn(0x7fa6a8069e90 legacy=0x7fa6a806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:33.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.448+0000 7fa6a7fff640 1 -- 172.21.15.26:0/481712339 >> v1:172.21.15.26:6789/0 conn(0x7fa6a80c26b0 legacy=0x7fa6a80c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:33.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.448+0000 7fa6a7fff640 1 -- 172.21.15.26:0/481712339 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a80ca7f0 con 0x7fa6a806d010 2023-10-14T11:14:33.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.448+0000 7fa6a77fe640 1 -- 172.21.15.26:0/481712339 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 923805447 0 0) 0x7fa6a815ae30 con 0x7fa6a80c26b0 2023-10-14T11:14:33.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.452+0000 7fa6a7fff640 1 --2- 172.21.15.26:0/481712339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6a806d010 0x7fa6a80c9ce0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa694009870 tx=0x7fa69401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3cb881a7f83825 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:33.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.452+0000 7fa6a77fe640 1 -- 172.21.15.26:0/481712339 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6940a8a30 con 0x7fa6a806d010 2023-10-14T11:14:33.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.452+0000 7fa6a77fe640 1 -- 172.21.15.26:0/481712339 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6940a8b90 con 0x7fa6a806d010 2023-10-14T11:14:33.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.452+0000 7fa6a77fe640 1 -- 172.21.15.26:0/481712339 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6940b0440 con 0x7fa6a806d010 2023-10-14T11:14:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.452+0000 7fa6aee32640 1 -- 172.21.15.26:0/481712339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6a806d010 msgr2=0x7fa6a80c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.452+0000 7fa6aee32640 1 --2- 172.21.15.26:0/481712339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6a806d010 0x7fa6a80c9ce0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa694009870 tx=0x7fa69401ed30 comp rx=0 tx=0).stop 2023-10-14T11:14:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.452+0000 7fa6aee32640 1 -- 172.21.15.26:0/481712339 shutdown_connections 2023-10-14T11:14:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.452+0000 7fa6aee32640 1 --2- 172.21.15.26:0/481712339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6a806d010 0x7fa6a80c9ce0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.452+0000 7fa6aee32640 1 -- 172.21.15.26:0/481712339 >> 172.21.15.26:0/481712339 conn(0x7fa6a80b0da0 msgr2=0x7fa6a80ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:33.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.452+0000 7fa6aee32640 1 -- 172.21.15.26:0/481712339 shutdown_connections 2023-10-14T11:14:33.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.452+0000 7fa6aee32640 1 -- 172.21.15.26:0/481712339 wait complete. 2023-10-14T11:14:33.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6aee32640 1 Processor -- start 2023-10-14T11:14:33.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6aee32640 1 -- start start 2023-10-14T11:14:33.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6aee32640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6a8069e90 0x7fa6a815b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:33.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6aee32640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6a806d010 0x7fa6a8156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:33.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6aee32640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6a80c26b0 0x7fa6a815c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:33.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6aee32640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a80cc350 con 0x7fa6a80c26b0 2023-10-14T11:14:33.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6aee32640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a815d440 con 0x7fa6a8069e90 2023-10-14T11:14:33.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6aee32640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a815d720 con 0x7fa6a806d010 2023-10-14T11:14:33.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6ad3cf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6a80c26b0 0x7fa6a815c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:33.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6ad3cf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6a80c26b0 0x7fa6a815c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42852/0 (socket says 172.21.15.26:42852) 2023-10-14T11:14:33.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6ad3cf640 1 -- 172.21.15.26:0/2170783574 learned_addr learned my addr 172.21.15.26:0/2170783574 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:33.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6acbce640 1 --2- 172.21.15.26:0/2170783574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6a8069e90 0x7fa6a815b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:33.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6a7fff640 1 --2- 172.21.15.26:0/2170783574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6a806d010 0x7fa6a8156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:33.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6ad3cf640 1 -- 172.21.15.26:0/2170783574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6a806d010 msgr2=0x7fa6a8156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:33.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6ad3cf640 1 --2- 172.21.15.26:0/2170783574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6a806d010 0x7fa6a8156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6ad3cf640 1 -- 172.21.15.26:0/2170783574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6a8069e90 msgr2=0x7fa6a815b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:33.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6ad3cf640 1 --2- 172.21.15.26:0/2170783574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6a8069e90 0x7fa6a815b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6ad3cf640 1 -- 172.21.15.26:0/2170783574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6940094d0 con 0x7fa6a80c26b0 2023-10-14T11:14:33.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6ad3cf640 1 --2- 172.21.15.26:0/2170783574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6a80c26b0 0x7fa6a815c9f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000c700 tx=0x7fa6a000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:33.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6a57fa640 1 -- 172.21.15.26:0/2170783574 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a000ce10 con 0x7fa6a80c26b0 2023-10-14T11:14:33.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6a57fa640 1 -- 172.21.15.26:0/2170783574 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a000a640 con 0x7fa6a80c26b0 2023-10-14T11:14:33.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6a57fa640 1 -- 172.21.15.26:0/2170783574 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a000aa70 con 0x7fa6a80c26b0 2023-10-14T11:14:33.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6aee32640 1 -- 172.21.15.26:0/2170783574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a815da00 con 0x7fa6a80c26b0 2023-10-14T11:14:33.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.456+0000 7fa6aee32640 1 -- 172.21.15.26:0/2170783574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a815b550 con 0x7fa6a80c26b0 2023-10-14T11:14:33.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.460+0000 7fa6aee32640 1 -- 172.21.15.26:0/2170783574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a804e170 con 0x7fa6a80c26b0 2023-10-14T11:14:33.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.460+0000 7fa6a57fa640 1 -- 172.21.15.26:0/2170783574 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa6a000abd0 con 0x7fa6a80c26b0 2023-10-14T11:14:33.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.460+0000 7fa6a57fa640 1 --2- 172.21.15.26:0/2170783574 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa68c0664a0 0x7fa68c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:33.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.460+0000 7fa6a57fa640 1 -- 172.21.15.26:0/2170783574 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7fa6a0083530 con 0x7fa6a80c26b0 2023-10-14T11:14:33.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.460+0000 7fa6acbce640 1 --2- 172.21.15.26:0/2170783574 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa68c0664a0 0x7fa68c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:33.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.460+0000 7fa6acbce640 1 --2- 172.21.15.26:0/2170783574 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa68c0664a0 0x7fa68c068960 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80ce530 tx=0x7fa69c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:33.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.464+0000 7fa6a57fa640 1 -- 172.21.15.26:0/2170783574 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa6a00507e0 con 0x7fa6a80c26b0 2023-10-14T11:14:33.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.620+0000 7fa6aee32640 1 -- 172.21.15.26:0/2170783574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa6a80cc770 con 0x7fa6a80c26b0 2023-10-14T11:14:33.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.620+0000 7fa6a57fa640 1 -- 172.21.15.26:0/2170783574 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"}]=0 v42) v1 ==== 109+0+11 (secure 0 0 0) 0x7fa6a00180b0 con 0x7fa6a80c26b0 2023-10-14T11:14:33.627 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:14:33.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.624+0000 7fa6aee32640 1 -- 172.21.15.26:0/2170783574 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa68c0664a0 msgr2=0x7fa68c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:33.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.624+0000 7fa6aee32640 1 --2- 172.21.15.26:0/2170783574 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa68c0664a0 0x7fa68c068960 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80ce530 tx=0x7fa69c009040 comp rx=0 tx=0).stop 2023-10-14T11:14:33.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.624+0000 7fa6aee32640 1 -- 172.21.15.26:0/2170783574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6a80c26b0 msgr2=0x7fa6a815c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:33.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.624+0000 7fa6aee32640 1 --2- 172.21.15.26:0/2170783574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6a80c26b0 0x7fa6a815c9f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000c700 tx=0x7fa6a000cbc0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.624+0000 7fa6aee32640 1 -- 172.21.15.26:0/2170783574 shutdown_connections 2023-10-14T11:14:33.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.624+0000 7fa6aee32640 1 --2- 172.21.15.26:0/2170783574 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa68c0664a0 0x7fa68c068960 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.624+0000 7fa6aee32640 1 --2- 172.21.15.26:0/2170783574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6a80c26b0 0x7fa6a815c9f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.624+0000 7fa6aee32640 1 --2- 172.21.15.26:0/2170783574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6a806d010 0x7fa6a8156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.624+0000 7fa6aee32640 1 --2- 172.21.15.26:0/2170783574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6a8069e90 0x7fa6a815b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.624+0000 7fa6aee32640 1 -- 172.21.15.26:0/2170783574 >> 172.21.15.26:0/2170783574 conn(0x7fa6a80b0da0 msgr2=0x7fa6a80701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:33.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.624+0000 7fa6aee32640 1 -- 172.21.15.26:0/2170783574 shutdown_connections 2023-10-14T11:14:33.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.624+0000 7fa6aee32640 1 -- 172.21.15.26:0/2170783574 wait complete. 2023-10-14T11:14:33.648 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_data pg_num 2023-10-14T11:14:33.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.788+0000 7f7316691640 1 Processor -- start 2023-10-14T11:14:33.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.788+0000 7f7316691640 1 -- start start 2023-10-14T11:14:33.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.792+0000 7f7316691640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f731006a5a0 0x7f731006e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:33.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.792+0000 7f7316691640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f73100b3f00 0x7f73100c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:33.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.792+0000 7f7316691640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73100b4340 con 0x7f7310159900 2023-10-14T11:14:33.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.792+0000 7f7316691640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73100cd740 con 0x7f73100b3f00 2023-10-14T11:14:33.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.792+0000 7f7316691640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73100b4600 con 0x7f731006a5a0 2023-10-14T11:14:33.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.792+0000 7f730f7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f731006a5a0 0x7f731006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:33.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.792+0000 7f730f7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f731006a5a0 0x7f731006e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:50272/0 (socket says 172.21.15.26:50272) 2023-10-14T11:14:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.792+0000 7f730f7fe640 1 -- 172.21.15.26:0/2819707173 learned_addr learned my addr 172.21.15.26:0/2819707173 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.792+0000 7f7314c2e640 1 --2- 172.21.15.26:0/2819707173 >> v2:172.21.15.110:3300/0 conn(0x7f73100b3f00 0x7f73100c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.792+0000 7f730f7fe640 1 -- 172.21.15.26:0/2819707173 >> v2:172.21.15.110:3300/0 conn(0x7f73100b3f00 msgr2=0x7f73100c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.792+0000 7f730f7fe640 1 --2- 172.21.15.26:0/2819707173 >> v2:172.21.15.110:3300/0 conn(0x7f73100b3f00 0x7f73100c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.792+0000 7f730f7fe640 1 -- 172.21.15.26:0/2819707173 >> v1:172.21.15.110:6789/0 conn(0x7f7310159900 legacy=0x7f7310069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.792+0000 7f730f7fe640 1 -- 172.21.15.26:0/2819707173 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73100c8dd0 con 0x7f731006a5a0 2023-10-14T11:14:33.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.796+0000 7f730f7fe640 1 --2- 172.21.15.26:0/2819707173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f731006a5a0 0x7f731006e260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7304009870 tx=0x7f730401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7143226e1807fa38 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:33.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.796+0000 7f730effd640 1 -- 172.21.15.26:0/2819707173 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73040aa670 con 0x7f731006a5a0 2023-10-14T11:14:33.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.796+0000 7f730effd640 1 -- 172.21.15.26:0/2819707173 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73040aa7d0 con 0x7f731006a5a0 2023-10-14T11:14:33.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.796+0000 7f730effd640 1 -- 172.21.15.26:0/2819707173 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73040aab60 con 0x7f731006a5a0 2023-10-14T11:14:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.796+0000 7f7316691640 1 -- 172.21.15.26:0/2819707173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f731006a5a0 msgr2=0x7f731006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.796+0000 7f7316691640 1 --2- 172.21.15.26:0/2819707173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f731006a5a0 0x7f731006e260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7304009870 tx=0x7f730401c510 comp rx=0 tx=0).stop 2023-10-14T11:14:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.796+0000 7f7316691640 1 -- 172.21.15.26:0/2819707173 shutdown_connections 2023-10-14T11:14:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.796+0000 7f7316691640 1 --2- 172.21.15.26:0/2819707173 >> v2:172.21.15.110:3300/0 conn(0x7f73100b3f00 0x7f73100c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.796+0000 7f7316691640 1 --2- 172.21.15.26:0/2819707173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f731006a5a0 0x7f731006e260 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.796+0000 7f7316691640 1 -- 172.21.15.26:0/2819707173 >> 172.21.15.26:0/2819707173 conn(0x7f73100b0da0 msgr2=0x7f73100ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.796+0000 7f7316691640 1 -- 172.21.15.26:0/2819707173 shutdown_connections 2023-10-14T11:14:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.796+0000 7f7316691640 1 -- 172.21.15.26:0/2819707173 wait complete. 2023-10-14T11:14:33.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.796+0000 7f7316691640 1 Processor -- start 2023-10-14T11:14:33.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.796+0000 7f7316691640 1 -- start start 2023-10-14T11:14:33.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f7316691640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f731006a5a0 0x7f73100b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:33.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f7316691640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73100b3f00 0x7f731014ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:33.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f7316691640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7310159900 0x7f731015c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:33.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f7316691640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731014dfe0 con 0x7f7310159900 2023-10-14T11:14:33.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f7316691640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731014d3d0 con 0x7f731006a5a0 2023-10-14T11:14:33.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f7316691640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731014d6b0 con 0x7f73100b3f00 2023-10-14T11:14:33.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f7314c2e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7310159900 0x7f731015c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:33.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f7314c2e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7310159900 0x7f731015c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42854/0 (socket says 172.21.15.26:42854) 2023-10-14T11:14:33.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f7314c2e640 1 -- 172.21.15.26:0/942961471 learned_addr learned my addr 172.21.15.26:0/942961471 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:33.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f730ffff640 1 --2- 172.21.15.26:0/942961471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f731006a5a0 0x7f73100b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:33.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f730f7fe640 1 --2- 172.21.15.26:0/942961471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73100b3f00 0x7f731014ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:33.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f7314c2e640 1 -- 172.21.15.26:0/942961471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73100b3f00 msgr2=0x7f731014ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:33.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f7314c2e640 1 --2- 172.21.15.26:0/942961471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73100b3f00 0x7f731014ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f7314c2e640 1 -- 172.21.15.26:0/942961471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f731006a5a0 msgr2=0x7f73100b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:33.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f7314c2e640 1 --2- 172.21.15.26:0/942961471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f731006a5a0 0x7f73100b1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f7314c2e640 1 -- 172.21.15.26:0/942961471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73040094d0 con 0x7f7310159900 2023-10-14T11:14:33.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f7314c2e640 1 --2- 172.21.15.26:0/942961471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7310159900 0x7f731015c3c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f730800efc0 tx=0x7f730800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:33.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f730cff9640 1 -- 172.21.15.26:0/942961471 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7308014480 con 0x7f7310159900 2023-10-14T11:14:33.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f730cff9640 1 -- 172.21.15.26:0/942961471 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730800f040 con 0x7f7310159900 2023-10-14T11:14:33.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f730cff9640 1 -- 172.21.15.26:0/942961471 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7308014820 con 0x7f7310159900 2023-10-14T11:14:33.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f7316691640 1 -- 172.21.15.26:0/942961471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731014d990 con 0x7f7310159900 2023-10-14T11:14:33.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f7316691640 1 -- 172.21.15.26:0/942961471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731015c900 con 0x7f7310159900 2023-10-14T11:14:33.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f7316691640 1 -- 172.21.15.26:0/942961471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731014e150 con 0x7f7310159900 2023-10-14T11:14:33.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.800+0000 7f730cff9640 1 -- 172.21.15.26:0/942961471 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7308014980 con 0x7f7310159900 2023-10-14T11:14:33.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.804+0000 7f730cff9640 1 --2- 172.21.15.26:0/942961471 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f72fc0664a0 0x7f72fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:33.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.804+0000 7f730cff9640 1 -- 172.21.15.26:0/942961471 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f7308084d30 con 0x7f7310159900 2023-10-14T11:14:33.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.804+0000 7f730ffff640 1 --2- 172.21.15.26:0/942961471 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f72fc0664a0 0x7f72fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:33.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.804+0000 7f730ffff640 1 --2- 172.21.15.26:0/942961471 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f72fc0664a0 0x7f72fc068960 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7300007fd0 tx=0x7f7300009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:33.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.808+0000 7f730cff9640 1 -- 172.21.15.26:0/942961471 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7308051e40 con 0x7f7310159900 2023-10-14T11:14:33.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.964+0000 7f7316691640 1 -- 172.21.15.26:0/942961471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"} v 0) v1 -- 0x7f731004e170 con 0x7f7310159900 2023-10-14T11:14:33.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.964+0000 7f730cff9640 1 -- 172.21.15.26:0/942961471 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"}]=0 v42) v1 ==== 105+0+11 (secure 0 0 0) 0x7f7308018070 con 0x7f7310159900 2023-10-14T11:14:33.970 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:14:33.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.964+0000 7f7316691640 1 -- 172.21.15.26:0/942961471 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f72fc0664a0 msgr2=0x7f72fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:33.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.964+0000 7f7316691640 1 --2- 172.21.15.26:0/942961471 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f72fc0664a0 0x7f72fc068960 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7300007fd0 tx=0x7f7300009040 comp rx=0 tx=0).stop 2023-10-14T11:14:33.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.964+0000 7f7316691640 1 -- 172.21.15.26:0/942961471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7310159900 msgr2=0x7f731015c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:33.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.964+0000 7f7316691640 1 --2- 172.21.15.26:0/942961471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7310159900 0x7f731015c3c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f730800efc0 tx=0x7f730800c490 comp rx=0 tx=0).stop 2023-10-14T11:14:33.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.964+0000 7f7316691640 1 -- 172.21.15.26:0/942961471 shutdown_connections 2023-10-14T11:14:33.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.964+0000 7f7316691640 1 --2- 172.21.15.26:0/942961471 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f72fc0664a0 0x7f72fc068960 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.964+0000 7f7316691640 1 --2- 172.21.15.26:0/942961471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7310159900 0x7f731015c3c0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.964+0000 7f7316691640 1 --2- 172.21.15.26:0/942961471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73100b3f00 0x7f731014ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.964+0000 7f7316691640 1 --2- 172.21.15.26:0/942961471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f731006a5a0 0x7f73100b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:33.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.964+0000 7f7316691640 1 -- 172.21.15.26:0/942961471 >> 172.21.15.26:0/942961471 conn(0x7f73100b0da0 msgr2=0x7f7310158c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:33.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.968+0000 7f7316691640 1 -- 172.21.15.26:0/942961471 shutdown_connections 2023-10-14T11:14:33.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:33.968+0000 7f7316691640 1 -- 172.21.15.26:0/942961471 wait complete. 2023-10-14T11:14:33.991 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-10-14T11:14:34.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.132+0000 7f6849ff8640 1 Processor -- start 2023-10-14T11:14:34.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.132+0000 7f6849ff8640 1 -- start start 2023-10-14T11:14:34.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.132+0000 7f6849ff8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f68440b84e0 0x7f68440d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:34.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.132+0000 7f6849ff8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68440d1670 con 0x7f68440d0210 2023-10-14T11:14:34.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.132+0000 7f6849ff8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68440d1950 con 0x7f684415cba0 2023-10-14T11:14:34.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.132+0000 7f6849ff8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68440d1460 con 0x7f68440b84e0 2023-10-14T11:14:34.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.132+0000 7f6842ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f68440d0210 0x7f68440b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36542/0 (socket says 172.21.15.26:36542) 2023-10-14T11:14:34.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.132+0000 7f6842ffd640 1 -- 172.21.15.26:0/1746178186 learned_addr learned my addr 172.21.15.26:0/1746178186 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:34.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.132+0000 7f6843fff640 1 --2- 172.21.15.26:0/1746178186 >> v2:172.21.15.110:3300/0 conn(0x7f68440b84e0 0x7f68440d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:34.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.132+0000 7f68427fc640 1 -- 172.21.15.26:0/1746178186 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662549452 0 0) 0x7f68440d1670 con 0x7f68440d0210 2023-10-14T11:14:34.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.132+0000 7f68427fc640 1 -- 172.21.15.26:0/1746178186 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f682c003530 con 0x7f68440d0210 2023-10-14T11:14:34.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.132+0000 7f6843fff640 1 -- 172.21.15.26:0/1746178186 >> v1:172.21.15.110:6789/0 conn(0x7f684415cba0 legacy=0x7f68440cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:34.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.132+0000 7f6843fff640 1 -- 172.21.15.26:0/1746178186 >> v1:172.21.15.26:6789/0 conn(0x7f68440d0210 legacy=0x7f68440b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:34.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.132+0000 7f6843fff640 1 -- 172.21.15.26:0/1746178186 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68440d1c30 con 0x7f68440b84e0 2023-10-14T11:14:34.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.136+0000 7f6843fff640 1 --2- 172.21.15.26:0/1746178186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68440b84e0 0x7f68440d0f20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f683c009d90 tx=0x7f683c01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d2e1597045f23f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:34.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.136+0000 7f68427fc640 1 -- 172.21.15.26:0/1746178186 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c0a5980 con 0x7f68440b84e0 2023-10-14T11:14:34.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.136+0000 7f68427fc640 1 -- 172.21.15.26:0/1746178186 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683c0a5ae0 con 0x7f68440b84e0 2023-10-14T11:14:34.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.136+0000 7f68427fc640 1 -- 172.21.15.26:0/1746178186 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c0a5e70 con 0x7f68440b84e0 2023-10-14T11:14:34.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.136+0000 7f6849ff8640 1 -- 172.21.15.26:0/1746178186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68440b84e0 msgr2=0x7f68440d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:34.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.136+0000 7f6849ff8640 1 --2- 172.21.15.26:0/1746178186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68440b84e0 0x7f68440d0f20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f683c009d90 tx=0x7f683c01c8c0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.136+0000 7f6849ff8640 1 -- 172.21.15.26:0/1746178186 shutdown_connections 2023-10-14T11:14:34.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.136+0000 7f6849ff8640 1 --2- 172.21.15.26:0/1746178186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68440b84e0 0x7f68440d0f20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.136+0000 7f6849ff8640 1 -- 172.21.15.26:0/1746178186 >> 172.21.15.26:0/1746178186 conn(0x7f68440719c0 msgr2=0x7f6844071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:34.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.136+0000 7f6849ff8640 1 -- 172.21.15.26:0/1746178186 shutdown_connections 2023-10-14T11:14:34.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.136+0000 7f6849ff8640 1 -- 172.21.15.26:0/1746178186 wait complete. 2023-10-14T11:14:34.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f6849ff8640 1 Processor -- start 2023-10-14T11:14:34.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f6849ff8640 1 -- start start 2023-10-14T11:14:34.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f6849ff8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68440b84e0 0x7f684414c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:34.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f6849ff8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68440d0210 0x7f6844159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:34.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f6849ff8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f684415cba0 0x7f6844159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:34.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f6849ff8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684414c840 con 0x7f684415cba0 2023-10-14T11:14:34.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f6849ff8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68441509f0 con 0x7f68440d0210 2023-10-14T11:14:34.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f6849ff8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68440b1cd0 con 0x7f68440b84e0 2023-10-14T11:14:34.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f6843fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f684415cba0 0x7f6844159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:34.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f6843fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f684415cba0 0x7f6844159880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42858/0 (socket says 172.21.15.26:42858) 2023-10-14T11:14:34.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f6843fff640 1 -- 172.21.15.26:0/2121734383 learned_addr learned my addr 172.21.15.26:0/2121734383 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:34.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f6842ffd640 1 --2- 172.21.15.26:0/2121734383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68440d0210 0x7f6844159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:34.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f68437fe640 1 --2- 172.21.15.26:0/2121734383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68440b84e0 0x7f684414c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:34.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f6843fff640 1 -- 172.21.15.26:0/2121734383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68440b84e0 msgr2=0x7f684414c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:34.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f6843fff640 1 --2- 172.21.15.26:0/2121734383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68440b84e0 0x7f684414c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f6843fff640 1 -- 172.21.15.26:0/2121734383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68440d0210 msgr2=0x7f6844159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:34.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f6843fff640 1 --2- 172.21.15.26:0/2121734383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68440d0210 0x7f6844159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f6843fff640 1 -- 172.21.15.26:0/2121734383 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f683c009a70 con 0x7f684415cba0 2023-10-14T11:14:34.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f68437fe640 1 --2- 172.21.15.26:0/2121734383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68440b84e0 0x7f684414c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:34.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f6843fff640 1 --2- 172.21.15.26:0/2121734383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f684415cba0 0x7f6844159880 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f683c0b0040 tx=0x7f683c019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:34.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f682bfff640 1 -- 172.21.15.26:0/2121734383 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c0b9860 con 0x7f684415cba0 2023-10-14T11:14:34.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f682bfff640 1 -- 172.21.15.26:0/2121734383 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683c0b99c0 con 0x7f684415cba0 2023-10-14T11:14:34.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f682bfff640 1 -- 172.21.15.26:0/2121734383 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c0b9d30 con 0x7f684415cba0 2023-10-14T11:14:34.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f6849ff8640 1 -- 172.21.15.26:0/2121734383 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684414fde0 con 0x7f684415cba0 2023-10-14T11:14:34.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.140+0000 7f6849ff8640 1 -- 172.21.15.26:0/2121734383 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68441503a0 con 0x7f684415cba0 2023-10-14T11:14:34.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.144+0000 7f6849ff8640 1 -- 172.21.15.26:0/2121734383 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6844154170 con 0x7f684415cba0 2023-10-14T11:14:34.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.144+0000 7f682bfff640 1 -- 172.21.15.26:0/2121734383 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f683c0ad440 con 0x7f684415cba0 2023-10-14T11:14:34.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.144+0000 7f682bfff640 1 --2- 172.21.15.26:0/2121734383 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f68300664a0 0x7f6830068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:34.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.144+0000 7f682bfff640 1 -- 172.21.15.26:0/2121734383 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f683c11f300 con 0x7f684415cba0 2023-10-14T11:14:34.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.144+0000 7f68437fe640 1 --2- 172.21.15.26:0/2121734383 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f68300664a0 0x7f6830068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:34.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.144+0000 7f68437fe640 1 --2- 172.21.15.26:0/2121734383 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f68300664a0 0x7f6830068960 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6834000f70 tx=0x7f6834009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:34.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.148+0000 7f682bfff640 1 -- 172.21.15.26:0/2121734383 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f683c0ec520 con 0x7f684415cba0 2023-10-14T11:14:34.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.304+0000 7f6849ff8640 1 -- 172.21.15.26:0/2121734383 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f684404e170 con 0x7f684415cba0 2023-10-14T11:14:34.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.304+0000 7f682bfff640 1 -- 172.21.15.26:0/2121734383 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v42) v1 ==== 97+0+11 (secure 0 0 0) 0x7f683c0efb40 con 0x7f684415cba0 2023-10-14T11:14:34.311 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:14:34.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.308+0000 7f6849ff8640 1 -- 172.21.15.26:0/2121734383 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f68300664a0 msgr2=0x7f6830068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:34.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.308+0000 7f6849ff8640 1 --2- 172.21.15.26:0/2121734383 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f68300664a0 0x7f6830068960 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6834000f70 tx=0x7f6834009040 comp rx=0 tx=0).stop 2023-10-14T11:14:34.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.308+0000 7f6849ff8640 1 -- 172.21.15.26:0/2121734383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f684415cba0 msgr2=0x7f6844159880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:34.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.308+0000 7f6849ff8640 1 --2- 172.21.15.26:0/2121734383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f684415cba0 0x7f6844159880 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f683c0b0040 tx=0x7f683c019660 comp rx=0 tx=0).stop 2023-10-14T11:14:34.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.308+0000 7f6849ff8640 1 -- 172.21.15.26:0/2121734383 shutdown_connections 2023-10-14T11:14:34.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.308+0000 7f6849ff8640 1 --2- 172.21.15.26:0/2121734383 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f68300664a0 0x7f6830068960 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.308+0000 7f6849ff8640 1 --2- 172.21.15.26:0/2121734383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f684415cba0 0x7f6844159880 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.308+0000 7f6849ff8640 1 --2- 172.21.15.26:0/2121734383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68440d0210 0x7f6844159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.308+0000 7f6849ff8640 1 --2- 172.21.15.26:0/2121734383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68440b84e0 0x7f684414c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.308+0000 7f6849ff8640 1 -- 172.21.15.26:0/2121734383 >> 172.21.15.26:0/2121734383 conn(0x7f68440719c0 msgr2=0x7f68440cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:34.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.308+0000 7f6849ff8640 1 -- 172.21.15.26:0/2121734383 shutdown_connections 2023-10-14T11:14:34.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.308+0000 7f6849ff8640 1 -- 172.21.15.26:0/2121734383 wait complete. 2023-10-14T11:14:34.332 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:14:34.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.468+0000 7f678b73e640 1 Processor -- start 2023-10-14T11:14:34.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.468+0000 7f678b73e640 1 -- start start 2023-10-14T11:14:34.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.472+0000 7f678b73e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6784164520 0x7f67840ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:34.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.472+0000 7f678b73e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67840b07f0 0x7f67840cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:34.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.472+0000 7f678b73e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67840c96f0 con 0x7f67840ad960 2023-10-14T11:14:34.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.472+0000 7f678b73e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6784164900 con 0x7f6784164520 2023-10-14T11:14:34.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.472+0000 7f678b73e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67840cb950 con 0x7f67840b07f0 2023-10-14T11:14:34.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.472+0000 7f67894da640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6784164520 0x7f67840ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:34.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.472+0000 7f67894da640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6784164520 0x7f67840ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42860/0 (socket says 172.21.15.26:42860) 2023-10-14T11:14:34.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.472+0000 7f67894da640 1 -- 172.21.15.26:0/347211388 learned_addr learned my addr 172.21.15.26:0/347211388 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:34.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.472+0000 7f6789cdb640 1 --2- 172.21.15.26:0/347211388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67840b07f0 0x7f67840cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:34.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.472+0000 7f67894da640 1 -- 172.21.15.26:0/347211388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67840b07f0 msgr2=0x7f67840cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:34.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.472+0000 7f67894da640 1 --2- 172.21.15.26:0/347211388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67840b07f0 0x7f67840cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.472+0000 7f67894da640 1 -- 172.21.15.26:0/347211388 >> v1:172.21.15.110:6789/0 conn(0x7f67840ad960 legacy=0x7f67840b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:34.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.472+0000 7f677bfff640 1 -- 172.21.15.26:0/347211388 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900710773 0 0) 0x7f67840c96f0 con 0x7f67840ad960 2023-10-14T11:14:34.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.472+0000 7f67894da640 1 -- 172.21.15.26:0/347211388 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67840cbed0 con 0x7f6784164520 2023-10-14T11:14:34.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.476+0000 7f67894da640 1 --2- 172.21.15.26:0/347211388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6784164520 0x7f67840ce010 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6780009870 tx=0x7f678001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba28cdeeb12fa03b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:34.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.476+0000 7f677bfff640 1 -- 172.21.15.26:0/347211388 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67800a95f0 con 0x7f6784164520 2023-10-14T11:14:34.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.476+0000 7f677bfff640 1 -- 172.21.15.26:0/347211388 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67800a9750 con 0x7f6784164520 2023-10-14T11:14:34.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.476+0000 7f677bfff640 1 -- 172.21.15.26:0/347211388 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67800a9ae0 con 0x7f6784164520 2023-10-14T11:14:34.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.476+0000 7f678b73e640 1 -- 172.21.15.26:0/347211388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6784164520 msgr2=0x7f67840ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:34.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.476+0000 7f678b73e640 1 --2- 172.21.15.26:0/347211388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6784164520 0x7f67840ce010 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6780009870 tx=0x7f678001c510 comp rx=0 tx=0).stop 2023-10-14T11:14:34.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.476+0000 7f678b73e640 1 -- 172.21.15.26:0/347211388 shutdown_connections 2023-10-14T11:14:34.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.476+0000 7f678b73e640 1 --2- 172.21.15.26:0/347211388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67840b07f0 0x7f67840cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.476+0000 7f678b73e640 1 --2- 172.21.15.26:0/347211388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6784164520 0x7f67840ce010 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.476+0000 7f678b73e640 1 -- 172.21.15.26:0/347211388 >> 172.21.15.26:0/347211388 conn(0x7f678406c190 msgr2=0x7f678406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:34.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.476+0000 7f678b73e640 1 -- 172.21.15.26:0/347211388 shutdown_connections 2023-10-14T11:14:34.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.476+0000 7f678b73e640 1 -- 172.21.15.26:0/347211388 wait complete. 2023-10-14T11:14:34.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.476+0000 7f678b73e640 1 Processor -- start 2023-10-14T11:14:34.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.476+0000 7f678b73e640 1 -- start start 2023-10-14T11:14:34.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.476+0000 7f678b73e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67840ad960 0x7f678415ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:34.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.476+0000 7f678b73e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67840b07f0 0x7f67841fd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:34.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.476+0000 7f678b73e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6784164520 0x7f6784159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:34.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.476+0000 7f678b73e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6784163100 con 0x7f6784164520 2023-10-14T11:14:34.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.476+0000 7f678b73e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67841fd9e0 con 0x7f67840b07f0 2023-10-14T11:14:34.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.480+0000 7f678b73e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67841597d0 con 0x7f67840ad960 2023-10-14T11:14:34.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.480+0000 7f6789cdb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6784164520 0x7f6784159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:34.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.480+0000 7f6789cdb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6784164520 0x7f6784159050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42872/0 (socket says 172.21.15.26:42872) 2023-10-14T11:14:34.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.480+0000 7f6789cdb640 1 -- 172.21.15.26:0/1125417754 learned_addr learned my addr 172.21.15.26:0/1125417754 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:34.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.480+0000 7f67894da640 1 --2- 172.21.15.26:0/1125417754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67840ad960 0x7f678415ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:34.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.480+0000 7f6788cd9640 1 --2- 172.21.15.26:0/1125417754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67840b07f0 0x7f67841fd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:34.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.480+0000 7f6789cdb640 1 -- 172.21.15.26:0/1125417754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67840ad960 msgr2=0x7f678415ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:34.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.480+0000 7f6789cdb640 1 --2- 172.21.15.26:0/1125417754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67840ad960 0x7f678415ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.480+0000 7f6789cdb640 1 -- 172.21.15.26:0/1125417754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67840b07f0 msgr2=0x7f67841fd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:34.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.480+0000 7f6789cdb640 1 --2- 172.21.15.26:0/1125417754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67840b07f0 0x7f67841fd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.480+0000 7f6789cdb640 1 -- 172.21.15.26:0/1125417754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67800094d0 con 0x7f6784164520 2023-10-14T11:14:34.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.480+0000 7f6789cdb640 1 --2- 172.21.15.26:0/1125417754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6784164520 0x7f6784159050 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f677c00ec10 tx=0x7f677c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:34.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.480+0000 7f6779ffb640 1 -- 172.21.15.26:0/1125417754 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c009a70 con 0x7f6784164520 2023-10-14T11:14:34.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.480+0000 7f6779ffb640 1 -- 172.21.15.26:0/1125417754 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677c00f040 con 0x7f6784164520 2023-10-14T11:14:34.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.480+0000 7f6779ffb640 1 -- 172.21.15.26:0/1125417754 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c014480 con 0x7f6784164520 2023-10-14T11:14:34.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.480+0000 7f678b73e640 1 -- 172.21.15.26:0/1125417754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6784159590 con 0x7f6784164520 2023-10-14T11:14:34.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.480+0000 7f678b73e640 1 -- 172.21.15.26:0/1125417754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67841fdeb0 con 0x7f6784164520 2023-10-14T11:14:34.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.480+0000 7f678b73e640 1 -- 172.21.15.26:0/1125417754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6784074010 con 0x7f6784164520 2023-10-14T11:14:34.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.480+0000 7f6779ffb640 1 -- 172.21.15.26:0/1125417754 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f677c0145e0 con 0x7f6784164520 2023-10-14T11:14:34.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.484+0000 7f6779ffb640 1 --2- 172.21.15.26:0/1125417754 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f67680664a0 0x7f6768068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:34.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.484+0000 7f6779ffb640 1 -- 172.21.15.26:0/1125417754 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f677c084d90 con 0x7f6784164520 2023-10-14T11:14:34.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.484+0000 7f67894da640 1 --2- 172.21.15.26:0/1125417754 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f67680664a0 0x7f6768068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:34.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.484+0000 7f67894da640 1 --2- 172.21.15.26:0/1125417754 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f67680664a0 0x7f6768068960 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f67800ae000 tx=0x7f67800b3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:34.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.488+0000 7f6779ffb640 1 -- 172.21.15.26:0/1125417754 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f677c051f30 con 0x7f6784164520 2023-10-14T11:14:34.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.680+0000 7f678b73e640 1 -- 172.21.15.26:0/1125417754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67840c5520 con 0x7f6784164520 2023-10-14T11:14:34.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.680+0000 7f6779ffb640 1 -- 172.21.15.26:0/1125417754 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f677c018020 con 0x7f6784164520 2023-10-14T11:14:34.687 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:34.687 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5425,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/1669994220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1669994220},{"type":"v1","addr":"172.21.15.110:6834","nonce":1669994220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3054425791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3054425791},{"type":"v1","addr":"172.21.15.110:6835","nonce":3054425791}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5434,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3759640340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3759640340},{"type":"v1","addr":"172.21.15.26:6837","nonce":3759640340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:13:50.622103+0000","modified":"2023-10-14T11:13:59.658132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5493":{"gid":5493,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/812681761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":812681761},{"type":"v1","addr":"172.21.15.26:6835","nonce":812681761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T11:14:34.688 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 18 2023-10-14T11:14:34.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.684+0000 7f678b73e640 1 -- 172.21.15.26:0/1125417754 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f67680664a0 msgr2=0x7f6768068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:34.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.684+0000 7f678b73e640 1 --2- 172.21.15.26:0/1125417754 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f67680664a0 0x7f6768068960 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f67800ae000 tx=0x7f67800b3040 comp rx=0 tx=0).stop 2023-10-14T11:14:34.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.684+0000 7f678b73e640 1 -- 172.21.15.26:0/1125417754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6784164520 msgr2=0x7f6784159050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:34.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.684+0000 7f678b73e640 1 --2- 172.21.15.26:0/1125417754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6784164520 0x7f6784159050 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f677c00ec10 tx=0x7f677c00c490 comp rx=0 tx=0).stop 2023-10-14T11:14:34.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.684+0000 7f678b73e640 1 -- 172.21.15.26:0/1125417754 shutdown_connections 2023-10-14T11:14:34.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.684+0000 7f678b73e640 1 --2- 172.21.15.26:0/1125417754 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f67680664a0 0x7f6768068960 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.684+0000 7f678b73e640 1 --2- 172.21.15.26:0/1125417754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6784164520 0x7f6784159050 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.684+0000 7f678b73e640 1 --2- 172.21.15.26:0/1125417754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67840b07f0 0x7f67841fd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.684+0000 7f678b73e640 1 --2- 172.21.15.26:0/1125417754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67840ad960 0x7f678415ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.684+0000 7f678b73e640 1 -- 172.21.15.26:0/1125417754 >> 172.21.15.26:0/1125417754 conn(0x7f678406c190 msgr2=0x7f67840b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:34.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.684+0000 7f678b73e640 1 -- 172.21.15.26:0/1125417754 shutdown_connections 2023-10-14T11:14:34.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.684+0000 7f678b73e640 1 -- 172.21.15.26:0/1125417754 wait complete. 2023-10-14T11:14:34.708 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:14:34.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.848+0000 7fc97cbb8640 1 Processor -- start 2023-10-14T11:14:34.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.848+0000 7fc97cbb8640 1 -- start start 2023-10-14T11:14:34.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.848+0000 7fc97cbb8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc97815cb90 0x7fc9780cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:34.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.848+0000 7fc97cbb8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc9780d15d0 0x7fc9780c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:34.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.848+0000 7fc97cbb8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9780ce770 con 0x7fc9780d3010 2023-10-14T11:14:34.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.848+0000 7fc97cbb8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9780d0600 con 0x7fc9780d15d0 2023-10-14T11:14:34.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.848+0000 7fc97cbb8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780c6450 con 0x7fc97815cb90 2023-10-14T11:14:34.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.848+0000 7fc975d9b640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc9780d3010 0x7fc9780d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36544/0 (socket says 172.21.15.26:36544) 2023-10-14T11:14:34.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.848+0000 7fc975d9b640 1 -- 172.21.15.26:0/1416526689 learned_addr learned my addr 172.21.15.26:0/1416526689 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:34.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.848+0000 7fc97659c640 1 --2- 172.21.15.26:0/1416526689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc97815cb90 0x7fc9780cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:34.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.848+0000 7fc976d9d640 1 --2- 172.21.15.26:0/1416526689 >> v2:172.21.15.110:3300/0 conn(0x7fc9780d15d0 0x7fc9780c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:34.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.848+0000 7fc97559a640 1 -- 172.21.15.26:0/1416526689 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115925451 0 0) 0x7fc9780ce770 con 0x7fc9780d3010 2023-10-14T11:14:34.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.848+0000 7fc97559a640 1 -- 172.21.15.26:0/1416526689 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc960003530 con 0x7fc9780d3010 2023-10-14T11:14:34.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.848+0000 7fc97659c640 1 -- 172.21.15.26:0/1416526689 >> v2:172.21.15.110:3300/0 conn(0x7fc9780d15d0 msgr2=0x7fc9780c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:34.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.848+0000 7fc97659c640 1 --2- 172.21.15.26:0/1416526689 >> v2:172.21.15.110:3300/0 conn(0x7fc9780d15d0 0x7fc9780c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.848+0000 7fc97659c640 1 -- 172.21.15.26:0/1416526689 >> v1:172.21.15.26:6789/0 conn(0x7fc9780d3010 legacy=0x7fc9780d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:34.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.848+0000 7fc97659c640 1 -- 172.21.15.26:0/1416526689 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9780d08a0 con 0x7fc97815cb90 2023-10-14T11:14:34.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.852+0000 7fc97659c640 1 --2- 172.21.15.26:0/1416526689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc97815cb90 0x7fc9780cfb10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc9680097a0 tx=0x7fc96801c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e491819c87664954 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:34.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.852+0000 7fc97559a640 1 -- 172.21.15.26:0/1416526689 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9680ac600 con 0x7fc97815cb90 2023-10-14T11:14:34.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.852+0000 7fc97559a640 1 -- 172.21.15.26:0/1416526689 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9680a8050 con 0x7fc97815cb90 2023-10-14T11:14:34.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.852+0000 7fc97559a640 1 -- 172.21.15.26:0/1416526689 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9680ac980 con 0x7fc97815cb90 2023-10-14T11:14:34.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.852+0000 7fc97cbb8640 1 -- 172.21.15.26:0/1416526689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc97815cb90 msgr2=0x7fc9780cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:34.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.852+0000 7fc97cbb8640 1 --2- 172.21.15.26:0/1416526689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc97815cb90 0x7fc9780cfb10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc9680097a0 tx=0x7fc96801c3a0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.852+0000 7fc97cbb8640 1 -- 172.21.15.26:0/1416526689 shutdown_connections 2023-10-14T11:14:34.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.852+0000 7fc97cbb8640 1 --2- 172.21.15.26:0/1416526689 >> v2:172.21.15.110:3300/0 conn(0x7fc9780d15d0 0x7fc9780c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.852+0000 7fc97cbb8640 1 --2- 172.21.15.26:0/1416526689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc97815cb90 0x7fc9780cfb10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.852+0000 7fc97cbb8640 1 -- 172.21.15.26:0/1416526689 >> 172.21.15.26:0/1416526689 conn(0x7fc97809bc50 msgr2=0x7fc9780d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:34.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.852+0000 7fc97cbb8640 1 -- 172.21.15.26:0/1416526689 shutdown_connections 2023-10-14T11:14:34.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.852+0000 7fc97cbb8640 1 -- 172.21.15.26:0/1416526689 wait complete. 2023-10-14T11:14:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc97cbb8640 1 Processor -- start 2023-10-14T11:14:34.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc97cbb8640 1 -- start start 2023-10-14T11:14:34.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc97cbb8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9780d15d0 0x7fc9780cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:34.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc97cbb8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9780d3010 0x7fc97814e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:34.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc97cbb8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc97815cb90 0x7fc978153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:34.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc97cbb8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780c9a70 con 0x7fc9780d15d0 2023-10-14T11:14:34.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc97cbb8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780c9d50 con 0x7fc97815cb90 2023-10-14T11:14:34.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc97cbb8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780ca030 con 0x7fc9780d3010 2023-10-14T11:14:34.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc97659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9780d15d0 0x7fc9780cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:34.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc97659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9780d15d0 0x7fc9780cc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42876/0 (socket says 172.21.15.26:42876) 2023-10-14T11:14:34.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc97659c640 1 -- 172.21.15.26:0/1516288172 learned_addr learned my addr 172.21.15.26:0/1516288172 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:34.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc975d9b640 1 --2- 172.21.15.26:0/1516288172 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9780d3010 0x7fc97814e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:34.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc976d9d640 1 --2- 172.21.15.26:0/1516288172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc97815cb90 0x7fc978153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:34.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc97659c640 1 -- 172.21.15.26:0/1516288172 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9780d3010 msgr2=0x7fc97814e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:34.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc97659c640 1 --2- 172.21.15.26:0/1516288172 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9780d3010 0x7fc97814e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc97659c640 1 -- 172.21.15.26:0/1516288172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc97815cb90 msgr2=0x7fc978153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:34.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc97659c640 1 --2- 172.21.15.26:0/1516288172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc97815cb90 0x7fc978153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc97659c640 1 -- 172.21.15.26:0/1516288172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9680093b0 con 0x7fc9780d15d0 2023-10-14T11:14:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc976d9d640 1 --2- 172.21.15.26:0/1516288172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc97815cb90 0x7fc978153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc97659c640 1 --2- 172.21.15.26:0/1516288172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9780d15d0 0x7fc9780cc5d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc968019fd0 tx=0x7fc96801abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc966ffd640 1 -- 172.21.15.26:0/1516288172 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9680b7420 con 0x7fc9780d15d0 2023-10-14T11:14:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc966ffd640 1 -- 172.21.15.26:0/1516288172 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9680b7580 con 0x7fc9780d15d0 2023-10-14T11:14:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc97cbb8640 1 -- 172.21.15.26:0/1516288172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9780ca310 con 0x7fc9780d15d0 2023-10-14T11:14:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc966ffd640 1 -- 172.21.15.26:0/1516288172 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9680b7930 con 0x7fc9780d15d0 2023-10-14T11:14:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.856+0000 7fc97cbb8640 1 -- 172.21.15.26:0/1516288172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc978154310 con 0x7fc9780d15d0 2023-10-14T11:14:34.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.860+0000 7fc97cbb8640 1 -- 172.21.15.26:0/1516288172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc978074010 con 0x7fc9780d15d0 2023-10-14T11:14:34.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.860+0000 7fc966ffd640 1 -- 172.21.15.26:0/1516288172 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc9680b3040 con 0x7fc9780d15d0 2023-10-14T11:14:34.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.860+0000 7fc966ffd640 1 --2- 172.21.15.26:0/1516288172 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc9580664a0 0x7fc958068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:34.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.860+0000 7fc966ffd640 1 -- 172.21.15.26:0/1516288172 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7fc96811e5a0 con 0x7fc9780d15d0 2023-10-14T11:14:34.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.860+0000 7fc975d9b640 1 --2- 172.21.15.26:0/1516288172 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc9580664a0 0x7fc958068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:34.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.860+0000 7fc975d9b640 1 --2- 172.21.15.26:0/1516288172 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc9580664a0 0x7fc958068960 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc97814f4c0 tx=0x7fc96c007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:34.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:34.864+0000 7fc966ffd640 1 -- 172.21.15.26:0/1516288172 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc9680eb6c0 con 0x7fc9780d15d0 2023-10-14T11:14:35.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.024+0000 7fc97cbb8640 1 -- 172.21.15.26:0/1516288172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9780c9bb0 con 0x7fc9780d15d0 2023-10-14T11:14:35.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.024+0000 7fc966ffd640 1 -- 172.21.15.26:0/1516288172 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18578 (secure 0 0 0) 0x7fc9780c9bb0 con 0x7fc9780d15d0 2023-10-14T11:14:35.029 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:35.030 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":42,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:14:01.292164+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:13:48.453821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:13:49.623527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-10-14T11:13:59.245615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:14:35.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.024+0000 7fc97cbb8640 1 -- 172.21.15.26:0/1516288172 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc9580664a0 msgr2=0x7fc958068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:35.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.024+0000 7fc97cbb8640 1 --2- 172.21.15.26:0/1516288172 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc9580664a0 0x7fc958068960 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc97814f4c0 tx=0x7fc96c007d40 comp rx=0 tx=0).stop 2023-10-14T11:14:35.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.024+0000 7fc97cbb8640 1 -- 172.21.15.26:0/1516288172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9780d15d0 msgr2=0x7fc9780cc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:35.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.024+0000 7fc97cbb8640 1 --2- 172.21.15.26:0/1516288172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9780d15d0 0x7fc9780cc5d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc968019fd0 tx=0x7fc96801abe0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.024+0000 7fc97cbb8640 1 -- 172.21.15.26:0/1516288172 shutdown_connections 2023-10-14T11:14:35.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.024+0000 7fc97cbb8640 1 --2- 172.21.15.26:0/1516288172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc97815cb90 0x7fc978153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.024+0000 7fc97cbb8640 1 --2- 172.21.15.26:0/1516288172 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9780d3010 0x7fc97814e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.024+0000 7fc97cbb8640 1 --2- 172.21.15.26:0/1516288172 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc9580664a0 0x7fc958068960 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.024+0000 7fc97cbb8640 1 --2- 172.21.15.26:0/1516288172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9780d15d0 0x7fc9780cc5d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.024+0000 7fc97cbb8640 1 -- 172.21.15.26:0/1516288172 >> 172.21.15.26:0/1516288172 conn(0x7fc97809bc50 msgr2=0x7fc9780d19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:35.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.024+0000 7fc97cbb8640 1 -- 172.21.15.26:0/1516288172 shutdown_connections 2023-10-14T11:14:35.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.024+0000 7fc97cbb8640 1 -- 172.21.15.26:0/1516288172 wait complete. 2023-10-14T11:14:35.051 INFO:tasks.cephfs.filesystem:Destroying file system testcephfs1 and related pools 2023-10-14T11:14:35.051 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:14:35.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.192+0000 7f90d61b8640 1 Processor -- start 2023-10-14T11:14:35.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.192+0000 7f90d61b8640 1 -- start start 2023-10-14T11:14:35.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.192+0000 7f90d61b8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f90d015cb90 0x7f90d00cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:35.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.192+0000 7f90d61b8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f90d00d3010 0x7f90d00d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:35.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.192+0000 7f90d61b8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d00d1850 con 0x7f90d00d1400 2023-10-14T11:14:35.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.192+0000 7f90d61b8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d00ce770 con 0x7f90d015cb90 2023-10-14T11:14:35.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.192+0000 7f90d61b8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d00d0600 con 0x7f90d00d3010 2023-10-14T11:14:35.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.192+0000 7f90cf7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f90d015cb90 0x7f90d00cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:35.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.192+0000 7f90cf7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f90d015cb90 0x7f90d00cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42890/0 (socket says 172.21.15.26:42890) 2023-10-14T11:14:35.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.192+0000 7f90cf7fe640 1 -- 172.21.15.26:0/1859495236 learned_addr learned my addr 172.21.15.26:0/1859495236 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:35.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.192+0000 7f90ceffd640 1 --2- 172.21.15.26:0/1859495236 >> v2:172.21.15.110:3300/0 conn(0x7f90d00d3010 0x7f90d00d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:35.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.192+0000 7f90cf7fe640 1 -- 172.21.15.26:0/1859495236 >> v2:172.21.15.110:3300/0 conn(0x7f90d00d3010 msgr2=0x7f90d00d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:35.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.192+0000 7f90cf7fe640 1 --2- 172.21.15.26:0/1859495236 >> v2:172.21.15.110:3300/0 conn(0x7f90d00d3010 0x7f90d00d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.192+0000 7f90cf7fe640 1 -- 172.21.15.26:0/1859495236 >> v1:172.21.15.110:6789/0 conn(0x7f90d00d1400 legacy=0x7f90d00cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:35.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.192+0000 7f90cf7fe640 1 -- 172.21.15.26:0/1859495236 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d00c6450 con 0x7f90d015cb90 2023-10-14T11:14:35.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.192+0000 7f90ceffd640 1 --2- 172.21.15.26:0/1859495236 >> v2:172.21.15.110:3300/0 conn(0x7f90d00d3010 0x7f90d00d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:35.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.196+0000 7f90cf7fe640 1 --2- 172.21.15.26:0/1859495236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d015cb90 0x7f90d00cfb10 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f90d008a880 tx=0x7f90c001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b22fd8a9fdf4f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:35.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.196+0000 7f90ce7fc640 1 -- 172.21.15.26:0/1859495236 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c00ab600 con 0x7f90d015cb90 2023-10-14T11:14:35.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.196+0000 7f90ce7fc640 1 -- 172.21.15.26:0/1859495236 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c00ab760 con 0x7f90d015cb90 2023-10-14T11:14:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.196+0000 7f90ce7fc640 1 -- 172.21.15.26:0/1859495236 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c00abaf0 con 0x7f90d015cb90 2023-10-14T11:14:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.196+0000 7f90d61b8640 1 -- 172.21.15.26:0/1859495236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d015cb90 msgr2=0x7f90d00cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.196+0000 7f90d61b8640 1 --2- 172.21.15.26:0/1859495236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d015cb90 0x7f90d00cfb10 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f90d008a880 tx=0x7f90c001c400 comp rx=0 tx=0).stop 2023-10-14T11:14:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.196+0000 7f90d61b8640 1 -- 172.21.15.26:0/1859495236 shutdown_connections 2023-10-14T11:14:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.196+0000 7f90d61b8640 1 --2- 172.21.15.26:0/1859495236 >> v2:172.21.15.110:3300/0 conn(0x7f90d00d3010 0x7f90d00d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.196+0000 7f90d61b8640 1 --2- 172.21.15.26:0/1859495236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d015cb90 0x7f90d00cfb10 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.196+0000 7f90d61b8640 1 -- 172.21.15.26:0/1859495236 >> 172.21.15.26:0/1859495236 conn(0x7f90d009bc50 msgr2=0x7f90d00d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.196+0000 7f90d61b8640 1 -- 172.21.15.26:0/1859495236 shutdown_connections 2023-10-14T11:14:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.196+0000 7f90d61b8640 1 -- 172.21.15.26:0/1859495236 wait complete. 2023-10-14T11:14:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90d61b8640 1 Processor -- start 2023-10-14T11:14:35.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90d61b8640 1 -- start start 2023-10-14T11:14:35.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90d61b8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90d00d1400 0x7f90d0165900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:35.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90d61b8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90d00d3010 0x7f90d0155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:35.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90d61b8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d015cb90 0x7f90d0156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:35.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90d61b8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d0166ba0 con 0x7f90d015cb90 2023-10-14T11:14:35.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90d61b8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d0167030 con 0x7f90d00d3010 2023-10-14T11:14:35.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90d61b8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d0165f90 con 0x7f90d00d1400 2023-10-14T11:14:35.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90cffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d015cb90 0x7f90d0156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:35.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90cf7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90d00d1400 0x7f90d0165900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90cf7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90d00d1400 0x7f90d0165900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:50332/0 (socket says 172.21.15.26:50332) 2023-10-14T11:14:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90cf7fe640 1 -- 172.21.15.26:0/3545696048 learned_addr learned my addr 172.21.15.26:0/3545696048 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90ceffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90d00d3010 0x7f90d0155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:35.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90cffff640 1 -- 172.21.15.26:0/3545696048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90d00d1400 msgr2=0x7f90d0165900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:35.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90cffff640 1 --2- 172.21.15.26:0/3545696048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90d00d1400 0x7f90d0165900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90cffff640 1 -- 172.21.15.26:0/3545696048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90d00d3010 msgr2=0x7f90d0155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:35.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90cffff640 1 --2- 172.21.15.26:0/3545696048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90d00d3010 0x7f90d0155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90cffff640 1 -- 172.21.15.26:0/3545696048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c0009480 con 0x7f90d015cb90 2023-10-14T11:14:35.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90cf7fe640 1 --2- 172.21.15.26:0/3545696048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90d00d1400 0x7f90d0165900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:14:35.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90cffff640 1 --2- 172.21.15.26:0/3545696048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d015cb90 0x7f90d0156360 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f90c800be00 tx=0x7f90c800bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:35.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90b7fff640 1 -- 172.21.15.26:0/3545696048 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c800ce70 con 0x7f90d015cb90 2023-10-14T11:14:35.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90b7fff640 1 -- 172.21.15.26:0/3545696048 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c8003980 con 0x7f90d015cb90 2023-10-14T11:14:35.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90d61b8640 1 -- 172.21.15.26:0/3545696048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d0166270 con 0x7f90d015cb90 2023-10-14T11:14:35.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90b7fff640 1 -- 172.21.15.26:0/3545696048 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c8003d70 con 0x7f90d015cb90 2023-10-14T11:14:35.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.200+0000 7f90d61b8640 1 -- 172.21.15.26:0/3545696048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d0166830 con 0x7f90d015cb90 2023-10-14T11:14:35.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.204+0000 7f90d61b8640 1 -- 172.21.15.26:0/3545696048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d01669f0 con 0x7f90d015cb90 2023-10-14T11:14:35.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.204+0000 7f90b7fff640 1 -- 172.21.15.26:0/3545696048 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f90c8003ef0 con 0x7f90d015cb90 2023-10-14T11:14:35.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.204+0000 7f90b7fff640 1 --2- 172.21.15.26:0/3545696048 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f90bc0664a0 0x7f90bc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:35.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.204+0000 7f90b7fff640 1 -- 172.21.15.26:0/3545696048 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f90c80840f0 con 0x7f90d015cb90 2023-10-14T11:14:35.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.204+0000 7f90cf7fe640 1 --2- 172.21.15.26:0/3545696048 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f90bc0664a0 0x7f90bc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:35.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.204+0000 7f90cf7fe640 1 --2- 172.21.15.26:0/3545696048 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f90bc0664a0 0x7f90bc068960 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f90c00ad040 tx=0x7f90c00a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:35.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.208+0000 7f90b7fff640 1 -- 172.21.15.26:0/3545696048 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f90c80512a0 con 0x7f90d015cb90 2023-10-14T11:14:35.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.412+0000 7f90d61b8640 1 -- 172.21.15.26:0/3545696048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90d0074010 con 0x7f90d015cb90 2023-10-14T11:14:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.412+0000 7f90b7fff640 1 -- 172.21.15.26:0/3545696048 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f90c80548c0 con 0x7f90d015cb90 2023-10-14T11:14:35.418 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:35.418 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5425,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/1669994220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1669994220},{"type":"v1","addr":"172.21.15.110:6834","nonce":1669994220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3054425791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3054425791},{"type":"v1","addr":"172.21.15.110:6835","nonce":3054425791}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5434,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3759640340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3759640340},{"type":"v1","addr":"172.21.15.26:6837","nonce":3759640340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:13:50.622103+0000","modified":"2023-10-14T11:13:59.658132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5493":{"gid":5493,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/812681761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":812681761},{"type":"v1","addr":"172.21.15.26:6835","nonce":812681761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T11:14:35.419 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 18 2023-10-14T11:14:35.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.416+0000 7f90d61b8640 1 -- 172.21.15.26:0/3545696048 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f90bc0664a0 msgr2=0x7f90bc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:35.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.416+0000 7f90d61b8640 1 --2- 172.21.15.26:0/3545696048 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f90bc0664a0 0x7f90bc068960 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f90c00ad040 tx=0x7f90c00a7000 comp rx=0 tx=0).stop 2023-10-14T11:14:35.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.416+0000 7f90d61b8640 1 -- 172.21.15.26:0/3545696048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d015cb90 msgr2=0x7f90d0156360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:35.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.416+0000 7f90d61b8640 1 --2- 172.21.15.26:0/3545696048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d015cb90 0x7f90d0156360 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f90c800be00 tx=0x7f90c800bef0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.416+0000 7f90d61b8640 1 -- 172.21.15.26:0/3545696048 shutdown_connections 2023-10-14T11:14:35.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.416+0000 7f90d61b8640 1 --2- 172.21.15.26:0/3545696048 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f90bc0664a0 0x7f90bc068960 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.416+0000 7f90d61b8640 1 --2- 172.21.15.26:0/3545696048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d015cb90 0x7f90d0156360 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.416+0000 7f90d61b8640 1 --2- 172.21.15.26:0/3545696048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90d00d3010 0x7f90d0155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.416+0000 7f90d61b8640 1 --2- 172.21.15.26:0/3545696048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90d00d1400 0x7f90d0165900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.416+0000 7f90d61b8640 1 -- 172.21.15.26:0/3545696048 >> 172.21.15.26:0/3545696048 conn(0x7f90d009bc50 msgr2=0x7f90d00ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:35.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.416+0000 7f90d61b8640 1 -- 172.21.15.26:0/3545696048 shutdown_connections 2023-10-14T11:14:35.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.416+0000 7f90d61b8640 1 -- 172.21.15.26:0/3545696048 wait complete. 2023-10-14T11:14:35.440 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:14:35.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.576+0000 7fd52331d640 1 Processor -- start 2023-10-14T11:14:35.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.576+0000 7fd52331d640 1 -- start start 2023-10-14T11:14:35.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.580+0000 7fd52331d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd51c0b2ad0 0x7fd51c06b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.580+0000 7fd52331d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd51c0ce310 0x7fd51c0ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.580+0000 7fd52331d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51c06d000 con 0x7fd51c15cf90 2023-10-14T11:14:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.580+0000 7fd52331d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51c0ced00 con 0x7fd51c0b2ad0 2023-10-14T11:14:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.580+0000 7fd52331d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c160580 con 0x7fd51c0ce310 2023-10-14T11:14:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.580+0000 7fd5210b9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd51c0b2ad0 0x7fd51c06b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:35.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.580+0000 7fd5210b9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd51c0b2ad0 0x7fd51c06b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42916/0 (socket says 172.21.15.26:42916) 2023-10-14T11:14:35.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.580+0000 7fd5210b9640 1 -- 172.21.15.26:0/3758980911 learned_addr learned my addr 172.21.15.26:0/3758980911 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:35.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.580+0000 7fd5218ba640 1 --2- 172.21.15.26:0/3758980911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd51c0ce310 0x7fd51c0ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:35.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.580+0000 7fd5210b9640 1 -- 172.21.15.26:0/3758980911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd51c0ce310 msgr2=0x7fd51c0ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:35.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.580+0000 7fd5210b9640 1 --2- 172.21.15.26:0/3758980911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd51c0ce310 0x7fd51c0ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.580+0000 7fd5210b9640 1 -- 172.21.15.26:0/3758980911 >> v1:172.21.15.110:6789/0 conn(0x7fd51c15cf90 legacy=0x7fd51c06c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:35.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.580+0000 7fd5210b9640 1 -- 172.21.15.26:0/3758980911 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c15d4e0 con 0x7fd51c0b2ad0 2023-10-14T11:14:35.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.580+0000 7fd5218ba640 1 --2- 172.21.15.26:0/3758980911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd51c0ce310 0x7fd51c0ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.584+0000 7fd5210b9640 1 --2- 172.21.15.26:0/3758980911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd51c0b2ad0 0x7fd51c06b4b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd5180098a0 tx=0x7fd51801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d62f294a0bcbdde server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.584+0000 7fd513fff640 1 -- 172.21.15.26:0/3758980911 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5180aa650 con 0x7fd51c0b2ad0 2023-10-14T11:14:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.584+0000 7fd513fff640 1 -- 172.21.15.26:0/3758980911 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5180aa7b0 con 0x7fd51c0b2ad0 2023-10-14T11:14:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.584+0000 7fd513fff640 1 -- 172.21.15.26:0/3758980911 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5180aab40 con 0x7fd51c0b2ad0 2023-10-14T11:14:35.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.584+0000 7fd52331d640 1 -- 172.21.15.26:0/3758980911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd51c0b2ad0 msgr2=0x7fd51c06b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:35.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.584+0000 7fd52331d640 1 --2- 172.21.15.26:0/3758980911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd51c0b2ad0 0x7fd51c06b4b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd5180098a0 tx=0x7fd51801c4f0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.584+0000 7fd52331d640 1 -- 172.21.15.26:0/3758980911 shutdown_connections 2023-10-14T11:14:35.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.584+0000 7fd52331d640 1 --2- 172.21.15.26:0/3758980911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd51c0ce310 0x7fd51c0ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.584+0000 7fd52331d640 1 --2- 172.21.15.26:0/3758980911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd51c0b2ad0 0x7fd51c06b4b0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.584+0000 7fd52331d640 1 -- 172.21.15.26:0/3758980911 >> 172.21.15.26:0/3758980911 conn(0x7fd51c0cd1c0 msgr2=0x7fd51c0cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:35.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.584+0000 7fd52331d640 1 -- 172.21.15.26:0/3758980911 shutdown_connections 2023-10-14T11:14:35.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.584+0000 7fd52331d640 1 -- 172.21.15.26:0/3758980911 wait complete. 2023-10-14T11:14:35.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.584+0000 7fd52331d640 1 Processor -- start 2023-10-14T11:14:35.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.584+0000 7fd52331d640 1 -- start start 2023-10-14T11:14:35.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd52331d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd51c0b2ad0 0x7fd51c0b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:35.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd52331d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd51c0ce310 0x7fd51c158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:35.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd52331d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd51c15cf90 0x7fd51c159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:35.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd52331d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0b4650 con 0x7fd51c15cf90 2023-10-14T11:14:35.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd52331d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0c5670 con 0x7fd51c0ce310 2023-10-14T11:14:35.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd52331d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0b3db0 con 0x7fd51c0b2ad0 2023-10-14T11:14:35.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd5218ba640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd51c15cf90 0x7fd51c159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:35.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd5218ba640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd51c15cf90 0x7fd51c159480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42924/0 (socket says 172.21.15.26:42924) 2023-10-14T11:14:35.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd5218ba640 1 -- 172.21.15.26:0/245497226 learned_addr learned my addr 172.21.15.26:0/245497226 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:35.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd5210b9640 1 --2- 172.21.15.26:0/245497226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd51c0b2ad0 0x7fd51c0b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:35.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd5208b8640 1 --2- 172.21.15.26:0/245497226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd51c0ce310 0x7fd51c158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:35.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd5218ba640 1 -- 172.21.15.26:0/245497226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd51c0b2ad0 msgr2=0x7fd51c0b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:35.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd5218ba640 1 --2- 172.21.15.26:0/245497226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd51c0b2ad0 0x7fd51c0b5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd5218ba640 1 -- 172.21.15.26:0/245497226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd51c0ce310 msgr2=0x7fd51c158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:35.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd5218ba640 1 --2- 172.21.15.26:0/245497226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd51c0ce310 0x7fd51c158f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd5218ba640 1 -- 172.21.15.26:0/245497226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5180094d0 con 0x7fd51c15cf90 2023-10-14T11:14:35.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd5208b8640 1 --2- 172.21.15.26:0/245497226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd51c0ce310 0x7fd51c158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:35.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd5218ba640 1 --2- 172.21.15.26:0/245497226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd51c15cf90 0x7fd51c159480 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd51400cd50 tx=0x7fd51400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:35.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd511ffb640 1 -- 172.21.15.26:0/245497226 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51400f680 con 0x7fd51c15cf90 2023-10-14T11:14:35.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd511ffb640 1 -- 172.21.15.26:0/245497226 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51400f800 con 0x7fd51c15cf90 2023-10-14T11:14:35.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd52331d640 1 -- 172.21.15.26:0/245497226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51c0b4090 con 0x7fd51c15cf90 2023-10-14T11:14:35.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd511ffb640 1 -- 172.21.15.26:0/245497226 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51400fbb0 con 0x7fd51c15cf90 2023-10-14T11:14:35.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd52331d640 1 -- 172.21.15.26:0/245497226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51c0c58c0 con 0x7fd51c15cf90 2023-10-14T11:14:35.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd52331d640 1 -- 172.21.15.26:0/245497226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd51c0c5ae0 con 0x7fd51c15cf90 2023-10-14T11:14:35.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.588+0000 7fd511ffb640 1 -- 172.21.15.26:0/245497226 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd51400b040 con 0x7fd51c15cf90 2023-10-14T11:14:35.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.592+0000 7fd511ffb640 1 --2- 172.21.15.26:0/245497226 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd5000664d0 0x7fd500068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:35.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.592+0000 7fd511ffb640 1 -- 172.21.15.26:0/245497226 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7fd514084b80 con 0x7fd51c15cf90 2023-10-14T11:14:35.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.592+0000 7fd5210b9640 1 --2- 172.21.15.26:0/245497226 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd5000664d0 0x7fd500068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:35.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.592+0000 7fd5210b9640 1 --2- 172.21.15.26:0/245497226 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd5000664d0 0x7fd500068990 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd5180ae000 tx=0x7fd5180b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:35.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.596+0000 7fd511ffb640 1 -- 172.21.15.26:0/245497226 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd514051c70 con 0x7fd51c15cf90 2023-10-14T11:14:35.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.788+0000 7fd52331d640 1 -- 172.21.15.26:0/245497226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd51c074010 con 0x7fd51c15cf90 2023-10-14T11:14:35.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.788+0000 7fd511ffb640 1 -- 172.21.15.26:0/245497226 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4923 (secure 0 0 0) 0x7fd514084e60 con 0x7fd51c15cf90 2023-10-14T11:14:35.797 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:35.797 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5425,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/1669994220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1669994220},{"type":"v1","addr":"172.21.15.110:6834","nonce":1669994220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3054425791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3054425791},{"type":"v1","addr":"172.21.15.110:6835","nonce":3054425791}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5434,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3759640340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3759640340},{"type":"v1","addr":"172.21.15.26:6837","nonce":3759640340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:13:50.622103+0000","modified":"2023-10-14T11:13:59.658132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5493":{"gid":5493,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/812681761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":812681761},{"type":"v1","addr":"172.21.15.26:6835","nonce":812681761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T11:14:35.798 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 18 2023-10-14T11:14:35.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.792+0000 7fd52331d640 1 -- 172.21.15.26:0/245497226 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd5000664d0 msgr2=0x7fd500068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:35.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.792+0000 7fd52331d640 1 --2- 172.21.15.26:0/245497226 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd5000664d0 0x7fd500068990 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd5180ae000 tx=0x7fd5180b5040 comp rx=0 tx=0).stop 2023-10-14T11:14:35.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.792+0000 7fd52331d640 1 -- 172.21.15.26:0/245497226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd51c15cf90 msgr2=0x7fd51c159480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:35.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.792+0000 7fd52331d640 1 --2- 172.21.15.26:0/245497226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd51c15cf90 0x7fd51c159480 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd51400cd50 tx=0x7fd51400a650 comp rx=0 tx=0).stop 2023-10-14T11:14:35.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.792+0000 7fd52331d640 1 -- 172.21.15.26:0/245497226 shutdown_connections 2023-10-14T11:14:35.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.792+0000 7fd52331d640 1 --2- 172.21.15.26:0/245497226 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd5000664d0 0x7fd500068990 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.792+0000 7fd52331d640 1 --2- 172.21.15.26:0/245497226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd51c15cf90 0x7fd51c159480 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.792+0000 7fd52331d640 1 --2- 172.21.15.26:0/245497226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd51c0ce310 0x7fd51c158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.792+0000 7fd52331d640 1 --2- 172.21.15.26:0/245497226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd51c0b2ad0 0x7fd51c0b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.792+0000 7fd52331d640 1 -- 172.21.15.26:0/245497226 >> 172.21.15.26:0/245497226 conn(0x7fd51c0cd1c0 msgr2=0x7fd51c15c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:35.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.792+0000 7fd52331d640 1 -- 172.21.15.26:0/245497226 shutdown_connections 2023-10-14T11:14:35.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.792+0000 7fd52331d640 1 -- 172.21.15.26:0/245497226 wait complete. 2023-10-14T11:14:35.816 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:14:35.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.956+0000 7f3a4b846640 1 Processor -- start 2023-10-14T11:14:35.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.956+0000 7f3a4b846640 1 -- start start 2023-10-14T11:14:35.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.956+0000 7f3a4b846640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3a44164520 0x7f3a440ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:35.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.956+0000 7f3a4b846640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a440b07f0 0x7f3a440cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:35.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.956+0000 7f3a4b846640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a440c96f0 con 0x7f3a440ad960 2023-10-14T11:14:35.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.956+0000 7f3a4b846640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a44164900 con 0x7f3a44164520 2023-10-14T11:14:35.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.956+0000 7f3a4b846640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a440cb950 con 0x7f3a440b07f0 2023-10-14T11:14:35.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.956+0000 7f3a48de1640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3a440ad960 0x7f3a440b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36552/0 (socket says 172.21.15.26:36552) 2023-10-14T11:14:35.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.956+0000 7f3a48de1640 1 -- 172.21.15.26:0/710455310 learned_addr learned my addr 172.21.15.26:0/710455310 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:35.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.956+0000 7f3a495e2640 1 --2- 172.21.15.26:0/710455310 >> v2:172.21.15.110:3300/0 conn(0x7f3a44164520 0x7f3a440ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:35.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.956+0000 7f3a49de3640 1 --2- 172.21.15.26:0/710455310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a440b07f0 0x7f3a440cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:35.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.956+0000 7f3a3bfff640 1 -- 172.21.15.26:0/710455310 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954684862 0 0) 0x7f3a440c96f0 con 0x7f3a440ad960 2023-10-14T11:14:35.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.956+0000 7f3a3bfff640 1 -- 172.21.15.26:0/710455310 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a30003530 con 0x7f3a440ad960 2023-10-14T11:14:35.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.960+0000 7f3a495e2640 1 -- 172.21.15.26:0/710455310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a440b07f0 msgr2=0x7f3a440cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:35.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.960+0000 7f3a495e2640 1 --2- 172.21.15.26:0/710455310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a440b07f0 0x7f3a440cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.960+0000 7f3a495e2640 1 -- 172.21.15.26:0/710455310 >> v1:172.21.15.26:6789/0 conn(0x7f3a440ad960 legacy=0x7f3a440b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:35.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.960+0000 7f3a3bfff640 1 -- 172.21.15.26:0/710455310 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 855832204 0 0) 0x7f3a30003530 con 0x7f3a440ad960 2023-10-14T11:14:35.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.960+0000 7f3a495e2640 1 -- 172.21.15.26:0/710455310 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a440cbed0 con 0x7f3a44164520 2023-10-14T11:14:35.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.960+0000 7f3a495e2640 1 --2- 172.21.15.26:0/710455310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a44164520 0x7f3a440ce010 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3a400097c0 tx=0x7f3a4001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=153f603d12916014 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:35.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.960+0000 7f3a3bfff640 1 -- 172.21.15.26:0/710455310 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a34001680 con 0x7f3a44164520 2023-10-14T11:14:35.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.960+0000 7f3a3bfff640 1 -- 172.21.15.26:0/710455310 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a400a7050 con 0x7f3a44164520 2023-10-14T11:14:35.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.960+0000 7f3a3bfff640 1 -- 172.21.15.26:0/710455310 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a400ab620 con 0x7f3a44164520 2023-10-14T11:14:35.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a4b846640 1 -- 172.21.15.26:0/710455310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a44164520 msgr2=0x7f3a440ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:35.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a4b846640 1 --2- 172.21.15.26:0/710455310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a44164520 0x7f3a440ce010 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3a400097c0 tx=0x7f3a4001c370 comp rx=0 tx=0).stop 2023-10-14T11:14:35.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a4b846640 1 -- 172.21.15.26:0/710455310 shutdown_connections 2023-10-14T11:14:35.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a4b846640 1 --2- 172.21.15.26:0/710455310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a440b07f0 0x7f3a440cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a4b846640 1 --2- 172.21.15.26:0/710455310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a44164520 0x7f3a440ce010 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a4b846640 1 -- 172.21.15.26:0/710455310 >> 172.21.15.26:0/710455310 conn(0x7f3a4406c190 msgr2=0x7f3a4406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:35.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a4b846640 1 -- 172.21.15.26:0/710455310 shutdown_connections 2023-10-14T11:14:35.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a4b846640 1 -- 172.21.15.26:0/710455310 wait complete. 2023-10-14T11:14:35.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a4b846640 1 Processor -- start 2023-10-14T11:14:35.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a4b846640 1 -- start start 2023-10-14T11:14:35.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a4b846640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a440ad960 0x7f3a440af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:35.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a4b846640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a440b07f0 0x7f3a44153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:35.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a4b846640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a44164520 0x7f3a44153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:35.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a4b846640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a440c5d90 con 0x7f3a440ad960 2023-10-14T11:14:35.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a4b846640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4415fb30 con 0x7f3a44164520 2023-10-14T11:14:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a4b846640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4415fe10 con 0x7f3a440b07f0 2023-10-14T11:14:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a495e2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a440ad960 0x7f3a440af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a495e2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a440ad960 0x7f3a440af4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42928/0 (socket says 172.21.15.26:42928) 2023-10-14T11:14:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a495e2640 1 -- 172.21.15.26:0/462148295 learned_addr learned my addr 172.21.15.26:0/462148295 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a48de1640 1 --2- 172.21.15.26:0/462148295 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a440b07f0 0x7f3a44153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a49de3640 1 --2- 172.21.15.26:0/462148295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a44164520 0x7f3a44153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a495e2640 1 -- 172.21.15.26:0/462148295 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a440b07f0 msgr2=0x7f3a44153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a495e2640 1 --2- 172.21.15.26:0/462148295 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a440b07f0 0x7f3a44153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a495e2640 1 -- 172.21.15.26:0/462148295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a44164520 msgr2=0x7f3a44153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a495e2640 1 --2- 172.21.15.26:0/462148295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a44164520 0x7f3a44153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a495e2640 1 -- 172.21.15.26:0/462148295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a40009420 con 0x7f3a440ad960 2023-10-14T11:14:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.964+0000 7f3a49de3640 1 --2- 172.21.15.26:0/462148295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a44164520 0x7f3a44153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.968+0000 7f3a495e2640 1 --2- 172.21.15.26:0/462148295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a440ad960 0x7f3a440af4a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3a400ae040 tx=0x7f3a4001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.968+0000 7f3a39ffb640 1 -- 172.21.15.26:0/462148295 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a40006e20 con 0x7f3a440ad960 2023-10-14T11:14:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.968+0000 7f3a39ffb640 1 -- 172.21.15.26:0/462148295 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a400b7450 con 0x7f3a440ad960 2023-10-14T11:14:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.968+0000 7f3a39ffb640 1 -- 172.21.15.26:0/462148295 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a400b7800 con 0x7f3a440ad960 2023-10-14T11:14:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.968+0000 7f3a4b846640 1 -- 172.21.15.26:0/462148295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a441600f0 con 0x7f3a440ad960 2023-10-14T11:14:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.968+0000 7f3a4b846640 1 -- 172.21.15.26:0/462148295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a440af9e0 con 0x7f3a440ad960 2023-10-14T11:14:35.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.968+0000 7f3a4b846640 1 -- 172.21.15.26:0/462148295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a44074010 con 0x7f3a440ad960 2023-10-14T11:14:35.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.968+0000 7f3a39ffb640 1 -- 172.21.15.26:0/462148295 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3a400b7960 con 0x7f3a440ad960 2023-10-14T11:14:35.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.968+0000 7f3a39ffb640 1 --2- 172.21.15.26:0/462148295 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3a280664d0 0x7f3a28068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:35.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.968+0000 7f3a39ffb640 1 -- 172.21.15.26:0/462148295 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f3a4011e280 con 0x7f3a440ad960 2023-10-14T11:14:35.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.968+0000 7f3a48de1640 1 --2- 172.21.15.26:0/462148295 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3a280664d0 0x7f3a28068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:35.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.971+0000 7f3a48de1640 1 --2- 172.21.15.26:0/462148295 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3a280664d0 0x7f3a28068990 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3a340014b0 tx=0x7f3a34009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:35.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:35.971+0000 7f3a39ffb640 1 -- 172.21.15.26:0/462148295 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3a400eb400 con 0x7f3a440ad960 2023-10-14T11:14:36.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.131+0000 7f3a4b846640 1 -- 172.21.15.26:0/462148295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a4415dcf0 con 0x7f3a440ad960 2023-10-14T11:14:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.131+0000 7f3a39ffb640 1 -- 172.21.15.26:0/462148295 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18578 (secure 0 0 0) 0x7f3a400eea20 con 0x7f3a440ad960 2023-10-14T11:14:36.138 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:36.138 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":42,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:14:01.292164+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:13:48.453821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:13:49.623527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-10-14T11:13:59.245615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:14:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.131+0000 7f3a4b846640 1 -- 172.21.15.26:0/462148295 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3a280664d0 msgr2=0x7f3a28068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.135+0000 7f3a4b846640 1 --2- 172.21.15.26:0/462148295 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3a280664d0 0x7f3a28068990 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3a340014b0 tx=0x7f3a34009040 comp rx=0 tx=0).stop 2023-10-14T11:14:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.135+0000 7f3a4b846640 1 -- 172.21.15.26:0/462148295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a440ad960 msgr2=0x7f3a440af4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.135+0000 7f3a4b846640 1 --2- 172.21.15.26:0/462148295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a440ad960 0x7f3a440af4a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3a400ae040 tx=0x7f3a4001abb0 comp rx=0 tx=0).stop 2023-10-14T11:14:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.135+0000 7f3a4b846640 1 -- 172.21.15.26:0/462148295 shutdown_connections 2023-10-14T11:14:36.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.135+0000 7f3a4b846640 1 --2- 172.21.15.26:0/462148295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a44164520 0x7f3a44153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:36.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.135+0000 7f3a4b846640 1 --2- 172.21.15.26:0/462148295 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a440b07f0 0x7f3a44153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:36.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.135+0000 7f3a4b846640 1 --2- 172.21.15.26:0/462148295 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3a280664d0 0x7f3a28068990 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:36.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.135+0000 7f3a4b846640 1 --2- 172.21.15.26:0/462148295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a440ad960 0x7f3a440af4a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.135+0000 7f3a4b846640 1 -- 172.21.15.26:0/462148295 >> 172.21.15.26:0/462148295 conn(0x7f3a4406c190 msgr2=0x7f3a440affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.135+0000 7f3a4b846640 1 -- 172.21.15.26:0/462148295 shutdown_connections 2023-10-14T11:14:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.135+0000 7f3a4b846640 1 -- 172.21.15.26:0/462148295 wait complete. 2023-10-14T11:14:36.160 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail testcephfs1 2023-10-14T11:14:36.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.299+0000 7f2cb73c4640 1 Processor -- start 2023-10-14T11:14:36.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.299+0000 7f2cb73c4640 1 -- start start 2023-10-14T11:14:36.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.299+0000 7f2cb73c4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2cb015cb90 0x7f2cb00cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:36.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.299+0000 7f2cb73c4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2cb00d15d0 0x7f2cb00c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:36.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.299+0000 7f2cb73c4640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb00ce770 con 0x7f2cb00d3010 2023-10-14T11:14:36.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.299+0000 7f2cb73c4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb00d0600 con 0x7f2cb015cb90 2023-10-14T11:14:36.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.299+0000 7f2cb73c4640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb00c6450 con 0x7f2cb00d15d0 2023-10-14T11:14:36.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.299+0000 7f2cb5160640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2cb015cb90 0x7f2cb00cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:36.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.299+0000 7f2cb5160640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2cb015cb90 0x7f2cb00cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42930/0 (socket says 172.21.15.26:42930) 2023-10-14T11:14:36.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.299+0000 7f2cb5160640 1 -- 172.21.15.26:0/2443417165 learned_addr learned my addr 172.21.15.26:0/2443417165 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:36.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.299+0000 7f2cb495f640 1 --1- 172.21.15.26:0/2443417165 >> v1:172.21.15.26:6789/0 conn(0x7f2cb00d3010 0x7f2cb00d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36564/0 (socket says 172.21.15.26:36564) 2023-10-14T11:14:36.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.299+0000 7f2cb5961640 1 --2- 172.21.15.26:0/2443417165 >> v2:172.21.15.110:3300/0 conn(0x7f2cb00d15d0 0x7f2cb00c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:36.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.299+0000 7f2cb5160640 1 -- 172.21.15.26:0/2443417165 >> v2:172.21.15.110:3300/0 conn(0x7f2cb00d15d0 msgr2=0x7f2cb00c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:36.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.299+0000 7f2cb5160640 1 --2- 172.21.15.26:0/2443417165 >> v2:172.21.15.110:3300/0 conn(0x7f2cb00d15d0 0x7f2cb00c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:36.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.299+0000 7f2cb5160640 1 -- 172.21.15.26:0/2443417165 >> v1:172.21.15.26:6789/0 conn(0x7f2cb00d3010 legacy=0x7f2cb00d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:36.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.299+0000 7f2cb5160640 1 -- 172.21.15.26:0/2443417165 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb00d08a0 con 0x7f2cb015cb90 2023-10-14T11:14:36.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.299+0000 7f2cb5961640 1 --2- 172.21.15.26:0/2443417165 >> v2:172.21.15.110:3300/0 conn(0x7f2cb00d15d0 0x7f2cb00c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:36.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.303+0000 7f2cb5160640 1 --2- 172.21.15.26:0/2443417165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cb015cb90 0x7f2cb00cfb10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00ccee0 tx=0x7f2cac01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317ff562c9915af server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:36.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.303+0000 7f2ca7fff640 1 -- 172.21.15.26:0/2443417165 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac0ab640 con 0x7f2cb015cb90 2023-10-14T11:14:36.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.303+0000 7f2ca7fff640 1 -- 172.21.15.26:0/2443417165 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cac0a7070 con 0x7f2cb015cb90 2023-10-14T11:14:36.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.303+0000 7f2ca7fff640 1 -- 172.21.15.26:0/2443417165 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac0ab9c0 con 0x7f2cb015cb90 2023-10-14T11:14:36.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.303+0000 7f2cb73c4640 1 -- 172.21.15.26:0/2443417165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cb015cb90 msgr2=0x7f2cb00cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:36.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.303+0000 7f2cb73c4640 1 --2- 172.21.15.26:0/2443417165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cb015cb90 0x7f2cb00cfb10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00ccee0 tx=0x7f2cac01c440 comp rx=0 tx=0).stop 2023-10-14T11:14:36.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.303+0000 7f2cb73c4640 1 -- 172.21.15.26:0/2443417165 shutdown_connections 2023-10-14T11:14:36.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.303+0000 7f2cb73c4640 1 --2- 172.21.15.26:0/2443417165 >> v2:172.21.15.110:3300/0 conn(0x7f2cb00d15d0 0x7f2cb00c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:36.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.303+0000 7f2cb73c4640 1 --2- 172.21.15.26:0/2443417165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cb015cb90 0x7f2cb00cfb10 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:36.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.303+0000 7f2cb73c4640 1 -- 172.21.15.26:0/2443417165 >> 172.21.15.26:0/2443417165 conn(0x7f2cb009bc50 msgr2=0x7f2cb00d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:36.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.303+0000 7f2cb73c4640 1 -- 172.21.15.26:0/2443417165 shutdown_connections 2023-10-14T11:14:36.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.303+0000 7f2cb73c4640 1 -- 172.21.15.26:0/2443417165 wait complete. 2023-10-14T11:14:36.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb73c4640 1 Processor -- start 2023-10-14T11:14:36.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb73c4640 1 -- start start 2023-10-14T11:14:36.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb73c4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cb00d15d0 0x7f2cb009e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:36.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb73c4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cb00d3010 0x7f2cb009ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:36.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb73c4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cb015cb90 0x7f2cb00ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:36.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb73c4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb009ef40 con 0x7f2cb00d3010 2023-10-14T11:14:36.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb73c4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb00ca160 con 0x7f2cb015cb90 2023-10-14T11:14:36.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb73c4640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb009f190 con 0x7f2cb00d15d0 2023-10-14T11:14:36.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb495f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cb00d3010 0x7f2cb009ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:36.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb495f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cb00d3010 0x7f2cb009ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42946/0 (socket says 172.21.15.26:42946) 2023-10-14T11:14:36.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb495f640 1 -- 172.21.15.26:0/3566211090 learned_addr learned my addr 172.21.15.26:0/3566211090 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:36.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb5160640 1 --2- 172.21.15.26:0/3566211090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cb00d15d0 0x7f2cb009e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:36.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb5961640 1 --2- 172.21.15.26:0/3566211090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cb015cb90 0x7f2cb00ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:36.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb495f640 1 -- 172.21.15.26:0/3566211090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cb00d15d0 msgr2=0x7f2cb009e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:36.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb495f640 1 --2- 172.21.15.26:0/3566211090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cb00d15d0 0x7f2cb009e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:36.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb495f640 1 -- 172.21.15.26:0/3566211090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cb015cb90 msgr2=0x7f2cb00ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:36.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb495f640 1 --2- 172.21.15.26:0/3566211090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cb015cb90 0x7f2cb00ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:36.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb495f640 1 -- 172.21.15.26:0/3566211090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cac009480 con 0x7f2cb00d3010 2023-10-14T11:14:36.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb5160640 1 --2- 172.21.15.26:0/3566211090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cb00d15d0 0x7f2cb009e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:36.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb5961640 1 --2- 172.21.15.26:0/3566211090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cb015cb90 0x7f2cb00ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:36.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb495f640 1 --2- 172.21.15.26:0/3566211090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cb00d3010 0x7f2cb009ea00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000c460 tx=0x7f2ca000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:36.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2ca5ffb640 1 -- 172.21.15.26:0/3566211090 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0007480 con 0x7f2cb00d3010 2023-10-14T11:14:36.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2ca5ffb640 1 -- 172.21.15.26:0/3566211090 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca0007600 con 0x7f2cb00d3010 2023-10-14T11:14:36.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2ca5ffb640 1 -- 172.21.15.26:0/3566211090 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0004a30 con 0x7f2cb00d3010 2023-10-14T11:14:36.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb73c4640 1 -- 172.21.15.26:0/3566211090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb009f470 con 0x7f2cb00d3010 2023-10-14T11:14:36.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb73c4640 1 -- 172.21.15.26:0/3566211090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb009fa30 con 0x7f2cb00d3010 2023-10-14T11:14:36.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.307+0000 7f2cb73c4640 1 -- 172.21.15.26:0/3566211090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb0074010 con 0x7f2cb00d3010 2023-10-14T11:14:36.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.311+0000 7f2ca5ffb640 1 -- 172.21.15.26:0/3566211090 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2ca0004b90 con 0x7f2cb00d3010 2023-10-14T11:14:36.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.311+0000 7f2ca5ffb640 1 --2- 172.21.15.26:0/3566211090 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2c940664a0 0x7f2c94068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:36.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.311+0000 7f2ca5ffb640 1 -- 172.21.15.26:0/3566211090 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6449+0+0 (secure 0 0 0) 0x7f2ca00833f0 con 0x7f2cb00d3010 2023-10-14T11:14:36.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.311+0000 7f2cb5160640 1 --2- 172.21.15.26:0/3566211090 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2c940664a0 0x7f2c94068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:36.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.311+0000 7f2cb5160640 1 --2- 172.21.15.26:0/3566211090 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2c940664a0 0x7f2c94068960 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0af000 tx=0x7f2cac0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:36.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.315+0000 7f2ca5ffb640 1 -- 172.21.15.26:0/3566211090 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2ca00504e0 con 0x7f2cb00d3010 2023-10-14T11:14:36.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.507+0000 7f2cb73c4640 1 -- 172.21.15.26:0/3566211090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "testcephfs1"} v 0) v1 -- 0x7f2cb006ce40 con 0x7f2cb00d3010 2023-10-14T11:14:36.514 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-14T11:14:36.507+0000 7f7c7d495640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T11:14:36.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.511+0000 7f2ca5ffb640 1 -- 172.21.15.26:0/3566211090 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "testcephfs1"}]=0 testcephfs1 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f2ca0053b00 con 0x7f2cb00d3010 2023-10-14T11:14:36.517 INFO:teuthology.orchestra.run.smithi026.stderr:testcephfs1 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T11:14:36.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.511+0000 7f2cb73c4640 1 -- 172.21.15.26:0/3566211090 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2c940664a0 msgr2=0x7f2c94068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:36.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.511+0000 7f2cb73c4640 1 --2- 172.21.15.26:0/3566211090 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2c940664a0 0x7f2c94068960 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0af000 tx=0x7f2cac0a7000 comp rx=0 tx=0).stop 2023-10-14T11:14:36.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.511+0000 7f2cb73c4640 1 -- 172.21.15.26:0/3566211090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cb00d3010 msgr2=0x7f2cb009ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:36.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.511+0000 7f2cb73c4640 1 --2- 172.21.15.26:0/3566211090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cb00d3010 0x7f2cb009ea00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000c460 tx=0x7f2ca000c920 comp rx=0 tx=0).stop 2023-10-14T11:14:36.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.515+0000 7f2cb73c4640 1 -- 172.21.15.26:0/3566211090 shutdown_connections 2023-10-14T11:14:36.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.515+0000 7f2cb73c4640 1 --2- 172.21.15.26:0/3566211090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cb015cb90 0x7f2cb00ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:36.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.515+0000 7f2cb73c4640 1 --2- 172.21.15.26:0/3566211090 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2c940664a0 0x7f2c94068960 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:36.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.515+0000 7f2cb73c4640 1 --2- 172.21.15.26:0/3566211090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cb00d3010 0x7f2cb009ea00 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:36.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.515+0000 7f2cb73c4640 1 --2- 172.21.15.26:0/3566211090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cb00d15d0 0x7f2cb009e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:36.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.515+0000 7f2cb73c4640 1 -- 172.21.15.26:0/3566211090 >> 172.21.15.26:0/3566211090 conn(0x7f2cb009bc50 msgr2=0x7f2cb00b7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:36.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.515+0000 7f2cb73c4640 1 -- 172.21.15.26:0/3566211090 shutdown_connections 2023-10-14T11:14:36.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.515+0000 7f2cb73c4640 1 -- 172.21.15.26:0/3566211090 wait complete. 2023-10-14T11:14:36.528 INFO:tasks.ceph.mds.a.smithi026.stderr: -3573> 2023-10-14T11:13:55.197+0000 7f391bc78640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T11:14:36.541 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm testcephfs1 --yes-i-really-mean-it 2023-10-14T11:14:36.578 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-14T11:14:36.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.683+0000 7f131fdf1640 1 Processor -- start 2023-10-14T11:14:36.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.683+0000 7f131fdf1640 1 -- start start 2023-10-14T11:14:36.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.683+0000 7f131fdf1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f13180cb040 0x7f13180ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:36.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.683+0000 7f131fdf1640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13180cc330 con 0x7f131815cc60 2023-10-14T11:14:36.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.683+0000 7f131fdf1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13180cb4d0 con 0x7f13180cebd0 2023-10-14T11:14:36.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.683+0000 7f131fdf1640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13180cefe0 con 0x7f13180cb040 2023-10-14T11:14:36.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.683+0000 7f131db8d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f131815cc60 0x7f1318161260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36566/0 (socket says 172.21.15.26:36566) 2023-10-14T11:14:36.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.683+0000 7f131db8d640 1 -- 172.21.15.26:0/2771917680 learned_addr learned my addr 172.21.15.26:0/2771917680 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:36.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.683+0000 7f131d38c640 1 --2- 172.21.15.26:0/2771917680 >> v2:172.21.15.26:3300/0 conn(0x7f13180cb040 0x7f13180ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:36.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.683+0000 7f131d38c640 1 -- 172.21.15.26:0/2771917680 >> v1:172.21.15.110:6789/0 conn(0x7f13180cebd0 legacy=0x7f13180cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:36.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.683+0000 7f131d38c640 1 -- 172.21.15.26:0/2771917680 >> v1:172.21.15.26:6789/0 conn(0x7f131815cc60 legacy=0x7f1318161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:36.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.683+0000 7f131d38c640 1 -- 172.21.15.26:0/2771917680 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13180cb720 con 0x7f13180cb040 2023-10-14T11:14:36.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.687+0000 7f131d38c640 1 --2- 172.21.15.26:0/2771917680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13180cb040 0x7f13180ce690 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f13080097c0 tx=0x7f130801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac2676c3720d527 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:36.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.687+0000 7f131cb8b640 1 -- 172.21.15.26:0/2771917680 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13080ab650 con 0x7f13180cb040 2023-10-14T11:14:36.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.687+0000 7f131cb8b640 1 -- 172.21.15.26:0/2771917680 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13080ab7b0 con 0x7f13180cb040 2023-10-14T11:14:36.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.687+0000 7f131cb8b640 1 -- 172.21.15.26:0/2771917680 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13080abb40 con 0x7f13180cb040 2023-10-14T11:14:36.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.687+0000 7f131fdf1640 1 -- 172.21.15.26:0/2771917680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13180cb040 msgr2=0x7f13180ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:36.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.687+0000 7f131fdf1640 1 --2- 172.21.15.26:0/2771917680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13180cb040 0x7f13180ce690 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f13080097c0 tx=0x7f130801c450 comp rx=0 tx=0).stop 2023-10-14T11:14:36.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.687+0000 7f131fdf1640 1 -- 172.21.15.26:0/2771917680 shutdown_connections 2023-10-14T11:14:36.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.687+0000 7f131fdf1640 1 --2- 172.21.15.26:0/2771917680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13180cb040 0x7f13180ce690 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:36.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.687+0000 7f131fdf1640 1 -- 172.21.15.26:0/2771917680 >> 172.21.15.26:0/2771917680 conn(0x7f131806e570 msgr2=0x7f131806e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:36.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.687+0000 7f131fdf1640 1 -- 172.21.15.26:0/2771917680 shutdown_connections 2023-10-14T11:14:36.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.687+0000 7f131fdf1640 1 -- 172.21.15.26:0/2771917680 wait complete. 2023-10-14T11:14:36.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f131fdf1640 1 Processor -- start 2023-10-14T11:14:36.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f131fdf1640 1 -- start start 2023-10-14T11:14:36.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f131fdf1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13180cb040 0x7f13181407f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:36.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f131fdf1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13180cebd0 0x7f1318155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:36.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f131fdf1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f131815cc60 0x7f1318156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:36.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f131fdf1640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13180b28e0 con 0x7f13180cebd0 2023-10-14T11:14:36.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f131fdf1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13180b1fb0 con 0x7f13180cb040 2023-10-14T11:14:36.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f131fdf1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13180b2290 con 0x7f131815cc60 2023-10-14T11:14:36.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f131d38c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13180cebd0 0x7f1318155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:36.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f131d38c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13180cebd0 0x7f1318155c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42974/0 (socket says 172.21.15.26:42974) 2023-10-14T11:14:36.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f131d38c640 1 -- 172.21.15.26:0/2396665852 learned_addr learned my addr 172.21.15.26:0/2396665852 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:36.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f131db8d640 1 --2- 172.21.15.26:0/2396665852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13180cb040 0x7f13181407f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:36.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f131e38e640 1 --2- 172.21.15.26:0/2396665852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f131815cc60 0x7f1318156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:36.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f131d38c640 1 -- 172.21.15.26:0/2396665852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f131815cc60 msgr2=0x7f1318156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:36.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f131d38c640 1 --2- 172.21.15.26:0/2396665852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f131815cc60 0x7f1318156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:36.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f131d38c640 1 -- 172.21.15.26:0/2396665852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13180cb040 msgr2=0x7f13181407f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:36.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f131d38c640 1 --2- 172.21.15.26:0/2396665852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13180cb040 0x7f13181407f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:36.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f131d38c640 1 -- 172.21.15.26:0/2396665852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1308009420 con 0x7f13180cebd0 2023-10-14T11:14:36.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f131e38e640 1 --2- 172.21.15.26:0/2396665852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f131815cc60 0x7f1318156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:36.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f131d38c640 1 --2- 172.21.15.26:0/2396665852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13180cebd0 0x7f1318155c50 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f13080ad040 tx=0x7f130801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:36.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f130e7fc640 1 -- 172.21.15.26:0/2396665852 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13080b5810 con 0x7f13180cebd0 2023-10-14T11:14:36.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f130e7fc640 1 -- 172.21.15.26:0/2396665852 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13080b59b0 con 0x7f13180cebd0 2023-10-14T11:14:36.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f130e7fc640 1 -- 172.21.15.26:0/2396665852 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13080b5d60 con 0x7f13180cebd0 2023-10-14T11:14:36.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f131fdf1640 1 -- 172.21.15.26:0/2396665852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13180b2570 con 0x7f13180cebd0 2023-10-14T11:14:36.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.691+0000 7f131fdf1640 1 -- 172.21.15.26:0/2396665852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13180b1bd0 con 0x7f13180cebd0 2023-10-14T11:14:36.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.695+0000 7f131fdf1640 1 -- 172.21.15.26:0/2396665852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f131804e170 con 0x7f13180cebd0 2023-10-14T11:14:36.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.695+0000 7f130e7fc640 1 -- 172.21.15.26:0/2396665852 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f13080b4390 con 0x7f13180cebd0 2023-10-14T11:14:36.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.695+0000 7f130e7fc640 1 --2- 172.21.15.26:0/2396665852 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f12fc0664a0 0x7f12fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:36.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.695+0000 7f130e7fc640 1 -- 172.21.15.26:0/2396665852 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6535+0+0 (secure 0 0 0) 0x7f130811ed60 con 0x7f13180cebd0 2023-10-14T11:14:36.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.695+0000 7f131db8d640 1 --2- 172.21.15.26:0/2396665852 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f12fc0664a0 0x7f12fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:36.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.695+0000 7f131db8d640 1 --2- 172.21.15.26:0/2396665852 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f12fc0664a0 0x7f12fc068960 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1314005890 tx=0x7f1314009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:36.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.699+0000 7f130e7fc640 1 -- 172.21.15.26:0/2396665852 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f13080ebf50 con 0x7f13180cebd0 2023-10-14T11:14:36.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:36.891+0000 7f131fdf1640 1 -- 172.21.15.26:0/2396665852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "testcephfs1", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f13180b2730 con 0x7f13180cebd0 2023-10-14T11:14:37.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.511+0000 7f130e7fc640 1 -- 172.21.15.26:0/2396665852 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "testcephfs1", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 109+0+0 (secure 0 0 0) 0x7f13080ef570 con 0x7f13180cebd0 2023-10-14T11:14:37.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.515+0000 7f131fdf1640 1 -- 172.21.15.26:0/2396665852 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f12fc0664a0 msgr2=0x7f12fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:37.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.515+0000 7f131fdf1640 1 --2- 172.21.15.26:0/2396665852 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f12fc0664a0 0x7f12fc068960 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1314005890 tx=0x7f1314009040 comp rx=0 tx=0).stop 2023-10-14T11:14:37.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.515+0000 7f131fdf1640 1 -- 172.21.15.26:0/2396665852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13180cebd0 msgr2=0x7f1318155c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.515+0000 7f131fdf1640 1 --2- 172.21.15.26:0/2396665852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13180cebd0 0x7f1318155c50 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f13080ad040 tx=0x7f130801ac90 comp rx=0 tx=0).stop 2023-10-14T11:14:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.515+0000 7f131fdf1640 1 -- 172.21.15.26:0/2396665852 shutdown_connections 2023-10-14T11:14:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.515+0000 7f131fdf1640 1 --2- 172.21.15.26:0/2396665852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f131815cc60 0x7f1318156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.515+0000 7f131fdf1640 1 --2- 172.21.15.26:0/2396665852 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f12fc0664a0 0x7f12fc068960 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.515+0000 7f131fdf1640 1 --2- 172.21.15.26:0/2396665852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13180cebd0 0x7f1318155c50 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.515+0000 7f131fdf1640 1 --2- 172.21.15.26:0/2396665852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13180cb040 0x7f13181407f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:37.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.515+0000 7f131fdf1640 1 -- 172.21.15.26:0/2396665852 >> 172.21.15.26:0/2396665852 conn(0x7f131806e570 msgr2=0x7f131815d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:37.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.515+0000 7f131fdf1640 1 -- 172.21.15.26:0/2396665852 shutdown_connections 2023-10-14T11:14:37.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.515+0000 7f131fdf1640 1 -- 172.21.15.26:0/2396665852 wait complete. 2023-10-14T11:14:37.546 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm testcephfs1_metadata testcephfs1_metadata --yes-i-really-really-mean-it 2023-10-14T11:14:37.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.735+0000 7f7eba2ea640 1 Processor -- start 2023-10-14T11:14:37.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.735+0000 7f7eba2ea640 1 -- start start 2023-10-14T11:14:37.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.735+0000 7f7eba2ea640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7eb40cfd20 0x7f7eb40d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:37.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.735+0000 7f7eba2ea640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb40ce460 con 0x7f7eb40cdc80 2023-10-14T11:14:37.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.735+0000 7f7eba2ea640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb415da30 con 0x7f7eb40d2570 2023-10-14T11:14:37.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.735+0000 7f7eba2ea640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb40cd830 con 0x7f7eb40cfd20 2023-10-14T11:14:37.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.735+0000 7f7eb37fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7eb40cdc80 0x7f7eb40cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36574/0 (socket says 172.21.15.26:36574) 2023-10-14T11:14:37.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.735+0000 7f7eb37fe640 1 -- 172.21.15.26:0/780073996 learned_addr learned my addr 172.21.15.26:0/780073996 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:37.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.735+0000 7f7eb8887640 1 --2- 172.21.15.26:0/780073996 >> v2:172.21.15.110:3300/0 conn(0x7f7eb40cfd20 0x7f7eb40d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:37.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.735+0000 7f7eb2ffd640 1 -- 172.21.15.26:0/780073996 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173903736 0 0) 0x7f7eb40ce460 con 0x7f7eb40cdc80 2023-10-14T11:14:37.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.735+0000 7f7eb2ffd640 1 -- 172.21.15.26:0/780073996 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e9c003530 con 0x7f7eb40cdc80 2023-10-14T11:14:37.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.735+0000 7f7eb2ffd640 1 -- 172.21.15.26:0/780073996 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3262902863 0 0) 0x7f7e9c003530 con 0x7f7eb40cdc80 2023-10-14T11:14:37.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.735+0000 7f7eb2ffd640 1 -- 172.21.15.26:0/780073996 >> v2:172.21.15.110:3300/0 conn(0x7f7eb40cfd20 msgr2=0x7f7eb40d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:37.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.735+0000 7f7eb2ffd640 1 --2- 172.21.15.26:0/780073996 >> v2:172.21.15.110:3300/0 conn(0x7f7eb40cfd20 0x7f7eb40d0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:37.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.735+0000 7f7eb2ffd640 1 -- 172.21.15.26:0/780073996 >> v1:172.21.15.110:6789/0 conn(0x7f7eb40d2570 legacy=0x7f7eb4161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:37.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.735+0000 7f7eb2ffd640 1 -- 172.21.15.26:0/780073996 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb40ce180 con 0x7f7eb40cdc80 2023-10-14T11:14:37.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.735+0000 7f7eb2ffd640 1 -- 172.21.15.26:0/780073996 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f7ea8001680 con 0x7f7eb40cdc80 2023-10-14T11:14:37.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.735+0000 7f7eb2ffd640 1 -- 172.21.15.26:0/780073996 >> v1:172.21.15.26:6789/0 conn(0x7f7eb40cdc80 legacy=0x7f7eb40cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:37.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.739+0000 7f7eb2ffd640 1 --2- 172.21.15.26:0/780073996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e9c003980 0x7f7e9c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:37.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.739+0000 7f7eb2ffd640 1 --2- 172.21.15.26:0/780073996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e9c004380 0x7f7e9c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:37.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.739+0000 7f7eb2ffd640 1 --2- 172.21.15.26:0/780073996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e9c005050 0x7f7e9c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:37.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.739+0000 7f7eb2ffd640 1 -- 172.21.15.26:0/780073996 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40cd830 con 0x7f7e9c005050 2023-10-14T11:14:37.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.739+0000 7f7eb2ffd640 1 -- 172.21.15.26:0/780073996 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c00bfb0 con 0x7f7e9c004380 2023-10-14T11:14:37.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.739+0000 7f7eb2ffd640 1 -- 172.21.15.26:0/780073996 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c00c170 con 0x7f7e9c003980 2023-10-14T11:14:37.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.739+0000 7f7eb8887640 1 --2- 172.21.15.26:0/780073996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e9c005050 0x7f7e9c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:37.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.739+0000 7f7eb3fff640 1 --2- 172.21.15.26:0/780073996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e9c003980 0x7f7e9c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:37.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.739+0000 7f7eb37fe640 1 --2- 172.21.15.26:0/780073996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e9c004380 0x7f7e9c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:37.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.739+0000 7f7eb8887640 1 -- 172.21.15.26:0/780073996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e9c003980 msgr2=0x7f7e9c003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:37.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.739+0000 7f7eb8887640 1 --2- 172.21.15.26:0/780073996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e9c003980 0x7f7e9c003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:37.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.739+0000 7f7eb8887640 1 -- 172.21.15.26:0/780073996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e9c004380 msgr2=0x7f7e9c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:37.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.739+0000 7f7eb8887640 1 --2- 172.21.15.26:0/780073996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e9c004380 0x7f7e9c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:37.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.739+0000 7f7eb8887640 1 -- 172.21.15.26:0/780073996 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c003530 con 0x7f7e9c005050 2023-10-14T11:14:37.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.739+0000 7f7eb8887640 1 -- 172.21.15.26:0/780073996 reap_dead start 2023-10-14T11:14:37.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.739+0000 7f7eb8887640 1 --2- 172.21.15.26:0/780073996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e9c005050 0x7f7e9c00b990 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40d0130 tx=0x7f7eac01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d7d9fa9cf085dd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:37.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.739+0000 7f7eb2ffd640 1 -- 172.21.15.26:0/780073996 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea8007ea0 con 0x7f7e9c005050 2023-10-14T11:14:37.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.739+0000 7f7eb2ffd640 1 -- 172.21.15.26:0/780073996 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac00f040 con 0x7f7e9c005050 2023-10-14T11:14:37.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.739+0000 7f7eb2ffd640 1 -- 172.21.15.26:0/780073996 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac0a5e90 con 0x7f7e9c005050 2023-10-14T11:14:37.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.743+0000 7f7eba2ea640 1 -- 172.21.15.26:0/780073996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e9c005050 msgr2=0x7f7e9c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:37.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.743+0000 7f7eba2ea640 1 --2- 172.21.15.26:0/780073996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e9c005050 0x7f7e9c00b990 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40d0130 tx=0x7f7eac01cc40 comp rx=0 tx=0).stop 2023-10-14T11:14:37.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.743+0000 7f7eba2ea640 1 -- 172.21.15.26:0/780073996 shutdown_connections 2023-10-14T11:14:37.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.743+0000 7f7eba2ea640 1 --2- 172.21.15.26:0/780073996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e9c005050 0x7f7e9c00b990 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:37.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.743+0000 7f7eba2ea640 1 -- 172.21.15.26:0/780073996 >> 172.21.15.26:0/780073996 conn(0x7f7eb40715c0 msgr2=0x7f7eb40719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:37.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.743+0000 7f7eba2ea640 1 -- 172.21.15.26:0/780073996 shutdown_connections 2023-10-14T11:14:37.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.743+0000 7f7eba2ea640 1 -- 172.21.15.26:0/780073996 wait complete. 2023-10-14T11:14:37.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.743+0000 7f7eba2ea640 1 Processor -- start 2023-10-14T11:14:37.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.743+0000 7f7eba2ea640 1 -- start start 2023-10-14T11:14:37.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.743+0000 7f7eba2ea640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e9c005050 0x7f7eb4157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:37.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.743+0000 7f7eba2ea640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7eb40c7890 0x7f7eb40c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:37.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.743+0000 7f7eba2ea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eb40c9060 0x7f7eb4160650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:37.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.743+0000 7f7eba2ea640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40c9510 con 0x7f7eb40c9060 2023-10-14T11:14:37.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.743+0000 7f7eba2ea640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40c67f0 con 0x7f7eb40c7890 2023-10-14T11:14:37.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.743+0000 7f7eba2ea640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40c6ad0 con 0x7f7e9c005050 2023-10-14T11:14:37.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.743+0000 7f7eb8887640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eb40c9060 0x7f7eb4160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:37.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.743+0000 7f7eb8887640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eb40c9060 0x7f7eb4160650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42990/0 (socket says 172.21.15.26:42990) 2023-10-14T11:14:37.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.743+0000 7f7eb8887640 1 -- 172.21.15.26:0/3280268044 learned_addr learned my addr 172.21.15.26:0/3280268044 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:37.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.743+0000 7f7eb3fff640 1 --2- 172.21.15.26:0/3280268044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e9c005050 0x7f7eb4157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:37.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.743+0000 7f7eb37fe640 1 --2- 172.21.15.26:0/3280268044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7eb40c7890 0x7f7eb40c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:37.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.747+0000 7f7eb8887640 1 -- 172.21.15.26:0/3280268044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e9c005050 msgr2=0x7f7eb4157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:37.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.747+0000 7f7eb8887640 1 --2- 172.21.15.26:0/3280268044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e9c005050 0x7f7eb4157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:37.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.747+0000 7f7eb8887640 1 -- 172.21.15.26:0/3280268044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7eb40c7890 msgr2=0x7f7eb40c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:37.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.747+0000 7f7eb8887640 1 --2- 172.21.15.26:0/3280268044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7eb40c7890 0x7f7eb40c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:37.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.747+0000 7f7eb8887640 1 -- 172.21.15.26:0/3280268044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb40c6db0 con 0x7f7eb40c9060 2023-10-14T11:14:37.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.747+0000 7f7eb37fe640 1 --2- 172.21.15.26:0/3280268044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7eb40c7890 0x7f7eb40c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:37.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.747+0000 7f7eb8887640 1 --2- 172.21.15.26:0/3280268044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eb40c9060 0x7f7eb4160650 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7eac01d4e0 tx=0x7f7eac009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:37.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.747+0000 7f7eb0ff9640 1 -- 172.21.15.26:0/3280268044 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac0b8670 con 0x7f7eb40c9060 2023-10-14T11:14:37.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.747+0000 7f7eb0ff9640 1 -- 172.21.15.26:0/3280268044 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac0b87f0 con 0x7f7eb40c9060 2023-10-14T11:14:37.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.747+0000 7f7eb0ff9640 1 -- 172.21.15.26:0/3280268044 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac0b8ba0 con 0x7f7eb40c9060 2023-10-14T11:14:37.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.747+0000 7f7eba2ea640 1 -- 172.21.15.26:0/3280268044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb40c7090 con 0x7f7eb40c9060 2023-10-14T11:14:37.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.747+0000 7f7eba2ea640 1 -- 172.21.15.26:0/3280268044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb4158510 con 0x7f7eb40c9060 2023-10-14T11:14:37.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.747+0000 7f7eba2ea640 1 -- 172.21.15.26:0/3280268044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb40c75b0 con 0x7f7eb40c9060 2023-10-14T11:14:37.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.747+0000 7f7eb0ff9640 1 -- 172.21.15.26:0/3280268044 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7eac0b8d00 con 0x7f7eb40c9060 2023-10-14T11:14:37.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.747+0000 7f7eb0ff9640 1 --2- 172.21.15.26:0/3280268044 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7ea00664d0 0x7f7ea0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:37.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.747+0000 7f7eb0ff9640 1 -- 172.21.15.26:0/3280268044 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6535+0+0 (secure 0 0 0) 0x7f7eac11f680 con 0x7f7eb40c9060 2023-10-14T11:14:37.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.747+0000 7f7eb3fff640 1 --2- 172.21.15.26:0/3280268044 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7ea00664d0 0x7f7ea0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:37.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.751+0000 7f7eb3fff640 1 --2- 172.21.15.26:0/3280268044 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7ea00664d0 0x7f7ea0068990 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7eb41611f0 tx=0x7f7ea4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:37.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.751+0000 7f7eb0ff9640 1 -- 172.21.15.26:0/3280268044 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7eb40c75b0 con 0x7f7eb40c9060 2023-10-14T11:14:37.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:37.911+0000 7f7eba2ea640 1 -- 172.21.15.26:0/3280268044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "testcephfs1_metadata", "pool2": "testcephfs1_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7eb40c75b0 con 0x7f7eb40c9060 2023-10-14T11:14:38.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.515+0000 7f7eb0ff9640 1 -- 172.21.15.26:0/3280268044 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "testcephfs1_metadata", "pool2": "testcephfs1_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'testcephfs1_metadata' removed v44) v1 ==== 196+0+0 (secure 0 0 0) 0x7f7eb40c75b0 con 0x7f7eb40c9060 2023-10-14T11:14:38.522 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'testcephfs1_metadata' removed 2023-10-14T11:14:38.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.519+0000 7f7eba2ea640 1 -- 172.21.15.26:0/3280268044 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7ea00664d0 msgr2=0x7f7ea0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:38.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.519+0000 7f7eba2ea640 1 --2- 172.21.15.26:0/3280268044 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7ea00664d0 0x7f7ea0068990 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7eb41611f0 tx=0x7f7ea4009040 comp rx=0 tx=0).stop 2023-10-14T11:14:38.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.519+0000 7f7eba2ea640 1 -- 172.21.15.26:0/3280268044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eb40c9060 msgr2=0x7f7eb4160650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:38.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.519+0000 7f7eba2ea640 1 --2- 172.21.15.26:0/3280268044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eb40c9060 0x7f7eb4160650 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7eac01d4e0 tx=0x7f7eac009750 comp rx=0 tx=0).stop 2023-10-14T11:14:38.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.519+0000 7f7eba2ea640 1 -- 172.21.15.26:0/3280268044 shutdown_connections 2023-10-14T11:14:38.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.519+0000 7f7eba2ea640 1 --2- 172.21.15.26:0/3280268044 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7ea00664d0 0x7f7ea0068990 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:38.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.519+0000 7f7eba2ea640 1 --2- 172.21.15.26:0/3280268044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eb40c9060 0x7f7eb4160650 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:38.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.519+0000 7f7eba2ea640 1 --2- 172.21.15.26:0/3280268044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7eb40c7890 0x7f7eb40c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:38.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.519+0000 7f7eba2ea640 1 --2- 172.21.15.26:0/3280268044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e9c005050 0x7f7eb4157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:38.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.519+0000 7f7eba2ea640 1 -- 172.21.15.26:0/3280268044 >> 172.21.15.26:0/3280268044 conn(0x7f7eb40715c0 msgr2=0x7f7eb41592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:38.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.519+0000 7f7eba2ea640 1 -- 172.21.15.26:0/3280268044 shutdown_connections 2023-10-14T11:14:38.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.519+0000 7f7eba2ea640 1 -- 172.21.15.26:0/3280268044 wait complete. 2023-10-14T11:14:38.550 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm testcephfs1_data testcephfs1_data --yes-i-really-really-mean-it 2023-10-14T11:14:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.695+0000 7f9213dd9640 1 Processor -- start 2023-10-14T11:14:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.695+0000 7f9213dd9640 1 -- start start 2023-10-14T11:14:38.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.695+0000 7f9213dd9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f920c1441a0 0x7f920c0b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:38.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.695+0000 7f9213dd9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f920c0b1a90 0x7f920c0cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:38.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.695+0000 7f9213dd9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f920c0b1ef0 con 0x7f920c0cb360 2023-10-14T11:14:38.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.695+0000 7f9213dd9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f920c15e5f0 con 0x7f920c1441a0 2023-10-14T11:14:38.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.695+0000 7f9213dd9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920c15e8d0 con 0x7f920c0b1a90 2023-10-14T11:14:38.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.695+0000 7f9211374640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f920c0b1a90 0x7f920c0cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:38.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.695+0000 7f9211b75640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f920c1441a0 0x7f920c0b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:38.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.695+0000 7f9211374640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f920c0b1a90 0x7f920c0cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:50422/0 (socket says 172.21.15.26:50422) 2023-10-14T11:14:38.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.695+0000 7f9211374640 1 -- 172.21.15.26:0/62763783 learned_addr learned my addr 172.21.15.26:0/62763783 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:38.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.695+0000 7f9212376640 1 --1- 172.21.15.26:0/62763783 >> v1:172.21.15.110:6789/0 conn(0x7f920c0cb360 0x7f920c06c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:55828/0 (socket says 172.21.15.26:55828) 2023-10-14T11:14:38.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.695+0000 7f9211b75640 1 -- 172.21.15.26:0/62763783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f920c0b1a90 msgr2=0x7f920c0cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:38.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.695+0000 7f9211b75640 1 --2- 172.21.15.26:0/62763783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f920c0b1a90 0x7f920c0cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:38.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.695+0000 7f9211b75640 1 -- 172.21.15.26:0/62763783 >> v1:172.21.15.110:6789/0 conn(0x7f920c0cb360 legacy=0x7f920c06c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:38.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.695+0000 7f9211b75640 1 -- 172.21.15.26:0/62763783 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920c15ebb0 con 0x7f920c1441a0 2023-10-14T11:14:38.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.695+0000 7f9211374640 1 --2- 172.21.15.26:0/62763783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f920c0b1a90 0x7f920c0cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:14:38.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.695+0000 7f9210b73640 1 -- 172.21.15.26:0/62763783 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435359711 0 0) 0x7f920c0b1ef0 con 0x7f920c0cb360 2023-10-14T11:14:38.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.699+0000 7f9211b75640 1 --2- 172.21.15.26:0/62763783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f920c1441a0 0x7f920c0b1550 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f92080097c0 tx=0x7f920801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a7fef1780590d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:38.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.699+0000 7f9210b73640 1 -- 172.21.15.26:0/62763783 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92080ab600 con 0x7f920c1441a0 2023-10-14T11:14:38.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.699+0000 7f9210b73640 1 -- 172.21.15.26:0/62763783 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92080a7050 con 0x7f920c1441a0 2023-10-14T11:14:38.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.699+0000 7f9210b73640 1 -- 172.21.15.26:0/62763783 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92080ab980 con 0x7f920c1441a0 2023-10-14T11:14:38.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.699+0000 7f9213dd9640 1 -- 172.21.15.26:0/62763783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f920c1441a0 msgr2=0x7f920c0b1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:38.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.699+0000 7f9213dd9640 1 --2- 172.21.15.26:0/62763783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f920c1441a0 0x7f920c0b1550 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f92080097c0 tx=0x7f920801c480 comp rx=0 tx=0).stop 2023-10-14T11:14:38.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.699+0000 7f9213dd9640 1 -- 172.21.15.26:0/62763783 shutdown_connections 2023-10-14T11:14:38.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.699+0000 7f9213dd9640 1 --2- 172.21.15.26:0/62763783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f920c0b1a90 0x7f920c0cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:38.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.699+0000 7f9213dd9640 1 --2- 172.21.15.26:0/62763783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f920c1441a0 0x7f920c0b1550 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:38.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.699+0000 7f9213dd9640 1 -- 172.21.15.26:0/62763783 >> 172.21.15.26:0/62763783 conn(0x7f920c06a820 msgr2=0x7f920c0b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:38.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.699+0000 7f9213dd9640 1 -- 172.21.15.26:0/62763783 shutdown_connections 2023-10-14T11:14:38.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.699+0000 7f9213dd9640 1 -- 172.21.15.26:0/62763783 wait complete. 2023-10-14T11:14:38.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f9213dd9640 1 Processor -- start 2023-10-14T11:14:38.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f9213dd9640 1 -- start start 2023-10-14T11:14:38.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f9213dd9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f920c0b1a90 0x7f920c13f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:38.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f9213dd9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f920c0cb360 0x7f920c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:38.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f9213dd9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f920c1441a0 0x7f920c13a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:38.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f9213dd9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920c0cc850 con 0x7f920c0cb360 2023-10-14T11:14:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f9213dd9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920c142510 con 0x7f920c1441a0 2023-10-14T11:14:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f9213dd9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920c071a60 con 0x7f920c0b1a90 2023-10-14T11:14:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f9211374640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f920c0cb360 0x7f920c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f9211374640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f920c0cb360 0x7f920c0710c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43006/0 (socket says 172.21.15.26:43006) 2023-10-14T11:14:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f9211374640 1 -- 172.21.15.26:0/2904413190 learned_addr learned my addr 172.21.15.26:0/2904413190 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f9211b75640 1 --2- 172.21.15.26:0/2904413190 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f920c0b1a90 0x7f920c13f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f9212376640 1 --2- 172.21.15.26:0/2904413190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f920c1441a0 0x7f920c13a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f9211374640 1 -- 172.21.15.26:0/2904413190 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f920c0b1a90 msgr2=0x7f920c13f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:38.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f9211374640 1 --2- 172.21.15.26:0/2904413190 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f920c0b1a90 0x7f920c13f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:38.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f9211374640 1 -- 172.21.15.26:0/2904413190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f920c1441a0 msgr2=0x7f920c13a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:38.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f9211374640 1 --2- 172.21.15.26:0/2904413190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f920c1441a0 0x7f920c13a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:38.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f9211374640 1 -- 172.21.15.26:0/2904413190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc0094d0 con 0x7f920c0cb360 2023-10-14T11:14:38.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f9211374640 1 --2- 172.21.15.26:0/2904413190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f920c0cb360 0x7f920c0710c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f91fc00e930 tx=0x7f91fc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f92027fc640 1 -- 172.21.15.26:0/2904413190 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc00ca00 con 0x7f920c0cb360 2023-10-14T11:14:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f92027fc640 1 -- 172.21.15.26:0/2904413190 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91fc00cb60 con 0x7f920c0cb360 2023-10-14T11:14:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f92027fc640 1 -- 172.21.15.26:0/2904413190 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc013470 con 0x7f920c0cb360 2023-10-14T11:14:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f9213dd9640 1 -- 172.21.15.26:0/2904413190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9208009420 con 0x7f920c0cb360 2023-10-14T11:14:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.703+0000 7f9213dd9640 1 -- 172.21.15.26:0/2904413190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920c071df0 con 0x7f920c0cb360 2023-10-14T11:14:38.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.707+0000 7f9213dd9640 1 -- 172.21.15.26:0/2904413190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f920c04e170 con 0x7f920c0cb360 2023-10-14T11:14:38.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.707+0000 7f92027fc640 1 -- 172.21.15.26:0/2904413190 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f91fc0135d0 con 0x7f920c0cb360 2023-10-14T11:14:38.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.707+0000 7f92027fc640 1 --2- 172.21.15.26:0/2904413190 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f91f00664a0 0x7f91f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:38.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.707+0000 7f92027fc640 1 -- 172.21.15.26:0/2904413190 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f91fc0841f0 con 0x7f920c0cb360 2023-10-14T11:14:38.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.707+0000 7f9211b75640 1 --2- 172.21.15.26:0/2904413190 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f91f00664a0 0x7f91f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:38.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.707+0000 7f9211b75640 1 --2- 172.21.15.26:0/2904413190 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f91f00664a0 0x7f91f0068960 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f92080ad000 tx=0x7f92080a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:38.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.711+0000 7f92027fc640 1 -- 172.21.15.26:0/2904413190 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f91fc051590 con 0x7f920c0cb360 2023-10-14T11:14:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:38.867+0000 7f9213dd9640 1 -- 172.21.15.26:0/2904413190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "testcephfs1_data", "pool2": "testcephfs1_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f920c0cc530 con 0x7f920c0cb360 2023-10-14T11:14:39.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.523+0000 7f92027fc640 1 -- 172.21.15.26:0/2904413190 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "testcephfs1_data", "pool2": "testcephfs1_data", "yes_i_really_really_mean_it": true}]=0 pool 'testcephfs1_data' removed v45) v1 ==== 184+0+0 (secure 0 0 0) 0x7f91fc054bb0 con 0x7f920c0cb360 2023-10-14T11:14:39.529 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'testcephfs1_data' removed 2023-10-14T11:14:39.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.523+0000 7f9213dd9640 1 -- 172.21.15.26:0/2904413190 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f91f00664a0 msgr2=0x7f91f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:39.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.523+0000 7f9213dd9640 1 --2- 172.21.15.26:0/2904413190 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f91f00664a0 0x7f91f0068960 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f92080ad000 tx=0x7f92080a6000 comp rx=0 tx=0).stop 2023-10-14T11:14:39.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.523+0000 7f9213dd9640 1 -- 172.21.15.26:0/2904413190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f920c0cb360 msgr2=0x7f920c0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:39.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.523+0000 7f9213dd9640 1 --2- 172.21.15.26:0/2904413190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f920c0cb360 0x7f920c0710c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f91fc00e930 tx=0x7f91fc00edf0 comp rx=0 tx=0).stop 2023-10-14T11:14:39.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.527+0000 7f9213dd9640 1 -- 172.21.15.26:0/2904413190 shutdown_connections 2023-10-14T11:14:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.527+0000 7f9213dd9640 1 --2- 172.21.15.26:0/2904413190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f920c1441a0 0x7f920c13a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.527+0000 7f9213dd9640 1 --2- 172.21.15.26:0/2904413190 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f91f00664a0 0x7f91f0068960 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.527+0000 7f9213dd9640 1 --2- 172.21.15.26:0/2904413190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f920c0cb360 0x7f920c0710c0 secure :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f91fc00e930 tx=0x7f91fc00edf0 comp rx=0 tx=0).stop 2023-10-14T11:14:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.527+0000 7f9213dd9640 1 --2- 172.21.15.26:0/2904413190 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f920c0b1a90 0x7f920c13f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.527+0000 7f9213dd9640 1 -- 172.21.15.26:0/2904413190 >> 172.21.15.26:0/2904413190 conn(0x7f920c06a820 msgr2=0x7f920c156d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:39.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.527+0000 7f9213dd9640 1 -- 172.21.15.26:0/2904413190 shutdown_connections 2023-10-14T11:14:39.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.527+0000 7f9213dd9640 1 -- 172.21.15.26:0/2904413190 wait complete. 2023-10-14T11:14:39.558 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm data_new data_new --yes-i-really-really-mean-it 2023-10-14T11:14:39.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.699+0000 7fe9ffdf8640 1 Processor -- start 2023-10-14T11:14:39.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.699+0000 7fe9ffdf8640 1 -- start start 2023-10-14T11:14:39.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.699+0000 7fe9ffdf8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9f80ae470 0x7fe9f8165cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:39.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9ffdf8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f80ce6b0 con 0x7fe9f80d13f0 2023-10-14T11:14:39.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9ffdf8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f815f850 con 0x7fe9f80cd540 2023-10-14T11:14:39.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9ffdf8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f80cebe0 con 0x7fe9f80ae470 2023-10-14T11:14:39.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fd393640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe9f80d13f0 0x7fe9f815f140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36578/0 (socket says 172.21.15.26:36578) 2023-10-14T11:14:39.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fd393640 1 -- 172.21.15.26:0/2468169949 learned_addr learned my addr 172.21.15.26:0/2468169949 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:39.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fcb92640 1 -- 172.21.15.26:0/2468169949 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281426223 0 0) 0x7fe9f80ce6b0 con 0x7fe9f80d13f0 2023-10-14T11:14:39.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fe395640 1 --2- 172.21.15.26:0/2468169949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9f80ae470 0x7fe9f8165cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:39.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fcb92640 1 -- 172.21.15.26:0/2468169949 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9e4003530 con 0x7fe9f80d13f0 2023-10-14T11:14:39.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fcb92640 1 -- 172.21.15.26:0/2468169949 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3723287044 0 0) 0x7fe9e4003530 con 0x7fe9f80d13f0 2023-10-14T11:14:39.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fcb92640 1 -- 172.21.15.26:0/2468169949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9f80ae470 msgr2=0x7fe9f8165cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:39.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fcb92640 1 --2- 172.21.15.26:0/2468169949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9f80ae470 0x7fe9f8165cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:39.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fcb92640 1 -- 172.21.15.26:0/2468169949 >> v1:172.21.15.110:6789/0 conn(0x7fe9f80cd540 legacy=0x7fe9f815ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:39.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fcb92640 1 -- 172.21.15.26:0/2468169949 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f80cc6d0 con 0x7fe9f80d13f0 2023-10-14T11:14:39.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fcb92640 1 -- 172.21.15.26:0/2468169949 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7fe9e8001680 con 0x7fe9f80d13f0 2023-10-14T11:14:39.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fcb92640 1 -- 172.21.15.26:0/2468169949 >> v1:172.21.15.26:6789/0 conn(0x7fe9f80d13f0 legacy=0x7fe9f815f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:39.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fcb92640 1 --2- 172.21.15.26:0/2468169949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9e40039b0 0x7fe9e4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:39.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fcb92640 1 --2- 172.21.15.26:0/2468169949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9e4004360 0x7fe9e4004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:39.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fcb92640 1 --2- 172.21.15.26:0/2468169949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9f80ae470 0x7fe9e4005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:39.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fcb92640 1 -- 172.21.15.26:0/2468169949 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f80cebe0 con 0x7fe9e40039b0 2023-10-14T11:14:39.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fcb92640 1 -- 172.21.15.26:0/2468169949 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e400b990 con 0x7fe9e4004360 2023-10-14T11:14:39.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fcb92640 1 -- 172.21.15.26:0/2468169949 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e400bb50 con 0x7fe9f80ae470 2023-10-14T11:14:39.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fdb94640 1 --2- 172.21.15.26:0/2468169949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9e40039b0 0x7fe9e4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:39.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fe395640 1 --2- 172.21.15.26:0/2468169949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9f80ae470 0x7fe9e4005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:39.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fd393640 1 --2- 172.21.15.26:0/2468169949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9e4004360 0x7fe9e4004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:39.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fdb94640 1 -- 172.21.15.26:0/2468169949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9f80ae470 msgr2=0x7fe9e4005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:39.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fdb94640 1 --2- 172.21.15.26:0/2468169949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9f80ae470 0x7fe9e4005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:39.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fdb94640 1 -- 172.21.15.26:0/2468169949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9e4004360 msgr2=0x7fe9e4004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:39.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fdb94640 1 --2- 172.21.15.26:0/2468169949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9e4004360 0x7fe9e4004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:39.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.703+0000 7fe9fdb94640 1 -- 172.21.15.26:0/2468169949 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e4003530 con 0x7fe9e40039b0 2023-10-14T11:14:39.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.707+0000 7fe9fdb94640 1 --2- 172.21.15.26:0/2468169949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9e40039b0 0x7fe9e4003d90 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4001860 tx=0x7fe9f401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2025b980990fbe7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:39.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.707+0000 7fe9fcb92640 1 -- 172.21.15.26:0/2468169949 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40ab3f0 con 0x7fe9e40039b0 2023-10-14T11:14:39.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.707+0000 7fe9fcb92640 1 -- 172.21.15.26:0/2468169949 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f40ab550 con 0x7fe9e40039b0 2023-10-14T11:14:39.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.707+0000 7fe9fcb92640 1 -- 172.21.15.26:0/2468169949 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40ab900 con 0x7fe9e40039b0 2023-10-14T11:14:39.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.707+0000 7fe9ffdf8640 1 -- 172.21.15.26:0/2468169949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9e40039b0 msgr2=0x7fe9e4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:39.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.707+0000 7fe9ffdf8640 1 --2- 172.21.15.26:0/2468169949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9e40039b0 0x7fe9e4003d90 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4001860 tx=0x7fe9f401c4d0 comp rx=0 tx=0).stop 2023-10-14T11:14:39.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.707+0000 7fe9fe395640 1 -- 172.21.15.26:0/2468169949 reap_dead start 2023-10-14T11:14:39.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.707+0000 7fe9ffdf8640 1 -- 172.21.15.26:0/2468169949 shutdown_connections 2023-10-14T11:14:39.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.707+0000 7fe9ffdf8640 1 -- 172.21.15.26:0/2468169949 >> 172.21.15.26:0/2468169949 conn(0x7fe9f80d08d0 msgr2=0x7fe9f80d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:39.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.707+0000 7fe9ffdf8640 1 -- 172.21.15.26:0/2468169949 shutdown_connections 2023-10-14T11:14:39.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.707+0000 7fe9ffdf8640 1 -- 172.21.15.26:0/2468169949 wait complete. 2023-10-14T11:14:39.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.707+0000 7fe9ffdf8640 1 Processor -- start 2023-10-14T11:14:39.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.707+0000 7fe9ffdf8640 1 -- start start 2023-10-14T11:14:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9ffdf8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9e40039b0 0x7fe9f8154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9ffdf8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9f8155490 0x7fe9f8155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9ffdf8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9f815da00 0x7fe9f815de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9ffdf8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f80b1300 con 0x7fe9e40039b0 2023-10-14T11:14:39.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9ffdf8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f815e3c0 con 0x7fe9f815da00 2023-10-14T11:14:39.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9ffdf8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f8155f50 con 0x7fe9f8155490 2023-10-14T11:14:39.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9fdb94640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9e40039b0 0x7fe9f8154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:39.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9fdb94640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9e40039b0 0x7fe9f8154c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43028/0 (socket says 172.21.15.26:43028) 2023-10-14T11:14:39.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9fdb94640 1 -- 172.21.15.26:0/2603102158 learned_addr learned my addr 172.21.15.26:0/2603102158 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:39.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9fd393640 1 --2- 172.21.15.26:0/2603102158 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9f8155490 0x7fe9f8155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:39.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9fe395640 1 --2- 172.21.15.26:0/2603102158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9f815da00 0x7fe9f815de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:39.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9fdb94640 1 -- 172.21.15.26:0/2603102158 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9f8155490 msgr2=0x7fe9f8155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:39.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9fdb94640 1 --2- 172.21.15.26:0/2603102158 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9f8155490 0x7fe9f8155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:39.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9fdb94640 1 -- 172.21.15.26:0/2603102158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9f815da00 msgr2=0x7fe9f815de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:39.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9fdb94640 1 --2- 172.21.15.26:0/2603102158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9f815da00 0x7fe9f815de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:39.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9fdb94640 1 -- 172.21.15.26:0/2603102158 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f8156230 con 0x7fe9e40039b0 2023-10-14T11:14:39.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9fdb94640 1 --2- 172.21.15.26:0/2603102158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9e40039b0 0x7fe9f8154c50 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe9f40ad040 tx=0x7fe9e4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:39.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9ee7fc640 1 -- 172.21.15.26:0/2603102158 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40ab3f0 con 0x7fe9e40039b0 2023-10-14T11:14:39.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9ee7fc640 1 -- 172.21.15.26:0/2603102158 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f4005070 con 0x7fe9e40039b0 2023-10-14T11:14:39.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9ffdf8640 1 -- 172.21.15.26:0/2603102158 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f8156510 con 0x7fe9e40039b0 2023-10-14T11:14:39.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9ee7fc640 1 -- 172.21.15.26:0/2603102158 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40053e0 con 0x7fe9e40039b0 2023-10-14T11:14:39.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9ffdf8640 1 -- 172.21.15.26:0/2603102158 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f8157270 con 0x7fe9e40039b0 2023-10-14T11:14:39.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9ffdf8640 1 -- 172.21.15.26:0/2603102158 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f804e170 con 0x7fe9e40039b0 2023-10-14T11:14:39.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.711+0000 7fe9ee7fc640 1 -- 172.21.15.26:0/2603102158 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe9f40bb070 con 0x7fe9e40039b0 2023-10-14T11:14:39.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.715+0000 7fe9ee7fc640 1 --2- 172.21.15.26:0/2603102158 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe9dc0664a0 0x7fe9dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:39.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.715+0000 7fe9ee7fc640 1 -- 172.21.15.26:0/2603102158 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5663+0+0 (secure 0 0 0) 0x7fe9f40a8050 con 0x7fe9e40039b0 2023-10-14T11:14:39.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.715+0000 7fe9fd393640 1 --2- 172.21.15.26:0/2603102158 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe9dc0664a0 0x7fe9dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:39.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.715+0000 7fe9fd393640 1 --2- 172.21.15.26:0/2603102158 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe9dc0664a0 0x7fe9dc068960 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8070520 tx=0x7fe9e8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:39.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.719+0000 7fe9ee7fc640 1 -- 172.21.15.26:0/2603102158 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe9f40eb9d0 con 0x7fe9e40039b0 2023-10-14T11:14:39.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:39.879+0000 7fe9ffdf8640 1 -- 172.21.15.26:0/2603102158 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe9f815ab80 con 0x7fe9e40039b0 2023-10-14T11:14:40.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.527+0000 7fe9ee7fc640 1 -- 172.21.15.26:0/2603102158 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true}]=0 pool 'data_new' removed v46) v1 ==== 160+0+0 (secure 0 0 0) 0x7fe9f40eeff0 con 0x7fe9e40039b0 2023-10-14T11:14:40.535 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'data_new' removed 2023-10-14T11:14:40.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.531+0000 7fe9ffdf8640 1 -- 172.21.15.26:0/2603102158 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe9dc0664a0 msgr2=0x7fe9dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:40.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.531+0000 7fe9ffdf8640 1 --2- 172.21.15.26:0/2603102158 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe9dc0664a0 0x7fe9dc068960 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8070520 tx=0x7fe9e8009040 comp rx=0 tx=0).stop 2023-10-14T11:14:40.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.531+0000 7fe9ffdf8640 1 -- 172.21.15.26:0/2603102158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9e40039b0 msgr2=0x7fe9f8154c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:40.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.531+0000 7fe9ffdf8640 1 --2- 172.21.15.26:0/2603102158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9e40039b0 0x7fe9f8154c50 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe9f40ad040 tx=0x7fe9e4005800 comp rx=0 tx=0).stop 2023-10-14T11:14:40.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.531+0000 7fe9ffdf8640 1 -- 172.21.15.26:0/2603102158 shutdown_connections 2023-10-14T11:14:40.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.531+0000 7fe9ffdf8640 1 --2- 172.21.15.26:0/2603102158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9f815da00 0x7fe9f815de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:40.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.531+0000 7fe9ffdf8640 1 --2- 172.21.15.26:0/2603102158 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9f8155490 0x7fe9f8155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:40.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.531+0000 7fe9ffdf8640 1 --2- 172.21.15.26:0/2603102158 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe9dc0664a0 0x7fe9dc068960 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:40.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.531+0000 7fe9ffdf8640 1 --2- 172.21.15.26:0/2603102158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9e40039b0 0x7fe9f8154c50 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:40.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.531+0000 7fe9ffdf8640 1 -- 172.21.15.26:0/2603102158 >> 172.21.15.26:0/2603102158 conn(0x7fe9f80d08d0 msgr2=0x7fe9f815c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:40.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.531+0000 7fe9ffdf8640 1 -- 172.21.15.26:0/2603102158 shutdown_connections 2023-10-14T11:14:40.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.531+0000 7fe9ffdf8640 1 -- 172.21.15.26:0/2603102158 wait complete. 2023-10-14T11:14:40.561 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T11:14:40.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.703+0000 7f4896cc9640 1 Processor -- start 2023-10-14T11:14:40.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.703+0000 7f4896cc9640 1 -- start start 2023-10-14T11:14:40.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.703+0000 7f4896cc9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4890159900 0x7f489006e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:40.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.703+0000 7f4896cc9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f48900b3f00 0x7f4890069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:40.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.703+0000 7f4896cc9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48900b4360 con 0x7f489006a3d0 2023-10-14T11:14:40.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.703+0000 7f4896cc9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48900cd740 con 0x7f48900b3f00 2023-10-14T11:14:40.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.703+0000 7f4896cc9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489006a840 con 0x7f4890159900 2023-10-14T11:14:40.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.703+0000 7f488ffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f48900b3f00 0x7f4890069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:40.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.703+0000 7f4894a65640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4890159900 0x7f489006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:40.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.707+0000 7f4894a65640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4890159900 0x7f489006e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:50478/0 (socket says 172.21.15.26:50478) 2023-10-14T11:14:40.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.707+0000 7f488ffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f48900b3f00 0x7f4890069e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:52220/0 (socket says 172.21.15.26:52220) 2023-10-14T11:14:40.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.707+0000 7f4894a65640 1 -- 172.21.15.26:0/864786612 learned_addr learned my addr 172.21.15.26:0/864786612 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:40.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.707+0000 7f4895266640 1 --1- 172.21.15.26:0/864786612 >> v1:172.21.15.110:6789/0 conn(0x7f489006a3d0 0x7f48900cc350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:55856/0 (socket says 172.21.15.26:55856) 2023-10-14T11:14:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.707+0000 7f4894a65640 1 -- 172.21.15.26:0/864786612 >> v2:172.21.15.110:3300/0 conn(0x7f48900b3f00 msgr2=0x7f4890069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.707+0000 7f4894a65640 1 --2- 172.21.15.26:0/864786612 >> v2:172.21.15.110:3300/0 conn(0x7f48900b3f00 0x7f4890069e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.707+0000 7f4894a65640 1 -- 172.21.15.26:0/864786612 >> v1:172.21.15.110:6789/0 conn(0x7f489006a3d0 legacy=0x7f48900cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.707+0000 7f488f7fe640 1 -- 172.21.15.26:0/864786612 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368087665 0 0) 0x7f48900b4360 con 0x7f489006a3d0 2023-10-14T11:14:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.707+0000 7f4894a65640 1 -- 172.21.15.26:0/864786612 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48900b4600 con 0x7f4890159900 2023-10-14T11:14:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.707+0000 7f488ffff640 1 --2- 172.21.15.26:0/864786612 >> v2:172.21.15.110:3300/0 conn(0x7f48900b3f00 0x7f4890069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:14:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.707+0000 7f4894a65640 1 --2- 172.21.15.26:0/864786612 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4890159900 0x7f489006e260 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4884009870 tx=0x7f488401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ed3514a8bb0488c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.707+0000 7f488f7fe640 1 -- 172.21.15.26:0/864786612 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48840aa670 con 0x7f4890159900 2023-10-14T11:14:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.707+0000 7f488f7fe640 1 -- 172.21.15.26:0/864786612 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48840aa7d0 con 0x7f4890159900 2023-10-14T11:14:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.707+0000 7f488f7fe640 1 -- 172.21.15.26:0/864786612 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48840aab60 con 0x7f4890159900 2023-10-14T11:14:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.711+0000 7f4896cc9640 1 -- 172.21.15.26:0/864786612 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4890159900 msgr2=0x7f489006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:40.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.711+0000 7f4896cc9640 1 --2- 172.21.15.26:0/864786612 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4890159900 0x7f489006e260 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4884009870 tx=0x7f488401c510 comp rx=0 tx=0).stop 2023-10-14T11:14:40.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.711+0000 7f4896cc9640 1 -- 172.21.15.26:0/864786612 shutdown_connections 2023-10-14T11:14:40.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.711+0000 7f4896cc9640 1 --2- 172.21.15.26:0/864786612 >> v2:172.21.15.110:3300/0 conn(0x7f48900b3f00 0x7f4890069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:40.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.711+0000 7f4896cc9640 1 --2- 172.21.15.26:0/864786612 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4890159900 0x7f489006e260 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:40.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.711+0000 7f4896cc9640 1 -- 172.21.15.26:0/864786612 >> 172.21.15.26:0/864786612 conn(0x7f48900b0da0 msgr2=0x7f48900ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:40.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.711+0000 7f4896cc9640 1 -- 172.21.15.26:0/864786612 shutdown_connections 2023-10-14T11:14:40.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.711+0000 7f4896cc9640 1 -- 172.21.15.26:0/864786612 wait complete. 2023-10-14T11:14:40.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.711+0000 7f4896cc9640 1 Processor -- start 2023-10-14T11:14:40.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.711+0000 7f4896cc9640 1 -- start start 2023-10-14T11:14:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.711+0000 7f4896cc9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f489006a3d0 0x7f48900c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.715+0000 7f4896cc9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48900b3f00 0x7f48900c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.715+0000 7f4896cc9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4890159900 0x7f48900c1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.715+0000 7f4896cc9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4890143000 con 0x7f489006a3d0 2023-10-14T11:14:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.715+0000 7f4896cc9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4890142380 con 0x7f4890159900 2023-10-14T11:14:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.715+0000 7f4896cc9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4890142660 con 0x7f48900b3f00 2023-10-14T11:14:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.715+0000 7f4894a65640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f489006a3d0 0x7f48900c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.715+0000 7f4894a65640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f489006a3d0 0x7f48900c7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43040/0 (socket says 172.21.15.26:43040) 2023-10-14T11:14:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.715+0000 7f4894a65640 1 -- 172.21.15.26:0/2268986681 learned_addr learned my addr 172.21.15.26:0/2268986681 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.715+0000 7f488ffff640 1 --2- 172.21.15.26:0/2268986681 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48900b3f00 0x7f48900c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.715+0000 7f4895266640 1 --2- 172.21.15.26:0/2268986681 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4890159900 0x7f48900c1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.715+0000 7f4894a65640 1 -- 172.21.15.26:0/2268986681 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48900b3f00 msgr2=0x7f48900c1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.715+0000 7f4894a65640 1 --2- 172.21.15.26:0/2268986681 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48900b3f00 0x7f48900c1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.715+0000 7f4894a65640 1 -- 172.21.15.26:0/2268986681 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4890159900 msgr2=0x7f48900c1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.715+0000 7f4894a65640 1 --2- 172.21.15.26:0/2268986681 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4890159900 0x7f48900c1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.715+0000 7f4894a65640 1 -- 172.21.15.26:0/2268986681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c009420 con 0x7f489006a3d0 2023-10-14T11:14:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.715+0000 7f4894a65640 1 --2- 172.21.15.26:0/2268986681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f489006a3d0 0x7f48900c7da0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f48840ac040 tx=0x7f48840192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:40.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.719+0000 7f488d7fa640 1 -- 172.21.15.26:0/2268986681 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48840b4810 con 0x7f489006a3d0 2023-10-14T11:14:40.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.719+0000 7f488d7fa640 1 -- 172.21.15.26:0/2268986681 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48840b4970 con 0x7f489006a3d0 2023-10-14T11:14:40.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.719+0000 7f488d7fa640 1 -- 172.21.15.26:0/2268986681 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48840b4d00 con 0x7f489006a3d0 2023-10-14T11:14:40.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.719+0000 7f4896cc9640 1 -- 172.21.15.26:0/2268986681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48840094d0 con 0x7f489006a3d0 2023-10-14T11:14:40.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.719+0000 7f4896cc9640 1 -- 172.21.15.26:0/2268986681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4890142c20 con 0x7f489006a3d0 2023-10-14T11:14:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.723+0000 7f488d7fa640 1 -- 172.21.15.26:0/2268986681 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f48840be410 con 0x7f489006a3d0 2023-10-14T11:14:40.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.723+0000 7f488d7fa640 1 --2- 172.21.15.26:0/2268986681 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f48740664f0 0x7f48740689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:40.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.723+0000 7f488d7fa640 1 -- 172.21.15.26:0/2268986681 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f488411ec10 con 0x7f489006a3d0 2023-10-14T11:14:40.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.723+0000 7f4896cc9640 1 -- 172.21.15.26:0/2268986681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4870005260 con 0x7f489006a3d0 2023-10-14T11:14:40.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.723+0000 7f488ffff640 1 --2- 172.21.15.26:0/2268986681 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f48740664f0 0x7f48740689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:40.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.727+0000 7f488ffff640 1 --2- 172.21.15.26:0/2268986681 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f48740664f0 0x7f48740689b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f48901532e0 tx=0x7f487c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:40.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.735+0000 7f488d7fa640 1 -- 172.21.15.26:0/2268986681 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f48840b4e60 con 0x7f489006a3d0 2023-10-14T11:14:40.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.891+0000 7f4896cc9640 1 -- 172.21.15.26:0/2268986681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4870005a90 con 0x7f489006a3d0 2023-10-14T11:14:40.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.895+0000 7f488d7fa640 1 -- 172.21.15.26:0/2268986681 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f48840b4e60 con 0x7f489006a3d0 2023-10-14T11:14:40.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.895+0000 7f4896cc9640 1 -- 172.21.15.26:0/2268986681 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f48740664f0 msgr2=0x7f48740689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:40.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.895+0000 7f4896cc9640 1 --2- 172.21.15.26:0/2268986681 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f48740664f0 0x7f48740689b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f48901532e0 tx=0x7f487c009190 comp rx=0 tx=0).stop 2023-10-14T11:14:40.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.895+0000 7f4896cc9640 1 -- 172.21.15.26:0/2268986681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f489006a3d0 msgr2=0x7f48900c7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:40.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.895+0000 7f4896cc9640 1 --2- 172.21.15.26:0/2268986681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f489006a3d0 0x7f48900c7da0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f48840ac040 tx=0x7f48840192b0 comp rx=0 tx=0).stop 2023-10-14T11:14:40.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.899+0000 7f4896cc9640 1 -- 172.21.15.26:0/2268986681 shutdown_connections 2023-10-14T11:14:40.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.899+0000 7f4896cc9640 1 --2- 172.21.15.26:0/2268986681 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4890159900 0x7f48900c1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:40.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.899+0000 7f4896cc9640 1 --2- 172.21.15.26:0/2268986681 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48900b3f00 0x7f48900c1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:40.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.899+0000 7f4896cc9640 1 --2- 172.21.15.26:0/2268986681 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f48740664f0 0x7f48740689b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:40.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.899+0000 7f4896cc9640 1 --2- 172.21.15.26:0/2268986681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f489006a3d0 0x7f48900c7da0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:40.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.899+0000 7f4896cc9640 1 -- 172.21.15.26:0/2268986681 >> 172.21.15.26:0/2268986681 conn(0x7f48900b0da0 msgr2=0x7f48900cb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:40.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.899+0000 7f4896cc9640 1 -- 172.21.15.26:0/2268986681 shutdown_connections 2023-10-14T11:14:40.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:40.899+0000 7f4896cc9640 1 -- 172.21.15.26:0/2268986681 wait complete. 2023-10-14T11:14:40.924 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2023-10-14T11:14:41.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.059+0000 7fd11cb72640 1 Processor -- start 2023-10-14T11:14:41.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.059+0000 7fd11cb72640 1 -- start start 2023-10-14T11:14:41.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.063+0000 7fd11cb72640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd1180b2ad0 0x7fd11806b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:41.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.063+0000 7fd11cb72640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd1180ce310 0x7fd1180ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:41.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.063+0000 7fd11cb72640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd11806d000 con 0x7fd11815cf90 2023-10-14T11:14:41.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.063+0000 7fd11cb72640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1180ced00 con 0x7fd1180ce310 2023-10-14T11:14:41.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.063+0000 7fd11cb72640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd118160580 con 0x7fd1180b2ad0 2023-10-14T11:14:41.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.063+0000 7fd115d9b640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd11815cf90 0x7fd11806c8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36582/0 (socket says 172.21.15.26:36582) 2023-10-14T11:14:41.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.063+0000 7fd115d9b640 1 -- 172.21.15.26:0/2987914404 learned_addr learned my addr 172.21.15.26:0/2987914404 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:41.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.063+0000 7fd116d9d640 1 --2- 172.21.15.26:0/2987914404 >> v2:172.21.15.26:3300/0 conn(0x7fd1180ce310 0x7fd1180ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:41.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.063+0000 7fd11659c640 1 --2- 172.21.15.26:0/2987914404 >> v2:172.21.15.110:3300/0 conn(0x7fd1180b2ad0 0x7fd11806b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:41.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.063+0000 7fd116d9d640 1 -- 172.21.15.26:0/2987914404 >> v2:172.21.15.110:3300/0 conn(0x7fd1180b2ad0 msgr2=0x7fd11806b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:41.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.063+0000 7fd116d9d640 1 --2- 172.21.15.26:0/2987914404 >> v2:172.21.15.110:3300/0 conn(0x7fd1180b2ad0 0x7fd11806b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:41.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.063+0000 7fd116d9d640 1 -- 172.21.15.26:0/2987914404 >> v1:172.21.15.26:6789/0 conn(0x7fd11815cf90 legacy=0x7fd11806c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:41.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.063+0000 7fd11559a640 1 -- 172.21.15.26:0/2987914404 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435917021 0 0) 0x7fd11806d000 con 0x7fd11815cf90 2023-10-14T11:14:41.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.063+0000 7fd116d9d640 1 -- 172.21.15.26:0/2987914404 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11815d4e0 con 0x7fd1180ce310 2023-10-14T11:14:41.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.067+0000 7fd116d9d640 1 --2- 172.21.15.26:0/2987914404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1180ce310 0x7fd1180ce7c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd110009d90 tx=0x7fd11001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8490d3176de45ed1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:41.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.067+0000 7fd11559a640 1 -- 172.21.15.26:0/2987914404 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1100a59a0 con 0x7fd1180ce310 2023-10-14T11:14:41.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.067+0000 7fd11559a640 1 -- 172.21.15.26:0/2987914404 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1100a5b00 con 0x7fd1180ce310 2023-10-14T11:14:41.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.067+0000 7fd11559a640 1 -- 172.21.15.26:0/2987914404 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1100a5e90 con 0x7fd1180ce310 2023-10-14T11:14:41.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.067+0000 7fd11cb72640 1 -- 172.21.15.26:0/2987914404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1180ce310 msgr2=0x7fd1180ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:41.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.067+0000 7fd11cb72640 1 --2- 172.21.15.26:0/2987914404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1180ce310 0x7fd1180ce7c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd110009d90 tx=0x7fd11001c8e0 comp rx=0 tx=0).stop 2023-10-14T11:14:41.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.067+0000 7fd11cb72640 1 -- 172.21.15.26:0/2987914404 shutdown_connections 2023-10-14T11:14:41.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.067+0000 7fd11cb72640 1 --2- 172.21.15.26:0/2987914404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1180ce310 0x7fd1180ce7c0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:41.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.067+0000 7fd11cb72640 1 --2- 172.21.15.26:0/2987914404 >> v2:172.21.15.110:3300/0 conn(0x7fd1180b2ad0 0x7fd11806b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:41.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.067+0000 7fd11cb72640 1 -- 172.21.15.26:0/2987914404 >> 172.21.15.26:0/2987914404 conn(0x7fd1180cd1c0 msgr2=0x7fd1180cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:41.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.067+0000 7fd11cb72640 1 -- 172.21.15.26:0/2987914404 shutdown_connections 2023-10-14T11:14:41.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.067+0000 7fd11cb72640 1 -- 172.21.15.26:0/2987914404 wait complete. 2023-10-14T11:14:41.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.067+0000 7fd11cb72640 1 Processor -- start 2023-10-14T11:14:41.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd11cb72640 1 -- start start 2023-10-14T11:14:41.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd11cb72640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1180b2ad0 0x7fd11814acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:41.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd11cb72640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1180ce310 0x7fd11814b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:41.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd11cb72640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd11815cf90 0x7fd11814ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:41.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd11cb72640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd118158ed0 con 0x7fd11815cf90 2023-10-14T11:14:41.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd11cb72640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1180b0c00 con 0x7fd1180ce310 2023-10-14T11:14:41.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd11cb72640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1180b0ee0 con 0x7fd1180b2ad0 2023-10-14T11:14:41.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd116d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd11815cf90 0x7fd11814ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:41.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd116d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd11815cf90 0x7fd11814ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43062/0 (socket says 172.21.15.26:43062) 2023-10-14T11:14:41.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd116d9d640 1 -- 172.21.15.26:0/3417764993 learned_addr learned my addr 172.21.15.26:0/3417764993 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:41.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd11659c640 1 --2- 172.21.15.26:0/3417764993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1180b2ad0 0x7fd11814acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:41.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd115d9b640 1 --2- 172.21.15.26:0/3417764993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1180ce310 0x7fd11814b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:41.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd116d9d640 1 -- 172.21.15.26:0/3417764993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1180b2ad0 msgr2=0x7fd11814acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:41.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd116d9d640 1 --2- 172.21.15.26:0/3417764993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1180b2ad0 0x7fd11814acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:41.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd116d9d640 1 -- 172.21.15.26:0/3417764993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1180ce310 msgr2=0x7fd11814b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:41.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd116d9d640 1 --2- 172.21.15.26:0/3417764993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1180ce310 0x7fd11814b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:41.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd116d9d640 1 -- 172.21.15.26:0/3417764993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd110009a70 con 0x7fd11815cf90 2023-10-14T11:14:41.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd115d9b640 1 --2- 172.21.15.26:0/3417764993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1180ce310 0x7fd11814b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:41.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd11659c640 1 --2- 172.21.15.26:0/3417764993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1180b2ad0 0x7fd11814acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:41.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd116d9d640 1 --2- 172.21.15.26:0/3417764993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd11815cf90 0x7fd11814ba80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd1100b0040 tx=0x7fd110019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:41.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd106ffd640 1 -- 172.21.15.26:0/3417764993 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1100add90 con 0x7fd11815cf90 2023-10-14T11:14:41.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd106ffd640 1 -- 172.21.15.26:0/3417764993 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd110009450 con 0x7fd11815cf90 2023-10-14T11:14:41.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd106ffd640 1 -- 172.21.15.26:0/3417764993 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1100b9690 con 0x7fd11815cf90 2023-10-14T11:14:41.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd11cb72640 1 -- 172.21.15.26:0/3417764993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1180b11c0 con 0x7fd11815cf90 2023-10-14T11:14:41.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd11cb72640 1 -- 172.21.15.26:0/3417764993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1180b19c0 con 0x7fd11815cf90 2023-10-14T11:14:41.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.071+0000 7fd11cb72640 1 -- 172.21.15.26:0/3417764993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd118074010 con 0x7fd11815cf90 2023-10-14T11:14:41.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.075+0000 7fd106ffd640 1 -- 172.21.15.26:0/3417764993 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd1100b97f0 con 0x7fd11815cf90 2023-10-14T11:14:41.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.075+0000 7fd106ffd640 1 --2- 172.21.15.26:0/3417764993 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd0f80664a0 0x7fd0f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:41.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.075+0000 7fd106ffd640 1 -- 172.21.15.26:0/3417764993 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd11011f4b0 con 0x7fd11815cf90 2023-10-14T11:14:41.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.075+0000 7fd11659c640 1 --2- 172.21.15.26:0/3417764993 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd0f80664a0 0x7fd0f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:41.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.075+0000 7fd11659c640 1 --2- 172.21.15.26:0/3417764993 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd0f80664a0 0x7fd0f8068960 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd108009b10 tx=0x7fd108008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:41.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.079+0000 7fd106ffd640 1 -- 172.21.15.26:0/3417764993 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd1100ecb90 con 0x7fd11815cf90 2023-10-14T11:14:41.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.287+0000 7fd11cb72640 1 -- 172.21.15.26:0/3417764993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7fd1180ccb90 con 0x7fd11815cf90 2023-10-14T11:14:41.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.531+0000 7fd106ffd640 1 -- 172.21.15.26:0/3417764993 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v153) v1 ==== 147+0+0 (secure 0 0 0) 0x7fd1100f01b0 con 0x7fd11815cf90 2023-10-14T11:14:41.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.531+0000 7fd11cb72640 1 -- 172.21.15.26:0/3417764993 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd0f80664a0 msgr2=0x7fd0f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:41.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.531+0000 7fd11cb72640 1 --2- 172.21.15.26:0/3417764993 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd0f80664a0 0x7fd0f8068960 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd108009b10 tx=0x7fd108008040 comp rx=0 tx=0).stop 2023-10-14T11:14:41.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.531+0000 7fd11cb72640 1 -- 172.21.15.26:0/3417764993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd11815cf90 msgr2=0x7fd11814ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:41.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.531+0000 7fd11cb72640 1 --2- 172.21.15.26:0/3417764993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd11815cf90 0x7fd11814ba80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd1100b0040 tx=0x7fd110019680 comp rx=0 tx=0).stop 2023-10-14T11:14:41.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.531+0000 7fd11cb72640 1 -- 172.21.15.26:0/3417764993 shutdown_connections 2023-10-14T11:14:41.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.531+0000 7fd11cb72640 1 --2- 172.21.15.26:0/3417764993 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd0f80664a0 0x7fd0f8068960 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:41.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.531+0000 7fd11cb72640 1 --2- 172.21.15.26:0/3417764993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd11815cf90 0x7fd11814ba80 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:41.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.531+0000 7fd11cb72640 1 --2- 172.21.15.26:0/3417764993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1180ce310 0x7fd11814b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:41.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.531+0000 7fd11cb72640 1 --2- 172.21.15.26:0/3417764993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1180b2ad0 0x7fd11814acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:41.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.531+0000 7fd11cb72640 1 -- 172.21.15.26:0/3417764993 >> 172.21.15.26:0/3417764993 conn(0x7fd1180cd1c0 msgr2=0x7fd11815ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:41.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.531+0000 7fd11cb72640 1 -- 172.21.15.26:0/3417764993 shutdown_connections 2023-10-14T11:14:41.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.531+0000 7fd11cb72640 1 -- 172.21.15.26:0/3417764993 wait complete. 2023-10-14T11:14:41.560 INFO:tasks.cephfs_test_runner:That a client who does not have the capability for setting ... ok 2023-10-14T11:14:41.560 INFO:tasks.cephfs_test_runner:Starting test: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-10-14T11:14:41.561 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:14:41.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.695+0000 7f511826b640 1 Processor -- start 2023-10-14T11:14:41.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.695+0000 7f511826b640 1 -- start start 2023-10-14T11:14:41.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.699+0000 7f511826b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5110070c40 0x7f511015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:41.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.699+0000 7f511826b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51100b4020 0x7f51100b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:41.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.699+0000 7f511826b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f51100b0620 0x7f511015c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:41.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.699+0000 7f511826b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511015b3b0 con 0x7f5110070c40 2023-10-14T11:14:41.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.699+0000 7f511826b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51100b0a90 con 0x7f51100b0620 2023-10-14T11:14:41.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.699+0000 7f511826b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511015be60 con 0x7f51100b4020 2023-10-14T11:14:41.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.699+0000 7f5116007640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5110070c40 0x7f511015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:41.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.699+0000 7f5116007640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5110070c40 0x7f511015ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43072/0 (socket says 172.21.15.26:43072) 2023-10-14T11:14:41.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.699+0000 7f5116007640 1 -- 172.21.15.26:0/4159263743 learned_addr learned my addr 172.21.15.26:0/4159263743 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:41.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.699+0000 7f5115806640 1 --2- 172.21.15.26:0/4159263743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51100b4020 0x7f51100b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:41.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.699+0000 7f5116808640 1 --2- 172.21.15.26:0/4159263743 >> v2:172.21.15.110:3300/0 conn(0x7f51100b0620 0x7f511015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:41.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.699+0000 7f5116007640 1 -- 172.21.15.26:0/4159263743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51100b4020 msgr2=0x7f51100b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:41.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.699+0000 7f5116007640 1 --2- 172.21.15.26:0/4159263743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51100b4020 0x7f51100b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:41.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.699+0000 7f5116007640 1 -- 172.21.15.26:0/4159263743 >> v2:172.21.15.110:3300/0 conn(0x7f51100b0620 msgr2=0x7f511015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:41.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.699+0000 7f5116007640 1 --2- 172.21.15.26:0/4159263743 >> v2:172.21.15.110:3300/0 conn(0x7f51100b0620 0x7f511015c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:41.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.699+0000 7f5116007640 1 -- 172.21.15.26:0/4159263743 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511015c1f0 con 0x7f5110070c40 2023-10-14T11:14:41.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.699+0000 7f5116808640 1 --2- 172.21.15.26:0/4159263743 >> v2:172.21.15.110:3300/0 conn(0x7f51100b0620 0x7f511015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:41.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.703+0000 7f5116007640 1 --2- 172.21.15.26:0/4159263743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5110070c40 0x7f511015ae70 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f51100b0e30 tx=0x7f510c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283e001f5bfc9289 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:41.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.703+0000 7f5115005640 1 -- 172.21.15.26:0/4159263743 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c0a7070 con 0x7f5110070c40 2023-10-14T11:14:41.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.703+0000 7f5115005640 1 -- 172.21.15.26:0/4159263743 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c0ab430 con 0x7f5110070c40 2023-10-14T11:14:41.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.703+0000 7f5115005640 1 -- 172.21.15.26:0/4159263743 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c0ab7c0 con 0x7f5110070c40 2023-10-14T11:14:41.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.703+0000 7f511826b640 1 -- 172.21.15.26:0/4159263743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5110070c40 msgr2=0x7f511015ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:41.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.703+0000 7f511826b640 1 --2- 172.21.15.26:0/4159263743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5110070c40 0x7f511015ae70 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f51100b0e30 tx=0x7f510c01c470 comp rx=0 tx=0).stop 2023-10-14T11:14:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.703+0000 7f511826b640 1 -- 172.21.15.26:0/4159263743 shutdown_connections 2023-10-14T11:14:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.703+0000 7f511826b640 1 --2- 172.21.15.26:0/4159263743 >> v2:172.21.15.110:3300/0 conn(0x7f51100b0620 0x7f511015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.703+0000 7f511826b640 1 --2- 172.21.15.26:0/4159263743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51100b4020 0x7f51100b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.703+0000 7f511826b640 1 --2- 172.21.15.26:0/4159263743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5110070c40 0x7f511015ae70 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.703+0000 7f511826b640 1 -- 172.21.15.26:0/4159263743 >> 172.21.15.26:0/4159263743 conn(0x7f511006c190 msgr2=0x7f511006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.703+0000 7f511826b640 1 -- 172.21.15.26:0/4159263743 shutdown_connections 2023-10-14T11:14:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.703+0000 7f511826b640 1 -- 172.21.15.26:0/4159263743 wait complete. 2023-10-14T11:14:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.703+0000 7f511826b640 1 Processor -- start 2023-10-14T11:14:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.703+0000 7f511826b640 1 -- start start 2023-10-14T11:14:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f511826b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5110070c40 0x7f51100c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f511826b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51100b0620 0x7f51101467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f511826b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51100b4020 0x7f51100ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f511826b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51100c3ce0 con 0x7f51100b4020 2023-10-14T11:14:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f511826b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51100b2100 con 0x7f5110070c40 2023-10-14T11:14:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f511826b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5110146ce0 con 0x7f51100b0620 2023-10-14T11:14:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f5116808640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51100b4020 0x7f51100ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f5116808640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51100b4020 0x7f51100ae8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43080/0 (socket says 172.21.15.26:43080) 2023-10-14T11:14:41.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f5116808640 1 -- 172.21.15.26:0/2865597085 learned_addr learned my addr 172.21.15.26:0/2865597085 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:41.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f5116007640 1 --2- 172.21.15.26:0/2865597085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5110070c40 0x7f51100c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:41.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f5115806640 1 --2- 172.21.15.26:0/2865597085 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51100b0620 0x7f51101467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:41.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f5116808640 1 -- 172.21.15.26:0/2865597085 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51100b0620 msgr2=0x7f51101467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:41.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f5116808640 1 --2- 172.21.15.26:0/2865597085 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51100b0620 0x7f51101467a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:41.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f5116808640 1 -- 172.21.15.26:0/2865597085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5110070c40 msgr2=0x7f51100c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:41.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f5116808640 1 --2- 172.21.15.26:0/2865597085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5110070c40 0x7f51100c37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:41.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f5116808640 1 -- 172.21.15.26:0/2865597085 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c0094d0 con 0x7f51100b4020 2023-10-14T11:14:41.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f5116808640 1 --2- 172.21.15.26:0/2865597085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51100b4020 0x7f51100ae8f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f5108007de0 tx=0x7f510800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:41.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f5106ffd640 1 -- 172.21.15.26:0/2865597085 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51080039a0 con 0x7f51100b4020 2023-10-14T11:14:41.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f5106ffd640 1 -- 172.21.15.26:0/2865597085 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510800f040 con 0x7f51100b4020 2023-10-14T11:14:41.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f5106ffd640 1 -- 172.21.15.26:0/2865597085 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108003d40 con 0x7f51100b4020 2023-10-14T11:14:41.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f511826b640 1 -- 172.21.15.26:0/2865597085 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51100b1580 con 0x7f51100b4020 2023-10-14T11:14:41.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f511826b640 1 -- 172.21.15.26:0/2865597085 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51100b1b40 con 0x7f51100b4020 2023-10-14T11:14:41.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.707+0000 7f511826b640 1 -- 172.21.15.26:0/2865597085 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5110144410 con 0x7f51100b4020 2023-10-14T11:14:41.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.711+0000 7f5106ffd640 1 -- 172.21.15.26:0/2865597085 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5108004030 con 0x7f51100b4020 2023-10-14T11:14:41.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.711+0000 7f5106ffd640 1 --2- 172.21.15.26:0/2865597085 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f50f40664a0 0x7f50f4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:41.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.711+0000 7f5106ffd640 1 -- 172.21.15.26:0/2865597085 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f5108083f10 con 0x7f51100b4020 2023-10-14T11:14:41.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.711+0000 7f5116007640 1 --2- 172.21.15.26:0/2865597085 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f50f40664a0 0x7f50f4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:41.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.711+0000 7f5116007640 1 --2- 172.21.15.26:0/2865597085 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f50f40664a0 0x7f50f4068960 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f510c0af000 tx=0x7f510c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:41.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.715+0000 7f5106ffd640 1 -- 172.21.15.26:0/2865597085 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5110144410 con 0x7f51100b4020 2023-10-14T11:14:41.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.875+0000 7f511826b640 1 -- 172.21.15.26:0/2865597085 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5110144410 con 0x7f51100b4020 2023-10-14T11:14:41.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.875+0000 7f5106ffd640 1 -- 172.21.15.26:0/2865597085 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+13189 (secure 0 0 0) 0x7f5110144410 con 0x7f51100b4020 2023-10-14T11:14:41.882 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:41.883 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":46,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:14:40.527473+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:6835/812681761":"2023-10-15T11:14:36.512467+0000","172.21.15.26:6834/812681761":"2023-10-15T11:14:36.512467+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:14:41.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.879+0000 7f511826b640 1 -- 172.21.15.26:0/2865597085 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f50f40664a0 msgr2=0x7f50f4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:41.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.879+0000 7f511826b640 1 --2- 172.21.15.26:0/2865597085 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f50f40664a0 0x7f50f4068960 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f510c0af000 tx=0x7f510c008040 comp rx=0 tx=0).stop 2023-10-14T11:14:41.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.879+0000 7f511826b640 1 -- 172.21.15.26:0/2865597085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51100b4020 msgr2=0x7f51100ae8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:41.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.879+0000 7f511826b640 1 --2- 172.21.15.26:0/2865597085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51100b4020 0x7f51100ae8f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f5108007de0 tx=0x7f510800d4a0 comp rx=0 tx=0).stop 2023-10-14T11:14:41.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.879+0000 7f511826b640 1 -- 172.21.15.26:0/2865597085 shutdown_connections 2023-10-14T11:14:41.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.879+0000 7f511826b640 1 --2- 172.21.15.26:0/2865597085 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f50f40664a0 0x7f50f4068960 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:41.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.879+0000 7f511826b640 1 --2- 172.21.15.26:0/2865597085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51100b4020 0x7f51100ae8f0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:41.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.879+0000 7f511826b640 1 --2- 172.21.15.26:0/2865597085 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51100b0620 0x7f51101467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:41.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.879+0000 7f511826b640 1 --2- 172.21.15.26:0/2865597085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5110070c40 0x7f51100c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:41.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.879+0000 7f511826b640 1 -- 172.21.15.26:0/2865597085 >> 172.21.15.26:0/2865597085 conn(0x7f511006c190 msgr2=0x7f5110148be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:41.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.879+0000 7f511826b640 1 -- 172.21.15.26:0/2865597085 shutdown_connections 2023-10-14T11:14:41.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:41.879+0000 7f511826b640 1 -- 172.21.15.26:0/2865597085 wait complete. 2023-10-14T11:14:41.904 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:14:41.905 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:14:42.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.043+0000 7fb04e90f640 1 Processor -- start 2023-10-14T11:14:42.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.043+0000 7fb04e90f640 1 -- start start 2023-10-14T11:14:42.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb04e90f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb04806a5a0 0x7fb04806e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:42.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb04e90f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0480b4370 con 0x7fb0480b3f00 2023-10-14T11:14:42.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb04e90f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0480b4600 con 0x7fb048159900 2023-10-14T11:14:42.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb04e90f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0480cd740 con 0x7fb04806a5a0 2023-10-14T11:14:42.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb04ceac640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb0480b3f00 0x7fb0480c9b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36590/0 (socket says 172.21.15.26:36590) 2023-10-14T11:14:42.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb04ceac640 1 -- 172.21.15.26:0/2325386396 learned_addr learned my addr 172.21.15.26:0/2325386396 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:42.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb0477fe640 1 --2- 172.21.15.26:0/2325386396 >> v2:172.21.15.110:3300/0 conn(0x7fb04806a5a0 0x7fb04806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:42.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb046ffd640 1 -- 172.21.15.26:0/2325386396 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808848333 0 0) 0x7fb0480b4370 con 0x7fb0480b3f00 2023-10-14T11:14:42.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb046ffd640 1 -- 172.21.15.26:0/2325386396 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb030005740 con 0x7fb0480b3f00 2023-10-14T11:14:42.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb046ffd640 1 -- 172.21.15.26:0/2325386396 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2404774731 0 0) 0x7fb030005740 con 0x7fb0480b3f00 2023-10-14T11:14:42.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb046ffd640 1 -- 172.21.15.26:0/2325386396 >> v2:172.21.15.110:3300/0 conn(0x7fb04806a5a0 msgr2=0x7fb04806e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:42.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb046ffd640 1 --2- 172.21.15.26:0/2325386396 >> v2:172.21.15.110:3300/0 conn(0x7fb04806a5a0 0x7fb04806e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:42.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb046ffd640 1 -- 172.21.15.26:0/2325386396 >> v1:172.21.15.110:6789/0 conn(0x7fb048159900 legacy=0x7fb048069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:42.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb046ffd640 1 -- 172.21.15.26:0/2325386396 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0480c8dd0 con 0x7fb0480b3f00 2023-10-14T11:14:42.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb046ffd640 1 -- 172.21.15.26:0/2325386396 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7fb040001a00 con 0x7fb0480b3f00 2023-10-14T11:14:42.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb046ffd640 1 -- 172.21.15.26:0/2325386396 >> v1:172.21.15.26:6789/0 conn(0x7fb0480b3f00 legacy=0x7fb0480c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:42.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb046ffd640 1 --2- 172.21.15.26:0/2325386396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb030005b90 0x7fb030005f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:42.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb046ffd640 1 --2- 172.21.15.26:0/2325386396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb030006590 0x7fb030006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:42.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb046ffd640 1 --2- 172.21.15.26:0/2325386396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb030007260 0x7fb03000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:42.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb046ffd640 1 -- 172.21.15.26:0/2325386396 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0480cd740 con 0x7fb030006590 2023-10-14T11:14:42.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb046ffd640 1 -- 172.21.15.26:0/2325386396 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03000e1c0 con 0x7fb030005b90 2023-10-14T11:14:42.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb046ffd640 1 -- 172.21.15.26:0/2325386396 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03000e380 con 0x7fb030007260 2023-10-14T11:14:42.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb0477fe640 1 --2- 172.21.15.26:0/2325386396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb030006590 0x7fb030006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:42.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb047fff640 1 --2- 172.21.15.26:0/2325386396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb030005b90 0x7fb030005f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:42.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb04ceac640 1 --2- 172.21.15.26:0/2325386396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb030007260 0x7fb03000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:42.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb0477fe640 1 -- 172.21.15.26:0/2325386396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb030007260 msgr2=0x7fb03000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:42.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb0477fe640 1 --2- 172.21.15.26:0/2325386396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb030007260 0x7fb03000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:42.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb0477fe640 1 -- 172.21.15.26:0/2325386396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb030005b90 msgr2=0x7fb030005f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:42.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb0477fe640 1 --2- 172.21.15.26:0/2325386396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb030005b90 0x7fb030005f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:42.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb0477fe640 1 -- 172.21.15.26:0/2325386396 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb030005740 con 0x7fb030006590 2023-10-14T11:14:42.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.047+0000 7fb04ceac640 1 -- 172.21.15.26:0/2325386396 reap_dead start 2023-10-14T11:14:42.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.051+0000 7fb0477fe640 1 --2- 172.21.15.26:0/2325386396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb030006590 0x7fb030006a60 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009ae0 tx=0x7fb03c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed19762690dedb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:42.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.051+0000 7fb046ffd640 1 -- 172.21.15.26:0/2325386396 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c0a5640 con 0x7fb030006590 2023-10-14T11:14:42.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.051+0000 7fb046ffd640 1 -- 172.21.15.26:0/2325386396 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c0a57a0 con 0x7fb030006590 2023-10-14T11:14:42.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.051+0000 7fb046ffd640 1 -- 172.21.15.26:0/2325386396 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c0a5b50 con 0x7fb030006590 2023-10-14T11:14:42.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.051+0000 7fb04e90f640 1 -- 172.21.15.26:0/2325386396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb030006590 msgr2=0x7fb030006a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:42.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.051+0000 7fb04e90f640 1 --2- 172.21.15.26:0/2325386396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb030006590 0x7fb030006a60 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009ae0 tx=0x7fb03c01ca50 comp rx=0 tx=0).stop 2023-10-14T11:14:42.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.051+0000 7fb04e90f640 1 -- 172.21.15.26:0/2325386396 shutdown_connections 2023-10-14T11:14:42.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.051+0000 7fb04e90f640 1 --2- 172.21.15.26:0/2325386396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb030006590 0x7fb030006a60 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:42.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.051+0000 7fb04e90f640 1 -- 172.21.15.26:0/2325386396 >> 172.21.15.26:0/2325386396 conn(0x7fb0480b0da0 msgr2=0x7fb0480ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:42.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.051+0000 7fb04e90f640 1 -- 172.21.15.26:0/2325386396 shutdown_connections 2023-10-14T11:14:42.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.051+0000 7fb04e90f640 1 -- 172.21.15.26:0/2325386396 wait complete. 2023-10-14T11:14:42.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb04e90f640 1 Processor -- start 2023-10-14T11:14:42.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb04e90f640 1 -- start start 2023-10-14T11:14:42.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb04e90f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb030006590 0x7fb04814ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:42.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb04e90f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb04815bef0 0x7fb0480c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:42.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb04e90f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0480c4b90 0x7fb0481f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:42.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb04e90f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0480c5010 con 0x7fb030006590 2023-10-14T11:14:42.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb04e90f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04814f1c0 con 0x7fb04815bef0 2023-10-14T11:14:42.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb04e90f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04815ac40 con 0x7fb0480c4b90 2023-10-14T11:14:42.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb047fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb030006590 0x7fb04814ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:42.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb047fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb030006590 0x7fb04814ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43106/0 (socket says 172.21.15.26:43106) 2023-10-14T11:14:42.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb047fff640 1 -- 172.21.15.26:0/4150408473 learned_addr learned my addr 172.21.15.26:0/4150408473 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:42.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb0477fe640 1 --2- 172.21.15.26:0/4150408473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb04815bef0 0x7fb0480c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:42.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb04ceac640 1 --2- 172.21.15.26:0/4150408473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0480c4b90 0x7fb0481f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:42.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb047fff640 1 -- 172.21.15.26:0/4150408473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0480c4b90 msgr2=0x7fb0481f56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:42.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb047fff640 1 --2- 172.21.15.26:0/4150408473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0480c4b90 0x7fb0481f56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:42.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb047fff640 1 -- 172.21.15.26:0/4150408473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb04815bef0 msgr2=0x7fb0480c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:42.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb047fff640 1 --2- 172.21.15.26:0/4150408473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb04815bef0 0x7fb0480c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:42.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb047fff640 1 -- 172.21.15.26:0/4150408473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04815a030 con 0x7fb030006590 2023-10-14T11:14:42.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb04ceac640 1 --2- 172.21.15.26:0/4150408473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0480c4b90 0x7fb0481f56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:42.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb047fff640 1 --2- 172.21.15.26:0/4150408473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb030006590 0x7fb04814ec80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb038011620 tx=0x7fb038011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:42.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb044ff9640 1 -- 172.21.15.26:0/4150408473 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb038005320 con 0x7fb030006590 2023-10-14T11:14:42.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb044ff9640 1 -- 172.21.15.26:0/4150408473 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb038005480 con 0x7fb030006590 2023-10-14T11:14:42.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb04e90f640 1 -- 172.21.15.26:0/4150408473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04815a310 con 0x7fb030006590 2023-10-14T11:14:42.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb044ff9640 1 -- 172.21.15.26:0/4150408473 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb038003600 con 0x7fb030006590 2023-10-14T11:14:42.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb04e90f640 1 -- 172.21.15.26:0/4150408473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04815a8d0 con 0x7fb030006590 2023-10-14T11:14:42.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.055+0000 7fb04e90f640 1 -- 172.21.15.26:0/4150408473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04815aa60 con 0x7fb030006590 2023-10-14T11:14:42.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.059+0000 7fb044ff9640 1 -- 172.21.15.26:0/4150408473 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb038003780 con 0x7fb030006590 2023-10-14T11:14:42.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.059+0000 7fb044ff9640 1 --2- 172.21.15.26:0/4150408473 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb0340664a0 0x7fb034068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:42.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.059+0000 7fb044ff9640 1 -- 172.21.15.26:0/4150408473 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fb038086c10 con 0x7fb030006590 2023-10-14T11:14:42.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.059+0000 7fb0477fe640 1 --2- 172.21.15.26:0/4150408473 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb0340664a0 0x7fb034068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:42.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.059+0000 7fb0477fe640 1 --2- 172.21.15.26:0/4150408473 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb0340664a0 0x7fb034068960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0af000 tx=0x7fb03c0046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:42.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.063+0000 7fb044ff9640 1 -- 172.21.15.26:0/4150408473 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb0380541b0 con 0x7fb030006590 2023-10-14T11:14:42.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.219+0000 7fb04e90f640 1 -- 172.21.15.26:0/4150408473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb04804e170 con 0x7fb030006590 2023-10-14T11:14:42.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.219+0000 7fb044ff9640 1 -- 172.21.15.26:0/4150408473 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0380577d0 con 0x7fb030006590 2023-10-14T11:14:42.227 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:14:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.223+0000 7fb04e90f640 1 -- 172.21.15.26:0/4150408473 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb0340664a0 msgr2=0x7fb034068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.223+0000 7fb04e90f640 1 --2- 172.21.15.26:0/4150408473 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb0340664a0 0x7fb034068960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0af000 tx=0x7fb03c0046d0 comp rx=0 tx=0).stop 2023-10-14T11:14:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.223+0000 7fb04e90f640 1 -- 172.21.15.26:0/4150408473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb030006590 msgr2=0x7fb04814ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.223+0000 7fb04e90f640 1 --2- 172.21.15.26:0/4150408473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb030006590 0x7fb04814ec80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb038011620 tx=0x7fb038011ae0 comp rx=0 tx=0).stop 2023-10-14T11:14:42.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.223+0000 7fb04e90f640 1 -- 172.21.15.26:0/4150408473 shutdown_connections 2023-10-14T11:14:42.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.223+0000 7fb04e90f640 1 --2- 172.21.15.26:0/4150408473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0480c4b90 0x7fb0481f56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:42.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.223+0000 7fb04e90f640 1 --2- 172.21.15.26:0/4150408473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb04815bef0 0x7fb0480c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:42.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.223+0000 7fb04e90f640 1 --2- 172.21.15.26:0/4150408473 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb0340664a0 0x7fb034068960 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:42.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.223+0000 7fb04e90f640 1 --2- 172.21.15.26:0/4150408473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb030006590 0x7fb04814ec80 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:42.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.223+0000 7fb04e90f640 1 -- 172.21.15.26:0/4150408473 >> 172.21.15.26:0/4150408473 conn(0x7fb0480b0da0 msgr2=0x7fb048072820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:42.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.223+0000 7fb04e90f640 1 -- 172.21.15.26:0/4150408473 shutdown_connections 2023-10-14T11:14:42.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.223+0000 7fb04e90f640 1 -- 172.21.15.26:0/4150408473 wait complete. 2023-10-14T11:14:42.248 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2023-10-14T11:14:42.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.383+0000 7fe785805640 1 Processor -- start 2023-10-14T11:14:42.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.387+0000 7fe785805640 1 -- start start 2023-10-14T11:14:42.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.387+0000 7fe785805640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe78015cb90 0x7fe7800cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:42.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.387+0000 7fe785805640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7800ce770 con 0x7fe7800d15d0 2023-10-14T11:14:42.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.387+0000 7fe785805640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7800d0600 con 0x7fe7800d3010 2023-10-14T11:14:42.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.387+0000 7fe785805640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7800c6450 con 0x7fe78015cb90 2023-10-14T11:14:42.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.387+0000 7fe77f7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe7800d15d0 0x7fe7800c6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34048/0 (socket says 172.21.15.26:34048) 2023-10-14T11:14:42.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.387+0000 7fe77f7fe640 1 -- 172.21.15.26:0/195611045 learned_addr learned my addr 172.21.15.26:0/195611045 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:42.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.387+0000 7fe77effd640 1 --2- 172.21.15.26:0/195611045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe78015cb90 0x7fe7800cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:42.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.387+0000 7fe77e7fc640 1 -- 172.21.15.26:0/195611045 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178435057 0 0) 0x7fe7800ce770 con 0x7fe7800d15d0 2023-10-14T11:14:42.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.387+0000 7fe77e7fc640 1 -- 172.21.15.26:0/195611045 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe76c003530 con 0x7fe7800d15d0 2023-10-14T11:14:42.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.387+0000 7fe77e7fc640 1 -- 172.21.15.26:0/195611045 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060811229 0 0) 0x7fe7800d0600 con 0x7fe7800d3010 2023-10-14T11:14:42.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.387+0000 7fe77e7fc640 1 -- 172.21.15.26:0/195611045 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7800ce770 con 0x7fe7800d3010 2023-10-14T11:14:42.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.387+0000 7fe77effd640 1 -- 172.21.15.26:0/195611045 >> v1:172.21.15.110:6789/0 conn(0x7fe7800d3010 legacy=0x7fe7800d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:42.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.387+0000 7fe77effd640 1 -- 172.21.15.26:0/195611045 >> v1:172.21.15.26:6789/0 conn(0x7fe7800d15d0 legacy=0x7fe7800c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:42.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.387+0000 7fe77effd640 1 -- 172.21.15.26:0/195611045 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7800d08a0 con 0x7fe78015cb90 2023-10-14T11:14:42.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.391+0000 7fe77effd640 1 --2- 172.21.15.26:0/195611045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe78015cb90 0x7fe7800cfb10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe7700097d0 tx=0x7fe77001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3a8e971de4b966e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:42.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.391+0000 7fe77e7fc640 1 -- 172.21.15.26:0/195611045 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7700ac640 con 0x7fe78015cb90 2023-10-14T11:14:42.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.391+0000 7fe77e7fc640 1 -- 172.21.15.26:0/195611045 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7700ac7a0 con 0x7fe78015cb90 2023-10-14T11:14:42.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.391+0000 7fe77e7fc640 1 -- 172.21.15.26:0/195611045 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7700acb30 con 0x7fe78015cb90 2023-10-14T11:14:42.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.391+0000 7fe785805640 1 -- 172.21.15.26:0/195611045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe78015cb90 msgr2=0x7fe7800cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:42.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.391+0000 7fe785805640 1 --2- 172.21.15.26:0/195611045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe78015cb90 0x7fe7800cfb10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe7700097d0 tx=0x7fe77001c3e0 comp rx=0 tx=0).stop 2023-10-14T11:14:42.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.391+0000 7fe785805640 1 -- 172.21.15.26:0/195611045 shutdown_connections 2023-10-14T11:14:42.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.391+0000 7fe785805640 1 --2- 172.21.15.26:0/195611045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe78015cb90 0x7fe7800cfb10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:42.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.391+0000 7fe785805640 1 -- 172.21.15.26:0/195611045 >> 172.21.15.26:0/195611045 conn(0x7fe78009bc50 msgr2=0x7fe7800d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:42.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.391+0000 7fe785805640 1 -- 172.21.15.26:0/195611045 shutdown_connections 2023-10-14T11:14:42.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.391+0000 7fe785805640 1 -- 172.21.15.26:0/195611045 wait complete. 2023-10-14T11:14:42.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe785805640 1 Processor -- start 2023-10-14T11:14:42.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe785805640 1 -- start start 2023-10-14T11:14:42.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe785805640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7800d15d0 0x7fe7800b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:42.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe785805640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7800d3010 0x7fe7800b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:42.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe785805640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe78015cb90 0x7fe7800b7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:42.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe785805640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe780158f30 con 0x7fe78015cb90 2023-10-14T11:14:42.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe785805640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7801591a0 con 0x7fe7800d15d0 2023-10-14T11:14:42.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe785805640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe780159480 con 0x7fe7800d3010 2023-10-14T11:14:42.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe77f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe78015cb90 0x7fe7800b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:42.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe77f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe78015cb90 0x7fe7800b7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59768/0 (socket says 172.21.15.26:59768) 2023-10-14T11:14:42.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe77f7fe640 1 -- 172.21.15.26:0/2514534785 learned_addr learned my addr 172.21.15.26:0/2514534785 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:42.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe77effd640 1 --2- 172.21.15.26:0/2514534785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7800d15d0 0x7fe7800b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:42.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe777fff640 1 --2- 172.21.15.26:0/2514534785 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7800d3010 0x7fe7800b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:42.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe77f7fe640 1 -- 172.21.15.26:0/2514534785 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7800d3010 msgr2=0x7fe7800b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:42.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe77f7fe640 1 --2- 172.21.15.26:0/2514534785 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7800d3010 0x7fe7800b5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:42.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe77f7fe640 1 -- 172.21.15.26:0/2514534785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7800d15d0 msgr2=0x7fe7800b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:42.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe77f7fe640 1 --2- 172.21.15.26:0/2514534785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7800d15d0 0x7fe7800b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:42.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe77f7fe640 1 -- 172.21.15.26:0/2514534785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7700093b0 con 0x7fe78015cb90 2023-10-14T11:14:42.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe77f7fe640 1 --2- 172.21.15.26:0/2514534785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe78015cb90 0x7fe7800b7510 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe77800ca70 tx=0x7fe77800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:42.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe77cff9640 1 -- 172.21.15.26:0/2514534785 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77800abd0 con 0x7fe78015cb90 2023-10-14T11:14:42.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe77cff9640 1 -- 172.21.15.26:0/2514534785 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77800ad50 con 0x7fe78015cb90 2023-10-14T11:14:42.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe77cff9640 1 -- 172.21.15.26:0/2514534785 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe778012640 con 0x7fe78015cb90 2023-10-14T11:14:42.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe785805640 1 -- 172.21.15.26:0/2514534785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe780159760 con 0x7fe78015cb90 2023-10-14T11:14:42.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe785805640 1 -- 172.21.15.26:0/2514534785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7800b7a50 con 0x7fe78015cb90 2023-10-14T11:14:42.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.395+0000 7fe785805640 1 -- 172.21.15.26:0/2514534785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe780074010 con 0x7fe78015cb90 2023-10-14T11:14:42.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.399+0000 7fe77cff9640 1 -- 172.21.15.26:0/2514534785 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe778007070 con 0x7fe78015cb90 2023-10-14T11:14:42.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.399+0000 7fe77cff9640 1 --2- 172.21.15.26:0/2514534785 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe7600664a0 0x7fe760068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:42.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.399+0000 7fe77cff9640 1 -- 172.21.15.26:0/2514534785 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe778083be0 con 0x7fe78015cb90 2023-10-14T11:14:42.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.399+0000 7fe77effd640 1 --2- 172.21.15.26:0/2514534785 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe7600664a0 0x7fe760068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:42.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.399+0000 7fe77effd640 1 --2- 172.21.15.26:0/2514534785 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe7600664a0 0x7fe760068960 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe7700ae000 tx=0x7fe7700a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:42.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.403+0000 7fe77cff9640 1 -- 172.21.15.26:0/2514534785 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe778051230 con 0x7fe78015cb90 2023-10-14T11:14:42.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:42.615+0000 7fe785805640 1 -- 172.21.15.26:0/2514534785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7fe780159c10 con 0x7fe78015cb90 2023-10-14T11:14:43.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.535+0000 7fe77cff9640 1 -- 172.21.15.26:0/2514534785 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v155) v1 ==== 137+0+0 (secure 0 0 0) 0x7fe7780170d0 con 0x7fe78015cb90 2023-10-14T11:14:43.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.535+0000 7fe785805640 1 -- 172.21.15.26:0/2514534785 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe7600664a0 msgr2=0x7fe760068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:43.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.535+0000 7fe785805640 1 --2- 172.21.15.26:0/2514534785 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe7600664a0 0x7fe760068960 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe7700ae000 tx=0x7fe7700a7000 comp rx=0 tx=0).stop 2023-10-14T11:14:43.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.535+0000 7fe785805640 1 -- 172.21.15.26:0/2514534785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe78015cb90 msgr2=0x7fe7800b7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:43.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.535+0000 7fe785805640 1 --2- 172.21.15.26:0/2514534785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe78015cb90 0x7fe7800b7510 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe77800ca70 tx=0x7fe77800cf30 comp rx=0 tx=0).stop 2023-10-14T11:14:43.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.535+0000 7fe785805640 1 -- 172.21.15.26:0/2514534785 shutdown_connections 2023-10-14T11:14:43.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.535+0000 7fe785805640 1 --2- 172.21.15.26:0/2514534785 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe7600664a0 0x7fe760068960 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:43.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.535+0000 7fe785805640 1 --2- 172.21.15.26:0/2514534785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe78015cb90 0x7fe7800b7510 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:43.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.535+0000 7fe785805640 1 --2- 172.21.15.26:0/2514534785 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7800d3010 0x7fe7800b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:43.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.535+0000 7fe785805640 1 --2- 172.21.15.26:0/2514534785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7800d15d0 0x7fe7800b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:43.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.535+0000 7fe785805640 1 -- 172.21.15.26:0/2514534785 >> 172.21.15.26:0/2514534785 conn(0x7fe78009bc50 msgr2=0x7fe7800cb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:43.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.539+0000 7fe785805640 1 -- 172.21.15.26:0/2514534785 shutdown_connections 2023-10-14T11:14:43.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.539+0000 7fe785805640 1 -- 172.21.15.26:0/2514534785 wait complete. 2023-10-14T11:14:43.567 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T11:14:43.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.711+0000 7f2c0f13e640 1 Processor -- start 2023-10-14T11:14:43.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.711+0000 7f2c0f13e640 1 -- start start 2023-10-14T11:14:43.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.711+0000 7f2c0f13e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2c0806d010 0x7f2c080c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:43.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.711+0000 7f2c0f13e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2c080c26b0 0x7f2c080c2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:43.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.711+0000 7f2c0f13e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c0815ae30 con 0x7f2c08069e90 2023-10-14T11:14:43.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.711+0000 7f2c0f13e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c080cb090 con 0x7f2c080c26b0 2023-10-14T11:14:43.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.711+0000 7f2c0f13e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c0806d470 con 0x7f2c0806d010 2023-10-14T11:14:43.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.711+0000 7f2c0ceda640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2c08069e90 0x7f2c0806a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34064/0 (socket says 172.21.15.26:34064) 2023-10-14T11:14:43.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.711+0000 7f2c0ceda640 1 -- 172.21.15.26:0/1232024240 learned_addr learned my addr 172.21.15.26:0/1232024240 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:43.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.711+0000 7f2c0d6db640 1 --2- 172.21.15.26:0/1232024240 >> v2:172.21.15.26:3300/0 conn(0x7f2c080c26b0 0x7f2c080c2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:43.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.711+0000 7f2c07fff640 1 --2- 172.21.15.26:0/1232024240 >> v2:172.21.15.110:3300/0 conn(0x7f2c0806d010 0x7f2c080c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:43.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.711+0000 7f2c077fe640 1 -- 172.21.15.26:0/1232024240 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491577344 0 0) 0x7f2c0815ae30 con 0x7f2c08069e90 2023-10-14T11:14:43.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.711+0000 7f2c077fe640 1 -- 172.21.15.26:0/1232024240 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bf8003530 con 0x7f2c08069e90 2023-10-14T11:14:43.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.711+0000 7f2c0d6db640 1 -- 172.21.15.26:0/1232024240 >> v2:172.21.15.110:3300/0 conn(0x7f2c0806d010 msgr2=0x7f2c080c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:43.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.711+0000 7f2c0d6db640 1 --2- 172.21.15.26:0/1232024240 >> v2:172.21.15.110:3300/0 conn(0x7f2c0806d010 0x7f2c080c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:43.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.711+0000 7f2c0d6db640 1 -- 172.21.15.26:0/1232024240 >> v1:172.21.15.26:6789/0 conn(0x7f2c08069e90 legacy=0x7f2c0806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:43.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.711+0000 7f2c0d6db640 1 -- 172.21.15.26:0/1232024240 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c080ca510 con 0x7f2c080c26b0 2023-10-14T11:14:43.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.715+0000 7f2c0d6db640 1 --2- 172.21.15.26:0/1232024240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c080c26b0 0x7f2c080c2b20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f2c0806ada0 tx=0x7f2c0001f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b25b14082d509b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:43.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.715+0000 7f2c077fe640 1 -- 172.21.15.26:0/1232024240 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c000b0440 con 0x7f2c080c26b0 2023-10-14T11:14:43.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.715+0000 7f2c077fe640 1 -- 172.21.15.26:0/1232024240 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c000b05a0 con 0x7f2c080c26b0 2023-10-14T11:14:43.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.715+0000 7f2c077fe640 1 -- 172.21.15.26:0/1232024240 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c000b0930 con 0x7f2c080c26b0 2023-10-14T11:14:43.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.715+0000 7f2c0f13e640 1 -- 172.21.15.26:0/1232024240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c080c26b0 msgr2=0x7f2c080c2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:43.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.715+0000 7f2c0f13e640 1 --2- 172.21.15.26:0/1232024240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c080c26b0 0x7f2c080c2b20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f2c0806ada0 tx=0x7f2c0001f0f0 comp rx=0 tx=0).stop 2023-10-14T11:14:43.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.715+0000 7f2c0f13e640 1 -- 172.21.15.26:0/1232024240 shutdown_connections 2023-10-14T11:14:43.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.715+0000 7f2c0f13e640 1 --2- 172.21.15.26:0/1232024240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c080c26b0 0x7f2c080c2b20 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:43.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.715+0000 7f2c0f13e640 1 --2- 172.21.15.26:0/1232024240 >> v2:172.21.15.110:3300/0 conn(0x7f2c0806d010 0x7f2c080c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:43.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.715+0000 7f2c0f13e640 1 -- 172.21.15.26:0/1232024240 >> 172.21.15.26:0/1232024240 conn(0x7f2c080b0da0 msgr2=0x7f2c080ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:43.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.715+0000 7f2c0f13e640 1 -- 172.21.15.26:0/1232024240 shutdown_connections 2023-10-14T11:14:43.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.715+0000 7f2c0f13e640 1 -- 172.21.15.26:0/1232024240 wait complete. 2023-10-14T11:14:43.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c0f13e640 1 Processor -- start 2023-10-14T11:14:43.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c0f13e640 1 -- start start 2023-10-14T11:14:43.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c0f13e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c08069e90 0x7f2c080cd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:43.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c0f13e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c0806d010 0x7f2c080c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:43.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c0f13e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c080c26b0 0x7f2c081f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:43.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c0f13e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c081f2d20 con 0x7f2c0806d010 2023-10-14T11:14:43.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c0f13e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c080c7920 con 0x7f2c080c26b0 2023-10-14T11:14:43.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c0f13e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c080cc350 con 0x7f2c08069e90 2023-10-14T11:14:43.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c07fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c0806d010 0x7f2c080c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:43.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c07fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c0806d010 0x7f2c080c7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59796/0 (socket says 172.21.15.26:59796) 2023-10-14T11:14:43.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c07fff640 1 -- 172.21.15.26:0/2660338037 learned_addr learned my addr 172.21.15.26:0/2660338037 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:43.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c0ceda640 1 --2- 172.21.15.26:0/2660338037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c08069e90 0x7f2c080cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:43.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c0d6db640 1 --2- 172.21.15.26:0/2660338037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c080c26b0 0x7f2c081f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:43.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c07fff640 1 -- 172.21.15.26:0/2660338037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c08069e90 msgr2=0x7f2c080cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:43.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c07fff640 1 --2- 172.21.15.26:0/2660338037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c08069e90 0x7f2c080cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:43.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c07fff640 1 -- 172.21.15.26:0/2660338037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c080c26b0 msgr2=0x7f2c081f27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:43.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c07fff640 1 --2- 172.21.15.26:0/2660338037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c080c26b0 0x7f2c081f27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:43.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c07fff640 1 -- 172.21.15.26:0/2660338037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c00009a70 con 0x7f2c0806d010 2023-10-14T11:14:43.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c0ceda640 1 --2- 172.21.15.26:0/2660338037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c08069e90 0x7f2c080cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:43.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c0d6db640 1 --2- 172.21.15.26:0/2660338037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c080c26b0 0x7f2c081f27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:43.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c07fff640 1 --2- 172.21.15.26:0/2660338037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c0806d010 0x7f2c080c7290 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400d800 tx=0x7f2bf400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:43.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c057fa640 1 -- 172.21.15.26:0/2660338037 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf400b6c0 con 0x7f2c0806d010 2023-10-14T11:14:43.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c057fa640 1 -- 172.21.15.26:0/2660338037 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf400b820 con 0x7f2c0806d010 2023-10-14T11:14:43.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c057fa640 1 -- 172.21.15.26:0/2660338037 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf400bb90 con 0x7f2c0806d010 2023-10-14T11:14:43.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c0f13e640 1 -- 172.21.15.26:0/2660338037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c080cc630 con 0x7f2c0806d010 2023-10-14T11:14:43.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.719+0000 7f2c0f13e640 1 -- 172.21.15.26:0/2660338037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c080ccbf0 con 0x7f2c0806d010 2023-10-14T11:14:43.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.723+0000 7f2c0f13e640 1 -- 172.21.15.26:0/2660338037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c0804e170 con 0x7f2c0806d010 2023-10-14T11:14:43.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.723+0000 7f2c057fa640 1 -- 172.21.15.26:0/2660338037 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2bf400bcf0 con 0x7f2c0806d010 2023-10-14T11:14:43.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.723+0000 7f2c057fa640 1 --2- 172.21.15.26:0/2660338037 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2bec0664d0 0x7f2bec068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:43.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.723+0000 7f2c057fa640 1 -- 172.21.15.26:0/2660338037 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f2bf4084280 con 0x7f2c0806d010 2023-10-14T11:14:43.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.723+0000 7f2c0ceda640 1 --2- 172.21.15.26:0/2660338037 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2bec0664d0 0x7f2bec068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:43.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.723+0000 7f2c0ceda640 1 --2- 172.21.15.26:0/2660338037 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2bec0664d0 0x7f2bec068990 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc005890 tx=0x7f2bfc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:43.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.727+0000 7f2c057fa640 1 -- 172.21.15.26:0/2660338037 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2bf4051820 con 0x7f2c0806d010 2023-10-14T11:14:43.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.883+0000 7f2c0f13e640 1 -- 172.21.15.26:0/2660338037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2c080c2090 con 0x7f2c0806d010 2023-10-14T11:14:43.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.887+0000 7f2c057fa640 1 -- 172.21.15.26:0/2660338037 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2bf4054e40 con 0x7f2c0806d010 2023-10-14T11:14:43.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.891+0000 7f2c0f13e640 1 -- 172.21.15.26:0/2660338037 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2bec0664d0 msgr2=0x7f2bec068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:43.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.891+0000 7f2c0f13e640 1 --2- 172.21.15.26:0/2660338037 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2bec0664d0 0x7f2bec068990 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc005890 tx=0x7f2bfc009040 comp rx=0 tx=0).stop 2023-10-14T11:14:43.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.891+0000 7f2c0f13e640 1 -- 172.21.15.26:0/2660338037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c0806d010 msgr2=0x7f2c080c7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:43.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.891+0000 7f2c0f13e640 1 --2- 172.21.15.26:0/2660338037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c0806d010 0x7f2c080c7290 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400d800 tx=0x7f2bf400dcc0 comp rx=0 tx=0).stop 2023-10-14T11:14:43.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.891+0000 7f2c0f13e640 1 -- 172.21.15.26:0/2660338037 shutdown_connections 2023-10-14T11:14:43.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.891+0000 7f2c0f13e640 1 --2- 172.21.15.26:0/2660338037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c080c26b0 0x7f2c081f27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:43.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.891+0000 7f2c0f13e640 1 --2- 172.21.15.26:0/2660338037 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2bec0664d0 0x7f2bec068990 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:43.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.891+0000 7f2c0f13e640 1 --2- 172.21.15.26:0/2660338037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c0806d010 0x7f2c080c7290 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:43.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.891+0000 7f2c0f13e640 1 --2- 172.21.15.26:0/2660338037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c08069e90 0x7f2c080cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:43.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.891+0000 7f2c0f13e640 1 -- 172.21.15.26:0/2660338037 >> 172.21.15.26:0/2660338037 conn(0x7f2c080b0da0 msgr2=0x7f2c080c9920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:43.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.891+0000 7f2c0f13e640 1 -- 172.21.15.26:0/2660338037 shutdown_connections 2023-10-14T11:14:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:43.891+0000 7f2c0f13e640 1 -- 172.21.15.26:0/2660338037 wait complete. 2023-10-14T11:14:43.918 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T11:14:43.919 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T11:14:44.014 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T11:14:44.104 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T11:14:44.105 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:14:44.105 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:14:44.115 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357764k,nr_inodes=4089441,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7700 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-14T11:14:44.116 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:14:44.116 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:14:44.127 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7574 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-14T11:14:44.128 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:14:44.128 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:14:44.168 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357764k,nr_inodes=4089441,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7700 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-14T11:14:44.169 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:14:44.169 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:14:44.182 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7574 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-14T11:14:44.183 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T11:14:44.183 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:14:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.347+0000 7fbd2dc46640 1 Processor -- start 2023-10-14T11:14:44.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.347+0000 7fbd2dc46640 1 -- start start 2023-10-14T11:14:44.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.351+0000 7fbd2dc46640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbd281597c0 0x7fbd280ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:44.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.351+0000 7fbd2dc46640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd28159ba0 0x7fbd280cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:44.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.351+0000 7fbd2dc46640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd280723d0 con 0x7fbd280adc10 2023-10-14T11:14:44.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.351+0000 7fbd2dc46640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd280717c0 con 0x7fbd281597c0 2023-10-14T11:14:44.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.351+0000 7fbd2dc46640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd28071aa0 con 0x7fbd28159ba0 2023-10-14T11:14:44.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.351+0000 7fbd277fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbd281597c0 0x7fbd280ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:44.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.351+0000 7fbd277fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbd281597c0 0x7fbd280ad6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.26:55992/0 (socket says 172.21.15.26:55992) 2023-10-14T11:14:44.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.351+0000 7fbd277fe640 1 -- 172.21.15.26:0/3722523024 learned_addr learned my addr 172.21.15.26:0/3722523024 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:44.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.351+0000 7fbd27fff640 1 --1- 172.21.15.26:0/3722523024 >> v1:172.21.15.110:6789/0 conn(0x7fbd280adc10 0x7fbd280cb350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:37688/0 (socket says 172.21.15.26:37688) 2023-10-14T11:14:44.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.351+0000 7fbd26ffd640 1 --2- 172.21.15.26:0/3722523024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd28159ba0 0x7fbd280cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:44.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.351+0000 7fbd277fe640 1 -- 172.21.15.26:0/3722523024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd28159ba0 msgr2=0x7fbd280cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:44.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.351+0000 7fbd277fe640 1 --2- 172.21.15.26:0/3722523024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd28159ba0 0x7fbd280cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:44.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.351+0000 7fbd277fe640 1 -- 172.21.15.26:0/3722523024 >> v1:172.21.15.110:6789/0 conn(0x7fbd280adc10 legacy=0x7fbd280cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:44.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.351+0000 7fbd277fe640 1 -- 172.21.15.26:0/3722523024 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd28071d80 con 0x7fbd281597c0 2023-10-14T11:14:44.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.355+0000 7fbd277fe640 1 --2- 172.21.15.26:0/3722523024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd281597c0 0x7fbd280ad6d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009870 tx=0x7fbd1801c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20a71226ee95d92 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:44.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.355+0000 7fbd267fc640 1 -- 172.21.15.26:0/3722523024 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd180aa640 con 0x7fbd281597c0 2023-10-14T11:14:44.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.355+0000 7fbd267fc640 1 -- 172.21.15.26:0/3722523024 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd180aa7a0 con 0x7fbd281597c0 2023-10-14T11:14:44.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.355+0000 7fbd267fc640 1 -- 172.21.15.26:0/3722523024 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd180aab30 con 0x7fbd281597c0 2023-10-14T11:14:44.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.355+0000 7fbd2dc46640 1 -- 172.21.15.26:0/3722523024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd281597c0 msgr2=0x7fbd280ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:44.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.355+0000 7fbd2dc46640 1 --2- 172.21.15.26:0/3722523024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd281597c0 0x7fbd280ad6d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009870 tx=0x7fbd1801c540 comp rx=0 tx=0).stop 2023-10-14T11:14:44.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.355+0000 7fbd2dc46640 1 -- 172.21.15.26:0/3722523024 shutdown_connections 2023-10-14T11:14:44.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.355+0000 7fbd2dc46640 1 --2- 172.21.15.26:0/3722523024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd28159ba0 0x7fbd280cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:44.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.355+0000 7fbd2dc46640 1 --2- 172.21.15.26:0/3722523024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd281597c0 0x7fbd280ad6d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:44.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.355+0000 7fbd2dc46640 1 -- 172.21.15.26:0/3722523024 >> 172.21.15.26:0/3722523024 conn(0x7fbd2806c190 msgr2=0x7fbd2806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:44.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.355+0000 7fbd2dc46640 1 -- 172.21.15.26:0/3722523024 shutdown_connections 2023-10-14T11:14:44.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.355+0000 7fbd2dc46640 1 -- 172.21.15.26:0/3722523024 wait complete. 2023-10-14T11:14:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.355+0000 7fbd2dc46640 1 Processor -- start 2023-10-14T11:14:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.355+0000 7fbd2dc46640 1 -- start start 2023-10-14T11:14:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd2dc46640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd280adc10 0x7fbd2814aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd2dc46640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd281597c0 0x7fbd28157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:44.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd2dc46640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd28159ba0 0x7fbd280c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:44.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd2dc46640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd28156750 con 0x7fbd28159ba0 2023-10-14T11:14:44.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd2dc46640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2814b410 con 0x7fbd280adc10 2023-10-14T11:14:44.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd2dc46640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd28155ad0 con 0x7fbd281597c0 2023-10-14T11:14:44.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd27fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd28159ba0 0x7fbd280c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:44.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd27fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd28159ba0 0x7fbd280c7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59812/0 (socket says 172.21.15.26:59812) 2023-10-14T11:14:44.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd27fff640 1 -- 172.21.15.26:0/4092090476 learned_addr learned my addr 172.21.15.26:0/4092090476 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:44.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd277fe640 1 --2- 172.21.15.26:0/4092090476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd280adc10 0x7fbd2814aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:44.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd26ffd640 1 --2- 172.21.15.26:0/4092090476 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd281597c0 0x7fbd28157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:44.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd27fff640 1 -- 172.21.15.26:0/4092090476 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd281597c0 msgr2=0x7fbd28157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:44.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd27fff640 1 --2- 172.21.15.26:0/4092090476 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd281597c0 0x7fbd28157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:44.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd27fff640 1 -- 172.21.15.26:0/4092090476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd280adc10 msgr2=0x7fbd2814aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:44.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd27fff640 1 --2- 172.21.15.26:0/4092090476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd280adc10 0x7fbd2814aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:44.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd27fff640 1 -- 172.21.15.26:0/4092090476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd180094d0 con 0x7fbd28159ba0 2023-10-14T11:14:44.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd26ffd640 1 --2- 172.21.15.26:0/4092090476 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd281597c0 0x7fbd28157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:44.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd27fff640 1 --2- 172.21.15.26:0/4092090476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd28159ba0 0x7fbd280c7900 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c730 tx=0x7fbd2000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:44.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd0ffff640 1 -- 172.21.15.26:0/4092090476 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2000ce40 con 0x7fbd28159ba0 2023-10-14T11:14:44.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd0ffff640 1 -- 172.21.15.26:0/4092090476 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2000a640 con 0x7fbd28159ba0 2023-10-14T11:14:44.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd0ffff640 1 -- 172.21.15.26:0/4092090476 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2000a9b0 con 0x7fbd28159ba0 2023-10-14T11:14:44.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd2dc46640 1 -- 172.21.15.26:0/4092090476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd28155db0 con 0x7fbd28159ba0 2023-10-14T11:14:44.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd2dc46640 1 -- 172.21.15.26:0/4092090476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd28156370 con 0x7fbd28159ba0 2023-10-14T11:14:44.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.359+0000 7fbd2dc46640 1 -- 172.21.15.26:0/4092090476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd28156890 con 0x7fbd28159ba0 2023-10-14T11:14:44.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.363+0000 7fbd0ffff640 1 -- 172.21.15.26:0/4092090476 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbd2000ab10 con 0x7fbd28159ba0 2023-10-14T11:14:44.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.363+0000 7fbd0ffff640 1 --2- 172.21.15.26:0/4092090476 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd140664a0 0x7fbd14068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:44.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.363+0000 7fbd0ffff640 1 -- 172.21.15.26:0/4092090476 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fbd20083310 con 0x7fbd28159ba0 2023-10-14T11:14:44.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.363+0000 7fbd277fe640 1 --2- 172.21.15.26:0/4092090476 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd140664a0 0x7fbd14068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:44.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.363+0000 7fbd277fe640 1 --2- 172.21.15.26:0/4092090476 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd140664a0 0x7fbd14068960 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbd180ae000 tx=0x7fbd180b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:44.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.367+0000 7fbd0ffff640 1 -- 172.21.15.26:0/4092090476 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbd28156890 con 0x7fbd28159ba0 2023-10-14T11:14:44.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.559+0000 7fbd2dc46640 1 -- 172.21.15.26:0/4092090476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd28156890 con 0x7fbd28159ba0 2023-10-14T11:14:44.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.559+0000 7fbd0ffff640 1 -- 172.21.15.26:0/4092090476 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3705 (secure 0 0 0) 0x7fbd28156890 con 0x7fbd28159ba0 2023-10-14T11:14:44.568 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:44.568 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5425,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/1669994220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1669994220},{"type":"v1","addr":"172.21.15.110:6834","nonce":1669994220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3054425791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3054425791},{"type":"v1","addr":"172.21.15.110:6835","nonce":3054425791}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5434,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3759640340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3759640340},{"type":"v1","addr":"172.21.15.26:6837","nonce":3759640340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":6069,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/1417085392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":1417085392},{"type":"v1","addr":"172.21.15.26:6835","nonce":1417085392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[]} 2023-10-14T11:14:44.568 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 20 2023-10-14T11:14:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.563+0000 7fbd2dc46640 1 -- 172.21.15.26:0/4092090476 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd140664a0 msgr2=0x7fbd14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.563+0000 7fbd2dc46640 1 --2- 172.21.15.26:0/4092090476 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd140664a0 0x7fbd14068960 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbd180ae000 tx=0x7fbd180b5040 comp rx=0 tx=0).stop 2023-10-14T11:14:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.563+0000 7fbd2dc46640 1 -- 172.21.15.26:0/4092090476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd28159ba0 msgr2=0x7fbd280c7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.563+0000 7fbd2dc46640 1 --2- 172.21.15.26:0/4092090476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd28159ba0 0x7fbd280c7900 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c730 tx=0x7fbd2000cbf0 comp rx=0 tx=0).stop 2023-10-14T11:14:44.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.563+0000 7fbd2dc46640 1 -- 172.21.15.26:0/4092090476 shutdown_connections 2023-10-14T11:14:44.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.563+0000 7fbd2dc46640 1 --2- 172.21.15.26:0/4092090476 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd140664a0 0x7fbd14068960 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:44.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.563+0000 7fbd2dc46640 1 --2- 172.21.15.26:0/4092090476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd28159ba0 0x7fbd280c7900 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:44.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.563+0000 7fbd2dc46640 1 --2- 172.21.15.26:0/4092090476 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd281597c0 0x7fbd28157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:44.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.563+0000 7fbd2dc46640 1 --2- 172.21.15.26:0/4092090476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd280adc10 0x7fbd2814aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:44.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.563+0000 7fbd2dc46640 1 -- 172.21.15.26:0/4092090476 >> 172.21.15.26:0/4092090476 conn(0x7fbd2806c190 msgr2=0x7fbd280af190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:44.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.563+0000 7fbd2dc46640 1 -- 172.21.15.26:0/4092090476 shutdown_connections 2023-10-14T11:14:44.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.563+0000 7fbd2dc46640 1 -- 172.21.15.26:0/4092090476 wait complete. 2023-10-14T11:14:44.589 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T11:14:44.589 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T11:14:44.590 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T11:14:44.590 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:14:44.590 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T11:14:44.591 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T11:14:44.591 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T11:14:44.591 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:14:44.592 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T11:14:44.592 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T11:14:44.592 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T11:14:44.592 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:14:44.593 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T11:14:44.593 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T11:14:44.593 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T11:14:44.593 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:14:44.602 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T11:14:44.603 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T11:14:44.604 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T11:14:44.604 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T11:14:44.607 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T11:14:44.607 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T11:14:44.608 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T11:14:44.609 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T11:14:44.654 INFO:tasks.ceph.mds.a:Started 2023-10-14T11:14:44.655 DEBUG:teuthology.parallel:result is None 2023-10-14T11:14:44.657 INFO:tasks.ceph.mds.c:Started 2023-10-14T11:14:44.657 DEBUG:teuthology.parallel:result is None 2023-10-14T11:14:44.658 INFO:tasks.ceph.mds.b:Started 2023-10-14T11:14:44.658 DEBUG:teuthology.parallel:result is None 2023-10-14T11:14:44.660 INFO:tasks.ceph.mds.d:Started 2023-10-14T11:14:44.660 DEBUG:teuthology.parallel:result is None 2023-10-14T11:14:44.661 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T11:14:44.743 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-14T11:14:44.746 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-10-14T11:14:44.750 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2023-10-14T11:14:44.751 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2023-10-14T11:14:44.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.803+0000 7f9714c74640 1 Processor -- start 2023-10-14T11:14:44.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.803+0000 7f9714c74640 1 -- start start 2023-10-14T11:14:44.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.803+0000 7f9714c74640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f971006ffa0 0x7f97100c9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:44.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.803+0000 7f9714c74640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f97100afd90 0x7f97100b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:44.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.803+0000 7f9714c74640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97100c9cd0 con 0x7f971015a6c0 2023-10-14T11:14:44.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.803+0000 7f9714c74640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971015e5b0 con 0x7f971006ffa0 2023-10-14T11:14:44.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.803+0000 7f9714c74640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971015f150 con 0x7f97100afd90 2023-10-14T11:14:44.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.803+0000 7f970f7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f971015a6c0 0x7f971015ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34068/0 (socket says 172.21.15.26:34068) 2023-10-14T11:14:44.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.803+0000 7f970f7fe640 1 -- 172.21.15.26:0/2424566853 learned_addr learned my addr 172.21.15.26:0/2424566853 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:44.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.803+0000 7f970effd640 1 --2- 172.21.15.26:0/2424566853 >> v2:172.21.15.26:3300/0 conn(0x7f971006ffa0 0x7f97100c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:44.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.803+0000 7f970ffff640 1 --2- 172.21.15.26:0/2424566853 >> v2:172.21.15.110:3300/0 conn(0x7f97100afd90 0x7f97100b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:44.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.803+0000 7f970effd640 1 -- 172.21.15.26:0/2424566853 >> v2:172.21.15.110:3300/0 conn(0x7f97100afd90 msgr2=0x7f97100b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:44.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.803+0000 7f970effd640 1 --2- 172.21.15.26:0/2424566853 >> v2:172.21.15.110:3300/0 conn(0x7f97100afd90 0x7f97100b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:44.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.803+0000 7f970effd640 1 -- 172.21.15.26:0/2424566853 >> v1:172.21.15.26:6789/0 conn(0x7f971015a6c0 legacy=0x7f971015ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:44.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.803+0000 7f970effd640 1 -- 172.21.15.26:0/2424566853 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971015aaa0 con 0x7f971006ffa0 2023-10-14T11:14:44.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.803+0000 7f970ffff640 1 --2- 172.21.15.26:0/2424566853 >> v2:172.21.15.110:3300/0 conn(0x7f97100afd90 0x7f97100b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:44.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.807+0000 7f970effd640 1 --2- 172.21.15.26:0/2424566853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971006ffa0 0x7f97100c9790 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f97100ce2c0 tx=0x7f970401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c0af306d5c44c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:44.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.807+0000 7f970e7fc640 1 -- 172.21.15.26:0/2424566853 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97040ab600 con 0x7f971006ffa0 2023-10-14T11:14:44.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.807+0000 7f970e7fc640 1 -- 172.21.15.26:0/2424566853 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97040a7050 con 0x7f971006ffa0 2023-10-14T11:14:44.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.807+0000 7f970e7fc640 1 -- 172.21.15.26:0/2424566853 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97040ab980 con 0x7f971006ffa0 2023-10-14T11:14:44.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.807+0000 7f9714c74640 1 -- 172.21.15.26:0/2424566853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971006ffa0 msgr2=0x7f97100c9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:44.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.807+0000 7f9714c74640 1 --2- 172.21.15.26:0/2424566853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971006ffa0 0x7f97100c9790 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f97100ce2c0 tx=0x7f970401c460 comp rx=0 tx=0).stop 2023-10-14T11:14:44.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.807+0000 7f9714c74640 1 -- 172.21.15.26:0/2424566853 shutdown_connections 2023-10-14T11:14:44.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.807+0000 7f9714c74640 1 --2- 172.21.15.26:0/2424566853 >> v2:172.21.15.110:3300/0 conn(0x7f97100afd90 0x7f97100b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:44.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.807+0000 7f9714c74640 1 --2- 172.21.15.26:0/2424566853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971006ffa0 0x7f97100c9790 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:44.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.807+0000 7f9714c74640 1 -- 172.21.15.26:0/2424566853 >> 172.21.15.26:0/2424566853 conn(0x7f971006a4f0 msgr2=0x7f97100cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:44.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.807+0000 7f9714c74640 1 -- 172.21.15.26:0/2424566853 shutdown_connections 2023-10-14T11:14:44.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.807+0000 7f9714c74640 1 -- 172.21.15.26:0/2424566853 wait complete. 2023-10-14T11:14:44.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f9714c74640 1 Processor -- start 2023-10-14T11:14:44.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f9714c74640 1 -- start start 2023-10-14T11:14:44.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f9714c74640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971006ffa0 0x7f97100c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:44.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f9714c74640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97100afd90 0x7f971015ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:44.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f9714c74640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f971015a6c0 0x7f97100adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:44.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f9714c74640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9710158970 con 0x7f971006ffa0 2023-10-14T11:14:44.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f9714c74640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97100c8270 con 0x7f971015a6c0 2023-10-14T11:14:44.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f9714c74640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97101566a0 con 0x7f97100afd90 2023-10-14T11:14:44.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f970f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971006ffa0 0x7f97100c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:44.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f970f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971006ffa0 0x7f97100c7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59850/0 (socket says 172.21.15.26:59850) 2023-10-14T11:14:44.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f970f7fe640 1 -- 172.21.15.26:0/1359898577 learned_addr learned my addr 172.21.15.26:0/1359898577 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:44.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f970effd640 1 --2- 172.21.15.26:0/1359898577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97100afd90 0x7f971015ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:44.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f970ffff640 1 --2- 172.21.15.26:0/1359898577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f971015a6c0 0x7f97100adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:44.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f970f7fe640 1 -- 172.21.15.26:0/1359898577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97100afd90 msgr2=0x7f971015ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:44.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f970f7fe640 1 --2- 172.21.15.26:0/1359898577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97100afd90 0x7f971015ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:44.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f970f7fe640 1 -- 172.21.15.26:0/1359898577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f971015a6c0 msgr2=0x7f97100adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:44.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f970f7fe640 1 --2- 172.21.15.26:0/1359898577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f971015a6c0 0x7f97100adf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:44.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f970f7fe640 1 -- 172.21.15.26:0/1359898577 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9704009420 con 0x7f971006ffa0 2023-10-14T11:14:44.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f970f7fe640 1 --2- 172.21.15.26:0/1359898577 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971006ffa0 0x7f97100c7d30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f970000c500 tx=0x7f970000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:44.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f96f7fff640 1 -- 172.21.15.26:0/1359898577 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9700005cf0 con 0x7f971006ffa0 2023-10-14T11:14:44.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f96f7fff640 1 -- 172.21.15.26:0/1359898577 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9700005e50 con 0x7f971006ffa0 2023-10-14T11:14:44.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f9714c74640 1 -- 172.21.15.26:0/1359898577 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9710157d60 con 0x7f971006ffa0 2023-10-14T11:14:44.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f96f7fff640 1 -- 172.21.15.26:0/1359898577 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97000072f0 con 0x7f971006ffa0 2023-10-14T11:14:44.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.811+0000 7f9714c74640 1 -- 172.21.15.26:0/1359898577 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9710158320 con 0x7f971006ffa0 2023-10-14T11:14:44.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.815+0000 7f9714c74640 1 -- 172.21.15.26:0/1359898577 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971004e9c0 con 0x7f971006ffa0 2023-10-14T11:14:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.815+0000 7f96f7fff640 1 -- 172.21.15.26:0/1359898577 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9700007450 con 0x7f971006ffa0 2023-10-14T11:14:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.815+0000 7f96f7fff640 1 --2- 172.21.15.26:0/1359898577 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f96fc0664a0 0x7f96fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.815+0000 7f96f7fff640 1 -- 172.21.15.26:0/1359898577 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f9700082fe0 con 0x7f971006ffa0 2023-10-14T11:14:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.815+0000 7f970effd640 1 --2- 172.21.15.26:0/1359898577 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f96fc0664a0 0x7f96fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.815+0000 7f970effd640 1 --2- 172.21.15.26:0/1359898577 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f96fc0664a0 0x7f96fc068960 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f97040ad000 tx=0x7f9704008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:44.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.819+0000 7f96f7fff640 1 -- 172.21.15.26:0/1359898577 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f97000506c0 con 0x7f971006ffa0 2023-10-14T11:14:44.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:44.991+0000 7f9714c74640 1 -- 172.21.15.26:0/1359898577 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f97100c9cd0 con 0x7f971006ffa0 2023-10-14T11:14:45.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:45.903+0000 7f96f7fff640 1 -- 172.21.15.26:0/1359898577 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v51) v1 ==== 97+0+0 (secure 0 0 0) 0x7f97100c9cd0 con 0x7f971006ffa0 2023-10-14T11:14:45.911 INFO:teuthology.orchestra.run.smithi026.stderr: removed all blocklist entries 2023-10-14T11:14:45.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:45.907+0000 7f9714c74640 1 -- 172.21.15.26:0/1359898577 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f96fc0664a0 msgr2=0x7f96fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:45.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:45.907+0000 7f9714c74640 1 --2- 172.21.15.26:0/1359898577 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f96fc0664a0 0x7f96fc068960 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f97040ad000 tx=0x7f9704008040 comp rx=0 tx=0).stop 2023-10-14T11:14:45.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:45.907+0000 7f9714c74640 1 -- 172.21.15.26:0/1359898577 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971006ffa0 msgr2=0x7f97100c7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:45.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:45.907+0000 7f9714c74640 1 --2- 172.21.15.26:0/1359898577 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971006ffa0 0x7f97100c7d30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f970000c500 tx=0x7f970000c9c0 comp rx=0 tx=0).stop 2023-10-14T11:14:45.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:45.907+0000 7f9714c74640 1 -- 172.21.15.26:0/1359898577 shutdown_connections 2023-10-14T11:14:45.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:45.907+0000 7f9714c74640 1 --2- 172.21.15.26:0/1359898577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f971015a6c0 0x7f97100adf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:45.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:45.907+0000 7f9714c74640 1 --2- 172.21.15.26:0/1359898577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97100afd90 0x7f971015ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:45.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:45.907+0000 7f9714c74640 1 --2- 172.21.15.26:0/1359898577 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f96fc0664a0 0x7f96fc068960 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:45.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:45.907+0000 7f9714c74640 1 --2- 172.21.15.26:0/1359898577 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971006ffa0 0x7f97100c7d30 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:45.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:45.907+0000 7f9714c74640 1 -- 172.21.15.26:0/1359898577 >> 172.21.15.26:0/1359898577 conn(0x7f971006a4f0 msgr2=0x7f971015ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:45.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:45.907+0000 7f9714c74640 1 -- 172.21.15.26:0/1359898577 shutdown_connections 2023-10-14T11:14:45.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:45.907+0000 7f9714c74640 1 -- 172.21.15.26:0/1359898577 wait complete. 2023-10-14T11:14:45.938 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T11:14:46.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.079+0000 7f37f0217640 1 Processor -- start 2023-10-14T11:14:46.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.079+0000 7f37f0217640 1 -- start start 2023-10-14T11:14:46.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.083+0000 7f37f0217640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f37e8164520 0x7f37e80ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:46.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.083+0000 7f37f0217640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f37e80ad960 0x7f37e80b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:46.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.083+0000 7f37f0217640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37e80c9b80 0x7f37e80b0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:46.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.083+0000 7f37f0217640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e8164900 con 0x7f37e8164520 2023-10-14T11:14:46.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.083+0000 7f37f0217640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e80c96f0 con 0x7f37e80ad960 2023-10-14T11:14:46.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.083+0000 7f37f0217640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e80cb950 con 0x7f37e80c9b80 2023-10-14T11:14:46.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.083+0000 7f37edfb3640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f37e8164520 0x7f37e80ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:46.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.083+0000 7f37edfb3640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f37e8164520 0x7f37e80ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59856/0 (socket says 172.21.15.26:59856) 2023-10-14T11:14:46.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.083+0000 7f37edfb3640 1 -- 172.21.15.26:0/3150703378 learned_addr learned my addr 172.21.15.26:0/3150703378 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:46.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.083+0000 7f37ee7b4640 1 --2- 172.21.15.26:0/3150703378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37e80c9b80 0x7f37e80b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:46.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.083+0000 7f37ed7b2640 1 --2- 172.21.15.26:0/3150703378 >> v2:172.21.15.110:3300/0 conn(0x7f37e80ad960 0x7f37e80b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:46.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.083+0000 7f37edfb3640 1 -- 172.21.15.26:0/3150703378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37e80c9b80 msgr2=0x7f37e80b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:46.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.083+0000 7f37edfb3640 1 --2- 172.21.15.26:0/3150703378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37e80c9b80 0x7f37e80b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.083+0000 7f37edfb3640 1 -- 172.21.15.26:0/3150703378 >> v2:172.21.15.110:3300/0 conn(0x7f37e80ad960 msgr2=0x7f37e80b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:46.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.083+0000 7f37edfb3640 1 --2- 172.21.15.26:0/3150703378 >> v2:172.21.15.110:3300/0 conn(0x7f37e80ad960 0x7f37e80b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.083+0000 7f37edfb3640 1 -- 172.21.15.26:0/3150703378 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e80cbed0 con 0x7f37e8164520 2023-10-14T11:14:46.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.083+0000 7f37edfb3640 1 --2- 172.21.15.26:0/3150703378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37e8164520 0x7f37e80ce010 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f37e806e3a0 tx=0x7f37e401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e2cb253f86584d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:46.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.083+0000 7f37ecfb1640 1 -- 172.21.15.26:0/3150703378 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e40aa640 con 0x7f37e8164520 2023-10-14T11:14:46.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37ecfb1640 1 -- 172.21.15.26:0/3150703378 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e40aa7a0 con 0x7f37e8164520 2023-10-14T11:14:46.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37ecfb1640 1 -- 172.21.15.26:0/3150703378 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e40aab30 con 0x7f37e8164520 2023-10-14T11:14:46.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37f0217640 1 -- 172.21.15.26:0/3150703378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37e8164520 msgr2=0x7f37e80ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:46.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37f0217640 1 --2- 172.21.15.26:0/3150703378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37e8164520 0x7f37e80ce010 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f37e806e3a0 tx=0x7f37e401c500 comp rx=0 tx=0).stop 2023-10-14T11:14:46.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37f0217640 1 -- 172.21.15.26:0/3150703378 shutdown_connections 2023-10-14T11:14:46.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37f0217640 1 --2- 172.21.15.26:0/3150703378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37e80c9b80 0x7f37e80b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37f0217640 1 --2- 172.21.15.26:0/3150703378 >> v2:172.21.15.110:3300/0 conn(0x7f37e80ad960 0x7f37e80b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37f0217640 1 --2- 172.21.15.26:0/3150703378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37e8164520 0x7f37e80ce010 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37f0217640 1 -- 172.21.15.26:0/3150703378 >> 172.21.15.26:0/3150703378 conn(0x7f37e806c190 msgr2=0x7f37e806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:46.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37f0217640 1 -- 172.21.15.26:0/3150703378 shutdown_connections 2023-10-14T11:14:46.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37f0217640 1 -- 172.21.15.26:0/3150703378 wait complete. 2023-10-14T11:14:46.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37f0217640 1 Processor -- start 2023-10-14T11:14:46.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37f0217640 1 -- start start 2023-10-14T11:14:46.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37f0217640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37e80ad960 0x7f37e80c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:46.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37f0217640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37e80c9b80 0x7f37e80c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:46.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37f0217640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37e8164520 0x7f37e80c2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:46.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37f0217640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e80b3ec0 con 0x7f37e80ad960 2023-10-14T11:14:46.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37f0217640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e80b4180 con 0x7f37e80c9b80 2023-10-14T11:14:46.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37f0217640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e80c22f0 con 0x7f37e8164520 2023-10-14T11:14:46.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37edfb3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37e80ad960 0x7f37e80c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:46.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37edfb3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37e80ad960 0x7f37e80c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59866/0 (socket says 172.21.15.26:59866) 2023-10-14T11:14:46.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37edfb3640 1 -- 172.21.15.26:0/3737887997 learned_addr learned my addr 172.21.15.26:0/3737887997 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:46.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37ed7b2640 1 --2- 172.21.15.26:0/3737887997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37e80c9b80 0x7f37e80c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:46.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.087+0000 7f37ee7b4640 1 --2- 172.21.15.26:0/3737887997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37e8164520 0x7f37e80c2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:46.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.091+0000 7f37edfb3640 1 -- 172.21.15.26:0/3737887997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37e8164520 msgr2=0x7f37e80c2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:46.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.091+0000 7f37edfb3640 1 --2- 172.21.15.26:0/3737887997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37e8164520 0x7f37e80c2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.091+0000 7f37edfb3640 1 -- 172.21.15.26:0/3737887997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37e80c9b80 msgr2=0x7f37e80c3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:46.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.091+0000 7f37edfb3640 1 --2- 172.21.15.26:0/3737887997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37e80c9b80 0x7f37e80c3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.091+0000 7f37edfb3640 1 -- 172.21.15.26:0/3737887997 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e40094d0 con 0x7f37e80ad960 2023-10-14T11:14:46.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.091+0000 7f37ee7b4640 1 --2- 172.21.15.26:0/3737887997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37e8164520 0x7f37e80c2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:46.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.091+0000 7f37edfb3640 1 --2- 172.21.15.26:0/3737887997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37e80ad960 0x7f37e80c8400 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f37e40ac040 tx=0x7f37e401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:46.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.091+0000 7f37de7fc640 1 -- 172.21.15.26:0/3737887997 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e40bd5f0 con 0x7f37e80ad960 2023-10-14T11:14:46.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.091+0000 7f37de7fc640 1 -- 172.21.15.26:0/3737887997 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e40bd750 con 0x7f37e80ad960 2023-10-14T11:14:46.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.091+0000 7f37de7fc640 1 -- 172.21.15.26:0/3737887997 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e40bdb00 con 0x7f37e80ad960 2023-10-14T11:14:46.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.091+0000 7f37f0217640 1 -- 172.21.15.26:0/3737887997 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e80c25d0 con 0x7f37e80ad960 2023-10-14T11:14:46.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.091+0000 7f37f0217640 1 -- 172.21.15.26:0/3737887997 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e80c42e0 con 0x7f37e80ad960 2023-10-14T11:14:46.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.091+0000 7f37f0217640 1 -- 172.21.15.26:0/3737887997 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e80c44d0 con 0x7f37e80ad960 2023-10-14T11:14:46.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.091+0000 7f37de7fc640 1 -- 172.21.15.26:0/3737887997 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f37e40a8050 con 0x7f37e80ad960 2023-10-14T11:14:46.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.091+0000 7f37de7fc640 1 --2- 172.21.15.26:0/3737887997 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37cc0664a0 0x7f37cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:46.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.091+0000 7f37de7fc640 1 -- 172.21.15.26:0/3737887997 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f37e411e390 con 0x7f37e80ad960 2023-10-14T11:14:46.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.095+0000 7f37ed7b2640 1 --2- 172.21.15.26:0/3737887997 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37cc0664a0 0x7f37cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:46.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.095+0000 7f37ed7b2640 1 --2- 172.21.15.26:0/3737887997 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37cc0664a0 0x7f37cc068960 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f37e80c5530 tx=0x7f37d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:46.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.095+0000 7f37de7fc640 1 -- 172.21.15.26:0/3737887997 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f37e80c44d0 con 0x7f37e80ad960 2023-10-14T11:14:46.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.307+0000 7f37f0217640 1 -- 172.21.15.26:0/3737887997 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f37e80c44d0 con 0x7f37e80ad960 2023-10-14T11:14:46.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.307+0000 7f37de7fc640 1 -- 172.21.15.26:0/3737887997 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5303 (secure 0 0 0) 0x7f37e80c44d0 con 0x7f37e80ad960 2023-10-14T11:14:46.315 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:46.315 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:14:46.316 INFO:teuthology.orchestra.run.smithi026.stdout: "auth_dump": [ 2023-10-14T11:14:46.316 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:14:46.316 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.a", 2023-10-14T11:14:46.316 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBZdyplRm7mBhAA9TLX9jvw13hKZFBzlqLVWA==", 2023-10-14T11:14:46.316 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:14:46.317 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-14T11:14:46.317 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-14T11:14:46.317 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-14T11:14:46.317 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:14:46.318 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:46.318 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:46.318 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:14:46.318 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.b", 2023-10-14T11:14:46.319 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBZdyplCziNExAADrUZ/ARa7JGEmPPFlzyiOg==", 2023-10-14T11:14:46.319 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:14:46.319 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-14T11:14:46.319 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-14T11:14:46.319 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-14T11:14:46.320 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:14:46.320 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:46.320 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:46.320 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:14:46.321 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.c", 2023-10-14T11:14:46.321 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBZdyplCHJwDhAAfunTAdo2FVxukOSj7Hztsg==", 2023-10-14T11:14:46.321 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:14:46.321 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-14T11:14:46.321 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-14T11:14:46.322 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-14T11:14:46.322 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:14:46.322 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:46.322 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:46.322 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:14:46.323 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.d", 2023-10-14T11:14:46.323 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBZdyplzgA5GxAAK5Ah/o0nnDMVIZprhphkxw==", 2023-10-14T11:14:46.323 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:14:46.323 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-14T11:14:46.323 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-14T11:14:46.324 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-14T11:14:46.324 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:14:46.324 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:46.324 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:46.324 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:14:46.325 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.0", 2023-10-14T11:14:46.325 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBbdyplyABdBRAALhGtz0Y51kT1x8n8Vj21Cw==", 2023-10-14T11:14:46.325 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:14:46.325 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-14T11:14:46.325 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-14T11:14:46.326 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:14:46.326 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:46.326 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:46.326 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:14:46.326 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.1", 2023-10-14T11:14:46.327 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBedyplCaVcCxAAFVOhDkVThePN3Y/gjD3wNA==", 2023-10-14T11:14:46.327 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:14:46.327 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-14T11:14:46.327 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-14T11:14:46.328 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:14:46.328 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:46.328 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:46.328 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:14:46.328 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.2", 2023-10-14T11:14:46.329 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBhdypljagWEhAAFVSbpqTlV5d/o/ydvm53tQ==", 2023-10-14T11:14:46.329 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:14:46.329 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-14T11:14:46.329 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-14T11:14:46.329 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:14:46.330 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:46.330 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:46.330 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:14:46.330 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.3", 2023-10-14T11:14:46.330 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBkdyplvzxDGhAAn9TglOxt8PgopVubKj+J/Q==", 2023-10-14T11:14:46.331 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:14:46.331 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-14T11:14:46.331 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-14T11:14:46.331 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:14:46.331 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:46.332 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:46.332 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:14:46.332 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.4", 2023-10-14T11:14:46.332 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBodyploWvTJxAAFxIauZ1IG+Taz4096ajC2Q==", 2023-10-14T11:14:46.332 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:14:46.333 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-14T11:14:46.333 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-14T11:14:46.333 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:14:46.333 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:46.334 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:46.334 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:14:46.334 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.5", 2023-10-14T11:14:46.334 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBrdyplw++tLRAALzDk+Aw1H/IDM+5WsjSPvA==", 2023-10-14T11:14:46.334 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:14:46.335 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-14T11:14:46.335 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-14T11:14:46.335 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:14:46.335 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:46.335 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:46.336 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:14:46.336 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.6", 2023-10-14T11:14:46.336 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBudyplwJJdNBAARKiA3WwEH8t1/y7UNy92eg==", 2023-10-14T11:14:46.336 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:14:46.337 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-14T11:14:46.337 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-14T11:14:46.337 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:14:46.337 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:46.337 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:46.338 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:14:46.338 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.7", 2023-10-14T11:14:46.338 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBxdyplgBijOhAAy21yvN9VKAds3X/rGbCUgQ==", 2023-10-14T11:14:46.338 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:14:46.338 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-14T11:14:46.339 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-14T11:14:46.339 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:14:46.339 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:46.339 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:46.339 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:14:46.340 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.0", 2023-10-14T11:14:46.340 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBZdyplGXdwHxAA3yn7fC60cZX9BQGuvdlfYw==", 2023-10-14T11:14:46.340 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:14:46.340 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-14T11:14:46.341 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow r", 2023-10-14T11:14:46.341 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rw pool=testcephfs1_data" 2023-10-14T11:14:46.341 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:46.341 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:46.341 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:14:46.342 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.1", 2023-10-14T11:14:46.342 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBZdypl5UdxKRAAeFk3cdLM7WTuHwdsE3PZIA==", 2023-10-14T11:14:46.342 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:14:46.342 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-14T11:14:46.342 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-14T11:14:46.343 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-14T11:14:46.343 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-14T11:14:46.343 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:46.343 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:46.343 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:14:46.344 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.2", 2023-10-14T11:14:46.344 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBZdyplH9PCJRAArxibYqSOXNQRw3K/6HcKTQ==", 2023-10-14T11:14:46.344 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:14:46.344 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-14T11:14:46.344 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-14T11:14:46.345 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-14T11:14:46.345 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-14T11:14:46.345 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:46.345 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:46.345 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:14:46.346 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.3", 2023-10-14T11:14:46.346 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBZdyplVCFoLxAAqT8U/Z+hM68mTywgrINGzg==", 2023-10-14T11:14:46.346 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:14:46.346 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-14T11:14:46.347 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-14T11:14:46.347 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-14T11:14:46.347 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-14T11:14:46.347 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:46.347 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:46.348 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:14:46.348 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.admin", 2023-10-14T11:14:46.348 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBYdyplTP0tJRAAwMbMTzoX7DJ0QpPsPr+ckw==", 2023-10-14T11:14:46.348 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:14:46.349 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-14T11:14:46.349 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-14T11:14:46.349 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-14T11:14:46.349 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:14:46.349 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:46.350 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:46.350 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:14:46.350 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.x", 2023-10-14T11:14:46.350 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBZdyplKBIpAhAAcL6wVN4Q7x9dIscL9JZjPw==", 2023-10-14T11:14:46.350 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:14:46.351 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-14T11:14:46.351 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-14T11:14:46.351 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:14:46.351 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:46.351 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:46.352 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:14:46.352 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.y", 2023-10-14T11:14:46.352 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBYdyplAXfkORAAVGkkCTmYSKxUhZbWw9wJYg==", 2023-10-14T11:14:46.352 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-14T11:14:46.353 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-14T11:14:46.353 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-14T11:14:46.353 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-14T11:14:46.353 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:46.353 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:46.354 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-14T11:14:46.354 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:14:46.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.311+0000 7f37f0217640 1 -- 172.21.15.26:0/3737887997 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37cc0664a0 msgr2=0x7f37cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:46.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.311+0000 7f37f0217640 1 --2- 172.21.15.26:0/3737887997 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37cc0664a0 0x7f37cc068960 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f37e80c5530 tx=0x7f37d8008040 comp rx=0 tx=0).stop 2023-10-14T11:14:46.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.311+0000 7f37f0217640 1 -- 172.21.15.26:0/3737887997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37e80ad960 msgr2=0x7f37e80c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:46.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.311+0000 7f37f0217640 1 --2- 172.21.15.26:0/3737887997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37e80ad960 0x7f37e80c8400 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f37e40ac040 tx=0x7f37e401ad40 comp rx=0 tx=0).stop 2023-10-14T11:14:46.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.311+0000 7f37f0217640 1 -- 172.21.15.26:0/3737887997 shutdown_connections 2023-10-14T11:14:46.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.311+0000 7f37f0217640 1 --2- 172.21.15.26:0/3737887997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37e8164520 0x7f37e80c2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.311+0000 7f37f0217640 1 --2- 172.21.15.26:0/3737887997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37e80c9b80 0x7f37e80c3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.311+0000 7f37f0217640 1 --2- 172.21.15.26:0/3737887997 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f37cc0664a0 0x7f37cc068960 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.311+0000 7f37f0217640 1 --2- 172.21.15.26:0/3737887997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37e80ad960 0x7f37e80c8400 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.311+0000 7f37f0217640 1 -- 172.21.15.26:0/3737887997 >> 172.21.15.26:0/3737887997 conn(0x7f37e806c190 msgr2=0x7f37e80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:46.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.311+0000 7f37f0217640 1 -- 172.21.15.26:0/3737887997 shutdown_connections 2023-10-14T11:14:46.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.311+0000 7f37f0217640 1 -- 172.21.15.26:0/3737887997 wait complete. 2023-10-14T11:14:46.358 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:14:46.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.495+0000 7f1897b0f640 1 Processor -- start 2023-10-14T11:14:46.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.495+0000 7f1897b0f640 1 -- start start 2023-10-14T11:14:46.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.495+0000 7f1897b0f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f189015cb90 0x7f18900cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:46.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.495+0000 7f1897b0f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f18900d3010 0x7f18900d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:46.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.495+0000 7f1897b0f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f18900d1400 0x7f18900cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:46.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.495+0000 7f1897b0f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18900d1890 con 0x7f18900d3010 2023-10-14T11:14:46.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.495+0000 7f1897b0f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18900ce770 con 0x7f18900d1400 2023-10-14T11:14:46.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.495+0000 7f1897b0f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18900d0600 con 0x7f189015cb90 2023-10-14T11:14:46.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.495+0000 7f18950aa640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f18900d3010 0x7f18900d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:46.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.495+0000 7f18950aa640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f18900d3010 0x7f18900d0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59876/0 (socket says 172.21.15.26:59876) 2023-10-14T11:14:46.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.495+0000 7f18950aa640 1 -- 172.21.15.26:0/3967981367 learned_addr learned my addr 172.21.15.26:0/3967981367 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:46.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.495+0000 7f18958ab640 1 --2- 172.21.15.26:0/3967981367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f189015cb90 0x7f18900cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:46.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.495+0000 7f18960ac640 1 --2- 172.21.15.26:0/3967981367 >> v2:172.21.15.110:3300/0 conn(0x7f18900d1400 0x7f18900cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:46.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.495+0000 7f18950aa640 1 -- 172.21.15.26:0/3967981367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f189015cb90 msgr2=0x7f18900cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:46.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.495+0000 7f18950aa640 1 --2- 172.21.15.26:0/3967981367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f189015cb90 0x7f18900cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.495+0000 7f18950aa640 1 -- 172.21.15.26:0/3967981367 >> v2:172.21.15.110:3300/0 conn(0x7f18900d1400 msgr2=0x7f18900cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:46.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.495+0000 7f18950aa640 1 --2- 172.21.15.26:0/3967981367 >> v2:172.21.15.110:3300/0 conn(0x7f18900d1400 0x7f18900cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.495+0000 7f18950aa640 1 -- 172.21.15.26:0/3967981367 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18900c6450 con 0x7f18900d3010 2023-10-14T11:14:46.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.495+0000 7f18960ac640 1 --2- 172.21.15.26:0/3967981367 >> v2:172.21.15.110:3300/0 conn(0x7f18900d1400 0x7f18900cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:46.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.499+0000 7f18950aa640 1 --2- 172.21.15.26:0/3967981367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18900d3010 0x7f18900d0ec0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f18900725c0 tx=0x7f188001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f77066d20b35d16 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:46.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.499+0000 7f18948a9640 1 -- 172.21.15.26:0/3967981367 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18800ab600 con 0x7f18900d3010 2023-10-14T11:14:46.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.499+0000 7f18948a9640 1 -- 172.21.15.26:0/3967981367 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18800ab760 con 0x7f18900d3010 2023-10-14T11:14:46.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.499+0000 7f18948a9640 1 -- 172.21.15.26:0/3967981367 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18800abaf0 con 0x7f18900d3010 2023-10-14T11:14:46.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.499+0000 7f1897b0f640 1 -- 172.21.15.26:0/3967981367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18900d3010 msgr2=0x7f18900d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:46.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.499+0000 7f1897b0f640 1 --2- 172.21.15.26:0/3967981367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18900d3010 0x7f18900d0ec0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f18900725c0 tx=0x7f188001c440 comp rx=0 tx=0).stop 2023-10-14T11:14:46.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.499+0000 7f1897b0f640 1 -- 172.21.15.26:0/3967981367 shutdown_connections 2023-10-14T11:14:46.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.499+0000 7f1897b0f640 1 --2- 172.21.15.26:0/3967981367 >> v2:172.21.15.110:3300/0 conn(0x7f18900d1400 0x7f18900cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.499+0000 7f1897b0f640 1 --2- 172.21.15.26:0/3967981367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18900d3010 0x7f18900d0ec0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.499+0000 7f1897b0f640 1 --2- 172.21.15.26:0/3967981367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f189015cb90 0x7f18900cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.499+0000 7f1897b0f640 1 -- 172.21.15.26:0/3967981367 >> 172.21.15.26:0/3967981367 conn(0x7f189009bc50 msgr2=0x7f18900d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:46.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.499+0000 7f1897b0f640 1 -- 172.21.15.26:0/3967981367 shutdown_connections 2023-10-14T11:14:46.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.499+0000 7f1897b0f640 1 -- 172.21.15.26:0/3967981367 wait complete. 2023-10-14T11:14:46.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f1897b0f640 1 Processor -- start 2023-10-14T11:14:46.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f1897b0f640 1 -- start start 2023-10-14T11:14:46.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f1897b0f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18900d1400 0x7f189014bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:46.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f1897b0f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18900d3010 0x7f18901573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:46.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f1897b0f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f189015cb90 0x7f18900b7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:46.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f1897b0f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189015bfa0 con 0x7f18900d1400 2023-10-14T11:14:46.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f1897b0f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18901565e0 con 0x7f18900d3010 2023-10-14T11:14:46.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f1897b0f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18901568c0 con 0x7f189015cb90 2023-10-14T11:14:46.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f18958ab640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18900d1400 0x7f189014bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:46.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f18958ab640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18900d1400 0x7f189014bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59884/0 (socket says 172.21.15.26:59884) 2023-10-14T11:14:46.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f18958ab640 1 -- 172.21.15.26:0/2167041682 learned_addr learned my addr 172.21.15.26:0/2167041682 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:46.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f18950aa640 1 --2- 172.21.15.26:0/2167041682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18900d3010 0x7f18901573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:46.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f18960ac640 1 --2- 172.21.15.26:0/2167041682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f189015cb90 0x7f18900b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:46.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f18958ab640 1 -- 172.21.15.26:0/2167041682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f189015cb90 msgr2=0x7f18900b7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:46.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f18958ab640 1 --2- 172.21.15.26:0/2167041682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f189015cb90 0x7f18900b7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f18958ab640 1 -- 172.21.15.26:0/2167041682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18900d3010 msgr2=0x7f18901573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:46.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f18958ab640 1 --2- 172.21.15.26:0/2167041682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18900d3010 0x7f18901573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f18958ab640 1 -- 172.21.15.26:0/2167041682 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18800094d0 con 0x7f18900d1400 2023-10-14T11:14:46.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f18958ab640 1 --2- 172.21.15.26:0/2167041682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18900d1400 0x7f189014bcb0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f188c00e870 tx=0x7f188c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:46.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f18867fc640 1 -- 172.21.15.26:0/2167041682 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c0095d0 con 0x7f18900d1400 2023-10-14T11:14:46.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f18867fc640 1 -- 172.21.15.26:0/2167041682 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c00c940 con 0x7f18900d1400 2023-10-14T11:14:46.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f18867fc640 1 -- 172.21.15.26:0/2167041682 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c00ccb0 con 0x7f18900d1400 2023-10-14T11:14:46.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f1897b0f640 1 -- 172.21.15.26:0/2167041682 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1890156ba0 con 0x7f18900d1400 2023-10-14T11:14:46.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.503+0000 7f1897b0f640 1 -- 172.21.15.26:0/2167041682 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18901578e0 con 0x7f18900d1400 2023-10-14T11:14:46.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.507+0000 7f1897b0f640 1 -- 172.21.15.26:0/2167041682 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18900c66d0 con 0x7f18900d1400 2023-10-14T11:14:46.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.507+0000 7f18867fc640 1 -- 172.21.15.26:0/2167041682 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f188c013470 con 0x7f18900d1400 2023-10-14T11:14:46.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.507+0000 7f18867fc640 1 --2- 172.21.15.26:0/2167041682 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f18740664a0 0x7f1874068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:46.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.507+0000 7f18867fc640 1 -- 172.21.15.26:0/2167041682 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f188c0840e0 con 0x7f18900d1400 2023-10-14T11:14:46.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.507+0000 7f18950aa640 1 --2- 172.21.15.26:0/2167041682 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f18740664a0 0x7f1874068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:46.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.507+0000 7f18950aa640 1 --2- 172.21.15.26:0/2167041682 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f18740664a0 0x7f1874068960 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f18800af000 tx=0x7f18800b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:46.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.511+0000 7f18867fc640 1 -- 172.21.15.26:0/2167041682 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f18900c66d0 con 0x7f18900d1400 2023-10-14T11:14:46.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.671+0000 7f1897b0f640 1 -- 172.21.15.26:0/2167041682 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18900c66d0 con 0x7f18900d1400 2023-10-14T11:14:46.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.675+0000 7f18867fc640 1 -- 172.21.15.26:0/2167041682 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+13062 (secure 0 0 0) 0x7f18900c66d0 con 0x7f18900d1400 2023-10-14T11:14:46.680 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:46.681 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":51,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:14:45.906368+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:14:46.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.675+0000 7f1897b0f640 1 -- 172.21.15.26:0/2167041682 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f18740664a0 msgr2=0x7f1874068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:46.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.675+0000 7f1897b0f640 1 --2- 172.21.15.26:0/2167041682 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f18740664a0 0x7f1874068960 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f18800af000 tx=0x7f18800b6040 comp rx=0 tx=0).stop 2023-10-14T11:14:46.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.675+0000 7f1897b0f640 1 -- 172.21.15.26:0/2167041682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18900d1400 msgr2=0x7f189014bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:46.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.675+0000 7f1897b0f640 1 --2- 172.21.15.26:0/2167041682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18900d1400 0x7f189014bcb0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f188c00e870 tx=0x7f188c00ed30 comp rx=0 tx=0).stop 2023-10-14T11:14:46.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.675+0000 7f1897b0f640 1 -- 172.21.15.26:0/2167041682 shutdown_connections 2023-10-14T11:14:46.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.675+0000 7f1897b0f640 1 --2- 172.21.15.26:0/2167041682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f189015cb90 0x7f18900b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.675+0000 7f1897b0f640 1 --2- 172.21.15.26:0/2167041682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18900d3010 0x7f18901573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.675+0000 7f1897b0f640 1 --2- 172.21.15.26:0/2167041682 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f18740664a0 0x7f1874068960 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.675+0000 7f1897b0f640 1 --2- 172.21.15.26:0/2167041682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18900d1400 0x7f189014bcb0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.675+0000 7f1897b0f640 1 -- 172.21.15.26:0/2167041682 >> 172.21.15.26:0/2167041682 conn(0x7f189009bc50 msgr2=0x7f18900c7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:46.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.675+0000 7f1897b0f640 1 -- 172.21.15.26:0/2167041682 shutdown_connections 2023-10-14T11:14:46.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.675+0000 7f1897b0f640 1 -- 172.21.15.26:0/2167041682 wait complete. 2023-10-14T11:14:46.701 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:14:46.702 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:14:46.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.839+0000 7f1311054640 1 Processor -- start 2023-10-14T11:14:46.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.843+0000 7f1311054640 1 -- start start 2023-10-14T11:14:46.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.843+0000 7f1311054640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f130c15cba0 0x7f130c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:46.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.843+0000 7f1311054640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f130c0b84e0 0x7f130c0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:46.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.843+0000 7f1311054640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f130c0d1670 con 0x7f130c0d0040 2023-10-14T11:14:46.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.843+0000 7f1311054640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130c0d1460 con 0x7f130c15cba0 2023-10-14T11:14:46.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.843+0000 7f1311054640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130c0d04b0 con 0x7f130c0b84e0 2023-10-14T11:14:46.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.843+0000 7f130b59e640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f130c0d0040 0x7f130c0d2ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34070/0 (socket says 172.21.15.26:34070) 2023-10-14T11:14:46.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.843+0000 7f130b59e640 1 -- 172.21.15.26:0/3116173436 learned_addr learned my addr 172.21.15.26:0/3116173436 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:46.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.843+0000 7f130ad9d640 1 --2- 172.21.15.26:0/3116173436 >> v2:172.21.15.110:3300/0 conn(0x7f130c15cba0 0x7f130c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:46.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.843+0000 7f1303fff640 1 --2- 172.21.15.26:0/3116173436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f130c0b84e0 0x7f130c0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:46.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.843+0000 7f130a59c640 1 -- 172.21.15.26:0/3116173436 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83458626 0 0) 0x7f130c0d1670 con 0x7f130c0d0040 2023-10-14T11:14:46.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.843+0000 7f130a59c640 1 -- 172.21.15.26:0/3116173436 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12f8003530 con 0x7f130c0d0040 2023-10-14T11:14:46.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.843+0000 7f130a59c640 1 -- 172.21.15.26:0/3116173436 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3186351069 0 0) 0x7f12f8003530 con 0x7f130c0d0040 2023-10-14T11:14:46.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.843+0000 7f130ad9d640 1 -- 172.21.15.26:0/3116173436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f130c0b84e0 msgr2=0x7f130c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:46.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.843+0000 7f130ad9d640 1 --2- 172.21.15.26:0/3116173436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f130c0b84e0 0x7f130c0cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.843+0000 7f130ad9d640 1 -- 172.21.15.26:0/3116173436 >> v1:172.21.15.26:6789/0 conn(0x7f130c0d0040 legacy=0x7f130c0d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:46.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.843+0000 7f130ad9d640 1 -- 172.21.15.26:0/3116173436 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c0d1950 con 0x7f130c15cba0 2023-10-14T11:14:46.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.843+0000 7f1303fff640 1 --2- 172.21.15.26:0/3116173436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f130c0b84e0 0x7f130c0cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:14:46.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.847+0000 7f130ad9d640 1 --2- 172.21.15.26:0/3116173436 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f130c15cba0 0x7f130c0d0f20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f12fc0097c0 tx=0x7f12fc01c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72dd79f0896d0f16 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:46.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.847+0000 7f130a59c640 1 -- 172.21.15.26:0/3116173436 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304001a00 con 0x7f130c15cba0 2023-10-14T11:14:46.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.847+0000 7f130a59c640 1 -- 172.21.15.26:0/3116173436 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc0a7050 con 0x7f130c15cba0 2023-10-14T11:14:46.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.847+0000 7f130a59c640 1 -- 172.21.15.26:0/3116173436 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc0ab620 con 0x7f130c15cba0 2023-10-14T11:14:46.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.847+0000 7f1311054640 1 -- 172.21.15.26:0/3116173436 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f130c15cba0 msgr2=0x7f130c0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:46.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.847+0000 7f1311054640 1 --2- 172.21.15.26:0/3116173436 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f130c15cba0 0x7f130c0d0f20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f12fc0097c0 tx=0x7f12fc01c3a0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.847+0000 7f1311054640 1 -- 172.21.15.26:0/3116173436 shutdown_connections 2023-10-14T11:14:46.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.847+0000 7f1311054640 1 --2- 172.21.15.26:0/3116173436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f130c0b84e0 0x7f130c0cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.847+0000 7f1311054640 1 --2- 172.21.15.26:0/3116173436 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f130c15cba0 0x7f130c0d0f20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.847+0000 7f1311054640 1 -- 172.21.15.26:0/3116173436 >> 172.21.15.26:0/3116173436 conn(0x7f130c0719c0 msgr2=0x7f130c071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:46.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.847+0000 7f1311054640 1 -- 172.21.15.26:0/3116173436 shutdown_connections 2023-10-14T11:14:46.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.847+0000 7f1311054640 1 -- 172.21.15.26:0/3116173436 wait complete. 2023-10-14T11:14:46.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f1311054640 1 Processor -- start 2023-10-14T11:14:46.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f1311054640 1 -- start start 2023-10-14T11:14:46.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f1311054640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f130c0b84e0 0x7f130c155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:46.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f1311054640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f130c0d0040 0x7f130c14df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:46.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f1311054640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f130c15cba0 0x7f130c14e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:46.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f1311054640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c155320 con 0x7f130c15cba0 2023-10-14T11:14:46.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f1311054640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c158540 con 0x7f130c0b84e0 2023-10-14T11:14:46.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f1311054640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130c155fb0 con 0x7f130c0d0040 2023-10-14T11:14:46.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f130b59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f130c15cba0 0x7f130c14e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:46.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f130b59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f130c15cba0 0x7f130c14e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59894/0 (socket says 172.21.15.26:59894) 2023-10-14T11:14:46.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f130b59e640 1 -- 172.21.15.26:0/1745314098 learned_addr learned my addr 172.21.15.26:0/1745314098 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:46.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f1303fff640 1 --2- 172.21.15.26:0/1745314098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f130c0d0040 0x7f130c14df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:46.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f130ad9d640 1 --2- 172.21.15.26:0/1745314098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f130c0b84e0 0x7f130c155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:46.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f130b59e640 1 -- 172.21.15.26:0/1745314098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f130c0d0040 msgr2=0x7f130c14df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:46.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f130b59e640 1 --2- 172.21.15.26:0/1745314098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f130c0d0040 0x7f130c14df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f130b59e640 1 -- 172.21.15.26:0/1745314098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f130c0b84e0 msgr2=0x7f130c155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:46.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f130b59e640 1 --2- 172.21.15.26:0/1745314098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f130c0b84e0 0x7f130c155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:46.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f130b59e640 1 -- 172.21.15.26:0/1745314098 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f4009420 con 0x7f130c15cba0 2023-10-14T11:14:46.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f130ad9d640 1 --2- 172.21.15.26:0/1745314098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f130c0b84e0 0x7f130c155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:46.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f130b59e640 1 --2- 172.21.15.26:0/1745314098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f130c15cba0 0x7f130c14e7c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1304001840 tx=0x7f130400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:46.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f13037fe640 1 -- 172.21.15.26:0/1745314098 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304012400 con 0x7f130c15cba0 2023-10-14T11:14:46.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f13037fe640 1 -- 172.21.15.26:0/1745314098 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1304012560 con 0x7f130c15cba0 2023-10-14T11:14:46.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f13037fe640 1 -- 172.21.15.26:0/1745314098 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304012910 con 0x7f130c15cba0 2023-10-14T11:14:46.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f1311054640 1 -- 172.21.15.26:0/1745314098 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12fc009420 con 0x7f130c15cba0 2023-10-14T11:14:46.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.851+0000 7f1311054640 1 -- 172.21.15.26:0/1745314098 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130c1587e0 con 0x7f130c15cba0 2023-10-14T11:14:46.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.855+0000 7f1311054640 1 -- 172.21.15.26:0/1745314098 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130c0b7df0 con 0x7f130c15cba0 2023-10-14T11:14:46.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.855+0000 7f13037fe640 1 -- 172.21.15.26:0/1745314098 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1304012a70 con 0x7f130c15cba0 2023-10-14T11:14:46.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.855+0000 7f13037fe640 1 --2- 172.21.15.26:0/1745314098 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f12ec0664a0 0x7f12ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:46.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.855+0000 7f13037fe640 1 -- 172.21.15.26:0/1745314098 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1304084350 con 0x7f130c15cba0 2023-10-14T11:14:46.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.855+0000 7f130ad9d640 1 --2- 172.21.15.26:0/1745314098 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f12ec0664a0 0x7f12ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:46.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.855+0000 7f130ad9d640 1 --2- 172.21.15.26:0/1745314098 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f12ec0664a0 0x7f12ec068960 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f12fc0ad000 tx=0x7f12fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:46.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:46.859+0000 7f13037fe640 1 -- 172.21.15.26:0/1745314098 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f13040519e0 con 0x7f130c15cba0 2023-10-14T11:14:47.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.019+0000 7f1311054640 1 -- 172.21.15.26:0/1745314098 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f130c0b58b0 con 0x7f130c15cba0 2023-10-14T11:14:47.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.019+0000 7f13037fe640 1 -- 172.21.15.26:0/1745314098 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1304055000 con 0x7f130c15cba0 2023-10-14T11:14:47.025 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:14:47.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.019+0000 7f1311054640 1 -- 172.21.15.26:0/1745314098 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f12ec0664a0 msgr2=0x7f12ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:47.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.019+0000 7f1311054640 1 --2- 172.21.15.26:0/1745314098 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f12ec0664a0 0x7f12ec068960 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f12fc0ad000 tx=0x7f12fc008040 comp rx=0 tx=0).stop 2023-10-14T11:14:47.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.019+0000 7f1311054640 1 -- 172.21.15.26:0/1745314098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f130c15cba0 msgr2=0x7f130c14e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:47.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.019+0000 7f1311054640 1 --2- 172.21.15.26:0/1745314098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f130c15cba0 0x7f130c14e7c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1304001840 tx=0x7f130400a430 comp rx=0 tx=0).stop 2023-10-14T11:14:47.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.019+0000 7f1311054640 1 -- 172.21.15.26:0/1745314098 shutdown_connections 2023-10-14T11:14:47.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.019+0000 7f1311054640 1 --2- 172.21.15.26:0/1745314098 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f12ec0664a0 0x7f12ec068960 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:47.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.019+0000 7f1311054640 1 --2- 172.21.15.26:0/1745314098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f130c15cba0 0x7f130c14e7c0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:47.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.019+0000 7f1311054640 1 --2- 172.21.15.26:0/1745314098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f130c0d0040 0x7f130c14df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:47.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.019+0000 7f1311054640 1 --2- 172.21.15.26:0/1745314098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f130c0b84e0 0x7f130c155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:47.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.019+0000 7f1311054640 1 -- 172.21.15.26:0/1745314098 >> 172.21.15.26:0/1745314098 conn(0x7f130c0719c0 msgr2=0x7f130c0b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:47.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.019+0000 7f1311054640 1 -- 172.21.15.26:0/1745314098 shutdown_connections 2023-10-14T11:14:47.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.019+0000 7f1311054640 1 -- 172.21.15.26:0/1745314098 wait complete. 2023-10-14T11:14:47.046 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T11:14:47.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.183+0000 7f0388646640 1 Processor -- start 2023-10-14T11:14:47.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.183+0000 7f0388646640 1 -- start start 2023-10-14T11:14:47.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.183+0000 7f0388646640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03800b2ad0 0x7f038006b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:47.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.183+0000 7f0388646640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f03800ce310 0x7f03800ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:47.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.183+0000 7f0388646640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f038006d000 con 0x7f038015cf90 2023-10-14T11:14:47.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.183+0000 7f0388646640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03800cece0 con 0x7f03800ce310 2023-10-14T11:14:47.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.183+0000 7f0388646640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0380160580 con 0x7f03800b2ad0 2023-10-14T11:14:47.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.183+0000 7f0386be3640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f03800ce310 0x7f03800ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:47.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.187+0000 7f0386be3640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f03800ce310 0x7f03800ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59904/0 (socket says 172.21.15.26:59904) 2023-10-14T11:14:47.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.187+0000 7f0386be3640 1 -- 172.21.15.26:0/2219020426 learned_addr learned my addr 172.21.15.26:0/2219020426 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:47.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.187+0000 7f03863e2640 1 --2- 172.21.15.26:0/2219020426 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03800b2ad0 0x7f038006b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:47.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.187+0000 7f0386be3640 1 -- 172.21.15.26:0/2219020426 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03800b2ad0 msgr2=0x7f038006b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:47.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.187+0000 7f0386be3640 1 --2- 172.21.15.26:0/2219020426 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03800b2ad0 0x7f038006b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:47.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.187+0000 7f0386be3640 1 -- 172.21.15.26:0/2219020426 >> v1:172.21.15.110:6789/0 conn(0x7f038015cf90 legacy=0x7f038006c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:47.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.187+0000 7f0386be3640 1 -- 172.21.15.26:0/2219020426 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038015d4e0 con 0x7f03800ce310 2023-10-14T11:14:47.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.187+0000 7f0386be3640 1 --2- 172.21.15.26:0/2219020426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03800ce310 0x7f03800ce7a0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0378009e50 tx=0x7f037801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8fb7bd0a922bd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:47.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.187+0000 7f03853e0640 1 -- 172.21.15.26:0/2219020426 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03780a58a0 con 0x7f03800ce310 2023-10-14T11:14:47.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.187+0000 7f03853e0640 1 -- 172.21.15.26:0/2219020426 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03780a5a00 con 0x7f03800ce310 2023-10-14T11:14:47.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.187+0000 7f03853e0640 1 -- 172.21.15.26:0/2219020426 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03780a5d90 con 0x7f03800ce310 2023-10-14T11:14:47.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f0388646640 1 -- 172.21.15.26:0/2219020426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03800ce310 msgr2=0x7f03800ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:47.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f0388646640 1 --2- 172.21.15.26:0/2219020426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03800ce310 0x7f03800ce7a0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0378009e50 tx=0x7f037801c9e0 comp rx=0 tx=0).stop 2023-10-14T11:14:47.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f0388646640 1 -- 172.21.15.26:0/2219020426 shutdown_connections 2023-10-14T11:14:47.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f0388646640 1 --2- 172.21.15.26:0/2219020426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03800ce310 0x7f03800ce7a0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:47.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f0388646640 1 --2- 172.21.15.26:0/2219020426 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03800b2ad0 0x7f038006b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:47.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f0388646640 1 -- 172.21.15.26:0/2219020426 >> 172.21.15.26:0/2219020426 conn(0x7f03800cd1c0 msgr2=0x7f03800cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:47.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f0388646640 1 -- 172.21.15.26:0/2219020426 shutdown_connections 2023-10-14T11:14:47.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f0388646640 1 -- 172.21.15.26:0/2219020426 wait complete. 2023-10-14T11:14:47.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f0388646640 1 Processor -- start 2023-10-14T11:14:47.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f0388646640 1 -- start start 2023-10-14T11:14:47.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f0388646640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03800b2ad0 0x7f03800b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:47.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f0388646640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03800ce310 0x7f03800b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:47.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f0388646640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f038015cf90 0x7f03800b1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:47.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f0388646640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03800c4370 con 0x7f03800b2ad0 2023-10-14T11:14:47.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f0388646640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03800ab870 con 0x7f03800ce310 2023-10-14T11:14:47.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f0388646640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03800b4360 con 0x7f038015cf90 2023-10-14T11:14:47.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f03863e2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03800b2ad0 0x7f03800b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:47.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f03863e2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03800b2ad0 0x7f03800b3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59918/0 (socket says 172.21.15.26:59918) 2023-10-14T11:14:47.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f03863e2640 1 -- 172.21.15.26:0/3555916462 learned_addr learned my addr 172.21.15.26:0/3555916462 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:47.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f0385be1640 1 --2- 172.21.15.26:0/3555916462 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03800ce310 0x7f03800b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:47.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f0386be3640 1 --2- 172.21.15.26:0/3555916462 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f038015cf90 0x7f03800b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:47.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f03863e2640 1 -- 172.21.15.26:0/3555916462 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f038015cf90 msgr2=0x7f03800b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:47.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f03863e2640 1 --2- 172.21.15.26:0/3555916462 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f038015cf90 0x7f03800b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:47.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f03863e2640 1 -- 172.21.15.26:0/3555916462 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03800ce310 msgr2=0x7f03800b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:47.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f03863e2640 1 --2- 172.21.15.26:0/3555916462 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03800ce310 0x7f03800b10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:47.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.191+0000 7f03863e2640 1 -- 172.21.15.26:0/3555916462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0378009b30 con 0x7f03800b2ad0 2023-10-14T11:14:47.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.195+0000 7f03863e2640 1 --2- 172.21.15.26:0/3555916462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03800b2ad0 0x7f03800b3e20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f037c00e870 tx=0x7f037c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:47.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.195+0000 7f0376ffd640 1 -- 172.21.15.26:0/3555916462 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c009510 con 0x7f03800b2ad0 2023-10-14T11:14:47.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.195+0000 7f0376ffd640 1 -- 172.21.15.26:0/3555916462 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c00eec0 con 0x7f03800b2ad0 2023-10-14T11:14:47.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.195+0000 7f0388646640 1 -- 172.21.15.26:0/3555916462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03800b34a0 con 0x7f03800b2ad0 2023-10-14T11:14:47.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.195+0000 7f0376ffd640 1 -- 172.21.15.26:0/3555916462 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c00cb40 con 0x7f03800b2ad0 2023-10-14T11:14:47.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.195+0000 7f0388646640 1 -- 172.21.15.26:0/3555916462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03800b5890 con 0x7f03800b2ad0 2023-10-14T11:14:47.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.195+0000 7f0388646640 1 -- 172.21.15.26:0/3555916462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03800c45e0 con 0x7f03800b2ad0 2023-10-14T11:14:47.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.195+0000 7f0376ffd640 1 -- 172.21.15.26:0/3555916462 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f037c00cca0 con 0x7f03800b2ad0 2023-10-14T11:14:47.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.195+0000 7f0376ffd640 1 --2- 172.21.15.26:0/3555916462 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f03640664a0 0x7f0364068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:47.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.195+0000 7f0376ffd640 1 -- 172.21.15.26:0/3555916462 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f037c083c90 con 0x7f03800b2ad0 2023-10-14T11:14:47.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.195+0000 7f0385be1640 1 --2- 172.21.15.26:0/3555916462 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f03640664a0 0x7f0364068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:47.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.199+0000 7f0385be1640 1 --2- 172.21.15.26:0/3555916462 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f03640664a0 0x7f0364068960 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f03801fa130 tx=0x7f0370009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:47.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.199+0000 7f0376ffd640 1 -- 172.21.15.26:0/3555916462 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f037c0513d0 con 0x7f03800b2ad0 2023-10-14T11:14:47.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.359+0000 7f0388646640 1 -- 172.21.15.26:0/3555916462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0380074010 con 0x7f03800b2ad0 2023-10-14T11:14:47.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.359+0000 7f0376ffd640 1 -- 172.21.15.26:0/3555916462 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v51) v1 ==== 84+0+65 (secure 0 0 0) 0x7f037c0549f0 con 0x7f03800b2ad0 2023-10-14T11:14:47.367 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:47.367 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-14T11:14:47.367 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-14T11:14:47.368 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-10-14T11:14:47.368 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-10-14T11:14:47.368 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:47.368 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-14T11:14:47.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.363+0000 7f0388646640 1 -- 172.21.15.26:0/3555916462 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f03640664a0 msgr2=0x7f0364068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:47.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.363+0000 7f0388646640 1 --2- 172.21.15.26:0/3555916462 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f03640664a0 0x7f0364068960 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f03801fa130 tx=0x7f0370009040 comp rx=0 tx=0).stop 2023-10-14T11:14:47.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.363+0000 7f0388646640 1 -- 172.21.15.26:0/3555916462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03800b2ad0 msgr2=0x7f03800b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:47.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.363+0000 7f0388646640 1 --2- 172.21.15.26:0/3555916462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03800b2ad0 0x7f03800b3e20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f037c00e870 tx=0x7f037c00ec70 comp rx=0 tx=0).stop 2023-10-14T11:14:47.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.363+0000 7f0388646640 1 -- 172.21.15.26:0/3555916462 shutdown_connections 2023-10-14T11:14:47.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.363+0000 7f0388646640 1 --2- 172.21.15.26:0/3555916462 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f038015cf90 0x7f03800b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:47.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.363+0000 7f0388646640 1 --2- 172.21.15.26:0/3555916462 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03800ce310 0x7f03800b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:47.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.363+0000 7f0388646640 1 --2- 172.21.15.26:0/3555916462 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f03640664a0 0x7f0364068960 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:47.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.363+0000 7f0388646640 1 --2- 172.21.15.26:0/3555916462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03800b2ad0 0x7f03800b3e20 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:47.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.363+0000 7f0388646640 1 -- 172.21.15.26:0/3555916462 >> 172.21.15.26:0/3555916462 conn(0x7f03800cd1c0 msgr2=0x7f038015c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:47.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.363+0000 7f0388646640 1 -- 172.21.15.26:0/3555916462 shutdown_connections 2023-10-14T11:14:47.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.363+0000 7f0388646640 1 -- 172.21.15.26:0/3555916462 wait complete. 2023-10-14T11:14:47.390 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'testcephfs1' 2023-10-14T11:14:47.390 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_metadata --pg_num_min 64 2023-10-14T11:14:47.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.531+0000 7f2278f0e640 1 Processor -- start 2023-10-14T11:14:47.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.531+0000 7f2278f0e640 1 -- start start 2023-10-14T11:14:47.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.531+0000 7f2278f0e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f22741441a0 0x7f22740b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:47.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.531+0000 7f2278f0e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f227415e5f0 con 0x7f22740b1a90 2023-10-14T11:14:47.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.531+0000 7f2278f0e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f227415e8d0 con 0x7f22740cb530 2023-10-14T11:14:47.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.531+0000 7f2278f0e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22740b1f20 con 0x7f22741441a0 2023-10-14T11:14:47.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.531+0000 7f226bfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f22740b1a90 0x7f22740cae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34076/0 (socket says 172.21.15.26:34076) 2023-10-14T11:14:47.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.531+0000 7f226bfff640 1 -- 172.21.15.26:0/3701105076 learned_addr learned my addr 172.21.15.26:0/3701105076 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:47.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.531+0000 7f227259c640 1 --2- 172.21.15.26:0/3701105076 >> v2:172.21.15.110:3300/0 conn(0x7f22741441a0 0x7f22740b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:47.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.531+0000 7f2271d9b640 1 -- 172.21.15.26:0/3701105076 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1876191679 0 0) 0x7f227415e5f0 con 0x7f22740b1a90 2023-10-14T11:14:47.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.531+0000 7f2271d9b640 1 -- 172.21.15.26:0/3701105076 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2260003530 con 0x7f22740b1a90 2023-10-14T11:14:47.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.531+0000 7f2271d9b640 1 -- 172.21.15.26:0/3701105076 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720078320 0 0) 0x7f227415e8d0 con 0x7f22740cb530 2023-10-14T11:14:47.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.531+0000 7f2271d9b640 1 -- 172.21.15.26:0/3701105076 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f227415e5f0 con 0x7f22740cb530 2023-10-14T11:14:47.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.531+0000 7f227259c640 1 -- 172.21.15.26:0/3701105076 >> v1:172.21.15.110:6789/0 conn(0x7f22740cb530 legacy=0x7f22740c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:47.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.531+0000 7f227259c640 1 -- 172.21.15.26:0/3701105076 >> v1:172.21.15.26:6789/0 conn(0x7f22740b1a90 legacy=0x7f22740cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:47.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.531+0000 7f227259c640 1 -- 172.21.15.26:0/3701105076 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227415ebb0 con 0x7f22741441a0 2023-10-14T11:14:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.535+0000 7f227259c640 1 --2- 172.21.15.26:0/3701105076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22741441a0 0x7f22740b1550 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f22640097c0 tx=0x7f226401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55407a77a34feb16 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.535+0000 7f2271d9b640 1 -- 172.21.15.26:0/3701105076 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22640ab600 con 0x7f22741441a0 2023-10-14T11:14:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.535+0000 7f2271d9b640 1 -- 172.21.15.26:0/3701105076 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22640a7050 con 0x7f22741441a0 2023-10-14T11:14:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.535+0000 7f2271d9b640 1 -- 172.21.15.26:0/3701105076 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22640ab980 con 0x7f22741441a0 2023-10-14T11:14:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.535+0000 7f2278f0e640 1 -- 172.21.15.26:0/3701105076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22741441a0 msgr2=0x7f22740b1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.535+0000 7f2278f0e640 1 --2- 172.21.15.26:0/3701105076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22741441a0 0x7f22740b1550 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f22640097c0 tx=0x7f226401c480 comp rx=0 tx=0).stop 2023-10-14T11:14:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.535+0000 7f2278f0e640 1 -- 172.21.15.26:0/3701105076 shutdown_connections 2023-10-14T11:14:47.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.535+0000 7f2278f0e640 1 --2- 172.21.15.26:0/3701105076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22741441a0 0x7f22740b1550 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:47.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.535+0000 7f2278f0e640 1 -- 172.21.15.26:0/3701105076 >> 172.21.15.26:0/3701105076 conn(0x7f227406a820 msgr2=0x7f22740b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:47.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.535+0000 7f2278f0e640 1 -- 172.21.15.26:0/3701105076 shutdown_connections 2023-10-14T11:14:47.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.535+0000 7f2278f0e640 1 -- 172.21.15.26:0/3701105076 wait complete. 2023-10-14T11:14:47.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f2278f0e640 1 Processor -- start 2023-10-14T11:14:47.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f2278f0e640 1 -- start start 2023-10-14T11:14:47.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f2278f0e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22740b1a90 0x7f22741401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:47.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f2278f0e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22740cb530 0x7f227415da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:47.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f2278f0e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22741441a0 0x7f2274071820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:47.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f2278f0e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2274142bc0 con 0x7f22740cb530 2023-10-14T11:14:47.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f2278f0e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2274139e70 con 0x7f22741441a0 2023-10-14T11:14:47.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f2278f0e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227415df60 con 0x7f22740b1a90 2023-10-14T11:14:47.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f226bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22740cb530 0x7f227415da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:47.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f227259c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22740b1a90 0x7f22741401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:47.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f226bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22740cb530 0x7f227415da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59920/0 (socket says 172.21.15.26:59920) 2023-10-14T11:14:47.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f226bfff640 1 -- 172.21.15.26:0/2971710133 learned_addr learned my addr 172.21.15.26:0/2971710133 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:47.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f2272d9d640 1 --2- 172.21.15.26:0/2971710133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22741441a0 0x7f2274071820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:47.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f226bfff640 1 -- 172.21.15.26:0/2971710133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22740b1a90 msgr2=0x7f22741401b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:47.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f226bfff640 1 --2- 172.21.15.26:0/2971710133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22740b1a90 0x7f22741401b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:47.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f226bfff640 1 -- 172.21.15.26:0/2971710133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22741441a0 msgr2=0x7f2274071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:47.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f226bfff640 1 --2- 172.21.15.26:0/2971710133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22741441a0 0x7f2274071820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:47.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f226bfff640 1 -- 172.21.15.26:0/2971710133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2264009420 con 0x7f22740cb530 2023-10-14T11:14:47.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f2272d9d640 1 --2- 172.21.15.26:0/2971710133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22741441a0 0x7f2274071820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:47.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f226bfff640 1 --2- 172.21.15.26:0/2971710133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22740cb530 0x7f227415da20 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f225c00c4d0 tx=0x7f225c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:47.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f226affd640 1 -- 172.21.15.26:0/2971710133 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c005cf0 con 0x7f22740cb530 2023-10-14T11:14:47.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f226affd640 1 -- 172.21.15.26:0/2971710133 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c005e50 con 0x7f22740cb530 2023-10-14T11:14:47.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f2278f0e640 1 -- 172.21.15.26:0/2971710133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2274142320 con 0x7f22740cb530 2023-10-14T11:14:47.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f226affd640 1 -- 172.21.15.26:0/2971710133 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c0072b0 con 0x7f22740cb530 2023-10-14T11:14:47.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.539+0000 7f2278f0e640 1 -- 172.21.15.26:0/2971710133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22741428e0 con 0x7f22740cb530 2023-10-14T11:14:47.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.543+0000 7f2278f0e640 1 -- 172.21.15.26:0/2971710133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227404e170 con 0x7f22740cb530 2023-10-14T11:14:47.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.543+0000 7f226affd640 1 -- 172.21.15.26:0/2971710133 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f225c007410 con 0x7f22740cb530 2023-10-14T11:14:47.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.543+0000 7f226affd640 1 --2- 172.21.15.26:0/2971710133 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f22540664a0 0x7f2254068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:47.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.543+0000 7f226affd640 1 -- 172.21.15.26:0/2971710133 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f225c083290 con 0x7f22740cb530 2023-10-14T11:14:47.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.543+0000 7f227259c640 1 --2- 172.21.15.26:0/2971710133 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f22540664a0 0x7f2254068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:47.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.543+0000 7f227259c640 1 --2- 172.21.15.26:0/2971710133 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f22540664a0 0x7f2254068960 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f22640ad000 tx=0x7f2264008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:47.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.547+0000 7f226affd640 1 -- 172.21.15.26:0/2971710133 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f225c050930 con 0x7f22740cb530 2023-10-14T11:14:47.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:47.703+0000 7f2278f0e640 1 -- 172.21.15.26:0/2971710133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f22740cb310 con 0x7f22740cb530 2023-10-14T11:14:48.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.555+0000 7f226affd640 1 -- 172.21.15.26:0/2971710133 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64}]=0 pool 'testcephfs1_metadata' created v52) v1 ==== 148+0+0 (secure 0 0 0) 0x7f225c053f50 con 0x7f22740cb530 2023-10-14T11:14:48.564 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'testcephfs1_metadata' created 2023-10-14T11:14:48.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.559+0000 7f2278f0e640 1 -- 172.21.15.26:0/2971710133 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f22540664a0 msgr2=0x7f2254068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:48.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.559+0000 7f2278f0e640 1 --2- 172.21.15.26:0/2971710133 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f22540664a0 0x7f2254068960 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f22640ad000 tx=0x7f2264008040 comp rx=0 tx=0).stop 2023-10-14T11:14:48.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.559+0000 7f2278f0e640 1 -- 172.21.15.26:0/2971710133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22740cb530 msgr2=0x7f227415da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:48.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.559+0000 7f2278f0e640 1 --2- 172.21.15.26:0/2971710133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22740cb530 0x7f227415da20 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f225c00c4d0 tx=0x7f225c00c990 comp rx=0 tx=0).stop 2023-10-14T11:14:48.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.559+0000 7f2278f0e640 1 -- 172.21.15.26:0/2971710133 shutdown_connections 2023-10-14T11:14:48.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.559+0000 7f2278f0e640 1 --2- 172.21.15.26:0/2971710133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22741441a0 0x7f2274071820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:48.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.559+0000 7f2278f0e640 1 --2- 172.21.15.26:0/2971710133 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f22540664a0 0x7f2254068960 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:48.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.559+0000 7f2278f0e640 1 --2- 172.21.15.26:0/2971710133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22740cb530 0x7f227415da20 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:48.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.559+0000 7f2278f0e640 1 --2- 172.21.15.26:0/2971710133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22740b1a90 0x7f22741401b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:48.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.559+0000 7f2278f0e640 1 -- 172.21.15.26:0/2971710133 >> 172.21.15.26:0/2971710133 conn(0x7f227406a820 msgr2=0x7f22740703d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:48.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.559+0000 7f2278f0e640 1 -- 172.21.15.26:0/2971710133 shutdown_connections 2023-10-14T11:14:48.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.559+0000 7f2278f0e640 1 -- 172.21.15.26:0/2971710133 wait complete. 2023-10-14T11:14:48.597 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T11:14:48.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.743+0000 7f6992079640 1 Processor -- start 2023-10-14T11:14:48.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.743+0000 7f6992079640 1 -- start start 2023-10-14T11:14:48.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.747+0000 7f6992079640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f698c069e90 0x7f698c06a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:48.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.747+0000 7f6992079640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698c15e5e0 con 0x7f698c06dbd0 2023-10-14T11:14:48.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.747+0000 7f6992079640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698c15b570 con 0x7f698c15ade0 2023-10-14T11:14:48.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.747+0000 7f6992079640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698c06a840 con 0x7f698c069e90 2023-10-14T11:14:48.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.747+0000 7f698b7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f698c06dbd0 0x7f698c0c8e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34086/0 (socket says 172.21.15.26:34086) 2023-10-14T11:14:48.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.747+0000 7f698b7fe640 1 -- 172.21.15.26:0/2237062543 learned_addr learned my addr 172.21.15.26:0/2237062543 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:48.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.747+0000 7f698bfff640 1 --2- 172.21.15.26:0/2237062543 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f698c069e90 0x7f698c06a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:48.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.747+0000 7f698a7fc640 1 -- 172.21.15.26:0/2237062543 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297572900 0 0) 0x7f698c15e5e0 con 0x7f698c06dbd0 2023-10-14T11:14:48.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.747+0000 7f698a7fc640 1 -- 172.21.15.26:0/2237062543 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6974003530 con 0x7f698c06dbd0 2023-10-14T11:14:48.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.747+0000 7f698a7fc640 1 -- 172.21.15.26:0/2237062543 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 652562137 0 0) 0x7f698c15b570 con 0x7f698c15ade0 2023-10-14T11:14:48.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.747+0000 7f698a7fc640 1 -- 172.21.15.26:0/2237062543 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f698c15e5e0 con 0x7f698c15ade0 2023-10-14T11:14:48.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.747+0000 7f698bfff640 1 -- 172.21.15.26:0/2237062543 >> v1:172.21.15.110:6789/0 conn(0x7f698c15ade0 legacy=0x7f698c06c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:48.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.747+0000 7f698bfff640 1 -- 172.21.15.26:0/2237062543 >> v1:172.21.15.26:6789/0 conn(0x7f698c06dbd0 legacy=0x7f698c0c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:48.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.747+0000 7f698a7fc640 1 -- 172.21.15.26:0/2237062543 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 713094596 0 0) 0x7f6974003530 con 0x7f698c06dbd0 2023-10-14T11:14:48.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.747+0000 7f698bfff640 1 -- 172.21.15.26:0/2237062543 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698c15b850 con 0x7f698c069e90 2023-10-14T11:14:48.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.751+0000 7f698bfff640 1 --2- 172.21.15.26:0/2237062543 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f698c069e90 0x7f698c06a300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6984009dc0 tx=0x7f698401c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3df377077e94a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:48.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.751+0000 7f698a7fc640 1 -- 172.21.15.26:0/2237062543 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c001680 con 0x7f698c069e90 2023-10-14T11:14:48.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.751+0000 7f698a7fc640 1 -- 172.21.15.26:0/2237062543 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69840a56a0 con 0x7f698c069e90 2023-10-14T11:14:48.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.751+0000 7f698a7fc640 1 -- 172.21.15.26:0/2237062543 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69840a5a30 con 0x7f698c069e90 2023-10-14T11:14:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.751+0000 7f6992079640 1 -- 172.21.15.26:0/2237062543 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f698c069e90 msgr2=0x7f698c06a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.751+0000 7f6992079640 1 --2- 172.21.15.26:0/2237062543 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f698c069e90 0x7f698c06a300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6984009dc0 tx=0x7f698401c860 comp rx=0 tx=0).stop 2023-10-14T11:14:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.751+0000 7f6992079640 1 -- 172.21.15.26:0/2237062543 shutdown_connections 2023-10-14T11:14:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.751+0000 7f6992079640 1 --2- 172.21.15.26:0/2237062543 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f698c069e90 0x7f698c06a300 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.751+0000 7f6992079640 1 -- 172.21.15.26:0/2237062543 >> 172.21.15.26:0/2237062543 conn(0x7f698c0b0d10 msgr2=0x7f698c0ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.751+0000 7f6992079640 1 -- 172.21.15.26:0/2237062543 shutdown_connections 2023-10-14T11:14:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.751+0000 7f6992079640 1 -- 172.21.15.26:0/2237062543 wait complete. 2023-10-14T11:14:48.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.751+0000 7f6992079640 1 Processor -- start 2023-10-14T11:14:48.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.751+0000 7f6992079640 1 -- start start 2023-10-14T11:14:48.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f6992079640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f698c069e90 0x7f698c0c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:48.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f6992079640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f698c06dbd0 0x7f698c0c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:48.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f6992079640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f698c15ade0 0x7f698c0ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:48.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f6992079640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c14c810 con 0x7f698c15ade0 2023-10-14T11:14:48.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f6992079640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c0ad1d0 con 0x7f698c06dbd0 2023-10-14T11:14:48.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f6992079640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698c0ac650 con 0x7f698c069e90 2023-10-14T11:14:48.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f698bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f698c15ade0 0x7f698c0ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:48.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f698b7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f698c069e90 0x7f698c0c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:48.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f698bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f698c15ade0 0x7f698c0ae350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59932/0 (socket says 172.21.15.26:59932) 2023-10-14T11:14:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f698b7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f698c069e90 0x7f698c0c41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:37678/0 (socket says 172.21.15.26:37678) 2023-10-14T11:14:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f698bfff640 1 -- 172.21.15.26:0/611427508 learned_addr learned my addr 172.21.15.26:0/611427508 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f698affd640 1 --2- 172.21.15.26:0/611427508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f698c06dbd0 0x7f698c0c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f698bfff640 1 -- 172.21.15.26:0/611427508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f698c069e90 msgr2=0x7f698c0c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:48.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f698bfff640 1 --2- 172.21.15.26:0/611427508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f698c069e90 0x7f698c0c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:48.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f698bfff640 1 -- 172.21.15.26:0/611427508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f698c06dbd0 msgr2=0x7f698c0c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:48.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f698bfff640 1 --2- 172.21.15.26:0/611427508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f698c06dbd0 0x7f698c0c4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:48.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f698bfff640 1 -- 172.21.15.26:0/611427508 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6984009a70 con 0x7f698c15ade0 2023-10-14T11:14:48.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f698b7fe640 1 --2- 172.21.15.26:0/611427508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f698c069e90 0x7f698c0c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:14:48.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f698bfff640 1 --2- 172.21.15.26:0/611427508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f698c15ade0 0x7f698c0ae350 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6984009dc0 tx=0x7f6984019600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:48.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f6973fff640 1 -- 172.21.15.26:0/611427508 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984003ba0 con 0x7f698c15ade0 2023-10-14T11:14:48.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f6992079640 1 -- 172.21.15.26:0/611427508 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698c0ac930 con 0x7f698c15ade0 2023-10-14T11:14:48.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f6973fff640 1 -- 172.21.15.26:0/611427508 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6984003d00 con 0x7f698c15ade0 2023-10-14T11:14:48.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f6973fff640 1 -- 172.21.15.26:0/611427508 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69840ad890 con 0x7f698c15ade0 2023-10-14T11:14:48.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f6992079640 1 -- 172.21.15.26:0/611427508 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698c0acef0 con 0x7f698c15ade0 2023-10-14T11:14:48.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f6992079640 1 -- 172.21.15.26:0/611427508 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698c15b1c0 con 0x7f698c15ade0 2023-10-14T11:14:48.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.755+0000 7f6973fff640 1 -- 172.21.15.26:0/611427508 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f69840b4050 con 0x7f698c15ade0 2023-10-14T11:14:48.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.759+0000 7f6973fff640 1 --2- 172.21.15.26:0/611427508 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f69780664a0 0x7f6978068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:48.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.759+0000 7f6973fff640 1 -- 172.21.15.26:0/611427508 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5552+0+0 (secure 0 0 0) 0x7f698411df60 con 0x7f698c15ade0 2023-10-14T11:14:48.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.759+0000 7f698b7fe640 1 --2- 172.21.15.26:0/611427508 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f69780664a0 0x7f6978068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:48.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.759+0000 7f698b7fe640 1 --2- 172.21.15.26:0/611427508 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f69780664a0 0x7f6978068960 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f697c000f70 tx=0x7f697c0016c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:48.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.763+0000 7f6973fff640 1 -- 172.21.15.26:0/611427508 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f69840eb4b0 con 0x7f698c15ade0 2023-10-14T11:14:48.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:48.919+0000 7f6992079640 1 -- 172.21.15.26:0/611427508 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f698c15b1c0 con 0x7f698c15ade0 2023-10-14T11:14:49.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.559+0000 7f6973fff640 1 -- 172.21.15.26:0/611427508 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'testcephfs1_data' created v53) v1 ==== 180+0+0 (secure 0 0 0) 0x7f698c15b1c0 con 0x7f698c15ade0 2023-10-14T11:14:49.568 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'testcephfs1_data' created 2023-10-14T11:14:49.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.563+0000 7f6992079640 1 -- 172.21.15.26:0/611427508 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f69780664a0 msgr2=0x7f6978068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:49.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.563+0000 7f6992079640 1 --2- 172.21.15.26:0/611427508 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f69780664a0 0x7f6978068960 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f697c000f70 tx=0x7f697c0016c0 comp rx=0 tx=0).stop 2023-10-14T11:14:49.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.563+0000 7f6992079640 1 -- 172.21.15.26:0/611427508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f698c15ade0 msgr2=0x7f698c0ae350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:49.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.563+0000 7f6992079640 1 --2- 172.21.15.26:0/611427508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f698c15ade0 0x7f698c0ae350 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6984009dc0 tx=0x7f6984019600 comp rx=0 tx=0).stop 2023-10-14T11:14:49.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.563+0000 7f6992079640 1 -- 172.21.15.26:0/611427508 shutdown_connections 2023-10-14T11:14:49.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.563+0000 7f6992079640 1 --2- 172.21.15.26:0/611427508 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f69780664a0 0x7f6978068960 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:49.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.563+0000 7f6992079640 1 --2- 172.21.15.26:0/611427508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f698c15ade0 0x7f698c0ae350 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:49.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.563+0000 7f6992079640 1 --2- 172.21.15.26:0/611427508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f698c06dbd0 0x7f698c0c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:49.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.563+0000 7f6992079640 1 --2- 172.21.15.26:0/611427508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f698c069e90 0x7f698c0c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:49.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.563+0000 7f6992079640 1 -- 172.21.15.26:0/611427508 >> 172.21.15.26:0/611427508 conn(0x7f698c0b0d10 msgr2=0x7f698c1564e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:49.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.563+0000 7f6992079640 1 -- 172.21.15.26:0/611427508 shutdown_connections 2023-10-14T11:14:49.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.563+0000 7f6992079640 1 -- 172.21.15.26:0/611427508 wait complete. 2023-10-14T11:14:49.614 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new testcephfs1 testcephfs1_metadata testcephfs1_data 2023-10-14T11:14:49.763 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:14:49.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.755+0000 7f7ee990f640 1 Processor -- start 2023-10-14T11:14:49.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.755+0000 7f7ee990f640 1 -- start start 2023-10-14T11:14:49.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.759+0000 7f7ee990f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ee40b84e0 0x7f7ee40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:49.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.759+0000 7f7ee990f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee40d1670 con 0x7f7ee40d0210 2023-10-14T11:14:49.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.759+0000 7f7ee990f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee40d1950 con 0x7f7ee415cba0 2023-10-14T11:14:49.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.759+0000 7f7ee990f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee40d1460 con 0x7f7ee40b84e0 2023-10-14T11:14:49.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.759+0000 7f7edbfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7ee40d0210 0x7f7ee40b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34088/0 (socket says 172.21.15.26:34088) 2023-10-14T11:14:49.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.759+0000 7f7edbfff640 1 -- 172.21.15.26:0/408029896 learned_addr learned my addr 172.21.15.26:0/408029896 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:49.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.759+0000 7f7ee37fe640 1 --2- 172.21.15.26:0/408029896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ee40b84e0 0x7f7ee40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:49.767 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:14:49.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.759+0000 7f7ee27fc640 1 -- 172.21.15.26:0/408029896 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143881781 0 0) 0x7f7ee40d1670 con 0x7f7ee40d0210 2023-10-14T11:14:49.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.759+0000 7f7ee27fc640 1 -- 172.21.15.26:0/408029896 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ed0003530 con 0x7f7ee40d0210 2023-10-14T11:14:49.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.759+0000 7f7ee27fc640 1 -- 172.21.15.26:0/408029896 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782094848 0 0) 0x7f7ee40d1950 con 0x7f7ee415cba0 2023-10-14T11:14:49.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.759+0000 7f7ee27fc640 1 -- 172.21.15.26:0/408029896 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ee40d1670 con 0x7f7ee415cba0 2023-10-14T11:14:49.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.759+0000 7f7ee37fe640 1 -- 172.21.15.26:0/408029896 >> v1:172.21.15.110:6789/0 conn(0x7f7ee415cba0 legacy=0x7f7ee40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:49.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.759+0000 7f7ee27fc640 1 -- 172.21.15.26:0/408029896 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2980354955 0 0) 0x7f7ed0003530 con 0x7f7ee40d0210 2023-10-14T11:14:49.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.759+0000 7f7ee37fe640 1 -- 172.21.15.26:0/408029896 >> v1:172.21.15.26:6789/0 conn(0x7f7ee40d0210 legacy=0x7f7ee40b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:49.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.759+0000 7f7ee37fe640 1 -- 172.21.15.26:0/408029896 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee40d1c30 con 0x7f7ee40b84e0 2023-10-14T11:14:49.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.763+0000 7f7ee37fe640 1 --2- 172.21.15.26:0/408029896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ee40b84e0 0x7f7ee40d0f20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009dc0 tx=0x7f7edc01c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c682c5094ca3ebb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:49.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.763+0000 7f7ee27fc640 1 -- 172.21.15.26:0/408029896 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc001680 con 0x7f7ee40b84e0 2023-10-14T11:14:49.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.763+0000 7f7ee27fc640 1 -- 172.21.15.26:0/408029896 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc0a56d0 con 0x7f7ee40b84e0 2023-10-14T11:14:49.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.763+0000 7f7ee27fc640 1 -- 172.21.15.26:0/408029896 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0a5a60 con 0x7f7ee40b84e0 2023-10-14T11:14:49.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.763+0000 7f7ee990f640 1 -- 172.21.15.26:0/408029896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ee40b84e0 msgr2=0x7f7ee40d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:49.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.763+0000 7f7ee990f640 1 --2- 172.21.15.26:0/408029896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ee40b84e0 0x7f7ee40d0f20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009dc0 tx=0x7f7edc01c890 comp rx=0 tx=0).stop 2023-10-14T11:14:49.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.763+0000 7f7ee990f640 1 -- 172.21.15.26:0/408029896 shutdown_connections 2023-10-14T11:14:49.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.763+0000 7f7ee990f640 1 --2- 172.21.15.26:0/408029896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ee40b84e0 0x7f7ee40d0f20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:49.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.763+0000 7f7ee990f640 1 -- 172.21.15.26:0/408029896 >> 172.21.15.26:0/408029896 conn(0x7f7ee40719c0 msgr2=0x7f7ee4071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:49.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.763+0000 7f7ee990f640 1 -- 172.21.15.26:0/408029896 shutdown_connections 2023-10-14T11:14:49.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.763+0000 7f7ee990f640 1 -- 172.21.15.26:0/408029896 wait complete. 2023-10-14T11:14:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee990f640 1 Processor -- start 2023-10-14T11:14:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee990f640 1 -- start start 2023-10-14T11:14:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee990f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ee40b84e0 0x7f7ee40cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee990f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ee40d0210 0x7f7ee40c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee990f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ee415cba0 0x7f7ee40c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:49.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee990f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee40c75a0 con 0x7f7ee40b84e0 2023-10-14T11:14:49.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee990f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee40c91e0 con 0x7f7ee415cba0 2023-10-14T11:14:49.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee990f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee40cbbf0 con 0x7f7ee40d0210 2023-10-14T11:14:49.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ee40b84e0 0x7f7ee40cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:49.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ee40b84e0 0x7f7ee40cac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59946/0 (socket says 172.21.15.26:59946) 2023-10-14T11:14:49.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee2ffd640 1 -- 172.21.15.26:0/1547535471 learned_addr learned my addr 172.21.15.26:0/1547535471 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:49.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee37fe640 1 --2- 172.21.15.26:0/1547535471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ee415cba0 0x7f7ee40c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:49.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7edbfff640 1 --2- 172.21.15.26:0/1547535471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ee40d0210 0x7f7ee40c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:49.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee2ffd640 1 -- 172.21.15.26:0/1547535471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ee40d0210 msgr2=0x7f7ee40c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:49.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee2ffd640 1 --2- 172.21.15.26:0/1547535471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ee40d0210 0x7f7ee40c7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:49.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee2ffd640 1 -- 172.21.15.26:0/1547535471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ee415cba0 msgr2=0x7f7ee40c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:49.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee2ffd640 1 --2- 172.21.15.26:0/1547535471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ee415cba0 0x7f7ee40c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:49.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee2ffd640 1 -- 172.21.15.26:0/1547535471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc009a70 con 0x7f7ee40b84e0 2023-10-14T11:14:49.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee2ffd640 1 --2- 172.21.15.26:0/1547535471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ee40b84e0 0x7f7ee40cac70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400c490 tx=0x7f7ed400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:49.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee0ff9640 1 -- 172.21.15.26:0/1547535471 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed40052d0 con 0x7f7ee40b84e0 2023-10-14T11:14:49.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee0ff9640 1 -- 172.21.15.26:0/1547535471 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed4005430 con 0x7f7ee40b84e0 2023-10-14T11:14:49.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee990f640 1 -- 172.21.15.26:0/1547535471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee415d470 con 0x7f7ee40b84e0 2023-10-14T11:14:49.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee0ff9640 1 -- 172.21.15.26:0/1547535471 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4012870 con 0x7f7ee40b84e0 2023-10-14T11:14:49.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee990f640 1 -- 172.21.15.26:0/1547535471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee40cb630 con 0x7f7ee40b84e0 2023-10-14T11:14:49.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.767+0000 7f7ee990f640 1 -- 172.21.15.26:0/1547535471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee404e170 con 0x7f7ee40b84e0 2023-10-14T11:14:49.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.771+0000 7f7ee0ff9640 1 -- 172.21.15.26:0/1547535471 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7ed40129d0 con 0x7f7ee40b84e0 2023-10-14T11:14:49.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.771+0000 7f7ee0ff9640 1 --2- 172.21.15.26:0/1547535471 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7ec40664a0 0x7f7ec4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:49.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.771+0000 7f7ee0ff9640 1 -- 172.21.15.26:0/1547535471 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f7ed40843b0 con 0x7f7ee40b84e0 2023-10-14T11:14:49.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.771+0000 7f7edbfff640 1 --2- 172.21.15.26:0/1547535471 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7ec40664a0 0x7f7ec4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:49.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.771+0000 7f7edbfff640 1 --2- 172.21.15.26:0/1547535471 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7ec40664a0 0x7f7ec4068960 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7ee40ccc90 tx=0x7f7ecc0016e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:49.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.775+0000 7f7ee0ff9640 1 -- 172.21.15.26:0/1547535471 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7ed4051880 con 0x7f7ee40b84e0 2023-10-14T11:14:49.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:49.967+0000 7f7ee990f640 1 -- 172.21.15.26:0/1547535471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"} v 0) v1 -- 0x7f7ee4160370 con 0x7f7ee40b84e0 2023-10-14T11:14:50.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.575+0000 7f7ee0ff9640 1 -- 172.21.15.26:0/1547535471 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"}]=0 new fs with metadata pool 8 and data pool 9 v22) v1 ==== 187+0+0 (secure 0 0 0) 0x7f7ed4054ea0 con 0x7f7ee40b84e0 2023-10-14T11:14:50.582 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 8 and data pool 9 2023-10-14T11:14:50.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.579+0000 7f7ee990f640 1 -- 172.21.15.26:0/1547535471 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7ec40664a0 msgr2=0x7f7ec4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:50.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.579+0000 7f7ee990f640 1 --2- 172.21.15.26:0/1547535471 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7ec40664a0 0x7f7ec4068960 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7ee40ccc90 tx=0x7f7ecc0016e0 comp rx=0 tx=0).stop 2023-10-14T11:14:50.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.579+0000 7f7ee990f640 1 -- 172.21.15.26:0/1547535471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ee40b84e0 msgr2=0x7f7ee40cac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:50.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.579+0000 7f7ee990f640 1 --2- 172.21.15.26:0/1547535471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ee40b84e0 0x7f7ee40cac70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400c490 tx=0x7f7ed400c950 comp rx=0 tx=0).stop 2023-10-14T11:14:50.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.579+0000 7f7ee990f640 1 -- 172.21.15.26:0/1547535471 shutdown_connections 2023-10-14T11:14:50.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.579+0000 7f7ee990f640 1 --2- 172.21.15.26:0/1547535471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ee415cba0 0x7f7ee40c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.579+0000 7f7ee990f640 1 --2- 172.21.15.26:0/1547535471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ee40d0210 0x7f7ee40c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.579+0000 7f7ee990f640 1 --2- 172.21.15.26:0/1547535471 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7ec40664a0 0x7f7ec4068960 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.579+0000 7f7ee990f640 1 --2- 172.21.15.26:0/1547535471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ee40b84e0 0x7f7ee40cac70 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.579+0000 7f7ee990f640 1 -- 172.21.15.26:0/1547535471 >> 172.21.15.26:0/1547535471 conn(0x7f7ee40719c0 msgr2=0x7f7ee415b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.579+0000 7f7ee990f640 1 -- 172.21.15.26:0/1547535471 shutdown_connections 2023-10-14T11:14:50.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.579+0000 7f7ee990f640 1 -- 172.21.15.26:0/1547535471 wait complete. 2023-10-14T11:14:50.635 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:14:50.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.775+0000 7f42b7b94640 1 Processor -- start 2023-10-14T11:14:50.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.775+0000 7f42b7b94640 1 -- start start 2023-10-14T11:14:50.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.775+0000 7f42b7b94640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42b0070c40 0x7f42b015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:50.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.775+0000 7f42b7b94640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f42b00b07f0 0x7f42b0164490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:50.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.775+0000 7f42b7b94640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b015be60 con 0x7f42b00b4020 2023-10-14T11:14:50.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.775+0000 7f42b7b94640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b015b3b0 con 0x7f42b00b07f0 2023-10-14T11:14:50.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.775+0000 7f42b7b94640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b015c1f0 con 0x7f42b0070c40 2023-10-14T11:14:50.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.775+0000 7f42b512f640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f42b00b4020 0x7f42b00b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34104/0 (socket says 172.21.15.26:34104) 2023-10-14T11:14:50.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.775+0000 7f42b512f640 1 -- 172.21.15.26:0/1275465640 learned_addr learned my addr 172.21.15.26:0/1275465640 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:50.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.775+0000 7f42b5930640 1 --2- 172.21.15.26:0/1275465640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42b0070c40 0x7f42b015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:50.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.775+0000 7f42b6131640 1 --2- 172.21.15.26:0/1275465640 >> v2:172.21.15.110:3300/0 conn(0x7f42b00b07f0 0x7f42b0164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:50.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.775+0000 7f42b492e640 1 -- 172.21.15.26:0/1275465640 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548583942 0 0) 0x7f42b015be60 con 0x7f42b00b4020 2023-10-14T11:14:50.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.775+0000 7f42b492e640 1 -- 172.21.15.26:0/1275465640 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f429c003530 con 0x7f42b00b4020 2023-10-14T11:14:50.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.775+0000 7f42b5930640 1 -- 172.21.15.26:0/1275465640 >> v2:172.21.15.110:3300/0 conn(0x7f42b00b07f0 msgr2=0x7f42b0164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:50.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.775+0000 7f42b5930640 1 --2- 172.21.15.26:0/1275465640 >> v2:172.21.15.110:3300/0 conn(0x7f42b00b07f0 0x7f42b0164490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:50.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.775+0000 7f42b5930640 1 -- 172.21.15.26:0/1275465640 >> v1:172.21.15.26:6789/0 conn(0x7f42b00b4020 legacy=0x7f42b00b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:50.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.775+0000 7f42b5930640 1 -- 172.21.15.26:0/1275465640 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b0071020 con 0x7f42b0070c40 2023-10-14T11:14:50.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.779+0000 7f42b5930640 1 --2- 172.21.15.26:0/1275465640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42b0070c40 0x7f42b015ae70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0097c0 tx=0x7f42ac01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50822d79e2e9f9b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:50.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.779+0000 7f42b492e640 1 -- 172.21.15.26:0/1275465640 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac0ab5f0 con 0x7f42b0070c40 2023-10-14T11:14:50.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.779+0000 7f42b492e640 1 -- 172.21.15.26:0/1275465640 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ac0ab750 con 0x7f42b0070c40 2023-10-14T11:14:50.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.779+0000 7f42b492e640 1 -- 172.21.15.26:0/1275465640 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac0abac0 con 0x7f42b0070c40 2023-10-14T11:14:50.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.779+0000 7f42b7b94640 1 -- 172.21.15.26:0/1275465640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42b0070c40 msgr2=0x7f42b015ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:50.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.779+0000 7f42b7b94640 1 --2- 172.21.15.26:0/1275465640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42b0070c40 0x7f42b015ae70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0097c0 tx=0x7f42ac01c3f0 comp rx=0 tx=0).stop 2023-10-14T11:14:50.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.779+0000 7f42b7b94640 1 -- 172.21.15.26:0/1275465640 shutdown_connections 2023-10-14T11:14:50.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.779+0000 7f42b7b94640 1 --2- 172.21.15.26:0/1275465640 >> v2:172.21.15.110:3300/0 conn(0x7f42b00b07f0 0x7f42b0164490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:50.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.779+0000 7f42b7b94640 1 --2- 172.21.15.26:0/1275465640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42b0070c40 0x7f42b015ae70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:50.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.779+0000 7f42b7b94640 1 -- 172.21.15.26:0/1275465640 >> 172.21.15.26:0/1275465640 conn(0x7f42b006c190 msgr2=0x7f42b006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:50.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.779+0000 7f42b7b94640 1 -- 172.21.15.26:0/1275465640 shutdown_connections 2023-10-14T11:14:50.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.779+0000 7f42b7b94640 1 -- 172.21.15.26:0/1275465640 wait complete. 2023-10-14T11:14:50.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42b7b94640 1 Processor -- start 2023-10-14T11:14:50.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42b7b94640 1 -- start start 2023-10-14T11:14:50.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42b7b94640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42b0070c40 0x7f42b014df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:50.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42b7b94640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42b00b07f0 0x7f42b0159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:50.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42b7b94640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42b00b4020 0x7f42b0159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:50.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42b7b94640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b00ae120 con 0x7f42b00b4020 2023-10-14T11:14:50.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42b7b94640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b00ce2b0 con 0x7f42b00b07f0 2023-10-14T11:14:50.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42b7b94640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b00cdd80 con 0x7f42b0070c40 2023-10-14T11:14:50.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42b6131640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42b00b4020 0x7f42b0159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:50.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42b6131640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42b00b4020 0x7f42b0159e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59950/0 (socket says 172.21.15.26:59950) 2023-10-14T11:14:50.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42b6131640 1 -- 172.21.15.26:0/702790497 learned_addr learned my addr 172.21.15.26:0/702790497 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:50.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42b5930640 1 --2- 172.21.15.26:0/702790497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42b0070c40 0x7f42b014df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:50.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42b512f640 1 --2- 172.21.15.26:0/702790497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42b00b07f0 0x7f42b0159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:50.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42b6131640 1 -- 172.21.15.26:0/702790497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42b0070c40 msgr2=0x7f42b014df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:50.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42b6131640 1 --2- 172.21.15.26:0/702790497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42b0070c40 0x7f42b014df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:50.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42b6131640 1 -- 172.21.15.26:0/702790497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42b00b07f0 msgr2=0x7f42b0159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:50.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42b6131640 1 --2- 172.21.15.26:0/702790497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42b00b07f0 0x7f42b0159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:50.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42b6131640 1 -- 172.21.15.26:0/702790497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ac009420 con 0x7f42b00b4020 2023-10-14T11:14:50.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42b6131640 1 --2- 172.21.15.26:0/702790497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42b00b4020 0x7f42b0159e80 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f42a800ef90 tx=0x7f42a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:50.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42a67fc640 1 -- 172.21.15.26:0/702790497 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a8009bf0 con 0x7f42b00b4020 2023-10-14T11:14:50.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42a67fc640 1 -- 172.21.15.26:0/702790497 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a800f040 con 0x7f42b00b4020 2023-10-14T11:14:50.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42b7b94640 1 -- 172.21.15.26:0/702790497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b014e440 con 0x7f42b00b4020 2023-10-14T11:14:50.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42a67fc640 1 -- 172.21.15.26:0/702790497 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a80146c0 con 0x7f42b00b4020 2023-10-14T11:14:50.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42b7b94640 1 -- 172.21.15.26:0/702790497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b00ade40 con 0x7f42b00b4020 2023-10-14T11:14:50.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.783+0000 7f42b7b94640 1 -- 172.21.15.26:0/702790497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b0074010 con 0x7f42b00b4020 2023-10-14T11:14:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.787+0000 7f42a67fc640 1 -- 172.21.15.26:0/702790497 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f42a8014820 con 0x7f42b00b4020 2023-10-14T11:14:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.787+0000 7f42a67fc640 1 --2- 172.21.15.26:0/702790497 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f42940664a0 0x7f4294068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.787+0000 7f42a67fc640 1 -- 172.21.15.26:0/702790497 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f42a8084c60 con 0x7f42b00b4020 2023-10-14T11:14:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.787+0000 7f42b5930640 1 --2- 172.21.15.26:0/702790497 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f42940664a0 0x7f4294068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.787+0000 7f42b5930640 1 --2- 172.21.15.26:0/702790497 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f42940664a0 0x7f4294068960 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0af000 tx=0x7f42ac0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:50.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.791+0000 7f42a67fc640 1 -- 172.21.15.26:0/702790497 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f42a80520a0 con 0x7f42b00b4020 2023-10-14T11:14:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.947+0000 7f42b7b94640 1 -- 172.21.15.26:0/702790497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42b00b3c90 con 0x7f42b00b4020 2023-10-14T11:14:50.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.947+0000 7f42a67fc640 1 -- 172.21.15.26:0/702790497 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16803 (secure 0 0 0) 0x7f42a8018090 con 0x7f42b00b4020 2023-10-14T11:14:50.956 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:50.956 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":54,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:14:49.973362+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:14:47.752880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:14:48.971211+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:14:50.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.951+0000 7f42b7b94640 1 -- 172.21.15.26:0/702790497 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f42940664a0 msgr2=0x7f4294068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:50.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.951+0000 7f42b7b94640 1 --2- 172.21.15.26:0/702790497 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f42940664a0 0x7f4294068960 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0af000 tx=0x7f42ac0a7000 comp rx=0 tx=0).stop 2023-10-14T11:14:50.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.951+0000 7f42b7b94640 1 -- 172.21.15.26:0/702790497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42b00b4020 msgr2=0x7f42b0159e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:50.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.951+0000 7f42b7b94640 1 --2- 172.21.15.26:0/702790497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42b00b4020 0x7f42b0159e80 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f42a800ef90 tx=0x7f42a800c490 comp rx=0 tx=0).stop 2023-10-14T11:14:50.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.951+0000 7f42b7b94640 1 -- 172.21.15.26:0/702790497 shutdown_connections 2023-10-14T11:14:50.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.951+0000 7f42b7b94640 1 --2- 172.21.15.26:0/702790497 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f42940664a0 0x7f4294068960 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:50.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.951+0000 7f42b7b94640 1 --2- 172.21.15.26:0/702790497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42b00b4020 0x7f42b0159e80 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:50.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.951+0000 7f42b7b94640 1 --2- 172.21.15.26:0/702790497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42b00b07f0 0x7f42b0159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:50.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.951+0000 7f42b7b94640 1 --2- 172.21.15.26:0/702790497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42b0070c40 0x7f42b014df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:50.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.951+0000 7f42b7b94640 1 -- 172.21.15.26:0/702790497 >> 172.21.15.26:0/702790497 conn(0x7f42b006c190 msgr2=0x7f42b00b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:50.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.951+0000 7f42b7b94640 1 -- 172.21.15.26:0/702790497 shutdown_connections 2023-10-14T11:14:50.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:50.951+0000 7f42b7b94640 1 -- 172.21.15.26:0/702790497 wait complete. 2023-10-14T11:14:50.977 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:14:51.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5197994640 1 Processor -- start 2023-10-14T11:14:51.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5197994640 1 -- start start 2023-10-14T11:14:51.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5197994640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f51900d15d0 0x7f51900cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:51.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5197994640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51900ce770 con 0x7f51900d3010 2023-10-14T11:14:51.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5197994640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51900d0600 con 0x7f519015cb90 2023-10-14T11:14:51.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5197994640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51900c6450 con 0x7f51900d15d0 2023-10-14T11:14:51.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5195f31640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f51900d3010 0x7f51900c6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34114/0 (socket says 172.21.15.26:34114) 2023-10-14T11:14:51.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5195f31640 1 -- 172.21.15.26:0/3596549642 learned_addr learned my addr 172.21.15.26:0/3596549642 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:51.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5194f2f640 1 --2- 172.21.15.26:0/3596549642 >> v2:172.21.15.110:3300/0 conn(0x7f51900d15d0 0x7f51900cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:51.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5187fff640 1 -- 172.21.15.26:0/3596549642 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928061417 0 0) 0x7f51900ce770 con 0x7f51900d3010 2023-10-14T11:14:51.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5187fff640 1 -- 172.21.15.26:0/3596549642 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f517c003530 con 0x7f51900d3010 2023-10-14T11:14:51.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5187fff640 1 -- 172.21.15.26:0/3596549642 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2506493113 0 0) 0x7f517c003530 con 0x7f51900d3010 2023-10-14T11:14:51.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5187fff640 1 -- 172.21.15.26:0/3596549642 >> v2:172.21.15.110:3300/0 conn(0x7f51900d15d0 msgr2=0x7f51900cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:51.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5187fff640 1 --2- 172.21.15.26:0/3596549642 >> v2:172.21.15.110:3300/0 conn(0x7f51900d15d0 0x7f51900cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:51.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5187fff640 1 -- 172.21.15.26:0/3596549642 >> v1:172.21.15.110:6789/0 conn(0x7f519015cb90 legacy=0x7f51900d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:51.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5187fff640 1 -- 172.21.15.26:0/3596549642 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51900d08a0 con 0x7f51900d3010 2023-10-14T11:14:51.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5187fff640 1 -- 172.21.15.26:0/3596549642 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f5188001a00 con 0x7f51900d3010 2023-10-14T11:14:51.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5187fff640 1 -- 172.21.15.26:0/3596549642 >> v1:172.21.15.26:6789/0 conn(0x7f51900d3010 legacy=0x7f51900c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:51.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5187fff640 1 --2- 172.21.15.26:0/3596549642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f517c003980 0x7f517c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:51.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5187fff640 1 --2- 172.21.15.26:0/3596549642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f517c004380 0x7f517c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:51.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5187fff640 1 --2- 172.21.15.26:0/3596549642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f517c0050f0 0x7f517c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:51.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5187fff640 1 -- 172.21.15.26:0/3596549642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51900c6450 con 0x7f517c004380 2023-10-14T11:14:51.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5187fff640 1 -- 172.21.15.26:0/3596549642 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c00c030 con 0x7f517c0050f0 2023-10-14T11:14:51.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5187fff640 1 -- 172.21.15.26:0/3596549642 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517c00c1f0 con 0x7f517c003980 2023-10-14T11:14:51.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5194f2f640 1 --2- 172.21.15.26:0/3596549642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f517c004380 0x7f517c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:51.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.115+0000 7f5195730640 1 --2- 172.21.15.26:0/3596549642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f517c003980 0x7f517c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:51.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.119+0000 7f5195f31640 1 --2- 172.21.15.26:0/3596549642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f517c0050f0 0x7f517c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:51.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.119+0000 7f5194f2f640 1 -- 172.21.15.26:0/3596549642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f517c003980 msgr2=0x7f517c003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:51.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.119+0000 7f5194f2f640 1 --2- 172.21.15.26:0/3596549642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f517c003980 0x7f517c003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:51.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.119+0000 7f5194f2f640 1 -- 172.21.15.26:0/3596549642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f517c0050f0 msgr2=0x7f517c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:51.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.119+0000 7f5194f2f640 1 --2- 172.21.15.26:0/3596549642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f517c0050f0 0x7f517c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:51.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.119+0000 7f5194f2f640 1 -- 172.21.15.26:0/3596549642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c003530 con 0x7f517c004380 2023-10-14T11:14:51.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.119+0000 7f5195f31640 1 -- 172.21.15.26:0/3596549642 reap_dead start 2023-10-14T11:14:51.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.119+0000 7f5194f2f640 1 --2- 172.21.15.26:0/3596549642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f517c004380 0x7f517c004850 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5180009ae0 tx=0x7f518001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca33b3e6e81d33f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:51.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.119+0000 7f5187fff640 1 -- 172.21.15.26:0/3596549642 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51800a5640 con 0x7f517c004380 2023-10-14T11:14:51.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.119+0000 7f5187fff640 1 -- 172.21.15.26:0/3596549642 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51800a57a0 con 0x7f517c004380 2023-10-14T11:14:51.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.119+0000 7f5187fff640 1 -- 172.21.15.26:0/3596549642 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51800a5b50 con 0x7f517c004380 2023-10-14T11:14:51.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.119+0000 7f5197994640 1 -- 172.21.15.26:0/3596549642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f517c004380 msgr2=0x7f517c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:51.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.119+0000 7f5197994640 1 --2- 172.21.15.26:0/3596549642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f517c004380 0x7f517c004850 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5180009ae0 tx=0x7f518001ca50 comp rx=0 tx=0).stop 2023-10-14T11:14:51.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.119+0000 7f5197994640 1 -- 172.21.15.26:0/3596549642 shutdown_connections 2023-10-14T11:14:51.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.119+0000 7f5197994640 1 --2- 172.21.15.26:0/3596549642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f517c004380 0x7f517c004850 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:51.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.119+0000 7f5197994640 1 -- 172.21.15.26:0/3596549642 >> 172.21.15.26:0/3596549642 conn(0x7f519009bc50 msgr2=0x7f51900d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:51.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5197994640 1 -- 172.21.15.26:0/3596549642 shutdown_connections 2023-10-14T11:14:51.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5197994640 1 -- 172.21.15.26:0/3596549642 wait complete. 2023-10-14T11:14:51.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5197994640 1 Processor -- start 2023-10-14T11:14:51.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5197994640 1 -- start start 2023-10-14T11:14:51.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5197994640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f517c004380 0x7f51900cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:51.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5197994640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51900cda00 0x7f5190154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:51.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5197994640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51901e4b10 0x7f51901e4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:51.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5197994640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51901e5500 con 0x7f51900cda00 2023-10-14T11:14:51.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5197994640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51900cc8c0 con 0x7f517c004380 2023-10-14T11:14:51.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5197994640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51900cb2e0 con 0x7f51901e4b10 2023-10-14T11:14:51.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5194f2f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51900cda00 0x7f5190154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5194f2f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51900cda00 0x7f5190154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59958/0 (socket says 172.21.15.26:59958) 2023-10-14T11:14:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5194f2f640 1 -- 172.21.15.26:0/2172008180 learned_addr learned my addr 172.21.15.26:0/2172008180 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5195730640 1 --2- 172.21.15.26:0/2172008180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f517c004380 0x7f51900cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5195f31640 1 --2- 172.21.15.26:0/2172008180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51901e4b10 0x7f51901e4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5194f2f640 1 -- 172.21.15.26:0/2172008180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51901e4b10 msgr2=0x7f51901e4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5194f2f640 1 --2- 172.21.15.26:0/2172008180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51901e4b10 0x7f51901e4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:51.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5194f2f640 1 -- 172.21.15.26:0/2172008180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f517c004380 msgr2=0x7f51900cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:51.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5194f2f640 1 --2- 172.21.15.26:0/2172008180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f517c004380 0x7f51900cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:51.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5194f2f640 1 -- 172.21.15.26:0/2172008180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51900cb5c0 con 0x7f51900cda00 2023-10-14T11:14:51.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5194f2f640 1 --2- 172.21.15.26:0/2172008180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51900cda00 0x7f5190154db0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f51800b0040 tx=0x7f51800197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:51.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5185ffb640 1 -- 172.21.15.26:0/2172008180 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5180004220 con 0x7f51900cda00 2023-10-14T11:14:51.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5185ffb640 1 -- 172.21.15.26:0/2172008180 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51800043a0 con 0x7f51900cda00 2023-10-14T11:14:51.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5197994640 1 -- 172.21.15.26:0/2172008180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51900cb8a0 con 0x7f51900cda00 2023-10-14T11:14:51.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.123+0000 7f5185ffb640 1 -- 172.21.15.26:0/2172008180 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5180004510 con 0x7f51900cda00 2023-10-14T11:14:51.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.127+0000 7f5197994640 1 -- 172.21.15.26:0/2172008180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51900cbe60 con 0x7f51900cda00 2023-10-14T11:14:51.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.127+0000 7f5197994640 1 -- 172.21.15.26:0/2172008180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5190074010 con 0x7f51900cda00 2023-10-14T11:14:51.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.127+0000 7f5185ffb640 1 -- 172.21.15.26:0/2172008180 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f51800b4070 con 0x7f51900cda00 2023-10-14T11:14:51.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.127+0000 7f5185ffb640 1 --2- 172.21.15.26:0/2172008180 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f51740664d0 0x7f5174068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:51.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.127+0000 7f5185ffb640 1 -- 172.21.15.26:0/2172008180 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f518011dfa0 con 0x7f51900cda00 2023-10-14T11:14:51.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.127+0000 7f5195730640 1 --2- 172.21.15.26:0/2172008180 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f51740664d0 0x7f5174068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:51.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.131+0000 7f5195730640 1 --2- 172.21.15.26:0/2172008180 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f51740664d0 0x7f5174068990 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f518c007b20 tx=0x7f518c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:51.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.131+0000 7f5185ffb640 1 -- 172.21.15.26:0/2172008180 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f51800eb2d0 con 0x7f51900cda00 2023-10-14T11:14:51.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.291+0000 7f5197994640 1 -- 172.21.15.26:0/2172008180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f519006b800 con 0x7f51900cda00 2023-10-14T11:14:51.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.291+0000 7f5185ffb640 1 -- 172.21.15.26:0/2172008180 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16803 (secure 0 0 0) 0x7f51800b2090 con 0x7f51900cda00 2023-10-14T11:14:51.298 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:51.298 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":54,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:14:49.973362+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:14:47.752880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:14:48.971211+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:14:51.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.291+0000 7f5197994640 1 -- 172.21.15.26:0/2172008180 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f51740664d0 msgr2=0x7f5174068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:51.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.291+0000 7f5197994640 1 --2- 172.21.15.26:0/2172008180 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f51740664d0 0x7f5174068990 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f518c007b20 tx=0x7f518c009040 comp rx=0 tx=0).stop 2023-10-14T11:14:51.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.291+0000 7f5197994640 1 -- 172.21.15.26:0/2172008180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51900cda00 msgr2=0x7f5190154db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:51.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.291+0000 7f5197994640 1 --2- 172.21.15.26:0/2172008180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51900cda00 0x7f5190154db0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f51800b0040 tx=0x7f51800197f0 comp rx=0 tx=0).stop 2023-10-14T11:14:51.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.291+0000 7f5197994640 1 -- 172.21.15.26:0/2172008180 shutdown_connections 2023-10-14T11:14:51.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.291+0000 7f5197994640 1 --2- 172.21.15.26:0/2172008180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51901e4b10 0x7f51901e4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:51.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.291+0000 7f5197994640 1 --2- 172.21.15.26:0/2172008180 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f51740664d0 0x7f5174068990 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:51.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.291+0000 7f5197994640 1 --2- 172.21.15.26:0/2172008180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51900cda00 0x7f5190154db0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:51.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.291+0000 7f5197994640 1 --2- 172.21.15.26:0/2172008180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f517c004380 0x7f51900cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:51.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.295+0000 7f5197994640 1 -- 172.21.15.26:0/2172008180 >> 172.21.15.26:0/2172008180 conn(0x7f519009bc50 msgr2=0x7f51900ceed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:51.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.295+0000 7f5197994640 1 -- 172.21.15.26:0/2172008180 shutdown_connections 2023-10-14T11:14:51.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.295+0000 7f5197994640 1 -- 172.21.15.26:0/2172008180 wait complete. 2023-10-14T11:14:51.319 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 standby_count_wanted 0 2023-10-14T11:14:51.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.459+0000 7fb13d72a640 1 Processor -- start 2023-10-14T11:14:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.459+0000 7fb13d72a640 1 -- start start 2023-10-14T11:14:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.459+0000 7fb13d72a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb1380b84e0 0x7fb1380d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:51.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.459+0000 7fb13d72a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1380d1670 con 0x7fb1380d0210 2023-10-14T11:14:51.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.459+0000 7fb13d72a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1380d1950 con 0x7fb13815cba0 2023-10-14T11:14:51.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.459+0000 7fb13d72a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1380d1460 con 0x7fb1380b84e0 2023-10-14T11:14:51.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.459+0000 7fb12ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb1380d0210 0x7fb1380b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34116/0 (socket says 172.21.15.26:34116) 2023-10-14T11:14:51.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.459+0000 7fb12ffff640 1 -- 172.21.15.26:0/4112886321 learned_addr learned my addr 172.21.15.26:0/4112886321 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:51.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.459+0000 7fb1377fe640 1 --2- 172.21.15.26:0/4112886321 >> v2:172.21.15.110:3300/0 conn(0x7fb1380b84e0 0x7fb1380d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:51.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.459+0000 7fb1367fc640 1 -- 172.21.15.26:0/4112886321 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389564680 0 0) 0x7fb1380d1670 con 0x7fb1380d0210 2023-10-14T11:14:51.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.459+0000 7fb1367fc640 1 -- 172.21.15.26:0/4112886321 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb124003530 con 0x7fb1380d0210 2023-10-14T11:14:51.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.459+0000 7fb1367fc640 1 -- 172.21.15.26:0/4112886321 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894315600 0 0) 0x7fb1380d1950 con 0x7fb13815cba0 2023-10-14T11:14:51.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.459+0000 7fb1367fc640 1 -- 172.21.15.26:0/4112886321 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1380d1670 con 0x7fb13815cba0 2023-10-14T11:14:51.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.459+0000 7fb1377fe640 1 -- 172.21.15.26:0/4112886321 >> v1:172.21.15.110:6789/0 conn(0x7fb13815cba0 legacy=0x7fb1380cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:51.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.459+0000 7fb1377fe640 1 -- 172.21.15.26:0/4112886321 >> v1:172.21.15.26:6789/0 conn(0x7fb1380d0210 legacy=0x7fb1380b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:51.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.459+0000 7fb1377fe640 1 -- 172.21.15.26:0/4112886321 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1380d1c30 con 0x7fb1380b84e0 2023-10-14T11:14:51.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.463+0000 7fb1377fe640 1 --2- 172.21.15.26:0/4112886321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1380b84e0 0x7fb1380d0f20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb130009d90 tx=0x7fb13001c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dfcb8d9dda6539c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:51.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.463+0000 7fb1367fc640 1 -- 172.21.15.26:0/4112886321 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1300a5980 con 0x7fb1380b84e0 2023-10-14T11:14:51.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.463+0000 7fb1367fc640 1 -- 172.21.15.26:0/4112886321 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1300a5ae0 con 0x7fb1380b84e0 2023-10-14T11:14:51.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.463+0000 7fb1367fc640 1 -- 172.21.15.26:0/4112886321 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1300a5e70 con 0x7fb1380b84e0 2023-10-14T11:14:51.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.463+0000 7fb13d72a640 1 -- 172.21.15.26:0/4112886321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1380b84e0 msgr2=0x7fb1380d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:51.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.463+0000 7fb13d72a640 1 --2- 172.21.15.26:0/4112886321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1380b84e0 0x7fb1380d0f20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb130009d90 tx=0x7fb13001c8c0 comp rx=0 tx=0).stop 2023-10-14T11:14:51.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.463+0000 7fb13d72a640 1 -- 172.21.15.26:0/4112886321 shutdown_connections 2023-10-14T11:14:51.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.463+0000 7fb13d72a640 1 --2- 172.21.15.26:0/4112886321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1380b84e0 0x7fb1380d0f20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:51.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.463+0000 7fb13d72a640 1 -- 172.21.15.26:0/4112886321 >> 172.21.15.26:0/4112886321 conn(0x7fb1380719c0 msgr2=0x7fb138071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:51.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.463+0000 7fb13d72a640 1 -- 172.21.15.26:0/4112886321 shutdown_connections 2023-10-14T11:14:51.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.463+0000 7fb13d72a640 1 -- 172.21.15.26:0/4112886321 wait complete. 2023-10-14T11:14:51.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb13d72a640 1 Processor -- start 2023-10-14T11:14:51.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb13d72a640 1 -- start start 2023-10-14T11:14:51.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb13d72a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1380b84e0 0x7fb1380cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:51.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb13d72a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1380d0210 0x7fb1380c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:51.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb13d72a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb13815cba0 0x7fb1380ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:51.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb13d72a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1380c77a0 con 0x7fb13815cba0 2023-10-14T11:14:51.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb13d72a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1380cac80 con 0x7fb1380d0210 2023-10-14T11:14:51.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb13d72a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1380c9cc0 con 0x7fb1380b84e0 2023-10-14T11:14:51.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb1377fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb13815cba0 0x7fb1380ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:51.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb1377fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb13815cba0 0x7fb1380ca740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59960/0 (socket says 172.21.15.26:59960) 2023-10-14T11:14:51.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb1377fe640 1 -- 172.21.15.26:0/3513848856 learned_addr learned my addr 172.21.15.26:0/3513848856 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:51.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb136ffd640 1 --2- 172.21.15.26:0/3513848856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1380b84e0 0x7fb1380cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:51.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb12ffff640 1 --2- 172.21.15.26:0/3513848856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1380d0210 0x7fb1380c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:51.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb1377fe640 1 -- 172.21.15.26:0/3513848856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1380b84e0 msgr2=0x7fb1380cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:51.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb1377fe640 1 --2- 172.21.15.26:0/3513848856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1380b84e0 0x7fb1380cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:51.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb1377fe640 1 -- 172.21.15.26:0/3513848856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1380d0210 msgr2=0x7fb1380c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:51.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb1377fe640 1 --2- 172.21.15.26:0/3513848856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1380d0210 0x7fb1380c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:51.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb1377fe640 1 -- 172.21.15.26:0/3513848856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb130009a70 con 0x7fb13815cba0 2023-10-14T11:14:51.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb1377fe640 1 --2- 172.21.15.26:0/3513848856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb13815cba0 0x7fb1380ca740 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb13001a4f0 tx=0x7fb130019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:51.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb12f7fe640 1 -- 172.21.15.26:0/3513848856 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1300b9860 con 0x7fb13815cba0 2023-10-14T11:14:51.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb12f7fe640 1 -- 172.21.15.26:0/3513848856 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1300b99c0 con 0x7fb13815cba0 2023-10-14T11:14:51.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb12f7fe640 1 -- 172.21.15.26:0/3513848856 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1300b9d30 con 0x7fb13815cba0 2023-10-14T11:14:51.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb13d72a640 1 -- 172.21.15.26:0/3513848856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1380c7a00 con 0x7fb13815cba0 2023-10-14T11:14:51.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.467+0000 7fb13d72a640 1 -- 172.21.15.26:0/3513848856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1380ca240 con 0x7fb13815cba0 2023-10-14T11:14:51.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.471+0000 7fb13d72a640 1 -- 172.21.15.26:0/3513848856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb13804e170 con 0x7fb13815cba0 2023-10-14T11:14:51.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.471+0000 7fb12f7fe640 1 -- 172.21.15.26:0/3513848856 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb1300ad440 con 0x7fb13815cba0 2023-10-14T11:14:51.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.471+0000 7fb12f7fe640 1 --2- 172.21.15.26:0/3513848856 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb1180664a0 0x7fb118068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:51.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.471+0000 7fb12f7fe640 1 -- 172.21.15.26:0/3513848856 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fb13011f200 con 0x7fb13815cba0 2023-10-14T11:14:51.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.471+0000 7fb136ffd640 1 --2- 172.21.15.26:0/3513848856 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb1180664a0 0x7fb118068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:51.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.471+0000 7fb136ffd640 1 --2- 172.21.15.26:0/3513848856 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb1180664a0 0x7fb118068960 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb1280011f0 tx=0x7fb128009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:51.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.475+0000 7fb12f7fe640 1 -- 172.21.15.26:0/3513848856 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb1300ec5b0 con 0x7fb13815cba0 2023-10-14T11:14:51.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:51.667+0000 7fb13d72a640 1 -- 172.21.15.26:0/3513848856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb1380cdaa0 con 0x7fb13815cba0 2023-10-14T11:14:52.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.599+0000 7fb12f7fe640 1 -- 172.21.15.26:0/3513848856 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb1300efbd0 con 0x7fb13815cba0 2023-10-14T11:14:52.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.603+0000 7fb13d72a640 1 -- 172.21.15.26:0/3513848856 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb1180664a0 msgr2=0x7fb118068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:52.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.603+0000 7fb13d72a640 1 --2- 172.21.15.26:0/3513848856 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb1180664a0 0x7fb118068960 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb1280011f0 tx=0x7fb128009040 comp rx=0 tx=0).stop 2023-10-14T11:14:52.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.603+0000 7fb13d72a640 1 -- 172.21.15.26:0/3513848856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb13815cba0 msgr2=0x7fb1380ca740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:52.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.603+0000 7fb13d72a640 1 --2- 172.21.15.26:0/3513848856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb13815cba0 0x7fb1380ca740 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb13001a4f0 tx=0x7fb130019660 comp rx=0 tx=0).stop 2023-10-14T11:14:52.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.603+0000 7fb13d72a640 1 -- 172.21.15.26:0/3513848856 shutdown_connections 2023-10-14T11:14:52.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.603+0000 7fb13d72a640 1 --2- 172.21.15.26:0/3513848856 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fb1180664a0 0x7fb118068960 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:52.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.603+0000 7fb13d72a640 1 --2- 172.21.15.26:0/3513848856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb13815cba0 0x7fb1380ca740 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:52.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.603+0000 7fb13d72a640 1 --2- 172.21.15.26:0/3513848856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1380d0210 0x7fb1380c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:52.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.603+0000 7fb13d72a640 1 --2- 172.21.15.26:0/3513848856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1380b84e0 0x7fb1380cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:52.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.603+0000 7fb13d72a640 1 -- 172.21.15.26:0/3513848856 >> 172.21.15.26:0/3513848856 conn(0x7fb1380719c0 msgr2=0x7fb138072900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:52.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.603+0000 7fb13d72a640 1 -- 172.21.15.26:0/3513848856 shutdown_connections 2023-10-14T11:14:52.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.603+0000 7fb13d72a640 1 -- 172.21.15.26:0/3513848856 wait complete. 2023-10-14T11:14:52.633 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-14T11:14:52.634 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 allow_standby_replay false 2023-10-14T11:14:52.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f326f73e640 1 Processor -- start 2023-10-14T11:14:52.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f326f73e640 1 -- start start 2023-10-14T11:14:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f326f73e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32680b84e0 0x7f32680d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f326f73e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32680d1670 con 0x7f326815cba0 2023-10-14T11:14:52.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f326f73e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32680d1950 con 0x7f32680d0210 2023-10-14T11:14:52.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f326f73e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32680d1460 con 0x7f32680b84e0 2023-10-14T11:14:52.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f326d4da640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f326815cba0 0x7f32680cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48652/0 (socket says 172.21.15.26:48652) 2023-10-14T11:14:52.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f326d4da640 1 -- 172.21.15.26:0/2829769955 learned_addr learned my addr 172.21.15.26:0/2829769955 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:52.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f326dcdb640 1 --2- 172.21.15.26:0/2829769955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32680b84e0 0x7f32680d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:52.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f325ffff640 1 -- 172.21.15.26:0/2829769955 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328090269 0 0) 0x7f32680d1670 con 0x7f326815cba0 2023-10-14T11:14:52.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f325ffff640 1 -- 172.21.15.26:0/2829769955 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3254003530 con 0x7f326815cba0 2023-10-14T11:14:52.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f325ffff640 1 -- 172.21.15.26:0/2829769955 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 293178241 0 0) 0x7f3254003530 con 0x7f326815cba0 2023-10-14T11:14:52.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f325ffff640 1 -- 172.21.15.26:0/2829769955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32680b84e0 msgr2=0x7f32680d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:52.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f325ffff640 1 --2- 172.21.15.26:0/2829769955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32680b84e0 0x7f32680d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:52.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f325ffff640 1 -- 172.21.15.26:0/2829769955 >> v1:172.21.15.110:6789/0 conn(0x7f32680d0210 legacy=0x7f32680b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:52.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f325ffff640 1 -- 172.21.15.26:0/2829769955 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32680d1c30 con 0x7f326815cba0 2023-10-14T11:14:52.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f325ffff640 1 -- 172.21.15.26:0/2829769955 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f3264001680 con 0x7f326815cba0 2023-10-14T11:14:52.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f325ffff640 1 -- 172.21.15.26:0/2829769955 >> v1:172.21.15.26:6789/0 conn(0x7f326815cba0 legacy=0x7f32680cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:52.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f325ffff640 1 --2- 172.21.15.26:0/2829769955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32540039b0 0x7f3254003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:52.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f325ffff640 1 --2- 172.21.15.26:0/2829769955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32680b84e0 0x7f32540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:52.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f325ffff640 1 --2- 172.21.15.26:0/2829769955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3254004d10 0x7f3254005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:52.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f325ffff640 1 -- 172.21.15.26:0/2829769955 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32680d1460 con 0x7f32540039b0 2023-10-14T11:14:52.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f325ffff640 1 -- 172.21.15.26:0/2829769955 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325400ba40 con 0x7f3254004d10 2023-10-14T11:14:52.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.779+0000 7f325ffff640 1 -- 172.21.15.26:0/2829769955 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325400bc00 con 0x7f32680b84e0 2023-10-14T11:14:52.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.783+0000 7f326d4da640 1 --2- 172.21.15.26:0/2829769955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32540039b0 0x7f3254003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:52.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.783+0000 7f326ccd9640 1 --2- 172.21.15.26:0/2829769955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32680b84e0 0x7f32540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.783+0000 7f326dcdb640 1 --2- 172.21.15.26:0/2829769955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3254004d10 0x7f3254005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.783+0000 7f326d4da640 1 -- 172.21.15.26:0/2829769955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32680b84e0 msgr2=0x7f32540047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:52.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.783+0000 7f326d4da640 1 --2- 172.21.15.26:0/2829769955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32680b84e0 0x7f32540047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:52.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.783+0000 7f326d4da640 1 -- 172.21.15.26:0/2829769955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3254004d10 msgr2=0x7f3254005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:52.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.783+0000 7f326d4da640 1 --2- 172.21.15.26:0/2829769955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3254004d10 0x7f3254005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:52.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.783+0000 7f326d4da640 1 -- 172.21.15.26:0/2829769955 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3254003530 con 0x7f32540039b0 2023-10-14T11:14:52.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.783+0000 7f326d4da640 1 --2- 172.21.15.26:0/2829769955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32540039b0 0x7f3254003dd0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f326400c210 tx=0x7f326401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb8a42ee764473f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:52.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.783+0000 7f325ffff640 1 -- 172.21.15.26:0/2829769955 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3264005ae0 con 0x7f32540039b0 2023-10-14T11:14:52.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.783+0000 7f325ffff640 1 -- 172.21.15.26:0/2829769955 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3264005c40 con 0x7f32540039b0 2023-10-14T11:14:52.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.783+0000 7f325ffff640 1 -- 172.21.15.26:0/2829769955 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32640a5810 con 0x7f32540039b0 2023-10-14T11:14:52.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326f73e640 1 -- 172.21.15.26:0/2829769955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32540039b0 msgr2=0x7f3254003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:52.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326f73e640 1 --2- 172.21.15.26:0/2829769955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32540039b0 0x7f3254003dd0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f326400c210 tx=0x7f326401cc20 comp rx=0 tx=0).stop 2023-10-14T11:14:52.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326dcdb640 1 -- 172.21.15.26:0/2829769955 reap_dead start 2023-10-14T11:14:52.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326f73e640 1 -- 172.21.15.26:0/2829769955 shutdown_connections 2023-10-14T11:14:52.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326f73e640 1 -- 172.21.15.26:0/2829769955 >> 172.21.15.26:0/2829769955 conn(0x7f32680719c0 msgr2=0x7f3268071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:52.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326f73e640 1 -- 172.21.15.26:0/2829769955 shutdown_connections 2023-10-14T11:14:52.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326f73e640 1 -- 172.21.15.26:0/2829769955 wait complete. 2023-10-14T11:14:52.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326f73e640 1 Processor -- start 2023-10-14T11:14:52.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326f73e640 1 -- start start 2023-10-14T11:14:52.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326f73e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32540039b0 0x7f32680c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:52.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326f73e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32680c5510 0x7f3268149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:52.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326f73e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32681543c0 0x7f3268154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:52.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326f73e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32680c5c80 con 0x7f32540039b0 2023-10-14T11:14:52.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326f73e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32680c8860 con 0x7f32681543c0 2023-10-14T11:14:52.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326f73e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3268154d90 con 0x7f32680c5510 2023-10-14T11:14:52.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326d4da640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32540039b0 0x7f32680c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:52.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326d4da640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32540039b0 0x7f32680c64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54388/0 (socket says 172.21.15.26:54388) 2023-10-14T11:14:52.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326d4da640 1 -- 172.21.15.26:0/1113117682 learned_addr learned my addr 172.21.15.26:0/1113117682 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:52.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326ccd9640 1 --2- 172.21.15.26:0/1113117682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32680c5510 0x7f3268149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:52.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326d4da640 1 -- 172.21.15.26:0/1113117682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32680c5510 msgr2=0x7f3268149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:52.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326dcdb640 1 --2- 172.21.15.26:0/1113117682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32681543c0 0x7f3268154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:52.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326d4da640 1 --2- 172.21.15.26:0/1113117682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32680c5510 0x7f3268149cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:52.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326d4da640 1 -- 172.21.15.26:0/1113117682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32681543c0 msgr2=0x7f3268154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:52.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326d4da640 1 --2- 172.21.15.26:0/1113117682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32681543c0 0x7f3268154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:52.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326d4da640 1 -- 172.21.15.26:0/1113117682 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32680c9530 con 0x7f32540039b0 2023-10-14T11:14:52.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326ccd9640 1 --2- 172.21.15.26:0/1113117682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32680c5510 0x7f3268149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:52.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.787+0000 7f326dcdb640 1 --2- 172.21.15.26:0/1113117682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32681543c0 0x7f3268154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:52.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.791+0000 7f326d4da640 1 --2- 172.21.15.26:0/1113117682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32540039b0 0x7f32680c64b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3264000c10 tx=0x7f3254005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:52.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.791+0000 7f325dffb640 1 -- 172.21.15.26:0/1113117682 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32640b4070 con 0x7f32540039b0 2023-10-14T11:14:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.791+0000 7f325dffb640 1 -- 172.21.15.26:0/1113117682 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3264005db0 con 0x7f32540039b0 2023-10-14T11:14:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.791+0000 7f325dffb640 1 -- 172.21.15.26:0/1113117682 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3264001680 con 0x7f32540039b0 2023-10-14T11:14:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.791+0000 7f326f73e640 1 -- 172.21.15.26:0/1113117682 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32680c90a0 con 0x7f32540039b0 2023-10-14T11:14:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.791+0000 7f326f73e640 1 -- 172.21.15.26:0/1113117682 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32680c8a50 con 0x7f32540039b0 2023-10-14T11:14:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.791+0000 7f326f73e640 1 -- 172.21.15.26:0/1113117682 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f326804e170 con 0x7f32540039b0 2023-10-14T11:14:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.791+0000 7f325dffb640 1 -- 172.21.15.26:0/1113117682 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f32640a5810 con 0x7f32540039b0 2023-10-14T11:14:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.791+0000 7f325dffb640 1 --2- 172.21.15.26:0/1113117682 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f324c0664a0 0x7f324c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.791+0000 7f325dffb640 1 -- 172.21.15.26:0/1113117682 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f326411d760 con 0x7f32540039b0 2023-10-14T11:14:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.795+0000 7f326ccd9640 1 --2- 172.21.15.26:0/1113117682 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f324c0664a0 0x7f324c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.795+0000 7f326ccd9640 1 --2- 172.21.15.26:0/1113117682 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f324c0664a0 0x7f324c068960 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f32680c52d0 tx=0x7f3258009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:52.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.799+0000 7f325dffb640 1 -- 172.21.15.26:0/1113117682 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f32640eaa70 con 0x7f32540039b0 2023-10-14T11:14:52.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:52.991+0000 7f326f73e640 1 -- 172.21.15.26:0/1113117682 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f32680c9530 con 0x7f32540039b0 2023-10-14T11:14:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:53.851+0000 7f325dffb640 1 -- 172.21.15.26:0/1113117682 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"}]=0 v26) v1 ==== 127+0+0 (secure 0 0 0) 0x7f32680c9530 con 0x7f32540039b0 2023-10-14T11:14:53.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:53.851+0000 7f326f73e640 1 -- 172.21.15.26:0/1113117682 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f324c0664a0 msgr2=0x7f324c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:53.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:53.851+0000 7f326f73e640 1 --2- 172.21.15.26:0/1113117682 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f324c0664a0 0x7f324c068960 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f32680c52d0 tx=0x7f3258009040 comp rx=0 tx=0).stop 2023-10-14T11:14:53.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:53.851+0000 7f326f73e640 1 -- 172.21.15.26:0/1113117682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32540039b0 msgr2=0x7f32680c64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:53.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:53.851+0000 7f326f73e640 1 --2- 172.21.15.26:0/1113117682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32540039b0 0x7f32680c64b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3264000c10 tx=0x7f3254005800 comp rx=0 tx=0).stop 2023-10-14T11:14:53.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:53.851+0000 7f326f73e640 1 -- 172.21.15.26:0/1113117682 shutdown_connections 2023-10-14T11:14:53.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:53.851+0000 7f326f73e640 1 --2- 172.21.15.26:0/1113117682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32681543c0 0x7f3268154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:53.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:53.851+0000 7f326f73e640 1 --2- 172.21.15.26:0/1113117682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32680c5510 0x7f3268149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:53.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:53.851+0000 7f326f73e640 1 --2- 172.21.15.26:0/1113117682 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f324c0664a0 0x7f324c068960 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:53.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:53.851+0000 7f326f73e640 1 --2- 172.21.15.26:0/1113117682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32540039b0 0x7f32680c64b0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:53.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:53.851+0000 7f326f73e640 1 -- 172.21.15.26:0/1113117682 >> 172.21.15.26:0/1113117682 conn(0x7f32680719c0 msgr2=0x7f32680cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:53.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:53.851+0000 7f326f73e640 1 -- 172.21.15.26:0/1113117682 shutdown_connections 2023-10-14T11:14:53.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:53.851+0000 7f326f73e640 1 -- 172.21.15.26:0/1113117682 wait complete. 2023-10-14T11:14:53.883 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'testcephfs1' 2023-10-14T11:14:53.884 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:14:54.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5613e17640 1 Processor -- start 2023-10-14T11:14:54.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5613e17640 1 -- start start 2023-10-14T11:14:54.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5613e17640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f560c070c40 0x7f560c15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:54.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5613e17640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560c15be60 con 0x7f560c0b07f0 2023-10-14T11:14:54.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5613e17640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560c15c1f0 con 0x7f560c0b4020 2023-10-14T11:14:54.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5613e17640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560c15b3b0 con 0x7f560c070c40 2023-10-14T11:14:54.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f56123b4640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f560c0b07f0 0x7f560c164490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48658/0 (socket says 172.21.15.26:48658) 2023-10-14T11:14:54.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f56123b4640 1 -- 172.21.15.26:0/755727953 learned_addr learned my addr 172.21.15.26:0/755727953 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:54.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5611bb3640 1 --2- 172.21.15.26:0/755727953 >> v2:172.21.15.110:3300/0 conn(0x7f560c070c40 0x7f560c15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:54.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5610bb1640 1 -- 172.21.15.26:0/755727953 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2832196301 0 0) 0x7f560c15be60 con 0x7f560c0b07f0 2023-10-14T11:14:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5610bb1640 1 -- 172.21.15.26:0/755727953 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55f8003530 con 0x7f560c0b07f0 2023-10-14T11:14:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5610bb1640 1 -- 172.21.15.26:0/755727953 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2373039912 0 0) 0x7f55f8003530 con 0x7f560c0b07f0 2023-10-14T11:14:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5610bb1640 1 -- 172.21.15.26:0/755727953 >> v2:172.21.15.110:3300/0 conn(0x7f560c070c40 msgr2=0x7f560c15ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5610bb1640 1 --2- 172.21.15.26:0/755727953 >> v2:172.21.15.110:3300/0 conn(0x7f560c070c40 0x7f560c15ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5610bb1640 1 -- 172.21.15.26:0/755727953 >> v1:172.21.15.110:6789/0 conn(0x7f560c0b4020 legacy=0x7f560c0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:54.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5610bb1640 1 -- 172.21.15.26:0/755727953 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c071020 con 0x7f560c0b07f0 2023-10-14T11:14:54.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5610bb1640 1 -- 172.21.15.26:0/755727953 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f5604001a00 con 0x7f560c0b07f0 2023-10-14T11:14:54.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5610bb1640 1 -- 172.21.15.26:0/755727953 >> v1:172.21.15.26:6789/0 conn(0x7f560c0b07f0 legacy=0x7f560c164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:54.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5610bb1640 1 --2- 172.21.15.26:0/755727953 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55f8003980 0x7f55f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:54.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5610bb1640 1 --2- 172.21.15.26:0/755727953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55f80047d0 0x7f55f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:54.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5610bb1640 1 --2- 172.21.15.26:0/755727953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55f8005190 0x7f55f800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:54.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5610bb1640 1 -- 172.21.15.26:0/755727953 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c15b3b0 con 0x7f55f80047d0 2023-10-14T11:14:54.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5610bb1640 1 -- 172.21.15.26:0/755727953 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f800c130 con 0x7f55f8005190 2023-10-14T11:14:54.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5610bb1640 1 -- 172.21.15.26:0/755727953 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f800c2f0 con 0x7f55f8003980 2023-10-14T11:14:54.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f56113b2640 1 --2- 172.21.15.26:0/755727953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55f80047d0 0x7f55f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:54.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f5611bb3640 1 --2- 172.21.15.26:0/755727953 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55f8003980 0x7f55f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:54.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f56123b4640 1 --2- 172.21.15.26:0/755727953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55f8005190 0x7f55f800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:54.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f56113b2640 1 -- 172.21.15.26:0/755727953 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55f8003980 msgr2=0x7f55f8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:54.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f56113b2640 1 --2- 172.21.15.26:0/755727953 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55f8003980 0x7f55f8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f56113b2640 1 -- 172.21.15.26:0/755727953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55f8005190 msgr2=0x7f55f800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:54.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f56113b2640 1 --2- 172.21.15.26:0/755727953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55f8005190 0x7f55f800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.027+0000 7f56113b2640 1 -- 172.21.15.26:0/755727953 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f8003530 con 0x7f55f80047d0 2023-10-14T11:14:54.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.031+0000 7f56123b4640 1 --2- 172.21.15.26:0/755727953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55f8005190 0x7f55f800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:54.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.031+0000 7f56123b4640 1 -- 172.21.15.26:0/755727953 reap_dead start 2023-10-14T11:14:54.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.031+0000 7f56113b2640 1 --2- 172.21.15.26:0/755727953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55f80047d0 0x7f55f8004c50 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f55fc001780 tx=0x7f55fc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e082cad9539f6627 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:54.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.031+0000 7f5610bb1640 1 -- 172.21.15.26:0/755727953 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc0a4ea0 con 0x7f55f80047d0 2023-10-14T11:14:54.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.031+0000 7f5610bb1640 1 -- 172.21.15.26:0/755727953 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55fc0a7050 con 0x7f55f80047d0 2023-10-14T11:14:54.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.031+0000 7f5610bb1640 1 -- 172.21.15.26:0/755727953 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc003600 con 0x7f55f80047d0 2023-10-14T11:14:54.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.031+0000 7f5613e17640 1 -- 172.21.15.26:0/755727953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55f80047d0 msgr2=0x7f55f8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:54.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.031+0000 7f5613e17640 1 --2- 172.21.15.26:0/755727953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55f80047d0 0x7f55f8004c50 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f55fc001780 tx=0x7f55fc01c3e0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.031+0000 7f5613e17640 1 -- 172.21.15.26:0/755727953 shutdown_connections 2023-10-14T11:14:54.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.031+0000 7f5613e17640 1 --2- 172.21.15.26:0/755727953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55f80047d0 0x7f55f8004c50 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.031+0000 7f5613e17640 1 -- 172.21.15.26:0/755727953 >> 172.21.15.26:0/755727953 conn(0x7f560c06c190 msgr2=0x7f560c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:54.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.031+0000 7f5613e17640 1 -- 172.21.15.26:0/755727953 shutdown_connections 2023-10-14T11:14:54.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.031+0000 7f5613e17640 1 -- 172.21.15.26:0/755727953 wait complete. 2023-10-14T11:14:54.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f5613e17640 1 Processor -- start 2023-10-14T11:14:54.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f5613e17640 1 -- start start 2023-10-14T11:14:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f5613e17640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55f80047d0 0x7f560c152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f5613e17640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f560c06c570 0x7f560c06c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f5613e17640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560c1e8890 0x7f560c1e8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f5613e17640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c06cf30 con 0x7f560c1e8890 2023-10-14T11:14:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f5613e17640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c1f5860 con 0x7f560c06c570 2023-10-14T11:14:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f5613e17640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560c1e9570 con 0x7f55f80047d0 2023-10-14T11:14:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f56123b4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560c1e8890 0x7f560c1e8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f56123b4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560c1e8890 0x7f560c1e8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54414/0 (socket says 172.21.15.26:54414) 2023-10-14T11:14:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f56123b4640 1 -- 172.21.15.26:0/3426285982 learned_addr learned my addr 172.21.15.26:0/3426285982 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f56113b2640 1 --2- 172.21.15.26:0/3426285982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f560c06c570 0x7f560c06c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f5611bb3640 1 --2- 172.21.15.26:0/3426285982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55f80047d0 0x7f560c152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f56123b4640 1 -- 172.21.15.26:0/3426285982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55f80047d0 msgr2=0x7f560c152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f56123b4640 1 --2- 172.21.15.26:0/3426285982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55f80047d0 0x7f560c152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f56123b4640 1 -- 172.21.15.26:0/3426285982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f560c06c570 msgr2=0x7f560c06c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f56123b4640 1 --2- 172.21.15.26:0/3426285982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f560c06c570 0x7f560c06c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f56123b4640 1 -- 172.21.15.26:0/3426285982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c1e9850 con 0x7f560c1e8890 2023-10-14T11:14:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f56113b2640 1 --2- 172.21.15.26:0/3426285982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f560c06c570 0x7f560c06c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f56123b4640 1 --2- 172.21.15.26:0/3426285982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560c1e8890 0x7f560c1e8d10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f560c070100 tx=0x7f5604007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f56027fc640 1 -- 172.21.15.26:0/3426285982 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560400e960 con 0x7f560c1e8890 2023-10-14T11:14:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f56027fc640 1 -- 172.21.15.26:0/3426285982 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560400eac0 con 0x7f560c1e8890 2023-10-14T11:14:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f56027fc640 1 -- 172.21.15.26:0/3426285982 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560400ee30 con 0x7f560c1e8890 2023-10-14T11:14:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f5613e17640 1 -- 172.21.15.26:0/3426285982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560c1e9b30 con 0x7f560c1e8890 2023-10-14T11:14:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.035+0000 7f5613e17640 1 -- 172.21.15.26:0/3426285982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560c153200 con 0x7f560c1e8890 2023-10-14T11:14:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.039+0000 7f5613e17640 1 -- 172.21.15.26:0/3426285982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560c1e9fe0 con 0x7f560c1e8890 2023-10-14T11:14:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.039+0000 7f56027fc640 1 -- 172.21.15.26:0/3426285982 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f560401d460 con 0x7f560c1e8890 2023-10-14T11:14:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.039+0000 7f56027fc640 1 --2- 172.21.15.26:0/3426285982 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f55f00664d0 0x7f55f0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:54.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.039+0000 7f56027fc640 1 -- 172.21.15.26:0/3426285982 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f56040842d0 con 0x7f560c1e8890 2023-10-14T11:14:54.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.039+0000 7f5611bb3640 1 --2- 172.21.15.26:0/3426285982 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f55f00664d0 0x7f55f0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:54.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.039+0000 7f5611bb3640 1 --2- 172.21.15.26:0/3426285982 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f55f00664d0 0x7f55f0068990 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f560c1eb170 tx=0x7f5608009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:54.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.043+0000 7f56027fc640 1 -- 172.21.15.26:0/3426285982 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f56040515e0 con 0x7f560c1e8890 2023-10-14T11:14:54.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.231+0000 7f5613e17640 1 -- 172.21.15.26:0/3426285982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f560c074010 con 0x7f560c1e8890 2023-10-14T11:14:54.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.235+0000 7f56027fc640 1 -- 172.21.15.26:0/3426285982 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f5604054c00 con 0x7f560c1e8890 2023-10-14T11:14:54.241 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:54.241 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/633779909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":633779909},{"type":"v1","addr":"172.21.15.110:6834","nonce":633779909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5995,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3833036081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3833036081},{"type":"v1","addr":"172.21.15.110:6835","nonce":3833036081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":6144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2594736858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2594736858},{"type":"v1","addr":"172.21.15.26:6835","nonce":2594736858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:14:49.973814+0000","modified":"2023-10-14T11:14:52.995854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6147},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6147":{"gid":6147,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6837/2641279888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2641279888},{"type":"v1","addr":"172.21.15.26:6837","nonce":2641279888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-14T11:14:54.241 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 26 2023-10-14T11:14:54.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.235+0000 7f5613e17640 1 -- 172.21.15.26:0/3426285982 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f55f00664d0 msgr2=0x7f55f0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:54.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.235+0000 7f5613e17640 1 --2- 172.21.15.26:0/3426285982 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f55f00664d0 0x7f55f0068990 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f560c1eb170 tx=0x7f5608009190 comp rx=0 tx=0).stop 2023-10-14T11:14:54.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.235+0000 7f5613e17640 1 -- 172.21.15.26:0/3426285982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560c1e8890 msgr2=0x7f560c1e8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:54.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.235+0000 7f5613e17640 1 --2- 172.21.15.26:0/3426285982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560c1e8890 0x7f560c1e8d10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f560c070100 tx=0x7f5604007b00 comp rx=0 tx=0).stop 2023-10-14T11:14:54.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.235+0000 7f5613e17640 1 -- 172.21.15.26:0/3426285982 shutdown_connections 2023-10-14T11:14:54.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.235+0000 7f5613e17640 1 --2- 172.21.15.26:0/3426285982 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f55f00664d0 0x7f55f0068990 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.235+0000 7f5613e17640 1 --2- 172.21.15.26:0/3426285982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560c1e8890 0x7f560c1e8d10 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.235+0000 7f5613e17640 1 --2- 172.21.15.26:0/3426285982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f560c06c570 0x7f560c06c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.235+0000 7f5613e17640 1 --2- 172.21.15.26:0/3426285982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55f80047d0 0x7f560c152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.235+0000 7f5613e17640 1 -- 172.21.15.26:0/3426285982 >> 172.21.15.26:0/3426285982 conn(0x7f560c06c190 msgr2=0x7f560c0af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:54.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.235+0000 7f5613e17640 1 -- 172.21.15.26:0/3426285982 shutdown_connections 2023-10-14T11:14:54.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.235+0000 7f5613e17640 1 -- 172.21.15.26:0/3426285982 wait complete. 2023-10-14T11:14:54.261 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:14:54.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.399+0000 7fd13c468640 1 Processor -- start 2023-10-14T11:14:54.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.399+0000 7fd13c468640 1 -- start start 2023-10-14T11:14:54.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.399+0000 7fd13c468640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd1340c8cb0 0x7fd1340cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:54.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.399+0000 7fd13c468640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1340723d0 con 0x7fd134159ba0 2023-10-14T11:14:54.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.399+0000 7fd13c468640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1340717c0 con 0x7fd1341597c0 2023-10-14T11:14:54.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.399+0000 7fd13c468640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd134071aa0 con 0x7fd1340c8cb0 2023-10-14T11:14:54.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.399+0000 7fd139a03640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd134159ba0 0x7fd1340cae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48672/0 (socket says 172.21.15.26:48672) 2023-10-14T11:14:54.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.399+0000 7fd139a03640 1 -- 172.21.15.26:0/1401139245 learned_addr learned my addr 172.21.15.26:0/1401139245 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:54.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.399+0000 7fd13aa05640 1 --2- 172.21.15.26:0/1401139245 >> v2:172.21.15.110:3300/0 conn(0x7fd1340c8cb0 0x7fd1340cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:54.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.399+0000 7fd139202640 1 -- 172.21.15.26:0/1401139245 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383377277 0 0) 0x7fd1340723d0 con 0x7fd134159ba0 2023-10-14T11:14:54.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.399+0000 7fd139202640 1 -- 172.21.15.26:0/1401139245 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd120005740 con 0x7fd134159ba0 2023-10-14T11:14:54.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.399+0000 7fd139202640 1 -- 172.21.15.26:0/1401139245 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945930753 0 0) 0x7fd1340717c0 con 0x7fd1341597c0 2023-10-14T11:14:54.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.399+0000 7fd139202640 1 -- 172.21.15.26:0/1401139245 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1340723d0 con 0x7fd1341597c0 2023-10-14T11:14:54.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.399+0000 7fd13aa05640 1 -- 172.21.15.26:0/1401139245 >> v1:172.21.15.110:6789/0 conn(0x7fd1341597c0 legacy=0x7fd1340ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:54.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.399+0000 7fd13aa05640 1 -- 172.21.15.26:0/1401139245 >> v1:172.21.15.26:6789/0 conn(0x7fd134159ba0 legacy=0x7fd1340cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:54.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.399+0000 7fd13aa05640 1 -- 172.21.15.26:0/1401139245 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd134071d80 con 0x7fd1340c8cb0 2023-10-14T11:14:54.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.403+0000 7fd13aa05640 1 --2- 172.21.15.26:0/1401139245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1340c8cb0 0x7fd1340cb520 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009d90 tx=0x7fd12c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dd494f027abe856 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:54.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.403+0000 7fd139202640 1 -- 172.21.15.26:0/1401139245 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c0a58b0 con 0x7fd1340c8cb0 2023-10-14T11:14:54.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.403+0000 7fd139202640 1 -- 172.21.15.26:0/1401139245 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c0a5a10 con 0x7fd1340c8cb0 2023-10-14T11:14:54.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.403+0000 7fd139202640 1 -- 172.21.15.26:0/1401139245 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c0a5da0 con 0x7fd1340c8cb0 2023-10-14T11:14:54.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.403+0000 7fd13c468640 1 -- 172.21.15.26:0/1401139245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1340c8cb0 msgr2=0x7fd1340cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:54.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.403+0000 7fd13c468640 1 --2- 172.21.15.26:0/1401139245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1340c8cb0 0x7fd1340cb520 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009d90 tx=0x7fd12c01c950 comp rx=0 tx=0).stop 2023-10-14T11:14:54.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.403+0000 7fd13c468640 1 -- 172.21.15.26:0/1401139245 shutdown_connections 2023-10-14T11:14:54.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.403+0000 7fd13c468640 1 --2- 172.21.15.26:0/1401139245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1340c8cb0 0x7fd1340cb520 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.403+0000 7fd13c468640 1 -- 172.21.15.26:0/1401139245 >> 172.21.15.26:0/1401139245 conn(0x7fd13406c190 msgr2=0x7fd13406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:54.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.403+0000 7fd13c468640 1 -- 172.21.15.26:0/1401139245 shutdown_connections 2023-10-14T11:14:54.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.403+0000 7fd13c468640 1 -- 172.21.15.26:0/1401139245 wait complete. 2023-10-14T11:14:54.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd13c468640 1 Processor -- start 2023-10-14T11:14:54.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd13c468640 1 -- start start 2023-10-14T11:14:54.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd13c468640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1340c8cb0 0x7fd134155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:54.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd13c468640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1341597c0 0x7fd134154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:54.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd13c468640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd134159ba0 0x7fd1341f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:54.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd13c468640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd134155d40 con 0x7fd134159ba0 2023-10-14T11:14:54.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd13c468640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1341f44d0 con 0x7fd1341597c0 2023-10-14T11:14:54.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd13c468640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13414d270 con 0x7fd1340c8cb0 2023-10-14T11:14:54.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd13aa05640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd134159ba0 0x7fd1341f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:54.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd13aa05640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd134159ba0 0x7fd1341f4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54418/0 (socket says 172.21.15.26:54418) 2023-10-14T11:14:54.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd13aa05640 1 -- 172.21.15.26:0/267788359 learned_addr learned my addr 172.21.15.26:0/267788359 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:54.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd13a204640 1 --2- 172.21.15.26:0/267788359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1340c8cb0 0x7fd134155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:54.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd139a03640 1 --2- 172.21.15.26:0/267788359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1341597c0 0x7fd134154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:54.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd13aa05640 1 -- 172.21.15.26:0/267788359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1340c8cb0 msgr2=0x7fd134155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:54.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd13aa05640 1 --2- 172.21.15.26:0/267788359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1340c8cb0 0x7fd134155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd13aa05640 1 -- 172.21.15.26:0/267788359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1341597c0 msgr2=0x7fd134154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:54.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd13aa05640 1 --2- 172.21.15.26:0/267788359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1341597c0 0x7fd134154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd13aa05640 1 -- 172.21.15.26:0/267788359 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c009a70 con 0x7fd134159ba0 2023-10-14T11:14:54.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd13aa05640 1 --2- 172.21.15.26:0/267788359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd134159ba0 0x7fd1341f4960 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0b0040 tx=0x7fd12c0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:54.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd12affd640 1 -- 172.21.15.26:0/267788359 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c0b9650 con 0x7fd134159ba0 2023-10-14T11:14:54.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd12affd640 1 -- 172.21.15.26:0/267788359 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c0b97b0 con 0x7fd134159ba0 2023-10-14T11:14:54.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd12affd640 1 -- 172.21.15.26:0/267788359 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c0b9b40 con 0x7fd134159ba0 2023-10-14T11:14:54.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd13c468640 1 -- 172.21.15.26:0/267788359 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13415cdf0 con 0x7fd134159ba0 2023-10-14T11:14:54.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.407+0000 7fd13c468640 1 -- 172.21.15.26:0/267788359 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13414ccb0 con 0x7fd134159ba0 2023-10-14T11:14:54.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.411+0000 7fd13c468640 1 -- 172.21.15.26:0/267788359 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1341f42a0 con 0x7fd134159ba0 2023-10-14T11:14:54.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.411+0000 7fd12affd640 1 -- 172.21.15.26:0/267788359 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd12c0b9ca0 con 0x7fd134159ba0 2023-10-14T11:14:54.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.411+0000 7fd12affd640 1 --2- 172.21.15.26:0/267788359 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd1180664a0 0x7fd118068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:54.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.411+0000 7fd12affd640 1 -- 172.21.15.26:0/267788359 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fd12c11ef80 con 0x7fd134159ba0 2023-10-14T11:14:54.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.411+0000 7fd13a204640 1 --2- 172.21.15.26:0/267788359 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd1180664a0 0x7fd118068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:54.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.411+0000 7fd13a204640 1 --2- 172.21.15.26:0/267788359 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd1180664a0 0x7fd118068960 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd1300011f0 tx=0x7fd130009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:54.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.415+0000 7fd12affd640 1 -- 172.21.15.26:0/267788359 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd12c150090 con 0x7fd134159ba0 2023-10-14T11:14:54.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.571+0000 7fd13c468640 1 -- 172.21.15.26:0/267788359 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1341f4660 con 0x7fd134159ba0 2023-10-14T11:14:54.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.571+0000 7fd12affd640 1 -- 172.21.15.26:0/267788359 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16790 (secure 0 0 0) 0x7fd1341f42a0 con 0x7fd134159ba0 2023-10-14T11:14:54.580 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:54.580 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":55,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:14:51.591742+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:14:47.752880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:14:48.971211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:14:54.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.575+0000 7fd13c468640 1 -- 172.21.15.26:0/267788359 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd1180664a0 msgr2=0x7fd118068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:54.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.575+0000 7fd13c468640 1 --2- 172.21.15.26:0/267788359 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd1180664a0 0x7fd118068960 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd1300011f0 tx=0x7fd130009040 comp rx=0 tx=0).stop 2023-10-14T11:14:54.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.575+0000 7fd13c468640 1 -- 172.21.15.26:0/267788359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd134159ba0 msgr2=0x7fd1341f4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:54.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.575+0000 7fd13c468640 1 --2- 172.21.15.26:0/267788359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd134159ba0 0x7fd1341f4960 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0b0040 tx=0x7fd12c0196f0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.575+0000 7fd13c468640 1 -- 172.21.15.26:0/267788359 shutdown_connections 2023-10-14T11:14:54.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.575+0000 7fd13c468640 1 --2- 172.21.15.26:0/267788359 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd1180664a0 0x7fd118068960 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.575+0000 7fd13c468640 1 --2- 172.21.15.26:0/267788359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd134159ba0 0x7fd1341f4960 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.575+0000 7fd13c468640 1 --2- 172.21.15.26:0/267788359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1341597c0 0x7fd134154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.575+0000 7fd13c468640 1 --2- 172.21.15.26:0/267788359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1340c8cb0 0x7fd134155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.575+0000 7fd13c468640 1 -- 172.21.15.26:0/267788359 >> 172.21.15.26:0/267788359 conn(0x7fd13406c190 msgr2=0x7fd1340ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:54.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.575+0000 7fd13c468640 1 -- 172.21.15.26:0/267788359 shutdown_connections 2023-10-14T11:14:54.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.575+0000 7fd13c468640 1 -- 172.21.15.26:0/267788359 wait complete. 2023-10-14T11:14:54.602 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T11:14:54.603 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:14:54.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.739+0000 7f34fdcd6640 1 Processor -- start 2023-10-14T11:14:54.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.739+0000 7f34fdcd6640 1 -- start start 2023-10-14T11:14:54.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.739+0000 7f34fdcd6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34f815ce30 0x7f34f80cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:54.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.739+0000 7f34fdcd6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f34f80b21c0 0x7f34f80b2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:54.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.739+0000 7f34fdcd6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f80b2b50 con 0x7f34f815ca50 2023-10-14T11:14:54.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.739+0000 7f34fdcd6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f81607e0 con 0x7f34f80b21c0 2023-10-14T11:14:54.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.739+0000 7f34fdcd6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f80cf060 con 0x7f34f815ce30 2023-10-14T11:14:54.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.739+0000 7f34f7fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f34f80b21c0 0x7f34f80b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:54.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.739+0000 7f34f7fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f34f80b21c0 0x7f34f80b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54424/0 (socket says 172.21.15.26:54424) 2023-10-14T11:14:54.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.739+0000 7f34f77fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f34f815ca50 0x7f34f806c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48680/0 (socket says 172.21.15.26:48680) 2023-10-14T11:14:54.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.739+0000 7f34f7fff640 1 -- 172.21.15.26:0/1838848329 learned_addr learned my addr 172.21.15.26:0/1838848329 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:54.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.739+0000 7f34f6ffd640 1 --2- 172.21.15.26:0/1838848329 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34f815ce30 0x7f34f80cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:54.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.739+0000 7f34f7fff640 1 -- 172.21.15.26:0/1838848329 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34f815ce30 msgr2=0x7f34f80cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:54.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.739+0000 7f34f7fff640 1 --2- 172.21.15.26:0/1838848329 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34f815ce30 0x7f34f80cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.739+0000 7f34f67fc640 1 -- 172.21.15.26:0/1838848329 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245357432 0 0) 0x7f34e8001120 con 0x7f34f815ca50 2023-10-14T11:14:54.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.739+0000 7f34f7fff640 1 -- 172.21.15.26:0/1838848329 >> v1:172.21.15.26:6789/0 conn(0x7f34f815ca50 legacy=0x7f34f806c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:54.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.739+0000 7f34f7fff640 1 -- 172.21.15.26:0/1838848329 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f8070210 con 0x7f34f80b21c0 2023-10-14T11:14:54.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.743+0000 7f34f7fff640 1 --2- 172.21.15.26:0/1838848329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34f80b21c0 0x7f34f80b2610 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009e50 tx=0x7f34f001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83aa65adc14b7f40 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:54.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.743+0000 7f34f67fc640 1 -- 172.21.15.26:0/1838848329 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f00a58e0 con 0x7f34f80b21c0 2023-10-14T11:14:54.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.743+0000 7f34f67fc640 1 -- 172.21.15.26:0/1838848329 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f00a5a40 con 0x7f34f80b21c0 2023-10-14T11:14:54.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.743+0000 7f34f67fc640 1 -- 172.21.15.26:0/1838848329 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f00a5dd0 con 0x7f34f80b21c0 2023-10-14T11:14:54.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.743+0000 7f34fdcd6640 1 -- 172.21.15.26:0/1838848329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34f80b21c0 msgr2=0x7f34f80b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:54.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.743+0000 7f34fdcd6640 1 --2- 172.21.15.26:0/1838848329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34f80b21c0 0x7f34f80b2610 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009e50 tx=0x7f34f001ca10 comp rx=0 tx=0).stop 2023-10-14T11:14:54.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.743+0000 7f34fdcd6640 1 -- 172.21.15.26:0/1838848329 shutdown_connections 2023-10-14T11:14:54.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.743+0000 7f34fdcd6640 1 --2- 172.21.15.26:0/1838848329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34f80b21c0 0x7f34f80b2610 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.743+0000 7f34fdcd6640 1 --2- 172.21.15.26:0/1838848329 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34f815ce30 0x7f34f80cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.743+0000 7f34fdcd6640 1 -- 172.21.15.26:0/1838848329 >> 172.21.15.26:0/1838848329 conn(0x7f34f80cd1c0 msgr2=0x7f34f80cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:54.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.743+0000 7f34fdcd6640 1 -- 172.21.15.26:0/1838848329 shutdown_connections 2023-10-14T11:14:54.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.743+0000 7f34fdcd6640 1 -- 172.21.15.26:0/1838848329 wait complete. 2023-10-14T11:14:54.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.747+0000 7f34fdcd6640 1 Processor -- start 2023-10-14T11:14:54.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.747+0000 7f34fdcd6640 1 -- start start 2023-10-14T11:14:54.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.747+0000 7f34fdcd6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34f80b21c0 0x7f34f80b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:54.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.747+0000 7f34fdcd6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34f815ca50 0x7f34f80c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:54.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.747+0000 7f34fdcd6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34f815ce30 0x7f34f80c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:54.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.747+0000 7f34fdcd6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f80c5260 con 0x7f34f80b21c0 2023-10-14T11:14:54.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.747+0000 7f34fdcd6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f80c56f0 con 0x7f34f815ca50 2023-10-14T11:14:54.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.747+0000 7f34fdcd6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f80c4650 con 0x7f34f815ce30 2023-10-14T11:14:54.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.747+0000 7f34f77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34f80b21c0 0x7f34f80b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:54.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.747+0000 7f34f77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34f80b21c0 0x7f34f80b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54430/0 (socket says 172.21.15.26:54430) 2023-10-14T11:14:54.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.747+0000 7f34f77fe640 1 -- 172.21.15.26:0/860870460 learned_addr learned my addr 172.21.15.26:0/860870460 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:54.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.747+0000 7f34f6ffd640 1 --2- 172.21.15.26:0/860870460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34f815ca50 0x7f34f80c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:54.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.747+0000 7f34f7fff640 1 --2- 172.21.15.26:0/860870460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34f815ce30 0x7f34f80c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:54.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.747+0000 7f34f77fe640 1 -- 172.21.15.26:0/860870460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34f815ce30 msgr2=0x7f34f80c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:54.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.747+0000 7f34f77fe640 1 --2- 172.21.15.26:0/860870460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34f815ce30 0x7f34f80c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.747+0000 7f34f77fe640 1 -- 172.21.15.26:0/860870460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34f815ca50 msgr2=0x7f34f80c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:54.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.747+0000 7f34f77fe640 1 --2- 172.21.15.26:0/860870460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34f815ca50 0x7f34f80c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.747+0000 7f34f77fe640 1 -- 172.21.15.26:0/860870460 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f0009b30 con 0x7f34f80b21c0 2023-10-14T11:14:54.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.747+0000 7f34f77fe640 1 --2- 172.21.15.26:0/860870460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34f80b21c0 0x7f34f80b43c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f34e800c7b0 tx=0x7f34e800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:54.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.751+0000 7f34dffff640 1 -- 172.21.15.26:0/860870460 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e80072d0 con 0x7f34f80b21c0 2023-10-14T11:14:54.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.751+0000 7f34dffff640 1 -- 172.21.15.26:0/860870460 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e8007450 con 0x7f34f80b21c0 2023-10-14T11:14:54.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.751+0000 7f34dffff640 1 -- 172.21.15.26:0/860870460 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e80047f0 con 0x7f34f80b21c0 2023-10-14T11:14:54.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.751+0000 7f34fdcd6640 1 -- 172.21.15.26:0/860870460 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f80c4930 con 0x7f34f80b21c0 2023-10-14T11:14:54.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.751+0000 7f34fdcd6640 1 -- 172.21.15.26:0/860870460 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f80c4ef0 con 0x7f34f80b21c0 2023-10-14T11:14:54.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.751+0000 7f34fdcd6640 1 -- 172.21.15.26:0/860870460 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f8074010 con 0x7f34f80b21c0 2023-10-14T11:14:54.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.751+0000 7f34dffff640 1 -- 172.21.15.26:0/860870460 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f34e8004950 con 0x7f34f80b21c0 2023-10-14T11:14:54.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.751+0000 7f34dffff640 1 --2- 172.21.15.26:0/860870460 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f34e40664d0 0x7f34e4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:54.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.751+0000 7f34dffff640 1 -- 172.21.15.26:0/860870460 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f34e8082f50 con 0x7f34f80b21c0 2023-10-14T11:14:54.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.751+0000 7f34f6ffd640 1 --2- 172.21.15.26:0/860870460 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f34e40664d0 0x7f34e4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:54.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.755+0000 7f34f6ffd640 1 --2- 172.21.15.26:0/860870460 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f34e40664d0 0x7f34e4068990 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f34f80b5cf0 tx=0x7f34ec009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:54.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.755+0000 7f34dffff640 1 -- 172.21.15.26:0/860870460 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f34e8050310 con 0x7f34f80b21c0 2023-10-14T11:14:54.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.915+0000 7f34fdcd6640 1 -- 172.21.15.26:0/860870460 --> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34f8070ab0 con 0x7f34e40664d0 2023-10-14T11:14:54.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.923+0000 7f34dffff640 1 -- 172.21.15.26:0/860870460 <== mgr.4101 v2:172.21.15.26:6832/4136446821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289548 (secure 0 0 0) 0x7f34ec0119d0 con 0x7f34e40664d0 2023-10-14T11:14:54.933 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:54.936 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-14T11:14:54.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.927+0000 7f34fdcd6640 1 -- 172.21.15.26:0/860870460 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f34e40664d0 msgr2=0x7f34e4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:54.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.927+0000 7f34fdcd6640 1 --2- 172.21.15.26:0/860870460 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f34e40664d0 0x7f34e4068990 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f34f80b5cf0 tx=0x7f34ec009190 comp rx=0 tx=0).stop 2023-10-14T11:14:54.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.927+0000 7f34fdcd6640 1 -- 172.21.15.26:0/860870460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34f80b21c0 msgr2=0x7f34f80b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.927+0000 7f34fdcd6640 1 --2- 172.21.15.26:0/860870460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34f80b21c0 0x7f34f80b43c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f34e800c7b0 tx=0x7f34e800cc70 comp rx=0 tx=0).stop 2023-10-14T11:14:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.927+0000 7f34fdcd6640 1 -- 172.21.15.26:0/860870460 shutdown_connections 2023-10-14T11:14:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.927+0000 7f34fdcd6640 1 --2- 172.21.15.26:0/860870460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34f815ce30 0x7f34f80c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.927+0000 7f34fdcd6640 1 --2- 172.21.15.26:0/860870460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34f815ca50 0x7f34f80c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.927+0000 7f34fdcd6640 1 --2- 172.21.15.26:0/860870460 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f34e40664d0 0x7f34e4068990 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.927+0000 7f34fdcd6640 1 --2- 172.21.15.26:0/860870460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34f80b21c0 0x7f34f80b43c0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.927+0000 7f34fdcd6640 1 -- 172.21.15.26:0/860870460 >> 172.21.15.26:0/860870460 conn(0x7f34f80cd1c0 msgr2=0x7f34f80d1380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.927+0000 7f34fdcd6640 1 -- 172.21.15.26:0/860870460 shutdown_connections 2023-10-14T11:14:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:54.927+0000 7f34fdcd6640 1 -- 172.21.15.26:0/860870460 wait complete. 2023-10-14T11:14:54.955 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2023-10-14T11:14:54.192233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255832,"kb_used_data":6376,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718888,"statfs":{"total":773094113280,"available":772832141312,"internally_reserved":0,"allocated":6529024,"data_stored":3542228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":255315512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.629463"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.820092+0000","last_change":"2023-10-14T11:14:50.623497+0000","last_active":"2023-10-14T11:14:51.820092+0000","last_peered":"2023-10-14T11:14:51.820092+0000","last_clean":"2023-10-14T11:14:51.820092+0000","last_became_active":"2023-10-14T11:14:50.621054+0000","last_became_peered":"2023-10-14T11:14:50.621054+0000","last_unstale":"2023-10-14T11:14:51.820092+0000","last_undegraded":"2023-10-14T11:14:51.820092+0000","last_fullsized":"2023-10-14T11:14:51.820092+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:29:55.811449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.601984+0000","last_change":"2023-10-14T11:14:50.620467+0000","last_active":"2023-10-14T11:14:51.601984+0000","last_peered":"2023-10-14T11:14:51.601984+0000","last_clean":"2023-10-14T11:14:51.601984+0000","last_became_active":"2023-10-14T11:14:50.620194+0000","last_became_peered":"2023-10-14T11:14:50.620194+0000","last_unstale":"2023-10-14T11:14:51.601984+0000","last_undegraded":"2023-10-14T11:14:51.601984+0000","last_fullsized":"2023-10-14T11:14:51.601984+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:52:19.657086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.604417+0000","last_change":"2023-10-14T11:14:50.609399+0000","last_active":"2023-10-14T11:14:51.604417+0000","last_peered":"2023-10-14T11:14:51.604417+0000","last_clean":"2023-10-14T11:14:51.604417+0000","last_became_active":"2023-10-14T11:14:50.608727+0000","last_became_peered":"2023-10-14T11:14:50.608727+0000","last_unstale":"2023-10-14T11:14:51.604417+0000","last_undegraded":"2023-10-14T11:14:51.604417+0000","last_fullsized":"2023-10-14T11:14:51.604417+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:40:25.562519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.383898+0000","last_change":"2023-10-14T11:14:50.614976+0000","last_active":"2023-10-14T11:14:52.383898+0000","last_peered":"2023-10-14T11:14:52.383898+0000","last_clean":"2023-10-14T11:14:52.383898+0000","last_became_active":"2023-10-14T11:14:50.614669+0000","last_became_peered":"2023-10-14T11:14:50.614669+0000","last_unstale":"2023-10-14T11:14:52.383898+0000","last_undegraded":"2023-10-14T11:14:52.383898+0000","last_fullsized":"2023-10-14T11:14:52.383898+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:31:39.409712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.820062+0000","last_change":"2023-10-14T11:14:50.614734+0000","last_active":"2023-10-14T11:14:51.820062+0000","last_peered":"2023-10-14T11:14:51.820062+0000","last_clean":"2023-10-14T11:14:51.820062+0000","last_became_active":"2023-10-14T11:14:50.614405+0000","last_became_peered":"2023-10-14T11:14:50.614405+0000","last_unstale":"2023-10-14T11:14:51.820062+0000","last_undegraded":"2023-10-14T11:14:51.820062+0000","last_fullsized":"2023-10-14T11:14:51.820062+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:55:30.024247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.313102+0000","last_change":"2023-10-14T11:14:50.609839+0000","last_active":"2023-10-14T11:14:52.313102+0000","last_peered":"2023-10-14T11:14:52.313102+0000","last_clean":"2023-10-14T11:14:52.313102+0000","last_became_active":"2023-10-14T11:14:50.609586+0000","last_became_peered":"2023-10-14T11:14:50.609586+0000","last_unstale":"2023-10-14T11:14:52.313102+0000","last_undegraded":"2023-10-14T11:14:52.313102+0000","last_fullsized":"2023-10-14T11:14:52.313102+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:28:19.399632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.603408+0000","last_change":"2023-10-14T11:14:50.617940+0000","last_active":"2023-10-14T11:14:51.603408+0000","last_peered":"2023-10-14T11:14:51.603408+0000","last_clean":"2023-10-14T11:14:51.603408+0000","last_became_active":"2023-10-14T11:14:50.617623+0000","last_became_peered":"2023-10-14T11:14:50.617623+0000","last_unstale":"2023-10-14T11:14:51.603408+0000","last_undegraded":"2023-10-14T11:14:51.603408+0000","last_fullsized":"2023-10-14T11:14:51.603408+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:34:49.405847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.601237+0000","last_change":"2023-10-14T11:14:50.616844+0000","last_active":"2023-10-14T11:14:51.601237+0000","last_peered":"2023-10-14T11:14:51.601237+0000","last_clean":"2023-10-14T11:14:51.601237+0000","last_became_active":"2023-10-14T11:14:50.616561+0000","last_became_peered":"2023-10-14T11:14:50.616561+0000","last_unstale":"2023-10-14T11:14:51.601237+0000","last_undegraded":"2023-10-14T11:14:51.601237+0000","last_fullsized":"2023-10-14T11:14:51.601237+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:17.315084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.604043+0000","last_change":"2023-10-14T11:14:50.612793+0000","last_active":"2023-10-14T11:14:51.604043+0000","last_peered":"2023-10-14T11:14:51.604043+0000","last_clean":"2023-10-14T11:14:51.604043+0000","last_became_active":"2023-10-14T11:14:50.612525+0000","last_became_peered":"2023-10-14T11:14:50.612525+0000","last_unstale":"2023-10-14T11:14:51.604043+0000","last_undegraded":"2023-10-14T11:14:51.604043+0000","last_fullsized":"2023-10-14T11:14:51.604043+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:18:03.370461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.383508+0000","last_change":"2023-10-14T11:14:50.591622+0000","last_active":"2023-10-14T11:14:52.383508+0000","last_peered":"2023-10-14T11:14:52.383508+0000","last_clean":"2023-10-14T11:14:52.383508+0000","last_became_active":"2023-10-14T11:14:50.590778+0000","last_became_peered":"2023-10-14T11:14:50.590778+0000","last_unstale":"2023-10-14T11:14:52.383508+0000","last_undegraded":"2023-10-14T11:14:52.383508+0000","last_fullsized":"2023-10-14T11:14:52.383508+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:18:03.370461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.383500+0000","last_change":"2023-10-14T11:14:50.617259+0000","last_active":"2023-10-14T11:14:52.383500+0000","last_peered":"2023-10-14T11:14:52.383500+0000","last_clean":"2023-10-14T11:14:52.383500+0000","last_became_active":"2023-10-14T11:14:50.616950+0000","last_became_peered":"2023-10-14T11:14:50.616950+0000","last_unstale":"2023-10-14T11:14:52.383500+0000","last_undegraded":"2023-10-14T11:14:52.383500+0000","last_fullsized":"2023-10-14T11:14:52.383500+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:11.327501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.384139+0000","last_change":"2023-10-14T11:14:50.610445+0000","last_active":"2023-10-14T11:14:52.384139+0000","last_peered":"2023-10-14T11:14:52.384139+0000","last_clean":"2023-10-14T11:14:52.384139+0000","last_became_active":"2023-10-14T11:14:50.610180+0000","last_became_peered":"2023-10-14T11:14:50.610180+0000","last_unstale":"2023-10-14T11:14:52.384139+0000","last_undegraded":"2023-10-14T11:14:52.384139+0000","last_fullsized":"2023-10-14T11:14:52.384139+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:32:55.394335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.384418+0000","last_change":"2023-10-14T11:14:50.604876+0000","last_active":"2023-10-14T11:14:52.384418+0000","last_peered":"2023-10-14T11:14:52.384418+0000","last_clean":"2023-10-14T11:14:52.384418+0000","last_became_active":"2023-10-14T11:14:50.604229+0000","last_became_peered":"2023-10-14T11:14:50.604229+0000","last_unstale":"2023-10-14T11:14:52.384418+0000","last_undegraded":"2023-10-14T11:14:52.384418+0000","last_fullsized":"2023-10-14T11:14:52.384418+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:10.986672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.603241+0000","last_change":"2023-10-14T11:14:50.613055+0000","last_active":"2023-10-14T11:14:51.603241+0000","last_peered":"2023-10-14T11:14:51.603241+0000","last_clean":"2023-10-14T11:14:51.603241+0000","last_became_active":"2023-10-14T11:14:50.612763+0000","last_became_peered":"2023-10-14T11:14:50.612763+0000","last_unstale":"2023-10-14T11:14:51.603241+0000","last_undegraded":"2023-10-14T11:14:51.603241+0000","last_fullsized":"2023-10-14T11:14:51.603241+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:11:44.705742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.602928+0000","last_change":"2023-10-14T11:14:50.611176+0000","last_active":"2023-10-14T11:14:51.602928+0000","last_peered":"2023-10-14T11:14:51.602928+0000","last_clean":"2023-10-14T11:14:51.602928+0000","last_became_active":"2023-10-14T11:14:50.610228+0000","last_became_peered":"2023-10-14T11:14:50.610228+0000","last_unstale":"2023-10-14T11:14:51.602928+0000","last_undegraded":"2023-10-14T11:14:51.602928+0000","last_fullsized":"2023-10-14T11:14:51.602928+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:49:35.500310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.313119+0000","last_change":"2023-10-14T11:14:50.600014+0000","last_active":"2023-10-14T11:14:52.313119+0000","last_peered":"2023-10-14T11:14:52.313119+0000","last_clean":"2023-10-14T11:14:52.313119+0000","last_became_active":"2023-10-14T11:14:50.599689+0000","last_became_peered":"2023-10-14T11:14:50.599689+0000","last_unstale":"2023-10-14T11:14:52.313119+0000","last_undegraded":"2023-10-14T11:14:52.313119+0000","last_fullsized":"2023-10-14T11:14:52.313119+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:12.503993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.602002+0000","last_change":"2023-10-14T11:14:50.622928+0000","last_active":"2023-10-14T11:14:51.602002+0000","last_peered":"2023-10-14T11:14:51.602002+0000","last_clean":"2023-10-14T11:14:51.602002+0000","last_became_active":"2023-10-14T11:14:50.622671+0000","last_became_peered":"2023-10-14T11:14:50.622671+0000","last_unstale":"2023-10-14T11:14:51.602002+0000","last_undegraded":"2023-10-14T11:14:51.602002+0000","last_fullsized":"2023-10-14T11:14:51.602002+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:11:44.980335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.604679+0000","last_change":"2023-10-14T11:14:50.623477+0000","last_active":"2023-10-14T11:14:51.604679+0000","last_peered":"2023-10-14T11:14:51.604679+0000","last_clean":"2023-10-14T11:14:51.604679+0000","last_became_active":"2023-10-14T11:14:50.623174+0000","last_became_peered":"2023-10-14T11:14:50.623174+0000","last_unstale":"2023-10-14T11:14:51.604679+0000","last_undegraded":"2023-10-14T11:14:51.604679+0000","last_fullsized":"2023-10-14T11:14:51.604679+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:06:41.595984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.820033+0000","last_change":"2023-10-14T11:14:50.621400+0000","last_active":"2023-10-14T11:14:51.820033+0000","last_peered":"2023-10-14T11:14:51.820033+0000","last_clean":"2023-10-14T11:14:51.820033+0000","last_became_active":"2023-10-14T11:14:50.621076+0000","last_became_peered":"2023-10-14T11:14:50.621076+0000","last_unstale":"2023-10-14T11:14:51.820033+0000","last_undegraded":"2023-10-14T11:14:51.820033+0000","last_fullsized":"2023-10-14T11:14:51.820033+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:21:08.226623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.602054+0000","last_change":"2023-10-14T11:14:50.611184+0000","last_active":"2023-10-14T11:14:51.602054+0000","last_peered":"2023-10-14T11:14:51.602054+0000","last_clean":"2023-10-14T11:14:51.602054+0000","last_became_active":"2023-10-14T11:14:50.610906+0000","last_became_peered":"2023-10-14T11:14:50.610906+0000","last_unstale":"2023-10-14T11:14:51.602054+0000","last_undegraded":"2023-10-14T11:14:51.602054+0000","last_fullsized":"2023-10-14T11:14:51.602054+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:58:17.538004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.604309+0000","last_change":"2023-10-14T11:14:50.614095+0000","last_active":"2023-10-14T11:14:51.604309+0000","last_peered":"2023-10-14T11:14:51.604309+0000","last_clean":"2023-10-14T11:14:51.604309+0000","last_became_active":"2023-10-14T11:14:50.613618+0000","last_became_peered":"2023-10-14T11:14:50.613618+0000","last_unstale":"2023-10-14T11:14:51.604309+0000","last_undegraded":"2023-10-14T11:14:51.604309+0000","last_fullsized":"2023-10-14T11:14:51.604309+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:31:39.409712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.601347+0000","last_change":"2023-10-14T11:14:50.625766+0000","last_active":"2023-10-14T11:14:51.601347+0000","last_peered":"2023-10-14T11:14:51.601347+0000","last_clean":"2023-10-14T11:14:51.601347+0000","last_became_active":"2023-10-14T11:14:50.625513+0000","last_became_peered":"2023-10-14T11:14:50.625513+0000","last_unstale":"2023-10-14T11:14:51.601347+0000","last_undegraded":"2023-10-14T11:14:51.601347+0000","last_fullsized":"2023-10-14T11:14:51.601347+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:24:07.505052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.603672+0000","last_change":"2023-10-14T11:14:50.617007+0000","last_active":"2023-10-14T11:14:51.603672+0000","last_peered":"2023-10-14T11:14:51.603672+0000","last_clean":"2023-10-14T11:14:51.603672+0000","last_became_active":"2023-10-14T11:14:50.616663+0000","last_became_peered":"2023-10-14T11:14:50.616663+0000","last_unstale":"2023-10-14T11:14:51.603672+0000","last_undegraded":"2023-10-14T11:14:51.603672+0000","last_fullsized":"2023-10-14T11:14:51.603672+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:59:56.995911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.383741+0000","last_change":"2023-10-14T11:14:50.606838+0000","last_active":"2023-10-14T11:14:52.383741+0000","last_peered":"2023-10-14T11:14:52.383741+0000","last_clean":"2023-10-14T11:14:52.383741+0000","last_became_active":"2023-10-14T11:14:50.604926+0000","last_became_peered":"2023-10-14T11:14:50.604926+0000","last_unstale":"2023-10-14T11:14:52.383741+0000","last_undegraded":"2023-10-14T11:14:52.383741+0000","last_fullsized":"2023-10-14T11:14:52.383741+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:29:52.786200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.820173+0000","last_change":"2023-10-14T11:14:50.607951+0000","last_active":"2023-10-14T11:14:51.820173+0000","last_peered":"2023-10-14T11:14:51.820173+0000","last_clean":"2023-10-14T11:14:51.820173+0000","last_became_active":"2023-10-14T11:14:50.607698+0000","last_became_peered":"2023-10-14T11:14:50.607698+0000","last_unstale":"2023-10-14T11:14:51.820173+0000","last_undegraded":"2023-10-14T11:14:51.820173+0000","last_fullsized":"2023-10-14T11:14:51.820173+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:50:22.521940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.384542+0000","last_change":"2023-10-14T11:14:50.609132+0000","last_active":"2023-10-14T11:14:52.384542+0000","last_peered":"2023-10-14T11:14:52.384542+0000","last_clean":"2023-10-14T11:14:52.384542+0000","last_became_active":"2023-10-14T11:14:50.608839+0000","last_became_peered":"2023-10-14T11:14:50.608839+0000","last_unstale":"2023-10-14T11:14:52.384542+0000","last_undegraded":"2023-10-14T11:14:52.384542+0000","last_fullsized":"2023-10-14T11:14:52.384542+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:35:16.819102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.313178+0000","last_change":"2023-10-14T11:14:50.600136+0000","last_active":"2023-10-14T11:14:52.313178+0000","last_peered":"2023-10-14T11:14:52.313178+0000","last_clean":"2023-10-14T11:14:52.313178+0000","last_became_active":"2023-10-14T11:14:50.599837+0000","last_became_peered":"2023-10-14T11:14:50.599837+0000","last_unstale":"2023-10-14T11:14:52.313178+0000","last_undegraded":"2023-10-14T11:14:52.313178+0000","last_fullsized":"2023-10-14T11:14:52.313178+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:29:03.443328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.820034+0000","last_change":"2023-10-14T11:14:50.618778+0000","last_active":"2023-10-14T11:14:51.820034+0000","last_peered":"2023-10-14T11:14:51.820034+0000","last_clean":"2023-10-14T11:14:51.820034+0000","last_became_active":"2023-10-14T11:14:50.618411+0000","last_became_peered":"2023-10-14T11:14:50.618411+0000","last_unstale":"2023-10-14T11:14:51.820034+0000","last_undegraded":"2023-10-14T11:14:51.820034+0000","last_fullsized":"2023-10-14T11:14:51.820034+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:25.389075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.601745+0000","last_change":"2023-10-14T11:14:50.615706+0000","last_active":"2023-10-14T11:14:51.601745+0000","last_peered":"2023-10-14T11:14:51.601745+0000","last_clean":"2023-10-14T11:14:51.601745+0000","last_became_active":"2023-10-14T11:14:50.615423+0000","last_became_peered":"2023-10-14T11:14:50.615423+0000","last_unstale":"2023-10-14T11:14:51.601745+0000","last_undegraded":"2023-10-14T11:14:51.601745+0000","last_fullsized":"2023-10-14T11:14:51.601745+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:24:02.275351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.604184+0000","last_change":"2023-10-14T11:14:50.611246+0000","last_active":"2023-10-14T11:14:51.604184+0000","last_peered":"2023-10-14T11:14:51.604184+0000","last_clean":"2023-10-14T11:14:51.604184+0000","last_became_active":"2023-10-14T11:14:50.610935+0000","last_became_peered":"2023-10-14T11:14:50.610935+0000","last_unstale":"2023-10-14T11:14:51.604184+0000","last_undegraded":"2023-10-14T11:14:51.604184+0000","last_fullsized":"2023-10-14T11:14:51.604184+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:09:29.010723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.819872+0000","last_change":"2023-10-14T11:14:50.606809+0000","last_active":"2023-10-14T11:14:51.819872+0000","last_peered":"2023-10-14T11:14:51.819872+0000","last_clean":"2023-10-14T11:14:51.819872+0000","last_became_active":"2023-10-14T11:14:50.606510+0000","last_became_peered":"2023-10-14T11:14:50.606510+0000","last_unstale":"2023-10-14T11:14:51.819872+0000","last_undegraded":"2023-10-14T11:14:51.819872+0000","last_fullsized":"2023-10-14T11:14:51.819872+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:25.025219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.313578+0000","last_change":"2023-10-14T11:14:50.610089+0000","last_active":"2023-10-14T11:14:52.313578+0000","last_peered":"2023-10-14T11:14:52.313578+0000","last_clean":"2023-10-14T11:14:52.313578+0000","last_became_active":"2023-10-14T11:14:50.609485+0000","last_became_peered":"2023-10-14T11:14:50.609485+0000","last_unstale":"2023-10-14T11:14:52.313578+0000","last_undegraded":"2023-10-14T11:14:52.313578+0000","last_fullsized":"2023-10-14T11:14:52.313578+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:09:29.010723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.313635+0000","last_change":"2023-10-14T11:14:50.617575+0000","last_active":"2023-10-14T11:14:52.313635+0000","last_peered":"2023-10-14T11:14:52.313635+0000","last_clean":"2023-10-14T11:14:52.313635+0000","last_became_active":"2023-10-14T11:14:50.617044+0000","last_became_peered":"2023-10-14T11:14:50.617044+0000","last_unstale":"2023-10-14T11:14:52.313635+0000","last_undegraded":"2023-10-14T11:14:52.313635+0000","last_fullsized":"2023-10-14T11:14:52.313635+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:31:39.409712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.619616+0000","last_change":"2023-10-14T11:14:49.595574+0000","last_active":"2023-10-14T11:14:50.619616+0000","last_peered":"2023-10-14T11:14:50.619616+0000","last_clean":"2023-10-14T11:14:50.619616+0000","last_became_active":"2023-10-14T11:14:49.595227+0000","last_became_peered":"2023-10-14T11:14:49.595227+0000","last_unstale":"2023-10-14T11:14:50.619616+0000","last_undegraded":"2023-10-14T11:14:50.619616+0000","last_fullsized":"2023-10-14T11:14:50.619616+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:23:45.760710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.383552+0000","last_change":"2023-10-14T11:14:50.606707+0000","last_active":"2023-10-14T11:14:52.383552+0000","last_peered":"2023-10-14T11:14:52.383552+0000","last_clean":"2023-10-14T11:14:52.383552+0000","last_became_active":"2023-10-14T11:14:50.606425+0000","last_became_peered":"2023-10-14T11:14:50.606425+0000","last_unstale":"2023-10-14T11:14:52.383552+0000","last_undegraded":"2023-10-14T11:14:52.383552+0000","last_fullsized":"2023-10-14T11:14:52.383552+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:15:29.868189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.620046+0000","last_change":"2023-10-14T11:14:49.594071+0000","last_active":"2023-10-14T11:14:50.620046+0000","last_peered":"2023-10-14T11:14:50.620046+0000","last_clean":"2023-10-14T11:14:50.620046+0000","last_became_active":"2023-10-14T11:14:49.593138+0000","last_became_peered":"2023-10-14T11:14:49.593138+0000","last_unstale":"2023-10-14T11:14:50.620046+0000","last_undegraded":"2023-10-14T11:14:50.620046+0000","last_fullsized":"2023-10-14T11:14:50.620046+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:40.036746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.313362+0000","last_change":"2023-10-14T11:14:50.608877+0000","last_active":"2023-10-14T11:14:52.313362+0000","last_peered":"2023-10-14T11:14:52.313362+0000","last_clean":"2023-10-14T11:14:52.313362+0000","last_became_active":"2023-10-14T11:14:50.608568+0000","last_became_peered":"2023-10-14T11:14:50.608568+0000","last_unstale":"2023-10-14T11:14:52.313362+0000","last_undegraded":"2023-10-14T11:14:52.313362+0000","last_fullsized":"2023-10-14T11:14:52.313362+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:39.247115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.613866+0000","last_change":"2023-10-14T11:14:49.601217+0000","last_active":"2023-10-14T11:14:50.613866+0000","last_peered":"2023-10-14T11:14:50.613866+0000","last_clean":"2023-10-14T11:14:50.613866+0000","last_became_active":"2023-10-14T11:14:49.600946+0000","last_became_peered":"2023-10-14T11:14:49.600946+0000","last_unstale":"2023-10-14T11:14:50.613866+0000","last_undegraded":"2023-10-14T11:14:50.613866+0000","last_fullsized":"2023-10-14T11:14:50.613866+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:43.650913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.313220+0000","last_change":"2023-10-14T11:14:50.616272+0000","last_active":"2023-10-14T11:14:52.313220+0000","last_peered":"2023-10-14T11:14:52.313220+0000","last_clean":"2023-10-14T11:14:52.313220+0000","last_became_active":"2023-10-14T11:14:50.615990+0000","last_became_peered":"2023-10-14T11:14:50.615990+0000","last_unstale":"2023-10-14T11:14:52.313220+0000","last_undegraded":"2023-10-14T11:14:52.313220+0000","last_fullsized":"2023-10-14T11:14:52.313220+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:29:51.475908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.620897+0000","last_change":"2023-10-14T11:14:49.590359+0000","last_active":"2023-10-14T11:14:50.620897+0000","last_peered":"2023-10-14T11:14:50.620897+0000","last_clean":"2023-10-14T11:14:50.620897+0000","last_became_active":"2023-10-14T11:14:49.590094+0000","last_became_peered":"2023-10-14T11:14:49.590094+0000","last_unstale":"2023-10-14T11:14:50.620897+0000","last_undegraded":"2023-10-14T11:14:50.620897+0000","last_fullsized":"2023-10-14T11:14:50.620897+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:38.240189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.601606+0000","last_change":"2023-10-14T11:14:50.624008+0000","last_active":"2023-10-14T11:14:51.601606+0000","last_peered":"2023-10-14T11:14:51.601606+0000","last_clean":"2023-10-14T11:14:51.601606+0000","last_became_active":"2023-10-14T11:14:50.623750+0000","last_became_peered":"2023-10-14T11:14:50.623750+0000","last_unstale":"2023-10-14T11:14:51.601606+0000","last_undegraded":"2023-10-14T11:14:51.601606+0000","last_fullsized":"2023-10-14T11:14:51.601606+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:05.775683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.612710+0000","last_change":"2023-10-14T11:14:49.599989+0000","last_active":"2023-10-14T11:14:50.612710+0000","last_peered":"2023-10-14T11:14:50.612710+0000","last_clean":"2023-10-14T11:14:50.612710+0000","last_became_active":"2023-10-14T11:14:49.599705+0000","last_became_peered":"2023-10-14T11:14:49.599705+0000","last_unstale":"2023-10-14T11:14:50.612710+0000","last_undegraded":"2023-10-14T11:14:50.612710+0000","last_fullsized":"2023-10-14T11:14:50.612710+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:09.979747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.601467+0000","last_change":"2023-10-14T11:14:50.620426+0000","last_active":"2023-10-14T11:14:51.601467+0000","last_peered":"2023-10-14T11:14:51.601467+0000","last_clean":"2023-10-14T11:14:51.601467+0000","last_became_active":"2023-10-14T11:14:50.620136+0000","last_became_peered":"2023-10-14T11:14:50.620136+0000","last_unstale":"2023-10-14T11:14:51.601467+0000","last_undegraded":"2023-10-14T11:14:51.601467+0000","last_fullsized":"2023-10-14T11:14:51.601467+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:32.437644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.606142+0000","last_change":"2023-10-14T11:14:49.596142+0000","last_active":"2023-10-14T11:14:50.606142+0000","last_peered":"2023-10-14T11:14:50.606142+0000","last_clean":"2023-10-14T11:14:50.606142+0000","last_became_active":"2023-10-14T11:14:49.595831+0000","last_became_peered":"2023-10-14T11:14:49.595831+0000","last_unstale":"2023-10-14T11:14:50.606142+0000","last_undegraded":"2023-10-14T11:14:50.606142+0000","last_fullsized":"2023-10-14T11:14:50.606142+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:53:35.323550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.383902+0000","last_change":"2023-10-14T11:14:50.606077+0000","last_active":"2023-10-14T11:14:52.383902+0000","last_peered":"2023-10-14T11:14:52.383902+0000","last_clean":"2023-10-14T11:14:52.383902+0000","last_became_active":"2023-10-14T11:14:50.605814+0000","last_became_peered":"2023-10-14T11:14:50.605814+0000","last_unstale":"2023-10-14T11:14:52.383902+0000","last_undegraded":"2023-10-14T11:14:52.383902+0000","last_fullsized":"2023-10-14T11:14:52.383902+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:03:48.011461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.586275+0000","last_change":"2023-10-14T11:14:49.582679+0000","last_active":"2023-10-14T11:14:50.586275+0000","last_peered":"2023-10-14T11:14:50.586275+0000","last_clean":"2023-10-14T11:14:50.586275+0000","last_became_active":"2023-10-14T11:14:49.582447+0000","last_became_peered":"2023-10-14T11:14:49.582447+0000","last_unstale":"2023-10-14T11:14:50.586275+0000","last_undegraded":"2023-10-14T11:14:50.586275+0000","last_fullsized":"2023-10-14T11:14:50.586275+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:24.791021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.601358+0000","last_change":"2023-10-14T11:14:50.624842+0000","last_active":"2023-10-14T11:14:51.601358+0000","last_peered":"2023-10-14T11:14:51.601358+0000","last_clean":"2023-10-14T11:14:51.601358+0000","last_became_active":"2023-10-14T11:14:50.624584+0000","last_became_peered":"2023-10-14T11:14:50.624584+0000","last_unstale":"2023-10-14T11:14:51.601358+0000","last_undegraded":"2023-10-14T11:14:51.601358+0000","last_fullsized":"2023-10-14T11:14:51.601358+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:56:57.585998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.592529+0000","last_change":"2023-10-14T11:14:49.590167+0000","last_active":"2023-10-14T11:14:50.592529+0000","last_peered":"2023-10-14T11:14:50.592529+0000","last_clean":"2023-10-14T11:14:50.592529+0000","last_became_active":"2023-10-14T11:14:49.589876+0000","last_became_peered":"2023-10-14T11:14:49.589876+0000","last_unstale":"2023-10-14T11:14:50.592529+0000","last_undegraded":"2023-10-14T11:14:50.592529+0000","last_fullsized":"2023-10-14T11:14:50.592529+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:38:14.938610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.603946+0000","last_change":"2023-10-14T11:14:50.611558+0000","last_active":"2023-10-14T11:14:51.603946+0000","last_peered":"2023-10-14T11:14:51.603946+0000","last_clean":"2023-10-14T11:14:51.603946+0000","last_became_active":"2023-10-14T11:14:50.610258+0000","last_became_peered":"2023-10-14T11:14:50.610258+0000","last_unstale":"2023-10-14T11:14:51.603946+0000","last_undegraded":"2023-10-14T11:14:51.603946+0000","last_fullsized":"2023-10-14T11:14:51.603946+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:11.327501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.600967+0000","last_change":"2023-10-14T11:14:49.597577+0000","last_active":"2023-10-14T11:14:50.600967+0000","last_peered":"2023-10-14T11:14:50.600967+0000","last_clean":"2023-10-14T11:14:50.600967+0000","last_became_active":"2023-10-14T11:14:49.597282+0000","last_became_peered":"2023-10-14T11:14:49.597282+0000","last_unstale":"2023-10-14T11:14:50.600967+0000","last_undegraded":"2023-10-14T11:14:50.600967+0000","last_fullsized":"2023-10-14T11:14:50.600967+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:38.240189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.604750+0000","last_change":"2023-10-14T11:14:50.613084+0000","last_active":"2023-10-14T11:14:51.604750+0000","last_peered":"2023-10-14T11:14:51.604750+0000","last_clean":"2023-10-14T11:14:51.604750+0000","last_became_active":"2023-10-14T11:14:50.612772+0000","last_became_peered":"2023-10-14T11:14:50.612772+0000","last_unstale":"2023-10-14T11:14:51.604750+0000","last_undegraded":"2023-10-14T11:14:51.604750+0000","last_fullsized":"2023-10-14T11:14:51.604750+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:02:41.199730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.604740+0000","last_change":"2023-10-14T11:14:49.603833+0000","last_active":"2023-10-14T11:14:50.604740+0000","last_peered":"2023-10-14T11:14:50.604740+0000","last_clean":"2023-10-14T11:14:50.604740+0000","last_became_active":"2023-10-14T11:14:49.602745+0000","last_became_peered":"2023-10-14T11:14:49.602745+0000","last_unstale":"2023-10-14T11:14:50.604740+0000","last_undegraded":"2023-10-14T11:14:50.604740+0000","last_fullsized":"2023-10-14T11:14:50.604740+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:10:48.293059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.383165+0000","last_change":"2023-10-14T11:14:50.601977+0000","last_active":"2023-10-14T11:14:52.383165+0000","last_peered":"2023-10-14T11:14:52.383165+0000","last_clean":"2023-10-14T11:14:52.383165+0000","last_became_active":"2023-10-14T11:14:50.601690+0000","last_became_peered":"2023-10-14T11:14:50.601690+0000","last_unstale":"2023-10-14T11:14:52.383165+0000","last_undegraded":"2023-10-14T11:14:52.383165+0000","last_fullsized":"2023-10-14T11:14:52.383165+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:11:44.705742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.618058+0000","last_change":"2023-10-14T11:14:49.601838+0000","last_active":"2023-10-14T11:14:50.618058+0000","last_peered":"2023-10-14T11:14:50.618058+0000","last_clean":"2023-10-14T11:14:50.618058+0000","last_became_active":"2023-10-14T11:14:49.601598+0000","last_became_peered":"2023-10-14T11:14:49.601598+0000","last_unstale":"2023-10-14T11:14:50.618058+0000","last_undegraded":"2023-10-14T11:14:50.618058+0000","last_fullsized":"2023-10-14T11:14:50.618058+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:29:02.436402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.604474+0000","last_change":"2023-10-14T11:14:50.614207+0000","last_active":"2023-10-14T11:14:51.604474+0000","last_peered":"2023-10-14T11:14:51.604474+0000","last_clean":"2023-10-14T11:14:51.604474+0000","last_became_active":"2023-10-14T11:14:50.613520+0000","last_became_peered":"2023-10-14T11:14:50.613520+0000","last_unstale":"2023-10-14T11:14:51.604474+0000","last_undegraded":"2023-10-14T11:14:51.604474+0000","last_fullsized":"2023-10-14T11:14:51.604474+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:32:55.394335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"54'6","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.628374+0000","last_change":"2023-10-14T11:14:49.597521+0000","last_active":"2023-10-14T11:14:50.628374+0000","last_peered":"2023-10-14T11:14:50.628374+0000","last_clean":"2023-10-14T11:14:50.628374+0000","last_became_active":"2023-10-14T11:14:49.597104+0000","last_became_peered":"2023-10-14T11:14:49.597104+0000","last_unstale":"2023-10-14T11:14:50.628374+0000","last_undegraded":"2023-10-14T11:14:50.628374+0000","last_fullsized":"2023-10-14T11:14:50.628374+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:34:47.516975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.383767+0000","last_change":"2023-10-14T11:14:50.597334+0000","last_active":"2023-10-14T11:14:52.383767+0000","last_peered":"2023-10-14T11:14:52.383767+0000","last_clean":"2023-10-14T11:14:52.383767+0000","last_became_active":"2023-10-14T11:14:50.596864+0000","last_became_peered":"2023-10-14T11:14:50.596864+0000","last_unstale":"2023-10-14T11:14:52.383767+0000","last_undegraded":"2023-10-14T11:14:52.383767+0000","last_fullsized":"2023-10-14T11:14:52.383767+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:09:29.010723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.625572+0000","last_change":"2023-10-14T11:14:49.603026+0000","last_active":"2023-10-14T11:14:50.625572+0000","last_peered":"2023-10-14T11:14:50.625572+0000","last_clean":"2023-10-14T11:14:50.625572+0000","last_became_active":"2023-10-14T11:14:49.602709+0000","last_became_peered":"2023-10-14T11:14:49.602709+0000","last_unstale":"2023-10-14T11:14:50.625572+0000","last_undegraded":"2023-10-14T11:14:50.625572+0000","last_fullsized":"2023-10-14T11:14:50.625572+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:46:41.627061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.604579+0000","last_change":"2023-10-14T11:14:50.609128+0000","last_active":"2023-10-14T11:14:51.604579+0000","last_peered":"2023-10-14T11:14:51.604579+0000","last_clean":"2023-10-14T11:14:51.604579+0000","last_became_active":"2023-10-14T11:14:50.607594+0000","last_became_peered":"2023-10-14T11:14:50.607594+0000","last_unstale":"2023-10-14T11:14:51.604579+0000","last_undegraded":"2023-10-14T11:14:51.604579+0000","last_fullsized":"2023-10-14T11:14:51.604579+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:29:24.012096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.585576+0000","last_change":"2023-10-14T11:14:49.587936+0000","last_active":"2023-10-14T11:14:50.585576+0000","last_peered":"2023-10-14T11:14:50.585576+0000","last_clean":"2023-10-14T11:14:50.585576+0000","last_became_active":"2023-10-14T11:14:49.587620+0000","last_became_peered":"2023-10-14T11:14:49.587620+0000","last_unstale":"2023-10-14T11:14:50.585576+0000","last_undegraded":"2023-10-14T11:14:50.585576+0000","last_fullsized":"2023-10-14T11:14:50.585576+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:12:13.284001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.602768+0000","last_change":"2023-10-14T11:14:50.607879+0000","last_active":"2023-10-14T11:14:51.602768+0000","last_peered":"2023-10-14T11:14:51.602768+0000","last_clean":"2023-10-14T11:14:51.602768+0000","last_became_active":"2023-10-14T11:14:50.607597+0000","last_became_peered":"2023-10-14T11:14:50.607597+0000","last_unstale":"2023-10-14T11:14:51.602768+0000","last_undegraded":"2023-10-14T11:14:51.602768+0000","last_fullsized":"2023-10-14T11:14:51.602768+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:42:13.942552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.587623+0000","last_change":"2023-10-14T11:14:49.591162+0000","last_active":"2023-10-14T11:14:50.587623+0000","last_peered":"2023-10-14T11:14:50.587623+0000","last_clean":"2023-10-14T11:14:50.587623+0000","last_became_active":"2023-10-14T11:14:49.590817+0000","last_became_peered":"2023-10-14T11:14:49.590817+0000","last_unstale":"2023-10-14T11:14:50.587623+0000","last_undegraded":"2023-10-14T11:14:50.587623+0000","last_fullsized":"2023-10-14T11:14:50.587623+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:02:31.259983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.603925+0000","last_change":"2023-10-14T11:14:50.617009+0000","last_active":"2023-10-14T11:14:51.603925+0000","last_peered":"2023-10-14T11:14:51.603925+0000","last_clean":"2023-10-14T11:14:51.603925+0000","last_became_active":"2023-10-14T11:14:50.616691+0000","last_became_peered":"2023-10-14T11:14:50.616691+0000","last_unstale":"2023-10-14T11:14:51.603925+0000","last_undegraded":"2023-10-14T11:14:51.603925+0000","last_fullsized":"2023-10-14T11:14:51.603925+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:56.127211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.616365+0000","last_change":"2023-10-14T11:14:49.594465+0000","last_active":"2023-10-14T11:14:50.616365+0000","last_peered":"2023-10-14T11:14:50.616365+0000","last_clean":"2023-10-14T11:14:50.616365+0000","last_became_active":"2023-10-14T11:14:49.594163+0000","last_became_peered":"2023-10-14T11:14:49.594163+0000","last_unstale":"2023-10-14T11:14:50.616365+0000","last_undegraded":"2023-10-14T11:14:50.616365+0000","last_fullsized":"2023-10-14T11:14:50.616365+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:18:02.363535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.604747+0000","last_change":"2023-10-14T11:14:50.609691+0000","last_active":"2023-10-14T11:14:51.604747+0000","last_peered":"2023-10-14T11:14:51.604747+0000","last_clean":"2023-10-14T11:14:51.604747+0000","last_became_active":"2023-10-14T11:14:50.609368+0000","last_became_peered":"2023-10-14T11:14:50.609368+0000","last_unstale":"2023-10-14T11:14:51.604747+0000","last_undegraded":"2023-10-14T11:14:51.604747+0000","last_fullsized":"2023-10-14T11:14:51.604747+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:45:11.784126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.626094+0000","last_change":"2023-10-14T11:14:49.603138+0000","last_active":"2023-10-14T11:14:50.626094+0000","last_peered":"2023-10-14T11:14:50.626094+0000","last_clean":"2023-10-14T11:14:50.626094+0000","last_became_active":"2023-10-14T11:14:49.602797+0000","last_became_peered":"2023-10-14T11:14:49.602797+0000","last_unstale":"2023-10-14T11:14:50.626094+0000","last_undegraded":"2023-10-14T11:14:50.626094+0000","last_fullsized":"2023-10-14T11:14:50.626094+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:02:40.192804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.384465+0000","last_change":"2023-10-14T11:14:50.596329+0000","last_active":"2023-10-14T11:14:52.384465+0000","last_peered":"2023-10-14T11:14:52.384465+0000","last_clean":"2023-10-14T11:14:52.384465+0000","last_became_active":"2023-10-14T11:14:50.596060+0000","last_became_peered":"2023-10-14T11:14:50.596060+0000","last_unstale":"2023-10-14T11:14:52.384465+0000","last_undegraded":"2023-10-14T11:14:52.384465+0000","last_fullsized":"2023-10-14T11:14:52.384465+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:29:24.012096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.617424+0000","last_change":"2023-10-14T11:14:49.600552+0000","last_active":"2023-10-14T11:14:50.617424+0000","last_peered":"2023-10-14T11:14:50.617424+0000","last_clean":"2023-10-14T11:14:50.617424+0000","last_became_active":"2023-10-14T11:14:49.600266+0000","last_became_peered":"2023-10-14T11:14:49.600266+0000","last_unstale":"2023-10-14T11:14:50.617424+0000","last_undegraded":"2023-10-14T11:14:50.617424+0000","last_fullsized":"2023-10-14T11:14:50.617424+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:48:39.809866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.601875+0000","last_change":"2023-10-14T11:14:50.613305+0000","last_active":"2023-10-14T11:14:51.601875+0000","last_peered":"2023-10-14T11:14:51.601875+0000","last_clean":"2023-10-14T11:14:51.601875+0000","last_became_active":"2023-10-14T11:14:50.613041+0000","last_became_peered":"2023-10-14T11:14:50.613041+0000","last_unstale":"2023-10-14T11:14:51.601875+0000","last_undegraded":"2023-10-14T11:14:51.601875+0000","last_fullsized":"2023-10-14T11:14:51.601875+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:15.624001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.619685+0000","last_change":"2023-10-14T11:14:49.585070+0000","last_active":"2023-10-14T11:14:50.619685+0000","last_peered":"2023-10-14T11:14:50.619685+0000","last_clean":"2023-10-14T11:14:50.619685+0000","last_became_active":"2023-10-14T11:14:49.584753+0000","last_became_peered":"2023-10-14T11:14:49.584753+0000","last_unstale":"2023-10-14T11:14:50.619685+0000","last_undegraded":"2023-10-14T11:14:50.619685+0000","last_fullsized":"2023-10-14T11:14:50.619685+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:55.120285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.604590+0000","last_change":"2023-10-14T11:14:50.614449+0000","last_active":"2023-10-14T11:14:51.604590+0000","last_peered":"2023-10-14T11:14:51.604590+0000","last_clean":"2023-10-14T11:14:51.604590+0000","last_became_active":"2023-10-14T11:14:50.613872+0000","last_became_peered":"2023-10-14T11:14:50.613872+0000","last_unstale":"2023-10-14T11:14:51.604590+0000","last_undegraded":"2023-10-14T11:14:51.604590+0000","last_fullsized":"2023-10-14T11:14:51.604590+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:35:16.819102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.596049+0000","last_change":"2023-10-14T11:14:49.595545+0000","last_active":"2023-10-14T11:14:50.596049+0000","last_peered":"2023-10-14T11:14:50.596049+0000","last_clean":"2023-10-14T11:14:50.596049+0000","last_became_active":"2023-10-14T11:14:49.595246+0000","last_became_peered":"2023-10-14T11:14:49.595246+0000","last_unstale":"2023-10-14T11:14:50.596049+0000","last_undegraded":"2023-10-14T11:14:50.596049+0000","last_fullsized":"2023-10-14T11:14:50.596049+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:24.791021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.383934+0000","last_change":"2023-10-14T11:14:50.597153+0000","last_active":"2023-10-14T11:14:52.383934+0000","last_peered":"2023-10-14T11:14:52.383934+0000","last_clean":"2023-10-14T11:14:52.383934+0000","last_became_active":"2023-10-14T11:14:50.596459+0000","last_became_peered":"2023-10-14T11:14:50.596459+0000","last_unstale":"2023-10-14T11:14:52.383934+0000","last_undegraded":"2023-10-14T11:14:52.383934+0000","last_fullsized":"2023-10-14T11:14:52.383934+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:40:25.562519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.625419+0000","last_change":"2023-10-14T11:14:49.589173+0000","last_active":"2023-10-14T11:14:50.625419+0000","last_peered":"2023-10-14T11:14:50.625419+0000","last_clean":"2023-10-14T11:14:50.625419+0000","last_became_active":"2023-10-14T11:14:49.588952+0000","last_became_peered":"2023-10-14T11:14:49.588952+0000","last_unstale":"2023-10-14T11:14:50.625419+0000","last_undegraded":"2023-10-14T11:14:50.625419+0000","last_fullsized":"2023-10-14T11:14:50.625419+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:41:26.527463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.313575+0000","last_change":"2023-10-14T11:14:50.600020+0000","last_active":"2023-10-14T11:14:52.313575+0000","last_peered":"2023-10-14T11:14:52.313575+0000","last_clean":"2023-10-14T11:14:52.313575+0000","last_became_active":"2023-10-14T11:14:50.599740+0000","last_became_peered":"2023-10-14T11:14:50.599740+0000","last_unstale":"2023-10-14T11:14:52.313575+0000","last_undegraded":"2023-10-14T11:14:52.313575+0000","last_fullsized":"2023-10-14T11:14:52.313575+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:56.127211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.583543+0000","last_change":"2023-10-14T11:14:49.595648+0000","last_active":"2023-10-14T11:14:50.583543+0000","last_peered":"2023-10-14T11:14:50.583543+0000","last_clean":"2023-10-14T11:14:50.583543+0000","last_became_active":"2023-10-14T11:14:49.595350+0000","last_became_peered":"2023-10-14T11:14:49.595350+0000","last_unstale":"2023-10-14T11:14:50.583543+0000","last_undegraded":"2023-10-14T11:14:50.583543+0000","last_fullsized":"2023-10-14T11:14:50.583543+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:46:30.968779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.313210+0000","last_change":"2023-10-14T11:14:50.606987+0000","last_active":"2023-10-14T11:14:52.313210+0000","last_peered":"2023-10-14T11:14:52.313210+0000","last_clean":"2023-10-14T11:14:52.313210+0000","last_became_active":"2023-10-14T11:14:50.606733+0000","last_became_peered":"2023-10-14T11:14:50.606733+0000","last_unstale":"2023-10-14T11:14:52.313210+0000","last_undegraded":"2023-10-14T11:14:52.313210+0000","last_fullsized":"2023-10-14T11:14:52.313210+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:02:32.266909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.586668+0000","last_change":"2023-10-14T11:14:49.587664+0000","last_active":"2023-10-14T11:14:50.586668+0000","last_peered":"2023-10-14T11:14:50.586668+0000","last_clean":"2023-10-14T11:14:50.586668+0000","last_became_active":"2023-10-14T11:14:49.585139+0000","last_became_peered":"2023-10-14T11:14:49.585139+0000","last_unstale":"2023-10-14T11:14:50.586668+0000","last_undegraded":"2023-10-14T11:14:50.586668+0000","last_fullsized":"2023-10-14T11:14:50.586668+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:01:13.487571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.384461+0000","last_change":"2023-10-14T11:14:50.612177+0000","last_active":"2023-10-14T11:14:52.384461+0000","last_peered":"2023-10-14T11:14:52.384461+0000","last_clean":"2023-10-14T11:14:52.384461+0000","last_became_active":"2023-10-14T11:14:50.611918+0000","last_became_peered":"2023-10-14T11:14:50.611918+0000","last_unstale":"2023-10-14T11:14:52.384461+0000","last_undegraded":"2023-10-14T11:14:52.384461+0000","last_fullsized":"2023-10-14T11:14:52.384461+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:46:42.633987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.626624+0000","last_change":"2023-10-14T11:14:49.594924+0000","last_active":"2023-10-14T11:14:50.626624+0000","last_peered":"2023-10-14T11:14:50.626624+0000","last_clean":"2023-10-14T11:14:50.626624+0000","last_became_active":"2023-10-14T11:14:49.594632+0000","last_became_peered":"2023-10-14T11:14:49.594632+0000","last_unstale":"2023-10-14T11:14:50.626624+0000","last_undegraded":"2023-10-14T11:14:50.626624+0000","last_fullsized":"2023-10-14T11:14:50.626624+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:34:47.516975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.384536+0000","last_change":"2023-10-14T11:14:50.611298+0000","last_active":"2023-10-14T11:14:52.384536+0000","last_peered":"2023-10-14T11:14:52.384536+0000","last_clean":"2023-10-14T11:14:52.384536+0000","last_became_active":"2023-10-14T11:14:50.610872+0000","last_became_peered":"2023-10-14T11:14:50.610872+0000","last_unstale":"2023-10-14T11:14:52.384536+0000","last_undegraded":"2023-10-14T11:14:52.384536+0000","last_fullsized":"2023-10-14T11:14:52.384536+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:06:41.595984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.597546+0000","last_change":"2023-10-14T11:14:49.592855+0000","last_active":"2023-10-14T11:14:50.597546+0000","last_peered":"2023-10-14T11:14:50.597546+0000","last_clean":"2023-10-14T11:14:50.597546+0000","last_became_active":"2023-10-14T11:14:49.592498+0000","last_became_peered":"2023-10-14T11:14:49.592498+0000","last_unstale":"2023-10-14T11:14:50.597546+0000","last_undegraded":"2023-10-14T11:14:50.597546+0000","last_fullsized":"2023-10-14T11:14:50.597546+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:01:13.487571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.383229+0000","last_change":"2023-10-14T11:14:50.601383+0000","last_active":"2023-10-14T11:14:52.383229+0000","last_peered":"2023-10-14T11:14:52.383229+0000","last_clean":"2023-10-14T11:14:52.383229+0000","last_became_active":"2023-10-14T11:14:50.601112+0000","last_became_peered":"2023-10-14T11:14:50.601112+0000","last_unstale":"2023-10-14T11:14:52.383229+0000","last_undegraded":"2023-10-14T11:14:52.383229+0000","last_fullsized":"2023-10-14T11:14:52.383229+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:34:49.405847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.585588+0000","last_change":"2023-10-14T11:14:49.587913+0000","last_active":"2023-10-14T11:14:50.585588+0000","last_peered":"2023-10-14T11:14:50.585588+0000","last_clean":"2023-10-14T11:14:50.585588+0000","last_became_active":"2023-10-14T11:14:49.587602+0000","last_became_peered":"2023-10-14T11:14:49.587602+0000","last_unstale":"2023-10-14T11:14:50.585588+0000","last_undegraded":"2023-10-14T11:14:50.585588+0000","last_fullsized":"2023-10-14T11:14:50.585588+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:38.318607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.313446+0000","last_change":"2023-10-14T11:14:50.615721+0000","last_active":"2023-10-14T11:14:52.313446+0000","last_peered":"2023-10-14T11:14:52.313446+0000","last_clean":"2023-10-14T11:14:52.313446+0000","last_became_active":"2023-10-14T11:14:50.613039+0000","last_became_peered":"2023-10-14T11:14:50.613039+0000","last_unstale":"2023-10-14T11:14:52.313446+0000","last_undegraded":"2023-10-14T11:14:52.313446+0000","last_fullsized":"2023-10-14T11:14:52.313446+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:59:56.995911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.588105+0000","last_change":"2023-10-14T11:14:49.586244+0000","last_active":"2023-10-14T11:14:50.588105+0000","last_peered":"2023-10-14T11:14:50.588105+0000","last_clean":"2023-10-14T11:14:50.588105+0000","last_became_active":"2023-10-14T11:14:49.585942+0000","last_became_peered":"2023-10-14T11:14:49.585942+0000","last_unstale":"2023-10-14T11:14:50.588105+0000","last_undegraded":"2023-10-14T11:14:50.588105+0000","last_fullsized":"2023-10-14T11:14:50.588105+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:59:55.988986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.601454+0000","last_change":"2023-10-14T11:14:50.622391+0000","last_active":"2023-10-14T11:14:51.601454+0000","last_peered":"2023-10-14T11:14:51.601454+0000","last_clean":"2023-10-14T11:14:51.601454+0000","last_became_active":"2023-10-14T11:14:50.620839+0000","last_became_peered":"2023-10-14T11:14:50.620839+0000","last_unstale":"2023-10-14T11:14:51.601454+0000","last_undegraded":"2023-10-14T11:14:51.601454+0000","last_fullsized":"2023-10-14T11:14:51.601454+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:29:08.569971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.583777+0000","last_change":"2023-10-14T11:14:49.580579+0000","last_active":"2023-10-14T11:14:50.583777+0000","last_peered":"2023-10-14T11:14:50.583777+0000","last_clean":"2023-10-14T11:14:50.583777+0000","last_became_active":"2023-10-14T11:14:49.579933+0000","last_became_peered":"2023-10-14T11:14:49.579933+0000","last_unstale":"2023-10-14T11:14:50.583777+0000","last_undegraded":"2023-10-14T11:14:50.583777+0000","last_fullsized":"2023-10-14T11:14:50.583777+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:38:14.938610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.604482+0000","last_change":"2023-10-14T11:14:50.616697+0000","last_active":"2023-10-14T11:14:51.604482+0000","last_peered":"2023-10-14T11:14:51.604482+0000","last_clean":"2023-10-14T11:14:51.604482+0000","last_became_active":"2023-10-14T11:14:50.616402+0000","last_became_peered":"2023-10-14T11:14:50.616402+0000","last_unstale":"2023-10-14T11:14:51.604482+0000","last_undegraded":"2023-10-14T11:14:51.604482+0000","last_fullsized":"2023-10-14T11:14:51.604482+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:46:42.633987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.592609+0000","last_change":"2023-10-14T11:14:49.598108+0000","last_active":"2023-10-14T11:14:50.592609+0000","last_peered":"2023-10-14T11:14:50.592609+0000","last_clean":"2023-10-14T11:14:50.592609+0000","last_became_active":"2023-10-14T11:14:49.597536+0000","last_became_peered":"2023-10-14T11:14:49.597536+0000","last_unstale":"2023-10-14T11:14:50.592609+0000","last_undegraded":"2023-10-14T11:14:50.592609+0000","last_fullsized":"2023-10-14T11:14:50.592609+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:03:47.004535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.382892+0000","last_change":"2023-10-14T11:14:50.591501+0000","last_active":"2023-10-14T11:14:52.382892+0000","last_peered":"2023-10-14T11:14:52.382892+0000","last_clean":"2023-10-14T11:14:52.382892+0000","last_became_active":"2023-10-14T11:14:50.591221+0000","last_became_peered":"2023-10-14T11:14:50.591221+0000","last_unstale":"2023-10-14T11:14:52.382892+0000","last_undegraded":"2023-10-14T11:14:52.382892+0000","last_fullsized":"2023-10-14T11:14:52.382892+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:49:35.500310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.583543+0000","last_change":"2023-10-14T11:14:49.599033+0000","last_active":"2023-10-14T11:14:50.583543+0000","last_peered":"2023-10-14T11:14:50.583543+0000","last_clean":"2023-10-14T11:14:50.583543+0000","last_became_active":"2023-10-14T11:14:49.598735+0000","last_became_peered":"2023-10-14T11:14:49.598735+0000","last_unstale":"2023-10-14T11:14:50.583543+0000","last_undegraded":"2023-10-14T11:14:50.583543+0000","last_fullsized":"2023-10-14T11:14:50.583543+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:38.318607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.601495+0000","last_change":"2023-10-14T11:14:50.621068+0000","last_active":"2023-10-14T11:14:51.601495+0000","last_peered":"2023-10-14T11:14:51.601495+0000","last_clean":"2023-10-14T11:14:51.601495+0000","last_became_active":"2023-10-14T11:14:50.620807+0000","last_became_peered":"2023-10-14T11:14:50.620807+0000","last_unstale":"2023-10-14T11:14:51.601495+0000","last_undegraded":"2023-10-14T11:14:51.601495+0000","last_fullsized":"2023-10-14T11:14:51.601495+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:31:52.681912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.601637+0000","last_change":"2023-10-14T11:14:49.585845+0000","last_active":"2023-10-14T11:14:50.601637+0000","last_peered":"2023-10-14T11:14:50.601637+0000","last_clean":"2023-10-14T11:14:50.601637+0000","last_became_active":"2023-10-14T11:14:49.585545+0000","last_became_peered":"2023-10-14T11:14:49.585545+0000","last_unstale":"2023-10-14T11:14:50.601637+0000","last_undegraded":"2023-10-14T11:14:50.601637+0000","last_fullsized":"2023-10-14T11:14:50.601637+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:45:10.777200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.601238+0000","last_change":"2023-10-14T11:14:50.606866+0000","last_active":"2023-10-14T11:14:51.601238+0000","last_peered":"2023-10-14T11:14:51.601238+0000","last_clean":"2023-10-14T11:14:51.601238+0000","last_became_active":"2023-10-14T11:14:50.606614+0000","last_became_peered":"2023-10-14T11:14:50.606614+0000","last_unstale":"2023-10-14T11:14:51.601238+0000","last_undegraded":"2023-10-14T11:14:51.601238+0000","last_fullsized":"2023-10-14T11:14:51.601238+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:21.349936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.585802+0000","last_change":"2023-10-14T11:14:49.593770+0000","last_active":"2023-10-14T11:14:50.585802+0000","last_peered":"2023-10-14T11:14:50.585802+0000","last_clean":"2023-10-14T11:14:50.585802+0000","last_became_active":"2023-10-14T11:14:49.593086+0000","last_became_peered":"2023-10-14T11:14:49.593086+0000","last_unstale":"2023-10-14T11:14:50.585802+0000","last_undegraded":"2023-10-14T11:14:50.585802+0000","last_fullsized":"2023-10-14T11:14:50.585802+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:46:30.968779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":193,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.594274+0000","last_change":"2023-10-14T11:12:12.162289+0000","last_active":"2023-10-14T11:14:50.594274+0000","last_peered":"2023-10-14T11:14:50.594274+0000","last_clean":"2023-10-14T11:14:50.594274+0000","last_became_active":"2023-10-14T11:12:12.161055+0000","last_became_peered":"2023-10-14T11:12:12.161055+0000","last_unstale":"2023-10-14T11:14:50.594274+0000","last_undegraded":"2023-10-14T11:14:50.594274+0000","last_fullsized":"2023-10-14T11:14:50.594274+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_clean_scrub_stamp":"2023-10-14T11:12:10.853576+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:52.154107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1261568,"data_stored":885112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.81399999999999995,"15min":0.83999999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.95099999999999996,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.434,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.57199999999999995}]},{"osd":1,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68799999999999994,"15min":0.69699999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97999999999999998,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.443,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97099999999999997,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.68000000000000005}]},{"osd":2,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.84699999999999998,"15min":0.86499999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.081,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.628},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.80000000000000004,"15min":0.81599999999999995},"min":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96599999999999997,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.66100000000000003}]},{"osd":3,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.80400000000000005,"15min":0.82799999999999996},"min":{"1min":0.52300000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92500000000000004,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.86099999999999999,"15min":0.88300000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.014,"5min":3.5489999999999999,"15min":3.5489999999999999},"last":0.71499999999999997}]},{"osd":4,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.65800000000000003,"15min":0.66100000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.99299999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.52900000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94399999999999995,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.59499999999999997}]},{"osd":5,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69699999999999995,"15min":0.70199999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.96899999999999997,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.752,"15min":0.76300000000000001},"min":{"1min":0.442,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92100000000000004,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.61399999999999999}]},{"osd":6,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.80500000000000005,"15min":0.81699999999999995},"min":{"1min":0.60399999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.97299999999999998,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.78100000000000003,"15min":0.79400000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97499999999999998,"5min":1.395,"15min":1.395},"last":0.64200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":659456,"data_stored":294584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.372,"5min":0.315,"15min":0.315},"max":{"1min":0.85599999999999998,"5min":1.244,"15min":1.244},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.53600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.87,"5min":1.331,"15min":1.331},"last":0.74099999999999999}]},{"osd":1,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67900000000000005,"15min":0.68700000000000006},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.75700000000000001,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.69699999999999995,"15min":0.70499999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88300000000000001,"5min":1.304,"15min":1.304},"last":0.69099999999999995}]},{"osd":2,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.71399999999999997,"15min":0.73099999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90200000000000002,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.748,"15min":0.76100000000000001},"min":{"1min":0.53300000000000003,"5min":0.443,"15min":0.443},"max":{"1min":0.84199999999999997,"5min":1.845,"15min":1.845},"last":0.57799999999999996}]},{"osd":3,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.79000000000000004,"15min":0.80800000000000005},"min":{"1min":0.50700000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.91600000000000004,"5min":1.627,"15min":1.627},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.69499999999999995,"15min":0.70199999999999996},"min":{"1min":0.52000000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.83599999999999997,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.60599999999999998}]},{"osd":4,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70299999999999996,"15min":0.71299999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.97199999999999998,"5min":1.206,"15min":1.206},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.48599999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84299999999999997,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.54900000000000004}]},{"osd":5,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.878,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92800000000000005,"5min":1.425,"15min":1.425},"last":0.86199999999999999}]},{"osd":7,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.76400000000000001,"15min":0.78200000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81399999999999995,"5min":1.502,"15min":1.502},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77500000000000002,"15min":0.78700000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.94799999999999995,"5min":1.609,"15min":1.609},"last":0.78500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31832,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":667648,"data_stored":295236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63300000000000001,"15min":0.63},"min":{"1min":0.51300000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.68100000000000005,"15min":0.68899999999999995},"min":{"1min":0.46300000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.86599999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.72399999999999998}]},{"osd":1,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.70899999999999996,"15min":0.70199999999999996},"min":{"1min":0.55800000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0309999999999999,"5min":1.181,"15min":1.181},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64900000000000002,"15min":0.64800000000000002},"min":{"1min":0.46600000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.88300000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.753}]},{"osd":2,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67800000000000005,"15min":0.68000000000000005},"min":{"1min":0.48799999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91800000000000004,"5min":1.024,"15min":1.024},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.51000000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85499999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.74099999999999999}]},{"osd":3,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73299999999999998,"15min":0.73599999999999999},"min":{"1min":0.52200000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89600000000000002,"5min":1.405,"15min":1.405},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72999999999999998,"15min":0.73099999999999998},"min":{"1min":0.53600000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92700000000000005,"5min":1.22,"15min":1.22},"last":0.79100000000000004}]},{"osd":4,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82899999999999996,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.5},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.88400000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.46000000000000002}]},{"osd":6,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53800000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.91100000000000003,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.57599999999999996}]},{"osd":7,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77800000000000002,"15min":0.77900000000000003},"min":{"1min":0.52300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95899999999999996,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.60299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0169999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":671744,"data_stored":296196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.70899999999999996,"15min":0.72499999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.81299999999999994,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.497,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80700000000000005,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.96599999999999997}]},{"osd":1,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69699999999999995,"15min":0.70299999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.82899999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77300000000000002,"15min":0.78700000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85499999999999998,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.88100000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.79900000000000004,"15min":0.81499999999999995},"min":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.89100000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.76100000000000001,"15min":0.77500000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94099999999999995,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.83499999999999996}]},{"osd":3,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73899999999999999,"15min":0.746},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97699999999999998,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.78000000000000003,"15min":0.78700000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.879,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.94499999999999995}]},{"osd":5,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.71699999999999997,"15min":0.72699999999999998},"min":{"1min":0.45400000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.94099999999999995,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68300000000000005,"15min":0.68500000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86199999999999999,"5min":1.349,"15min":1.349},"last":0.71899999999999997}]},{"osd":6,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.745,"15min":0.749},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95099999999999996,"5min":1.306,"15min":1.306},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.77900000000000003,"15min":0.79300000000000004},"min":{"1min":0.51800000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92200000000000004,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.68600000000000005}]},{"osd":7,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.91100000000000003,"5min":1.163,"15min":1.163},"last":1.02},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.85699999999999998,"15min":0.86799999999999999},"min":{"1min":0.55400000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.93500000000000005,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.86699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31840,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340000,"statfs":{"total":96636764160,"available":96604160000,"internally_reserved":0,"allocated":667648,"data_stored":294640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.45800000000000002,"15min":0.46700000000000003},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.70899999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.45100000000000001,"15min":0.45500000000000002},"min":{"1min":0.30199999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.39800000000000002}]},{"osd":1,"last update":"Sat Oct 14 11:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.47099999999999997,"15min":0.48199999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58599999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.53600000000000003,"15min":0.54600000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.47299999999999998}]},{"osd":2,"last update":"Sat Oct 14 11:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.373,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72399999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.59299999999999997,"15min":0.60599999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79400000000000004,"5min":1.018,"15min":1.018},"last":0.42799999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.77600000000000002,"15min":0.79100000000000004},"min":{"1min":0.496,"5min":0.443,"15min":0.443},"max":{"1min":0.90200000000000002,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76800000000000002,"15min":0.77800000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.86899999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.59699999999999998}]},{"osd":5,"last update":"Sat Oct 14 11:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.51700000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.92100000000000004,"5min":1.375,"15min":1.375},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.79000000000000004,"15min":0.80600000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86199999999999999,"5min":1.286,"15min":1.286},"last":0.51000000000000001}]},{"osd":6,"last update":"Sat Oct 14 11:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.98799999999999999,"5min":1.46,"15min":1.46},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.79500000000000004,"15min":0.80900000000000005},"min":{"1min":0.53800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97999999999999998,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.66100000000000003}]},{"osd":7,"last update":"Sat Oct 14 11:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78300000000000003,"15min":0.79400000000000004},"min":{"1min":0.53200000000000003,"5min":0.503,"15min":0.503},"max":{"1min":0.91000000000000003,"5min":1.222,"15min":1.222},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.80800000000000005,"15min":0.81399999999999995},"min":{"1min":0.626,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":0.997,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.68400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31832,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":667648,"data_stored":294640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.47499999999999998,"15min":0.48699999999999999},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69899999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.443},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.49099999999999999,"15min":0.505},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58999999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.52400000000000002}]},{"osd":1,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55300000000000005,"15min":0.56200000000000006},"min":{"1min":0.39500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70799999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79400000000000004,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.57799999999999996}]},{"osd":3,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.48199999999999998,"15min":0.48799999999999999},"min":{"1min":0.32700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63300000000000001,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.56799999999999995,"15min":0.57999999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.64300000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.55200000000000005}]},{"osd":4,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.55000000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.99199999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77000000000000002,"15min":0.77600000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.004,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.81799999999999995}]},{"osd":5,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.77800000000000002,"15min":0.79000000000000004},"min":{"1min":0.43099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92800000000000005,"5min":1.073,"15min":1.073},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.82199999999999995,"15min":0.84199999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91000000000000003,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.83799999999999997}]},{"osd":6,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96199999999999997,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.85899999999999999,"15min":0.88},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.96999999999999997,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.77000000000000002}]},{"osd":7,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.84599999999999997,"15min":0.86199999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94799999999999995,"5min":1.3,"15min":1.3},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.84699999999999998,"15min":0.86599999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.98299999999999998,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.879}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":663552,"data_stored":294674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.40600000000000003,"15min":0.40999999999999998},"min":{"1min":0.309,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66300000000000003,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.55800000000000005,"15min":0.56599999999999995},"min":{"1min":0.41299999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77700000000000002,"5min":1.244,"15min":1.244},"last":0.55900000000000005}]},{"osd":2,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.438,"15min":0.432},"min":{"1min":0.313,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.375},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46700000000000003,"15min":0.46899999999999997},"min":{"1min":0.35699999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.66500000000000004,"5min":0.753,"15min":0.753},"last":0.47299999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.36599999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.55900000000000005,"15min":0.56599999999999995},"min":{"1min":0.39900000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.81200000000000006,"5min":1.081,"15min":1.081},"last":0.61499999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0780000000000001,"5min":1.629,"15min":1.629},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.93700000000000006,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.76500000000000001}]},{"osd":5,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0289999999999999,"5min":1.296,"15min":1.296},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.80700000000000005,"15min":0.81999999999999995},"min":{"1min":0.53400000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.002,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":0.74199999999999999}]},{"osd":6,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.752,"15min":0.75600000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.99199999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.79900000000000004,"15min":0.81299999999999994},"min":{"1min":0.54800000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94899999999999995,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.78900000000000003}]},{"osd":7,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.83099999999999996,"15min":0.84499999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.98899999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.77600000000000002,"15min":0.79200000000000004},"min":{"1min":0.51200000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.874,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.66500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1269760,"data_stored":887146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 11:14:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.45400000000000001,"15min":0.46400000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.69699999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.752},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.51000000000000001,"15min":0.52000000000000002},"min":{"1min":0.373,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.55700000000000005,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.96199999999999997}]},{"osd":2,"last update":"Sat Oct 14 11:14:11 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.52400000000000002,"15min":0.54000000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.59199999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.45800000000000002,"15min":0.46600000000000003},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69099999999999995,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.68100000000000005}]},{"osd":3,"last update":"Sat Oct 14 11:14:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.51200000000000001,"15min":0.52200000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80100000000000005,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.56999999999999995,"15min":0.58199999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.63300000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.89000000000000001}]},{"osd":4,"last update":"Sat Oct 14 11:14:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.73199999999999998,"15min":0.73899999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91100000000000003,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.202},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.77800000000000002,"15min":0.79400000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.80300000000000005,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.048}]},{"osd":5,"last update":"Sat Oct 14 11:14:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.997,"5min":1.431,"15min":1.431},"last":1.45},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.95699999999999996,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":1.7190000000000001}]},{"osd":6,"last update":"Sat Oct 14 11:14:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.80900000000000005,"15min":0.82699999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.96399999999999997,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.9330000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.79500000000000004,"15min":0.81200000000000006},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93999999999999995,"5min":1.536,"15min":1.536},"last":1.127}]},{"osd":7,"last update":"Sat Oct 14 11:14:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.83999999999999997,"15min":0.85799999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.97599999999999998,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":7.0880000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.93600000000000005,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":1.3700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:14:54.961 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:14:55.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.135+0000 7f879b679640 1 Processor -- start 2023-10-14T11:14:55.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.135+0000 7f879b679640 1 -- start start 2023-10-14T11:14:55.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.135+0000 7f879b679640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8794164520 0x7f87940ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:55.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.135+0000 7f879b679640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f87940ad960 0x7f87940b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:55.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.135+0000 7f879b679640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87940c96f0 con 0x7f87940c9b80 2023-10-14T11:14:55.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.135+0000 7f879b679640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8794164900 con 0x7f87940ad960 2023-10-14T11:14:55.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.135+0000 7f879b679640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87940cb950 con 0x7f8794164520 2023-10-14T11:14:55.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.135+0000 7f8799c16640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f87940c9b80 0x7f8794164ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48684/0 (socket says 172.21.15.26:48684) 2023-10-14T11:14:55.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.135+0000 7f8799c16640 1 -- 172.21.15.26:0/2942884689 learned_addr learned my addr 172.21.15.26:0/2942884689 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:55.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.135+0000 7f8799415640 1 --2- 172.21.15.26:0/2942884689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8794164520 0x7f87940ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:55.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.135+0000 7f8798c14640 1 --2- 172.21.15.26:0/2942884689 >> v2:172.21.15.110:3300/0 conn(0x7f87940ad960 0x7f87940b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:55.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.139+0000 7f878bfff640 1 -- 172.21.15.26:0/2942884689 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546894737 0 0) 0x7f87940c96f0 con 0x7f87940c9b80 2023-10-14T11:14:55.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.139+0000 7f878bfff640 1 -- 172.21.15.26:0/2942884689 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8780003530 con 0x7f87940c9b80 2023-10-14T11:14:55.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.139+0000 7f8798c14640 1 -- 172.21.15.26:0/2942884689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8794164520 msgr2=0x7f87940ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:55.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.139+0000 7f8798c14640 1 --2- 172.21.15.26:0/2942884689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8794164520 0x7f87940ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:55.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.139+0000 7f8798c14640 1 -- 172.21.15.26:0/2942884689 >> v1:172.21.15.26:6789/0 conn(0x7f87940c9b80 legacy=0x7f8794164ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:55.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.139+0000 7f8798c14640 1 -- 172.21.15.26:0/2942884689 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87940cbed0 con 0x7f87940ad960 2023-10-14T11:14:55.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.139+0000 7f8798c14640 1 --2- 172.21.15.26:0/2942884689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87940ad960 0x7f87940b00e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f87840097c0 tx=0x7f878401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6548fa719f4852 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:55.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.139+0000 7f878bfff640 1 -- 172.21.15.26:0/2942884689 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87840a7070 con 0x7f87940ad960 2023-10-14T11:14:55.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.139+0000 7f878bfff640 1 -- 172.21.15.26:0/2942884689 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87840ab430 con 0x7f87940ad960 2023-10-14T11:14:55.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.139+0000 7f878bfff640 1 -- 172.21.15.26:0/2942884689 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87840ab7c0 con 0x7f87940ad960 2023-10-14T11:14:55.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f879b679640 1 -- 172.21.15.26:0/2942884689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87940ad960 msgr2=0x7f87940b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:55.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f879b679640 1 --2- 172.21.15.26:0/2942884689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87940ad960 0x7f87940b00e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f87840097c0 tx=0x7f878401c450 comp rx=0 tx=0).stop 2023-10-14T11:14:55.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f879b679640 1 -- 172.21.15.26:0/2942884689 shutdown_connections 2023-10-14T11:14:55.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f879b679640 1 --2- 172.21.15.26:0/2942884689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87940ad960 0x7f87940b00e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:55.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f879b679640 1 --2- 172.21.15.26:0/2942884689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8794164520 0x7f87940ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:55.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f879b679640 1 -- 172.21.15.26:0/2942884689 >> 172.21.15.26:0/2942884689 conn(0x7f879406c190 msgr2=0x7f879406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:55.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f879b679640 1 -- 172.21.15.26:0/2942884689 shutdown_connections 2023-10-14T11:14:55.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f879b679640 1 -- 172.21.15.26:0/2942884689 wait complete. 2023-10-14T11:14:55.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f879b679640 1 Processor -- start 2023-10-14T11:14:55.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f879b679640 1 -- start start 2023-10-14T11:14:55.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f879b679640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87940ad960 0x7f87940b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:55.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f879b679640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87940c9b80 0x7f8794162380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:55.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f879b679640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8794164520 0x7f87940b2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:55.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f879b679640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87940b0d20 con 0x7f8794164520 2023-10-14T11:14:55.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f879b679640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87940b0fc0 con 0x7f87940ad960 2023-10-14T11:14:55.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f879b679640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87940b12a0 con 0x7f87940c9b80 2023-10-14T11:14:55.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f8799c16640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8794164520 0x7f87940b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:55.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f8799c16640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8794164520 0x7f87940b2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54432/0 (socket says 172.21.15.26:54432) 2023-10-14T11:14:55.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f8799c16640 1 -- 172.21.15.26:0/2369671997 learned_addr learned my addr 172.21.15.26:0/2369671997 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:55.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f8798c14640 1 --2- 172.21.15.26:0/2369671997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87940c9b80 0x7f8794162380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:55.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f8799415640 1 --2- 172.21.15.26:0/2369671997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87940ad960 0x7f87940b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:55.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f8799c16640 1 -- 172.21.15.26:0/2369671997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87940c9b80 msgr2=0x7f8794162380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:55.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f8799c16640 1 --2- 172.21.15.26:0/2369671997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87940c9b80 0x7f8794162380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:55.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f8799c16640 1 -- 172.21.15.26:0/2369671997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87940ad960 msgr2=0x7f87940b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:55.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f8799c16640 1 --2- 172.21.15.26:0/2369671997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87940ad960 0x7f87940b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:55.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.143+0000 7f8799c16640 1 -- 172.21.15.26:0/2369671997 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8784009420 con 0x7f8794164520 2023-10-14T11:14:55.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.147+0000 7f8799c16640 1 --2- 172.21.15.26:0/2369671997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8794164520 0x7f87940b2400 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f878c00c9c0 tx=0x7f878c00ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:55.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.147+0000 7f8789ffb640 1 -- 172.21.15.26:0/2369671997 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c00ab70 con 0x7f8794164520 2023-10-14T11:14:55.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.147+0000 7f8789ffb640 1 -- 172.21.15.26:0/2369671997 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878c00acd0 con 0x7f8794164520 2023-10-14T11:14:55.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.147+0000 7f8789ffb640 1 -- 172.21.15.26:0/2369671997 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c012600 con 0x7f8794164520 2023-10-14T11:14:55.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.147+0000 7f879b679640 1 -- 172.21.15.26:0/2369671997 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87940b1580 con 0x7f8794164520 2023-10-14T11:14:55.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.147+0000 7f879b679640 1 -- 172.21.15.26:0/2369671997 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8794161250 con 0x7f8794164520 2023-10-14T11:14:55.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.147+0000 7f879b679640 1 -- 172.21.15.26:0/2369671997 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8794074010 con 0x7f8794164520 2023-10-14T11:14:55.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.147+0000 7f8789ffb640 1 -- 172.21.15.26:0/2369671997 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f878c012760 con 0x7f8794164520 2023-10-14T11:14:55.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.147+0000 7f8789ffb640 1 --2- 172.21.15.26:0/2369671997 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f87780664a0 0x7f8778068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:55.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.147+0000 7f8789ffb640 1 -- 172.21.15.26:0/2369671997 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f878c083de0 con 0x7f8794164520 2023-10-14T11:14:55.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.147+0000 7f8799415640 1 --2- 172.21.15.26:0/2369671997 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f87780664a0 0x7f8778068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:55.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.151+0000 7f8799415640 1 --2- 172.21.15.26:0/2369671997 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f87780664a0 0x7f8778068960 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f879406d110 tx=0x7f8790009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:55.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.151+0000 7f8789ffb640 1 -- 172.21.15.26:0/2369671997 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f878c051120 con 0x7f8794164520 2023-10-14T11:14:55.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.307+0000 7f879b679640 1 -- 172.21.15.26:0/2369671997 --> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f87940ade60 con 0x7f87780664a0 2023-10-14T11:14:55.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.315+0000 7f8789ffb640 1 -- 172.21.15.26:0/2369671997 <== mgr.4101 v2:172.21.15.26:6832/4136446821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289548 (secure 0 0 0) 0x7f8790011a60 con 0x7f87780664a0 2023-10-14T11:14:55.325 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:55.327 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-14T11:14:55.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.319+0000 7f879b679640 1 -- 172.21.15.26:0/2369671997 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f87780664a0 msgr2=0x7f8778068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:55.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.319+0000 7f879b679640 1 --2- 172.21.15.26:0/2369671997 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f87780664a0 0x7f8778068960 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f879406d110 tx=0x7f8790009190 comp rx=0 tx=0).stop 2023-10-14T11:14:55.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.319+0000 7f879b679640 1 -- 172.21.15.26:0/2369671997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8794164520 msgr2=0x7f87940b2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:55.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.319+0000 7f879b679640 1 --2- 172.21.15.26:0/2369671997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8794164520 0x7f87940b2400 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f878c00c9c0 tx=0x7f878c00ce80 comp rx=0 tx=0).stop 2023-10-14T11:14:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.319+0000 7f879b679640 1 -- 172.21.15.26:0/2369671997 shutdown_connections 2023-10-14T11:14:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.319+0000 7f879b679640 1 --2- 172.21.15.26:0/2369671997 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f87780664a0 0x7f8778068960 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.319+0000 7f879b679640 1 --2- 172.21.15.26:0/2369671997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8794164520 0x7f87940b2400 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.319+0000 7f879b679640 1 --2- 172.21.15.26:0/2369671997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87940c9b80 0x7f8794162380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.319+0000 7f879b679640 1 --2- 172.21.15.26:0/2369671997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87940ad960 0x7f87940b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.319+0000 7f879b679640 1 -- 172.21.15.26:0/2369671997 >> 172.21.15.26:0/2369671997 conn(0x7f879406c190 msgr2=0x7f8794071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:55.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.319+0000 7f879b679640 1 -- 172.21.15.26:0/2369671997 shutdown_connections 2023-10-14T11:14:55.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.319+0000 7f879b679640 1 -- 172.21.15.26:0/2369671997 wait complete. 2023-10-14T11:14:55.346 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2023-10-14T11:14:54.192233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255832,"kb_used_data":6376,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718888,"statfs":{"total":773094113280,"available":772832141312,"internally_reserved":0,"allocated":6529024,"data_stored":3542228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":255315512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.629463"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.820092+0000","last_change":"2023-10-14T11:14:50.623497+0000","last_active":"2023-10-14T11:14:51.820092+0000","last_peered":"2023-10-14T11:14:51.820092+0000","last_clean":"2023-10-14T11:14:51.820092+0000","last_became_active":"2023-10-14T11:14:50.621054+0000","last_became_peered":"2023-10-14T11:14:50.621054+0000","last_unstale":"2023-10-14T11:14:51.820092+0000","last_undegraded":"2023-10-14T11:14:51.820092+0000","last_fullsized":"2023-10-14T11:14:51.820092+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:29:55.811449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.601984+0000","last_change":"2023-10-14T11:14:50.620467+0000","last_active":"2023-10-14T11:14:51.601984+0000","last_peered":"2023-10-14T11:14:51.601984+0000","last_clean":"2023-10-14T11:14:51.601984+0000","last_became_active":"2023-10-14T11:14:50.620194+0000","last_became_peered":"2023-10-14T11:14:50.620194+0000","last_unstale":"2023-10-14T11:14:51.601984+0000","last_undegraded":"2023-10-14T11:14:51.601984+0000","last_fullsized":"2023-10-14T11:14:51.601984+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:52:19.657086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.604417+0000","last_change":"2023-10-14T11:14:50.609399+0000","last_active":"2023-10-14T11:14:51.604417+0000","last_peered":"2023-10-14T11:14:51.604417+0000","last_clean":"2023-10-14T11:14:51.604417+0000","last_became_active":"2023-10-14T11:14:50.608727+0000","last_became_peered":"2023-10-14T11:14:50.608727+0000","last_unstale":"2023-10-14T11:14:51.604417+0000","last_undegraded":"2023-10-14T11:14:51.604417+0000","last_fullsized":"2023-10-14T11:14:51.604417+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:40:25.562519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.383898+0000","last_change":"2023-10-14T11:14:50.614976+0000","last_active":"2023-10-14T11:14:52.383898+0000","last_peered":"2023-10-14T11:14:52.383898+0000","last_clean":"2023-10-14T11:14:52.383898+0000","last_became_active":"2023-10-14T11:14:50.614669+0000","last_became_peered":"2023-10-14T11:14:50.614669+0000","last_unstale":"2023-10-14T11:14:52.383898+0000","last_undegraded":"2023-10-14T11:14:52.383898+0000","last_fullsized":"2023-10-14T11:14:52.383898+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:31:39.409712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.820062+0000","last_change":"2023-10-14T11:14:50.614734+0000","last_active":"2023-10-14T11:14:51.820062+0000","last_peered":"2023-10-14T11:14:51.820062+0000","last_clean":"2023-10-14T11:14:51.820062+0000","last_became_active":"2023-10-14T11:14:50.614405+0000","last_became_peered":"2023-10-14T11:14:50.614405+0000","last_unstale":"2023-10-14T11:14:51.820062+0000","last_undegraded":"2023-10-14T11:14:51.820062+0000","last_fullsized":"2023-10-14T11:14:51.820062+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:55:30.024247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.313102+0000","last_change":"2023-10-14T11:14:50.609839+0000","last_active":"2023-10-14T11:14:52.313102+0000","last_peered":"2023-10-14T11:14:52.313102+0000","last_clean":"2023-10-14T11:14:52.313102+0000","last_became_active":"2023-10-14T11:14:50.609586+0000","last_became_peered":"2023-10-14T11:14:50.609586+0000","last_unstale":"2023-10-14T11:14:52.313102+0000","last_undegraded":"2023-10-14T11:14:52.313102+0000","last_fullsized":"2023-10-14T11:14:52.313102+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:28:19.399632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.603408+0000","last_change":"2023-10-14T11:14:50.617940+0000","last_active":"2023-10-14T11:14:51.603408+0000","last_peered":"2023-10-14T11:14:51.603408+0000","last_clean":"2023-10-14T11:14:51.603408+0000","last_became_active":"2023-10-14T11:14:50.617623+0000","last_became_peered":"2023-10-14T11:14:50.617623+0000","last_unstale":"2023-10-14T11:14:51.603408+0000","last_undegraded":"2023-10-14T11:14:51.603408+0000","last_fullsized":"2023-10-14T11:14:51.603408+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:34:49.405847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.601237+0000","last_change":"2023-10-14T11:14:50.616844+0000","last_active":"2023-10-14T11:14:51.601237+0000","last_peered":"2023-10-14T11:14:51.601237+0000","last_clean":"2023-10-14T11:14:51.601237+0000","last_became_active":"2023-10-14T11:14:50.616561+0000","last_became_peered":"2023-10-14T11:14:50.616561+0000","last_unstale":"2023-10-14T11:14:51.601237+0000","last_undegraded":"2023-10-14T11:14:51.601237+0000","last_fullsized":"2023-10-14T11:14:51.601237+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:17.315084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.604043+0000","last_change":"2023-10-14T11:14:50.612793+0000","last_active":"2023-10-14T11:14:51.604043+0000","last_peered":"2023-10-14T11:14:51.604043+0000","last_clean":"2023-10-14T11:14:51.604043+0000","last_became_active":"2023-10-14T11:14:50.612525+0000","last_became_peered":"2023-10-14T11:14:50.612525+0000","last_unstale":"2023-10-14T11:14:51.604043+0000","last_undegraded":"2023-10-14T11:14:51.604043+0000","last_fullsized":"2023-10-14T11:14:51.604043+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:18:03.370461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.383508+0000","last_change":"2023-10-14T11:14:50.591622+0000","last_active":"2023-10-14T11:14:52.383508+0000","last_peered":"2023-10-14T11:14:52.383508+0000","last_clean":"2023-10-14T11:14:52.383508+0000","last_became_active":"2023-10-14T11:14:50.590778+0000","last_became_peered":"2023-10-14T11:14:50.590778+0000","last_unstale":"2023-10-14T11:14:52.383508+0000","last_undegraded":"2023-10-14T11:14:52.383508+0000","last_fullsized":"2023-10-14T11:14:52.383508+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:18:03.370461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.383500+0000","last_change":"2023-10-14T11:14:50.617259+0000","last_active":"2023-10-14T11:14:52.383500+0000","last_peered":"2023-10-14T11:14:52.383500+0000","last_clean":"2023-10-14T11:14:52.383500+0000","last_became_active":"2023-10-14T11:14:50.616950+0000","last_became_peered":"2023-10-14T11:14:50.616950+0000","last_unstale":"2023-10-14T11:14:52.383500+0000","last_undegraded":"2023-10-14T11:14:52.383500+0000","last_fullsized":"2023-10-14T11:14:52.383500+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:11.327501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.384139+0000","last_change":"2023-10-14T11:14:50.610445+0000","last_active":"2023-10-14T11:14:52.384139+0000","last_peered":"2023-10-14T11:14:52.384139+0000","last_clean":"2023-10-14T11:14:52.384139+0000","last_became_active":"2023-10-14T11:14:50.610180+0000","last_became_peered":"2023-10-14T11:14:50.610180+0000","last_unstale":"2023-10-14T11:14:52.384139+0000","last_undegraded":"2023-10-14T11:14:52.384139+0000","last_fullsized":"2023-10-14T11:14:52.384139+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:32:55.394335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.384418+0000","last_change":"2023-10-14T11:14:50.604876+0000","last_active":"2023-10-14T11:14:52.384418+0000","last_peered":"2023-10-14T11:14:52.384418+0000","last_clean":"2023-10-14T11:14:52.384418+0000","last_became_active":"2023-10-14T11:14:50.604229+0000","last_became_peered":"2023-10-14T11:14:50.604229+0000","last_unstale":"2023-10-14T11:14:52.384418+0000","last_undegraded":"2023-10-14T11:14:52.384418+0000","last_fullsized":"2023-10-14T11:14:52.384418+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:10.986672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.603241+0000","last_change":"2023-10-14T11:14:50.613055+0000","last_active":"2023-10-14T11:14:51.603241+0000","last_peered":"2023-10-14T11:14:51.603241+0000","last_clean":"2023-10-14T11:14:51.603241+0000","last_became_active":"2023-10-14T11:14:50.612763+0000","last_became_peered":"2023-10-14T11:14:50.612763+0000","last_unstale":"2023-10-14T11:14:51.603241+0000","last_undegraded":"2023-10-14T11:14:51.603241+0000","last_fullsized":"2023-10-14T11:14:51.603241+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:11:44.705742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.602928+0000","last_change":"2023-10-14T11:14:50.611176+0000","last_active":"2023-10-14T11:14:51.602928+0000","last_peered":"2023-10-14T11:14:51.602928+0000","last_clean":"2023-10-14T11:14:51.602928+0000","last_became_active":"2023-10-14T11:14:50.610228+0000","last_became_peered":"2023-10-14T11:14:50.610228+0000","last_unstale":"2023-10-14T11:14:51.602928+0000","last_undegraded":"2023-10-14T11:14:51.602928+0000","last_fullsized":"2023-10-14T11:14:51.602928+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:49:35.500310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.313119+0000","last_change":"2023-10-14T11:14:50.600014+0000","last_active":"2023-10-14T11:14:52.313119+0000","last_peered":"2023-10-14T11:14:52.313119+0000","last_clean":"2023-10-14T11:14:52.313119+0000","last_became_active":"2023-10-14T11:14:50.599689+0000","last_became_peered":"2023-10-14T11:14:50.599689+0000","last_unstale":"2023-10-14T11:14:52.313119+0000","last_undegraded":"2023-10-14T11:14:52.313119+0000","last_fullsized":"2023-10-14T11:14:52.313119+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:12.503993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.602002+0000","last_change":"2023-10-14T11:14:50.622928+0000","last_active":"2023-10-14T11:14:51.602002+0000","last_peered":"2023-10-14T11:14:51.602002+0000","last_clean":"2023-10-14T11:14:51.602002+0000","last_became_active":"2023-10-14T11:14:50.622671+0000","last_became_peered":"2023-10-14T11:14:50.622671+0000","last_unstale":"2023-10-14T11:14:51.602002+0000","last_undegraded":"2023-10-14T11:14:51.602002+0000","last_fullsized":"2023-10-14T11:14:51.602002+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:11:44.980335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.604679+0000","last_change":"2023-10-14T11:14:50.623477+0000","last_active":"2023-10-14T11:14:51.604679+0000","last_peered":"2023-10-14T11:14:51.604679+0000","last_clean":"2023-10-14T11:14:51.604679+0000","last_became_active":"2023-10-14T11:14:50.623174+0000","last_became_peered":"2023-10-14T11:14:50.623174+0000","last_unstale":"2023-10-14T11:14:51.604679+0000","last_undegraded":"2023-10-14T11:14:51.604679+0000","last_fullsized":"2023-10-14T11:14:51.604679+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:06:41.595984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.820033+0000","last_change":"2023-10-14T11:14:50.621400+0000","last_active":"2023-10-14T11:14:51.820033+0000","last_peered":"2023-10-14T11:14:51.820033+0000","last_clean":"2023-10-14T11:14:51.820033+0000","last_became_active":"2023-10-14T11:14:50.621076+0000","last_became_peered":"2023-10-14T11:14:50.621076+0000","last_unstale":"2023-10-14T11:14:51.820033+0000","last_undegraded":"2023-10-14T11:14:51.820033+0000","last_fullsized":"2023-10-14T11:14:51.820033+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:21:08.226623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.602054+0000","last_change":"2023-10-14T11:14:50.611184+0000","last_active":"2023-10-14T11:14:51.602054+0000","last_peered":"2023-10-14T11:14:51.602054+0000","last_clean":"2023-10-14T11:14:51.602054+0000","last_became_active":"2023-10-14T11:14:50.610906+0000","last_became_peered":"2023-10-14T11:14:50.610906+0000","last_unstale":"2023-10-14T11:14:51.602054+0000","last_undegraded":"2023-10-14T11:14:51.602054+0000","last_fullsized":"2023-10-14T11:14:51.602054+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:58:17.538004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.604309+0000","last_change":"2023-10-14T11:14:50.614095+0000","last_active":"2023-10-14T11:14:51.604309+0000","last_peered":"2023-10-14T11:14:51.604309+0000","last_clean":"2023-10-14T11:14:51.604309+0000","last_became_active":"2023-10-14T11:14:50.613618+0000","last_became_peered":"2023-10-14T11:14:50.613618+0000","last_unstale":"2023-10-14T11:14:51.604309+0000","last_undegraded":"2023-10-14T11:14:51.604309+0000","last_fullsized":"2023-10-14T11:14:51.604309+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:31:39.409712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.601347+0000","last_change":"2023-10-14T11:14:50.625766+0000","last_active":"2023-10-14T11:14:51.601347+0000","last_peered":"2023-10-14T11:14:51.601347+0000","last_clean":"2023-10-14T11:14:51.601347+0000","last_became_active":"2023-10-14T11:14:50.625513+0000","last_became_peered":"2023-10-14T11:14:50.625513+0000","last_unstale":"2023-10-14T11:14:51.601347+0000","last_undegraded":"2023-10-14T11:14:51.601347+0000","last_fullsized":"2023-10-14T11:14:51.601347+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:24:07.505052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.603672+0000","last_change":"2023-10-14T11:14:50.617007+0000","last_active":"2023-10-14T11:14:51.603672+0000","last_peered":"2023-10-14T11:14:51.603672+0000","last_clean":"2023-10-14T11:14:51.603672+0000","last_became_active":"2023-10-14T11:14:50.616663+0000","last_became_peered":"2023-10-14T11:14:50.616663+0000","last_unstale":"2023-10-14T11:14:51.603672+0000","last_undegraded":"2023-10-14T11:14:51.603672+0000","last_fullsized":"2023-10-14T11:14:51.603672+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:59:56.995911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.383741+0000","last_change":"2023-10-14T11:14:50.606838+0000","last_active":"2023-10-14T11:14:52.383741+0000","last_peered":"2023-10-14T11:14:52.383741+0000","last_clean":"2023-10-14T11:14:52.383741+0000","last_became_active":"2023-10-14T11:14:50.604926+0000","last_became_peered":"2023-10-14T11:14:50.604926+0000","last_unstale":"2023-10-14T11:14:52.383741+0000","last_undegraded":"2023-10-14T11:14:52.383741+0000","last_fullsized":"2023-10-14T11:14:52.383741+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:29:52.786200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.820173+0000","last_change":"2023-10-14T11:14:50.607951+0000","last_active":"2023-10-14T11:14:51.820173+0000","last_peered":"2023-10-14T11:14:51.820173+0000","last_clean":"2023-10-14T11:14:51.820173+0000","last_became_active":"2023-10-14T11:14:50.607698+0000","last_became_peered":"2023-10-14T11:14:50.607698+0000","last_unstale":"2023-10-14T11:14:51.820173+0000","last_undegraded":"2023-10-14T11:14:51.820173+0000","last_fullsized":"2023-10-14T11:14:51.820173+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:50:22.521940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.384542+0000","last_change":"2023-10-14T11:14:50.609132+0000","last_active":"2023-10-14T11:14:52.384542+0000","last_peered":"2023-10-14T11:14:52.384542+0000","last_clean":"2023-10-14T11:14:52.384542+0000","last_became_active":"2023-10-14T11:14:50.608839+0000","last_became_peered":"2023-10-14T11:14:50.608839+0000","last_unstale":"2023-10-14T11:14:52.384542+0000","last_undegraded":"2023-10-14T11:14:52.384542+0000","last_fullsized":"2023-10-14T11:14:52.384542+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:35:16.819102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.313178+0000","last_change":"2023-10-14T11:14:50.600136+0000","last_active":"2023-10-14T11:14:52.313178+0000","last_peered":"2023-10-14T11:14:52.313178+0000","last_clean":"2023-10-14T11:14:52.313178+0000","last_became_active":"2023-10-14T11:14:50.599837+0000","last_became_peered":"2023-10-14T11:14:50.599837+0000","last_unstale":"2023-10-14T11:14:52.313178+0000","last_undegraded":"2023-10-14T11:14:52.313178+0000","last_fullsized":"2023-10-14T11:14:52.313178+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:29:03.443328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.820034+0000","last_change":"2023-10-14T11:14:50.618778+0000","last_active":"2023-10-14T11:14:51.820034+0000","last_peered":"2023-10-14T11:14:51.820034+0000","last_clean":"2023-10-14T11:14:51.820034+0000","last_became_active":"2023-10-14T11:14:50.618411+0000","last_became_peered":"2023-10-14T11:14:50.618411+0000","last_unstale":"2023-10-14T11:14:51.820034+0000","last_undegraded":"2023-10-14T11:14:51.820034+0000","last_fullsized":"2023-10-14T11:14:51.820034+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:25.389075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.601745+0000","last_change":"2023-10-14T11:14:50.615706+0000","last_active":"2023-10-14T11:14:51.601745+0000","last_peered":"2023-10-14T11:14:51.601745+0000","last_clean":"2023-10-14T11:14:51.601745+0000","last_became_active":"2023-10-14T11:14:50.615423+0000","last_became_peered":"2023-10-14T11:14:50.615423+0000","last_unstale":"2023-10-14T11:14:51.601745+0000","last_undegraded":"2023-10-14T11:14:51.601745+0000","last_fullsized":"2023-10-14T11:14:51.601745+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:24:02.275351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.604184+0000","last_change":"2023-10-14T11:14:50.611246+0000","last_active":"2023-10-14T11:14:51.604184+0000","last_peered":"2023-10-14T11:14:51.604184+0000","last_clean":"2023-10-14T11:14:51.604184+0000","last_became_active":"2023-10-14T11:14:50.610935+0000","last_became_peered":"2023-10-14T11:14:50.610935+0000","last_unstale":"2023-10-14T11:14:51.604184+0000","last_undegraded":"2023-10-14T11:14:51.604184+0000","last_fullsized":"2023-10-14T11:14:51.604184+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:09:29.010723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.819872+0000","last_change":"2023-10-14T11:14:50.606809+0000","last_active":"2023-10-14T11:14:51.819872+0000","last_peered":"2023-10-14T11:14:51.819872+0000","last_clean":"2023-10-14T11:14:51.819872+0000","last_became_active":"2023-10-14T11:14:50.606510+0000","last_became_peered":"2023-10-14T11:14:50.606510+0000","last_unstale":"2023-10-14T11:14:51.819872+0000","last_undegraded":"2023-10-14T11:14:51.819872+0000","last_fullsized":"2023-10-14T11:14:51.819872+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:25.025219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.313578+0000","last_change":"2023-10-14T11:14:50.610089+0000","last_active":"2023-10-14T11:14:52.313578+0000","last_peered":"2023-10-14T11:14:52.313578+0000","last_clean":"2023-10-14T11:14:52.313578+0000","last_became_active":"2023-10-14T11:14:50.609485+0000","last_became_peered":"2023-10-14T11:14:50.609485+0000","last_unstale":"2023-10-14T11:14:52.313578+0000","last_undegraded":"2023-10-14T11:14:52.313578+0000","last_fullsized":"2023-10-14T11:14:52.313578+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:09:29.010723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.313635+0000","last_change":"2023-10-14T11:14:50.617575+0000","last_active":"2023-10-14T11:14:52.313635+0000","last_peered":"2023-10-14T11:14:52.313635+0000","last_clean":"2023-10-14T11:14:52.313635+0000","last_became_active":"2023-10-14T11:14:50.617044+0000","last_became_peered":"2023-10-14T11:14:50.617044+0000","last_unstale":"2023-10-14T11:14:52.313635+0000","last_undegraded":"2023-10-14T11:14:52.313635+0000","last_fullsized":"2023-10-14T11:14:52.313635+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:31:39.409712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.619616+0000","last_change":"2023-10-14T11:14:49.595574+0000","last_active":"2023-10-14T11:14:50.619616+0000","last_peered":"2023-10-14T11:14:50.619616+0000","last_clean":"2023-10-14T11:14:50.619616+0000","last_became_active":"2023-10-14T11:14:49.595227+0000","last_became_peered":"2023-10-14T11:14:49.595227+0000","last_unstale":"2023-10-14T11:14:50.619616+0000","last_undegraded":"2023-10-14T11:14:50.619616+0000","last_fullsized":"2023-10-14T11:14:50.619616+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:23:45.760710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.383552+0000","last_change":"2023-10-14T11:14:50.606707+0000","last_active":"2023-10-14T11:14:52.383552+0000","last_peered":"2023-10-14T11:14:52.383552+0000","last_clean":"2023-10-14T11:14:52.383552+0000","last_became_active":"2023-10-14T11:14:50.606425+0000","last_became_peered":"2023-10-14T11:14:50.606425+0000","last_unstale":"2023-10-14T11:14:52.383552+0000","last_undegraded":"2023-10-14T11:14:52.383552+0000","last_fullsized":"2023-10-14T11:14:52.383552+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:15:29.868189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.620046+0000","last_change":"2023-10-14T11:14:49.594071+0000","last_active":"2023-10-14T11:14:50.620046+0000","last_peered":"2023-10-14T11:14:50.620046+0000","last_clean":"2023-10-14T11:14:50.620046+0000","last_became_active":"2023-10-14T11:14:49.593138+0000","last_became_peered":"2023-10-14T11:14:49.593138+0000","last_unstale":"2023-10-14T11:14:50.620046+0000","last_undegraded":"2023-10-14T11:14:50.620046+0000","last_fullsized":"2023-10-14T11:14:50.620046+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:40.036746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.313362+0000","last_change":"2023-10-14T11:14:50.608877+0000","last_active":"2023-10-14T11:14:52.313362+0000","last_peered":"2023-10-14T11:14:52.313362+0000","last_clean":"2023-10-14T11:14:52.313362+0000","last_became_active":"2023-10-14T11:14:50.608568+0000","last_became_peered":"2023-10-14T11:14:50.608568+0000","last_unstale":"2023-10-14T11:14:52.313362+0000","last_undegraded":"2023-10-14T11:14:52.313362+0000","last_fullsized":"2023-10-14T11:14:52.313362+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:39.247115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.613866+0000","last_change":"2023-10-14T11:14:49.601217+0000","last_active":"2023-10-14T11:14:50.613866+0000","last_peered":"2023-10-14T11:14:50.613866+0000","last_clean":"2023-10-14T11:14:50.613866+0000","last_became_active":"2023-10-14T11:14:49.600946+0000","last_became_peered":"2023-10-14T11:14:49.600946+0000","last_unstale":"2023-10-14T11:14:50.613866+0000","last_undegraded":"2023-10-14T11:14:50.613866+0000","last_fullsized":"2023-10-14T11:14:50.613866+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:43.650913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.313220+0000","last_change":"2023-10-14T11:14:50.616272+0000","last_active":"2023-10-14T11:14:52.313220+0000","last_peered":"2023-10-14T11:14:52.313220+0000","last_clean":"2023-10-14T11:14:52.313220+0000","last_became_active":"2023-10-14T11:14:50.615990+0000","last_became_peered":"2023-10-14T11:14:50.615990+0000","last_unstale":"2023-10-14T11:14:52.313220+0000","last_undegraded":"2023-10-14T11:14:52.313220+0000","last_fullsized":"2023-10-14T11:14:52.313220+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:29:51.475908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.620897+0000","last_change":"2023-10-14T11:14:49.590359+0000","last_active":"2023-10-14T11:14:50.620897+0000","last_peered":"2023-10-14T11:14:50.620897+0000","last_clean":"2023-10-14T11:14:50.620897+0000","last_became_active":"2023-10-14T11:14:49.590094+0000","last_became_peered":"2023-10-14T11:14:49.590094+0000","last_unstale":"2023-10-14T11:14:50.620897+0000","last_undegraded":"2023-10-14T11:14:50.620897+0000","last_fullsized":"2023-10-14T11:14:50.620897+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:38.240189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.601606+0000","last_change":"2023-10-14T11:14:50.624008+0000","last_active":"2023-10-14T11:14:51.601606+0000","last_peered":"2023-10-14T11:14:51.601606+0000","last_clean":"2023-10-14T11:14:51.601606+0000","last_became_active":"2023-10-14T11:14:50.623750+0000","last_became_peered":"2023-10-14T11:14:50.623750+0000","last_unstale":"2023-10-14T11:14:51.601606+0000","last_undegraded":"2023-10-14T11:14:51.601606+0000","last_fullsized":"2023-10-14T11:14:51.601606+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:05.775683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.612710+0000","last_change":"2023-10-14T11:14:49.599989+0000","last_active":"2023-10-14T11:14:50.612710+0000","last_peered":"2023-10-14T11:14:50.612710+0000","last_clean":"2023-10-14T11:14:50.612710+0000","last_became_active":"2023-10-14T11:14:49.599705+0000","last_became_peered":"2023-10-14T11:14:49.599705+0000","last_unstale":"2023-10-14T11:14:50.612710+0000","last_undegraded":"2023-10-14T11:14:50.612710+0000","last_fullsized":"2023-10-14T11:14:50.612710+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:09.979747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.601467+0000","last_change":"2023-10-14T11:14:50.620426+0000","last_active":"2023-10-14T11:14:51.601467+0000","last_peered":"2023-10-14T11:14:51.601467+0000","last_clean":"2023-10-14T11:14:51.601467+0000","last_became_active":"2023-10-14T11:14:50.620136+0000","last_became_peered":"2023-10-14T11:14:50.620136+0000","last_unstale":"2023-10-14T11:14:51.601467+0000","last_undegraded":"2023-10-14T11:14:51.601467+0000","last_fullsized":"2023-10-14T11:14:51.601467+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:32.437644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.606142+0000","last_change":"2023-10-14T11:14:49.596142+0000","last_active":"2023-10-14T11:14:50.606142+0000","last_peered":"2023-10-14T11:14:50.606142+0000","last_clean":"2023-10-14T11:14:50.606142+0000","last_became_active":"2023-10-14T11:14:49.595831+0000","last_became_peered":"2023-10-14T11:14:49.595831+0000","last_unstale":"2023-10-14T11:14:50.606142+0000","last_undegraded":"2023-10-14T11:14:50.606142+0000","last_fullsized":"2023-10-14T11:14:50.606142+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:53:35.323550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.383902+0000","last_change":"2023-10-14T11:14:50.606077+0000","last_active":"2023-10-14T11:14:52.383902+0000","last_peered":"2023-10-14T11:14:52.383902+0000","last_clean":"2023-10-14T11:14:52.383902+0000","last_became_active":"2023-10-14T11:14:50.605814+0000","last_became_peered":"2023-10-14T11:14:50.605814+0000","last_unstale":"2023-10-14T11:14:52.383902+0000","last_undegraded":"2023-10-14T11:14:52.383902+0000","last_fullsized":"2023-10-14T11:14:52.383902+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:03:48.011461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.586275+0000","last_change":"2023-10-14T11:14:49.582679+0000","last_active":"2023-10-14T11:14:50.586275+0000","last_peered":"2023-10-14T11:14:50.586275+0000","last_clean":"2023-10-14T11:14:50.586275+0000","last_became_active":"2023-10-14T11:14:49.582447+0000","last_became_peered":"2023-10-14T11:14:49.582447+0000","last_unstale":"2023-10-14T11:14:50.586275+0000","last_undegraded":"2023-10-14T11:14:50.586275+0000","last_fullsized":"2023-10-14T11:14:50.586275+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:24.791021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.601358+0000","last_change":"2023-10-14T11:14:50.624842+0000","last_active":"2023-10-14T11:14:51.601358+0000","last_peered":"2023-10-14T11:14:51.601358+0000","last_clean":"2023-10-14T11:14:51.601358+0000","last_became_active":"2023-10-14T11:14:50.624584+0000","last_became_peered":"2023-10-14T11:14:50.624584+0000","last_unstale":"2023-10-14T11:14:51.601358+0000","last_undegraded":"2023-10-14T11:14:51.601358+0000","last_fullsized":"2023-10-14T11:14:51.601358+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:56:57.585998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.592529+0000","last_change":"2023-10-14T11:14:49.590167+0000","last_active":"2023-10-14T11:14:50.592529+0000","last_peered":"2023-10-14T11:14:50.592529+0000","last_clean":"2023-10-14T11:14:50.592529+0000","last_became_active":"2023-10-14T11:14:49.589876+0000","last_became_peered":"2023-10-14T11:14:49.589876+0000","last_unstale":"2023-10-14T11:14:50.592529+0000","last_undegraded":"2023-10-14T11:14:50.592529+0000","last_fullsized":"2023-10-14T11:14:50.592529+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:38:14.938610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.603946+0000","last_change":"2023-10-14T11:14:50.611558+0000","last_active":"2023-10-14T11:14:51.603946+0000","last_peered":"2023-10-14T11:14:51.603946+0000","last_clean":"2023-10-14T11:14:51.603946+0000","last_became_active":"2023-10-14T11:14:50.610258+0000","last_became_peered":"2023-10-14T11:14:50.610258+0000","last_unstale":"2023-10-14T11:14:51.603946+0000","last_undegraded":"2023-10-14T11:14:51.603946+0000","last_fullsized":"2023-10-14T11:14:51.603946+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:11.327501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.600967+0000","last_change":"2023-10-14T11:14:49.597577+0000","last_active":"2023-10-14T11:14:50.600967+0000","last_peered":"2023-10-14T11:14:50.600967+0000","last_clean":"2023-10-14T11:14:50.600967+0000","last_became_active":"2023-10-14T11:14:49.597282+0000","last_became_peered":"2023-10-14T11:14:49.597282+0000","last_unstale":"2023-10-14T11:14:50.600967+0000","last_undegraded":"2023-10-14T11:14:50.600967+0000","last_fullsized":"2023-10-14T11:14:50.600967+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:38.240189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.604750+0000","last_change":"2023-10-14T11:14:50.613084+0000","last_active":"2023-10-14T11:14:51.604750+0000","last_peered":"2023-10-14T11:14:51.604750+0000","last_clean":"2023-10-14T11:14:51.604750+0000","last_became_active":"2023-10-14T11:14:50.612772+0000","last_became_peered":"2023-10-14T11:14:50.612772+0000","last_unstale":"2023-10-14T11:14:51.604750+0000","last_undegraded":"2023-10-14T11:14:51.604750+0000","last_fullsized":"2023-10-14T11:14:51.604750+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:02:41.199730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.604740+0000","last_change":"2023-10-14T11:14:49.603833+0000","last_active":"2023-10-14T11:14:50.604740+0000","last_peered":"2023-10-14T11:14:50.604740+0000","last_clean":"2023-10-14T11:14:50.604740+0000","last_became_active":"2023-10-14T11:14:49.602745+0000","last_became_peered":"2023-10-14T11:14:49.602745+0000","last_unstale":"2023-10-14T11:14:50.604740+0000","last_undegraded":"2023-10-14T11:14:50.604740+0000","last_fullsized":"2023-10-14T11:14:50.604740+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:10:48.293059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.383165+0000","last_change":"2023-10-14T11:14:50.601977+0000","last_active":"2023-10-14T11:14:52.383165+0000","last_peered":"2023-10-14T11:14:52.383165+0000","last_clean":"2023-10-14T11:14:52.383165+0000","last_became_active":"2023-10-14T11:14:50.601690+0000","last_became_peered":"2023-10-14T11:14:50.601690+0000","last_unstale":"2023-10-14T11:14:52.383165+0000","last_undegraded":"2023-10-14T11:14:52.383165+0000","last_fullsized":"2023-10-14T11:14:52.383165+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:11:44.705742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.618058+0000","last_change":"2023-10-14T11:14:49.601838+0000","last_active":"2023-10-14T11:14:50.618058+0000","last_peered":"2023-10-14T11:14:50.618058+0000","last_clean":"2023-10-14T11:14:50.618058+0000","last_became_active":"2023-10-14T11:14:49.601598+0000","last_became_peered":"2023-10-14T11:14:49.601598+0000","last_unstale":"2023-10-14T11:14:50.618058+0000","last_undegraded":"2023-10-14T11:14:50.618058+0000","last_fullsized":"2023-10-14T11:14:50.618058+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:29:02.436402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.604474+0000","last_change":"2023-10-14T11:14:50.614207+0000","last_active":"2023-10-14T11:14:51.604474+0000","last_peered":"2023-10-14T11:14:51.604474+0000","last_clean":"2023-10-14T11:14:51.604474+0000","last_became_active":"2023-10-14T11:14:50.613520+0000","last_became_peered":"2023-10-14T11:14:50.613520+0000","last_unstale":"2023-10-14T11:14:51.604474+0000","last_undegraded":"2023-10-14T11:14:51.604474+0000","last_fullsized":"2023-10-14T11:14:51.604474+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:32:55.394335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"54'6","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.628374+0000","last_change":"2023-10-14T11:14:49.597521+0000","last_active":"2023-10-14T11:14:50.628374+0000","last_peered":"2023-10-14T11:14:50.628374+0000","last_clean":"2023-10-14T11:14:50.628374+0000","last_became_active":"2023-10-14T11:14:49.597104+0000","last_became_peered":"2023-10-14T11:14:49.597104+0000","last_unstale":"2023-10-14T11:14:50.628374+0000","last_undegraded":"2023-10-14T11:14:50.628374+0000","last_fullsized":"2023-10-14T11:14:50.628374+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:34:47.516975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.383767+0000","last_change":"2023-10-14T11:14:50.597334+0000","last_active":"2023-10-14T11:14:52.383767+0000","last_peered":"2023-10-14T11:14:52.383767+0000","last_clean":"2023-10-14T11:14:52.383767+0000","last_became_active":"2023-10-14T11:14:50.596864+0000","last_became_peered":"2023-10-14T11:14:50.596864+0000","last_unstale":"2023-10-14T11:14:52.383767+0000","last_undegraded":"2023-10-14T11:14:52.383767+0000","last_fullsized":"2023-10-14T11:14:52.383767+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:09:29.010723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.625572+0000","last_change":"2023-10-14T11:14:49.603026+0000","last_active":"2023-10-14T11:14:50.625572+0000","last_peered":"2023-10-14T11:14:50.625572+0000","last_clean":"2023-10-14T11:14:50.625572+0000","last_became_active":"2023-10-14T11:14:49.602709+0000","last_became_peered":"2023-10-14T11:14:49.602709+0000","last_unstale":"2023-10-14T11:14:50.625572+0000","last_undegraded":"2023-10-14T11:14:50.625572+0000","last_fullsized":"2023-10-14T11:14:50.625572+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:46:41.627061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.604579+0000","last_change":"2023-10-14T11:14:50.609128+0000","last_active":"2023-10-14T11:14:51.604579+0000","last_peered":"2023-10-14T11:14:51.604579+0000","last_clean":"2023-10-14T11:14:51.604579+0000","last_became_active":"2023-10-14T11:14:50.607594+0000","last_became_peered":"2023-10-14T11:14:50.607594+0000","last_unstale":"2023-10-14T11:14:51.604579+0000","last_undegraded":"2023-10-14T11:14:51.604579+0000","last_fullsized":"2023-10-14T11:14:51.604579+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:29:24.012096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.585576+0000","last_change":"2023-10-14T11:14:49.587936+0000","last_active":"2023-10-14T11:14:50.585576+0000","last_peered":"2023-10-14T11:14:50.585576+0000","last_clean":"2023-10-14T11:14:50.585576+0000","last_became_active":"2023-10-14T11:14:49.587620+0000","last_became_peered":"2023-10-14T11:14:49.587620+0000","last_unstale":"2023-10-14T11:14:50.585576+0000","last_undegraded":"2023-10-14T11:14:50.585576+0000","last_fullsized":"2023-10-14T11:14:50.585576+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:12:13.284001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.602768+0000","last_change":"2023-10-14T11:14:50.607879+0000","last_active":"2023-10-14T11:14:51.602768+0000","last_peered":"2023-10-14T11:14:51.602768+0000","last_clean":"2023-10-14T11:14:51.602768+0000","last_became_active":"2023-10-14T11:14:50.607597+0000","last_became_peered":"2023-10-14T11:14:50.607597+0000","last_unstale":"2023-10-14T11:14:51.602768+0000","last_undegraded":"2023-10-14T11:14:51.602768+0000","last_fullsized":"2023-10-14T11:14:51.602768+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:42:13.942552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.587623+0000","last_change":"2023-10-14T11:14:49.591162+0000","last_active":"2023-10-14T11:14:50.587623+0000","last_peered":"2023-10-14T11:14:50.587623+0000","last_clean":"2023-10-14T11:14:50.587623+0000","last_became_active":"2023-10-14T11:14:49.590817+0000","last_became_peered":"2023-10-14T11:14:49.590817+0000","last_unstale":"2023-10-14T11:14:50.587623+0000","last_undegraded":"2023-10-14T11:14:50.587623+0000","last_fullsized":"2023-10-14T11:14:50.587623+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:02:31.259983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.603925+0000","last_change":"2023-10-14T11:14:50.617009+0000","last_active":"2023-10-14T11:14:51.603925+0000","last_peered":"2023-10-14T11:14:51.603925+0000","last_clean":"2023-10-14T11:14:51.603925+0000","last_became_active":"2023-10-14T11:14:50.616691+0000","last_became_peered":"2023-10-14T11:14:50.616691+0000","last_unstale":"2023-10-14T11:14:51.603925+0000","last_undegraded":"2023-10-14T11:14:51.603925+0000","last_fullsized":"2023-10-14T11:14:51.603925+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:56.127211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.616365+0000","last_change":"2023-10-14T11:14:49.594465+0000","last_active":"2023-10-14T11:14:50.616365+0000","last_peered":"2023-10-14T11:14:50.616365+0000","last_clean":"2023-10-14T11:14:50.616365+0000","last_became_active":"2023-10-14T11:14:49.594163+0000","last_became_peered":"2023-10-14T11:14:49.594163+0000","last_unstale":"2023-10-14T11:14:50.616365+0000","last_undegraded":"2023-10-14T11:14:50.616365+0000","last_fullsized":"2023-10-14T11:14:50.616365+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:18:02.363535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.604747+0000","last_change":"2023-10-14T11:14:50.609691+0000","last_active":"2023-10-14T11:14:51.604747+0000","last_peered":"2023-10-14T11:14:51.604747+0000","last_clean":"2023-10-14T11:14:51.604747+0000","last_became_active":"2023-10-14T11:14:50.609368+0000","last_became_peered":"2023-10-14T11:14:50.609368+0000","last_unstale":"2023-10-14T11:14:51.604747+0000","last_undegraded":"2023-10-14T11:14:51.604747+0000","last_fullsized":"2023-10-14T11:14:51.604747+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:45:11.784126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.626094+0000","last_change":"2023-10-14T11:14:49.603138+0000","last_active":"2023-10-14T11:14:50.626094+0000","last_peered":"2023-10-14T11:14:50.626094+0000","last_clean":"2023-10-14T11:14:50.626094+0000","last_became_active":"2023-10-14T11:14:49.602797+0000","last_became_peered":"2023-10-14T11:14:49.602797+0000","last_unstale":"2023-10-14T11:14:50.626094+0000","last_undegraded":"2023-10-14T11:14:50.626094+0000","last_fullsized":"2023-10-14T11:14:50.626094+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:02:40.192804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.384465+0000","last_change":"2023-10-14T11:14:50.596329+0000","last_active":"2023-10-14T11:14:52.384465+0000","last_peered":"2023-10-14T11:14:52.384465+0000","last_clean":"2023-10-14T11:14:52.384465+0000","last_became_active":"2023-10-14T11:14:50.596060+0000","last_became_peered":"2023-10-14T11:14:50.596060+0000","last_unstale":"2023-10-14T11:14:52.384465+0000","last_undegraded":"2023-10-14T11:14:52.384465+0000","last_fullsized":"2023-10-14T11:14:52.384465+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:29:24.012096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.617424+0000","last_change":"2023-10-14T11:14:49.600552+0000","last_active":"2023-10-14T11:14:50.617424+0000","last_peered":"2023-10-14T11:14:50.617424+0000","last_clean":"2023-10-14T11:14:50.617424+0000","last_became_active":"2023-10-14T11:14:49.600266+0000","last_became_peered":"2023-10-14T11:14:49.600266+0000","last_unstale":"2023-10-14T11:14:50.617424+0000","last_undegraded":"2023-10-14T11:14:50.617424+0000","last_fullsized":"2023-10-14T11:14:50.617424+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:48:39.809866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.601875+0000","last_change":"2023-10-14T11:14:50.613305+0000","last_active":"2023-10-14T11:14:51.601875+0000","last_peered":"2023-10-14T11:14:51.601875+0000","last_clean":"2023-10-14T11:14:51.601875+0000","last_became_active":"2023-10-14T11:14:50.613041+0000","last_became_peered":"2023-10-14T11:14:50.613041+0000","last_unstale":"2023-10-14T11:14:51.601875+0000","last_undegraded":"2023-10-14T11:14:51.601875+0000","last_fullsized":"2023-10-14T11:14:51.601875+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:15.624001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.619685+0000","last_change":"2023-10-14T11:14:49.585070+0000","last_active":"2023-10-14T11:14:50.619685+0000","last_peered":"2023-10-14T11:14:50.619685+0000","last_clean":"2023-10-14T11:14:50.619685+0000","last_became_active":"2023-10-14T11:14:49.584753+0000","last_became_peered":"2023-10-14T11:14:49.584753+0000","last_unstale":"2023-10-14T11:14:50.619685+0000","last_undegraded":"2023-10-14T11:14:50.619685+0000","last_fullsized":"2023-10-14T11:14:50.619685+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:55.120285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.604590+0000","last_change":"2023-10-14T11:14:50.614449+0000","last_active":"2023-10-14T11:14:51.604590+0000","last_peered":"2023-10-14T11:14:51.604590+0000","last_clean":"2023-10-14T11:14:51.604590+0000","last_became_active":"2023-10-14T11:14:50.613872+0000","last_became_peered":"2023-10-14T11:14:50.613872+0000","last_unstale":"2023-10-14T11:14:51.604590+0000","last_undegraded":"2023-10-14T11:14:51.604590+0000","last_fullsized":"2023-10-14T11:14:51.604590+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:35:16.819102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.596049+0000","last_change":"2023-10-14T11:14:49.595545+0000","last_active":"2023-10-14T11:14:50.596049+0000","last_peered":"2023-10-14T11:14:50.596049+0000","last_clean":"2023-10-14T11:14:50.596049+0000","last_became_active":"2023-10-14T11:14:49.595246+0000","last_became_peered":"2023-10-14T11:14:49.595246+0000","last_unstale":"2023-10-14T11:14:50.596049+0000","last_undegraded":"2023-10-14T11:14:50.596049+0000","last_fullsized":"2023-10-14T11:14:50.596049+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:24.791021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.383934+0000","last_change":"2023-10-14T11:14:50.597153+0000","last_active":"2023-10-14T11:14:52.383934+0000","last_peered":"2023-10-14T11:14:52.383934+0000","last_clean":"2023-10-14T11:14:52.383934+0000","last_became_active":"2023-10-14T11:14:50.596459+0000","last_became_peered":"2023-10-14T11:14:50.596459+0000","last_unstale":"2023-10-14T11:14:52.383934+0000","last_undegraded":"2023-10-14T11:14:52.383934+0000","last_fullsized":"2023-10-14T11:14:52.383934+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:40:25.562519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.625419+0000","last_change":"2023-10-14T11:14:49.589173+0000","last_active":"2023-10-14T11:14:50.625419+0000","last_peered":"2023-10-14T11:14:50.625419+0000","last_clean":"2023-10-14T11:14:50.625419+0000","last_became_active":"2023-10-14T11:14:49.588952+0000","last_became_peered":"2023-10-14T11:14:49.588952+0000","last_unstale":"2023-10-14T11:14:50.625419+0000","last_undegraded":"2023-10-14T11:14:50.625419+0000","last_fullsized":"2023-10-14T11:14:50.625419+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:41:26.527463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.313575+0000","last_change":"2023-10-14T11:14:50.600020+0000","last_active":"2023-10-14T11:14:52.313575+0000","last_peered":"2023-10-14T11:14:52.313575+0000","last_clean":"2023-10-14T11:14:52.313575+0000","last_became_active":"2023-10-14T11:14:50.599740+0000","last_became_peered":"2023-10-14T11:14:50.599740+0000","last_unstale":"2023-10-14T11:14:52.313575+0000","last_undegraded":"2023-10-14T11:14:52.313575+0000","last_fullsized":"2023-10-14T11:14:52.313575+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:56.127211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.583543+0000","last_change":"2023-10-14T11:14:49.595648+0000","last_active":"2023-10-14T11:14:50.583543+0000","last_peered":"2023-10-14T11:14:50.583543+0000","last_clean":"2023-10-14T11:14:50.583543+0000","last_became_active":"2023-10-14T11:14:49.595350+0000","last_became_peered":"2023-10-14T11:14:49.595350+0000","last_unstale":"2023-10-14T11:14:50.583543+0000","last_undegraded":"2023-10-14T11:14:50.583543+0000","last_fullsized":"2023-10-14T11:14:50.583543+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:46:30.968779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.313210+0000","last_change":"2023-10-14T11:14:50.606987+0000","last_active":"2023-10-14T11:14:52.313210+0000","last_peered":"2023-10-14T11:14:52.313210+0000","last_clean":"2023-10-14T11:14:52.313210+0000","last_became_active":"2023-10-14T11:14:50.606733+0000","last_became_peered":"2023-10-14T11:14:50.606733+0000","last_unstale":"2023-10-14T11:14:52.313210+0000","last_undegraded":"2023-10-14T11:14:52.313210+0000","last_fullsized":"2023-10-14T11:14:52.313210+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:02:32.266909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.586668+0000","last_change":"2023-10-14T11:14:49.587664+0000","last_active":"2023-10-14T11:14:50.586668+0000","last_peered":"2023-10-14T11:14:50.586668+0000","last_clean":"2023-10-14T11:14:50.586668+0000","last_became_active":"2023-10-14T11:14:49.585139+0000","last_became_peered":"2023-10-14T11:14:49.585139+0000","last_unstale":"2023-10-14T11:14:50.586668+0000","last_undegraded":"2023-10-14T11:14:50.586668+0000","last_fullsized":"2023-10-14T11:14:50.586668+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:01:13.487571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.384461+0000","last_change":"2023-10-14T11:14:50.612177+0000","last_active":"2023-10-14T11:14:52.384461+0000","last_peered":"2023-10-14T11:14:52.384461+0000","last_clean":"2023-10-14T11:14:52.384461+0000","last_became_active":"2023-10-14T11:14:50.611918+0000","last_became_peered":"2023-10-14T11:14:50.611918+0000","last_unstale":"2023-10-14T11:14:52.384461+0000","last_undegraded":"2023-10-14T11:14:52.384461+0000","last_fullsized":"2023-10-14T11:14:52.384461+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:46:42.633987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.626624+0000","last_change":"2023-10-14T11:14:49.594924+0000","last_active":"2023-10-14T11:14:50.626624+0000","last_peered":"2023-10-14T11:14:50.626624+0000","last_clean":"2023-10-14T11:14:50.626624+0000","last_became_active":"2023-10-14T11:14:49.594632+0000","last_became_peered":"2023-10-14T11:14:49.594632+0000","last_unstale":"2023-10-14T11:14:50.626624+0000","last_undegraded":"2023-10-14T11:14:50.626624+0000","last_fullsized":"2023-10-14T11:14:50.626624+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:34:47.516975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.384536+0000","last_change":"2023-10-14T11:14:50.611298+0000","last_active":"2023-10-14T11:14:52.384536+0000","last_peered":"2023-10-14T11:14:52.384536+0000","last_clean":"2023-10-14T11:14:52.384536+0000","last_became_active":"2023-10-14T11:14:50.610872+0000","last_became_peered":"2023-10-14T11:14:50.610872+0000","last_unstale":"2023-10-14T11:14:52.384536+0000","last_undegraded":"2023-10-14T11:14:52.384536+0000","last_fullsized":"2023-10-14T11:14:52.384536+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:06:41.595984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.597546+0000","last_change":"2023-10-14T11:14:49.592855+0000","last_active":"2023-10-14T11:14:50.597546+0000","last_peered":"2023-10-14T11:14:50.597546+0000","last_clean":"2023-10-14T11:14:50.597546+0000","last_became_active":"2023-10-14T11:14:49.592498+0000","last_became_peered":"2023-10-14T11:14:49.592498+0000","last_unstale":"2023-10-14T11:14:50.597546+0000","last_undegraded":"2023-10-14T11:14:50.597546+0000","last_fullsized":"2023-10-14T11:14:50.597546+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:01:13.487571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.383229+0000","last_change":"2023-10-14T11:14:50.601383+0000","last_active":"2023-10-14T11:14:52.383229+0000","last_peered":"2023-10-14T11:14:52.383229+0000","last_clean":"2023-10-14T11:14:52.383229+0000","last_became_active":"2023-10-14T11:14:50.601112+0000","last_became_peered":"2023-10-14T11:14:50.601112+0000","last_unstale":"2023-10-14T11:14:52.383229+0000","last_undegraded":"2023-10-14T11:14:52.383229+0000","last_fullsized":"2023-10-14T11:14:52.383229+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:34:49.405847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.585588+0000","last_change":"2023-10-14T11:14:49.587913+0000","last_active":"2023-10-14T11:14:50.585588+0000","last_peered":"2023-10-14T11:14:50.585588+0000","last_clean":"2023-10-14T11:14:50.585588+0000","last_became_active":"2023-10-14T11:14:49.587602+0000","last_became_peered":"2023-10-14T11:14:49.587602+0000","last_unstale":"2023-10-14T11:14:50.585588+0000","last_undegraded":"2023-10-14T11:14:50.585588+0000","last_fullsized":"2023-10-14T11:14:50.585588+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:38.318607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.313446+0000","last_change":"2023-10-14T11:14:50.615721+0000","last_active":"2023-10-14T11:14:52.313446+0000","last_peered":"2023-10-14T11:14:52.313446+0000","last_clean":"2023-10-14T11:14:52.313446+0000","last_became_active":"2023-10-14T11:14:50.613039+0000","last_became_peered":"2023-10-14T11:14:50.613039+0000","last_unstale":"2023-10-14T11:14:52.313446+0000","last_undegraded":"2023-10-14T11:14:52.313446+0000","last_fullsized":"2023-10-14T11:14:52.313446+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:59:56.995911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.588105+0000","last_change":"2023-10-14T11:14:49.586244+0000","last_active":"2023-10-14T11:14:50.588105+0000","last_peered":"2023-10-14T11:14:50.588105+0000","last_clean":"2023-10-14T11:14:50.588105+0000","last_became_active":"2023-10-14T11:14:49.585942+0000","last_became_peered":"2023-10-14T11:14:49.585942+0000","last_unstale":"2023-10-14T11:14:50.588105+0000","last_undegraded":"2023-10-14T11:14:50.588105+0000","last_fullsized":"2023-10-14T11:14:50.588105+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:59:55.988986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.601454+0000","last_change":"2023-10-14T11:14:50.622391+0000","last_active":"2023-10-14T11:14:51.601454+0000","last_peered":"2023-10-14T11:14:51.601454+0000","last_clean":"2023-10-14T11:14:51.601454+0000","last_became_active":"2023-10-14T11:14:50.620839+0000","last_became_peered":"2023-10-14T11:14:50.620839+0000","last_unstale":"2023-10-14T11:14:51.601454+0000","last_undegraded":"2023-10-14T11:14:51.601454+0000","last_fullsized":"2023-10-14T11:14:51.601454+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:29:08.569971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.583777+0000","last_change":"2023-10-14T11:14:49.580579+0000","last_active":"2023-10-14T11:14:50.583777+0000","last_peered":"2023-10-14T11:14:50.583777+0000","last_clean":"2023-10-14T11:14:50.583777+0000","last_became_active":"2023-10-14T11:14:49.579933+0000","last_became_peered":"2023-10-14T11:14:49.579933+0000","last_unstale":"2023-10-14T11:14:50.583777+0000","last_undegraded":"2023-10-14T11:14:50.583777+0000","last_fullsized":"2023-10-14T11:14:50.583777+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:38:14.938610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.604482+0000","last_change":"2023-10-14T11:14:50.616697+0000","last_active":"2023-10-14T11:14:51.604482+0000","last_peered":"2023-10-14T11:14:51.604482+0000","last_clean":"2023-10-14T11:14:51.604482+0000","last_became_active":"2023-10-14T11:14:50.616402+0000","last_became_peered":"2023-10-14T11:14:50.616402+0000","last_unstale":"2023-10-14T11:14:51.604482+0000","last_undegraded":"2023-10-14T11:14:51.604482+0000","last_fullsized":"2023-10-14T11:14:51.604482+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:46:42.633987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.592609+0000","last_change":"2023-10-14T11:14:49.598108+0000","last_active":"2023-10-14T11:14:50.592609+0000","last_peered":"2023-10-14T11:14:50.592609+0000","last_clean":"2023-10-14T11:14:50.592609+0000","last_became_active":"2023-10-14T11:14:49.597536+0000","last_became_peered":"2023-10-14T11:14:49.597536+0000","last_unstale":"2023-10-14T11:14:50.592609+0000","last_undegraded":"2023-10-14T11:14:50.592609+0000","last_fullsized":"2023-10-14T11:14:50.592609+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:03:47.004535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:52.382892+0000","last_change":"2023-10-14T11:14:50.591501+0000","last_active":"2023-10-14T11:14:52.382892+0000","last_peered":"2023-10-14T11:14:52.382892+0000","last_clean":"2023-10-14T11:14:52.382892+0000","last_became_active":"2023-10-14T11:14:50.591221+0000","last_became_peered":"2023-10-14T11:14:50.591221+0000","last_unstale":"2023-10-14T11:14:52.382892+0000","last_undegraded":"2023-10-14T11:14:52.382892+0000","last_fullsized":"2023-10-14T11:14:52.382892+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:49:35.500310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.583543+0000","last_change":"2023-10-14T11:14:49.599033+0000","last_active":"2023-10-14T11:14:50.583543+0000","last_peered":"2023-10-14T11:14:50.583543+0000","last_clean":"2023-10-14T11:14:50.583543+0000","last_became_active":"2023-10-14T11:14:49.598735+0000","last_became_peered":"2023-10-14T11:14:49.598735+0000","last_unstale":"2023-10-14T11:14:50.583543+0000","last_undegraded":"2023-10-14T11:14:50.583543+0000","last_fullsized":"2023-10-14T11:14:50.583543+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:38.318607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.601495+0000","last_change":"2023-10-14T11:14:50.621068+0000","last_active":"2023-10-14T11:14:51.601495+0000","last_peered":"2023-10-14T11:14:51.601495+0000","last_clean":"2023-10-14T11:14:51.601495+0000","last_became_active":"2023-10-14T11:14:50.620807+0000","last_became_peered":"2023-10-14T11:14:50.620807+0000","last_unstale":"2023-10-14T11:14:51.601495+0000","last_undegraded":"2023-10-14T11:14:51.601495+0000","last_fullsized":"2023-10-14T11:14:51.601495+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:31:52.681912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.601637+0000","last_change":"2023-10-14T11:14:49.585845+0000","last_active":"2023-10-14T11:14:50.601637+0000","last_peered":"2023-10-14T11:14:50.601637+0000","last_clean":"2023-10-14T11:14:50.601637+0000","last_became_active":"2023-10-14T11:14:49.585545+0000","last_became_peered":"2023-10-14T11:14:49.585545+0000","last_unstale":"2023-10-14T11:14:50.601637+0000","last_undegraded":"2023-10-14T11:14:50.601637+0000","last_fullsized":"2023-10-14T11:14:50.601637+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:45:10.777200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.601238+0000","last_change":"2023-10-14T11:14:50.606866+0000","last_active":"2023-10-14T11:14:51.601238+0000","last_peered":"2023-10-14T11:14:51.601238+0000","last_clean":"2023-10-14T11:14:51.601238+0000","last_became_active":"2023-10-14T11:14:50.606614+0000","last_became_peered":"2023-10-14T11:14:50.606614+0000","last_unstale":"2023-10-14T11:14:51.601238+0000","last_undegraded":"2023-10-14T11:14:51.601238+0000","last_fullsized":"2023-10-14T11:14:51.601238+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:49.561905+0000","last_clean_scrub_stamp":"2023-10-14T11:14:49.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:21.349936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.585802+0000","last_change":"2023-10-14T11:14:49.593770+0000","last_active":"2023-10-14T11:14:50.585802+0000","last_peered":"2023-10-14T11:14:50.585802+0000","last_clean":"2023-10-14T11:14:50.585802+0000","last_became_active":"2023-10-14T11:14:49.593086+0000","last_became_peered":"2023-10-14T11:14:49.593086+0000","last_unstale":"2023-10-14T11:14:50.585802+0000","last_undegraded":"2023-10-14T11:14:50.585802+0000","last_fullsized":"2023-10-14T11:14:50.585802+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:14:48.554979+0000","last_clean_scrub_stamp":"2023-10-14T11:14:48.554979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:46:30.968779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":193,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-14T11:14:50.594274+0000","last_change":"2023-10-14T11:12:12.162289+0000","last_active":"2023-10-14T11:14:50.594274+0000","last_peered":"2023-10-14T11:14:50.594274+0000","last_clean":"2023-10-14T11:14:50.594274+0000","last_became_active":"2023-10-14T11:12:12.161055+0000","last_became_peered":"2023-10-14T11:12:12.161055+0000","last_unstale":"2023-10-14T11:14:50.594274+0000","last_undegraded":"2023-10-14T11:14:50.594274+0000","last_fullsized":"2023-10-14T11:14:50.594274+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_clean_scrub_stamp":"2023-10-14T11:12:10.853576+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:52.154107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1261568,"data_stored":885112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.81399999999999995,"15min":0.83999999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.95099999999999996,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.434,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.57199999999999995}]},{"osd":1,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68799999999999994,"15min":0.69699999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97999999999999998,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.443,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97099999999999997,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.68000000000000005}]},{"osd":2,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.84699999999999998,"15min":0.86499999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.081,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.628},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.80000000000000004,"15min":0.81599999999999995},"min":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96599999999999997,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.66100000000000003}]},{"osd":3,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.80400000000000005,"15min":0.82799999999999996},"min":{"1min":0.52300000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92500000000000004,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.86099999999999999,"15min":0.88300000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.014,"5min":3.5489999999999999,"15min":3.5489999999999999},"last":0.71499999999999997}]},{"osd":4,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.65800000000000003,"15min":0.66100000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.99299999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.52900000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94399999999999995,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.59499999999999997}]},{"osd":5,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69699999999999995,"15min":0.70199999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.96899999999999997,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.752,"15min":0.76300000000000001},"min":{"1min":0.442,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92100000000000004,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.61399999999999999}]},{"osd":6,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.80500000000000005,"15min":0.81699999999999995},"min":{"1min":0.60399999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.97299999999999998,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.78100000000000003,"15min":0.79400000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97499999999999998,"5min":1.395,"15min":1.395},"last":0.64200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":659456,"data_stored":294584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.372,"5min":0.315,"15min":0.315},"max":{"1min":0.85599999999999998,"5min":1.244,"15min":1.244},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.53600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.87,"5min":1.331,"15min":1.331},"last":0.74099999999999999}]},{"osd":1,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67900000000000005,"15min":0.68700000000000006},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.75700000000000001,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.69699999999999995,"15min":0.70499999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88300000000000001,"5min":1.304,"15min":1.304},"last":0.69099999999999995}]},{"osd":2,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.71399999999999997,"15min":0.73099999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90200000000000002,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.748,"15min":0.76100000000000001},"min":{"1min":0.53300000000000003,"5min":0.443,"15min":0.443},"max":{"1min":0.84199999999999997,"5min":1.845,"15min":1.845},"last":0.57799999999999996}]},{"osd":3,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.79000000000000004,"15min":0.80800000000000005},"min":{"1min":0.50700000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.91600000000000004,"5min":1.627,"15min":1.627},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.69499999999999995,"15min":0.70199999999999996},"min":{"1min":0.52000000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.83599999999999997,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.60599999999999998}]},{"osd":4,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70299999999999996,"15min":0.71299999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.97199999999999998,"5min":1.206,"15min":1.206},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.48599999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84299999999999997,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.54900000000000004}]},{"osd":5,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.878,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92800000000000005,"5min":1.425,"15min":1.425},"last":0.86199999999999999}]},{"osd":7,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.76400000000000001,"15min":0.78200000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81399999999999995,"5min":1.502,"15min":1.502},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77500000000000002,"15min":0.78700000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.94799999999999995,"5min":1.609,"15min":1.609},"last":0.78500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31832,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":667648,"data_stored":295236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63300000000000001,"15min":0.63},"min":{"1min":0.51300000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.68100000000000005,"15min":0.68899999999999995},"min":{"1min":0.46300000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.86599999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.72399999999999998}]},{"osd":1,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.70899999999999996,"15min":0.70199999999999996},"min":{"1min":0.55800000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0309999999999999,"5min":1.181,"15min":1.181},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64900000000000002,"15min":0.64800000000000002},"min":{"1min":0.46600000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.88300000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.753}]},{"osd":2,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67800000000000005,"15min":0.68000000000000005},"min":{"1min":0.48799999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91800000000000004,"5min":1.024,"15min":1.024},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.51000000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85499999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.74099999999999999}]},{"osd":3,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73299999999999998,"15min":0.73599999999999999},"min":{"1min":0.52200000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89600000000000002,"5min":1.405,"15min":1.405},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72999999999999998,"15min":0.73099999999999998},"min":{"1min":0.53600000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92700000000000005,"5min":1.22,"15min":1.22},"last":0.79100000000000004}]},{"osd":4,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82899999999999996,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.5},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.88400000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.46000000000000002}]},{"osd":6,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53800000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.91100000000000003,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.57599999999999996}]},{"osd":7,"last update":"Sat Oct 14 11:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77800000000000002,"15min":0.77900000000000003},"min":{"1min":0.52300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95899999999999996,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.60299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0169999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":671744,"data_stored":296196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.70899999999999996,"15min":0.72499999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.81299999999999994,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.497,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80700000000000005,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.96599999999999997}]},{"osd":1,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69699999999999995,"15min":0.70299999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.82899999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77300000000000002,"15min":0.78700000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85499999999999998,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.88100000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.79900000000000004,"15min":0.81499999999999995},"min":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.89100000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.76100000000000001,"15min":0.77500000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94099999999999995,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.83499999999999996}]},{"osd":3,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73899999999999999,"15min":0.746},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97699999999999998,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.78000000000000003,"15min":0.78700000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.879,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.94499999999999995}]},{"osd":5,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.71699999999999997,"15min":0.72699999999999998},"min":{"1min":0.45400000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.94099999999999995,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68300000000000005,"15min":0.68500000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86199999999999999,"5min":1.349,"15min":1.349},"last":0.71899999999999997}]},{"osd":6,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.745,"15min":0.749},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95099999999999996,"5min":1.306,"15min":1.306},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.77900000000000003,"15min":0.79300000000000004},"min":{"1min":0.51800000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92200000000000004,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.68600000000000005}]},{"osd":7,"last update":"Sat Oct 14 11:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.91100000000000003,"5min":1.163,"15min":1.163},"last":1.02},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.85699999999999998,"15min":0.86799999999999999},"min":{"1min":0.55400000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.93500000000000005,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.86699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31840,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340000,"statfs":{"total":96636764160,"available":96604160000,"internally_reserved":0,"allocated":667648,"data_stored":294640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.45800000000000002,"15min":0.46700000000000003},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.70899999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.45100000000000001,"15min":0.45500000000000002},"min":{"1min":0.30199999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.39800000000000002}]},{"osd":1,"last update":"Sat Oct 14 11:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.47099999999999997,"15min":0.48199999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58599999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.53600000000000003,"15min":0.54600000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.47299999999999998}]},{"osd":2,"last update":"Sat Oct 14 11:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.373,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72399999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.59299999999999997,"15min":0.60599999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79400000000000004,"5min":1.018,"15min":1.018},"last":0.42799999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.77600000000000002,"15min":0.79100000000000004},"min":{"1min":0.496,"5min":0.443,"15min":0.443},"max":{"1min":0.90200000000000002,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76800000000000002,"15min":0.77800000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.86899999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.59699999999999998}]},{"osd":5,"last update":"Sat Oct 14 11:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.51700000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.92100000000000004,"5min":1.375,"15min":1.375},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.79000000000000004,"15min":0.80600000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86199999999999999,"5min":1.286,"15min":1.286},"last":0.51000000000000001}]},{"osd":6,"last update":"Sat Oct 14 11:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.98799999999999999,"5min":1.46,"15min":1.46},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.79500000000000004,"15min":0.80900000000000005},"min":{"1min":0.53800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97999999999999998,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.66100000000000003}]},{"osd":7,"last update":"Sat Oct 14 11:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78300000000000003,"15min":0.79400000000000004},"min":{"1min":0.53200000000000003,"5min":0.503,"15min":0.503},"max":{"1min":0.91000000000000003,"5min":1.222,"15min":1.222},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.80800000000000005,"15min":0.81399999999999995},"min":{"1min":0.626,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":0.997,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.68400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31832,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":667648,"data_stored":294640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.47499999999999998,"15min":0.48699999999999999},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69899999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.443},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.49099999999999999,"15min":0.505},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58999999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.52400000000000002}]},{"osd":1,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55300000000000005,"15min":0.56200000000000006},"min":{"1min":0.39500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70799999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79400000000000004,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.57799999999999996}]},{"osd":3,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.48199999999999998,"15min":0.48799999999999999},"min":{"1min":0.32700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63300000000000001,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.56799999999999995,"15min":0.57999999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.64300000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.55200000000000005}]},{"osd":4,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.55000000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.99199999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77000000000000002,"15min":0.77600000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.004,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.81799999999999995}]},{"osd":5,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.77800000000000002,"15min":0.79000000000000004},"min":{"1min":0.43099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92800000000000005,"5min":1.073,"15min":1.073},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.82199999999999995,"15min":0.84199999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91000000000000003,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.83799999999999997}]},{"osd":6,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96199999999999997,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.85899999999999999,"15min":0.88},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.96999999999999997,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.77000000000000002}]},{"osd":7,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.84599999999999997,"15min":0.86199999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94799999999999995,"5min":1.3,"15min":1.3},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.84699999999999998,"15min":0.86599999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.98299999999999998,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.879}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":663552,"data_stored":294674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.40600000000000003,"15min":0.40999999999999998},"min":{"1min":0.309,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66300000000000003,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.55800000000000005,"15min":0.56599999999999995},"min":{"1min":0.41299999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77700000000000002,"5min":1.244,"15min":1.244},"last":0.55900000000000005}]},{"osd":2,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.438,"15min":0.432},"min":{"1min":0.313,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.375},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46700000000000003,"15min":0.46899999999999997},"min":{"1min":0.35699999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.66500000000000004,"5min":0.753,"15min":0.753},"last":0.47299999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.36599999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.55900000000000005,"15min":0.56599999999999995},"min":{"1min":0.39900000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.81200000000000006,"5min":1.081,"15min":1.081},"last":0.61499999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0780000000000001,"5min":1.629,"15min":1.629},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.93700000000000006,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.76500000000000001}]},{"osd":5,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0289999999999999,"5min":1.296,"15min":1.296},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.80700000000000005,"15min":0.81999999999999995},"min":{"1min":0.53400000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.002,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":0.74199999999999999}]},{"osd":6,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.752,"15min":0.75600000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.99199999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.79900000000000004,"15min":0.81299999999999994},"min":{"1min":0.54800000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94899999999999995,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.78900000000000003}]},{"osd":7,"last update":"Sat Oct 14 11:14:16 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.83099999999999996,"15min":0.84499999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.98899999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.77600000000000002,"15min":0.79200000000000004},"min":{"1min":0.51200000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.874,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.66500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1269760,"data_stored":887146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 11:14:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.45400000000000001,"15min":0.46400000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.69699999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.752},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.51000000000000001,"15min":0.52000000000000002},"min":{"1min":0.373,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.55700000000000005,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.96199999999999997}]},{"osd":2,"last update":"Sat Oct 14 11:14:11 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.52400000000000002,"15min":0.54000000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.59199999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.45800000000000002,"15min":0.46600000000000003},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69099999999999995,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.68100000000000005}]},{"osd":3,"last update":"Sat Oct 14 11:14:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.51200000000000001,"15min":0.52200000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80100000000000005,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.56999999999999995,"15min":0.58199999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.63300000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.89000000000000001}]},{"osd":4,"last update":"Sat Oct 14 11:14:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.73199999999999998,"15min":0.73899999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91100000000000003,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.202},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.77800000000000002,"15min":0.79400000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.80300000000000005,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.048}]},{"osd":5,"last update":"Sat Oct 14 11:14:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.997,"5min":1.431,"15min":1.431},"last":1.45},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.95699999999999996,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":1.7190000000000001}]},{"osd":6,"last update":"Sat Oct 14 11:14:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.80900000000000005,"15min":0.82699999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.96399999999999997,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.9330000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.79500000000000004,"15min":0.81200000000000006},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93999999999999995,"5min":1.536,"15min":1.536},"last":1.127}]},{"osd":7,"last update":"Sat Oct 14 11:14:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.83999999999999997,"15min":0.85799999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.97599999999999998,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":7.0880000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.93600000000000005,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":1.3700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:14:55.353 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T11:14:55.354 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=testcephfs1' mds allow 2023-10-14T11:14:55.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.531+0000 7f7da5279640 1 Processor -- start 2023-10-14T11:14:55.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.531+0000 7f7da5279640 1 -- start start 2023-10-14T11:14:55.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.531+0000 7f7da5279640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7da00b85d0 0x7f7da015dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:55.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.531+0000 7f7da5279640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7da00d0300 0x7f7da00d0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:55.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.531+0000 7f7da5279640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7da015e1d0 con 0x7f7da00b89b0 2023-10-14T11:14:55.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.531+0000 7f7da5279640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da0161720 con 0x7f7da00b85d0 2023-10-14T11:14:55.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.531+0000 7f7da5279640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da0160ba0 con 0x7f7da00d0300 2023-10-14T11:14:55.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.531+0000 7f7d9effd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7da00b85d0 0x7f7da015dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:55.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.531+0000 7f7d9effd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7da00b85d0 0x7f7da015dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54448/0 (socket says 172.21.15.26:54448) 2023-10-14T11:14:55.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.531+0000 7f7d9effd640 1 -- 172.21.15.26:0/720578170 learned_addr learned my addr 172.21.15.26:0/720578170 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:55.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.531+0000 7f7d9f7fe640 1 --2- 172.21.15.26:0/720578170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7da00d0300 0x7f7da00d0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:55.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.531+0000 7f7d9effd640 1 -- 172.21.15.26:0/720578170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7da00d0300 msgr2=0x7f7da00d0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:55.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.531+0000 7f7d9effd640 1 --2- 172.21.15.26:0/720578170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7da00d0300 0x7f7da00d0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:55.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.531+0000 7f7d9effd640 1 -- 172.21.15.26:0/720578170 >> v1:172.21.15.110:6789/0 conn(0x7f7da00b89b0 legacy=0x7f7da00cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:55.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.531+0000 7f7d9effd640 1 -- 172.21.15.26:0/720578170 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da0160e80 con 0x7f7da00b85d0 2023-10-14T11:14:55.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.535+0000 7f7d9effd640 1 --2- 172.21.15.26:0/720578170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da00b85d0 0x7f7da015dc90 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009870 tx=0x7f7d9001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1cd0981312c689 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:55.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.535+0000 7f7d9dffb640 1 -- 172.21.15.26:0/720578170 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d900aa670 con 0x7f7da00b85d0 2023-10-14T11:14:55.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.535+0000 7f7d9dffb640 1 -- 172.21.15.26:0/720578170 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d900aa7d0 con 0x7f7da00b85d0 2023-10-14T11:14:55.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.535+0000 7f7d9dffb640 1 -- 172.21.15.26:0/720578170 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d900aab60 con 0x7f7da00b85d0 2023-10-14T11:14:55.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.535+0000 7f7da5279640 1 -- 172.21.15.26:0/720578170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da00b85d0 msgr2=0x7f7da015dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:55.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.535+0000 7f7da5279640 1 --2- 172.21.15.26:0/720578170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da00b85d0 0x7f7da015dc90 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009870 tx=0x7f7d9001c510 comp rx=0 tx=0).stop 2023-10-14T11:14:55.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.535+0000 7f7da5279640 1 -- 172.21.15.26:0/720578170 shutdown_connections 2023-10-14T11:14:55.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.535+0000 7f7da5279640 1 --2- 172.21.15.26:0/720578170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7da00d0300 0x7f7da00d0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:55.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.535+0000 7f7da5279640 1 --2- 172.21.15.26:0/720578170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da00b85d0 0x7f7da015dc90 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:55.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.535+0000 7f7da5279640 1 -- 172.21.15.26:0/720578170 >> 172.21.15.26:0/720578170 conn(0x7f7da006b750 msgr2=0x7f7da006bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:55.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.535+0000 7f7da5279640 1 -- 172.21.15.26:0/720578170 shutdown_connections 2023-10-14T11:14:55.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.535+0000 7f7da5279640 1 -- 172.21.15.26:0/720578170 wait complete. 2023-10-14T11:14:55.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7da5279640 1 Processor -- start 2023-10-14T11:14:55.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7da5279640 1 -- start start 2023-10-14T11:14:55.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7da5279640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7da00b85d0 0x7f7da01565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:55.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7da5279640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da00b89b0 0x7f7da014a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:55.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7da5279640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7da00d0300 0x7f7da0154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:55.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7da5279640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da01561d0 con 0x7f7da00b89b0 2023-10-14T11:14:55.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7da5279640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da014a710 con 0x7f7da00d0300 2023-10-14T11:14:55.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7da5279640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da0155550 con 0x7f7da00b85d0 2023-10-14T11:14:55.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7d9e7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da00b89b0 0x7f7da014a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:55.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7d9e7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da00b89b0 0x7f7da014a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54452/0 (socket says 172.21.15.26:54452) 2023-10-14T11:14:55.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7d9e7fc640 1 -- 172.21.15.26:0/3813770966 learned_addr learned my addr 172.21.15.26:0/3813770966 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:55.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7d9effd640 1 --2- 172.21.15.26:0/3813770966 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7da00b85d0 0x7f7da01565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:55.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7d9f7fe640 1 --2- 172.21.15.26:0/3813770966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7da00d0300 0x7f7da0154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:55.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7d9e7fc640 1 -- 172.21.15.26:0/3813770966 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7da00b85d0 msgr2=0x7f7da01565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:55.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7d9e7fc640 1 --2- 172.21.15.26:0/3813770966 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7da00b85d0 0x7f7da01565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:55.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7d9e7fc640 1 -- 172.21.15.26:0/3813770966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7da00d0300 msgr2=0x7f7da0154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:55.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7d9e7fc640 1 --2- 172.21.15.26:0/3813770966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7da00d0300 0x7f7da0154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:55.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7d9e7fc640 1 -- 172.21.15.26:0/3813770966 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d900094d0 con 0x7f7da00b89b0 2023-10-14T11:14:55.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7d9e7fc640 1 --2- 172.21.15.26:0/3813770966 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da00b89b0 0x7f7da014a1d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400c500 tx=0x7f7d9400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:55.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7d877fe640 1 -- 172.21.15.26:0/3813770966 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d94005220 con 0x7f7da00b89b0 2023-10-14T11:14:55.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7d877fe640 1 -- 172.21.15.26:0/3813770966 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d94005380 con 0x7f7da00b89b0 2023-10-14T11:14:55.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7da5279640 1 -- 172.21.15.26:0/3813770966 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da0155830 con 0x7f7da00b89b0 2023-10-14T11:14:55.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7d877fe640 1 -- 172.21.15.26:0/3813770966 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d94007270 con 0x7f7da00b89b0 2023-10-14T11:14:55.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.539+0000 7f7da5279640 1 -- 172.21.15.26:0/3813770966 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da0155df0 con 0x7f7da00b89b0 2023-10-14T11:14:55.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.543+0000 7f7da5279640 1 -- 172.21.15.26:0/3813770966 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da004e170 con 0x7f7da00b89b0 2023-10-14T11:14:55.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.543+0000 7f7d877fe640 1 -- 172.21.15.26:0/3813770966 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7d940073d0 con 0x7f7da00b89b0 2023-10-14T11:14:55.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.543+0000 7f7d877fe640 1 --2- 172.21.15.26:0/3813770966 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7d8c0664a0 0x7f7d8c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:55.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.543+0000 7f7d877fe640 1 -- 172.21.15.26:0/3813770966 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f7d94083830 con 0x7f7da00b89b0 2023-10-14T11:14:55.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.543+0000 7f7d9effd640 1 --2- 172.21.15.26:0/3813770966 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7d8c0664a0 0x7f7d8c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:55.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.543+0000 7f7d9effd640 1 --2- 172.21.15.26:0/3813770966 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7d8c0664a0 0x7f7d8c068960 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7d900ae000 tx=0x7f7d900b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:55.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.547+0000 7f7d877fe640 1 -- 172.21.15.26:0/3813770966 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7d94050b70 con 0x7f7da00b89b0 2023-10-14T11:14:55.556 INFO:tasks.ceph.mds.c.smithi026.stderr:2023-10-14T11:14:55.551+0000 7f49f8c57640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T11:14:55.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.755+0000 7f7da5279640 1 -- 172.21.15.26:0/3813770966 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]} v 0) v1 -- 0x7f7da00d0900 con 0x7f7da00b89b0 2023-10-14T11:14:55.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.759+0000 7f7d877fe640 1 -- 172.21.15.26:0/3813770966 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 195+0+152 (secure 0 0 0) 0x7f7d94054190 con 0x7f7da00b89b0 2023-10-14T11:14:55.766 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2023-10-14T11:14:55.766 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBZdyplGXdwHxAA3yn7fC60cZX9BQGuvdlfYw== 2023-10-14T11:14:55.766 INFO:teuthology.orchestra.run.smithi026.stdout: caps mds = "allow" 2023-10-14T11:14:55.766 INFO:teuthology.orchestra.run.smithi026.stdout: caps mon = "allow r" 2023-10-14T11:14:55.767 INFO:teuthology.orchestra.run.smithi026.stdout: caps osd = "allow rw tag cephfs data=testcephfs1" 2023-10-14T11:14:55.767 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-10-14T11:14:55.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.763+0000 7f7da5279640 1 -- 172.21.15.26:0/3813770966 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7d8c0664a0 msgr2=0x7f7d8c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:55.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.763+0000 7f7da5279640 1 --2- 172.21.15.26:0/3813770966 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7d8c0664a0 0x7f7d8c068960 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7d900ae000 tx=0x7f7d900b5040 comp rx=0 tx=0).stop 2023-10-14T11:14:55.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.763+0000 7f7da5279640 1 -- 172.21.15.26:0/3813770966 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da00b89b0 msgr2=0x7f7da014a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:55.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.763+0000 7f7da5279640 1 --2- 172.21.15.26:0/3813770966 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da00b89b0 0x7f7da014a1d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400c500 tx=0x7f7d9400c9c0 comp rx=0 tx=0).stop 2023-10-14T11:14:55.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.763+0000 7f7da5279640 1 -- 172.21.15.26:0/3813770966 shutdown_connections 2023-10-14T11:14:55.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.763+0000 7f7da5279640 1 --2- 172.21.15.26:0/3813770966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7da00d0300 0x7f7da0154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:55.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.763+0000 7f7da5279640 1 --2- 172.21.15.26:0/3813770966 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7d8c0664a0 0x7f7d8c068960 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:55.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.763+0000 7f7da5279640 1 --2- 172.21.15.26:0/3813770966 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da00b89b0 0x7f7da014a1d0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:55.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.763+0000 7f7da5279640 1 --2- 172.21.15.26:0/3813770966 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7da00b85d0 0x7f7da01565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:55.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.763+0000 7f7da5279640 1 -- 172.21.15.26:0/3813770966 >> 172.21.15.26:0/3813770966 conn(0x7f7da006b750 msgr2=0x7f7da0157100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:55.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.763+0000 7f7da5279640 1 -- 172.21.15.26:0/3813770966 shutdown_connections 2023-10-14T11:14:55.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.763+0000 7f7da5279640 1 -- 172.21.15.26:0/3813770966 wait complete. 2023-10-14T11:14:55.790 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:14:55.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.927+0000 7fbd8f50e640 1 Processor -- start 2023-10-14T11:14:55.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.927+0000 7fbd8f50e640 1 -- start start 2023-10-14T11:14:55.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.927+0000 7fbd8f50e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbd880b2ad0 0x7fbd8806b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:55.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.927+0000 7fbd8f50e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd8806d000 con 0x7fbd880ce310 2023-10-14T11:14:55.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.927+0000 7fbd8f50e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd8815d4e0 con 0x7fbd8815cf90 2023-10-14T11:14:55.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.927+0000 7fbd8f50e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd88160580 con 0x7fbd880b2ad0 2023-10-14T11:14:55.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.927+0000 7fbd8daab640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbd880ce310 0x7fbd881609d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48700/0 (socket says 172.21.15.26:48700) 2023-10-14T11:14:55.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.927+0000 7fbd8daab640 1 -- 172.21.15.26:0/182162956 learned_addr learned my addr 172.21.15.26:0/182162956 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:55.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.927+0000 7fbd8d2aa640 1 --2- 172.21.15.26:0/182162956 >> v2:172.21.15.110:3300/0 conn(0x7fbd880b2ad0 0x7fbd8806b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:55.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.927+0000 7fbd7ffff640 1 -- 172.21.15.26:0/182162956 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318939069 0 0) 0x7fbd8806d000 con 0x7fbd880ce310 2023-10-14T11:14:55.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.927+0000 7fbd7ffff640 1 -- 172.21.15.26:0/182162956 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd74003530 con 0x7fbd880ce310 2023-10-14T11:14:55.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.931+0000 7fbd7ffff640 1 -- 172.21.15.26:0/182162956 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 514808464 0 0) 0x7fbd8815d4e0 con 0x7fbd8815cf90 2023-10-14T11:14:55.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.931+0000 7fbd7ffff640 1 -- 172.21.15.26:0/182162956 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd8806d000 con 0x7fbd8815cf90 2023-10-14T11:14:55.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.931+0000 7fbd8d2aa640 1 -- 172.21.15.26:0/182162956 >> v1:172.21.15.110:6789/0 conn(0x7fbd8815cf90 legacy=0x7fbd8806c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:55.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.931+0000 7fbd8d2aa640 1 -- 172.21.15.26:0/182162956 >> v1:172.21.15.26:6789/0 conn(0x7fbd880ce310 legacy=0x7fbd881609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:55.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.931+0000 7fbd8d2aa640 1 -- 172.21.15.26:0/182162956 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8815d7c0 con 0x7fbd880b2ad0 2023-10-14T11:14:55.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.931+0000 7fbd8d2aa640 1 --2- 172.21.15.26:0/182162956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd880b2ad0 0x7fbd8806b4b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbd840097f0 tx=0x7fbd8401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b82800abb4008a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:55.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.931+0000 7fbd7ffff640 1 -- 172.21.15.26:0/182162956 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd840ad660 con 0x7fbd880b2ad0 2023-10-14T11:14:55.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.931+0000 7fbd7ffff640 1 -- 172.21.15.26:0/182162956 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd840ad7c0 con 0x7fbd880b2ad0 2023-10-14T11:14:55.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.931+0000 7fbd7ffff640 1 -- 172.21.15.26:0/182162956 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd840adb50 con 0x7fbd880b2ad0 2023-10-14T11:14:55.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.931+0000 7fbd8f50e640 1 -- 172.21.15.26:0/182162956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd880b2ad0 msgr2=0x7fbd8806b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:55.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.931+0000 7fbd8f50e640 1 --2- 172.21.15.26:0/182162956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd880b2ad0 0x7fbd8806b4b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbd840097f0 tx=0x7fbd8401c450 comp rx=0 tx=0).stop 2023-10-14T11:14:55.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.931+0000 7fbd8f50e640 1 -- 172.21.15.26:0/182162956 shutdown_connections 2023-10-14T11:14:55.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.931+0000 7fbd8f50e640 1 --2- 172.21.15.26:0/182162956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd880b2ad0 0x7fbd8806b4b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:55.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.931+0000 7fbd8f50e640 1 -- 172.21.15.26:0/182162956 >> 172.21.15.26:0/182162956 conn(0x7fbd880cd1c0 msgr2=0x7fbd880cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:55.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8f50e640 1 -- 172.21.15.26:0/182162956 shutdown_connections 2023-10-14T11:14:55.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8f50e640 1 -- 172.21.15.26:0/182162956 wait complete. 2023-10-14T11:14:55.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8f50e640 1 Processor -- start 2023-10-14T11:14:55.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8f50e640 1 -- start start 2023-10-14T11:14:55.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8f50e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd880b2ad0 0x7fbd880ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:55.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8f50e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd880ce310 0x7fbd880c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:55.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8f50e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd8815cf90 0x7fbd88156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:55.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8f50e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd880b40f0 con 0x7fbd8815cf90 2023-10-14T11:14:55.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8f50e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd880b3800 con 0x7fbd880b2ad0 2023-10-14T11:14:55.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8f50e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd880c6ae0 con 0x7fbd880ce310 2023-10-14T11:14:55.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8daab640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd8815cf90 0x7fbd88156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:55.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8daab640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd8815cf90 0x7fbd88156df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54462/0 (socket says 172.21.15.26:54462) 2023-10-14T11:14:55.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8daab640 1 -- 172.21.15.26:0/2753832216 learned_addr learned my addr 172.21.15.26:0/2753832216 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:55.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8d2aa640 1 --2- 172.21.15.26:0/2753832216 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd880b2ad0 0x7fbd880ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:55.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8caa9640 1 --2- 172.21.15.26:0/2753832216 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd880ce310 0x7fbd880c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:55.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8daab640 1 -- 172.21.15.26:0/2753832216 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd880ce310 msgr2=0x7fbd880c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:55.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8daab640 1 --2- 172.21.15.26:0/2753832216 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd880ce310 0x7fbd880c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:55.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8daab640 1 -- 172.21.15.26:0/2753832216 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd880b2ad0 msgr2=0x7fbd880ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:55.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8daab640 1 --2- 172.21.15.26:0/2753832216 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd880b2ad0 0x7fbd880ab870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:55.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8daab640 1 -- 172.21.15.26:0/2753832216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd84009420 con 0x7fbd8815cf90 2023-10-14T11:14:55.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8d2aa640 1 --2- 172.21.15.26:0/2753832216 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd880b2ad0 0x7fbd880ab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:55.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8caa9640 1 --2- 172.21.15.26:0/2753832216 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd880ce310 0x7fbd880c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:55.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8daab640 1 --2- 172.21.15.26:0/2753832216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd8815cf90 0x7fbd88156df0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000cb10 tx=0x7fbd8000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:55.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd7dffb640 1 -- 172.21.15.26:0/2753832216 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8000ac70 con 0x7fbd8815cf90 2023-10-14T11:14:55.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd7dffb640 1 -- 172.21.15.26:0/2753832216 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8000add0 con 0x7fbd8815cf90 2023-10-14T11:14:55.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd7dffb640 1 -- 172.21.15.26:0/2753832216 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd80012600 con 0x7fbd8815cf90 2023-10-14T11:14:55.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.935+0000 7fbd8f50e640 1 -- 172.21.15.26:0/2753832216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd880b3aa0 con 0x7fbd8815cf90 2023-10-14T11:14:55.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.939+0000 7fbd8f50e640 1 -- 172.21.15.26:0/2753832216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd880c66f0 con 0x7fbd8815cf90 2023-10-14T11:14:55.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.939+0000 7fbd8f50e640 1 -- 172.21.15.26:0/2753832216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd880b4260 con 0x7fbd8815cf90 2023-10-14T11:14:55.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.939+0000 7fbd7dffb640 1 -- 172.21.15.26:0/2753832216 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbd80007070 con 0x7fbd8815cf90 2023-10-14T11:14:55.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.939+0000 7fbd7dffb640 1 --2- 172.21.15.26:0/2753832216 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd6c0664d0 0x7fbd6c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:55.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.939+0000 7fbd7dffb640 1 -- 172.21.15.26:0/2753832216 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fbd80083de0 con 0x7fbd8815cf90 2023-10-14T11:14:55.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.939+0000 7fbd8d2aa640 1 --2- 172.21.15.26:0/2753832216 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd6c0664d0 0x7fbd6c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:55.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.943+0000 7fbd8d2aa640 1 --2- 172.21.15.26:0/2753832216 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd6c0664d0 0x7fbd6c068990 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbd840af000 tx=0x7fbd84008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:55.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:55.943+0000 7fbd7dffb640 1 -- 172.21.15.26:0/2753832216 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbd800511a0 con 0x7fbd8815cf90 2023-10-14T11:14:56.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.131+0000 7fbd8f50e640 1 -- 172.21.15.26:0/2753832216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd88074010 con 0x7fbd8815cf90 2023-10-14T11:14:56.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.135+0000 7fbd7dffb640 1 -- 172.21.15.26:0/2753832216 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4921 (secure 0 0 0) 0x7fbd80017090 con 0x7fbd8815cf90 2023-10-14T11:14:56.140 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:56.141 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/633779909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":633779909},{"type":"v1","addr":"172.21.15.110:6834","nonce":633779909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5995,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3833036081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3833036081},{"type":"v1","addr":"172.21.15.110:6835","nonce":3833036081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":6144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2594736858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2594736858},{"type":"v1","addr":"172.21.15.26:6835","nonce":2594736858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:14:49.973814+0000","modified":"2023-10-14T11:14:52.995854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6147},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6147":{"gid":6147,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6837/2641279888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2641279888},{"type":"v1","addr":"172.21.15.26:6837","nonce":2641279888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-14T11:14:56.141 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 26 2023-10-14T11:14:56.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.135+0000 7fbd8f50e640 1 -- 172.21.15.26:0/2753832216 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd6c0664d0 msgr2=0x7fbd6c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:56.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.135+0000 7fbd8f50e640 1 --2- 172.21.15.26:0/2753832216 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd6c0664d0 0x7fbd6c068990 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbd840af000 tx=0x7fbd84008040 comp rx=0 tx=0).stop 2023-10-14T11:14:56.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.135+0000 7fbd8f50e640 1 -- 172.21.15.26:0/2753832216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd8815cf90 msgr2=0x7fbd88156df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:56.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.135+0000 7fbd8f50e640 1 --2- 172.21.15.26:0/2753832216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd8815cf90 0x7fbd88156df0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000cb10 tx=0x7fbd8000a060 comp rx=0 tx=0).stop 2023-10-14T11:14:56.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.135+0000 7fbd8f50e640 1 -- 172.21.15.26:0/2753832216 shutdown_connections 2023-10-14T11:14:56.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.135+0000 7fbd8f50e640 1 --2- 172.21.15.26:0/2753832216 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbd6c0664d0 0x7fbd6c068990 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.135+0000 7fbd8f50e640 1 --2- 172.21.15.26:0/2753832216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd8815cf90 0x7fbd88156df0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.135+0000 7fbd8f50e640 1 --2- 172.21.15.26:0/2753832216 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd880ce310 0x7fbd880c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.135+0000 7fbd8f50e640 1 --2- 172.21.15.26:0/2753832216 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd880b2ad0 0x7fbd880ab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.135+0000 7fbd8f50e640 1 -- 172.21.15.26:0/2753832216 >> 172.21.15.26:0/2753832216 conn(0x7fbd880cd1c0 msgr2=0x7fbd880d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:56.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.135+0000 7fbd8f50e640 1 -- 172.21.15.26:0/2753832216 shutdown_connections 2023-10-14T11:14:56.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.135+0000 7fbd8f50e640 1 -- 172.21.15.26:0/2753832216 wait complete. 2023-10-14T11:14:56.564 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T11:14:49.973814+0000', 'modified': '2023-10-14T11:14:52.995854+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6147}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6147': {'gid': 6147, 'name': 'c', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.26:6837/2641279888', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6836', 'nonce': 2641279888}, {'type': 'v1', 'addr': '172.21.15.26:6837', 'nonce': 2641279888}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T11:14:56.565 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T11:14:56.565 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T11:14:56.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.707+0000 7fdd7e380640 1 Processor -- start 2023-10-14T11:14:56.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.707+0000 7fdd7e380640 1 -- start start 2023-10-14T11:14:56.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.707+0000 7fdd7e380640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdd7815a880 0x7fdd7815dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.707+0000 7fdd7e380640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd780cda30 0x7fdd780b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.707+0000 7fdd7e380640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd7815e000 con 0x7fdd780b00e0 2023-10-14T11:14:56.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.707+0000 7fdd7e380640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd780b0ab0 con 0x7fdd7815a880 2023-10-14T11:14:56.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.707+0000 7fdd7e380640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd780cb1d0 con 0x7fdd780cda30 2023-10-14T11:14:56.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.707+0000 7fdd77fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdd7815a880 0x7fdd7815dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.707+0000 7fdd777fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdd780b00e0 0x7fdd78160680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48710/0 (socket says 172.21.15.26:48710) 2023-10-14T11:14:56.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.707+0000 7fdd777fe640 1 -- 172.21.15.26:0/3223583976 learned_addr learned my addr 172.21.15.26:0/3223583976 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:56.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.707+0000 7fdd7c91d640 1 --2- 172.21.15.26:0/3223583976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd780cda30 0x7fdd780b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.707+0000 7fdd77fff640 1 -- 172.21.15.26:0/3223583976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd780cda30 msgr2=0x7fdd780b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:56.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.707+0000 7fdd77fff640 1 --2- 172.21.15.26:0/3223583976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd780cda30 0x7fdd780b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.707+0000 7fdd77fff640 1 -- 172.21.15.26:0/3223583976 >> v1:172.21.15.26:6789/0 conn(0x7fdd780b00e0 legacy=0x7fdd78160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:56.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.707+0000 7fdd77fff640 1 -- 172.21.15.26:0/3223583976 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd780cb4b0 con 0x7fdd7815a880 2023-10-14T11:14:56.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.711+0000 7fdd77fff640 1 --2- 172.21.15.26:0/3223583976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7815a880 0x7fdd7815dac0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fdd680097c0 tx=0x7fdd6801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edfe1194ce741a54 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:56.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.711+0000 7fdd76ffd640 1 -- 172.21.15.26:0/3223583976 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd680ab600 con 0x7fdd7815a880 2023-10-14T11:14:56.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.711+0000 7fdd76ffd640 1 -- 172.21.15.26:0/3223583976 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd680a7050 con 0x7fdd7815a880 2023-10-14T11:14:56.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.711+0000 7fdd76ffd640 1 -- 172.21.15.26:0/3223583976 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd680ab980 con 0x7fdd7815a880 2023-10-14T11:14:56.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.711+0000 7fdd7e380640 1 -- 172.21.15.26:0/3223583976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7815a880 msgr2=0x7fdd7815dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:56.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.711+0000 7fdd7e380640 1 --2- 172.21.15.26:0/3223583976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7815a880 0x7fdd7815dac0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fdd680097c0 tx=0x7fdd6801c480 comp rx=0 tx=0).stop 2023-10-14T11:14:56.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.711+0000 7fdd7e380640 1 -- 172.21.15.26:0/3223583976 shutdown_connections 2023-10-14T11:14:56.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.711+0000 7fdd7e380640 1 --2- 172.21.15.26:0/3223583976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd780cda30 0x7fdd780b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.711+0000 7fdd7e380640 1 --2- 172.21.15.26:0/3223583976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7815a880 0x7fdd7815dac0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.711+0000 7fdd7e380640 1 -- 172.21.15.26:0/3223583976 >> 172.21.15.26:0/3223583976 conn(0x7fdd7806c190 msgr2=0x7fdd7806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:56.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.711+0000 7fdd7e380640 1 -- 172.21.15.26:0/3223583976 shutdown_connections 2023-10-14T11:14:56.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.711+0000 7fdd7e380640 1 -- 172.21.15.26:0/3223583976 wait complete. 2023-10-14T11:14:56.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.711+0000 7fdd7e380640 1 Processor -- start 2023-10-14T11:14:56.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.711+0000 7fdd7e380640 1 -- start start 2023-10-14T11:14:56.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd7e380640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd780b00e0 0x7fdd780c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd7e380640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd780cda30 0x7fdd780c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd7e380640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd7815a880 0x7fdd780c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd7e380640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd780c55a0 con 0x7fdd780cda30 2023-10-14T11:14:56.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd7e380640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd780c5730 con 0x7fdd780b00e0 2023-10-14T11:14:56.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd7e380640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd780c6700 con 0x7fdd7815a880 2023-10-14T11:14:56.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd777fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd780cda30 0x7fdd780c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd777fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd780cda30 0x7fdd780c85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54478/0 (socket says 172.21.15.26:54478) 2023-10-14T11:14:56.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd777fe640 1 -- 172.21.15.26:0/1591204634 learned_addr learned my addr 172.21.15.26:0/1591204634 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:56.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd77fff640 1 --2- 172.21.15.26:0/1591204634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd780b00e0 0x7fdd780c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd7c91d640 1 --2- 172.21.15.26:0/1591204634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd7815a880 0x7fdd780c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd777fe640 1 -- 172.21.15.26:0/1591204634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd7815a880 msgr2=0x7fdd780c1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:56.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd777fe640 1 --2- 172.21.15.26:0/1591204634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd7815a880 0x7fdd780c1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd777fe640 1 -- 172.21.15.26:0/1591204634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd780b00e0 msgr2=0x7fdd780c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:56.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd777fe640 1 --2- 172.21.15.26:0/1591204634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd780b00e0 0x7fdd780c5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd777fe640 1 -- 172.21.15.26:0/1591204634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd68009420 con 0x7fdd780cda30 2023-10-14T11:14:56.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd77fff640 1 --2- 172.21.15.26:0/1591204634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd780b00e0 0x7fdd780c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:56.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd7c91d640 1 --2- 172.21.15.26:0/1591204634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd7815a880 0x7fdd780c1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:56.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd777fe640 1 --2- 172.21.15.26:0/1591204634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd780cda30 0x7fdd780c85b0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c007fd0 tx=0x7fdd6c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:56.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd74ff9640 1 -- 172.21.15.26:0/1591204634 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c005cf0 con 0x7fdd780cda30 2023-10-14T11:14:56.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd74ff9640 1 -- 172.21.15.26:0/1591204634 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6c005e70 con 0x7fdd780cda30 2023-10-14T11:14:56.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd7e380640 1 -- 172.21.15.26:0/1591204634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd780c60d0 con 0x7fdd780cda30 2023-10-14T11:14:56.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd74ff9640 1 -- 172.21.15.26:0/1591204634 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c0072f0 con 0x7fdd780cda30 2023-10-14T11:14:56.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd7e380640 1 -- 172.21.15.26:0/1591204634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd780c5c60 con 0x7fdd780cda30 2023-10-14T11:14:56.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.715+0000 7fdd74ff9640 1 -- 172.21.15.26:0/1591204634 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdd6c007450 con 0x7fdd780cda30 2023-10-14T11:14:56.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd74ff9640 1 --2- 172.21.15.26:0/1591204634 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdd640664d0 0x7fdd64068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd74ff9640 1 -- 172.21.15.26:0/1591204634 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fdd6c0835e0 con 0x7fdd780cda30 2023-10-14T11:14:56.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd77fff640 1 --2- 172.21.15.26:0/1591204634 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdd640664d0 0x7fdd64068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd81703000 1 Processor -- start 2023-10-14T11:14:56.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd77fff640 1 --2- 172.21.15.26:0/1591204634 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdd640664d0 0x7fdd64068990 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdd680ad000 tx=0x7fdd68008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:56.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd81703000 1 -- start start 2023-10-14T11:14:56.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd81703000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5631651fa8a0 0x5631651fac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd81703000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631651fb1c0 0x5631651b0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd81703000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651b0c50 0x5631651b1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd81703000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x563164fa5cc0 con 0x5631651b0c50 2023-10-14T11:14:56.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd81703000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x563165008920 con 0x5631651fb1c0 2023-10-14T11:14:56.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd81703000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x563165005e50 con 0x5631651fa8a0 2023-10-14T11:14:56.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd7c91d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651b0c50 0x5631651b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd7c91d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651b0c50 0x5631651b1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54490/0 (socket says 172.21.15.26:54490) 2023-10-14T11:14:56.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd7c91d640 1 -- 172.21.15.26:0/3889159034 learned_addr learned my addr 172.21.15.26:0/3889159034 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:56.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd77fff640 1 --2- 172.21.15.26:0/3889159034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5631651fa8a0 0x5631651fac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd777fe640 1 --2- 172.21.15.26:0/3889159034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631651fb1c0 0x5631651b0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd7c91d640 1 -- 172.21.15.26:0/3889159034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5631651fa8a0 msgr2=0x5631651fac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:56.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd7c91d640 1 --2- 172.21.15.26:0/3889159034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5631651fa8a0 0x5631651fac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd7c91d640 1 -- 172.21.15.26:0/3889159034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631651fb1c0 msgr2=0x5631651b0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:56.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd7c91d640 1 --2- 172.21.15.26:0/3889159034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631651fb1c0 0x5631651b0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd7c91d640 1 -- 172.21.15.26:0/3889159034 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563164cfa890 con 0x5631651b0c50 2023-10-14T11:14:56.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd7c91d640 1 --2- 172.21.15.26:0/3889159034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651b0c50 0x5631651b1030 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fdd700074e0 tx=0x7fdd700079a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2b1c3f11eb0a7b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:56.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd5dffb640 1 -- 172.21.15.26:0/3889159034 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd700147e0 con 0x5631651b0c50 2023-10-14T11:14:56.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd5dffb640 1 -- 172.21.15.26:0/3889159034 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd70014940 con 0x5631651b0c50 2023-10-14T11:14:56.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.719+0000 7fdd5dffb640 1 -- 172.21.15.26:0/3889159034 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd70014cd0 con 0x5631651b0c50 2023-10-14T11:14:56.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd81703000 1 -- 172.21.15.26:0/3889159034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651b0c50 msgr2=0x5631651b1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:56.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd81703000 1 --2- 172.21.15.26:0/3889159034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651b0c50 0x5631651b1030 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fdd700074e0 tx=0x7fdd700079a0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd81703000 1 -- 172.21.15.26:0/3889159034 shutdown_connections 2023-10-14T11:14:56.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd81703000 1 --2- 172.21.15.26:0/3889159034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651b0c50 0x5631651b1030 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd81703000 1 --2- 172.21.15.26:0/3889159034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631651fb1c0 0x5631651b0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd81703000 1 --2- 172.21.15.26:0/3889159034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5631651fa8a0 0x5631651fac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd81703000 1 -- 172.21.15.26:0/3889159034 >> 172.21.15.26:0/3889159034 conn(0x5631651a7fc0 msgr2=0x5631651aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:56.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd81703000 1 -- 172.21.15.26:0/3889159034 shutdown_connections 2023-10-14T11:14:56.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd81703000 1 -- 172.21.15.26:0/3889159034 wait complete. 2023-10-14T11:14:56.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd81703000 1 -- start start 2023-10-14T11:14:56.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd81703000 1 Processor -- start 2023-10-14T11:14:56.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd81703000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651b0c50 0x5631651b6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd81703000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5631651fa8a0 0x5631651b6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd81703000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631651fb1c0 0x5631651e8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd81703000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x563165001740 con 0x5631651b0c50 2023-10-14T11:14:56.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd81703000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x563164fc0d10 con 0x5631651fb1c0 2023-10-14T11:14:56.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd81703000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x563164fc09b0 con 0x5631651fa8a0 2023-10-14T11:14:56.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd81703000 10 client.0 _ll_register_callbacks cb 0x56316519c390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T11:14:56.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd77fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651b0c50 0x5631651b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd77fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651b0c50 0x5631651b6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54492/0 (socket says 172.21.15.26:54492) 2023-10-14T11:14:56.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd77fff640 1 -- 172.21.15.26:0/3307814364 learned_addr learned my addr 172.21.15.26:0/3307814364 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:56.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd777fe640 1 --2- 172.21.15.26:0/3307814364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5631651fa8a0 0x5631651b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd7c91d640 1 --2- 172.21.15.26:0/3307814364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631651fb1c0 0x5631651e8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd77fff640 1 -- 172.21.15.26:0/3307814364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5631651fa8a0 msgr2=0x5631651b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:56.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd77fff640 1 --2- 172.21.15.26:0/3307814364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5631651fa8a0 0x5631651b6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd77fff640 1 -- 172.21.15.26:0/3307814364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631651fb1c0 msgr2=0x5631651e8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:56.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd77fff640 1 --2- 172.21.15.26:0/3307814364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631651fb1c0 0x5631651e8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd77fff640 1 -- 172.21.15.26:0/3307814364 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd70009d40 con 0x5631651b0c50 2023-10-14T11:14:56.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd77fff640 1 --2- 172.21.15.26:0/3307814364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651b0c50 0x5631651b6010 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fdd6801c4c0 tx=0x7fdd6801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d36a43b47d80672 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:56.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.723+0000 7fdd56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-14T11:14:56.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd56ffd640 1 -- 172.21.15.26:0/3307814364 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd680b5850 con 0x5631651b0c50 2023-10-14T11:14:56.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd56ffd640 1 -- 172.21.15.26:0/3307814364 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fdd680b59b0 con 0x5631651b0c50 2023-10-14T11:14:56.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd81703000 1 -- 172.21.15.26:0/3307814364 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563164fb5370 con 0x5631651b0c50 2023-10-14T11:14:56.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd56ffd640 1 -- 172.21.15.26:0/3307814364 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd680b5b70 con 0x5631651b0c50 2023-10-14T11:14:56.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd81703000 10 client.6282 fetch_fsmap learned FSMap version 26 2023-10-14T11:14:56.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd81703000 1 -- 172.21.15.26:0/3307814364 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x563164fc3460 con 0x5631651b0c50 2023-10-14T11:14:56.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd56ffd640 1 -- 172.21.15.26:0/3307814364 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563164fb5370 con 0x5631651b0c50 2023-10-14T11:14:56.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd56ffd640 1 -- 172.21.15.26:0/3307814364 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 26) v1 ==== 3299+0+0 (secure 0 0 0) 0x7fdd680b5cd0 con 0x5631651b0c50 2023-10-14T11:14:56.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd81703000 10 client.6282 fetch_fsmap finished waiting for FSMap version 26 2023-10-14T11:14:56.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd81703000 10 client.6282 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T11:14:56.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd81703000 20 client.6282 populate_metadata read hostname 'smithi026' 2023-10-14T11:14:56.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd81703000 1 --2- 172.21.15.26:0/3307814364 >> [v2:172.21.15.26:6836/2641279888,v1:172.21.15.26:6837/2641279888] conn(0x56316520a940 0x56316520cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd81703000 4 client.6282 mds_command: new command op to 6147 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T11:14:56.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd81703000 1 -- 172.21.15.26:0/3307814364 --> [v2:172.21.15.26:6836/2641279888,v1:172.21.15.26:6837/2641279888] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563164f9b2d0 con 0x56316520a940 2023-10-14T11:14:56.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd777fe640 1 --2- 172.21.15.26:0/3307814364 >> [v2:172.21.15.26:6836/2641279888,v1:172.21.15.26:6837/2641279888] conn(0x56316520a940 0x56316520cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd777fe640 1 --2- 172.21.15.26:0/3307814364 >> [v2:172.21.15.26:6836/2641279888,v1:172.21.15.26:6837/2641279888] conn(0x56316520a940 0x56316520cd30 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8877635b8a5ce279 server_cookie=48efccfacb36c152 in_seq=0 out_seq=0 2023-10-14T11:14:56.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd56ffd640 10 client.6282 ms_handle_connect on v2:172.21.15.26:6836/2641279888 2023-10-14T11:14:56.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd56ffd640 1 -- 172.21.15.26:0/3307814364 <== mds.0 v2:172.21.15.26:6836/2641279888 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563164f9b2d0 con 0x56316520a940 2023-10-14T11:14:56.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd56ffd640 10 client.6282 handle_command_reply: tid=0 2023-10-14T11:14:56.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd81703000 1 client.6282 shutdown 2023-10-14T11:14:56.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd81703000 1 -- 172.21.15.26:0/3307814364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651b0c50 msgr2=0x5631651b6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:56.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd81703000 1 --2- 172.21.15.26:0/3307814364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651b0c50 0x5631651b6010 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fdd6801c4c0 tx=0x7fdd6801acc0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd81703000 1 -- 172.21.15.26:0/3307814364 shutdown_connections 2023-10-14T11:14:56.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd81703000 1 --2- 172.21.15.26:0/3307814364 >> [v2:172.21.15.26:6836/2641279888,v1:172.21.15.26:6837/2641279888] conn(0x56316520a940 0x56316520cd30 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd81703000 1 --2- 172.21.15.26:0/3307814364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631651fb1c0 0x5631651e8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd81703000 1 --2- 172.21.15.26:0/3307814364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5631651fa8a0 0x5631651b6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd56ffd640 0 client.6282 ms_handle_reset on v2:172.21.15.26:6836/2641279888 2023-10-14T11:14:56.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd81703000 1 --2- 172.21.15.26:0/3307814364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651b0c50 0x5631651b6010 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd81703000 1 -- 172.21.15.26:0/3307814364 >> 172.21.15.26:0/3307814364 conn(0x5631651a7fc0 msgr2=0x5631651af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:56.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd81703000 1 -- 172.21.15.26:0/3307814364 shutdown_connections 2023-10-14T11:14:56.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd81703000 1 -- 172.21.15.26:0/3307814364 wait complete. 2023-10-14T11:14:56.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.727+0000 7fdd81703000 20 client.6282 trim_cache size 0 max 16384 2023-10-14T11:14:56.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.743+0000 7fdd81703000 1 Processor -- start 2023-10-14T11:14:56.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.743+0000 7fdd81703000 1 -- start start 2023-10-14T11:14:56.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.743+0000 7fdd81703000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651b0c50 0x56316520e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.743+0000 7fdd81703000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5631651fa8a0 0x56316520e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.743+0000 7fdd81703000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631651fb1c0 0x5631651e39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.743+0000 7fdd81703000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x563164cbb940 con 0x5631651b0c50 2023-10-14T11:14:56.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.743+0000 7fdd81703000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x563164cfb1b0 con 0x5631651fb1c0 2023-10-14T11:14:56.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.743+0000 7fdd81703000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x563164fca720 con 0x5631651fa8a0 2023-10-14T11:14:56.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.743+0000 7fdd77fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651b0c50 0x56316520e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.743+0000 7fdd77fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651b0c50 0x56316520e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54502/0 (socket says 172.21.15.26:54502) 2023-10-14T11:14:56.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.743+0000 7fdd77fff640 1 -- 172.21.15.26:0/2157712014 learned_addr learned my addr 172.21.15.26:0/2157712014 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:56.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.743+0000 7fdd77fff640 1 -- 172.21.15.26:0/2157712014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5631651fa8a0 msgr2=0x56316520e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:56.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.743+0000 7fdd77fff640 1 --2- 172.21.15.26:0/2157712014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5631651fa8a0 0x56316520e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.743+0000 7fdd77fff640 1 -- 172.21.15.26:0/2157712014 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631651fb1c0 msgr2=0x5631651e39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:56.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.743+0000 7fdd77fff640 1 --2- 172.21.15.26:0/2157712014 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631651fb1c0 0x5631651e39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.743+0000 7fdd77fff640 1 -- 172.21.15.26:0/2157712014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563164fa9760 con 0x5631651b0c50 2023-10-14T11:14:56.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.743+0000 7fdd77fff640 1 --2- 172.21.15.26:0/2157712014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651b0c50 0x56316520e450 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fdd6801c2b0 tx=0x7fdd680be000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f00daa2c64ab9e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:56.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd5e7fc640 1 -- 172.21.15.26:0/2157712014 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd680c1a10 con 0x5631651b0c50 2023-10-14T11:14:56.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd5e7fc640 1 -- 172.21.15.26:0/2157712014 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd680c1b70 con 0x5631651b0c50 2023-10-14T11:14:56.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd5e7fc640 1 -- 172.21.15.26:0/2157712014 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd680b5410 con 0x5631651b0c50 2023-10-14T11:14:56.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd81703000 1 -- 172.21.15.26:0/2157712014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651b0c50 msgr2=0x56316520e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:56.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd81703000 1 --2- 172.21.15.26:0/2157712014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651b0c50 0x56316520e450 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fdd6801c2b0 tx=0x7fdd680be000 comp rx=0 tx=0).stop 2023-10-14T11:14:56.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd81703000 1 -- 172.21.15.26:0/2157712014 shutdown_connections 2023-10-14T11:14:56.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd81703000 1 --2- 172.21.15.26:0/2157712014 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631651fb1c0 0x5631651e39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd81703000 1 --2- 172.21.15.26:0/2157712014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5631651fa8a0 0x56316520e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd81703000 1 --2- 172.21.15.26:0/2157712014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651b0c50 0x56316520e450 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd81703000 1 -- 172.21.15.26:0/2157712014 >> 172.21.15.26:0/2157712014 conn(0x5631651a7fc0 msgr2=0x56316520cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:56.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd81703000 1 -- 172.21.15.26:0/2157712014 shutdown_connections 2023-10-14T11:14:56.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd81703000 1 -- 172.21.15.26:0/2157712014 wait complete. 2023-10-14T11:14:56.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd81703000 1 -- start start 2023-10-14T11:14:56.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd81703000 1 Processor -- start 2023-10-14T11:14:56.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd81703000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631651b0c50 0x5631651e7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd81703000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5631651fa8a0 0x5631652160f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd81703000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651fb1c0 0x563165216630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd81703000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56316500b200 con 0x5631651fb1c0 2023-10-14T11:14:56.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd81703000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631651b6240 con 0x5631651b0c50 2023-10-14T11:14:56.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd81703000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x563164fad3a0 con 0x5631651fa8a0 2023-10-14T11:14:56.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd81703000 10 client.0 _ll_register_callbacks cb 0x7fdd7806f260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T11:14:56.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd7c91d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651fb1c0 0x563165216630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd7c91d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651fb1c0 0x563165216630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54506/0 (socket says 172.21.15.26:54506) 2023-10-14T11:14:56.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd7c91d640 1 -- 172.21.15.26:0/19181570 learned_addr learned my addr 172.21.15.26:0/19181570 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:56.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd777fe640 1 --2- 172.21.15.26:0/19181570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5631651fa8a0 0x5631652160f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd77fff640 1 --2- 172.21.15.26:0/19181570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631651b0c50 0x5631651e7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd7c91d640 1 -- 172.21.15.26:0/19181570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5631651fa8a0 msgr2=0x5631652160f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:56.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd7c91d640 1 --2- 172.21.15.26:0/19181570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5631651fa8a0 0x5631652160f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd7c91d640 1 -- 172.21.15.26:0/19181570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631651b0c50 msgr2=0x5631651e7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:56.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd7c91d640 1 --2- 172.21.15.26:0/19181570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631651b0c50 0x5631651e7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd7c91d640 1 -- 172.21.15.26:0/19181570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563164fc3460 con 0x5631651fb1c0 2023-10-14T11:14:56.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd7c91d640 1 --2- 172.21.15.26:0/19181570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651fb1c0 0x563165216630 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fdd70008010 tx=0x7fdd70004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d2c76116f49b06 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:56.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.747+0000 7fdd56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-14T11:14:56.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd56ffd640 1 -- 172.21.15.26:0/19181570 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd70014d20 con 0x5631651fb1c0 2023-10-14T11:14:56.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd56ffd640 1 -- 172.21.15.26:0/19181570 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fdd70024070 con 0x5631651fb1c0 2023-10-14T11:14:56.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd81703000 1 -- 172.21.15.26:0/19181570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5631651b33b0 con 0x5631651fb1c0 2023-10-14T11:14:56.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd56ffd640 1 -- 172.21.15.26:0/19181570 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd70014e80 con 0x5631651fb1c0 2023-10-14T11:14:56.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd81703000 10 client.6288 fetch_fsmap learned FSMap version 26 2023-10-14T11:14:56.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd81703000 1 -- 172.21.15.26:0/19181570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x563164cfacc0 con 0x5631651fb1c0 2023-10-14T11:14:56.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd56ffd640 1 -- 172.21.15.26:0/19181570 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5631651b33b0 con 0x5631651fb1c0 2023-10-14T11:14:56.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd56ffd640 1 -- 172.21.15.26:0/19181570 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 26) v1 ==== 3299+0+0 (secure 0 0 0) 0x7fdd70031020 con 0x5631651fb1c0 2023-10-14T11:14:56.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd81703000 10 client.6288 fetch_fsmap finished waiting for FSMap version 26 2023-10-14T11:14:56.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd81703000 10 client.6288 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T11:14:56.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd81703000 20 client.6288 populate_metadata read hostname 'smithi026' 2023-10-14T11:14:56.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd81703000 1 --2- 172.21.15.26:0/19181570 >> [v2:172.21.15.26:6836/2641279888,v1:172.21.15.26:6837/2641279888] conn(0x563165259520 0x563165259900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd81703000 4 client.6288 mds_command: new command op to 6147 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T11:14:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd81703000 1 -- 172.21.15.26:0/19181570 --> [v2:172.21.15.26:6836/2641279888,v1:172.21.15.26:6837/2641279888] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563164f996f0 con 0x563165259520 2023-10-14T11:14:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd77fff640 1 --2- 172.21.15.26:0/19181570 >> [v2:172.21.15.26:6836/2641279888,v1:172.21.15.26:6837/2641279888] conn(0x563165259520 0x563165259900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd77fff640 1 --2- 172.21.15.26:0/19181570 >> [v2:172.21.15.26:6836/2641279888,v1:172.21.15.26:6837/2641279888] conn(0x563165259520 0x563165259900 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66426aec8beb9f00 server_cookie=e09a6b147171e84d in_seq=0 out_seq=0 2023-10-14T11:14:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd56ffd640 10 client.6288 ms_handle_connect on v2:172.21.15.26:6836/2641279888 2023-10-14T11:14:56.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd56ffd640 1 -- 172.21.15.26:0/19181570 <== mds.0 v2:172.21.15.26:6836/2641279888 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x563164f996f0 con 0x563165259520 2023-10-14T11:14:56.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd56ffd640 10 client.6288 handle_command_reply: tid=0 2023-10-14T11:14:56.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd81703000 1 client.6288 shutdown 2023-10-14T11:14:56.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd81703000 1 -- 172.21.15.26:0/19181570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651fb1c0 msgr2=0x563165216630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:56.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd81703000 1 --2- 172.21.15.26:0/19181570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651fb1c0 0x563165216630 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fdd70008010 tx=0x7fdd70004ac0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd81703000 1 -- 172.21.15.26:0/19181570 shutdown_connections 2023-10-14T11:14:56.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd81703000 1 --2- 172.21.15.26:0/19181570 >> [v2:172.21.15.26:6836/2641279888,v1:172.21.15.26:6837/2641279888] conn(0x563165259520 0x563165259900 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd81703000 1 --2- 172.21.15.26:0/19181570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631651fb1c0 0x563165216630 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd81703000 1 --2- 172.21.15.26:0/19181570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5631651fa8a0 0x5631652160f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd81703000 1 --2- 172.21.15.26:0/19181570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631651b0c50 0x5631651e7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd56ffd640 0 client.6288 ms_handle_reset on v2:172.21.15.26:6836/2641279888 2023-10-14T11:14:56.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd81703000 1 -- 172.21.15.26:0/19181570 >> 172.21.15.26:0/19181570 conn(0x5631651a7fc0 msgr2=0x56316520cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:56.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd81703000 1 -- 172.21.15.26:0/19181570 shutdown_connections 2023-10-14T11:14:56.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd81703000 1 -- 172.21.15.26:0/19181570 wait complete. 2023-10-14T11:14:56.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd81703000 20 client.6288 trim_cache size 0 max 16384 2023-10-14T11:14:56.771 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:14:56.771 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "9730719c-9713-4147-aaa1-ca8aabbbe5ad", 2023-10-14T11:14:56.771 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-10-14T11:14:56.771 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 6147, 2023-10-14T11:14:56.772 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-10-14T11:14:56.772 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-10-14T11:14:56.772 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "testcephfs1", 2023-10-14T11:14:56.772 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 6.174973638, 2023-10-14T11:14:56.772 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 26, 2023-10-14T11:14:56.772 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 55, 2023-10-14T11:14:56.773 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 55, 2023-10-14T11:14:56.773 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 12.006749294 2023-10-14T11:14:56.773 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:14:56.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd7e380640 1 -- 172.21.15.26:0/1591204634 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdd640664d0 msgr2=0x7fdd64068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:56.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd7e380640 1 --2- 172.21.15.26:0/1591204634 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdd640664d0 0x7fdd64068990 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdd680ad000 tx=0x7fdd68008040 comp rx=0 tx=0).stop 2023-10-14T11:14:56.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd7e380640 1 -- 172.21.15.26:0/1591204634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd780cda30 msgr2=0x7fdd780c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:56.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd7e380640 1 --2- 172.21.15.26:0/1591204634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd780cda30 0x7fdd780c85b0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c007fd0 tx=0x7fdd6c00c890 comp rx=0 tx=0).stop 2023-10-14T11:14:56.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd7e380640 1 -- 172.21.15.26:0/1591204634 shutdown_connections 2023-10-14T11:14:56.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd7e380640 1 --2- 172.21.15.26:0/1591204634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd7815a880 0x7fdd780c1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd7e380640 1 --2- 172.21.15.26:0/1591204634 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdd640664d0 0x7fdd64068990 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd7e380640 1 --2- 172.21.15.26:0/1591204634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd780cda30 0x7fdd780c85b0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd7e380640 1 --2- 172.21.15.26:0/1591204634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd780b00e0 0x7fdd780c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd7e380640 1 -- 172.21.15.26:0/1591204634 >> 172.21.15.26:0/1591204634 conn(0x7fdd7806c190 msgr2=0x7fdd780af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:56.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd7e380640 1 -- 172.21.15.26:0/1591204634 shutdown_connections 2023-10-14T11:14:56.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.751+0000 7fdd7e380640 1 -- 172.21.15.26:0/1591204634 wait complete. 2023-10-14T11:14:56.778 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T11:14:56.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.919+0000 7f0a5233e640 1 Processor -- start 2023-10-14T11:14:56.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.919+0000 7f0a5233e640 1 -- start start 2023-10-14T11:14:56.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.919+0000 7f0a5233e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a4c1597c0 0x7f0a4c0ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.919+0000 7f0a5233e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0a4c0adc10 0x7f0a4c0cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.919+0000 7f0a5233e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a4c0723d0 con 0x7f0a4c159ba0 2023-10-14T11:14:56.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.919+0000 7f0a5233e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a4c0717c0 con 0x7f0a4c0adc10 2023-10-14T11:14:56.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.919+0000 7f0a5233e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c071aa0 con 0x7f0a4c1597c0 2023-10-14T11:14:56.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.919+0000 7f0a508db640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0a4c0adc10 0x7f0a4c0cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.919+0000 7f0a508db640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0a4c0adc10 0x7f0a4c0cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54516/0 (socket says 172.21.15.26:54516) 2023-10-14T11:14:56.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.919+0000 7f0a508db640 1 -- 172.21.15.26:0/4128798408 learned_addr learned my addr 172.21.15.26:0/4128798408 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:56.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.919+0000 7f0a4bfff640 1 --2- 172.21.15.26:0/4128798408 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a4c1597c0 0x7f0a4c0ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.923+0000 7f0a508db640 1 -- 172.21.15.26:0/4128798408 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a4c1597c0 msgr2=0x7f0a4c0ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:56.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.923+0000 7f0a508db640 1 --2- 172.21.15.26:0/4128798408 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a4c1597c0 0x7f0a4c0ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.923+0000 7f0a508db640 1 -- 172.21.15.26:0/4128798408 >> v1:172.21.15.110:6789/0 conn(0x7f0a4c159ba0 legacy=0x7f0a4c0cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:56.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.923+0000 7f0a508db640 1 -- 172.21.15.26:0/4128798408 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4c071d80 con 0x7f0a4c0adc10 2023-10-14T11:14:56.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.923+0000 7f0a4bfff640 1 --2- 172.21.15.26:0/4128798408 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a4c1597c0 0x7f0a4c0ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:56.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.923+0000 7f0a508db640 1 --2- 172.21.15.26:0/4128798408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a4c0adc10 0x7f0a4c0cb520 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0a44009e50 tx=0x7f0a4401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef9892c2553cdca server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:56.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.923+0000 7f0a4affd640 1 -- 172.21.15.26:0/4128798408 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a440a5880 con 0x7f0a4c0adc10 2023-10-14T11:14:56.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.923+0000 7f0a4affd640 1 -- 172.21.15.26:0/4128798408 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a440a59e0 con 0x7f0a4c0adc10 2023-10-14T11:14:56.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.923+0000 7f0a4affd640 1 -- 172.21.15.26:0/4128798408 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a440a5d70 con 0x7f0a4c0adc10 2023-10-14T11:14:56.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.923+0000 7f0a5233e640 1 -- 172.21.15.26:0/4128798408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a4c0adc10 msgr2=0x7f0a4c0cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:56.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.923+0000 7f0a5233e640 1 --2- 172.21.15.26:0/4128798408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a4c0adc10 0x7f0a4c0cb520 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0a44009e50 tx=0x7f0a4401ca10 comp rx=0 tx=0).stop 2023-10-14T11:14:56.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.923+0000 7f0a5233e640 1 -- 172.21.15.26:0/4128798408 shutdown_connections 2023-10-14T11:14:56.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.923+0000 7f0a5233e640 1 --2- 172.21.15.26:0/4128798408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a4c0adc10 0x7f0a4c0cb520 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.923+0000 7f0a5233e640 1 --2- 172.21.15.26:0/4128798408 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a4c1597c0 0x7f0a4c0ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.923+0000 7f0a5233e640 1 -- 172.21.15.26:0/4128798408 >> 172.21.15.26:0/4128798408 conn(0x7f0a4c06c190 msgr2=0x7f0a4c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:56.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.923+0000 7f0a5233e640 1 -- 172.21.15.26:0/4128798408 shutdown_connections 2023-10-14T11:14:56.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.923+0000 7f0a5233e640 1 -- 172.21.15.26:0/4128798408 wait complete. 2023-10-14T11:14:56.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a5233e640 1 Processor -- start 2023-10-14T11:14:56.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a5233e640 1 -- start start 2023-10-14T11:14:56.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a5233e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a4c0adc10 0x7f0a4c149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a5233e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a4c1597c0 0x7f0a4c159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a5233e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a4c159ba0 0x7f0a4c15a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a5233e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c14bc10 con 0x7f0a4c0adc10 2023-10-14T11:14:56.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a5233e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c0c6710 con 0x7f0a4c1597c0 2023-10-14T11:14:56.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a5233e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c0c5de0 con 0x7f0a4c159ba0 2023-10-14T11:14:56.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a4bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a4c0adc10 0x7f0a4c149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a4bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a4c0adc10 0x7f0a4c149390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54528/0 (socket says 172.21.15.26:54528) 2023-10-14T11:14:56.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a4bfff640 1 -- 172.21.15.26:0/714594442 learned_addr learned my addr 172.21.15.26:0/714594442 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:56.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a4b7fe640 1 --2- 172.21.15.26:0/714594442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a4c1597c0 0x7f0a4c159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a508db640 1 --2- 172.21.15.26:0/714594442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a4c159ba0 0x7f0a4c15a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a4bfff640 1 -- 172.21.15.26:0/714594442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a4c159ba0 msgr2=0x7f0a4c15a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:56.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a4bfff640 1 --2- 172.21.15.26:0/714594442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a4c159ba0 0x7f0a4c15a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a4bfff640 1 -- 172.21.15.26:0/714594442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a4c1597c0 msgr2=0x7f0a4c159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:56.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a4bfff640 1 --2- 172.21.15.26:0/714594442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a4c1597c0 0x7f0a4c159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:56.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a4bfff640 1 -- 172.21.15.26:0/714594442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a44009b30 con 0x7f0a4c0adc10 2023-10-14T11:14:56.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a4bfff640 1 --2- 172.21.15.26:0/714594442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a4c0adc10 0x7f0a4c149390 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c00e840 tx=0x7f0a3c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:56.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a48ff9640 1 -- 172.21.15.26:0/714594442 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c00c8d0 con 0x7f0a4c0adc10 2023-10-14T11:14:56.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a48ff9640 1 -- 172.21.15.26:0/714594442 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3c00ca30 con 0x7f0a4c0adc10 2023-10-14T11:14:56.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a5233e640 1 -- 172.21.15.26:0/714594442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4c0c60c0 con 0x7f0a4c0adc10 2023-10-14T11:14:56.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.927+0000 7f0a48ff9640 1 -- 172.21.15.26:0/714594442 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c00cdc0 con 0x7f0a4c0adc10 2023-10-14T11:14:56.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.931+0000 7f0a5233e640 1 -- 172.21.15.26:0/714594442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4c1498d0 con 0x7f0a4c0adc10 2023-10-14T11:14:56.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.931+0000 7f0a5233e640 1 -- 172.21.15.26:0/714594442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4c074010 con 0x7f0a4c0adc10 2023-10-14T11:14:56.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.931+0000 7f0a48ff9640 1 -- 172.21.15.26:0/714594442 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0a3c013410 con 0x7f0a4c0adc10 2023-10-14T11:14:56.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.931+0000 7f0a48ff9640 1 --2- 172.21.15.26:0/714594442 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0a380664a0 0x7f0a38068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:56.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.931+0000 7f0a48ff9640 1 -- 172.21.15.26:0/714594442 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f0a3c083d80 con 0x7f0a4c0adc10 2023-10-14T11:14:56.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.931+0000 7f0a4b7fe640 1 --2- 172.21.15.26:0/714594442 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0a380664a0 0x7f0a38068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:56.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.935+0000 7f0a4b7fe640 1 --2- 172.21.15.26:0/714594442 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0a380664a0 0x7f0a38068960 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c156c70 tx=0x7f0a40009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:56.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:56.935+0000 7f0a48ff9640 1 -- 172.21.15.26:0/714594442 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0a3c0510b0 con 0x7f0a4c0adc10 2023-10-14T11:14:57.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:57.127+0000 7f0a5233e640 1 -- 172.21.15.26:0/714594442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0a4c0ad6c0 con 0x7f0a4c0adc10 2023-10-14T11:14:57.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:57.127+0000 7f0a48ff9640 1 -- 172.21.15.26:0/714594442 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0a3c0546d0 con 0x7f0a4c0adc10 2023-10-14T11:14:57.136 INFO:teuthology.orchestra.run.smithi026.stdout:name: testcephfs1, metadata pool: testcephfs1_metadata, data pools: [testcephfs1_data ] 2023-10-14T11:14:57.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:57.131+0000 7f0a5233e640 1 -- 172.21.15.26:0/714594442 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0a380664a0 msgr2=0x7f0a38068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:57.131+0000 7f0a5233e640 1 --2- 172.21.15.26:0/714594442 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0a380664a0 0x7f0a38068960 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c156c70 tx=0x7f0a40009040 comp rx=0 tx=0).stop 2023-10-14T11:14:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:57.131+0000 7f0a5233e640 1 -- 172.21.15.26:0/714594442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a4c0adc10 msgr2=0x7f0a4c149390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:57.131+0000 7f0a5233e640 1 --2- 172.21.15.26:0/714594442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a4c0adc10 0x7f0a4c149390 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c00e840 tx=0x7f0a3c00ed00 comp rx=0 tx=0).stop 2023-10-14T11:14:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:57.131+0000 7f0a5233e640 1 -- 172.21.15.26:0/714594442 shutdown_connections 2023-10-14T11:14:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:57.131+0000 7f0a5233e640 1 --2- 172.21.15.26:0/714594442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a4c159ba0 0x7f0a4c15a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:57.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:57.131+0000 7f0a5233e640 1 --2- 172.21.15.26:0/714594442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a4c1597c0 0x7f0a4c159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:57.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:57.131+0000 7f0a5233e640 1 --2- 172.21.15.26:0/714594442 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0a380664a0 0x7f0a38068960 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:57.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:57.131+0000 7f0a5233e640 1 --2- 172.21.15.26:0/714594442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a4c0adc10 0x7f0a4c149390 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:57.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:57.131+0000 7f0a5233e640 1 -- 172.21.15.26:0/714594442 >> 172.21.15.26:0/714594442 conn(0x7f0a4c06c190 msgr2=0x7f0a4c0cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:57.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:57.131+0000 7f0a5233e640 1 -- 172.21.15.26:0/714594442 shutdown_connections 2023-10-14T11:14:57.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:57.131+0000 7f0a5233e640 1 -- 172.21.15.26:0/714594442 wait complete. 2023-10-14T11:14:57.157 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T11:14:57.157 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T11:14:57.158 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-14T11:14:57.158 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T11:14:57.158 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T11:14:57.159 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T11:14:57.159 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T11:14:57.159 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T11:14:57.159 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:14:57.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:57.160 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-14T11:14:57.170 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:14:57.171 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:14:57.171 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:14:57.171 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:57.171 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-14T11:14:57.172 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:57.172 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:14:57.172 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-14T11:14:57.172 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-14T11:14:57.172 INFO:teuthology.orchestra.run.smithi026.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T11:14:57.172 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:14:57.173 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-14T11:14:57.173 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-14T11:14:57.173 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42280sec preferred_lft 42280sec 2023-10-14T11:14:57.173 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-14T11:14:57.173 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:57.174 INFO:teuthology.orchestra.run.smithi026.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:14:57.174 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-14T11:14:57.174 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-14T11:14:57.174 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:14:57.174 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:14:57.175 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-14T11:14:57.175 INFO:teuthology.orchestra.run.smithi026.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-14T11:14:57.175 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 02:42:e1:29:12:f0 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:14:57.175 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-14T11:14:57.175 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:57.175 INFO:teuthology.orchestra.run.smithi026.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T11:14:57.176 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-14T11:14:57.176 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T11:14:57.176 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:57.176 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-14T11:14:57.176 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:57.176 INFO:teuthology.orchestra.run.smithi026.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T11:14:57.177 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:14:57.177 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-14T11:14:57.177 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:57.177 INFO:teuthology.orchestra.run.smithi026.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T11:14:57.177 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:14:57.178 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-14T11:14:57.178 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:14:57.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:57.179 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T11:14:57.230 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-14T11:14:57.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:57.233 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-14T11:14:57.285 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-14T11:14:57.286 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T11:14:57.286 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-14T11:14:57.286 INFO:teuthology.orchestra.run.smithi026.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-14T11:14:57.286 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-14T11:14:57.286 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T11:14:57.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:57.287 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-14T11:14:57.288 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-14T11:14:57.288 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T11:14:57.288 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T11:14:57.289 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T11:14:57.289 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-14T11:14:57.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:57.380 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-14T11:14:57.390 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T11:14:57.391 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T11:14:57.391 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:14:57.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:57.392 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-10-14T11:14:57.456 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-14T11:14:57.457 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:14:57.457 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T11:14:57.508 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:14:57.508 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:14:57.509 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T11:14:57.559 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-10-14T11:14:57.624 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:14:57.677 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2023-10-14T11:14:57.678 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2023-10-14T11:14:57.678 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2023-10-14T11:14:57.678 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2023-10-14T11:14:57.678 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2023-10-14T11:14:57.678 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2023-10-14T11:14:57.679 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2023-10-14T11:14:57.679 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2023-10-14T11:14:57.679 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2023-10-14T11:14:57.679 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2023-10-14T11:14:57.679 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2023-10-14T11:14:57.680 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2023-10-14T11:14:57.680 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:14:57.680 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2023-10-14T11:14:57.680 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2023-10-14T11:14:57.680 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2023-10-14T11:14:57.681 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2023-10-14T11:14:57.681 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2023-10-14T11:14:57.681 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2023-10-14T11:14:57.681 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2023-10-14T11:14:57.681 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:14:57.682 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2023-10-14T11:14:57.682 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2023-10-14T11:14:57.682 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2023-10-14T11:14:57.682 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T11:14:57.682 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T11:14:57.683 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T11:14:57.683 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T11:14:57.684 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2023-10-14T11:14:57.684 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:14:57.684 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:14:57.684 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:14:57.685 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:14:57.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:57.686 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-10-14T11:14:57.736 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-14T11:14:57.736 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-14T11:14:57.782 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-10-14T11:14:57.804 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:14:57.857 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2023-10-14T11:14:57.858 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2023-10-14T11:14:57.858 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2023-10-14T11:14:57.858 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2023-10-14T11:14:57.858 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2023-10-14T11:14:57.859 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2023-10-14T11:14:57.859 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2023-10-14T11:14:57.859 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2023-10-14T11:14:57.859 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2023-10-14T11:14:57.859 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2023-10-14T11:14:57.860 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2023-10-14T11:14:57.860 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2023-10-14T11:14:57.860 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:14:57.860 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2023-10-14T11:14:57.860 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2023-10-14T11:14:57.860 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2023-10-14T11:14:57.861 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2023-10-14T11:14:57.861 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2023-10-14T11:14:57.861 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2023-10-14T11:14:57.861 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2023-10-14T11:14:57.861 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:14:57.862 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2023-10-14T11:14:57.862 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2023-10-14T11:14:57.862 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2023-10-14T11:14:57.862 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T11:14:57.862 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T11:14:57.863 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T11:14:57.863 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T11:14:57.863 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2023-10-14T11:14:57.863 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:14:57.863 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:14:57.863 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:14:57.864 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:14:57.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:57.865 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-10-14T11:14:57.880 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:2023-10-14T11:14:57.875+0000 7fe581647580 -1 init, newargv = 0x5610f878adc0 newargc=15 2023-10-14T11:14:57.881 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[50941]: starting ceph client 2023-10-14T11:14:57.888 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[50941]: starting fuse 2023-10-14T11:14:57.890 INFO:teuthology.orchestra.run.smithi026.stdout:43 2023-10-14T11:14:57.890 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-10-14T11:14:57.891 DEBUG:teuthology.orchestra.run.smithi026:> sudo stdin-killer -- python3 -c ' 2023-10-14T11:14:57.891 DEBUG:teuthology.orchestra.run.smithi026:> import glob 2023-10-14T11:14:57.892 DEBUG:teuthology.orchestra.run.smithi026:> import re 2023-10-14T11:14:57.892 DEBUG:teuthology.orchestra.run.smithi026:> import os 2023-10-14T11:14:57.892 DEBUG:teuthology.orchestra.run.smithi026:> import subprocess 2023-10-14T11:14:57.893 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:14:57.893 DEBUG:teuthology.orchestra.run.smithi026:> def _find_admin_socket(client_name): 2023-10-14T11:14:57.893 DEBUG:teuthology.orchestra.run.smithi026:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-14T11:14:57.894 DEBUG:teuthology.orchestra.run.smithi026:> files = glob.glob(asok_path) 2023-10-14T11:14:57.894 DEBUG:teuthology.orchestra.run.smithi026:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-14T11:14:57.895 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:14:57.895 DEBUG:teuthology.orchestra.run.smithi026:> # Given a non-glob path, it better be there 2023-10-14T11:14:57.895 DEBUG:teuthology.orchestra.run.smithi026:> if "*" not in asok_path: 2023-10-14T11:14:57.896 DEBUG:teuthology.orchestra.run.smithi026:> assert(len(files) == 1) 2023-10-14T11:14:57.896 DEBUG:teuthology.orchestra.run.smithi026:> return files[0] 2023-10-14T11:14:57.896 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:14:57.897 DEBUG:teuthology.orchestra.run.smithi026:> for f in files: 2023-10-14T11:14:57.897 DEBUG:teuthology.orchestra.run.smithi026:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-14T11:14:57.897 DEBUG:teuthology.orchestra.run.smithi026:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-14T11:14:57.898 DEBUG:teuthology.orchestra.run.smithi026:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-14T11:14:57.898 DEBUG:teuthology.orchestra.run.smithi026:> contents = proc_f.read() 2023-10-14T11:14:57.899 DEBUG:teuthology.orchestra.run.smithi026:> if mountpoint in contents: 2023-10-14T11:14:57.899 DEBUG:teuthology.orchestra.run.smithi026:> return f 2023-10-14T11:14:57.899 DEBUG:teuthology.orchestra.run.smithi026:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-14T11:14:57.900 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:14:57.900 DEBUG:teuthology.orchestra.run.smithi026:> print(_find_admin_socket("client.0")) 2023-10-14T11:14:57.900 DEBUG:teuthology.orchestra.run.smithi026:> ' 2023-10-14T11:14:58.019 INFO:teuthology.orchestra.run.smithi026.stdout:/var/run/ceph/ceph-client.0.50941.asok 2023-10-14T11:14:58.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-14T11:14:58.030 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.50941.asok 2023-10-14T11:14:58.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:58.031 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.50941.asok status 2023-10-14T11:14:58.205 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:14:58.206 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": { 2023-10-14T11:14:58.206 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-14T11:14:58.206 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T11:14:58.206 INFO:teuthology.orchestra.run.smithi026.stdout: "entity_id": "0", 2023-10-14T11:14:58.207 INFO:teuthology.orchestra.run.smithi026.stdout: "hostname": "smithi026", 2023-10-14T11:14:58.207 INFO:teuthology.orchestra.run.smithi026.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-14T11:14:58.207 INFO:teuthology.orchestra.run.smithi026.stdout: "pid": "50941", 2023-10-14T11:14:58.207 INFO:teuthology.orchestra.run.smithi026.stdout: "root": "/" 2023-10-14T11:14:58.207 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:58.208 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_count": 0, 2023-10-14T11:14:58.208 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_pinned_count": 0, 2023-10-14T11:14:58.208 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 6303, 2023-10-14T11:14:58.208 INFO:teuthology.orchestra.run.smithi026.stdout: "inst": { 2023-10-14T11:14:58.208 INFO:teuthology.orchestra.run.smithi026.stdout: "name": { 2023-10-14T11:14:58.208 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "client", 2023-10-14T11:14:58.209 INFO:teuthology.orchestra.run.smithi026.stdout: "num": 6303 2023-10-14T11:14:58.209 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:58.209 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-10-14T11:14:58.209 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-14T11:14:58.209 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2023-10-14T11:14:58.210 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 2085407489 2023-10-14T11:14:58.210 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:14:58.210 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:58.210 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-10-14T11:14:58.210 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-14T11:14:58.211 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2023-10-14T11:14:58.211 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 2085407489 2023-10-14T11:14:58.211 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:14:58.211 INFO:teuthology.orchestra.run.smithi026.stdout: "inst_str": "client.6303 192.168.0.1:0/2085407489", 2023-10-14T11:14:58.211 INFO:teuthology.orchestra.run.smithi026.stdout: "addr_str": "192.168.0.1:0/2085407489", 2023-10-14T11:14:58.212 INFO:teuthology.orchestra.run.smithi026.stdout: "inode_count": 1, 2023-10-14T11:14:58.212 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_epoch": 26, 2023-10-14T11:14:58.212 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch": 55, 2023-10-14T11:14:58.212 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch_barrier": 0, 2023-10-14T11:14:58.212 INFO:teuthology.orchestra.run.smithi026.stdout: "blocklisted": false, 2023-10-14T11:14:58.213 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "testcephfs1" 2023-10-14T11:14:58.213 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:14:58.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:58.221 DEBUG:teuthology.orchestra.run.smithi026:> stat --file-system '--printf=%T 2023-10-14T11:14:58.221 DEBUG:teuthology.orchestra.run.smithi026:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-14T11:14:58.231 INFO:teuthology.orchestra.run.smithi026.stdout:fuseblk 2023-10-14T11:14:58.232 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-14T11:14:58.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:58.232 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T11:14:58.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:14:58.297 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch test_file) 2023-10-14T11:14:58.356 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow r pool=testcephfs1_data' 2023-10-14T11:14:58.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.543+0000 7f7d175d9640 1 Processor -- start 2023-10-14T11:14:58.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.543+0000 7f7d175d9640 1 -- start start 2023-10-14T11:14:58.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.543+0000 7f7d175d9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7d10160e00 0x7f7d101656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:58.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.543+0000 7f7d175d9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7d100c3cf0 0x7f7d100cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:58.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.543+0000 7f7d175d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d10069e90 0x7f7d1006a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:58.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.543+0000 7f7d175d9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d1006a820 con 0x7f7d100c3cf0 2023-10-14T11:14:58.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.543+0000 7f7d175d9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d100cd7b0 con 0x7f7d10160e00 2023-10-14T11:14:58.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.543+0000 7f7d175d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d100c92c0 con 0x7f7d10069e90 2023-10-14T11:14:58.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.543+0000 7f7d14b74640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7d100c3cf0 0x7f7d100cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:58.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.543+0000 7f7d14b74640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7d100c3cf0 0x7f7d100cc9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54544/0 (socket says 172.21.15.26:54544) 2023-10-14T11:14:58.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.543+0000 7f7d14b74640 1 -- 172.21.15.26:0/386817772 learned_addr learned my addr 172.21.15.26:0/386817772 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:58.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.543+0000 7f7d15b76640 1 --2- 172.21.15.26:0/386817772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d10069e90 0x7f7d1006a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:58.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.543+0000 7f7d15375640 1 --2- 172.21.15.26:0/386817772 >> v2:172.21.15.110:3300/0 conn(0x7f7d10160e00 0x7f7d101656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:58.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.543+0000 7f7d14b74640 1 -- 172.21.15.26:0/386817772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d10069e90 msgr2=0x7f7d1006a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:58.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.543+0000 7f7d14b74640 1 --2- 172.21.15.26:0/386817772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d10069e90 0x7f7d1006a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:58.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.543+0000 7f7d14b74640 1 -- 172.21.15.26:0/386817772 >> v2:172.21.15.110:3300/0 conn(0x7f7d10160e00 msgr2=0x7f7d101656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:58.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.543+0000 7f7d14b74640 1 --2- 172.21.15.26:0/386817772 >> v2:172.21.15.110:3300/0 conn(0x7f7d10160e00 0x7f7d101656d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:58.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.543+0000 7f7d14b74640 1 -- 172.21.15.26:0/386817772 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d100c9540 con 0x7f7d100c3cf0 2023-10-14T11:14:58.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.547+0000 7f7d14b74640 1 --2- 172.21.15.26:0/386817772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d100c3cf0 0x7f7d100cc9e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f7d100c9730 tx=0x7f7d0001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84d66ff6219df2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:58.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.547+0000 7f7d07fff640 1 -- 172.21.15.26:0/386817772 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d000a6040 con 0x7f7d100c3cf0 2023-10-14T11:14:58.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.547+0000 7f7d07fff640 1 -- 172.21.15.26:0/386817772 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d000aa600 con 0x7f7d100c3cf0 2023-10-14T11:14:58.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.547+0000 7f7d07fff640 1 -- 172.21.15.26:0/386817772 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d000aa990 con 0x7f7d100c3cf0 2023-10-14T11:14:58.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.547+0000 7f7d175d9640 1 -- 172.21.15.26:0/386817772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d100c3cf0 msgr2=0x7f7d100cc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:58.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.547+0000 7f7d175d9640 1 --2- 172.21.15.26:0/386817772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d100c3cf0 0x7f7d100cc9e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f7d100c9730 tx=0x7f7d0001c4e0 comp rx=0 tx=0).stop 2023-10-14T11:14:58.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.547+0000 7f7d175d9640 1 -- 172.21.15.26:0/386817772 shutdown_connections 2023-10-14T11:14:58.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.547+0000 7f7d175d9640 1 --2- 172.21.15.26:0/386817772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d10069e90 0x7f7d1006a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:58.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.547+0000 7f7d175d9640 1 --2- 172.21.15.26:0/386817772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d100c3cf0 0x7f7d100cc9e0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:58.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.547+0000 7f7d175d9640 1 --2- 172.21.15.26:0/386817772 >> v2:172.21.15.110:3300/0 conn(0x7f7d10160e00 0x7f7d101656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:58.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.547+0000 7f7d175d9640 1 -- 172.21.15.26:0/386817772 >> 172.21.15.26:0/386817772 conn(0x7f7d100b0d10 msgr2=0x7f7d100ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:58.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.547+0000 7f7d175d9640 1 -- 172.21.15.26:0/386817772 shutdown_connections 2023-10-14T11:14:58.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.547+0000 7f7d175d9640 1 -- 172.21.15.26:0/386817772 wait complete. 2023-10-14T11:14:58.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d175d9640 1 Processor -- start 2023-10-14T11:14:58.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d175d9640 1 -- start start 2023-10-14T11:14:58.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d175d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d10069e90 0x7f7d10154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:58.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d175d9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d100c3cf0 0x7f7d101551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:58.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d175d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d10160e00 0x7f7d10157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:58.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d175d9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d101fa690 con 0x7f7d100c3cf0 2023-10-14T11:14:58.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d175d9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d100af420 con 0x7f7d10160e00 2023-10-14T11:14:58.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d175d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d100af700 con 0x7f7d10069e90 2023-10-14T11:14:58.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d14b74640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d100c3cf0 0x7f7d101551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:58.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d14b74640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d100c3cf0 0x7f7d101551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54560/0 (socket says 172.21.15.26:54560) 2023-10-14T11:14:58.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d14b74640 1 -- 172.21.15.26:0/3670463954 learned_addr learned my addr 172.21.15.26:0/3670463954 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:58.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d15375640 1 --2- 172.21.15.26:0/3670463954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d10069e90 0x7f7d10154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:58.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d15b76640 1 --2- 172.21.15.26:0/3670463954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d10160e00 0x7f7d10157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:58.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d14b74640 1 -- 172.21.15.26:0/3670463954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d10069e90 msgr2=0x7f7d10154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:58.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d14b74640 1 --2- 172.21.15.26:0/3670463954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d10069e90 0x7f7d10154a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:58.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d14b74640 1 -- 172.21.15.26:0/3670463954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d10160e00 msgr2=0x7f7d10157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:58.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d14b74640 1 --2- 172.21.15.26:0/3670463954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d10160e00 0x7f7d10157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:58.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d14b74640 1 -- 172.21.15.26:0/3670463954 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d000094d0 con 0x7f7d100c3cf0 2023-10-14T11:14:58.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d15375640 1 --2- 172.21.15.26:0/3670463954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d10069e90 0x7f7d10154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:58.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d14b74640 1 --2- 172.21.15.26:0/3670463954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d100c3cf0 0x7f7d101551e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7d00000c10 tx=0x7f7d0001ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:58.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d05ffb640 1 -- 172.21.15.26:0/3670463954 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d000b3600 con 0x7f7d100c3cf0 2023-10-14T11:14:58.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d05ffb640 1 -- 172.21.15.26:0/3670463954 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d000b3760 con 0x7f7d100c3cf0 2023-10-14T11:14:58.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.551+0000 7f7d175d9640 1 -- 172.21.15.26:0/3670463954 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d100af9e0 con 0x7f7d100c3cf0 2023-10-14T11:14:58.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.555+0000 7f7d05ffb640 1 -- 172.21.15.26:0/3670463954 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d000b3b10 con 0x7f7d100c3cf0 2023-10-14T11:14:58.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.555+0000 7f7d175d9640 1 -- 172.21.15.26:0/3670463954 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d10154f60 con 0x7f7d100c3cf0 2023-10-14T11:14:58.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.555+0000 7f7d175d9640 1 -- 172.21.15.26:0/3670463954 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d101fab20 con 0x7f7d100c3cf0 2023-10-14T11:14:58.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.555+0000 7f7d05ffb640 1 -- 172.21.15.26:0/3670463954 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7d000b3c70 con 0x7f7d100c3cf0 2023-10-14T11:14:58.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.555+0000 7f7d05ffb640 1 --2- 172.21.15.26:0/3670463954 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7cf40664a0 0x7f7cf4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:58.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.555+0000 7f7d05ffb640 1 -- 172.21.15.26:0/3670463954 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f7d0011e750 con 0x7f7d100c3cf0 2023-10-14T11:14:58.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.555+0000 7f7d15375640 1 --2- 172.21.15.26:0/3670463954 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7cf40664a0 0x7f7cf4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:58.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.559+0000 7f7d15375640 1 --2- 172.21.15.26:0/3670463954 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7cf40664a0 0x7f7cf4068960 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c009a90 tx=0x7f7d0c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:58.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.559+0000 7f7d05ffb640 1 -- 172.21.15.26:0/3670463954 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7d101fab20 con 0x7f7d100c3cf0 2023-10-14T11:14:58.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.779+0000 7f7d175d9640 1 -- 172.21.15.26:0/3670463954 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=testcephfs1_data"]} v 0) v1 -- 0x7f7d101fab20 con 0x7f7d100c3cf0 2023-10-14T11:14:58.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.783+0000 7f7d05ffb640 1 -- 172.21.15.26:0/3670463954 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=testcephfs1_data"]}]=0 updated caps for client.0 v16) v1 ==== 188+0+145 (secure 0 0 0) 0x7f7d101fab20 con 0x7f7d100c3cf0 2023-10-14T11:14:58.790 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2023-10-14T11:14:58.791 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBZdyplGXdwHxAA3yn7fC60cZX9BQGuvdlfYw== 2023-10-14T11:14:58.791 INFO:teuthology.orchestra.run.smithi026.stdout: caps mds = "allow" 2023-10-14T11:14:58.791 INFO:teuthology.orchestra.run.smithi026.stdout: caps mon = "allow r" 2023-10-14T11:14:58.791 INFO:teuthology.orchestra.run.smithi026.stdout: caps osd = "allow r pool=testcephfs1_data" 2023-10-14T11:14:58.791 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-10-14T11:14:58.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.787+0000 7f7d175d9640 1 -- 172.21.15.26:0/3670463954 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7cf40664a0 msgr2=0x7f7cf4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:58.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.787+0000 7f7d175d9640 1 --2- 172.21.15.26:0/3670463954 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7cf40664a0 0x7f7cf4068960 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c009a90 tx=0x7f7d0c008040 comp rx=0 tx=0).stop 2023-10-14T11:14:58.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.787+0000 7f7d175d9640 1 -- 172.21.15.26:0/3670463954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d100c3cf0 msgr2=0x7f7d101551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:58.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.787+0000 7f7d175d9640 1 --2- 172.21.15.26:0/3670463954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d100c3cf0 0x7f7d101551e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7d00000c10 tx=0x7f7d0001ad20 comp rx=0 tx=0).stop 2023-10-14T11:14:58.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.787+0000 7f7d175d9640 1 -- 172.21.15.26:0/3670463954 shutdown_connections 2023-10-14T11:14:58.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.787+0000 7f7d175d9640 1 --2- 172.21.15.26:0/3670463954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d10160e00 0x7f7d10157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:58.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.787+0000 7f7d175d9640 1 --2- 172.21.15.26:0/3670463954 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f7cf40664a0 0x7f7cf4068960 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:58.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.787+0000 7f7d175d9640 1 --2- 172.21.15.26:0/3670463954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d100c3cf0 0x7f7d101551e0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:58.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.787+0000 7f7d175d9640 1 --2- 172.21.15.26:0/3670463954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d10069e90 0x7f7d10154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:58.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.787+0000 7f7d175d9640 1 -- 172.21.15.26:0/3670463954 >> 172.21.15.26:0/3670463954 conn(0x7f7d100b0d10 msgr2=0x7f7d1006d830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:58.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.787+0000 7f7d175d9640 1 -- 172.21.15.26:0/3670463954 shutdown_connections 2023-10-14T11:14:58.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.787+0000 7f7d175d9640 1 -- 172.21.15.26:0/3670463954 wait complete. 2023-10-14T11:14:58.811 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:14:58.812 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:14:58.821 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:14:59.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.999+0000 7f56e5632640 1 Processor -- start 2023-10-14T11:14:59.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.999+0000 7f56e5632640 1 -- start start 2023-10-14T11:14:59.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.999+0000 7f56e5632640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f56e0070c40 0x7f56e015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:59.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.999+0000 7f56e5632640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f56e00b4020 0x7f56e00b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:59.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.999+0000 7f56e5632640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00b0620 0x7f56e015c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:59.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.999+0000 7f56e5632640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e015b3b0 con 0x7f56e0070c40 2023-10-14T11:14:59.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.999+0000 7f56e5632640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e00b0a70 con 0x7f56e00b4020 2023-10-14T11:14:59.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:58.999+0000 7f56e5632640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e015be60 con 0x7f56e00b0620 2023-10-14T11:14:59.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.003+0000 7f56deffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f56e0070c40 0x7f56e015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:59.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.003+0000 7f56deffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f56e0070c40 0x7f56e015ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54572/0 (socket says 172.21.15.26:54572) 2023-10-14T11:14:59.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.003+0000 7f56deffd640 1 -- 172.21.15.26:0/2951753565 learned_addr learned my addr 172.21.15.26:0/2951753565 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:59.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.003+0000 7f56d7fff640 1 --2- 172.21.15.26:0/2951753565 >> v2:172.21.15.110:3300/0 conn(0x7f56e00b4020 0x7f56e00b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:59.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.003+0000 7f56df7fe640 1 --2- 172.21.15.26:0/2951753565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00b0620 0x7f56e015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:59.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.003+0000 7f56deffd640 1 -- 172.21.15.26:0/2951753565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00b0620 msgr2=0x7f56e015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:59.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.003+0000 7f56deffd640 1 --2- 172.21.15.26:0/2951753565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00b0620 0x7f56e015c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.003+0000 7f56deffd640 1 -- 172.21.15.26:0/2951753565 >> v2:172.21.15.110:3300/0 conn(0x7f56e00b4020 msgr2=0x7f56e00b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:59.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.003+0000 7f56deffd640 1 --2- 172.21.15.26:0/2951753565 >> v2:172.21.15.110:3300/0 conn(0x7f56e00b4020 0x7f56e00b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.003+0000 7f56deffd640 1 -- 172.21.15.26:0/2951753565 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e015c1f0 con 0x7f56e0070c40 2023-10-14T11:14:59.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.003+0000 7f56df7fe640 1 --2- 172.21.15.26:0/2951753565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00b0620 0x7f56e015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:59.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.003+0000 7f56deffd640 1 --2- 172.21.15.26:0/2951753565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56e0070c40 0x7f56e015ae70 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f56e00cc1e0 tx=0x7f56d001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b98bb07022658 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:59.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.003+0000 7f56de7fc640 1 -- 172.21.15.26:0/2951753565 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d00a7070 con 0x7f56e0070c40 2023-10-14T11:14:59.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.003+0000 7f56de7fc640 1 -- 172.21.15.26:0/2951753565 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d00ab430 con 0x7f56e0070c40 2023-10-14T11:14:59.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.003+0000 7f56de7fc640 1 -- 172.21.15.26:0/2951753565 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d00ab7c0 con 0x7f56e0070c40 2023-10-14T11:14:59.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56e5632640 1 -- 172.21.15.26:0/2951753565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56e0070c40 msgr2=0x7f56e015ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:59.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56e5632640 1 --2- 172.21.15.26:0/2951753565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56e0070c40 0x7f56e015ae70 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f56e00cc1e0 tx=0x7f56d001c470 comp rx=0 tx=0).stop 2023-10-14T11:14:59.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56e5632640 1 -- 172.21.15.26:0/2951753565 shutdown_connections 2023-10-14T11:14:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56e5632640 1 --2- 172.21.15.26:0/2951753565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00b0620 0x7f56e015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56e5632640 1 --2- 172.21.15.26:0/2951753565 >> v2:172.21.15.110:3300/0 conn(0x7f56e00b4020 0x7f56e00b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56e5632640 1 --2- 172.21.15.26:0/2951753565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56e0070c40 0x7f56e015ae70 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56e5632640 1 -- 172.21.15.26:0/2951753565 >> 172.21.15.26:0/2951753565 conn(0x7f56e006c190 msgr2=0x7f56e006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56e5632640 1 -- 172.21.15.26:0/2951753565 shutdown_connections 2023-10-14T11:14:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56e5632640 1 -- 172.21.15.26:0/2951753565 wait complete. 2023-10-14T11:14:59.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56e5632640 1 Processor -- start 2023-10-14T11:14:59.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56e5632640 1 -- start start 2023-10-14T11:14:59.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56e5632640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56e0070c40 0x7f56e00b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:59.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56e5632640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00b0620 0x7f56e00c0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:59.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56e5632640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56e00b4020 0x7f56e00c12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:59.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56e5632640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e00c5070 con 0x7f56e00b4020 2023-10-14T11:14:59.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56e5632640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e0150370 con 0x7f56e0070c40 2023-10-14T11:14:59.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56e5632640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e0150650 con 0x7f56e00b0620 2023-10-14T11:14:59.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56df7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56e00b4020 0x7f56e00c12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:59.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56df7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56e00b4020 0x7f56e00c12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54578/0 (socket says 172.21.15.26:54578) 2023-10-14T11:14:59.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56df7fe640 1 -- 172.21.15.26:0/3172521363 learned_addr learned my addr 172.21.15.26:0/3172521363 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:59.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56deffd640 1 --2- 172.21.15.26:0/3172521363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56e0070c40 0x7f56e00b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:59.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56d7fff640 1 --2- 172.21.15.26:0/3172521363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00b0620 0x7f56e00c0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:59.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56df7fe640 1 -- 172.21.15.26:0/3172521363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00b0620 msgr2=0x7f56e00c0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:59.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56df7fe640 1 --2- 172.21.15.26:0/3172521363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00b0620 0x7f56e00c0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56df7fe640 1 -- 172.21.15.26:0/3172521363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56e0070c40 msgr2=0x7f56e00b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:59.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56df7fe640 1 --2- 172.21.15.26:0/3172521363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56e0070c40 0x7f56e00b19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56df7fe640 1 -- 172.21.15.26:0/3172521363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d00094d0 con 0x7f56e00b4020 2023-10-14T11:14:59.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56deffd640 1 --2- 172.21.15.26:0/3172521363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56e0070c40 0x7f56e00b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:59.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.007+0000 7f56d7fff640 1 --2- 172.21.15.26:0/3172521363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00b0620 0x7f56e00c0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:14:59.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.011+0000 7f56df7fe640 1 --2- 172.21.15.26:0/3172521363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56e00b4020 0x7f56e00c12e0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f56d8007de0 tx=0x7f56d800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:59.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.011+0000 7f56d77fe640 1 -- 172.21.15.26:0/3172521363 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d80039a0 con 0x7f56e00b4020 2023-10-14T11:14:59.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.011+0000 7f56d77fe640 1 -- 172.21.15.26:0/3172521363 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d800f040 con 0x7f56e00b4020 2023-10-14T11:14:59.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.011+0000 7f56d77fe640 1 -- 172.21.15.26:0/3172521363 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d8003d40 con 0x7f56e00b4020 2023-10-14T11:14:59.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.011+0000 7f56e5632640 1 -- 172.21.15.26:0/3172521363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e0150930 con 0x7f56e00b4020 2023-10-14T11:14:59.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.011+0000 7f56e5632640 1 -- 172.21.15.26:0/3172521363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e0150ef0 con 0x7f56e00b4020 2023-10-14T11:14:59.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.011+0000 7f56e5632640 1 -- 172.21.15.26:0/3172521363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e0074010 con 0x7f56e00b4020 2023-10-14T11:14:59.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.011+0000 7f56d77fe640 1 -- 172.21.15.26:0/3172521363 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f56d8004030 con 0x7f56e00b4020 2023-10-14T11:14:59.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.011+0000 7f56d77fe640 1 --2- 172.21.15.26:0/3172521363 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f56c00664a0 0x7f56c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:59.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.011+0000 7f56d77fe640 1 -- 172.21.15.26:0/3172521363 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f56d8084440 con 0x7f56e00b4020 2023-10-14T11:14:59.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.011+0000 7f56deffd640 1 --2- 172.21.15.26:0/3172521363 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f56c00664a0 0x7f56c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:59.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.015+0000 7f56deffd640 1 --2- 172.21.15.26:0/3172521363 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f56c00664a0 0x7f56c0068960 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f56d00af000 tx=0x7f56d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:59.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.015+0000 7f56d77fe640 1 -- 172.21.15.26:0/3172521363 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f56d80516c0 con 0x7f56e00b4020 2023-10-14T11:14:59.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.175+0000 7f56e5632640 1 -- 172.21.15.26:0/3172521363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56e01510b0 con 0x7f56e00b4020 2023-10-14T11:14:59.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.175+0000 7f56d77fe640 1 -- 172.21.15.26:0/3172521363 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16790 (secure 0 0 0) 0x7f56d8054ce0 con 0x7f56e00b4020 2023-10-14T11:14:59.183 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:14:59.183 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":55,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:14:51.591742+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:14:47.752880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:14:48.971211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:14:59.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.179+0000 7f56e5632640 1 -- 172.21.15.26:0/3172521363 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f56c00664a0 msgr2=0x7f56c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:59.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.179+0000 7f56e5632640 1 --2- 172.21.15.26:0/3172521363 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f56c00664a0 0x7f56c0068960 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f56d00af000 tx=0x7f56d0008040 comp rx=0 tx=0).stop 2023-10-14T11:14:59.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.179+0000 7f56e5632640 1 -- 172.21.15.26:0/3172521363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56e00b4020 msgr2=0x7f56e00c12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:59.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.179+0000 7f56e5632640 1 --2- 172.21.15.26:0/3172521363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56e00b4020 0x7f56e00c12e0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f56d8007de0 tx=0x7f56d800d4a0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.179+0000 7f56e5632640 1 -- 172.21.15.26:0/3172521363 shutdown_connections 2023-10-14T11:14:59.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.179+0000 7f56e5632640 1 --2- 172.21.15.26:0/3172521363 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f56c00664a0 0x7f56c0068960 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.179+0000 7f56e5632640 1 --2- 172.21.15.26:0/3172521363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56e00b4020 0x7f56e00c12e0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.179+0000 7f56e5632640 1 --2- 172.21.15.26:0/3172521363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00b0620 0x7f56e00c0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.179+0000 7f56e5632640 1 --2- 172.21.15.26:0/3172521363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56e0070c40 0x7f56e00b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.179+0000 7f56e5632640 1 -- 172.21.15.26:0/3172521363 >> 172.21.15.26:0/3172521363 conn(0x7f56e006c190 msgr2=0x7f56e0153e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:59.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.179+0000 7f56e5632640 1 -- 172.21.15.26:0/3172521363 shutdown_connections 2023-10-14T11:14:59.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.179+0000 7f56e5632640 1 -- 172.21.15.26:0/3172521363 wait complete. 2023-10-14T11:14:59.204 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'testcephfs1_metadata', 'create_time': '2023-10-14T11:14:47.752880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'testcephfs1_data', 'create_time': '2023-10-14T11:14:48.971211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:14:59.205 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:14:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.343+0000 7fd2b5854640 1 Processor -- start 2023-10-14T11:14:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.343+0000 7fd2b5854640 1 -- start start 2023-10-14T11:14:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.347+0000 7fd2b5854640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd2b015cba0 0x7fd2b00d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.347+0000 7fd2b5854640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2b00b84e0 0x7fd2b00cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.347+0000 7fd2b5854640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b00d1670 con 0x7fd2b00d0040 2023-10-14T11:14:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.347+0000 7fd2b5854640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b00d1460 con 0x7fd2b015cba0 2023-10-14T11:14:59.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.347+0000 7fd2b5854640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00d04b0 con 0x7fd2b00b84e0 2023-10-14T11:14:59.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.347+0000 7fd2af7fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd2b00d0040 0x7fd2b00d2ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:53808/0 (socket says 172.21.15.26:53808) 2023-10-14T11:14:59.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.347+0000 7fd2a7fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2b00b84e0 0x7fd2b00cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:59.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.347+0000 7fd2aeffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd2b015cba0 0x7fd2b00d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:59.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.347+0000 7fd2af7fe640 1 -- 172.21.15.26:0/3014178599 learned_addr learned my addr 172.21.15.26:0/3014178599 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:59.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.347+0000 7fd2a7fff640 1 -- 172.21.15.26:0/3014178599 >> v2:172.21.15.110:3300/0 conn(0x7fd2b015cba0 msgr2=0x7fd2b00d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:14:59.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.347+0000 7fd2a7fff640 1 --2- 172.21.15.26:0/3014178599 >> v2:172.21.15.110:3300/0 conn(0x7fd2b015cba0 0x7fd2b00d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.347+0000 7fd2a7fff640 1 -- 172.21.15.26:0/3014178599 >> v1:172.21.15.110:6789/0 conn(0x7fd2b00d0040 legacy=0x7fd2b00d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:59.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.347+0000 7fd2a7fff640 1 -- 172.21.15.26:0/3014178599 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b00d1950 con 0x7fd2b00b84e0 2023-10-14T11:14:59.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.347+0000 7fd2aeffd640 1 --2- 172.21.15.26:0/3014178599 >> v2:172.21.15.110:3300/0 conn(0x7fd2b015cba0 0x7fd2b00d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:14:59.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.347+0000 7fd2ae7fc640 1 -- 172.21.15.26:0/3014178599 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522651539 0 0) 0x7fd2b00d1670 con 0x7fd2b00d0040 2023-10-14T11:14:59.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.351+0000 7fd2a7fff640 1 --2- 172.21.15.26:0/3014178599 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2b00b84e0 0x7fd2b00cfb00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd2980097c0 tx=0x7fd29801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80aee803334ae968 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:59.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.351+0000 7fd2ae7fc640 1 -- 172.21.15.26:0/3014178599 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2980ac600 con 0x7fd2b00b84e0 2023-10-14T11:14:59.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.351+0000 7fd2ae7fc640 1 -- 172.21.15.26:0/3014178599 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2980a8050 con 0x7fd2b00b84e0 2023-10-14T11:14:59.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.351+0000 7fd2ae7fc640 1 -- 172.21.15.26:0/3014178599 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2980ac980 con 0x7fd2b00b84e0 2023-10-14T11:14:59.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.351+0000 7fd2b5854640 1 -- 172.21.15.26:0/3014178599 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2b00b84e0 msgr2=0x7fd2b00cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:59.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.351+0000 7fd2b5854640 1 --2- 172.21.15.26:0/3014178599 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2b00b84e0 0x7fd2b00cfb00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd2980097c0 tx=0x7fd29801c480 comp rx=0 tx=0).stop 2023-10-14T11:14:59.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.351+0000 7fd2b5854640 1 -- 172.21.15.26:0/3014178599 shutdown_connections 2023-10-14T11:14:59.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.351+0000 7fd2b5854640 1 --2- 172.21.15.26:0/3014178599 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2b00b84e0 0x7fd2b00cfb00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.351+0000 7fd2b5854640 1 --2- 172.21.15.26:0/3014178599 >> v2:172.21.15.110:3300/0 conn(0x7fd2b015cba0 0x7fd2b00d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.351+0000 7fd2b5854640 1 -- 172.21.15.26:0/3014178599 >> 172.21.15.26:0/3014178599 conn(0x7fd2b00719c0 msgr2=0x7fd2b0071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:59.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.351+0000 7fd2b5854640 1 -- 172.21.15.26:0/3014178599 shutdown_connections 2023-10-14T11:14:59.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.351+0000 7fd2b5854640 1 -- 172.21.15.26:0/3014178599 wait complete. 2023-10-14T11:14:59.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.351+0000 7fd2b5854640 1 Processor -- start 2023-10-14T11:14:59.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.351+0000 7fd2b5854640 1 -- start start 2023-10-14T11:14:59.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2b5854640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2b00b84e0 0x7fd2b01601c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:59.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2b5854640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2b00d0040 0x7fd2b014e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:59.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2b5854640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2b015cba0 0x7fd2b014e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:59.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2b5854640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b014e760 con 0x7fd2b00d0040 2023-10-14T11:14:59.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2b5854640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b015e470 con 0x7fd2b00b84e0 2023-10-14T11:14:59.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2b5854640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b015e750 con 0x7fd2b015cba0 2023-10-14T11:14:59.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2a7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2b00d0040 0x7fd2b014e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:59.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2a7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2b00d0040 0x7fd2b014e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54584/0 (socket says 172.21.15.26:54584) 2023-10-14T11:14:59.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2a7fff640 1 -- 172.21.15.26:0/250587778 learned_addr learned my addr 172.21.15.26:0/250587778 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:59.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2aeffd640 1 --2- 172.21.15.26:0/250587778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2b00b84e0 0x7fd2b01601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:59.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2af7fe640 1 --2- 172.21.15.26:0/250587778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2b015cba0 0x7fd2b014e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:59.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2a7fff640 1 -- 172.21.15.26:0/250587778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2b015cba0 msgr2=0x7fd2b014e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:59.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2a7fff640 1 --2- 172.21.15.26:0/250587778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2b015cba0 0x7fd2b014e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2a7fff640 1 -- 172.21.15.26:0/250587778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2b00b84e0 msgr2=0x7fd2b01601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:59.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2a7fff640 1 --2- 172.21.15.26:0/250587778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2b00b84e0 0x7fd2b01601c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2a7fff640 1 -- 172.21.15.26:0/250587778 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a0009420 con 0x7fd2b00d0040 2023-10-14T11:14:59.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2a7fff640 1 --2- 172.21.15.26:0/250587778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2b00d0040 0x7fd2b014e220 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd29801a0b0 tx=0x7fd298019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:59.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2acff9640 1 -- 172.21.15.26:0/250587778 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2980b5410 con 0x7fd2b00d0040 2023-10-14T11:14:59.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2acff9640 1 -- 172.21.15.26:0/250587778 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2980b5570 con 0x7fd2b00d0040 2023-10-14T11:14:59.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2acff9640 1 -- 172.21.15.26:0/250587778 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2980b58e0 con 0x7fd2b00d0040 2023-10-14T11:14:59.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2b5854640 1 -- 172.21.15.26:0/250587778 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd298009420 con 0x7fd2b00d0040 2023-10-14T11:14:59.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2b5854640 1 -- 172.21.15.26:0/250587778 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b0154f70 con 0x7fd2b00d0040 2023-10-14T11:14:59.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.355+0000 7fd2b5854640 1 -- 172.21.15.26:0/250587778 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b015ec00 con 0x7fd2b00d0040 2023-10-14T11:14:59.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.359+0000 7fd2acff9640 1 -- 172.21.15.26:0/250587778 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd2980b3040 con 0x7fd2b00d0040 2023-10-14T11:14:59.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.359+0000 7fd2acff9640 1 --2- 172.21.15.26:0/250587778 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd2900664a0 0x7fd290068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:59.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.359+0000 7fd2acff9640 1 -- 172.21.15.26:0/250587778 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fd29811db70 con 0x7fd2b00d0040 2023-10-14T11:14:59.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.359+0000 7fd2aeffd640 1 --2- 172.21.15.26:0/250587778 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd2900664a0 0x7fd290068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:59.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.359+0000 7fd2aeffd640 1 --2- 172.21.15.26:0/250587778 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd2900664a0 0x7fd290068960 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0009c50 tx=0x7fd2a0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:59.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.363+0000 7fd2acff9640 1 -- 172.21.15.26:0/250587778 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd2980eae10 con 0x7fd2b00d0040 2023-10-14T11:14:59.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.519+0000 7fd2b5854640 1 -- 172.21.15.26:0/250587778 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2b004e170 con 0x7fd2b00d0040 2023-10-14T11:14:59.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.519+0000 7fd2acff9640 1 -- 172.21.15.26:0/250587778 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2980b1020 con 0x7fd2b00d0040 2023-10-14T11:14:59.526 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:14:59.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.519+0000 7fd2b5854640 1 -- 172.21.15.26:0/250587778 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd2900664a0 msgr2=0x7fd290068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:59.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.519+0000 7fd2b5854640 1 --2- 172.21.15.26:0/250587778 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd2900664a0 0x7fd290068960 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0009c50 tx=0x7fd2a0009190 comp rx=0 tx=0).stop 2023-10-14T11:14:59.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.519+0000 7fd2b5854640 1 -- 172.21.15.26:0/250587778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2b00d0040 msgr2=0x7fd2b014e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:59.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.519+0000 7fd2b5854640 1 --2- 172.21.15.26:0/250587778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2b00d0040 0x7fd2b014e220 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd29801a0b0 tx=0x7fd298019220 comp rx=0 tx=0).stop 2023-10-14T11:14:59.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.519+0000 7fd2b5854640 1 -- 172.21.15.26:0/250587778 shutdown_connections 2023-10-14T11:14:59.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.519+0000 7fd2b5854640 1 --2- 172.21.15.26:0/250587778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2b015cba0 0x7fd2b014e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.519+0000 7fd2b5854640 1 --2- 172.21.15.26:0/250587778 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd2900664a0 0x7fd290068960 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.519+0000 7fd2b5854640 1 --2- 172.21.15.26:0/250587778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2b00d0040 0x7fd2b014e220 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.519+0000 7fd2b5854640 1 --2- 172.21.15.26:0/250587778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2b00b84e0 0x7fd2b01601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.519+0000 7fd2b5854640 1 -- 172.21.15.26:0/250587778 >> 172.21.15.26:0/250587778 conn(0x7fd2b00719c0 msgr2=0x7fd2b00b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:59.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.519+0000 7fd2b5854640 1 -- 172.21.15.26:0/250587778 shutdown_connections 2023-10-14T11:14:59.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.519+0000 7fd2b5854640 1 -- 172.21.15.26:0/250587778 wait complete. 2023-10-14T11:14:59.547 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_metadata pg_num 2023-10-14T11:14:59.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.687+0000 7fbc7dd65640 1 Processor -- start 2023-10-14T11:14:59.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.687+0000 7fbc7dd65640 1 -- start start 2023-10-14T11:14:59.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.687+0000 7fbc7dd65640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc7806d010 0x7fbc780c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:59.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.687+0000 7fbc7dd65640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc7815ae30 con 0x7fbc780c26b0 2023-10-14T11:14:59.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.687+0000 7fbc7dd65640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc780ca510 con 0x7fbc78069e90 2023-10-14T11:14:59.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.687+0000 7fbc7dd65640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc780cb090 con 0x7fbc7806d010 2023-10-14T11:14:59.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.687+0000 7fbc77fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbc780c26b0 0x7fbc780c2b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48726/0 (socket says 172.21.15.26:48726) 2023-10-14T11:14:59.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.687+0000 7fbc77fff640 1 -- 172.21.15.26:0/1685057301 learned_addr learned my addr 172.21.15.26:0/1685057301 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:14:59.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.687+0000 7fbc777fe640 1 --1- 172.21.15.26:0/1685057301 >> v1:172.21.15.110:6789/0 conn(0x7fbc78069e90 0x7fbc7806a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:53812/0 (socket says 172.21.15.26:53812) 2023-10-14T11:14:59.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.687+0000 7fbc76ffd640 1 --2- 172.21.15.26:0/1685057301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc7806d010 0x7fbc780c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:59.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.687+0000 7fbc767fc640 1 -- 172.21.15.26:0/1685057301 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112017862 0 0) 0x7fbc7815ae30 con 0x7fbc780c26b0 2023-10-14T11:14:59.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.687+0000 7fbc767fc640 1 -- 172.21.15.26:0/1685057301 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc60003530 con 0x7fbc780c26b0 2023-10-14T11:14:59.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.687+0000 7fbc767fc640 1 -- 172.21.15.26:0/1685057301 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164515560 0 0) 0x7fbc780ca510 con 0x7fbc78069e90 2023-10-14T11:14:59.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.687+0000 7fbc767fc640 1 -- 172.21.15.26:0/1685057301 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc7815ae30 con 0x7fbc78069e90 2023-10-14T11:14:59.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.687+0000 7fbc76ffd640 1 -- 172.21.15.26:0/1685057301 >> v1:172.21.15.110:6789/0 conn(0x7fbc78069e90 legacy=0x7fbc7806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:59.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.687+0000 7fbc76ffd640 1 -- 172.21.15.26:0/1685057301 >> v1:172.21.15.26:6789/0 conn(0x7fbc780c26b0 legacy=0x7fbc780c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:59.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.687+0000 7fbc76ffd640 1 -- 172.21.15.26:0/1685057301 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc780ca7f0 con 0x7fbc7806d010 2023-10-14T11:14:59.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.691+0000 7fbc76ffd640 1 --2- 172.21.15.26:0/1685057301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc7806d010 0x7fbc780c9ce0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0097f0 tx=0x7fbc6c01ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e8ad16c1d4bd251 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:59.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.691+0000 7fbc767fc640 1 -- 172.21.15.26:0/1685057301 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0a89b0 con 0x7fbc7806d010 2023-10-14T11:14:59.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.691+0000 7fbc767fc640 1 -- 172.21.15.26:0/1685057301 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c0a8b10 con 0x7fbc7806d010 2023-10-14T11:14:59.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.691+0000 7fbc767fc640 1 -- 172.21.15.26:0/1685057301 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0a8ea0 con 0x7fbc7806d010 2023-10-14T11:14:59.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.691+0000 7fbc7dd65640 1 -- 172.21.15.26:0/1685057301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc7806d010 msgr2=0x7fbc780c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:59.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.691+0000 7fbc7dd65640 1 --2- 172.21.15.26:0/1685057301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc7806d010 0x7fbc780c9ce0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0097f0 tx=0x7fbc6c01ecb0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.691+0000 7fbc7dd65640 1 -- 172.21.15.26:0/1685057301 shutdown_connections 2023-10-14T11:14:59.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.691+0000 7fbc7dd65640 1 --2- 172.21.15.26:0/1685057301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc7806d010 0x7fbc780c9ce0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.691+0000 7fbc7dd65640 1 -- 172.21.15.26:0/1685057301 >> 172.21.15.26:0/1685057301 conn(0x7fbc780b0da0 msgr2=0x7fbc780ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:59.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.691+0000 7fbc7dd65640 1 -- 172.21.15.26:0/1685057301 shutdown_connections 2023-10-14T11:14:59.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.691+0000 7fbc7dd65640 1 -- 172.21.15.26:0/1685057301 wait complete. 2023-10-14T11:14:59.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc7dd65640 1 Processor -- start 2023-10-14T11:14:59.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc7dd65640 1 -- start start 2023-10-14T11:14:59.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc7dd65640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc78069e90 0x7fbc7814ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:59.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc7dd65640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc7806d010 0x7fbc7814e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:59.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc7dd65640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc780c26b0 0x7fbc78156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:59.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc7dd65640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7815ca70 con 0x7fbc7806d010 2023-10-14T11:14:59.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc7dd65640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc780af420 con 0x7fbc780c26b0 2023-10-14T11:14:59.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc7dd65640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7815ccc0 con 0x7fbc78069e90 2023-10-14T11:14:59.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc76ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc7806d010 0x7fbc7814e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:59.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc76ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc7806d010 0x7fbc7814e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54598/0 (socket says 172.21.15.26:54598) 2023-10-14T11:14:59.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc76ffd640 1 -- 172.21.15.26:0/656198317 learned_addr learned my addr 172.21.15.26:0/656198317 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:14:59.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc777fe640 1 --2- 172.21.15.26:0/656198317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc78069e90 0x7fbc7814ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:59.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc77fff640 1 --2- 172.21.15.26:0/656198317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc780c26b0 0x7fbc78156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:59.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc76ffd640 1 -- 172.21.15.26:0/656198317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc78069e90 msgr2=0x7fbc7814ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:59.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc76ffd640 1 --2- 172.21.15.26:0/656198317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc78069e90 0x7fbc7814ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc76ffd640 1 -- 172.21.15.26:0/656198317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc780c26b0 msgr2=0x7fbc78156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:59.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc76ffd640 1 --2- 172.21.15.26:0/656198317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc780c26b0 0x7fbc78156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc76ffd640 1 -- 172.21.15.26:0/656198317 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c009420 con 0x7fbc7806d010 2023-10-14T11:14:59.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc777fe640 1 --2- 172.21.15.26:0/656198317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc78069e90 0x7fbc7814ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:59.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc77fff640 1 --2- 172.21.15.26:0/656198317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc780c26b0 0x7fbc78156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:14:59.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc76ffd640 1 --2- 172.21.15.26:0/656198317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc7806d010 0x7fbc7814e370 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c01b8c0 tx=0x7fbc6c01ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:59.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc5ffff640 1 -- 172.21.15.26:0/656198317 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0b0d80 con 0x7fbc7806d010 2023-10-14T11:14:59.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc5ffff640 1 -- 172.21.15.26:0/656198317 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c0b9430 con 0x7fbc7806d010 2023-10-14T11:14:59.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc7dd65640 1 -- 172.21.15.26:0/656198317 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7815cfa0 con 0x7fbc7806d010 2023-10-14T11:14:59.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.695+0000 7fbc5ffff640 1 -- 172.21.15.26:0/656198317 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0b97e0 con 0x7fbc7806d010 2023-10-14T11:14:59.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.699+0000 7fbc7dd65640 1 -- 172.21.15.26:0/656198317 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc780aef90 con 0x7fbc7806d010 2023-10-14T11:14:59.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.699+0000 7fbc7dd65640 1 -- 172.21.15.26:0/656198317 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7804e170 con 0x7fbc7806d010 2023-10-14T11:14:59.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.699+0000 7fbc5ffff640 1 -- 172.21.15.26:0/656198317 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbc6c0b7040 con 0x7fbc7806d010 2023-10-14T11:14:59.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.699+0000 7fbc5ffff640 1 --2- 172.21.15.26:0/656198317 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbc640664a0 0x7fbc64068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:14:59.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.699+0000 7fbc5ffff640 1 -- 172.21.15.26:0/656198317 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fbc6c121c10 con 0x7fbc7806d010 2023-10-14T11:14:59.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.699+0000 7fbc777fe640 1 --2- 172.21.15.26:0/656198317 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbc640664a0 0x7fbc64068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:14:59.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.699+0000 7fbc777fe640 1 --2- 172.21.15.26:0/656198317 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbc640664a0 0x7fbc64068960 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbc68001120 tx=0x7fbc68007c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:14:59.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.703+0000 7fbc5ffff640 1 -- 172.21.15.26:0/656198317 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbc6c0eee10 con 0x7fbc7806d010 2023-10-14T11:14:59.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.859+0000 7fbc7dd65640 1 -- 172.21.15.26:0/656198317 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc7815d450 con 0x7fbc7806d010 2023-10-14T11:14:59.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.859+0000 7fbc5ffff640 1 -- 172.21.15.26:0/656198317 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"}]=0 v55) v1 ==== 109+0+11 (secure 0 0 0) 0x7fbc6c0b5020 con 0x7fbc7806d010 2023-10-14T11:14:59.868 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:14:59.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.863+0000 7fbc7dd65640 1 -- 172.21.15.26:0/656198317 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbc640664a0 msgr2=0x7fbc64068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:59.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.863+0000 7fbc7dd65640 1 --2- 172.21.15.26:0/656198317 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbc640664a0 0x7fbc64068960 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbc68001120 tx=0x7fbc68007c90 comp rx=0 tx=0).stop 2023-10-14T11:14:59.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.863+0000 7fbc7dd65640 1 -- 172.21.15.26:0/656198317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc7806d010 msgr2=0x7fbc7814e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:14:59.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.863+0000 7fbc7dd65640 1 --2- 172.21.15.26:0/656198317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc7806d010 0x7fbc7814e370 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c01b8c0 tx=0x7fbc6c01ba50 comp rx=0 tx=0).stop 2023-10-14T11:14:59.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.863+0000 7fbc7dd65640 1 -- 172.21.15.26:0/656198317 shutdown_connections 2023-10-14T11:14:59.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.863+0000 7fbc7dd65640 1 --2- 172.21.15.26:0/656198317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc780c26b0 0x7fbc78156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.863+0000 7fbc7dd65640 1 --2- 172.21.15.26:0/656198317 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fbc640664a0 0x7fbc64068960 secure :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbc68001120 tx=0x7fbc68007c90 comp rx=0 tx=0).stop 2023-10-14T11:14:59.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.863+0000 7fbc7dd65640 1 --2- 172.21.15.26:0/656198317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc7806d010 0x7fbc7814e370 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.863+0000 7fbc7dd65640 1 --2- 172.21.15.26:0/656198317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc78069e90 0x7fbc7814ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:14:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.863+0000 7fbc7dd65640 1 -- 172.21.15.26:0/656198317 >> 172.21.15.26:0/656198317 conn(0x7fbc780b0da0 msgr2=0x7fbc78070a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:14:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.863+0000 7fbc7dd65640 1 -- 172.21.15.26:0/656198317 shutdown_connections 2023-10-14T11:14:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:14:59.863+0000 7fbc7dd65640 1 -- 172.21.15.26:0/656198317 wait complete. 2023-10-14T11:14:59.891 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_data pg_num 2023-10-14T11:15:00.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.031+0000 7f42450c9640 1 Processor -- start 2023-10-14T11:15:00.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.031+0000 7f42450c9640 1 -- start start 2023-10-14T11:15:00.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.031+0000 7f42450c9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f424015cba0 0x7f42400d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:00.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.031+0000 7f42450c9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f42400b84e0 0x7f42400cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:00.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.031+0000 7f42450c9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42400d0040 0x7f42400d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:00.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.031+0000 7f42450c9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42400d1460 con 0x7f42400b84e0 2023-10-14T11:15:00.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.031+0000 7f42450c9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42400d04b0 con 0x7f424015cba0 2023-10-14T11:15:00.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.031+0000 7f42450c9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42400d1670 con 0x7f42400d0040 2023-10-14T11:15:00.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.031+0000 7f4237fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f42400b84e0 0x7f42400cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:00.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.031+0000 7f4237fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f42400b84e0 0x7f42400cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54606/0 (socket says 172.21.15.26:54606) 2023-10-14T11:15:00.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.031+0000 7f4237fff640 1 -- 172.21.15.26:0/353131674 learned_addr learned my addr 172.21.15.26:0/353131674 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:00.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.031+0000 7f423f59e640 1 --2- 172.21.15.26:0/353131674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42400d0040 0x7f42400d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:00.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.031+0000 7f423ed9d640 1 --2- 172.21.15.26:0/353131674 >> v2:172.21.15.110:3300/0 conn(0x7f424015cba0 0x7f42400d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:00.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.031+0000 7f4237fff640 1 -- 172.21.15.26:0/353131674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42400d0040 msgr2=0x7f42400d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:00.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.031+0000 7f4237fff640 1 --2- 172.21.15.26:0/353131674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42400d0040 0x7f42400d2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.031+0000 7f4237fff640 1 -- 172.21.15.26:0/353131674 >> v2:172.21.15.110:3300/0 conn(0x7f424015cba0 msgr2=0x7f42400d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:00.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.031+0000 7f4237fff640 1 --2- 172.21.15.26:0/353131674 >> v2:172.21.15.110:3300/0 conn(0x7f424015cba0 0x7f42400d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.031+0000 7f4237fff640 1 -- 172.21.15.26:0/353131674 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42400d1950 con 0x7f42400b84e0 2023-10-14T11:15:00.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.031+0000 7f423ed9d640 1 --2- 172.21.15.26:0/353131674 >> v2:172.21.15.110:3300/0 conn(0x7f424015cba0 0x7f42400d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:00.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.031+0000 7f423f59e640 1 --2- 172.21.15.26:0/353131674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42400d0040 0x7f42400d2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:00.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.035+0000 7f4237fff640 1 --2- 172.21.15.26:0/353131674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42400b84e0 0x7f42400cfb00 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f42400b4890 tx=0x7f422801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231f982051fb0093 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:00.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.035+0000 7f423e59c640 1 -- 172.21.15.26:0/353131674 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42280ab600 con 0x7f42400b84e0 2023-10-14T11:15:00.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.035+0000 7f423e59c640 1 -- 172.21.15.26:0/353131674 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42280a7050 con 0x7f42400b84e0 2023-10-14T11:15:00.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.035+0000 7f423e59c640 1 -- 172.21.15.26:0/353131674 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42280ab980 con 0x7f42400b84e0 2023-10-14T11:15:00.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.035+0000 7f42450c9640 1 -- 172.21.15.26:0/353131674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42400b84e0 msgr2=0x7f42400cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:00.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.035+0000 7f42450c9640 1 --2- 172.21.15.26:0/353131674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42400b84e0 0x7f42400cfb00 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f42400b4890 tx=0x7f422801c240 comp rx=0 tx=0).stop 2023-10-14T11:15:00.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.035+0000 7f42450c9640 1 -- 172.21.15.26:0/353131674 shutdown_connections 2023-10-14T11:15:00.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.035+0000 7f42450c9640 1 --2- 172.21.15.26:0/353131674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42400d0040 0x7f42400d2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.035+0000 7f42450c9640 1 --2- 172.21.15.26:0/353131674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42400b84e0 0x7f42400cfb00 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.035+0000 7f42450c9640 1 --2- 172.21.15.26:0/353131674 >> v2:172.21.15.110:3300/0 conn(0x7f424015cba0 0x7f42400d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.035+0000 7f42450c9640 1 -- 172.21.15.26:0/353131674 >> 172.21.15.26:0/353131674 conn(0x7f42400719c0 msgr2=0x7f4240071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:00.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.035+0000 7f42450c9640 1 -- 172.21.15.26:0/353131674 shutdown_connections 2023-10-14T11:15:00.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.035+0000 7f42450c9640 1 -- 172.21.15.26:0/353131674 wait complete. 2023-10-14T11:15:00.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f42450c9640 1 Processor -- start 2023-10-14T11:15:00.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f42450c9640 1 -- start start 2023-10-14T11:15:00.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f42450c9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42400b84e0 0x7f42400c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:00.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f42450c9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42400d0040 0x7f424014f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:00.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f42450c9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f424015cba0 0x7f4240151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:00.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f42450c9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4240151f20 con 0x7f424015cba0 2023-10-14T11:15:00.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f42450c9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42400c8530 con 0x7f42400b84e0 2023-10-14T11:15:00.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f42450c9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42400c7960 con 0x7f42400d0040 2023-10-14T11:15:00.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f423f59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f424015cba0 0x7f4240151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:00.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f423f59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f424015cba0 0x7f4240151560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54610/0 (socket says 172.21.15.26:54610) 2023-10-14T11:15:00.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f423f59e640 1 -- 172.21.15.26:0/1715476073 learned_addr learned my addr 172.21.15.26:0/1715476073 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:00.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f4237fff640 1 --2- 172.21.15.26:0/1715476073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42400d0040 0x7f424014f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:00.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f423ed9d640 1 --2- 172.21.15.26:0/1715476073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42400b84e0 0x7f42400c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:00.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f423f59e640 1 -- 172.21.15.26:0/1715476073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42400d0040 msgr2=0x7f424014f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:00.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f423f59e640 1 --2- 172.21.15.26:0/1715476073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42400d0040 0x7f424014f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f423f59e640 1 -- 172.21.15.26:0/1715476073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42400b84e0 msgr2=0x7f42400c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:00.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f423f59e640 1 --2- 172.21.15.26:0/1715476073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42400b84e0 0x7f42400c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f423f59e640 1 -- 172.21.15.26:0/1715476073 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42280094d0 con 0x7f424015cba0 2023-10-14T11:15:00.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f423f59e640 1 --2- 172.21.15.26:0/1715476073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f424015cba0 0x7f4240151560 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4238007e10 tx=0x7f423800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:00.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f42377fe640 1 -- 172.21.15.26:0/1715476073 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4238003ba0 con 0x7f424015cba0 2023-10-14T11:15:00.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f42377fe640 1 -- 172.21.15.26:0/1715476073 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423800f040 con 0x7f424015cba0 2023-10-14T11:15:00.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f42377fe640 1 -- 172.21.15.26:0/1715476073 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423800de80 con 0x7f424015cba0 2023-10-14T11:15:00.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f42450c9640 1 -- 172.21.15.26:0/1715476073 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42400c7c00 con 0x7f424015cba0 2023-10-14T11:15:00.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.039+0000 7f42450c9640 1 -- 172.21.15.26:0/1715476073 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42400c8f00 con 0x7f424015cba0 2023-10-14T11:15:00.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.043+0000 7f42450c9640 1 -- 172.21.15.26:0/1715476073 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42400c86c0 con 0x7f424015cba0 2023-10-14T11:15:00.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.043+0000 7f42377fe640 1 -- 172.21.15.26:0/1715476073 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4238004030 con 0x7f424015cba0 2023-10-14T11:15:00.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.043+0000 7f42377fe640 1 --2- 172.21.15.26:0/1715476073 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f42200664d0 0x7f4220068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:00.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.043+0000 7f42377fe640 1 -- 172.21.15.26:0/1715476073 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f4238084290 con 0x7f424015cba0 2023-10-14T11:15:00.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.043+0000 7f423ed9d640 1 --2- 172.21.15.26:0/1715476073 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f42200664d0 0x7f4220068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:00.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.043+0000 7f423ed9d640 1 --2- 172.21.15.26:0/1715476073 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f42200664d0 0x7f4220068990 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f42400d0010 tx=0x7f4230008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:00.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.047+0000 7f42377fe640 1 -- 172.21.15.26:0/1715476073 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f42380515c0 con 0x7f424015cba0 2023-10-14T11:15:00.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.203+0000 7f42450c9640 1 -- 172.21.15.26:0/1715476073 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"} v 0) v1 -- 0x7f424004e170 con 0x7f424015cba0 2023-10-14T11:15:00.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.203+0000 7f42377fe640 1 -- 172.21.15.26:0/1715476073 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"}]=0 v55) v1 ==== 105+0+11 (secure 0 0 0) 0x7f4238054be0 con 0x7f424015cba0 2023-10-14T11:15:00.210 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:15:00.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.203+0000 7f42450c9640 1 -- 172.21.15.26:0/1715476073 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f42200664d0 msgr2=0x7f4220068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:00.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.203+0000 7f42450c9640 1 --2- 172.21.15.26:0/1715476073 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f42200664d0 0x7f4220068990 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f42400d0010 tx=0x7f4230008040 comp rx=0 tx=0).stop 2023-10-14T11:15:00.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.203+0000 7f42450c9640 1 -- 172.21.15.26:0/1715476073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f424015cba0 msgr2=0x7f4240151560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:00.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.203+0000 7f42450c9640 1 --2- 172.21.15.26:0/1715476073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f424015cba0 0x7f4240151560 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4238007e10 tx=0x7f423800d4a0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.203+0000 7f42450c9640 1 -- 172.21.15.26:0/1715476073 shutdown_connections 2023-10-14T11:15:00.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.203+0000 7f42450c9640 1 --2- 172.21.15.26:0/1715476073 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f42200664d0 0x7f4220068990 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.203+0000 7f42450c9640 1 --2- 172.21.15.26:0/1715476073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f424015cba0 0x7f4240151560 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.203+0000 7f42450c9640 1 --2- 172.21.15.26:0/1715476073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42400d0040 0x7f424014f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.203+0000 7f42450c9640 1 --2- 172.21.15.26:0/1715476073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42400b84e0 0x7f42400c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.203+0000 7f42450c9640 1 -- 172.21.15.26:0/1715476073 >> 172.21.15.26:0/1715476073 conn(0x7f42400719c0 msgr2=0x7f4240072820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:00.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.207+0000 7f42450c9640 1 -- 172.21.15.26:0/1715476073 shutdown_connections 2023-10-14T11:15:00.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.207+0000 7f42450c9640 1 -- 172.21.15.26:0/1715476073 wait complete. 2023-10-14T11:15:00.232 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:15:00.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.367+0000 7f82ed29a640 1 Processor -- start 2023-10-14T11:15:00.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.367+0000 7f82ed29a640 1 -- start start 2023-10-14T11:15:00.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.371+0000 7f82ed29a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82e81597c0 0x7f82e80ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:00.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.371+0000 7f82ed29a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e80723d0 con 0x7f82e8159ba0 2023-10-14T11:15:00.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.371+0000 7f82ed29a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e80717c0 con 0x7f82e80adc10 2023-10-14T11:15:00.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.371+0000 7f82ed29a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e8071aa0 con 0x7f82e81597c0 2023-10-14T11:15:00.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.371+0000 7f82dffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f82e8159ba0 0x7f82e80cae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48728/0 (socket says 172.21.15.26:48728) 2023-10-14T11:15:00.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.371+0000 7f82dffff640 1 -- 172.21.15.26:0/1391464225 learned_addr learned my addr 172.21.15.26:0/1391464225 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:00.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.371+0000 7f82e6ffd640 1 --2- 172.21.15.26:0/1391464225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82e81597c0 0x7f82e80ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:00.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.371+0000 7f82e67fc640 1 -- 172.21.15.26:0/1391464225 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054739001 0 0) 0x7f82e80723d0 con 0x7f82e8159ba0 2023-10-14T11:15:00.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.371+0000 7f82e67fc640 1 -- 172.21.15.26:0/1391464225 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82d4003530 con 0x7f82e8159ba0 2023-10-14T11:15:00.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.371+0000 7f82e67fc640 1 -- 172.21.15.26:0/1391464225 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143326265 0 0) 0x7f82e80717c0 con 0x7f82e80adc10 2023-10-14T11:15:00.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.371+0000 7f82e67fc640 1 -- 172.21.15.26:0/1391464225 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82e80723d0 con 0x7f82e80adc10 2023-10-14T11:15:00.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.371+0000 7f82e6ffd640 1 -- 172.21.15.26:0/1391464225 >> v1:172.21.15.110:6789/0 conn(0x7f82e80adc10 legacy=0x7f82e815d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:00.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.371+0000 7f82e6ffd640 1 -- 172.21.15.26:0/1391464225 >> v1:172.21.15.26:6789/0 conn(0x7f82e8159ba0 legacy=0x7f82e80cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:00.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.371+0000 7f82e6ffd640 1 -- 172.21.15.26:0/1391464225 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e8071d80 con 0x7f82e81597c0 2023-10-14T11:15:00.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.375+0000 7f82e6ffd640 1 --2- 172.21.15.26:0/1391464225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82e81597c0 0x7f82e80ad6d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f82d80097f0 tx=0x7f82d801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0712fa66c1dc266 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:00.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.375+0000 7f82e67fc640 1 -- 172.21.15.26:0/1391464225 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d80a7070 con 0x7f82e81597c0 2023-10-14T11:15:00.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.375+0000 7f82e67fc640 1 -- 172.21.15.26:0/1391464225 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d80ab430 con 0x7f82e81597c0 2023-10-14T11:15:00.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.375+0000 7f82e67fc640 1 -- 172.21.15.26:0/1391464225 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d80ab7c0 con 0x7f82e81597c0 2023-10-14T11:15:00.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.375+0000 7f82ed29a640 1 -- 172.21.15.26:0/1391464225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82e81597c0 msgr2=0x7f82e80ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:00.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.375+0000 7f82ed29a640 1 --2- 172.21.15.26:0/1391464225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82e81597c0 0x7f82e80ad6d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f82d80097f0 tx=0x7f82d801c490 comp rx=0 tx=0).stop 2023-10-14T11:15:00.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.375+0000 7f82ed29a640 1 -- 172.21.15.26:0/1391464225 shutdown_connections 2023-10-14T11:15:00.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.375+0000 7f82ed29a640 1 --2- 172.21.15.26:0/1391464225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82e81597c0 0x7f82e80ad6d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.375+0000 7f82ed29a640 1 -- 172.21.15.26:0/1391464225 >> 172.21.15.26:0/1391464225 conn(0x7f82e806c190 msgr2=0x7f82e806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:00.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.375+0000 7f82ed29a640 1 -- 172.21.15.26:0/1391464225 shutdown_connections 2023-10-14T11:15:00.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.375+0000 7f82ed29a640 1 -- 172.21.15.26:0/1391464225 wait complete. 2023-10-14T11:15:00.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.375+0000 7f82ed29a640 1 Processor -- start 2023-10-14T11:15:00.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.375+0000 7f82ed29a640 1 -- start start 2023-10-14T11:15:00.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82ed29a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82e80adc10 0x7f82e81f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:00.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82ed29a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82e81597c0 0x7f82e814b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:00.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82ed29a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82e8159ba0 0x7f82e80b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:00.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82ed29a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e81f5820 con 0x7f82e81597c0 2023-10-14T11:15:00.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82ed29a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e8155980 con 0x7f82e8159ba0 2023-10-14T11:15:00.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82ed29a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80c77d0 con 0x7f82e80adc10 2023-10-14T11:15:00.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82dffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82e81597c0 0x7f82e814b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:00.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82dffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82e81597c0 0x7f82e814b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54614/0 (socket says 172.21.15.26:54614) 2023-10-14T11:15:00.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82dffff640 1 -- 172.21.15.26:0/592620883 learned_addr learned my addr 172.21.15.26:0/592620883 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:00.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82e77fe640 1 --2- 172.21.15.26:0/592620883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82e8159ba0 0x7f82e80b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:00.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82e6ffd640 1 --2- 172.21.15.26:0/592620883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82e80adc10 0x7f82e81f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:00.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82dffff640 1 -- 172.21.15.26:0/592620883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82e80adc10 msgr2=0x7f82e81f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:00.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82dffff640 1 --2- 172.21.15.26:0/592620883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82e80adc10 0x7f82e81f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82dffff640 1 -- 172.21.15.26:0/592620883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82e8159ba0 msgr2=0x7f82e80b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:00.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82dffff640 1 --2- 172.21.15.26:0/592620883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82e8159ba0 0x7f82e80b2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82dffff640 1 -- 172.21.15.26:0/592620883 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d8009420 con 0x7f82e81597c0 2023-10-14T11:15:00.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82dffff640 1 --2- 172.21.15.26:0/592620883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82e81597c0 0x7f82e814b770 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f82d000c420 tx=0x7f82d000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:00.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82df7fe640 1 -- 172.21.15.26:0/592620883 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0005cf0 con 0x7f82e81597c0 2023-10-14T11:15:00.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82df7fe640 1 -- 172.21.15.26:0/592620883 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d0005e50 con 0x7f82e81597c0 2023-10-14T11:15:00.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82ed29a640 1 -- 172.21.15.26:0/592620883 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e80c7a70 con 0x7f82e81597c0 2023-10-14T11:15:00.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82df7fe640 1 -- 172.21.15.26:0/592620883 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d00072d0 con 0x7f82e81597c0 2023-10-14T11:15:00.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82ed29a640 1 -- 172.21.15.26:0/592620883 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e814fe10 con 0x7f82e81597c0 2023-10-14T11:15:00.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82ed29a640 1 -- 172.21.15.26:0/592620883 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e8155af0 con 0x7f82e81597c0 2023-10-14T11:15:00.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.379+0000 7f82df7fe640 1 -- 172.21.15.26:0/592620883 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f82d0007430 con 0x7f82e81597c0 2023-10-14T11:15:00.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.383+0000 7f82df7fe640 1 --2- 172.21.15.26:0/592620883 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f82c80664d0 0x7f82c8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:00.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.383+0000 7f82df7fe640 1 -- 172.21.15.26:0/592620883 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f82d0083460 con 0x7f82e81597c0 2023-10-14T11:15:00.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.383+0000 7f82e6ffd640 1 --2- 172.21.15.26:0/592620883 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f82c80664d0 0x7f82c8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:00.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.383+0000 7f82e6ffd640 1 --2- 172.21.15.26:0/592620883 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f82c80664d0 0x7f82c8068990 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f82d80af000 tx=0x7f82d80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:00.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.387+0000 7f82df7fe640 1 -- 172.21.15.26:0/592620883 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f82e8155af0 con 0x7f82e81597c0 2023-10-14T11:15:00.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.555+0000 7f82ed29a640 1 -- 172.21.15.26:0/592620883 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f82e8155af0 con 0x7f82e81597c0 2023-10-14T11:15:00.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.555+0000 7f82df7fe640 1 -- 172.21.15.26:0/592620883 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v55) v1 ==== 80+0+0 (secure 0 0 0) 0x7f82e8155af0 con 0x7f82e81597c0 2023-10-14T11:15:00.561 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-10-14T11:15:00.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.555+0000 7f82ed29a640 1 -- 172.21.15.26:0/592620883 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f82c80664d0 msgr2=0x7f82c8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:00.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.555+0000 7f82ed29a640 1 --2- 172.21.15.26:0/592620883 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f82c80664d0 0x7f82c8068990 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f82d80af000 tx=0x7f82d80a7000 comp rx=0 tx=0).stop 2023-10-14T11:15:00.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.555+0000 7f82ed29a640 1 -- 172.21.15.26:0/592620883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82e81597c0 msgr2=0x7f82e814b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:00.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.555+0000 7f82ed29a640 1 --2- 172.21.15.26:0/592620883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82e81597c0 0x7f82e814b770 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f82d000c420 tx=0x7f82d000c8e0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.555+0000 7f82ed29a640 1 -- 172.21.15.26:0/592620883 shutdown_connections 2023-10-14T11:15:00.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.555+0000 7f82ed29a640 1 --2- 172.21.15.26:0/592620883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82e8159ba0 0x7f82e80b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.555+0000 7f82ed29a640 1 --2- 172.21.15.26:0/592620883 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f82c80664d0 0x7f82c8068990 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.555+0000 7f82ed29a640 1 --2- 172.21.15.26:0/592620883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82e81597c0 0x7f82e814b770 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.555+0000 7f82ed29a640 1 --2- 172.21.15.26:0/592620883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82e80adc10 0x7f82e81f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.555+0000 7f82ed29a640 1 -- 172.21.15.26:0/592620883 >> 172.21.15.26:0/592620883 conn(0x7f82e806c190 msgr2=0x7f82e80af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:00.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.555+0000 7f82ed29a640 1 -- 172.21.15.26:0/592620883 shutdown_connections 2023-10-14T11:15:00.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.555+0000 7f82ed29a640 1 -- 172.21.15.26:0/592620883 wait complete. 2023-10-14T11:15:00.581 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:15:00.582 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:15:00.595 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:15:00.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.775+0000 7f65f6b0e640 1 Processor -- start 2023-10-14T11:15:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.775+0000 7f65f6b0e640 1 -- start start 2023-10-14T11:15:00.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.775+0000 7f65f6b0e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f65f015ca70 0x7f65f00d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:00.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.775+0000 7f65f6b0e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65f00d3550 0x7f65f00cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:00.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.775+0000 7f65f6b0e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65f00cf5d0 0x7f65f00d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:00.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.775+0000 7f65f6b0e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f00ce820 con 0x7f65f00d3550 2023-10-14T11:15:00.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.775+0000 7f65f6b0e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f00cfa40 con 0x7f65f015ca70 2023-10-14T11:15:00.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.775+0000 7f65f6b0e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00c65f0 con 0x7f65f00cf5d0 2023-10-14T11:15:00.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.779+0000 7f65effff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65f00d3550 0x7f65f00cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:00.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.779+0000 7f65effff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65f00d3550 0x7f65f00cf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54620/0 (socket says 172.21.15.26:54620) 2023-10-14T11:15:00.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.779+0000 7f65effff640 1 -- 172.21.15.26:0/3242638628 learned_addr learned my addr 172.21.15.26:0/3242638628 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:00.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.779+0000 7f65f48aa640 1 --2- 172.21.15.26:0/3242638628 >> v2:172.21.15.110:3300/0 conn(0x7f65f015ca70 0x7f65f00d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:00.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.779+0000 7f65f50ab640 1 --2- 172.21.15.26:0/3242638628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65f00cf5d0 0x7f65f00d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:00.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.779+0000 7f65effff640 1 -- 172.21.15.26:0/3242638628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65f00cf5d0 msgr2=0x7f65f00d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:00.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.779+0000 7f65effff640 1 --2- 172.21.15.26:0/3242638628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65f00cf5d0 0x7f65f00d0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.779+0000 7f65effff640 1 -- 172.21.15.26:0/3242638628 >> v2:172.21.15.110:3300/0 conn(0x7f65f015ca70 msgr2=0x7f65f00d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:00.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.779+0000 7f65effff640 1 --2- 172.21.15.26:0/3242638628 >> v2:172.21.15.110:3300/0 conn(0x7f65f015ca70 0x7f65f00d3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.779+0000 7f65effff640 1 -- 172.21.15.26:0/3242638628 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f00cdf80 con 0x7f65f00d3550 2023-10-14T11:15:00.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.779+0000 7f65f48aa640 1 --2- 172.21.15.26:0/3242638628 >> v2:172.21.15.110:3300/0 conn(0x7f65f015ca70 0x7f65f00d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:00.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.779+0000 7f65effff640 1 --2- 172.21.15.26:0/3242638628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00d3550 0x7f65f00cf090 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f65f008a880 tx=0x7f65dc01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a02e88d81da0aec server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:00.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.779+0000 7f65ef7fe640 1 -- 172.21.15.26:0/3242638628 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0ab600 con 0x7f65f00d3550 2023-10-14T11:15:00.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.779+0000 7f65ef7fe640 1 -- 172.21.15.26:0/3242638628 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65dc0a7050 con 0x7f65f00d3550 2023-10-14T11:15:00.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.779+0000 7f65ef7fe640 1 -- 172.21.15.26:0/3242638628 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0ab980 con 0x7f65f00d3550 2023-10-14T11:15:00.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65f6b0e640 1 -- 172.21.15.26:0/3242638628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00d3550 msgr2=0x7f65f00cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:00.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65f6b0e640 1 --2- 172.21.15.26:0/3242638628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00d3550 0x7f65f00cf090 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f65f008a880 tx=0x7f65dc01c210 comp rx=0 tx=0).stop 2023-10-14T11:15:00.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65f6b0e640 1 -- 172.21.15.26:0/3242638628 shutdown_connections 2023-10-14T11:15:00.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65f6b0e640 1 --2- 172.21.15.26:0/3242638628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65f00cf5d0 0x7f65f00d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65f6b0e640 1 --2- 172.21.15.26:0/3242638628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00d3550 0x7f65f00cf090 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65f6b0e640 1 --2- 172.21.15.26:0/3242638628 >> v2:172.21.15.110:3300/0 conn(0x7f65f015ca70 0x7f65f00d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65f6b0e640 1 -- 172.21.15.26:0/3242638628 >> 172.21.15.26:0/3242638628 conn(0x7f65f009bc50 msgr2=0x7f65f00d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:00.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65f6b0e640 1 -- 172.21.15.26:0/3242638628 shutdown_connections 2023-10-14T11:15:00.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65f6b0e640 1 -- 172.21.15.26:0/3242638628 wait complete. 2023-10-14T11:15:00.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65f6b0e640 1 Processor -- start 2023-10-14T11:15:00.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65f6b0e640 1 -- start start 2023-10-14T11:15:00.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65f6b0e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65f00cf5d0 0x7f65f015e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:00.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65f6b0e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00d3550 0x7f65f00c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:00.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65f6b0e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65f015ca70 0x7f65f015a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:00.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65f6b0e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f0159e50 con 0x7f65f00d3550 2023-10-14T11:15:00.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65f6b0e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f015a130 con 0x7f65f00cf5d0 2023-10-14T11:15:00.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65f6b0e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f015ef80 con 0x7f65f015ca70 2023-10-14T11:15:00.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65effff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00d3550 0x7f65f00c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:00.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65f48aa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65f00cf5d0 0x7f65f015e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:00.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65effff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00d3550 0x7f65f00c7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54624/0 (socket says 172.21.15.26:54624) 2023-10-14T11:15:00.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65effff640 1 -- 172.21.15.26:0/1585634415 learned_addr learned my addr 172.21.15.26:0/1585634415 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:00.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65f50ab640 1 --2- 172.21.15.26:0/1585634415 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65f015ca70 0x7f65f015a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:00.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65f48aa640 1 -- 172.21.15.26:0/1585634415 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65f015ca70 msgr2=0x7f65f015a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:00.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.783+0000 7f65f48aa640 1 --2- 172.21.15.26:0/1585634415 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65f015ca70 0x7f65f015a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.787+0000 7f65f48aa640 1 -- 172.21.15.26:0/1585634415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00d3550 msgr2=0x7f65f00c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:00.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.787+0000 7f65f48aa640 1 --2- 172.21.15.26:0/1585634415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00d3550 0x7f65f00c7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.787+0000 7f65f48aa640 1 -- 172.21.15.26:0/1585634415 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65dc0094d0 con 0x7f65f00cf5d0 2023-10-14T11:15:00.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.787+0000 7f65effff640 1 --2- 172.21.15.26:0/1585634415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00d3550 0x7f65f00c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:15:00.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.787+0000 7f65f48aa640 1 --2- 172.21.15.26:0/1585634415 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65f00cf5d0 0x7f65f015e730 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f65e4006fd0 tx=0x7f65e400ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:00.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.787+0000 7f65ed7fa640 1 -- 172.21.15.26:0/1585634415 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e40059a0 con 0x7f65f00cf5d0 2023-10-14T11:15:00.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.787+0000 7f65ed7fa640 1 -- 172.21.15.26:0/1585634415 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e4005b00 con 0x7f65f00cf5d0 2023-10-14T11:15:00.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.787+0000 7f65f6b0e640 1 -- 172.21.15.26:0/1585634415 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f015f260 con 0x7f65f00cf5d0 2023-10-14T11:15:00.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.787+0000 7f65ed7fa640 1 -- 172.21.15.26:0/1585634415 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e4005e90 con 0x7f65f00cf5d0 2023-10-14T11:15:00.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.787+0000 7f65f6b0e640 1 -- 172.21.15.26:0/1585634415 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f015ec70 con 0x7f65f00cf5d0 2023-10-14T11:15:00.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.787+0000 7f65f6b0e640 1 -- 172.21.15.26:0/1585634415 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f0074010 con 0x7f65f00cf5d0 2023-10-14T11:15:00.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.787+0000 7f65ed7fa640 1 -- 172.21.15.26:0/1585634415 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f65e4004030 con 0x7f65f00cf5d0 2023-10-14T11:15:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.787+0000 7f65ed7fa640 1 --2- 172.21.15.26:0/1585634415 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f65d40664a0 0x7f65d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.787+0000 7f65ed7fa640 1 -- 172.21.15.26:0/1585634415 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f65e4084420 con 0x7f65f00cf5d0 2023-10-14T11:15:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.787+0000 7f65effff640 1 --2- 172.21.15.26:0/1585634415 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f65d40664a0 0x7f65d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.791+0000 7f65effff640 1 --2- 172.21.15.26:0/1585634415 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f65d40664a0 0x7f65d4068960 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f65dc01c250 tx=0x7f65dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:00.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.791+0000 7f65ed7fa640 1 -- 172.21.15.26:0/1585634415 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f65e4051860 con 0x7f65f00cf5d0 2023-10-14T11:15:00.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.951+0000 7f65f6b0e640 1 -- 172.21.15.26:0/1585634415 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65f00cda00 con 0x7f65f00cf5d0 2023-10-14T11:15:00.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.955+0000 7f65ed7fa640 1 -- 172.21.15.26:0/1585634415 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16790 (secure 0 0 0) 0x7f65e4054e80 con 0x7f65f00cf5d0 2023-10-14T11:15:00.961 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:15:00.961 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":55,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:14:51.591742+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:14:47.752880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:14:48.971211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:15:00.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.955+0000 7f65f6b0e640 1 -- 172.21.15.26:0/1585634415 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f65d40664a0 msgr2=0x7f65d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:00.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.955+0000 7f65f6b0e640 1 --2- 172.21.15.26:0/1585634415 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f65d40664a0 0x7f65d4068960 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f65dc01c250 tx=0x7f65dc008040 comp rx=0 tx=0).stop 2023-10-14T11:15:00.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.955+0000 7f65f6b0e640 1 -- 172.21.15.26:0/1585634415 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65f00cf5d0 msgr2=0x7f65f015e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:00.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.955+0000 7f65f6b0e640 1 --2- 172.21.15.26:0/1585634415 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65f00cf5d0 0x7f65f015e730 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f65e4006fd0 tx=0x7f65e400ec70 comp rx=0 tx=0).stop 2023-10-14T11:15:00.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.955+0000 7f65f6b0e640 1 -- 172.21.15.26:0/1585634415 shutdown_connections 2023-10-14T11:15:00.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.955+0000 7f65f6b0e640 1 --2- 172.21.15.26:0/1585634415 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65f015ca70 0x7f65f015a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.955+0000 7f65f6b0e640 1 --2- 172.21.15.26:0/1585634415 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f65d40664a0 0x7f65d4068960 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.955+0000 7f65f6b0e640 1 --2- 172.21.15.26:0/1585634415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00d3550 0x7f65f00c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.955+0000 7f65f6b0e640 1 --2- 172.21.15.26:0/1585634415 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65f00cf5d0 0x7f65f015e730 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:00.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.955+0000 7f65f6b0e640 1 -- 172.21.15.26:0/1585634415 >> 172.21.15.26:0/1585634415 conn(0x7f65f009bc50 msgr2=0x7f65f00ceb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:00.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.955+0000 7f65f6b0e640 1 -- 172.21.15.26:0/1585634415 shutdown_connections 2023-10-14T11:15:00.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:00.955+0000 7f65f6b0e640 1 -- 172.21.15.26:0/1585634415 wait complete. 2023-10-14T11:15:00.982 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'testcephfs1_metadata', 'create_time': '2023-10-14T11:14:47.752880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'testcephfs1_data', 'create_time': '2023-10-14T11:14:48.971211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:15:00.983 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:15:01.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.123+0000 7f999b9c4640 1 Processor -- start 2023-10-14T11:15:01.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.123+0000 7f999b9c4640 1 -- start start 2023-10-14T11:15:01.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.123+0000 7f999b9c4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99940ade00 0x7f99940c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:01.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.123+0000 7f999b9c4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f999406a4d0 0x7f99940ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:01.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.123+0000 7f999b9c4640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f999406c6d0 con 0x7f999406a0f0 2023-10-14T11:15:01.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.123+0000 7f999b9c4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f999406c950 con 0x7f999406a4d0 2023-10-14T11:15:01.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.123+0000 7f999b9c4640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99941654f0 con 0x7f99940ade00 2023-10-14T11:15:01.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.123+0000 7f9999f61640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f999406a4d0 0x7f99940ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:01.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.123+0000 7f9999f61640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f999406a4d0 0x7f99940ccd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54640/0 (socket says 172.21.15.26:54640) 2023-10-14T11:15:01.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.123+0000 7f9999f61640 1 -- 172.21.15.26:0/2346495723 learned_addr learned my addr 172.21.15.26:0/2346495723 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:01.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.123+0000 7f9998f5f640 1 --2- 172.21.15.26:0/2346495723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99940ade00 0x7f99940c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:01.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.127+0000 7f9999f61640 1 -- 172.21.15.26:0/2346495723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99940ade00 msgr2=0x7f99940c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:01.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.127+0000 7f9999f61640 1 --2- 172.21.15.26:0/2346495723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99940ade00 0x7f99940c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.127+0000 7f9999f61640 1 -- 172.21.15.26:0/2346495723 >> v1:172.21.15.110:6789/0 conn(0x7f999406a0f0 legacy=0x7f99940ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:01.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.127+0000 7f9999f61640 1 -- 172.21.15.26:0/2346495723 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99941657d0 con 0x7f999406a4d0 2023-10-14T11:15:01.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.127+0000 7f9999f61640 1 --2- 172.21.15.26:0/2346495723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f999406a4d0 0x7f99940ccd00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f998c009e50 tx=0x7f998c01d470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb0292a45fe1ad8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:01.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.127+0000 7f998bfff640 1 -- 172.21.15.26:0/2346495723 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c0a5900 con 0x7f999406a4d0 2023-10-14T11:15:01.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.127+0000 7f998bfff640 1 -- 172.21.15.26:0/2346495723 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998c0a5a60 con 0x7f999406a4d0 2023-10-14T11:15:01.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.127+0000 7f998bfff640 1 -- 172.21.15.26:0/2346495723 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c0a5df0 con 0x7f999406a4d0 2023-10-14T11:15:01.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.127+0000 7f999b9c4640 1 -- 172.21.15.26:0/2346495723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f999406a4d0 msgr2=0x7f99940ccd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:01.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.127+0000 7f999b9c4640 1 --2- 172.21.15.26:0/2346495723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f999406a4d0 0x7f99940ccd00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f998c009e50 tx=0x7f998c01d470 comp rx=0 tx=0).stop 2023-10-14T11:15:01.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f999b9c4640 1 -- 172.21.15.26:0/2346495723 shutdown_connections 2023-10-14T11:15:01.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f999b9c4640 1 --2- 172.21.15.26:0/2346495723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99940ade00 0x7f99940c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f999b9c4640 1 --2- 172.21.15.26:0/2346495723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f999406a4d0 0x7f99940ccd00 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f999b9c4640 1 -- 172.21.15.26:0/2346495723 >> 172.21.15.26:0/2346495723 conn(0x7f99940b0da0 msgr2=0x7f99940ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:01.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f999b9c4640 1 -- 172.21.15.26:0/2346495723 shutdown_connections 2023-10-14T11:15:01.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f999b9c4640 1 -- 172.21.15.26:0/2346495723 wait complete. 2023-10-14T11:15:01.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f999b9c4640 1 Processor -- start 2023-10-14T11:15:01.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f999b9c4640 1 -- start start 2023-10-14T11:15:01.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f999b9c4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f999406a0f0 0x7f9994151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:01.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f999b9c4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f999406a4d0 0x7f99940c3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:01.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f999b9c4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99940ade00 0x7f99940c3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:01.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f999b9c4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99940c2250 con 0x7f999406a4d0 2023-10-14T11:15:01.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f999b9c4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99940c2dd0 con 0x7f99940ade00 2023-10-14T11:15:01.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f999b9c4640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99941523a0 con 0x7f999406a0f0 2023-10-14T11:15:01.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f9998f5f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f999406a4d0 0x7f99940c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:01.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f9998f5f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f999406a4d0 0x7f99940c3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54644/0 (socket says 172.21.15.26:54644) 2023-10-14T11:15:01.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f9998f5f640 1 -- 172.21.15.26:0/490072797 learned_addr learned my addr 172.21.15.26:0/490072797 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:01.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f9999f61640 1 --2- 172.21.15.26:0/490072797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99940ade00 0x7f99940c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:01.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f9999760640 1 --2- 172.21.15.26:0/490072797 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f999406a0f0 0x7f9994151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:01.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f9998f5f640 1 -- 172.21.15.26:0/490072797 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f999406a0f0 msgr2=0x7f9994151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:01.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f9998f5f640 1 --2- 172.21.15.26:0/490072797 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f999406a0f0 0x7f9994151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f9998f5f640 1 -- 172.21.15.26:0/490072797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99940ade00 msgr2=0x7f99940c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:01.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f9998f5f640 1 --2- 172.21.15.26:0/490072797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99940ade00 0x7f99940c3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f9998f5f640 1 -- 172.21.15.26:0/490072797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c009b30 con 0x7f999406a4d0 2023-10-14T11:15:01.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f9998f5f640 1 --2- 172.21.15.26:0/490072797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f999406a4d0 0x7f99940c3250 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f998400d860 tx=0x7f998400dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:01.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.131+0000 7f9989ffb640 1 -- 172.21.15.26:0/490072797 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998400de50 con 0x7f999406a4d0 2023-10-14T11:15:01.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.135+0000 7f9989ffb640 1 -- 172.21.15.26:0/490072797 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998400b8d0 con 0x7f999406a4d0 2023-10-14T11:15:01.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.135+0000 7f999b9c4640 1 -- 172.21.15.26:0/490072797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99940c24a0 con 0x7f999406a4d0 2023-10-14T11:15:01.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.135+0000 7f9989ffb640 1 -- 172.21.15.26:0/490072797 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998400bc40 con 0x7f999406a4d0 2023-10-14T11:15:01.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.135+0000 7f999b9c4640 1 -- 172.21.15.26:0/490072797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99940c2a60 con 0x7f999406a4d0 2023-10-14T11:15:01.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.135+0000 7f999b9c4640 1 -- 172.21.15.26:0/490072797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99940c2f40 con 0x7f999406a4d0 2023-10-14T11:15:01.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.135+0000 7f9989ffb640 1 -- 172.21.15.26:0/490072797 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f998401e460 con 0x7f999406a4d0 2023-10-14T11:15:01.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.135+0000 7f9989ffb640 1 --2- 172.21.15.26:0/490072797 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f99780664a0 0x7f9978068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:01.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.135+0000 7f9989ffb640 1 -- 172.21.15.26:0/490072797 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f9984084400 con 0x7f999406a4d0 2023-10-14T11:15:01.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.135+0000 7f9999760640 1 --2- 172.21.15.26:0/490072797 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f99780664a0 0x7f9978068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:01.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.139+0000 7f9999760640 1 --2- 172.21.15.26:0/490072797 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f99780664a0 0x7f9978068960 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9990007fd0 tx=0x7f9990009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:01.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.139+0000 7f9989ffb640 1 -- 172.21.15.26:0/490072797 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f99840517c0 con 0x7f999406a4d0 2023-10-14T11:15:01.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.295+0000 7f999b9c4640 1 -- 172.21.15.26:0/490072797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f999404e170 con 0x7f999406a4d0 2023-10-14T11:15:01.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.299+0000 7f9989ffb640 1 -- 172.21.15.26:0/490072797 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9984054de0 con 0x7f999406a4d0 2023-10-14T11:15:01.304 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:15:01.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.299+0000 7f999b9c4640 1 -- 172.21.15.26:0/490072797 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f99780664a0 msgr2=0x7f9978068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:01.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.299+0000 7f999b9c4640 1 --2- 172.21.15.26:0/490072797 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f99780664a0 0x7f9978068960 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9990007fd0 tx=0x7f9990009040 comp rx=0 tx=0).stop 2023-10-14T11:15:01.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.299+0000 7f999b9c4640 1 -- 172.21.15.26:0/490072797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f999406a4d0 msgr2=0x7f99940c3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.299+0000 7f999b9c4640 1 --2- 172.21.15.26:0/490072797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f999406a4d0 0x7f99940c3250 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f998400d860 tx=0x7f998400dd20 comp rx=0 tx=0).stop 2023-10-14T11:15:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.299+0000 7f999b9c4640 1 -- 172.21.15.26:0/490072797 shutdown_connections 2023-10-14T11:15:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.299+0000 7f999b9c4640 1 --2- 172.21.15.26:0/490072797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99940ade00 0x7f99940c3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.299+0000 7f999b9c4640 1 --2- 172.21.15.26:0/490072797 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f99780664a0 0x7f9978068960 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.299+0000 7f999b9c4640 1 --2- 172.21.15.26:0/490072797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f999406a4d0 0x7f99940c3250 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.299+0000 7f999b9c4640 1 --2- 172.21.15.26:0/490072797 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f999406a0f0 0x7f9994151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.299+0000 7f999b9c4640 1 -- 172.21.15.26:0/490072797 >> 172.21.15.26:0/490072797 conn(0x7f99940b0da0 msgr2=0x7f99940af010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:01.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.299+0000 7f999b9c4640 1 -- 172.21.15.26:0/490072797 shutdown_connections 2023-10-14T11:15:01.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.299+0000 7f999b9c4640 1 -- 172.21.15.26:0/490072797 wait complete. 2023-10-14T11:15:01.325 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_metadata pg_num 2023-10-14T11:15:01.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.467+0000 7fd61b232640 1 Processor -- start 2023-10-14T11:15:01.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.467+0000 7fd61b232640 1 -- start start 2023-10-14T11:15:01.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.467+0000 7fd61b232640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd61406d010 0x7fd6140c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:01.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.467+0000 7fd61b232640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd61415ae30 con 0x7fd614069e90 2023-10-14T11:15:01.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.467+0000 7fd61b232640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6140ca510 con 0x7fd6140c26b0 2023-10-14T11:15:01.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.467+0000 7fd61b232640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6140cb090 con 0x7fd61406d010 2023-10-14T11:15:01.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.467+0000 7fd613fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd61406d010 0x7fd6140c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:01.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.467+0000 7fd618fce640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd614069e90 0x7fd61406a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48734/0 (socket says 172.21.15.26:48734) 2023-10-14T11:15:01.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.467+0000 7fd618fce640 1 -- 172.21.15.26:0/2156594585 learned_addr learned my addr 172.21.15.26:0/2156594585 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:01.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.467+0000 7fd613fff640 1 -- 172.21.15.26:0/2156594585 >> v1:172.21.15.110:6789/0 conn(0x7fd6140c26b0 legacy=0x7fd6140c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:01.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.467+0000 7fd613fff640 1 -- 172.21.15.26:0/2156594585 >> v1:172.21.15.26:6789/0 conn(0x7fd614069e90 legacy=0x7fd61406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:01.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.467+0000 7fd613fff640 1 -- 172.21.15.26:0/2156594585 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6140ca7f0 con 0x7fd61406d010 2023-10-14T11:15:01.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.467+0000 7fd6137fe640 1 -- 172.21.15.26:0/2156594585 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870335477 0 0) 0x7fd61415ae30 con 0x7fd614069e90 2023-10-14T11:15:01.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.471+0000 7fd613fff640 1 --2- 172.21.15.26:0/2156594585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd61406d010 0x7fd6140c9ce0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd6000097c0 tx=0x7fd60001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b90fa6f282661c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:01.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.471+0000 7fd6137fe640 1 -- 172.21.15.26:0/2156594585 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6000a8970 con 0x7fd61406d010 2023-10-14T11:15:01.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.471+0000 7fd6137fe640 1 -- 172.21.15.26:0/2156594585 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6000a8ad0 con 0x7fd61406d010 2023-10-14T11:15:01.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.471+0000 7fd6137fe640 1 -- 172.21.15.26:0/2156594585 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6000a8e60 con 0x7fd61406d010 2023-10-14T11:15:01.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.471+0000 7fd61b232640 1 -- 172.21.15.26:0/2156594585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd61406d010 msgr2=0x7fd6140c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:01.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.471+0000 7fd61b232640 1 --2- 172.21.15.26:0/2156594585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd61406d010 0x7fd6140c9ce0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd6000097c0 tx=0x7fd60001ec70 comp rx=0 tx=0).stop 2023-10-14T11:15:01.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.471+0000 7fd61b232640 1 -- 172.21.15.26:0/2156594585 shutdown_connections 2023-10-14T11:15:01.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.471+0000 7fd61b232640 1 --2- 172.21.15.26:0/2156594585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd61406d010 0x7fd6140c9ce0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.471+0000 7fd61b232640 1 -- 172.21.15.26:0/2156594585 >> 172.21.15.26:0/2156594585 conn(0x7fd6140b0da0 msgr2=0x7fd6140ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:01.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.471+0000 7fd61b232640 1 -- 172.21.15.26:0/2156594585 shutdown_connections 2023-10-14T11:15:01.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.471+0000 7fd61b232640 1 -- 172.21.15.26:0/2156594585 wait complete. 2023-10-14T11:15:01.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd61b232640 1 Processor -- start 2023-10-14T11:15:01.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd61b232640 1 -- start start 2023-10-14T11:15:01.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd61b232640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd614069e90 0x7fd61415bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:01.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd61b232640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd61406d010 0x7fd6141523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:01.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd61b232640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6140c26b0 0x7fd61415cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:01.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd61b232640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61415b940 con 0x7fd61406d010 2023-10-14T11:15:01.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd61b232640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61415d7b0 con 0x7fd6140c26b0 2023-10-14T11:15:01.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd61b232640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61415b010 con 0x7fd614069e90 2023-10-14T11:15:01.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd613fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd61406d010 0x7fd6141523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:01.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd613fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd61406d010 0x7fd6141523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54666/0 (socket says 172.21.15.26:54666) 2023-10-14T11:15:01.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd613fff640 1 -- 172.21.15.26:0/1427033952 learned_addr learned my addr 172.21.15.26:0/1427033952 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:01.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd618fce640 1 --2- 172.21.15.26:0/1427033952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd614069e90 0x7fd61415bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:01.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd6197cf640 1 --2- 172.21.15.26:0/1427033952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6140c26b0 0x7fd61415cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:01.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd613fff640 1 -- 172.21.15.26:0/1427033952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd614069e90 msgr2=0x7fd61415bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:01.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd613fff640 1 --2- 172.21.15.26:0/1427033952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd614069e90 0x7fd61415bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd613fff640 1 -- 172.21.15.26:0/1427033952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6140c26b0 msgr2=0x7fd61415cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:01.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd613fff640 1 --2- 172.21.15.26:0/1427033952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6140c26b0 0x7fd61415cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd613fff640 1 -- 172.21.15.26:0/1427033952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd600009420 con 0x7fd61406d010 2023-10-14T11:15:01.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd6197cf640 1 --2- 172.21.15.26:0/1427033952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6140c26b0 0x7fd61415cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:01.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd613fff640 1 --2- 172.21.15.26:0/1427033952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd61406d010 0x7fd6141523b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd60001c8a0 tx=0x7fd60001d4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:01.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd6117fa640 1 -- 172.21.15.26:0/1427033952 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6000b1e30 con 0x7fd61406d010 2023-10-14T11:15:01.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd6117fa640 1 -- 172.21.15.26:0/1427033952 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd600004020 con 0x7fd61406d010 2023-10-14T11:15:01.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd61b232640 1 -- 172.21.15.26:0/1427033952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd61415b2f0 con 0x7fd61406d010 2023-10-14T11:15:01.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd6117fa640 1 -- 172.21.15.26:0/1427033952 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd600004390 con 0x7fd61406d010 2023-10-14T11:15:01.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd61b232640 1 -- 172.21.15.26:0/1427033952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6141530b0 con 0x7fd61406d010 2023-10-14T11:15:01.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.475+0000 7fd61b232640 1 -- 172.21.15.26:0/1427033952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6141532a0 con 0x7fd61406d010 2023-10-14T11:15:01.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.479+0000 7fd6117fa640 1 -- 172.21.15.26:0/1427033952 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd600003620 con 0x7fd61406d010 2023-10-14T11:15:01.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.479+0000 7fd6117fa640 1 --2- 172.21.15.26:0/1427033952 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd5f80664a0 0x7fd5f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:01.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.479+0000 7fd6117fa640 1 -- 172.21.15.26:0/1427033952 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fd600121b00 con 0x7fd61406d010 2023-10-14T11:15:01.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.479+0000 7fd618fce640 1 --2- 172.21.15.26:0/1427033952 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd5f80664a0 0x7fd5f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:01.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.479+0000 7fd618fce640 1 --2- 172.21.15.26:0/1427033952 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd5f80664a0 0x7fd5f8068960 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd608000f70 tx=0x7fd608007240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:01.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.483+0000 7fd6117fa640 1 -- 172.21.15.26:0/1427033952 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd600123e60 con 0x7fd61406d010 2023-10-14T11:15:01.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.639+0000 7fd61b232640 1 -- 172.21.15.26:0/1427033952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd61415b150 con 0x7fd61406d010 2023-10-14T11:15:01.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.639+0000 7fd6117fa640 1 -- 172.21.15.26:0/1427033952 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"}]=0 v55) v1 ==== 109+0+11 (secure 0 0 0) 0x7fd61415b150 con 0x7fd61406d010 2023-10-14T11:15:01.645 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:15:01.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.639+0000 7fd61b232640 1 -- 172.21.15.26:0/1427033952 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd5f80664a0 msgr2=0x7fd5f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:01.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.639+0000 7fd61b232640 1 --2- 172.21.15.26:0/1427033952 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd5f80664a0 0x7fd5f8068960 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd608000f70 tx=0x7fd608007240 comp rx=0 tx=0).stop 2023-10-14T11:15:01.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.639+0000 7fd61b232640 1 -- 172.21.15.26:0/1427033952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd61406d010 msgr2=0x7fd6141523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:01.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.639+0000 7fd61b232640 1 --2- 172.21.15.26:0/1427033952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd61406d010 0x7fd6141523b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd60001c8a0 tx=0x7fd60001d4b0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.639+0000 7fd61b232640 1 -- 172.21.15.26:0/1427033952 shutdown_connections 2023-10-14T11:15:01.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.639+0000 7fd61b232640 1 --2- 172.21.15.26:0/1427033952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6140c26b0 0x7fd61415cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.639+0000 7fd61b232640 1 --2- 172.21.15.26:0/1427033952 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd5f80664a0 0x7fd5f8068960 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.639+0000 7fd61b232640 1 --2- 172.21.15.26:0/1427033952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd61406d010 0x7fd6141523b0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.639+0000 7fd61b232640 1 --2- 172.21.15.26:0/1427033952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd614069e90 0x7fd61415bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.639+0000 7fd61b232640 1 -- 172.21.15.26:0/1427033952 >> 172.21.15.26:0/1427033952 conn(0x7fd6140b0da0 msgr2=0x7fd6140abf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:01.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.639+0000 7fd61b232640 1 -- 172.21.15.26:0/1427033952 shutdown_connections 2023-10-14T11:15:01.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.639+0000 7fd61b232640 1 -- 172.21.15.26:0/1427033952 wait complete. 2023-10-14T11:15:01.666 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_data pg_num 2023-10-14T11:15:01.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.803+0000 7fde354ea640 1 Processor -- start 2023-10-14T11:15:01.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.803+0000 7fde354ea640 1 -- start start 2023-10-14T11:15:01.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.807+0000 7fde354ea640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fde300d0210 0x7fde300d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:01.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.807+0000 7fde354ea640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fde300b84e0 0x7fde300b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:01.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.807+0000 7fde354ea640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde300d1670 con 0x7fde3015cba0 2023-10-14T11:15:01.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.807+0000 7fde354ea640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde300d1460 con 0x7fde300b84e0 2023-10-14T11:15:01.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.807+0000 7fde354ea640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde300d1950 con 0x7fde300d0210 2023-10-14T11:15:01.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.807+0000 7fde2f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fde300b84e0 0x7fde300b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:01.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.807+0000 7fde2f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fde300b84e0 0x7fde300b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54676/0 (socket says 172.21.15.26:54676) 2023-10-14T11:15:01.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.807+0000 7fde2f7fe640 1 -- 172.21.15.26:0/1267629971 learned_addr learned my addr 172.21.15.26:0/1267629971 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:01.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.807+0000 7fde27fff640 1 --2- 172.21.15.26:0/1267629971 >> v2:172.21.15.110:3300/0 conn(0x7fde300d0210 0x7fde300d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:01.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.807+0000 7fde2f7fe640 1 -- 172.21.15.26:0/1267629971 >> v2:172.21.15.110:3300/0 conn(0x7fde300d0210 msgr2=0x7fde300d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:01.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.807+0000 7fde2f7fe640 1 --2- 172.21.15.26:0/1267629971 >> v2:172.21.15.110:3300/0 conn(0x7fde300d0210 0x7fde300d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.807+0000 7fde2f7fe640 1 -- 172.21.15.26:0/1267629971 >> v1:172.21.15.26:6789/0 conn(0x7fde3015cba0 legacy=0x7fde300cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:01.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.807+0000 7fde2f7fe640 1 -- 172.21.15.26:0/1267629971 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde300d1c30 con 0x7fde300b84e0 2023-10-14T11:15:01.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.807+0000 7fde27fff640 1 --2- 172.21.15.26:0/1267629971 >> v2:172.21.15.110:3300/0 conn(0x7fde300d0210 0x7fde300d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:01.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.811+0000 7fde2f7fe640 1 --2- 172.21.15.26:0/1267629971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde300b84e0 0x7fde300b5cf0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fde300cf010 tx=0x7fde2801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25440edd19480c68 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:01.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.811+0000 7fde2e7fc640 1 -- 172.21.15.26:0/1267629971 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde280a5800 con 0x7fde300b84e0 2023-10-14T11:15:01.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.811+0000 7fde2e7fc640 1 -- 172.21.15.26:0/1267629971 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde280a5960 con 0x7fde300b84e0 2023-10-14T11:15:01.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.811+0000 7fde2e7fc640 1 -- 172.21.15.26:0/1267629971 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde280a5cf0 con 0x7fde300b84e0 2023-10-14T11:15:01.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.811+0000 7fde354ea640 1 -- 172.21.15.26:0/1267629971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde300b84e0 msgr2=0x7fde300b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:01.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.811+0000 7fde354ea640 1 --2- 172.21.15.26:0/1267629971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde300b84e0 0x7fde300b5cf0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fde300cf010 tx=0x7fde2801c940 comp rx=0 tx=0).stop 2023-10-14T11:15:01.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.811+0000 7fde354ea640 1 -- 172.21.15.26:0/1267629971 shutdown_connections 2023-10-14T11:15:01.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.811+0000 7fde354ea640 1 --2- 172.21.15.26:0/1267629971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde300b84e0 0x7fde300b5cf0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.811+0000 7fde354ea640 1 --2- 172.21.15.26:0/1267629971 >> v2:172.21.15.110:3300/0 conn(0x7fde300d0210 0x7fde300d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.811+0000 7fde354ea640 1 -- 172.21.15.26:0/1267629971 >> 172.21.15.26:0/1267629971 conn(0x7fde300719c0 msgr2=0x7fde30071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:01.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.811+0000 7fde354ea640 1 -- 172.21.15.26:0/1267629971 shutdown_connections 2023-10-14T11:15:01.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.811+0000 7fde354ea640 1 -- 172.21.15.26:0/1267629971 wait complete. 2023-10-14T11:15:01.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.811+0000 7fde354ea640 1 Processor -- start 2023-10-14T11:15:01.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.811+0000 7fde354ea640 1 -- start start 2023-10-14T11:15:01.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde354ea640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde300b84e0 0x7fde30148610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:01.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde354ea640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde300d0210 0x7fde30148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:01.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde354ea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde3015cba0 0x7fde30149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:01.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde354ea640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde30148b50 con 0x7fde3015cba0 2023-10-14T11:15:01.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde354ea640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde300c6770 con 0x7fde300b84e0 2023-10-14T11:15:01.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde354ea640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde30156f40 con 0x7fde300d0210 2023-10-14T11:15:01.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde2f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde3015cba0 0x7fde30149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:01.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde2f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde3015cba0 0x7fde30149210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54680/0 (socket says 172.21.15.26:54680) 2023-10-14T11:15:01.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde2f7fe640 1 -- 172.21.15.26:0/845219396 learned_addr learned my addr 172.21.15.26:0/845219396 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:01.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde27fff640 1 --2- 172.21.15.26:0/845219396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde300d0210 0x7fde30148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:01.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde2effd640 1 --2- 172.21.15.26:0/845219396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde300b84e0 0x7fde30148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:01.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde2f7fe640 1 -- 172.21.15.26:0/845219396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde300d0210 msgr2=0x7fde30148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:01.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde2f7fe640 1 --2- 172.21.15.26:0/845219396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde300d0210 0x7fde30148cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde2f7fe640 1 -- 172.21.15.26:0/845219396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde300b84e0 msgr2=0x7fde30148610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:01.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde2f7fe640 1 --2- 172.21.15.26:0/845219396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde300b84e0 0x7fde30148610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde2f7fe640 1 -- 172.21.15.26:0/845219396 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde28009b30 con 0x7fde3015cba0 2023-10-14T11:15:01.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde2f7fe640 1 --2- 172.21.15.26:0/845219396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde3015cba0 0x7fde30149210 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fde280af040 tx=0x7fde280196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:01.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde277fe640 1 -- 172.21.15.26:0/845219396 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde280b8670 con 0x7fde3015cba0 2023-10-14T11:15:01.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde277fe640 1 -- 172.21.15.26:0/845219396 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde280b87d0 con 0x7fde3015cba0 2023-10-14T11:15:01.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde277fe640 1 -- 172.21.15.26:0/845219396 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde280b8b60 con 0x7fde3015cba0 2023-10-14T11:15:01.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde354ea640 1 -- 172.21.15.26:0/845219396 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde301566a0 con 0x7fde3015cba0 2023-10-14T11:15:01.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde354ea640 1 -- 172.21.15.26:0/845219396 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde30156c60 con 0x7fde3015cba0 2023-10-14T11:15:01.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde354ea640 1 -- 172.21.15.26:0/845219396 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde300b6030 con 0x7fde3015cba0 2023-10-14T11:15:01.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.815+0000 7fde277fe640 1 -- 172.21.15.26:0/845219396 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fde280b8cc0 con 0x7fde3015cba0 2023-10-14T11:15:01.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.819+0000 7fde277fe640 1 --2- 172.21.15.26:0/845219396 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fde100664a0 0x7fde10068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:01.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.819+0000 7fde277fe640 1 -- 172.21.15.26:0/845219396 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fde2811f3e0 con 0x7fde3015cba0 2023-10-14T11:15:01.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.819+0000 7fde2effd640 1 --2- 172.21.15.26:0/845219396 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fde100664a0 0x7fde10068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:01.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.819+0000 7fde2effd640 1 --2- 172.21.15.26:0/845219396 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fde100664a0 0x7fde10068960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fde20007fd0 tx=0x7fde20009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:01.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.823+0000 7fde277fe640 1 -- 172.21.15.26:0/845219396 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fde280ec860 con 0x7fde3015cba0 2023-10-14T11:15:01.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.979+0000 7fde354ea640 1 -- 172.21.15.26:0/845219396 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"} v 0) v1 -- 0x7fde3004e170 con 0x7fde3015cba0 2023-10-14T11:15:01.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.979+0000 7fde277fe640 1 -- 172.21.15.26:0/845219396 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"}]=0 v55) v1 ==== 105+0+11 (secure 0 0 0) 0x7fde280efe80 con 0x7fde3015cba0 2023-10-14T11:15:01.987 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:15:01.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.983+0000 7fde354ea640 1 -- 172.21.15.26:0/845219396 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fde100664a0 msgr2=0x7fde10068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:01.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.983+0000 7fde354ea640 1 --2- 172.21.15.26:0/845219396 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fde100664a0 0x7fde10068960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fde20007fd0 tx=0x7fde20009040 comp rx=0 tx=0).stop 2023-10-14T11:15:01.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.983+0000 7fde354ea640 1 -- 172.21.15.26:0/845219396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde3015cba0 msgr2=0x7fde30149210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:01.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.983+0000 7fde354ea640 1 --2- 172.21.15.26:0/845219396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde3015cba0 0x7fde30149210 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fde280af040 tx=0x7fde280196e0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.983+0000 7fde354ea640 1 -- 172.21.15.26:0/845219396 shutdown_connections 2023-10-14T11:15:01.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.983+0000 7fde354ea640 1 --2- 172.21.15.26:0/845219396 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fde100664a0 0x7fde10068960 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.983+0000 7fde354ea640 1 --2- 172.21.15.26:0/845219396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde3015cba0 0x7fde30149210 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.983+0000 7fde354ea640 1 --2- 172.21.15.26:0/845219396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde300d0210 0x7fde30148cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.983+0000 7fde354ea640 1 --2- 172.21.15.26:0/845219396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde300b84e0 0x7fde30148610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:01.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.983+0000 7fde354ea640 1 -- 172.21.15.26:0/845219396 >> 172.21.15.26:0/845219396 conn(0x7fde300719c0 msgr2=0x7fde30153f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:01.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.983+0000 7fde354ea640 1 -- 172.21.15.26:0/845219396 shutdown_connections 2023-10-14T11:15:01.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:01.983+0000 7fde354ea640 1 -- 172.21.15.26:0/845219396 wait complete. 2023-10-14T11:15:02.008 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:15:02.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.147+0000 7f94c759e640 1 Processor -- start 2023-10-14T11:15:02.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.147+0000 7f94c759e640 1 -- start start 2023-10-14T11:15:02.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.147+0000 7f94c759e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f94c815c980 0x7f94c806af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:02.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.147+0000 7f94c759e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94c815cd60 0x7f94c80b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:02.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.147+0000 7f94c759e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c80d3510 con 0x7f94c80d0d80 2023-10-14T11:15:02.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.147+0000 7f94c759e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c80cd2b0 con 0x7f94c815c980 2023-10-14T11:15:02.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.147+0000 7f94c759e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c80d2f50 con 0x7f94c815cd60 2023-10-14T11:15:02.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.147+0000 7f94c6d9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f94c80d0d80 0x7f94c80cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48758/0 (socket says 172.21.15.26:48758) 2023-10-14T11:15:02.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.147+0000 7f94c6d9d640 1 -- 172.21.15.26:0/2761798585 learned_addr learned my addr 172.21.15.26:0/2761798585 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:02.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.147+0000 7f94c659c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f94c815c980 0x7f94c806af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:02.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.147+0000 7f94bffff640 1 --2- 172.21.15.26:0/2761798585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94c815cd60 0x7f94c80b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:02.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.147+0000 7f94c659c640 1 -- 172.21.15.26:0/2761798585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94c815cd60 msgr2=0x7f94c80b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:02.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.147+0000 7f94c659c640 1 --2- 172.21.15.26:0/2761798585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94c815cd60 0x7f94c80b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:02.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.147+0000 7f94c659c640 1 -- 172.21.15.26:0/2761798585 >> v1:172.21.15.26:6789/0 conn(0x7f94c80d0d80 legacy=0x7f94c80cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:02.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.147+0000 7f94c659c640 1 -- 172.21.15.26:0/2761798585 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c80d3230 con 0x7f94c815c980 2023-10-14T11:15:02.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.147+0000 7f94bffff640 1 --2- 172.21.15.26:0/2761798585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94c815cd60 0x7f94c80b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:02.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.151+0000 7f94c659c640 1 --2- 172.21.15.26:0/2761798585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94c815c980 0x7f94c806af90 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f94b80097a0 tx=0x7f94b801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ef2ca3b2fb37de server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:02.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.151+0000 7f94c5d9b640 1 -- 172.21.15.26:0/2761798585 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b80ab600 con 0x7f94c815c980 2023-10-14T11:15:02.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.151+0000 7f94c5d9b640 1 -- 172.21.15.26:0/2761798585 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b80a7050 con 0x7f94c815c980 2023-10-14T11:15:02.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.151+0000 7f94c5d9b640 1 -- 172.21.15.26:0/2761798585 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b80ab980 con 0x7f94c815c980 2023-10-14T11:15:02.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.151+0000 7f94c759e640 1 -- 172.21.15.26:0/2761798585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94c815c980 msgr2=0x7f94c806af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:02.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.151+0000 7f94c759e640 1 --2- 172.21.15.26:0/2761798585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94c815c980 0x7f94c806af90 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f94b80097a0 tx=0x7f94b801c460 comp rx=0 tx=0).stop 2023-10-14T11:15:02.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.151+0000 7f94c759e640 1 -- 172.21.15.26:0/2761798585 shutdown_connections 2023-10-14T11:15:02.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.151+0000 7f94c759e640 1 --2- 172.21.15.26:0/2761798585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94c815cd60 0x7f94c80b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:02.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.151+0000 7f94c759e640 1 --2- 172.21.15.26:0/2761798585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94c815c980 0x7f94c806af90 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:02.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.151+0000 7f94c759e640 1 -- 172.21.15.26:0/2761798585 >> 172.21.15.26:0/2761798585 conn(0x7f94c809ba80 msgr2=0x7f94c80d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:02.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.151+0000 7f94c759e640 1 -- 172.21.15.26:0/2761798585 shutdown_connections 2023-10-14T11:15:02.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.151+0000 7f94c759e640 1 -- 172.21.15.26:0/2761798585 wait complete. 2023-10-14T11:15:02.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94c759e640 1 Processor -- start 2023-10-14T11:15:02.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94c759e640 1 -- start start 2023-10-14T11:15:02.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94c759e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94c80d0d80 0x7f94c8154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:02.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94c759e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94c815c980 0x7f94c80c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:02.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94c759e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94c815cd60 0x7f94c80c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:02.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94c759e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c815ed90 con 0x7f94c80d0d80 2023-10-14T11:15:02.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94c759e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c815e0e0 con 0x7f94c815cd60 2023-10-14T11:15:02.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94c759e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c80c9ff0 con 0x7f94c815c980 2023-10-14T11:15:02.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94c659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94c80d0d80 0x7f94c8154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:02.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94c659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94c80d0d80 0x7f94c8154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54694/0 (socket says 172.21.15.26:54694) 2023-10-14T11:15:02.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94c659c640 1 -- 172.21.15.26:0/692847011 learned_addr learned my addr 172.21.15.26:0/692847011 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:02.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94bffff640 1 --2- 172.21.15.26:0/692847011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94c815c980 0x7f94c80c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:02.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94c6d9d640 1 --2- 172.21.15.26:0/692847011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94c815cd60 0x7f94c80c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:02.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94c659c640 1 -- 172.21.15.26:0/692847011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94c815c980 msgr2=0x7f94c80c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:02.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94c659c640 1 --2- 172.21.15.26:0/692847011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94c815c980 0x7f94c80c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:02.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94c659c640 1 -- 172.21.15.26:0/692847011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94c815cd60 msgr2=0x7f94c80c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:02.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94c659c640 1 --2- 172.21.15.26:0/692847011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94c815cd60 0x7f94c80c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:02.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94c659c640 1 -- 172.21.15.26:0/692847011 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b80093b0 con 0x7f94c80d0d80 2023-10-14T11:15:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94c659c640 1 --2- 172.21.15.26:0/692847011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94c80d0d80 0x7f94c8154800 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f94b80ae040 tx=0x7f94b801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94beffd640 1 -- 172.21.15.26:0/692847011 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b8005ba0 con 0x7f94c80d0d80 2023-10-14T11:15:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94beffd640 1 -- 172.21.15.26:0/692847011 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b8005d20 con 0x7f94c80d0d80 2023-10-14T11:15:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94beffd640 1 -- 172.21.15.26:0/692847011 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b8006260 con 0x7f94c80d0d80 2023-10-14T11:15:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94c759e640 1 -- 172.21.15.26:0/692847011 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c80d1720 con 0x7f94c80d0d80 2023-10-14T11:15:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.155+0000 7f94c759e640 1 -- 172.21.15.26:0/692847011 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c8154f30 con 0x7f94c80d0d80 2023-10-14T11:15:02.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.159+0000 7f94c759e640 1 -- 172.21.15.26:0/692847011 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c804e9c0 con 0x7f94c80d0d80 2023-10-14T11:15:02.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.159+0000 7f94beffd640 1 -- 172.21.15.26:0/692847011 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f94b80063c0 con 0x7f94c80d0d80 2023-10-14T11:15:02.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.159+0000 7f94beffd640 1 --2- 172.21.15.26:0/692847011 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f94a80664a0 0x7f94a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:02.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.159+0000 7f94beffd640 1 -- 172.21.15.26:0/692847011 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f94b811da20 con 0x7f94c80d0d80 2023-10-14T11:15:02.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.159+0000 7f94bffff640 1 --2- 172.21.15.26:0/692847011 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f94a80664a0 0x7f94a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:02.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.159+0000 7f94bffff640 1 --2- 172.21.15.26:0/692847011 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f94a80664a0 0x7f94a8068960 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f94c80b5350 tx=0x7f94b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:02.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.163+0000 7f94beffd640 1 -- 172.21.15.26:0/692847011 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f94b80eaca0 con 0x7f94c80d0d80 2023-10-14T11:15:02.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.335+0000 7f94c759e640 1 -- 172.21.15.26:0/692847011 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f94c80d36b0 con 0x7f94c80d0d80 2023-10-14T11:15:02.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.335+0000 7f94beffd640 1 -- 172.21.15.26:0/692847011 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v55) v1 ==== 80+0+0 (secure 0 0 0) 0x7f94b80b0080 con 0x7f94c80d0d80 2023-10-14T11:15:02.342 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-10-14T11:15:02.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.335+0000 7f94c759e640 1 -- 172.21.15.26:0/692847011 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f94a80664a0 msgr2=0x7f94a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:02.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.335+0000 7f94c759e640 1 --2- 172.21.15.26:0/692847011 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f94a80664a0 0x7f94a8068960 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f94c80b5350 tx=0x7f94b0008040 comp rx=0 tx=0).stop 2023-10-14T11:15:02.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.335+0000 7f94c759e640 1 -- 172.21.15.26:0/692847011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94c80d0d80 msgr2=0x7f94c8154800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:02.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.335+0000 7f94c759e640 1 --2- 172.21.15.26:0/692847011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94c80d0d80 0x7f94c8154800 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f94b80ae040 tx=0x7f94b801aca0 comp rx=0 tx=0).stop 2023-10-14T11:15:02.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.339+0000 7f94c759e640 1 -- 172.21.15.26:0/692847011 shutdown_connections 2023-10-14T11:15:02.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.339+0000 7f94c759e640 1 --2- 172.21.15.26:0/692847011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94c815cd60 0x7f94c80c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:02.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.339+0000 7f94c759e640 1 --2- 172.21.15.26:0/692847011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94c815c980 0x7f94c80c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:02.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.339+0000 7f94c759e640 1 --2- 172.21.15.26:0/692847011 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f94a80664a0 0x7f94a8068960 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:02.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.339+0000 7f94c759e640 1 --2- 172.21.15.26:0/692847011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94c80d0d80 0x7f94c8154800 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:02.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.339+0000 7f94c759e640 1 -- 172.21.15.26:0/692847011 >> 172.21.15.26:0/692847011 conn(0x7f94c809ba80 msgr2=0x7f94c815bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:02.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.339+0000 7f94c759e640 1 -- 172.21.15.26:0/692847011 shutdown_connections 2023-10-14T11:15:02.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.339+0000 7f94c759e640 1 -- 172.21.15.26:0/692847011 wait complete. 2023-10-14T11:15:02.363 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi026.front.sepia.ceph.com... 2023-10-14T11:15:02.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:02.364 DEBUG:teuthology.orchestra.run.smithi026:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-14T11:15:02.383 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[50941]: fuse finished with error 0 and tester_r 0 2023-10-14T11:15:02.386 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:15:02.466 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T11:15:02.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:02.467 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T11:15:02.477 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T11:15:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.655+0000 7f60a79c4640 1 Processor -- start 2023-10-14T11:15:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.655+0000 7f60a79c4640 1 -- start start 2023-10-14T11:15:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.655+0000 7f60a79c4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f60a00cf520 0x7f60a00c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:02.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.655+0000 7f60a79c4640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a00c65f0 con 0x7f60a015ca70 2023-10-14T11:15:02.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.655+0000 7f60a79c4640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a00cdf80 con 0x7f60a00cf090 2023-10-14T11:15:02.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.655+0000 7f60a79c4640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a00ce820 con 0x7f60a00cf520 2023-10-14T11:15:02.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.655+0000 7f60a5760640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f60a015ca70 0x7f60a00d3010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53062/0 (socket says 172.21.15.26:53062) 2023-10-14T11:15:02.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.655+0000 7f60a5760640 1 -- 172.21.15.26:0/3194072888 learned_addr learned my addr 172.21.15.26:0/3194072888 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:02.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.655+0000 7f60a5f61640 1 --2- 172.21.15.26:0/3194072888 >> v2:172.21.15.110:3300/0 conn(0x7f60a00cf520 0x7f60a00c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:02.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.655+0000 7f6097fff640 1 -- 172.21.15.26:0/3194072888 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564591639 0 0) 0x7f60a00c65f0 con 0x7f60a015ca70 2023-10-14T11:15:02.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.655+0000 7f6097fff640 1 -- 172.21.15.26:0/3194072888 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f608c003530 con 0x7f60a015ca70 2023-10-14T11:15:02.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.655+0000 7f6097fff640 1 -- 172.21.15.26:0/3194072888 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582258174 0 0) 0x7f60a00cdf80 con 0x7f60a00cf090 2023-10-14T11:15:02.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.655+0000 7f6097fff640 1 -- 172.21.15.26:0/3194072888 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60a00c65f0 con 0x7f60a00cf090 2023-10-14T11:15:02.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.659+0000 7f60a5f61640 1 -- 172.21.15.26:0/3194072888 >> v1:172.21.15.110:6789/0 conn(0x7f60a00cf090 legacy=0x7f60a00c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:02.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.659+0000 7f60a5f61640 1 -- 172.21.15.26:0/3194072888 >> v1:172.21.15.26:6789/0 conn(0x7f60a015ca70 legacy=0x7f60a00d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:02.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.659+0000 7f60a5f61640 1 -- 172.21.15.26:0/3194072888 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a00ce260 con 0x7f60a00cf520 2023-10-14T11:15:02.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.659+0000 7f60a5f61640 1 --2- 172.21.15.26:0/3194072888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60a00cf520 0x7f60a00c71e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6098009d90 tx=0x7f609801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57898cff30eae0bf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:02.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.659+0000 7f6097fff640 1 -- 172.21.15.26:0/3194072888 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60980a59a0 con 0x7f60a00cf520 2023-10-14T11:15:02.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.659+0000 7f6097fff640 1 -- 172.21.15.26:0/3194072888 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60980a5b00 con 0x7f60a00cf520 2023-10-14T11:15:02.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.659+0000 7f6097fff640 1 -- 172.21.15.26:0/3194072888 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60980a5e90 con 0x7f60a00cf520 2023-10-14T11:15:02.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.659+0000 7f60a79c4640 1 -- 172.21.15.26:0/3194072888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60a00cf520 msgr2=0x7f60a00c71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:02.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.659+0000 7f60a79c4640 1 --2- 172.21.15.26:0/3194072888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60a00cf520 0x7f60a00c71e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6098009d90 tx=0x7f609801c920 comp rx=0 tx=0).stop 2023-10-14T11:15:02.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.659+0000 7f60a79c4640 1 -- 172.21.15.26:0/3194072888 shutdown_connections 2023-10-14T11:15:02.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.659+0000 7f60a79c4640 1 --2- 172.21.15.26:0/3194072888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60a00cf520 0x7f60a00c71e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:02.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.659+0000 7f60a79c4640 1 -- 172.21.15.26:0/3194072888 >> 172.21.15.26:0/3194072888 conn(0x7f60a009bc50 msgr2=0x7f60a00d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:02.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.663+0000 7f60a79c4640 1 -- 172.21.15.26:0/3194072888 shutdown_connections 2023-10-14T11:15:02.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.663+0000 7f60a79c4640 1 -- 172.21.15.26:0/3194072888 wait complete. 2023-10-14T11:15:02.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.663+0000 7f60a79c4640 1 Processor -- start 2023-10-14T11:15:02.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.663+0000 7f60a79c4640 1 -- start start 2023-10-14T11:15:02.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.663+0000 7f60a79c4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a00cf090 0x7f60a0156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:02.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.663+0000 7f60a79c4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60a00cf520 0x7f60a00cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:02.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.663+0000 7f60a79c4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60a015ca70 0x7f60a00d2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:02.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.663+0000 7f60a79c4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a00cc870 con 0x7f60a00cf090 2023-10-14T11:15:02.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.663+0000 7f60a79c4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a015a750 con 0x7f60a00cf520 2023-10-14T11:15:02.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.663+0000 7f60a79c4640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a015aa30 con 0x7f60a015ca70 2023-10-14T11:15:02.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.663+0000 7f60a5760640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a00cf090 0x7f60a0156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:02.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.663+0000 7f60a5760640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a00cf090 0x7f60a0156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34626/0 (socket says 172.21.15.26:34626) 2023-10-14T11:15:02.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.663+0000 7f60a5760640 1 -- 172.21.15.26:0/2877631821 learned_addr learned my addr 172.21.15.26:0/2877631821 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:02.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.663+0000 7f60a5f61640 1 --2- 172.21.15.26:0/2877631821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60a015ca70 0x7f60a00d2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:02.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.663+0000 7f60a4f5f640 1 --2- 172.21.15.26:0/2877631821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60a00cf520 0x7f60a00cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:02.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.663+0000 7f60a5760640 1 -- 172.21.15.26:0/2877631821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60a015ca70 msgr2=0x7f60a00d2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:02.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.663+0000 7f60a5760640 1 --2- 172.21.15.26:0/2877631821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60a015ca70 0x7f60a00d2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:02.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.663+0000 7f60a5760640 1 -- 172.21.15.26:0/2877631821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60a00cf520 msgr2=0x7f60a00cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:02.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.663+0000 7f60a5760640 1 --2- 172.21.15.26:0/2877631821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60a00cf520 0x7f60a00cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:02.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.663+0000 7f60a5760640 1 -- 172.21.15.26:0/2877631821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6098009a70 con 0x7f60a00cf090 2023-10-14T11:15:02.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.663+0000 7f60a5760640 1 --2- 172.21.15.26:0/2877631821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a00cf090 0x7f60a0156d40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f609c00c450 tx=0x7f609c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:02.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.667+0000 7f6095ffb640 1 -- 172.21.15.26:0/2877631821 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c007480 con 0x7f60a00cf090 2023-10-14T11:15:02.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.667+0000 7f6095ffb640 1 -- 172.21.15.26:0/2877631821 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c0075e0 con 0x7f60a00cf090 2023-10-14T11:15:02.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.667+0000 7f6095ffb640 1 -- 172.21.15.26:0/2877631821 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c0059b0 con 0x7f60a00cf090 2023-10-14T11:15:02.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.667+0000 7f60a79c4640 1 -- 172.21.15.26:0/2877631821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a00d38a0 con 0x7f60a00cf090 2023-10-14T11:15:02.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.667+0000 7f60a79c4640 1 -- 172.21.15.26:0/2877631821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a015aff0 con 0x7f60a00cf090 2023-10-14T11:15:02.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.667+0000 7f60a79c4640 1 -- 172.21.15.26:0/2877631821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a0074010 con 0x7f60a00cf090 2023-10-14T11:15:02.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.667+0000 7f6095ffb640 1 -- 172.21.15.26:0/2877631821 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f609c005b10 con 0x7f60a00cf090 2023-10-14T11:15:02.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.667+0000 7f6095ffb640 1 --2- 172.21.15.26:0/2877631821 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f60840664a0 0x7f6084068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:02.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.667+0000 7f6095ffb640 1 -- 172.21.15.26:0/2877631821 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f609c083500 con 0x7f60a00cf090 2023-10-14T11:15:02.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.667+0000 7f60a4f5f640 1 --2- 172.21.15.26:0/2877631821 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f60840664a0 0x7f6084068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:02.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.667+0000 7f60a4f5f640 1 --2- 172.21.15.26:0/2877631821 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f60840664a0 0x7f6084068960 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f60a01f7dd0 tx=0x7f6090009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:02.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.671+0000 7f6095ffb640 1 -- 172.21.15.26:0/2877631821 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f609c050830 con 0x7f60a00cf090 2023-10-14T11:15:02.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.863+0000 7f60a79c4640 1 -- 172.21.15.26:0/2877631821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f60a015a450 con 0x7f60a00cf090 2023-10-14T11:15:02.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.863+0000 7f6095ffb640 1 -- 172.21.15.26:0/2877631821 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+88 (secure 0 0 0) 0x7f609c017070 con 0x7f60a00cf090 2023-10-14T11:15:02.872 INFO:teuthology.orchestra.run.smithi026.stdout:name: testcephfs1, metadata pool: testcephfs1_metadata, data pools: [testcephfs1_data ] 2023-10-14T11:15:02.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.867+0000 7f60a79c4640 1 -- 172.21.15.26:0/2877631821 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f60840664a0 msgr2=0x7f6084068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:02.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.867+0000 7f60a79c4640 1 --2- 172.21.15.26:0/2877631821 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f60840664a0 0x7f6084068960 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f60a01f7dd0 tx=0x7f6090009040 comp rx=0 tx=0).stop 2023-10-14T11:15:02.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.867+0000 7f60a79c4640 1 -- 172.21.15.26:0/2877631821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a00cf090 msgr2=0x7f60a0156d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:02.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.867+0000 7f60a79c4640 1 --2- 172.21.15.26:0/2877631821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a00cf090 0x7f60a0156d40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f609c00c450 tx=0x7f609c00c910 comp rx=0 tx=0).stop 2023-10-14T11:15:02.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.867+0000 7f60a79c4640 1 -- 172.21.15.26:0/2877631821 shutdown_connections 2023-10-14T11:15:02.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.867+0000 7f60a79c4640 1 --2- 172.21.15.26:0/2877631821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60a015ca70 0x7f60a00d2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:02.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.867+0000 7f60a79c4640 1 --2- 172.21.15.26:0/2877631821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60a00cf520 0x7f60a00cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:02.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.867+0000 7f60a79c4640 1 --2- 172.21.15.26:0/2877631821 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f60840664a0 0x7f6084068960 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:02.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.867+0000 7f60a79c4640 1 --2- 172.21.15.26:0/2877631821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a00cf090 0x7f60a0156d40 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:02.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.867+0000 7f60a79c4640 1 -- 172.21.15.26:0/2877631821 >> 172.21.15.26:0/2877631821 conn(0x7f60a009bc50 msgr2=0x7f60a00ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:02.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.867+0000 7f60a79c4640 1 -- 172.21.15.26:0/2877631821 shutdown_connections 2023-10-14T11:15:02.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:02.867+0000 7f60a79c4640 1 -- 172.21.15.26:0/2877631821 wait complete. 2023-10-14T11:15:02.893 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T11:15:02.893 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T11:15:02.894 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-14T11:15:02.894 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T11:15:02.894 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T11:15:02.894 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T11:15:02.895 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T11:15:02.895 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T11:15:02.895 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:15:02.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:02.896 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-14T11:15:02.906 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:15:02.907 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:15:02.907 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:15:02.907 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:15:02.907 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-14T11:15:02.907 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:15:02.907 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:15:02.908 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-14T11:15:02.908 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-14T11:15:02.908 INFO:teuthology.orchestra.run.smithi026.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T11:15:02.908 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:15:02.909 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-14T11:15:02.909 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-14T11:15:02.909 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42274sec preferred_lft 42274sec 2023-10-14T11:15:02.909 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-14T11:15:02.910 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:15:02.910 INFO:teuthology.orchestra.run.smithi026.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:15:02.910 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-14T11:15:02.910 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-14T11:15:02.910 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:15:02.911 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:15:02.911 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-14T11:15:02.911 INFO:teuthology.orchestra.run.smithi026.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-14T11:15:02.911 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 02:42:e1:29:12:f0 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:15:02.911 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-14T11:15:02.912 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:15:02.912 INFO:teuthology.orchestra.run.smithi026.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T11:15:02.912 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-14T11:15:02.912 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T11:15:02.912 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:15:02.912 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-14T11:15:02.913 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:15:02.913 INFO:teuthology.orchestra.run.smithi026.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T11:15:02.913 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:15:02.913 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-14T11:15:02.913 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:15:02.914 INFO:teuthology.orchestra.run.smithi026.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T11:15:02.914 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:15:02.914 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-14T11:15:02.914 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:15:02.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:02.915 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T11:15:02.967 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-14T11:15:02.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:02.969 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-14T11:15:03.021 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-14T11:15:03.021 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T11:15:03.021 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-14T11:15:03.022 INFO:teuthology.orchestra.run.smithi026.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-14T11:15:03.022 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-14T11:15:03.022 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T11:15:03.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:03.023 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-14T11:15:03.023 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-14T11:15:03.024 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T11:15:03.025 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T11:15:03.025 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T11:15:03.025 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-14T11:15:03.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:03.116 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-14T11:15:03.126 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T11:15:03.126 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T11:15:03.127 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:15:03.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:03.128 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-10-14T11:15:03.191 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-14T11:15:03.192 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:15:03.192 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T11:15:03.240 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:15:03.240 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:15:03.241 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T11:15:03.295 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-10-14T11:15:03.365 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:15:03.417 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2023-10-14T11:15:03.418 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2023-10-14T11:15:03.418 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2023-10-14T11:15:03.418 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2023-10-14T11:15:03.418 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2023-10-14T11:15:03.419 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2023-10-14T11:15:03.419 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2023-10-14T11:15:03.419 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2023-10-14T11:15:03.419 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2023-10-14T11:15:03.419 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2023-10-14T11:15:03.419 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2023-10-14T11:15:03.420 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2023-10-14T11:15:03.420 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:15:03.420 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2023-10-14T11:15:03.420 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2023-10-14T11:15:03.420 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2023-10-14T11:15:03.421 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2023-10-14T11:15:03.421 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2023-10-14T11:15:03.421 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2023-10-14T11:15:03.421 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2023-10-14T11:15:03.421 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:15:03.422 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2023-10-14T11:15:03.422 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2023-10-14T11:15:03.422 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2023-10-14T11:15:03.422 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T11:15:03.422 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T11:15:03.422 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T11:15:03.423 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T11:15:03.423 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2023-10-14T11:15:03.423 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:15:03.423 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:15:03.423 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:15:03.424 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:15:03.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:03.425 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-10-14T11:15:03.476 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-14T11:15:03.476 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-14T11:15:03.525 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-10-14T11:15:03.547 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:15:03.601 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2023-10-14T11:15:03.602 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2023-10-14T11:15:03.602 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2023-10-14T11:15:03.602 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2023-10-14T11:15:03.602 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2023-10-14T11:15:03.603 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2023-10-14T11:15:03.603 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2023-10-14T11:15:03.603 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2023-10-14T11:15:03.603 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2023-10-14T11:15:03.604 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2023-10-14T11:15:03.604 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2023-10-14T11:15:03.604 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2023-10-14T11:15:03.604 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:15:03.604 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2023-10-14T11:15:03.605 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2023-10-14T11:15:03.605 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2023-10-14T11:15:03.605 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2023-10-14T11:15:03.605 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2023-10-14T11:15:03.605 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2023-10-14T11:15:03.605 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2023-10-14T11:15:03.606 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:15:03.606 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2023-10-14T11:15:03.606 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2023-10-14T11:15:03.606 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2023-10-14T11:15:03.606 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T11:15:03.607 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T11:15:03.607 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T11:15:03.607 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T11:15:03.608 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2023-10-14T11:15:03.608 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:15:03.608 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:15:03.608 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:15:03.608 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:15:03.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:03.610 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-10-14T11:15:03.623 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:2023-10-14T11:15:03.615+0000 7f5098ac3580 -1 init, newargv = 0x56324a605e80 newargc=15 2023-10-14T11:15:03.624 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[51342]: starting ceph client 2023-10-14T11:15:03.631 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[51342]: starting fuse 2023-10-14T11:15:03.632 INFO:teuthology.orchestra.run.smithi026.stdout:43 2023-10-14T11:15:03.633 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-10-14T11:15:03.633 DEBUG:teuthology.orchestra.run.smithi026:> sudo stdin-killer -- python3 -c ' 2023-10-14T11:15:03.633 DEBUG:teuthology.orchestra.run.smithi026:> import glob 2023-10-14T11:15:03.634 DEBUG:teuthology.orchestra.run.smithi026:> import re 2023-10-14T11:15:03.634 DEBUG:teuthology.orchestra.run.smithi026:> import os 2023-10-14T11:15:03.635 DEBUG:teuthology.orchestra.run.smithi026:> import subprocess 2023-10-14T11:15:03.635 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:15:03.635 DEBUG:teuthology.orchestra.run.smithi026:> def _find_admin_socket(client_name): 2023-10-14T11:15:03.636 DEBUG:teuthology.orchestra.run.smithi026:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-14T11:15:03.636 DEBUG:teuthology.orchestra.run.smithi026:> files = glob.glob(asok_path) 2023-10-14T11:15:03.636 DEBUG:teuthology.orchestra.run.smithi026:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-14T11:15:03.637 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:15:03.637 DEBUG:teuthology.orchestra.run.smithi026:> # Given a non-glob path, it better be there 2023-10-14T11:15:03.637 DEBUG:teuthology.orchestra.run.smithi026:> if "*" not in asok_path: 2023-10-14T11:15:03.638 DEBUG:teuthology.orchestra.run.smithi026:> assert(len(files) == 1) 2023-10-14T11:15:03.638 DEBUG:teuthology.orchestra.run.smithi026:> return files[0] 2023-10-14T11:15:03.639 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:15:03.640 DEBUG:teuthology.orchestra.run.smithi026:> for f in files: 2023-10-14T11:15:03.640 DEBUG:teuthology.orchestra.run.smithi026:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-14T11:15:03.640 DEBUG:teuthology.orchestra.run.smithi026:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-14T11:15:03.641 DEBUG:teuthology.orchestra.run.smithi026:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-14T11:15:03.641 DEBUG:teuthology.orchestra.run.smithi026:> contents = proc_f.read() 2023-10-14T11:15:03.642 DEBUG:teuthology.orchestra.run.smithi026:> if mountpoint in contents: 2023-10-14T11:15:03.642 DEBUG:teuthology.orchestra.run.smithi026:> return f 2023-10-14T11:15:03.643 DEBUG:teuthology.orchestra.run.smithi026:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-14T11:15:03.643 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:15:03.643 DEBUG:teuthology.orchestra.run.smithi026:> print(_find_admin_socket("client.0")) 2023-10-14T11:15:03.644 DEBUG:teuthology.orchestra.run.smithi026:> ' 2023-10-14T11:15:03.758 INFO:teuthology.orchestra.run.smithi026.stdout:/var/run/ceph/ceph-client.0.51342.asok 2023-10-14T11:15:03.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-14T11:15:03.770 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.51342.asok 2023-10-14T11:15:03.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:03.771 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.51342.asok status 2023-10-14T11:15:03.949 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:15:03.950 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": { 2023-10-14T11:15:03.950 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-14T11:15:03.950 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T11:15:03.951 INFO:teuthology.orchestra.run.smithi026.stdout: "entity_id": "0", 2023-10-14T11:15:03.951 INFO:teuthology.orchestra.run.smithi026.stdout: "hostname": "smithi026", 2023-10-14T11:15:03.951 INFO:teuthology.orchestra.run.smithi026.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-14T11:15:03.951 INFO:teuthology.orchestra.run.smithi026.stdout: "pid": "51342", 2023-10-14T11:15:03.952 INFO:teuthology.orchestra.run.smithi026.stdout: "root": "/" 2023-10-14T11:15:03.952 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:15:03.952 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_count": 0, 2023-10-14T11:15:03.952 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_pinned_count": 0, 2023-10-14T11:15:03.953 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 6387, 2023-10-14T11:15:03.953 INFO:teuthology.orchestra.run.smithi026.stdout: "inst": { 2023-10-14T11:15:03.953 INFO:teuthology.orchestra.run.smithi026.stdout: "name": { 2023-10-14T11:15:03.953 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "client", 2023-10-14T11:15:03.954 INFO:teuthology.orchestra.run.smithi026.stdout: "num": 6387 2023-10-14T11:15:03.954 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:15:03.954 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-10-14T11:15:03.954 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-14T11:15:03.955 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2023-10-14T11:15:03.955 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 1152802504 2023-10-14T11:15:03.955 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:15:03.955 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:15:03.955 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-10-14T11:15:03.956 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-14T11:15:03.956 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2023-10-14T11:15:03.956 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 1152802504 2023-10-14T11:15:03.957 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:15:03.957 INFO:teuthology.orchestra.run.smithi026.stdout: "inst_str": "client.6387 192.168.0.1:0/1152802504", 2023-10-14T11:15:03.957 INFO:teuthology.orchestra.run.smithi026.stdout: "addr_str": "192.168.0.1:0/1152802504", 2023-10-14T11:15:03.957 INFO:teuthology.orchestra.run.smithi026.stdout: "inode_count": 1, 2023-10-14T11:15:03.957 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_epoch": 26, 2023-10-14T11:15:03.958 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch": 55, 2023-10-14T11:15:03.958 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch_barrier": 0, 2023-10-14T11:15:03.958 INFO:teuthology.orchestra.run.smithi026.stdout: "blocklisted": false, 2023-10-14T11:15:03.958 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "testcephfs1" 2023-10-14T11:15:03.958 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:15:03.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:03.965 DEBUG:teuthology.orchestra.run.smithi026:> stat --file-system '--printf=%T 2023-10-14T11:15:03.966 DEBUG:teuthology.orchestra.run.smithi026:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-14T11:15:03.975 INFO:teuthology.orchestra.run.smithi026.stdout:fuseblk 2023-10-14T11:15:03.976 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-14T11:15:03.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:03.977 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T11:15:04.043 DEBUG:teuthology.orchestra.run.smithi026:> stdin-killer -- python3 -c ' 2023-10-14T11:15:04.044 DEBUG:teuthology.orchestra.run.smithi026:> import os 2023-10-14T11:15:04.044 DEBUG:teuthology.orchestra.run.smithi026:> import errno 2023-10-14T11:15:04.045 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:15:04.045 DEBUG:teuthology.orchestra.run.smithi026:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2023-10-14T11:15:04.046 DEBUG:teuthology.orchestra.run.smithi026:> try: 2023-10-14T11:15:04.046 DEBUG:teuthology.orchestra.run.smithi026:> if False: 2023-10-14T11:15:04.047 DEBUG:teuthology.orchestra.run.smithi026:> ret = os.read(fd, 1024) 2023-10-14T11:15:04.047 DEBUG:teuthology.orchestra.run.smithi026:> else: 2023-10-14T11:15:04.048 DEBUG:teuthology.orchestra.run.smithi026:> os.write(fd, b'"'"'content'"'"') 2023-10-14T11:15:04.048 DEBUG:teuthology.orchestra.run.smithi026:> except OSError as e: 2023-10-14T11:15:04.049 DEBUG:teuthology.orchestra.run.smithi026:> if e.errno != errno.EPERM: 2023-10-14T11:15:04.049 DEBUG:teuthology.orchestra.run.smithi026:> raise 2023-10-14T11:15:04.049 DEBUG:teuthology.orchestra.run.smithi026:> else: 2023-10-14T11:15:04.050 DEBUG:teuthology.orchestra.run.smithi026:> raise RuntimeError("client does not check permission of data pool") 2023-10-14T11:15:04.050 DEBUG:teuthology.orchestra.run.smithi026:> ' 2023-10-14T11:15:04.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-14T11:15:04.166 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow w pool=testcephfs1_data' 2023-10-14T11:15:04.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.351+0000 7f8eabf1d640 1 Processor -- start 2023-10-14T11:15:04.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.351+0000 7f8eabf1d640 1 -- start start 2023-10-14T11:15:04.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.355+0000 7f8eabf1d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8ea40b85d0 0x7f8ea415dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:04.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.355+0000 7f8eabf1d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ea40d0300 0x7f8ea40d0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:04.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.355+0000 7f8eabf1d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea415e1d0 con 0x7f8ea40b89b0 2023-10-14T11:15:04.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.355+0000 7f8eabf1d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea4161720 con 0x7f8ea40b85d0 2023-10-14T11:15:04.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.355+0000 7f8eabf1d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea4160ba0 con 0x7f8ea40d0300 2023-10-14T11:15:04.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.355+0000 7f8eaa4ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ea40d0300 0x7f8ea40d0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:04.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.355+0000 7f8eaa4ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ea40d0300 0x7f8ea40d0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:50480/0 (socket says 172.21.15.26:50480) 2023-10-14T11:15:04.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.355+0000 7f8ea94b8640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8ea40b89b0 0x7f8ea40cfbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:44452/0 (socket says 172.21.15.26:44452) 2023-10-14T11:15:04.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.355+0000 7f8eaa4ba640 1 -- 172.21.15.26:0/4174963111 learned_addr learned my addr 172.21.15.26:0/4174963111 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:04.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.355+0000 7f8ea9cb9640 1 --2- 172.21.15.26:0/4174963111 >> v2:172.21.15.110:3300/0 conn(0x7f8ea40b85d0 0x7f8ea415dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:04.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.355+0000 7f8eaa4ba640 1 -- 172.21.15.26:0/4174963111 >> v2:172.21.15.110:3300/0 conn(0x7f8ea40b85d0 msgr2=0x7f8ea415dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:04.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.355+0000 7f8eaa4ba640 1 --2- 172.21.15.26:0/4174963111 >> v2:172.21.15.110:3300/0 conn(0x7f8ea40b85d0 0x7f8ea415dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.355+0000 7f8eaa4ba640 1 -- 172.21.15.26:0/4174963111 >> v1:172.21.15.110:6789/0 conn(0x7f8ea40b89b0 legacy=0x7f8ea40cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:04.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.355+0000 7f8eaa4ba640 1 -- 172.21.15.26:0/4174963111 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea4160e80 con 0x7f8ea40d0300 2023-10-14T11:15:04.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.355+0000 7f8ea8cb7640 1 -- 172.21.15.26:0/4174963111 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075574858 0 0) 0x7f8ea415e1d0 con 0x7f8ea40b89b0 2023-10-14T11:15:04.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.359+0000 7f8eaa4ba640 1 --2- 172.21.15.26:0/4174963111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ea40d0300 0x7f8ea40d0e00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c009e50 tx=0x7f8e9c01c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb76e798e8e600e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:04.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.359+0000 7f8ea8cb7640 1 -- 172.21.15.26:0/4174963111 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c0a58a0 con 0x7f8ea40d0300 2023-10-14T11:15:04.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.359+0000 7f8ea8cb7640 1 -- 172.21.15.26:0/4174963111 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9c0a5a00 con 0x7f8ea40d0300 2023-10-14T11:15:04.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.359+0000 7f8ea8cb7640 1 -- 172.21.15.26:0/4174963111 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c0a5d90 con 0x7f8ea40d0300 2023-10-14T11:15:04.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.359+0000 7f8eabf1d640 1 -- 172.21.15.26:0/4174963111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ea40d0300 msgr2=0x7f8ea40d0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:04.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.359+0000 7f8eabf1d640 1 --2- 172.21.15.26:0/4174963111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ea40d0300 0x7f8ea40d0e00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c009e50 tx=0x7f8e9c01c9e0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.359+0000 7f8eabf1d640 1 -- 172.21.15.26:0/4174963111 shutdown_connections 2023-10-14T11:15:04.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.359+0000 7f8eabf1d640 1 --2- 172.21.15.26:0/4174963111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ea40d0300 0x7f8ea40d0e00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.359+0000 7f8eabf1d640 1 --2- 172.21.15.26:0/4174963111 >> v2:172.21.15.110:3300/0 conn(0x7f8ea40b85d0 0x7f8ea415dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.359+0000 7f8eabf1d640 1 -- 172.21.15.26:0/4174963111 >> 172.21.15.26:0/4174963111 conn(0x7f8ea406b750 msgr2=0x7f8ea406bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:04.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.359+0000 7f8eabf1d640 1 -- 172.21.15.26:0/4174963111 shutdown_connections 2023-10-14T11:15:04.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.359+0000 7f8eabf1d640 1 -- 172.21.15.26:0/4174963111 wait complete. 2023-10-14T11:15:04.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.359+0000 7f8eabf1d640 1 Processor -- start 2023-10-14T11:15:04.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.359+0000 7f8eabf1d640 1 -- start start 2023-10-14T11:15:04.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8eabf1d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ea40b85d0 0x7f8ea4146f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:04.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8eabf1d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ea40b89b0 0x7f8ea4156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:04.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8eabf1d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ea40d0300 0x7f8ea40c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:04.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8eabf1d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40c88e0 con 0x7f8ea40b85d0 2023-10-14T11:15:04.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8eabf1d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40c7d30 con 0x7f8ea40b89b0 2023-10-14T11:15:04.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8eabf1d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40c7fb0 con 0x7f8ea40d0300 2023-10-14T11:15:04.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8ea9cb9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ea40b85d0 0x7f8ea4146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:04.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8ea9cb9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ea40b85d0 0x7f8ea4146f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34630/0 (socket says 172.21.15.26:34630) 2023-10-14T11:15:04.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8ea9cb9640 1 -- 172.21.15.26:0/1228939193 learned_addr learned my addr 172.21.15.26:0/1228939193 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:04.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8eaa4ba640 1 --2- 172.21.15.26:0/1228939193 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ea40d0300 0x7f8ea40c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:04.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8ea94b8640 1 --2- 172.21.15.26:0/1228939193 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ea40b89b0 0x7f8ea4156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:04.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8ea9cb9640 1 -- 172.21.15.26:0/1228939193 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ea40d0300 msgr2=0x7f8ea40c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:04.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8ea9cb9640 1 --2- 172.21.15.26:0/1228939193 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ea40d0300 0x7f8ea40c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8ea9cb9640 1 -- 172.21.15.26:0/1228939193 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ea40b89b0 msgr2=0x7f8ea4156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:04.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8ea9cb9640 1 --2- 172.21.15.26:0/1228939193 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ea40b89b0 0x7f8ea4156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8ea9cb9640 1 -- 172.21.15.26:0/1228939193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c009b30 con 0x7f8ea40b85d0 2023-10-14T11:15:04.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8ea9cb9640 1 --2- 172.21.15.26:0/1228939193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ea40b85d0 0x7f8ea4146f30 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000e930 tx=0x7f8ea000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:04.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8e9a7fc640 1 -- 172.21.15.26:0/1228939193 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0009690 con 0x7f8ea40b85d0 2023-10-14T11:15:04.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8e9a7fc640 1 -- 172.21.15.26:0/1228939193 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea000ca00 con 0x7f8ea40b85d0 2023-10-14T11:15:04.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8e9a7fc640 1 -- 172.21.15.26:0/1228939193 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea000cd70 con 0x7f8ea40b85d0 2023-10-14T11:15:04.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8eabf1d640 1 -- 172.21.15.26:0/1228939193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea40c8290 con 0x7f8ea40b85d0 2023-10-14T11:15:04.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8eabf1d640 1 -- 172.21.15.26:0/1228939193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea4157360 con 0x7f8ea40b85d0 2023-10-14T11:15:04.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8eabf1d640 1 -- 172.21.15.26:0/1228939193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea404e170 con 0x7f8ea40b85d0 2023-10-14T11:15:04.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.363+0000 7f8e9a7fc640 1 -- 172.21.15.26:0/1228939193 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8ea0013470 con 0x7f8ea40b85d0 2023-10-14T11:15:04.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.367+0000 7f8e9a7fc640 1 --2- 172.21.15.26:0/1228939193 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8e880664a0 0x7f8e88068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:04.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.367+0000 7f8e9a7fc640 1 -- 172.21.15.26:0/1228939193 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f8ea0084220 con 0x7f8ea40b85d0 2023-10-14T11:15:04.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.367+0000 7f8ea94b8640 1 --2- 172.21.15.26:0/1228939193 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8e880664a0 0x7f8e88068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:04.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.367+0000 7f8ea94b8640 1 --2- 172.21.15.26:0/1228939193 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8e880664a0 0x7f8e88068960 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40ce020 tx=0x7f8e94007b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:04.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.371+0000 7f8e9a7fc640 1 -- 172.21.15.26:0/1228939193 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8ea0051690 con 0x7f8ea40b85d0 2023-10-14T11:15:04.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.583+0000 7f8eabf1d640 1 -- 172.21.15.26:0/1228939193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=testcephfs1_data"]} v 0) v1 -- 0x7f8ea40d0900 con 0x7f8ea40b85d0 2023-10-14T11:15:04.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.583+0000 7f8e9a7fc640 1 -- 172.21.15.26:0/1228939193 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=testcephfs1_data"]}]=0 updated caps for client.0 v17) v1 ==== 188+0+145 (secure 0 0 0) 0x7f8ea0054cb0 con 0x7f8ea40b85d0 2023-10-14T11:15:04.592 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2023-10-14T11:15:04.592 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBZdyplGXdwHxAA3yn7fC60cZX9BQGuvdlfYw== 2023-10-14T11:15:04.592 INFO:teuthology.orchestra.run.smithi026.stdout: caps mds = "allow" 2023-10-14T11:15:04.592 INFO:teuthology.orchestra.run.smithi026.stdout: caps mon = "allow r" 2023-10-14T11:15:04.593 INFO:teuthology.orchestra.run.smithi026.stdout: caps osd = "allow w pool=testcephfs1_data" 2023-10-14T11:15:04.593 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-10-14T11:15:04.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.587+0000 7f8eabf1d640 1 -- 172.21.15.26:0/1228939193 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8e880664a0 msgr2=0x7f8e88068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:04.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.587+0000 7f8eabf1d640 1 --2- 172.21.15.26:0/1228939193 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8e880664a0 0x7f8e88068960 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40ce020 tx=0x7f8e94007b60 comp rx=0 tx=0).stop 2023-10-14T11:15:04.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.587+0000 7f8eabf1d640 1 -- 172.21.15.26:0/1228939193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ea40b85d0 msgr2=0x7f8ea4146f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:04.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.587+0000 7f8eabf1d640 1 --2- 172.21.15.26:0/1228939193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ea40b85d0 0x7f8ea4146f30 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000e930 tx=0x7f8ea000edf0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.587+0000 7f8eabf1d640 1 -- 172.21.15.26:0/1228939193 shutdown_connections 2023-10-14T11:15:04.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.587+0000 7f8eabf1d640 1 --2- 172.21.15.26:0/1228939193 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ea40d0300 0x7f8ea40c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.587+0000 7f8eabf1d640 1 --2- 172.21.15.26:0/1228939193 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ea40b89b0 0x7f8ea4156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.587+0000 7f8eabf1d640 1 --2- 172.21.15.26:0/1228939193 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8e880664a0 0x7f8e88068960 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.587+0000 7f8eabf1d640 1 --2- 172.21.15.26:0/1228939193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ea40b85d0 0x7f8ea4146f30 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.587+0000 7f8eabf1d640 1 -- 172.21.15.26:0/1228939193 >> 172.21.15.26:0/1228939193 conn(0x7f8ea406b750 msgr2=0x7f8ea415fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:04.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.587+0000 7f8eabf1d640 1 -- 172.21.15.26:0/1228939193 shutdown_connections 2023-10-14T11:15:04.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.587+0000 7f8eabf1d640 1 -- 172.21.15.26:0/1228939193 wait complete. 2023-10-14T11:15:04.613 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:15:04.613 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:15:04.623 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:15:04.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f672c9640 1 Processor -- start 2023-10-14T11:15:04.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f672c9640 1 -- start start 2023-10-14T11:15:04.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f672c9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4f6015cb90 0x7f4f600cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:04.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f672c9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f600ce770 con 0x7f4f600d15d0 2023-10-14T11:15:04.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f672c9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f600d0600 con 0x7f4f600d3010 2023-10-14T11:15:04.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f672c9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f600c6450 con 0x7f4f6015cb90 2023-10-14T11:15:04.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f65866640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4f600d15d0 0x7f4f600c6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53072/0 (socket says 172.21.15.26:53072) 2023-10-14T11:15:04.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f65866640 1 -- 172.21.15.26:0/2726711380 learned_addr learned my addr 172.21.15.26:0/2726711380 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:04.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f65065640 1 --2- 172.21.15.26:0/2726711380 >> v2:172.21.15.110:3300/0 conn(0x7f4f6015cb90 0x7f4f600cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:04.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f57fff640 1 -- 172.21.15.26:0/2726711380 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2322532671 0 0) 0x7f4f600ce770 con 0x7f4f600d15d0 2023-10-14T11:15:04.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f57fff640 1 -- 172.21.15.26:0/2726711380 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f4c003530 con 0x7f4f600d15d0 2023-10-14T11:15:04.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f57fff640 1 -- 172.21.15.26:0/2726711380 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299451339 0 0) 0x7f4f600d0600 con 0x7f4f600d3010 2023-10-14T11:15:04.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f57fff640 1 -- 172.21.15.26:0/2726711380 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f600ce770 con 0x7f4f600d3010 2023-10-14T11:15:04.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f57fff640 1 -- 172.21.15.26:0/2726711380 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3312157943 0 0) 0x7f4f4c003530 con 0x7f4f600d15d0 2023-10-14T11:15:04.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f57fff640 1 -- 172.21.15.26:0/2726711380 >> v2:172.21.15.110:3300/0 conn(0x7f4f6015cb90 msgr2=0x7f4f600cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:04.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f57fff640 1 --2- 172.21.15.26:0/2726711380 >> v2:172.21.15.110:3300/0 conn(0x7f4f6015cb90 0x7f4f600cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f57fff640 1 -- 172.21.15.26:0/2726711380 >> v1:172.21.15.110:6789/0 conn(0x7f4f600d3010 legacy=0x7f4f600d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:04.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f57fff640 1 -- 172.21.15.26:0/2726711380 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f600d08a0 con 0x7f4f600d15d0 2023-10-14T11:15:04.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f57fff640 1 -- 172.21.15.26:0/2726711380 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f4f58001a20 con 0x7f4f600d15d0 2023-10-14T11:15:04.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f57fff640 1 -- 172.21.15.26:0/2726711380 >> v1:172.21.15.26:6789/0 conn(0x7f4f600d15d0 legacy=0x7f4f600c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:04.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f57fff640 1 --2- 172.21.15.26:0/2726711380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f4c003b10 0x7f4f4c003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:04.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f57fff640 1 --2- 172.21.15.26:0/2726711380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f4c0047d0 0x7f4f4c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:04.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f57fff640 1 --2- 172.21.15.26:0/2726711380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f4c005190 0x7f4f4c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:04.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f57fff640 1 -- 172.21.15.26:0/2726711380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600c6450 con 0x7f4f4c005190 2023-10-14T11:15:04.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f57fff640 1 -- 172.21.15.26:0/2726711380 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c00c0c0 con 0x7f4f4c003b10 2023-10-14T11:15:04.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f57fff640 1 -- 172.21.15.26:0/2726711380 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c00c280 con 0x7f4f4c0047d0 2023-10-14T11:15:04.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f65065640 1 --2- 172.21.15.26:0/2726711380 >> v2:172.21.15.110:3300/0 conn(0x7f4f6015cb90 0x7f4f600cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:15:04.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.799+0000 7f4f65866640 1 --2- 172.21.15.26:0/2726711380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f4c005190 0x7f4f4c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:04.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.803+0000 7f4f64864640 1 --2- 172.21.15.26:0/2726711380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f4c0047d0 0x7f4f4c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:04.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.803+0000 7f4f65065640 1 --2- 172.21.15.26:0/2726711380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f4c003b10 0x7f4f4c003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:04.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.803+0000 7f4f65866640 1 -- 172.21.15.26:0/2726711380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f4c0047d0 msgr2=0x7f4f4c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:04.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.803+0000 7f4f65866640 1 --2- 172.21.15.26:0/2726711380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f4c0047d0 0x7f4f4c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.803+0000 7f4f65866640 1 -- 172.21.15.26:0/2726711380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f4c003b10 msgr2=0x7f4f4c003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:04.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.803+0000 7f4f65866640 1 --2- 172.21.15.26:0/2726711380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f4c003b10 0x7f4f4c003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.803+0000 7f4f65866640 1 -- 172.21.15.26:0/2726711380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4c003530 con 0x7f4f4c005190 2023-10-14T11:15:04.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.803+0000 7f4f65866640 1 -- 172.21.15.26:0/2726711380 reap_dead start 2023-10-14T11:15:04.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.803+0000 7f4f65866640 1 --2- 172.21.15.26:0/2726711380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f4c005190 0x7f4f4c00b990 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f4f600c9450 tx=0x7f4f5801d280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfae5d6b62387981 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:04.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.803+0000 7f4f57fff640 1 -- 172.21.15.26:0/2726711380 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f580ac620 con 0x7f4f4c005190 2023-10-14T11:15:04.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.803+0000 7f4f57fff640 1 -- 172.21.15.26:0/2726711380 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f580a8070 con 0x7f4f4c005190 2023-10-14T11:15:04.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.803+0000 7f4f57fff640 1 -- 172.21.15.26:0/2726711380 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f580ac9e0 con 0x7f4f4c005190 2023-10-14T11:15:04.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.803+0000 7f4f672c9640 1 -- 172.21.15.26:0/2726711380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f4c005190 msgr2=0x7f4f4c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:04.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.803+0000 7f4f672c9640 1 --2- 172.21.15.26:0/2726711380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f4c005190 0x7f4f4c00b990 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f4f600c9450 tx=0x7f4f5801d280 comp rx=0 tx=0).stop 2023-10-14T11:15:04.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f672c9640 1 -- 172.21.15.26:0/2726711380 shutdown_connections 2023-10-14T11:15:04.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f672c9640 1 --2- 172.21.15.26:0/2726711380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f4c005190 0x7f4f4c00b990 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f672c9640 1 -- 172.21.15.26:0/2726711380 >> 172.21.15.26:0/2726711380 conn(0x7f4f6009bc50 msgr2=0x7f4f600d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:04.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f672c9640 1 -- 172.21.15.26:0/2726711380 shutdown_connections 2023-10-14T11:15:04.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f672c9640 1 -- 172.21.15.26:0/2726711380 wait complete. 2023-10-14T11:15:04.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f672c9640 1 Processor -- start 2023-10-14T11:15:04.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f672c9640 1 -- start start 2023-10-14T11:15:04.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f672c9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f4c005190 0x7f4f601f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:04.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f672c9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f600b7950 0x7f4f6015ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:04.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f672c9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f600b7db0 0x7f4f6015b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:04.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f672c9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f601e5530 con 0x7f4f4c005190 2023-10-14T11:15:04.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f672c9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f601e5810 con 0x7f4f600b7950 2023-10-14T11:15:04.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f672c9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f601e5af0 con 0x7f4f600b7db0 2023-10-14T11:15:04.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f65065640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f4c005190 0x7f4f601f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:04.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f65065640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f4c005190 0x7f4f601f1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34656/0 (socket says 172.21.15.26:34656) 2023-10-14T11:15:04.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f65065640 1 -- 172.21.15.26:0/1135001860 learned_addr learned my addr 172.21.15.26:0/1135001860 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:04.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f64864640 1 --2- 172.21.15.26:0/1135001860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f600b7950 0x7f4f6015ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:04.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f65866640 1 --2- 172.21.15.26:0/1135001860 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f600b7db0 0x7f4f6015b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:04.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f65065640 1 -- 172.21.15.26:0/1135001860 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f600b7db0 msgr2=0x7f4f6015b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:04.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f65065640 1 --2- 172.21.15.26:0/1135001860 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f600b7db0 0x7f4f6015b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f65065640 1 -- 172.21.15.26:0/1135001860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f600b7950 msgr2=0x7f4f6015ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:04.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f65065640 1 --2- 172.21.15.26:0/1135001860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f600b7950 0x7f4f6015ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f65065640 1 -- 172.21.15.26:0/1135001860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f601e5dd0 con 0x7f4f4c005190 2023-10-14T11:15:04.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f65866640 1 --2- 172.21.15.26:0/1135001860 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f600b7db0 0x7f4f6015b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:04.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.807+0000 7f4f65065640 1 --2- 172.21.15.26:0/1135001860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f4c005190 0x7f4f601f1e40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0116f0 tx=0x7f4f5c011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:04.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.811+0000 7f4f55ffb640 1 -- 172.21.15.26:0/1135001860 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c00f9c0 con 0x7f4f4c005190 2023-10-14T11:15:04.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.811+0000 7f4f55ffb640 1 -- 172.21.15.26:0/1135001860 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c00fb20 con 0x7f4f4c005190 2023-10-14T11:15:04.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.811+0000 7f4f55ffb640 1 -- 172.21.15.26:0/1135001860 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c00fe90 con 0x7f4f4c005190 2023-10-14T11:15:04.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.811+0000 7f4f672c9640 1 -- 172.21.15.26:0/1135001860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f601e60b0 con 0x7f4f4c005190 2023-10-14T11:15:04.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.811+0000 7f4f672c9640 1 -- 172.21.15.26:0/1135001860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f600cc2d0 con 0x7f4f4c005190 2023-10-14T11:15:04.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.811+0000 7f4f672c9640 1 -- 172.21.15.26:0/1135001860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f60074010 con 0x7f4f4c005190 2023-10-14T11:15:04.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.811+0000 7f4f55ffb640 1 -- 172.21.15.26:0/1135001860 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4f5c015460 con 0x7f4f4c005190 2023-10-14T11:15:04.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.811+0000 7f4f55ffb640 1 --2- 172.21.15.26:0/1135001860 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4f440664d0 0x7f4f44068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:04.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.811+0000 7f4f55ffb640 1 -- 172.21.15.26:0/1135001860 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f4f5c084920 con 0x7f4f4c005190 2023-10-14T11:15:04.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.811+0000 7f4f64864640 1 --2- 172.21.15.26:0/1135001860 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4f440664d0 0x7f4f44068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:04.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.815+0000 7f4f64864640 1 --2- 172.21.15.26:0/1135001860 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4f440664d0 0x7f4f44068990 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4f50000c10 tx=0x7f4f500071a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:04.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.815+0000 7f4f55ffb640 1 -- 172.21.15.26:0/1135001860 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4f5c051ba0 con 0x7f4f4c005190 2023-10-14T11:15:04.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.975+0000 7f4f672c9640 1 -- 172.21.15.26:0/1135001860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f600ce550 con 0x7f4f4c005190 2023-10-14T11:15:04.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.975+0000 7f4f55ffb640 1 -- 172.21.15.26:0/1135001860 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16790 (secure 0 0 0) 0x7f4f5c022020 con 0x7f4f4c005190 2023-10-14T11:15:04.983 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:15:04.983 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":55,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:14:51.591742+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:14:47.752880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:14:48.971211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:15:04.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.979+0000 7f4f672c9640 1 -- 172.21.15.26:0/1135001860 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4f440664d0 msgr2=0x7f4f44068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:04.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.979+0000 7f4f672c9640 1 --2- 172.21.15.26:0/1135001860 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4f440664d0 0x7f4f44068990 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4f50000c10 tx=0x7f4f500071a0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.979+0000 7f4f672c9640 1 -- 172.21.15.26:0/1135001860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f4c005190 msgr2=0x7f4f601f1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:04.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.979+0000 7f4f672c9640 1 --2- 172.21.15.26:0/1135001860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f4c005190 0x7f4f601f1e40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0116f0 tx=0x7f4f5c011bb0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.979+0000 7f4f672c9640 1 -- 172.21.15.26:0/1135001860 shutdown_connections 2023-10-14T11:15:04.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.979+0000 7f4f672c9640 1 --2- 172.21.15.26:0/1135001860 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f600b7db0 0x7f4f6015b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.979+0000 7f4f672c9640 1 --2- 172.21.15.26:0/1135001860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f600b7950 0x7f4f6015ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.979+0000 7f4f672c9640 1 --2- 172.21.15.26:0/1135001860 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4f440664d0 0x7f4f44068990 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.979+0000 7f4f672c9640 1 --2- 172.21.15.26:0/1135001860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f4c005190 0x7f4f601f1e40 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:04.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.979+0000 7f4f672c9640 1 -- 172.21.15.26:0/1135001860 >> 172.21.15.26:0/1135001860 conn(0x7f4f6009bc50 msgr2=0x7f4f600c88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:04.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.979+0000 7f4f672c9640 1 -- 172.21.15.26:0/1135001860 shutdown_connections 2023-10-14T11:15:04.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:04.979+0000 7f4f672c9640 1 -- 172.21.15.26:0/1135001860 wait complete. 2023-10-14T11:15:05.004 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'testcephfs1_metadata', 'create_time': '2023-10-14T11:14:47.752880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'testcephfs1_data', 'create_time': '2023-10-14T11:14:48.971211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:15:05.005 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:15:05.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.143+0000 7f333ee88640 1 Processor -- start 2023-10-14T11:15:05.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.143+0000 7f333ee88640 1 -- start start 2023-10-14T11:15:05.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.147+0000 7f333ee88640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f333815cdc0 0x7f33380cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:05.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.147+0000 7f333ee88640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33380d0880 con 0x7f33380cf210 2023-10-14T11:15:05.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.147+0000 7f333ee88640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33380b1c00 con 0x7f33380b3cb0 2023-10-14T11:15:05.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.147+0000 7f333ee88640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33380b1ee0 con 0x7f333815cdc0 2023-10-14T11:15:05.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.147+0000 7f333d685640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f333815cdc0 0x7f33380cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:05.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.147+0000 7f333de86640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f33380cf210 0x7f33380cf5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53084/0 (socket says 172.21.15.26:53084) 2023-10-14T11:15:05.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.147+0000 7f333de86640 1 -- 172.21.15.26:0/4191499887 learned_addr learned my addr 172.21.15.26:0/4191499887 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:05.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.147+0000 7f333d685640 1 -- 172.21.15.26:0/4191499887 >> v1:172.21.15.110:6789/0 conn(0x7f33380b3cb0 legacy=0x7f33380cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:05.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.147+0000 7f333d685640 1 -- 172.21.15.26:0/4191499887 >> v1:172.21.15.26:6789/0 conn(0x7f33380cf210 legacy=0x7f33380cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:05.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.147+0000 7f333d685640 1 -- 172.21.15.26:0/4191499887 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33380b21c0 con 0x7f333815cdc0 2023-10-14T11:15:05.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.147+0000 7f333ce84640 1 -- 172.21.15.26:0/4191499887 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737777179 0 0) 0x7f33380d0880 con 0x7f33380cf210 2023-10-14T11:15:05.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.147+0000 7f333d685640 1 --2- 172.21.15.26:0/4191499887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f333815cdc0 0x7f33380cd4c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f33280097c0 tx=0x7f332801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78eb26b7490553b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:05.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.147+0000 7f333ce84640 1 -- 172.21.15.26:0/4191499887 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33280ab600 con 0x7f333815cdc0 2023-10-14T11:15:05.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.147+0000 7f333ce84640 1 -- 172.21.15.26:0/4191499887 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33280a7050 con 0x7f333815cdc0 2023-10-14T11:15:05.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.151+0000 7f333ce84640 1 -- 172.21.15.26:0/4191499887 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33280ab980 con 0x7f333815cdc0 2023-10-14T11:15:05.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.151+0000 7f333ee88640 1 -- 172.21.15.26:0/4191499887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f333815cdc0 msgr2=0x7f33380cd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:05.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.151+0000 7f333ee88640 1 --2- 172.21.15.26:0/4191499887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f333815cdc0 0x7f33380cd4c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f33280097c0 tx=0x7f332801c410 comp rx=0 tx=0).stop 2023-10-14T11:15:05.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.151+0000 7f333ee88640 1 -- 172.21.15.26:0/4191499887 shutdown_connections 2023-10-14T11:15:05.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.151+0000 7f333ee88640 1 --2- 172.21.15.26:0/4191499887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f333815cdc0 0x7f33380cd4c0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:05.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.151+0000 7f333ee88640 1 -- 172.21.15.26:0/4191499887 >> 172.21.15.26:0/4191499887 conn(0x7f33380d2800 msgr2=0x7f33380d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:05.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.151+0000 7f333ee88640 1 -- 172.21.15.26:0/4191499887 shutdown_connections 2023-10-14T11:15:05.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.151+0000 7f333ee88640 1 -- 172.21.15.26:0/4191499887 wait complete. 2023-10-14T11:15:05.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.151+0000 7f333ee88640 1 Processor -- start 2023-10-14T11:15:05.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.151+0000 7f333ee88640 1 -- start start 2023-10-14T11:15:05.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.151+0000 7f333ee88640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33380b3cb0 0x7f33380cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:05.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.151+0000 7f333ee88640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33380cf210 0x7f3338158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:05.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.151+0000 7f333ee88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f333815cdc0 0x7f3338158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:05.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.151+0000 7f333ee88640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33380ccd60 con 0x7f33380cf210 2023-10-14T11:15:05.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.151+0000 7f333ee88640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33381f6750 con 0x7f33380b3cb0 2023-10-14T11:15:05.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.151+0000 7f333ee88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33381f5bb0 con 0x7f333815cdc0 2023-10-14T11:15:05.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.151+0000 7f333d685640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33380cf210 0x7f3338158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:05.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.151+0000 7f333d685640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33380cf210 0x7f3338158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34662/0 (socket says 172.21.15.26:34662) 2023-10-14T11:15:05.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.151+0000 7f333d685640 1 -- 172.21.15.26:0/1089622927 learned_addr learned my addr 172.21.15.26:0/1089622927 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:05.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.151+0000 7f333de86640 1 --2- 172.21.15.26:0/1089622927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33380b3cb0 0x7f33380cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:05.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.151+0000 7f333e687640 1 --2- 172.21.15.26:0/1089622927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f333815cdc0 0x7f3338158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:05.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.155+0000 7f333d685640 1 -- 172.21.15.26:0/1089622927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f333815cdc0 msgr2=0x7f3338158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:05.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.155+0000 7f333d685640 1 --2- 172.21.15.26:0/1089622927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f333815cdc0 0x7f3338158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:05.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.155+0000 7f333d685640 1 -- 172.21.15.26:0/1089622927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33380b3cb0 msgr2=0x7f33380cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:05.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.155+0000 7f333d685640 1 --2- 172.21.15.26:0/1089622927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33380b3cb0 0x7f33380cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:05.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.155+0000 7f333d685640 1 -- 172.21.15.26:0/1089622927 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3328009420 con 0x7f33380cf210 2023-10-14T11:15:05.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.155+0000 7f333de86640 1 --2- 172.21.15.26:0/1089622927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33380b3cb0 0x7f33380cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:05.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.155+0000 7f333d685640 1 --2- 172.21.15.26:0/1089622927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33380cf210 0x7f3338158650 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f33280097c0 tx=0x7f33280191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:05.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.155+0000 7f332e7fc640 1 -- 172.21.15.26:0/1089622927 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33280bd070 con 0x7f33380cf210 2023-10-14T11:15:05.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.155+0000 7f332e7fc640 1 -- 172.21.15.26:0/1089622927 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33280abe50 con 0x7f33380cf210 2023-10-14T11:15:05.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.155+0000 7f333ee88640 1 -- 172.21.15.26:0/1089622927 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33381f6be0 con 0x7f33380cf210 2023-10-14T11:15:05.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.155+0000 7f332e7fc640 1 -- 172.21.15.26:0/1089622927 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33280b56b0 con 0x7f33380cf210 2023-10-14T11:15:05.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.155+0000 7f333ee88640 1 -- 172.21.15.26:0/1089622927 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33381f6100 con 0x7f33380cf210 2023-10-14T11:15:05.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.155+0000 7f333ee88640 1 -- 172.21.15.26:0/1089622927 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33381f68e0 con 0x7f33380cf210 2023-10-14T11:15:05.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.155+0000 7f332e7fc640 1 -- 172.21.15.26:0/1089622927 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f33280b2040 con 0x7f33380cf210 2023-10-14T11:15:05.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.155+0000 7f332e7fc640 1 --2- 172.21.15.26:0/1089622927 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f331c0664d0 0x7f331c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:05.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.155+0000 7f332e7fc640 1 -- 172.21.15.26:0/1089622927 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f332811dc50 con 0x7f33380cf210 2023-10-14T11:15:05.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.155+0000 7f333de86640 1 --2- 172.21.15.26:0/1089622927 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f331c0664d0 0x7f331c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:05.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.159+0000 7f333de86640 1 --2- 172.21.15.26:0/1089622927 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f331c0664d0 0x7f331c068990 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f33380c9c20 tx=0x7f3334009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:05.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.159+0000 7f332e7fc640 1 -- 172.21.15.26:0/1089622927 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f33280eaff0 con 0x7f33380cf210 2023-10-14T11:15:05.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.315+0000 7f333ee88640 1 -- 172.21.15.26:0/1089622927 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f333804e9c0 con 0x7f33380cf210 2023-10-14T11:15:05.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.315+0000 7f332e7fc640 1 -- 172.21.15.26:0/1089622927 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33280ee610 con 0x7f33380cf210 2023-10-14T11:15:05.324 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:15:05.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.319+0000 7f333ee88640 1 -- 172.21.15.26:0/1089622927 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f331c0664d0 msgr2=0x7f331c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:05.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.319+0000 7f333ee88640 1 --2- 172.21.15.26:0/1089622927 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f331c0664d0 0x7f331c068990 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f33380c9c20 tx=0x7f3334009040 comp rx=0 tx=0).stop 2023-10-14T11:15:05.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.319+0000 7f333ee88640 1 -- 172.21.15.26:0/1089622927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33380cf210 msgr2=0x7f3338158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:05.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.319+0000 7f333ee88640 1 --2- 172.21.15.26:0/1089622927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33380cf210 0x7f3338158650 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f33280097c0 tx=0x7f33280191b0 comp rx=0 tx=0).stop 2023-10-14T11:15:05.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.319+0000 7f333ee88640 1 -- 172.21.15.26:0/1089622927 shutdown_connections 2023-10-14T11:15:05.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.319+0000 7f333ee88640 1 --2- 172.21.15.26:0/1089622927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f333815cdc0 0x7f3338158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:05.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.319+0000 7f333ee88640 1 --2- 172.21.15.26:0/1089622927 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f331c0664d0 0x7f331c068990 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:05.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.319+0000 7f333ee88640 1 --2- 172.21.15.26:0/1089622927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33380cf210 0x7f3338158650 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:05.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.319+0000 7f333ee88640 1 --2- 172.21.15.26:0/1089622927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33380b3cb0 0x7f33380cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:05.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.319+0000 7f333ee88640 1 -- 172.21.15.26:0/1089622927 >> 172.21.15.26:0/1089622927 conn(0x7f33380d2800 msgr2=0x7f33380b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:05.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.319+0000 7f333ee88640 1 -- 172.21.15.26:0/1089622927 shutdown_connections 2023-10-14T11:15:05.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.319+0000 7f333ee88640 1 -- 172.21.15.26:0/1089622927 wait complete. 2023-10-14T11:15:05.345 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_metadata pg_num 2023-10-14T11:15:05.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.487+0000 7f1f86e46640 1 Processor -- start 2023-10-14T11:15:05.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.487+0000 7f1f86e46640 1 -- start start 2023-10-14T11:15:05.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.487+0000 7f1f86e46640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f800ceda0 0x7f1f80167be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:05.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.487+0000 7f1f86e46640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f800cc330 con 0x7f1f8015cc60 2023-10-14T11:15:05.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.487+0000 7f1f86e46640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f800cb4d0 con 0x7f1f800cb040 2023-10-14T11:15:05.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.487+0000 7f1f86e46640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800cb720 con 0x7f1f800ceda0 2023-10-14T11:15:05.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.487+0000 7f1f84be2640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1f8015cc60 0x7f1f80161260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53096/0 (socket says 172.21.15.26:53096) 2023-10-14T11:15:05.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.487+0000 7f1f84be2640 1 -- 172.21.15.26:0/1065997942 learned_addr learned my addr 172.21.15.26:0/1065997942 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:05.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.487+0000 7f1f853e3640 1 --2- 172.21.15.26:0/1065997942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f800ceda0 0x7f1f80167be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:05.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.487+0000 7f1f7f7fe640 1 -- 172.21.15.26:0/1065997942 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862322370 0 0) 0x7f1f800cc330 con 0x7f1f8015cc60 2023-10-14T11:15:05.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.487+0000 7f1f7f7fe640 1 -- 172.21.15.26:0/1065997942 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f70003530 con 0x7f1f8015cc60 2023-10-14T11:15:05.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.487+0000 7f1f7f7fe640 1 -- 172.21.15.26:0/1065997942 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1584174931 0 0) 0x7f1f800cb4d0 con 0x7f1f800cb040 2023-10-14T11:15:05.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.487+0000 7f1f7f7fe640 1 -- 172.21.15.26:0/1065997942 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f800cc330 con 0x7f1f800cb040 2023-10-14T11:15:05.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.487+0000 7f1f853e3640 1 -- 172.21.15.26:0/1065997942 >> v1:172.21.15.110:6789/0 conn(0x7f1f800cb040 legacy=0x7f1f800ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:05.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.487+0000 7f1f853e3640 1 -- 172.21.15.26:0/1065997942 >> v1:172.21.15.26:6789/0 conn(0x7f1f8015cc60 legacy=0x7f1f80161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:05.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.487+0000 7f1f853e3640 1 -- 172.21.15.26:0/1065997942 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f800cba00 con 0x7f1f800ceda0 2023-10-14T11:15:05.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.491+0000 7f1f853e3640 1 --2- 172.21.15.26:0/1065997942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f800ceda0 0x7f1f80167be0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009dc0 tx=0x7f1f7801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb4b8ce26cf243b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:05.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.491+0000 7f1f7f7fe640 1 -- 172.21.15.26:0/1065997942 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f780a5a00 con 0x7f1f800ceda0 2023-10-14T11:15:05.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.491+0000 7f1f7f7fe640 1 -- 172.21.15.26:0/1065997942 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f780a5b60 con 0x7f1f800ceda0 2023-10-14T11:15:05.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.491+0000 7f1f7f7fe640 1 -- 172.21.15.26:0/1065997942 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f780ad440 con 0x7f1f800ceda0 2023-10-14T11:15:05.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.491+0000 7f1f86e46640 1 -- 172.21.15.26:0/1065997942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f800ceda0 msgr2=0x7f1f80167be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:05.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.491+0000 7f1f86e46640 1 --2- 172.21.15.26:0/1065997942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f800ceda0 0x7f1f80167be0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009dc0 tx=0x7f1f7801c940 comp rx=0 tx=0).stop 2023-10-14T11:15:05.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.491+0000 7f1f86e46640 1 -- 172.21.15.26:0/1065997942 shutdown_connections 2023-10-14T11:15:05.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.491+0000 7f1f86e46640 1 --2- 172.21.15.26:0/1065997942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f800ceda0 0x7f1f80167be0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:05.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.491+0000 7f1f86e46640 1 -- 172.21.15.26:0/1065997942 >> 172.21.15.26:0/1065997942 conn(0x7f1f8006e570 msgr2=0x7f1f8006e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:05.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.491+0000 7f1f86e46640 1 -- 172.21.15.26:0/1065997942 shutdown_connections 2023-10-14T11:15:05.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.491+0000 7f1f86e46640 1 -- 172.21.15.26:0/1065997942 wait complete. 2023-10-14T11:15:05.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f86e46640 1 Processor -- start 2023-10-14T11:15:05.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f86e46640 1 -- start start 2023-10-14T11:15:05.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f86e46640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f800cb040 0x7f1f801555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:05.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f86e46640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f800ceda0 0x7f1f80153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:05.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f86e46640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f8015cc60 0x7f1f80153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:05.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f86e46640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f80156ab0 con 0x7f1f800cb040 2023-10-14T11:15:05.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f86e46640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f80156fe0 con 0x7f1f800ceda0 2023-10-14T11:15:05.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f86e46640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f801572c0 con 0x7f1f8015cc60 2023-10-14T11:15:05.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f84be2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f800cb040 0x7f1f801555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:05.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f84be2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f800cb040 0x7f1f801555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34674/0 (socket says 172.21.15.26:34674) 2023-10-14T11:15:05.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f84be2640 1 -- 172.21.15.26:0/3963562974 learned_addr learned my addr 172.21.15.26:0/3963562974 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:05.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f7ffff640 1 --2- 172.21.15.26:0/3963562974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f800ceda0 0x7f1f80153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:05.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f853e3640 1 --2- 172.21.15.26:0/3963562974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f8015cc60 0x7f1f80153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:05.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f84be2640 1 -- 172.21.15.26:0/3963562974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f8015cc60 msgr2=0x7f1f80153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:05.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f84be2640 1 --2- 172.21.15.26:0/3963562974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f8015cc60 0x7f1f80153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:05.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f84be2640 1 -- 172.21.15.26:0/3963562974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f800ceda0 msgr2=0x7f1f80153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:05.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f84be2640 1 --2- 172.21.15.26:0/3963562974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f800ceda0 0x7f1f80153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:05.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f84be2640 1 -- 172.21.15.26:0/3963562974 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f78009a70 con 0x7f1f800cb040 2023-10-14T11:15:05.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f853e3640 1 --2- 172.21.15.26:0/3963562974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f8015cc60 0x7f1f80153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:05.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f84be2640 1 --2- 172.21.15.26:0/3963562974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f800cb040 0x7f1f801555c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1f7400c420 tx=0x7f1f7400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:05.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f7d7fa640 1 -- 172.21.15.26:0/3963562974 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f74005cf0 con 0x7f1f800cb040 2023-10-14T11:15:05.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f7d7fa640 1 -- 172.21.15.26:0/3963562974 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f74005e50 con 0x7f1f800cb040 2023-10-14T11:15:05.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f7d7fa640 1 -- 172.21.15.26:0/3963562974 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f74007310 con 0x7f1f800cb040 2023-10-14T11:15:05.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f86e46640 1 -- 172.21.15.26:0/3963562974 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f801550a0 con 0x7f1f800cb040 2023-10-14T11:15:05.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.495+0000 7f1f86e46640 1 -- 172.21.15.26:0/3963562974 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f80155cd0 con 0x7f1f800cb040 2023-10-14T11:15:05.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.499+0000 7f1f86e46640 1 -- 172.21.15.26:0/3963562974 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f80154ee0 con 0x7f1f800cb040 2023-10-14T11:15:05.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.499+0000 7f1f7d7fa640 1 -- 172.21.15.26:0/3963562974 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1f74007470 con 0x7f1f800cb040 2023-10-14T11:15:05.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.499+0000 7f1f7d7fa640 1 --2- 172.21.15.26:0/3963562974 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1f640664d0 0x7f1f64068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:05.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.499+0000 7f1f7d7fa640 1 -- 172.21.15.26:0/3963562974 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f1f74083300 con 0x7f1f800cb040 2023-10-14T11:15:05.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.499+0000 7f1f7ffff640 1 --2- 172.21.15.26:0/3963562974 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1f640664d0 0x7f1f64068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:05.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.499+0000 7f1f7ffff640 1 --2- 172.21.15.26:0/3963562974 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1f640664d0 0x7f1f64068990 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0011f0 tx=0x7f1f6c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:05.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.503+0000 7f1f7d7fa640 1 -- 172.21.15.26:0/3963562974 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1f74050760 con 0x7f1f800cb040 2023-10-14T11:15:05.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.659+0000 7f1f86e46640 1 -- 172.21.15.26:0/3963562974 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1f80155cd0 con 0x7f1f800cb040 2023-10-14T11:15:05.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.663+0000 7f1f7d7fa640 1 -- 172.21.15.26:0/3963562974 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"}]=0 v55) v1 ==== 109+0+11 (secure 0 0 0) 0x7f1f80155cd0 con 0x7f1f800cb040 2023-10-14T11:15:05.669 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:15:05.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.663+0000 7f1f86e46640 1 -- 172.21.15.26:0/3963562974 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1f640664d0 msgr2=0x7f1f64068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:05.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.663+0000 7f1f86e46640 1 --2- 172.21.15.26:0/3963562974 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1f640664d0 0x7f1f64068990 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0011f0 tx=0x7f1f6c009040 comp rx=0 tx=0).stop 2023-10-14T11:15:05.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.663+0000 7f1f86e46640 1 -- 172.21.15.26:0/3963562974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f800cb040 msgr2=0x7f1f801555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:05.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.663+0000 7f1f86e46640 1 --2- 172.21.15.26:0/3963562974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f800cb040 0x7f1f801555c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1f7400c420 tx=0x7f1f7400c8e0 comp rx=0 tx=0).stop 2023-10-14T11:15:05.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.663+0000 7f1f86e46640 1 -- 172.21.15.26:0/3963562974 shutdown_connections 2023-10-14T11:15:05.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.663+0000 7f1f86e46640 1 --2- 172.21.15.26:0/3963562974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f8015cc60 0x7f1f80153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:05.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.663+0000 7f1f86e46640 1 --2- 172.21.15.26:0/3963562974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f800ceda0 0x7f1f80153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:05.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.663+0000 7f1f86e46640 1 --2- 172.21.15.26:0/3963562974 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1f640664d0 0x7f1f64068990 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:05.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.663+0000 7f1f86e46640 1 --2- 172.21.15.26:0/3963562974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f800cb040 0x7f1f801555c0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:05.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.663+0000 7f1f86e46640 1 -- 172.21.15.26:0/3963562974 >> 172.21.15.26:0/3963562974 conn(0x7f1f8006e570 msgr2=0x7f1f80158170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:05.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.663+0000 7f1f86e46640 1 -- 172.21.15.26:0/3963562974 shutdown_connections 2023-10-14T11:15:05.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.663+0000 7f1f86e46640 1 -- 172.21.15.26:0/3963562974 wait complete. 2023-10-14T11:15:05.689 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_data pg_num 2023-10-14T11:15:05.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.827+0000 7f27eef65640 1 Processor -- start 2023-10-14T11:15:05.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.827+0000 7f27eef65640 1 -- start start 2023-10-14T11:15:05.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.831+0000 7f27eef65640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f27e815cba0 0x7f27e80d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:05.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.831+0000 7f27eef65640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27e80d0210 0x7f27e80b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:05.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.831+0000 7f27eef65640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e80d1670 con 0x7f27e80b84e0 2023-10-14T11:15:05.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.831+0000 7f27eef65640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e80d1460 con 0x7f27e815cba0 2023-10-14T11:15:05.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.831+0000 7f27eef65640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e80d1950 con 0x7f27e80d0210 2023-10-14T11:15:05.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.831+0000 7f27ecd01640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f27e815cba0 0x7f27e80d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:05.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.831+0000 7f27ed502640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27e80d0210 0x7f27e80b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:05.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.831+0000 7f27e7fff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f27e80b84e0 0x7f27e80cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:44490/0 (socket says 172.21.15.26:44490) 2023-10-14T11:15:05.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.831+0000 7f27e7fff640 1 -- 172.21.15.26:0/2002496140 learned_addr learned my addr 172.21.15.26:0/2002496140 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:05.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.831+0000 7f27e77fe640 1 -- 172.21.15.26:0/2002496140 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4244139151 0 0) 0x7f27e80d1670 con 0x7f27e80b84e0 2023-10-14T11:15:05.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.831+0000 7f27ed502640 1 -- 172.21.15.26:0/2002496140 >> v2:172.21.15.110:3300/0 conn(0x7f27e815cba0 msgr2=0x7f27e80d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:05.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.831+0000 7f27ed502640 1 --2- 172.21.15.26:0/2002496140 >> v2:172.21.15.110:3300/0 conn(0x7f27e815cba0 0x7f27e80d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:05.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.831+0000 7f27ed502640 1 -- 172.21.15.26:0/2002496140 >> v1:172.21.15.110:6789/0 conn(0x7f27e80b84e0 legacy=0x7f27e80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:05.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.831+0000 7f27ed502640 1 -- 172.21.15.26:0/2002496140 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e80d1c30 con 0x7f27e80d0210 2023-10-14T11:15:05.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.835+0000 7f27ed502640 1 --2- 172.21.15.26:0/2002496140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27e80d0210 0x7f27e80b5cf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009d90 tx=0x7f27e001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0e3bf39acb275c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:05.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.835+0000 7f27e77fe640 1 -- 172.21.15.26:0/2002496140 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e00a5a10 con 0x7f27e80d0210 2023-10-14T11:15:05.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.835+0000 7f27e77fe640 1 -- 172.21.15.26:0/2002496140 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e00a5b70 con 0x7f27e80d0210 2023-10-14T11:15:05.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.835+0000 7f27e77fe640 1 -- 172.21.15.26:0/2002496140 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e00ad440 con 0x7f27e80d0210 2023-10-14T11:15:05.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.835+0000 7f27eef65640 1 -- 172.21.15.26:0/2002496140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27e80d0210 msgr2=0x7f27e80b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:05.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.835+0000 7f27eef65640 1 --2- 172.21.15.26:0/2002496140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27e80d0210 0x7f27e80b5cf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009d90 tx=0x7f27e001c950 comp rx=0 tx=0).stop 2023-10-14T11:15:05.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.835+0000 7f27eef65640 1 -- 172.21.15.26:0/2002496140 shutdown_connections 2023-10-14T11:15:05.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.835+0000 7f27eef65640 1 --2- 172.21.15.26:0/2002496140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27e80d0210 0x7f27e80b5cf0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:05.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.835+0000 7f27eef65640 1 --2- 172.21.15.26:0/2002496140 >> v2:172.21.15.110:3300/0 conn(0x7f27e815cba0 0x7f27e80d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:05.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.835+0000 7f27eef65640 1 -- 172.21.15.26:0/2002496140 >> 172.21.15.26:0/2002496140 conn(0x7f27e80719c0 msgr2=0x7f27e8071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:05.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.835+0000 7f27eef65640 1 -- 172.21.15.26:0/2002496140 shutdown_connections 2023-10-14T11:15:05.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.835+0000 7f27eef65640 1 -- 172.21.15.26:0/2002496140 wait complete. 2023-10-14T11:15:05.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.835+0000 7f27eef65640 1 Processor -- start 2023-10-14T11:15:05.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.835+0000 7f27eef65640 1 -- start start 2023-10-14T11:15:05.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27eef65640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27e80b84e0 0x7f27e815fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:05.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27eef65640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27e80d0210 0x7f27e815ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:05.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27eef65640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27e815cba0 0x7f27e80cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:05.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27eef65640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e80cc510 con 0x7f27e80d0210 2023-10-14T11:15:05.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27eef65640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e80cc230 con 0x7f27e815cba0 2023-10-14T11:15:05.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27eef65640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e815e290 con 0x7f27e80b84e0 2023-10-14T11:15:05.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27e7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27e80d0210 0x7f27e815ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:05.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27e7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27e80d0210 0x7f27e815ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34686/0 (socket says 172.21.15.26:34686) 2023-10-14T11:15:05.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27e7fff640 1 -- 172.21.15.26:0/507109316 learned_addr learned my addr 172.21.15.26:0/507109316 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:05.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27ecd01640 1 --2- 172.21.15.26:0/507109316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27e80b84e0 0x7f27e815fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:05.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27ed502640 1 --2- 172.21.15.26:0/507109316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27e815cba0 0x7f27e80cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:05.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27e7fff640 1 -- 172.21.15.26:0/507109316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27e80b84e0 msgr2=0x7f27e815fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:05.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27e7fff640 1 --2- 172.21.15.26:0/507109316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27e80b84e0 0x7f27e815fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:05.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27e7fff640 1 -- 172.21.15.26:0/507109316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27e815cba0 msgr2=0x7f27e80cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:05.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27e7fff640 1 --2- 172.21.15.26:0/507109316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27e815cba0 0x7f27e80cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:05.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27e7fff640 1 -- 172.21.15.26:0/507109316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e0009a70 con 0x7f27e80d0210 2023-10-14T11:15:05.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27e7fff640 1 --2- 172.21.15.26:0/507109316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27e80d0210 0x7f27e815ed70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f27d400c480 tx=0x7f27d400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:05.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27e57fa640 1 -- 172.21.15.26:0/507109316 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d40074e0 con 0x7f27e80d0210 2023-10-14T11:15:05.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27e57fa640 1 -- 172.21.15.26:0/507109316 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d4007660 con 0x7f27e80d0210 2023-10-14T11:15:05.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27eef65640 1 -- 172.21.15.26:0/507109316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e815e570 con 0x7f27e80d0210 2023-10-14T11:15:05.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27e57fa640 1 -- 172.21.15.26:0/507109316 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d4004a30 con 0x7f27e80d0210 2023-10-14T11:15:05.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27eef65640 1 -- 172.21.15.26:0/507109316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e81546f0 con 0x7f27e80d0210 2023-10-14T11:15:05.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.839+0000 7f27eef65640 1 -- 172.21.15.26:0/507109316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e804e170 con 0x7f27e80d0210 2023-10-14T11:15:05.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.843+0000 7f27e57fa640 1 -- 172.21.15.26:0/507109316 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f27d4004b90 con 0x7f27e80d0210 2023-10-14T11:15:05.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.843+0000 7f27e57fa640 1 --2- 172.21.15.26:0/507109316 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27cc0664a0 0x7f27cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:05.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.843+0000 7f27e57fa640 1 -- 172.21.15.26:0/507109316 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f27d4083420 con 0x7f27e80d0210 2023-10-14T11:15:05.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.843+0000 7f27ecd01640 1 --2- 172.21.15.26:0/507109316 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27cc0664a0 0x7f27cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:05.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.843+0000 7f27ecd01640 1 --2- 172.21.15.26:0/507109316 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27cc0664a0 0x7f27cc068960 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009b60 tx=0x7f27dc009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:05.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:05.847+0000 7f27e57fa640 1 -- 172.21.15.26:0/507109316 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f27d4050880 con 0x7f27e80d0210 2023-10-14T11:15:06.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.003+0000 7f27eef65640 1 -- 172.21.15.26:0/507109316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"} v 0) v1 -- 0x7f27e8072120 con 0x7f27e80d0210 2023-10-14T11:15:06.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.003+0000 7f27e57fa640 1 -- 172.21.15.26:0/507109316 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"}]=0 v55) v1 ==== 105+0+11 (secure 0 0 0) 0x7f27d4053ea0 con 0x7f27e80d0210 2023-10-14T11:15:06.011 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:15:06.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.007+0000 7f27eef65640 1 -- 172.21.15.26:0/507109316 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27cc0664a0 msgr2=0x7f27cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:06.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.007+0000 7f27eef65640 1 --2- 172.21.15.26:0/507109316 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27cc0664a0 0x7f27cc068960 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009b60 tx=0x7f27dc009190 comp rx=0 tx=0).stop 2023-10-14T11:15:06.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.007+0000 7f27eef65640 1 -- 172.21.15.26:0/507109316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27e80d0210 msgr2=0x7f27e815ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:06.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.007+0000 7f27eef65640 1 --2- 172.21.15.26:0/507109316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27e80d0210 0x7f27e815ed70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f27d400c480 tx=0x7f27d400c940 comp rx=0 tx=0).stop 2023-10-14T11:15:06.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.007+0000 7f27eef65640 1 -- 172.21.15.26:0/507109316 shutdown_connections 2023-10-14T11:15:06.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.007+0000 7f27eef65640 1 --2- 172.21.15.26:0/507109316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27e815cba0 0x7f27e80cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.007+0000 7f27eef65640 1 --2- 172.21.15.26:0/507109316 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f27cc0664a0 0x7f27cc068960 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.007+0000 7f27eef65640 1 --2- 172.21.15.26:0/507109316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27e80d0210 0x7f27e815ed70 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.007+0000 7f27eef65640 1 --2- 172.21.15.26:0/507109316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27e80b84e0 0x7f27e815fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.007+0000 7f27eef65640 1 -- 172.21.15.26:0/507109316 >> 172.21.15.26:0/507109316 conn(0x7f27e80719c0 msgr2=0x7f27e806b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:06.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.007+0000 7f27eef65640 1 -- 172.21.15.26:0/507109316 shutdown_connections 2023-10-14T11:15:06.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.007+0000 7f27eef65640 1 -- 172.21.15.26:0/507109316 wait complete. 2023-10-14T11:15:06.032 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:15:06.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.171+0000 7fe06b5d9640 1 Processor -- start 2023-10-14T11:15:06.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.171+0000 7fe06b5d9640 1 -- start start 2023-10-14T11:15:06.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.171+0000 7fe06b5d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0641591e0 0x7fe0640c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:06.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.171+0000 7fe06b5d9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe0640ca430 0x7fe064071c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:06.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.171+0000 7fe06b5d9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe064071020 con 0x7fe0640721b0 2023-10-14T11:15:06.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.171+0000 7fe06b5d9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0640c8e50 con 0x7fe0640ca430 2023-10-14T11:15:06.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.171+0000 7fe06b5d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0640c9130 con 0x7fe0641591e0 2023-10-14T11:15:06.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.171+0000 7fe068b74640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe0640ca430 0x7fe064071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:06.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.171+0000 7fe068b74640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe0640ca430 0x7fe064071c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34688/0 (socket says 172.21.15.26:34688) 2023-10-14T11:15:06.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.171+0000 7fe068b74640 1 -- 172.21.15.26:0/494173934 learned_addr learned my addr 172.21.15.26:0/494173934 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:06.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.171+0000 7fe069375640 1 --2- 172.21.15.26:0/494173934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0641591e0 0x7fe0640c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:06.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.171+0000 7fe068b74640 1 -- 172.21.15.26:0/494173934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0641591e0 msgr2=0x7fe0640c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:06.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.171+0000 7fe068b74640 1 --2- 172.21.15.26:0/494173934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0641591e0 0x7fe0640c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.171+0000 7fe068b74640 1 -- 172.21.15.26:0/494173934 >> v1:172.21.15.110:6789/0 conn(0x7fe0640721b0 legacy=0x7fe0640b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:06.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.171+0000 7fe068b74640 1 -- 172.21.15.26:0/494173934 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0640c9410 con 0x7fe0640ca430 2023-10-14T11:15:06.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.175+0000 7fe068b74640 1 --2- 172.21.15.26:0/494173934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0640ca430 0x7fe064071c70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe05400bb10 tx=0x7fe05401ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7666c0fcce7701d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:06.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.175+0000 7fe05bfff640 1 -- 172.21.15.26:0/494173934 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0540a7bd0 con 0x7fe0640ca430 2023-10-14T11:15:06.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.175+0000 7fe05bfff640 1 -- 172.21.15.26:0/494173934 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0540a7d30 con 0x7fe0640ca430 2023-10-14T11:15:06.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.175+0000 7fe05bfff640 1 -- 172.21.15.26:0/494173934 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0540a7ea0 con 0x7fe0640ca430 2023-10-14T11:15:06.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.175+0000 7fe06b5d9640 1 -- 172.21.15.26:0/494173934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0640ca430 msgr2=0x7fe064071c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:06.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.175+0000 7fe06b5d9640 1 --2- 172.21.15.26:0/494173934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0640ca430 0x7fe064071c70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe05400bb10 tx=0x7fe05401ec10 comp rx=0 tx=0).stop 2023-10-14T11:15:06.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.175+0000 7fe06b5d9640 1 -- 172.21.15.26:0/494173934 shutdown_connections 2023-10-14T11:15:06.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.175+0000 7fe06b5d9640 1 --2- 172.21.15.26:0/494173934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0640ca430 0x7fe064071c70 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.175+0000 7fe06b5d9640 1 --2- 172.21.15.26:0/494173934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0641591e0 0x7fe0640c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.175+0000 7fe06b5d9640 1 -- 172.21.15.26:0/494173934 >> 172.21.15.26:0/494173934 conn(0x7fe06406c190 msgr2=0x7fe06406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:06.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.175+0000 7fe06b5d9640 1 -- 172.21.15.26:0/494173934 shutdown_connections 2023-10-14T11:15:06.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.175+0000 7fe06b5d9640 1 -- 172.21.15.26:0/494173934 wait complete. 2023-10-14T11:15:06.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe06b5d9640 1 Processor -- start 2023-10-14T11:15:06.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe06b5d9640 1 -- start start 2023-10-14T11:15:06.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe06b5d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0640721b0 0x7fe0640cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:06.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe06b5d9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0640ca430 0x7fe064151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:06.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe06b5d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0641591e0 0x7fe0640c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:06.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe06b5d9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0640c42b0 con 0x7fe0640ca430 2023-10-14T11:15:06.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe06b5d9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe064152060 con 0x7fe0640721b0 2023-10-14T11:15:06.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe06b5d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe06415aaa0 con 0x7fe0641591e0 2023-10-14T11:15:06.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe068b74640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0640ca430 0x7fe064151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:06.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe068b74640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0640ca430 0x7fe064151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34702/0 (socket says 172.21.15.26:34702) 2023-10-14T11:15:06.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe068b74640 1 -- 172.21.15.26:0/3956589321 learned_addr learned my addr 172.21.15.26:0/3956589321 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:06.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe069375640 1 --2- 172.21.15.26:0/3956589321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0640721b0 0x7fe0640cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:06.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe069b76640 1 --2- 172.21.15.26:0/3956589321 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0641591e0 0x7fe0640c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:06.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe068b74640 1 -- 172.21.15.26:0/3956589321 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0641591e0 msgr2=0x7fe0640c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:06.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe068b74640 1 --2- 172.21.15.26:0/3956589321 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0641591e0 0x7fe0640c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe068b74640 1 -- 172.21.15.26:0/3956589321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0640721b0 msgr2=0x7fe0640cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:06.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe068b74640 1 --2- 172.21.15.26:0/3956589321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0640721b0 0x7fe0640cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe068b74640 1 -- 172.21.15.26:0/3956589321 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05400b770 con 0x7fe0640ca430 2023-10-14T11:15:06.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe068b74640 1 --2- 172.21.15.26:0/3956589321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0640ca430 0x7fe064151b20 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe05400b2c0 tx=0x7fe05401b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:06.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe059ffb640 1 -- 172.21.15.26:0/3956589321 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0540bd070 con 0x7fe0640ca430 2023-10-14T11:15:06.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe059ffb640 1 -- 172.21.15.26:0/3956589321 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0540b9400 con 0x7fe0640ca430 2023-10-14T11:15:06.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe06b5d9640 1 -- 172.21.15.26:0/3956589321 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe06415c040 con 0x7fe0640ca430 2023-10-14T11:15:06.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe059ffb640 1 -- 172.21.15.26:0/3956589321 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0540a7ea0 con 0x7fe0640ca430 2023-10-14T11:15:06.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.179+0000 7fe06b5d9640 1 -- 172.21.15.26:0/3956589321 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0641528f0 con 0x7fe0640ca430 2023-10-14T11:15:06.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.183+0000 7fe06b5d9640 1 -- 172.21.15.26:0/3956589321 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0640c43f0 con 0x7fe0640ca430 2023-10-14T11:15:06.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.183+0000 7fe059ffb640 1 -- 172.21.15.26:0/3956589321 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe0540c2410 con 0x7fe0640ca430 2023-10-14T11:15:06.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.183+0000 7fe059ffb640 1 --2- 172.21.15.26:0/3956589321 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe0480664a0 0x7fe048068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:06.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.183+0000 7fe059ffb640 1 -- 172.21.15.26:0/3956589321 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fe05411eaa0 con 0x7fe0640ca430 2023-10-14T11:15:06.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.183+0000 7fe069375640 1 --2- 172.21.15.26:0/3956589321 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe0480664a0 0x7fe048068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:06.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.183+0000 7fe069375640 1 --2- 172.21.15.26:0/3956589321 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe0480664a0 0x7fe048068960 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe060009ac0 tx=0x7fe060009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:06.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.187+0000 7fe059ffb640 1 -- 172.21.15.26:0/3956589321 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe0640c43f0 con 0x7fe0640ca430 2023-10-14T11:15:06.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.355+0000 7fe06b5d9640 1 -- 172.21.15.26:0/3956589321 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe0640c43f0 con 0x7fe0640ca430 2023-10-14T11:15:06.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.355+0000 7fe059ffb640 1 -- 172.21.15.26:0/3956589321 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v55) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe0640c43f0 con 0x7fe0640ca430 2023-10-14T11:15:06.363 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-10-14T11:15:06.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.359+0000 7fe06b5d9640 1 -- 172.21.15.26:0/3956589321 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe0480664a0 msgr2=0x7fe048068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:06.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.359+0000 7fe06b5d9640 1 --2- 172.21.15.26:0/3956589321 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe0480664a0 0x7fe048068960 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe060009ac0 tx=0x7fe060009190 comp rx=0 tx=0).stop 2023-10-14T11:15:06.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.359+0000 7fe06b5d9640 1 -- 172.21.15.26:0/3956589321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0640ca430 msgr2=0x7fe064151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:06.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.359+0000 7fe06b5d9640 1 --2- 172.21.15.26:0/3956589321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0640ca430 0x7fe064151b20 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe05400b2c0 tx=0x7fe05401b9b0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.359+0000 7fe06b5d9640 1 -- 172.21.15.26:0/3956589321 shutdown_connections 2023-10-14T11:15:06.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.359+0000 7fe06b5d9640 1 --2- 172.21.15.26:0/3956589321 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0641591e0 0x7fe0640c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.359+0000 7fe06b5d9640 1 --2- 172.21.15.26:0/3956589321 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe0480664a0 0x7fe048068960 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.359+0000 7fe06b5d9640 1 --2- 172.21.15.26:0/3956589321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0640ca430 0x7fe064151b20 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.359+0000 7fe06b5d9640 1 --2- 172.21.15.26:0/3956589321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0640721b0 0x7fe0640cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.359+0000 7fe06b5d9640 1 -- 172.21.15.26:0/3956589321 >> 172.21.15.26:0/3956589321 conn(0x7fe06406c190 msgr2=0x7fe064154730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.359+0000 7fe06b5d9640 1 -- 172.21.15.26:0/3956589321 shutdown_connections 2023-10-14T11:15:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.359+0000 7fe06b5d9640 1 -- 172.21.15.26:0/3956589321 wait complete. 2023-10-14T11:15:06.384 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:15:06.385 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:15:06.395 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:15:06.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.575+0000 7fe6009c5640 1 Processor -- start 2023-10-14T11:15:06.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.575+0000 7fe6009c5640 1 -- start start 2023-10-14T11:15:06.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.575+0000 7fe6009c5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe5fc1597c0 0x7fe5fc0ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:06.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.575+0000 7fe6009c5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5fc159ba0 0x7fe5fc0cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:06.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.575+0000 7fe6009c5640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5fc0723d0 con 0x7fe5fc0adc10 2023-10-14T11:15:06.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.575+0000 7fe6009c5640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5fc0717c0 con 0x7fe5fc1597c0 2023-10-14T11:15:06.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.575+0000 7fe6009c5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc071aa0 con 0x7fe5fc159ba0 2023-10-14T11:15:06.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.575+0000 7fe5fa59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe5fc1597c0 0x7fe5fc0ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:06.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.575+0000 7fe5fa59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe5fc1597c0 0x7fe5fc0ad6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34716/0 (socket says 172.21.15.26:34716) 2023-10-14T11:15:06.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.575+0000 7fe5fa59c640 1 -- 172.21.15.26:0/2027615449 learned_addr learned my addr 172.21.15.26:0/2027615449 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:06.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.575+0000 7fe5fad9d640 1 --1- 172.21.15.26:0/2027615449 >> v1:172.21.15.26:6789/0 conn(0x7fe5fc0adc10 0x7fe5fc0cb350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53104/0 (socket says 172.21.15.26:53104) 2023-10-14T11:15:06.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.575+0000 7fe5f3fff640 1 --2- 172.21.15.26:0/2027615449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5fc159ba0 0x7fe5fc0cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:06.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.579+0000 7fe5fa59c640 1 -- 172.21.15.26:0/2027615449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5fc159ba0 msgr2=0x7fe5fc0cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:06.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.579+0000 7fe5fa59c640 1 --2- 172.21.15.26:0/2027615449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5fc159ba0 0x7fe5fc0cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.579+0000 7fe5fa59c640 1 -- 172.21.15.26:0/2027615449 >> v1:172.21.15.26:6789/0 conn(0x7fe5fc0adc10 legacy=0x7fe5fc0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:06.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.579+0000 7fe5fa59c640 1 -- 172.21.15.26:0/2027615449 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc071d80 con 0x7fe5fc1597c0 2023-10-14T11:15:06.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.579+0000 7fe5fa59c640 1 --2- 172.21.15.26:0/2027615449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5fc1597c0 0x7fe5fc0ad6d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec009870 tx=0x7fe5ec01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a968650763ec42a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:06.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.579+0000 7fe5f9d9b640 1 -- 172.21.15.26:0/2027615449 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0aa640 con 0x7fe5fc1597c0 2023-10-14T11:15:06.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.579+0000 7fe5f9d9b640 1 -- 172.21.15.26:0/2027615449 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec0aa7a0 con 0x7fe5fc1597c0 2023-10-14T11:15:06.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.579+0000 7fe5f9d9b640 1 -- 172.21.15.26:0/2027615449 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0aab30 con 0x7fe5fc1597c0 2023-10-14T11:15:06.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.579+0000 7fe6009c5640 1 -- 172.21.15.26:0/2027615449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5fc1597c0 msgr2=0x7fe5fc0ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:06.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.579+0000 7fe6009c5640 1 --2- 172.21.15.26:0/2027615449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5fc1597c0 0x7fe5fc0ad6d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec009870 tx=0x7fe5ec01c540 comp rx=0 tx=0).stop 2023-10-14T11:15:06.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.579+0000 7fe6009c5640 1 -- 172.21.15.26:0/2027615449 shutdown_connections 2023-10-14T11:15:06.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.579+0000 7fe6009c5640 1 --2- 172.21.15.26:0/2027615449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5fc159ba0 0x7fe5fc0cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.579+0000 7fe6009c5640 1 --2- 172.21.15.26:0/2027615449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5fc1597c0 0x7fe5fc0ad6d0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.579+0000 7fe6009c5640 1 -- 172.21.15.26:0/2027615449 >> 172.21.15.26:0/2027615449 conn(0x7fe5fc06c190 msgr2=0x7fe5fc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:06.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.579+0000 7fe6009c5640 1 -- 172.21.15.26:0/2027615449 shutdown_connections 2023-10-14T11:15:06.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.579+0000 7fe6009c5640 1 -- 172.21.15.26:0/2027615449 wait complete. 2023-10-14T11:15:06.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.583+0000 7fe6009c5640 1 Processor -- start 2023-10-14T11:15:06.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.583+0000 7fe6009c5640 1 -- start start 2023-10-14T11:15:06.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.583+0000 7fe6009c5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5fc0adc10 0x7fe5fc0ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:06.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.583+0000 7fe6009c5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5fc1597c0 0x7fe5fc0c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:06.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.583+0000 7fe6009c5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5fc159ba0 0x7fe5fc0b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:06.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.583+0000 7fe6009c5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0b2b60 con 0x7fe5fc0adc10 2023-10-14T11:15:06.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.583+0000 7fe6009c5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0b3ec0 con 0x7fe5fc159ba0 2023-10-14T11:15:06.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.583+0000 7fe6009c5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0b1ee0 con 0x7fe5fc1597c0 2023-10-14T11:15:06.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.583+0000 7fe5fa59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5fc0adc10 0x7fe5fc0ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:06.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.583+0000 7fe5fa59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5fc0adc10 0x7fe5fc0ae990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34732/0 (socket says 172.21.15.26:34732) 2023-10-14T11:15:06.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.583+0000 7fe5fa59c640 1 -- 172.21.15.26:0/2781403924 learned_addr learned my addr 172.21.15.26:0/2781403924 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:06.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.583+0000 7fe5f3fff640 1 --2- 172.21.15.26:0/2781403924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5fc1597c0 0x7fe5fc0c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:06.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.583+0000 7fe5fad9d640 1 --2- 172.21.15.26:0/2781403924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5fc159ba0 0x7fe5fc0b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:06.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.583+0000 7fe5fa59c640 1 -- 172.21.15.26:0/2781403924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5fc1597c0 msgr2=0x7fe5fc0c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:06.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.583+0000 7fe5fa59c640 1 --2- 172.21.15.26:0/2781403924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5fc1597c0 0x7fe5fc0c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.583+0000 7fe5fa59c640 1 -- 172.21.15.26:0/2781403924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5fc159ba0 msgr2=0x7fe5fc0b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:06.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.583+0000 7fe5fa59c640 1 --2- 172.21.15.26:0/2781403924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5fc159ba0 0x7fe5fc0b2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.583+0000 7fe5fa59c640 1 -- 172.21.15.26:0/2781403924 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec0094d0 con 0x7fe5fc0adc10 2023-10-14T11:15:06.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.583+0000 7fe5fa59c640 1 --2- 172.21.15.26:0/2781403924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5fc0adc10 0x7fe5fc0ae990 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0ac040 tx=0x7fe5ec01ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:06.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.583+0000 7fe5f2ffd640 1 -- 172.21.15.26:0/2781403924 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0bd5f0 con 0x7fe5fc0adc10 2023-10-14T11:15:06.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.583+0000 7fe5f2ffd640 1 -- 172.21.15.26:0/2781403924 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec0bd770 con 0x7fe5fc0adc10 2023-10-14T11:15:06.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.583+0000 7fe6009c5640 1 -- 172.21.15.26:0/2781403924 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5fc0b21c0 con 0x7fe5fc0adc10 2023-10-14T11:15:06.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.587+0000 7fe5f2ffd640 1 -- 172.21.15.26:0/2781403924 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0bdb20 con 0x7fe5fc0adc10 2023-10-14T11:15:06.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.587+0000 7fe6009c5640 1 -- 172.21.15.26:0/2781403924 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5fc0b2780 con 0x7fe5fc0adc10 2023-10-14T11:15:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.587+0000 7fe6009c5640 1 -- 172.21.15.26:0/2781403924 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5fc0b2ca0 con 0x7fe5fc0adc10 2023-10-14T11:15:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.587+0000 7fe5f2ffd640 1 -- 172.21.15.26:0/2781403924 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe5ec0a8050 con 0x7fe5fc0adc10 2023-10-14T11:15:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.587+0000 7fe5f2ffd640 1 --2- 172.21.15.26:0/2781403924 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe5dc0664a0 0x7fe5dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.587+0000 7fe5f2ffd640 1 -- 172.21.15.26:0/2781403924 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fe5ec11ebd0 con 0x7fe5fc0adc10 2023-10-14T11:15:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.587+0000 7fe5f3fff640 1 --2- 172.21.15.26:0/2781403924 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe5dc0664a0 0x7fe5dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:06.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.587+0000 7fe5f3fff640 1 --2- 172.21.15.26:0/2781403924 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe5dc0664a0 0x7fe5dc068960 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc164560 tx=0x7fe5e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:06.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.591+0000 7fe5f2ffd640 1 -- 172.21.15.26:0/2781403924 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe5ec0ec0a0 con 0x7fe5fc0adc10 2023-10-14T11:15:06.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.751+0000 7fe6009c5640 1 -- 172.21.15.26:0/2781403924 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5fc074010 con 0x7fe5fc0adc10 2023-10-14T11:15:06.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.755+0000 7fe5f2ffd640 1 -- 172.21.15.26:0/2781403924 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16790 (secure 0 0 0) 0x7fe5ec0ef6c0 con 0x7fe5fc0adc10 2023-10-14T11:15:06.760 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:15:06.760 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":55,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:14:51.591742+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:14:47.752880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:14:48.971211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:15:06.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.755+0000 7fe6009c5640 1 -- 172.21.15.26:0/2781403924 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe5dc0664a0 msgr2=0x7fe5dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:06.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.755+0000 7fe6009c5640 1 --2- 172.21.15.26:0/2781403924 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe5dc0664a0 0x7fe5dc068960 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc164560 tx=0x7fe5e4008040 comp rx=0 tx=0).stop 2023-10-14T11:15:06.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.755+0000 7fe6009c5640 1 -- 172.21.15.26:0/2781403924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5fc0adc10 msgr2=0x7fe5fc0ae990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:06.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.755+0000 7fe6009c5640 1 --2- 172.21.15.26:0/2781403924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5fc0adc10 0x7fe5fc0ae990 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0ac040 tx=0x7fe5ec01ad80 comp rx=0 tx=0).stop 2023-10-14T11:15:06.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.755+0000 7fe6009c5640 1 -- 172.21.15.26:0/2781403924 shutdown_connections 2023-10-14T11:15:06.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.755+0000 7fe6009c5640 1 --2- 172.21.15.26:0/2781403924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5fc159ba0 0x7fe5fc0b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.755+0000 7fe6009c5640 1 --2- 172.21.15.26:0/2781403924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5fc1597c0 0x7fe5fc0c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.755+0000 7fe6009c5640 1 --2- 172.21.15.26:0/2781403924 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe5dc0664a0 0x7fe5dc068960 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.755+0000 7fe6009c5640 1 --2- 172.21.15.26:0/2781403924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5fc0adc10 0x7fe5fc0ae990 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.755+0000 7fe6009c5640 1 -- 172.21.15.26:0/2781403924 >> 172.21.15.26:0/2781403924 conn(0x7fe5fc06c190 msgr2=0x7fe5fc0cb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:06.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.755+0000 7fe6009c5640 1 -- 172.21.15.26:0/2781403924 shutdown_connections 2023-10-14T11:15:06.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.755+0000 7fe6009c5640 1 -- 172.21.15.26:0/2781403924 wait complete. 2023-10-14T11:15:06.781 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'testcephfs1_metadata', 'create_time': '2023-10-14T11:14:47.752880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'testcephfs1_data', 'create_time': '2023-10-14T11:14:48.971211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:15:06.782 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:15:06.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.927+0000 7fe158b9d640 1 Processor -- start 2023-10-14T11:15:06.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.927+0000 7fe158b9d640 1 -- start start 2023-10-14T11:15:06.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.927+0000 7fe158b9d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe15415cc60 0x7fe1540cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:06.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.927+0000 7fe158b9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe154161260 0x7fe1540ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:06.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.927+0000 7fe158b9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1540cebd0 0x7fe1540b2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:06.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.927+0000 7fe158b9d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1540cf020 con 0x7fe154161260 2023-10-14T11:15:06.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.927+0000 7fe158b9d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1540cc330 con 0x7fe15415cc60 2023-10-14T11:15:06.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.927+0000 7fe158b9d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1540cb720 con 0x7fe1540cebd0 2023-10-14T11:15:06.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.927+0000 7fe151d9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe154161260 0x7fe1540ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:06.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.927+0000 7fe151d9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe154161260 0x7fe1540ce690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34740/0 (socket says 172.21.15.26:34740) 2023-10-14T11:15:06.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.927+0000 7fe151d9b640 1 -- 172.21.15.26:0/1849207925 learned_addr learned my addr 172.21.15.26:0/1849207925 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:06.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.927+0000 7fe151d9b640 1 -- 172.21.15.26:0/1849207925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1540cebd0 msgr2=0x7fe1540b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:06.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.927+0000 7fe151d9b640 1 --2- 172.21.15.26:0/1849207925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1540cebd0 0x7fe1540b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.927+0000 7fe151d9b640 1 -- 172.21.15.26:0/1849207925 >> v2:172.21.15.110:3300/0 conn(0x7fe15415cc60 msgr2=0x7fe1540cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:06.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.927+0000 7fe151d9b640 1 --2- 172.21.15.26:0/1849207925 >> v2:172.21.15.110:3300/0 conn(0x7fe15415cc60 0x7fe1540cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.927+0000 7fe151d9b640 1 -- 172.21.15.26:0/1849207925 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1540cba00 con 0x7fe154161260 2023-10-14T11:15:06.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.931+0000 7fe151d9b640 1 --2- 172.21.15.26:0/1849207925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe154161260 0x7fe1540ce690 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe1540d0810 tx=0x7fe14801c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d938937dbdd78bba server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:06.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.931+0000 7fe15159a640 1 -- 172.21.15.26:0/1849207925 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1480ab600 con 0x7fe154161260 2023-10-14T11:15:06.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.931+0000 7fe15159a640 1 -- 172.21.15.26:0/1849207925 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1480a7050 con 0x7fe154161260 2023-10-14T11:15:06.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.931+0000 7fe15159a640 1 -- 172.21.15.26:0/1849207925 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1480ab980 con 0x7fe154161260 2023-10-14T11:15:06.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.931+0000 7fe158b9d640 1 -- 172.21.15.26:0/1849207925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe154161260 msgr2=0x7fe1540ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:06.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.931+0000 7fe158b9d640 1 --2- 172.21.15.26:0/1849207925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe154161260 0x7fe1540ce690 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe1540d0810 tx=0x7fe14801c210 comp rx=0 tx=0).stop 2023-10-14T11:15:06.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.931+0000 7fe158b9d640 1 -- 172.21.15.26:0/1849207925 shutdown_connections 2023-10-14T11:15:06.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.931+0000 7fe158b9d640 1 --2- 172.21.15.26:0/1849207925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1540cebd0 0x7fe1540b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.931+0000 7fe158b9d640 1 --2- 172.21.15.26:0/1849207925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe154161260 0x7fe1540ce690 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.931+0000 7fe158b9d640 1 --2- 172.21.15.26:0/1849207925 >> v2:172.21.15.110:3300/0 conn(0x7fe15415cc60 0x7fe1540cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.931+0000 7fe158b9d640 1 -- 172.21.15.26:0/1849207925 >> 172.21.15.26:0/1849207925 conn(0x7fe15406e570 msgr2=0x7fe15406e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:06.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.931+0000 7fe158b9d640 1 -- 172.21.15.26:0/1849207925 shutdown_connections 2023-10-14T11:15:06.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.931+0000 7fe158b9d640 1 -- 172.21.15.26:0/1849207925 wait complete. 2023-10-14T11:15:06.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe158b9d640 1 Processor -- start 2023-10-14T11:15:06.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe158b9d640 1 -- start start 2023-10-14T11:15:06.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe158b9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1540cebd0 0x7fe1540c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:06.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe158b9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe15415cc60 0x7fe1540b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:06.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe158b9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe154161260 0x7fe1540c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:06.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe158b9d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1540c4200 con 0x7fe15415cc60 2023-10-14T11:15:06.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe158b9d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1540c7270 con 0x7fe154161260 2023-10-14T11:15:06.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe158b9d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1540b3630 con 0x7fe1540cebd0 2023-10-14T11:15:06.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe151d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe15415cc60 0x7fe1540b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:06.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe151d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe15415cc60 0x7fe1540b0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34752/0 (socket says 172.21.15.26:34752) 2023-10-14T11:15:06.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe151d9b640 1 -- 172.21.15.26:0/2457147562 learned_addr learned my addr 172.21.15.26:0/2457147562 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:06.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe15259c640 1 --2- 172.21.15.26:0/2457147562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1540cebd0 0x7fe1540c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:06.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe152d9d640 1 --2- 172.21.15.26:0/2457147562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe154161260 0x7fe1540c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:06.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe151d9b640 1 -- 172.21.15.26:0/2457147562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1540cebd0 msgr2=0x7fe1540c68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:06.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe151d9b640 1 --2- 172.21.15.26:0/2457147562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1540cebd0 0x7fe1540c68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe151d9b640 1 -- 172.21.15.26:0/2457147562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe154161260 msgr2=0x7fe1540c43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:06.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe151d9b640 1 --2- 172.21.15.26:0/2457147562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe154161260 0x7fe1540c43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:06.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe151d9b640 1 -- 172.21.15.26:0/2457147562 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1480094d0 con 0x7fe15415cc60 2023-10-14T11:15:06.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe151d9b640 1 --2- 172.21.15.26:0/2457147562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe15415cc60 0x7fe1540b0800 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fe14801cab0 tx=0x7fe14801aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:06.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe142ffd640 1 -- 172.21.15.26:0/2457147562 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1480b6620 con 0x7fe15415cc60 2023-10-14T11:15:06.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe142ffd640 1 -- 172.21.15.26:0/2457147562 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1480b67a0 con 0x7fe15415cc60 2023-10-14T11:15:06.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe142ffd640 1 -- 172.21.15.26:0/2457147562 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1480b6b50 con 0x7fe15415cc60 2023-10-14T11:15:06.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe158b9d640 1 -- 172.21.15.26:0/2457147562 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1540c6f90 con 0x7fe15415cc60 2023-10-14T11:15:06.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe158b9d640 1 -- 172.21.15.26:0/2457147562 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1540b3bb0 con 0x7fe15415cc60 2023-10-14T11:15:06.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.935+0000 7fe158b9d640 1 -- 172.21.15.26:0/2457147562 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1540b3490 con 0x7fe15415cc60 2023-10-14T11:15:06.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.939+0000 7fe142ffd640 1 -- 172.21.15.26:0/2457147562 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe1480b2040 con 0x7fe15415cc60 2023-10-14T11:15:06.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.939+0000 7fe142ffd640 1 --2- 172.21.15.26:0/2457147562 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe1340664a0 0x7fe134068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:06.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.939+0000 7fe142ffd640 1 -- 172.21.15.26:0/2457147562 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fe14811e120 con 0x7fe15415cc60 2023-10-14T11:15:06.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.939+0000 7fe15259c640 1 --2- 172.21.15.26:0/2457147562 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe1340664a0 0x7fe134068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:06.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.939+0000 7fe15259c640 1 --2- 172.21.15.26:0/2457147562 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe1340664a0 0x7fe134068960 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe1540c78f0 tx=0x7fe144009110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:06.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:06.943+0000 7fe142ffd640 1 -- 172.21.15.26:0/2457147562 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe1540b3490 con 0x7fe15415cc60 2023-10-14T11:15:07.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.099+0000 7fe158b9d640 1 -- 172.21.15.26:0/2457147562 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1540b3490 con 0x7fe15415cc60 2023-10-14T11:15:07.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.103+0000 7fe142ffd640 1 -- 172.21.15.26:0/2457147562 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1540b3490 con 0x7fe15415cc60 2023-10-14T11:15:07.108 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:15:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.103+0000 7fe158b9d640 1 -- 172.21.15.26:0/2457147562 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe1340664a0 msgr2=0x7fe134068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.103+0000 7fe158b9d640 1 --2- 172.21.15.26:0/2457147562 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe1340664a0 0x7fe134068960 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe1540c78f0 tx=0x7fe144009110 comp rx=0 tx=0).stop 2023-10-14T11:15:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.103+0000 7fe158b9d640 1 -- 172.21.15.26:0/2457147562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe15415cc60 msgr2=0x7fe1540b0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:07.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.103+0000 7fe158b9d640 1 --2- 172.21.15.26:0/2457147562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe15415cc60 0x7fe1540b0800 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fe14801cab0 tx=0x7fe14801aa50 comp rx=0 tx=0).stop 2023-10-14T11:15:07.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.103+0000 7fe158b9d640 1 -- 172.21.15.26:0/2457147562 shutdown_connections 2023-10-14T11:15:07.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.103+0000 7fe158b9d640 1 --2- 172.21.15.26:0/2457147562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe154161260 0x7fe1540c43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.103+0000 7fe158b9d640 1 --2- 172.21.15.26:0/2457147562 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe1340664a0 0x7fe134068960 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.103+0000 7fe158b9d640 1 --2- 172.21.15.26:0/2457147562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe15415cc60 0x7fe1540b0800 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.103+0000 7fe158b9d640 1 --2- 172.21.15.26:0/2457147562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1540cebd0 0x7fe1540c68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.103+0000 7fe158b9d640 1 -- 172.21.15.26:0/2457147562 >> 172.21.15.26:0/2457147562 conn(0x7fe15406e570 msgr2=0x7fe15415bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.103+0000 7fe158b9d640 1 -- 172.21.15.26:0/2457147562 shutdown_connections 2023-10-14T11:15:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.103+0000 7fe158b9d640 1 -- 172.21.15.26:0/2457147562 wait complete. 2023-10-14T11:15:07.129 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_metadata pg_num 2023-10-14T11:15:07.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.267+0000 7f0846b80640 1 Processor -- start 2023-10-14T11:15:07.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.267+0000 7f0846b80640 1 -- start start 2023-10-14T11:15:07.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.271+0000 7f0846b80640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0840159900 0x7f084006e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:07.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.271+0000 7f0846b80640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f084006a5a0 0x7f08400c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:07.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.271+0000 7f0846b80640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08400b4390 con 0x7f08400b3f00 2023-10-14T11:15:07.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.271+0000 7f0846b80640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08400cd740 con 0x7f0840159900 2023-10-14T11:15:07.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.271+0000 7f0846b80640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08400b4600 con 0x7f084006a5a0 2023-10-14T11:15:07.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.271+0000 7f084491c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0840159900 0x7f084006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:07.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.271+0000 7f084491c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0840159900 0x7f084006e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34756/0 (socket says 172.21.15.26:34756) 2023-10-14T11:15:07.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.271+0000 7f084491c640 1 -- 172.21.15.26:0/343434253 learned_addr learned my addr 172.21.15.26:0/343434253 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:07.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.271+0000 7f084511d640 1 --2- 172.21.15.26:0/343434253 >> v2:172.21.15.110:3300/0 conn(0x7f084006a5a0 0x7f08400c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:07.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.271+0000 7f084491c640 1 -- 172.21.15.26:0/343434253 >> v2:172.21.15.110:3300/0 conn(0x7f084006a5a0 msgr2=0x7f08400c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:07.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.271+0000 7f084491c640 1 --2- 172.21.15.26:0/343434253 >> v2:172.21.15.110:3300/0 conn(0x7f084006a5a0 0x7f08400c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.271+0000 7f084491c640 1 -- 172.21.15.26:0/343434253 >> v1:172.21.15.110:6789/0 conn(0x7f08400b3f00 legacy=0x7f0840069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:07.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.271+0000 7f084491c640 1 -- 172.21.15.26:0/343434253 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08400c8dd0 con 0x7f0840159900 2023-10-14T11:15:07.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.275+0000 7f084491c640 1 --2- 172.21.15.26:0/343434253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0840159900 0x7f084006e260 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f08400b4910 tx=0x7f083401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeae8e90516be7a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:07.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.275+0000 7f083f7fe640 1 -- 172.21.15.26:0/343434253 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08340aa430 con 0x7f0840159900 2023-10-14T11:15:07.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.275+0000 7f083f7fe640 1 -- 172.21.15.26:0/343434253 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08340aa590 con 0x7f0840159900 2023-10-14T11:15:07.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.275+0000 7f083f7fe640 1 -- 172.21.15.26:0/343434253 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08340aa920 con 0x7f0840159900 2023-10-14T11:15:07.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.275+0000 7f0846b80640 1 -- 172.21.15.26:0/343434253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0840159900 msgr2=0x7f084006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:07.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.275+0000 7f0846b80640 1 --2- 172.21.15.26:0/343434253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0840159900 0x7f084006e260 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f08400b4910 tx=0x7f083401c4d0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.275+0000 7f0846b80640 1 -- 172.21.15.26:0/343434253 shutdown_connections 2023-10-14T11:15:07.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.275+0000 7f0846b80640 1 --2- 172.21.15.26:0/343434253 >> v2:172.21.15.110:3300/0 conn(0x7f084006a5a0 0x7f08400c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.275+0000 7f0846b80640 1 --2- 172.21.15.26:0/343434253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0840159900 0x7f084006e260 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.275+0000 7f0846b80640 1 -- 172.21.15.26:0/343434253 >> 172.21.15.26:0/343434253 conn(0x7f08400b0da0 msgr2=0x7f08400ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:07.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.275+0000 7f0846b80640 1 -- 172.21.15.26:0/343434253 shutdown_connections 2023-10-14T11:15:07.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.275+0000 7f0846b80640 1 -- 172.21.15.26:0/343434253 wait complete. 2023-10-14T11:15:07.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.275+0000 7f0846b80640 1 Processor -- start 2023-10-14T11:15:07.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.275+0000 7f0846b80640 1 -- start start 2023-10-14T11:15:07.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f0846b80640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f084006a5a0 0x7f08401574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:07.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f0846b80640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08400b3f00 0x7f08400c1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:07.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f0846b80640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0840159900 0x7f08400cc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:07.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f0846b80640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084014c4a0 con 0x7f0840159900 2023-10-14T11:15:07.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f0846b80640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0840156590 con 0x7f08400b3f00 2023-10-14T11:15:07.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f0846b80640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08401556a0 con 0x7f084006a5a0 2023-10-14T11:15:07.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f084511d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0840159900 0x7f08400cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:07.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f084511d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0840159900 0x7f08400cc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34772/0 (socket says 172.21.15.26:34772) 2023-10-14T11:15:07.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f084511d640 1 -- 172.21.15.26:0/218266591 learned_addr learned my addr 172.21.15.26:0/218266591 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:07.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f084491c640 1 --2- 172.21.15.26:0/218266591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f084006a5a0 0x7f08401574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:07.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f083ffff640 1 --2- 172.21.15.26:0/218266591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08400b3f00 0x7f08400c1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:07.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f084511d640 1 -- 172.21.15.26:0/218266591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f084006a5a0 msgr2=0x7f08401574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:07.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f084511d640 1 --2- 172.21.15.26:0/218266591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f084006a5a0 0x7f08401574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f084511d640 1 -- 172.21.15.26:0/218266591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08400b3f00 msgr2=0x7f08400c1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:07.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f084511d640 1 --2- 172.21.15.26:0/218266591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08400b3f00 0x7f08400c1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f084511d640 1 -- 172.21.15.26:0/218266591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08340094d0 con 0x7f0840159900 2023-10-14T11:15:07.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f084511d640 1 --2- 172.21.15.26:0/218266591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0840159900 0x7f08400cc300 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f083800efc0 tx=0x7f083800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:07.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f083d7fa640 1 -- 172.21.15.26:0/218266591 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838009ba0 con 0x7f0840159900 2023-10-14T11:15:07.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f083d7fa640 1 -- 172.21.15.26:0/218266591 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083800f040 con 0x7f0840159900 2023-10-14T11:15:07.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f0846b80640 1 -- 172.21.15.26:0/218266591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0840155980 con 0x7f0840159900 2023-10-14T11:15:07.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f083d7fa640 1 -- 172.21.15.26:0/218266591 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08380146c0 con 0x7f0840159900 2023-10-14T11:15:07.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f0846b80640 1 -- 172.21.15.26:0/218266591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0840155f40 con 0x7f0840159900 2023-10-14T11:15:07.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.279+0000 7f0846b80640 1 -- 172.21.15.26:0/218266591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084004e170 con 0x7f0840159900 2023-10-14T11:15:07.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.283+0000 7f083d7fa640 1 -- 172.21.15.26:0/218266591 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0838014820 con 0x7f0840159900 2023-10-14T11:15:07.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.283+0000 7f083d7fa640 1 --2- 172.21.15.26:0/218266591 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0824066470 0x7f0824068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:07.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.283+0000 7f083d7fa640 1 -- 172.21.15.26:0/218266591 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f0838084c50 con 0x7f0840159900 2023-10-14T11:15:07.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.283+0000 7f084491c640 1 --2- 172.21.15.26:0/218266591 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0824066470 0x7f0824068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:07.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.283+0000 7f084491c640 1 --2- 172.21.15.26:0/218266591 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0824066470 0x7f0824068930 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f08340ae000 tx=0x7f08340b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:07.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.287+0000 7f083d7fa640 1 -- 172.21.15.26:0/218266591 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0838052090 con 0x7f0840159900 2023-10-14T11:15:07.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.443+0000 7f0846b80640 1 -- 172.21.15.26:0/218266591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"} v 0) v1 -- 0x7f08401566d0 con 0x7f0840159900 2023-10-14T11:15:07.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.443+0000 7f083d7fa640 1 -- 172.21.15.26:0/218266591 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"}]=0 v55) v1 ==== 109+0+11 (secure 0 0 0) 0x7f08380180b0 con 0x7f0840159900 2023-10-14T11:15:07.451 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:15:07.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.447+0000 7f0846b80640 1 -- 172.21.15.26:0/218266591 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0824066470 msgr2=0x7f0824068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:07.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.447+0000 7f0846b80640 1 --2- 172.21.15.26:0/218266591 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0824066470 0x7f0824068930 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f08340ae000 tx=0x7f08340b5040 comp rx=0 tx=0).stop 2023-10-14T11:15:07.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.447+0000 7f0846b80640 1 -- 172.21.15.26:0/218266591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0840159900 msgr2=0x7f08400cc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:07.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.447+0000 7f0846b80640 1 --2- 172.21.15.26:0/218266591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0840159900 0x7f08400cc300 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f083800efc0 tx=0x7f083800c490 comp rx=0 tx=0).stop 2023-10-14T11:15:07.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.447+0000 7f0846b80640 1 -- 172.21.15.26:0/218266591 shutdown_connections 2023-10-14T11:15:07.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.447+0000 7f0846b80640 1 --2- 172.21.15.26:0/218266591 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0824066470 0x7f0824068930 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.447+0000 7f0846b80640 1 --2- 172.21.15.26:0/218266591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0840159900 0x7f08400cc300 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.447+0000 7f0846b80640 1 --2- 172.21.15.26:0/218266591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08400b3f00 0x7f08400c1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.447+0000 7f0846b80640 1 --2- 172.21.15.26:0/218266591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f084006a5a0 0x7f08401574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.447+0000 7f0846b80640 1 -- 172.21.15.26:0/218266591 >> 172.21.15.26:0/218266591 conn(0x7f08400b0da0 msgr2=0x7f0840158c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:07.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.447+0000 7f0846b80640 1 -- 172.21.15.26:0/218266591 shutdown_connections 2023-10-14T11:15:07.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.447+0000 7f0846b80640 1 -- 172.21.15.26:0/218266591 wait complete. 2023-10-14T11:15:07.472 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_data pg_num 2023-10-14T11:15:07.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.611+0000 7f0d1c79d640 1 Processor -- start 2023-10-14T11:15:07.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.611+0000 7f0d1c79d640 1 -- start start 2023-10-14T11:15:07.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.615+0000 7f0d1c79d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d14069e90 0x7f0d1406d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:07.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.615+0000 7f0d1c79d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0d140c26b0 0x7f0d140c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:07.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.615+0000 7f0d1c79d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d1415ae30 con 0x7f0d1406a270 2023-10-14T11:15:07.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.615+0000 7f0d1c79d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d140cb090 con 0x7f0d140c26b0 2023-10-14T11:15:07.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.615+0000 7f0d1c79d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d140ca510 con 0x7f0d14069e90 2023-10-14T11:15:07.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.615+0000 7f0d19d38640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0d1406a270 0x7f0d140c9ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53114/0 (socket says 172.21.15.26:53114) 2023-10-14T11:15:07.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.615+0000 7f0d19d38640 1 -- 172.21.15.26:0/3735698690 learned_addr learned my addr 172.21.15.26:0/3735698690 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:07.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.615+0000 7f0d1ad3a640 1 --2- 172.21.15.26:0/3735698690 >> v2:172.21.15.110:3300/0 conn(0x7f0d140c26b0 0x7f0d140c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:07.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.615+0000 7f0d1a539640 1 --2- 172.21.15.26:0/3735698690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d14069e90 0x7f0d1406d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:07.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.615+0000 7f0d19537640 1 -- 172.21.15.26:0/3735698690 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166317790 0 0) 0x7f0d1415ae30 con 0x7f0d1406a270 2023-10-14T11:15:07.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.615+0000 7f0d19537640 1 -- 172.21.15.26:0/3735698690 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d00003530 con 0x7f0d1406a270 2023-10-14T11:15:07.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.615+0000 7f0d1ad3a640 1 -- 172.21.15.26:0/3735698690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d14069e90 msgr2=0x7f0d1406d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:07.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.615+0000 7f0d1ad3a640 1 --2- 172.21.15.26:0/3735698690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d14069e90 0x7f0d1406d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.615+0000 7f0d1ad3a640 1 -- 172.21.15.26:0/3735698690 >> v1:172.21.15.26:6789/0 conn(0x7f0d1406a270 legacy=0x7f0d140c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:07.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.615+0000 7f0d1ad3a640 1 -- 172.21.15.26:0/3735698690 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d140ca7f0 con 0x7f0d140c26b0 2023-10-14T11:15:07.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.619+0000 7f0d1ad3a640 1 --2- 172.21.15.26:0/3735698690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d140c26b0 0x7f0d140c2b40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c009d90 tx=0x7f0d0c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6d62c1b727ea1c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:07.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.619+0000 7f0d19537640 1 -- 172.21.15.26:0/3735698690 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c0a59e0 con 0x7f0d140c26b0 2023-10-14T11:15:07.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.619+0000 7f0d19537640 1 -- 172.21.15.26:0/3735698690 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0c0a5b40 con 0x7f0d140c26b0 2023-10-14T11:15:07.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.619+0000 7f0d19537640 1 -- 172.21.15.26:0/3735698690 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c0ad440 con 0x7f0d140c26b0 2023-10-14T11:15:07.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.619+0000 7f0d1c79d640 1 -- 172.21.15.26:0/3735698690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d140c26b0 msgr2=0x7f0d140c2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:07.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.619+0000 7f0d1c79d640 1 --2- 172.21.15.26:0/3735698690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d140c26b0 0x7f0d140c2b40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c009d90 tx=0x7f0d0c01c920 comp rx=0 tx=0).stop 2023-10-14T11:15:07.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.619+0000 7f0d1c79d640 1 -- 172.21.15.26:0/3735698690 shutdown_connections 2023-10-14T11:15:07.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.619+0000 7f0d1c79d640 1 --2- 172.21.15.26:0/3735698690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d140c26b0 0x7f0d140c2b40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.619+0000 7f0d1c79d640 1 --2- 172.21.15.26:0/3735698690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d14069e90 0x7f0d1406d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.619+0000 7f0d1c79d640 1 -- 172.21.15.26:0/3735698690 >> 172.21.15.26:0/3735698690 conn(0x7f0d140b0da0 msgr2=0x7f0d140ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:07.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.619+0000 7f0d1c79d640 1 -- 172.21.15.26:0/3735698690 shutdown_connections 2023-10-14T11:15:07.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.619+0000 7f0d1c79d640 1 -- 172.21.15.26:0/3735698690 wait complete. 2023-10-14T11:15:07.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.619+0000 7f0d1c79d640 1 Processor -- start 2023-10-14T11:15:07.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.619+0000 7f0d1c79d640 1 -- start start 2023-10-14T11:15:07.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.619+0000 7f0d1c79d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d14069e90 0x7f0d14149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:07.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.619+0000 7f0d1c79d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d1406a270 0x7f0d1415ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:07.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.619+0000 7f0d1c79d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d140c26b0 0x7f0d140c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:07.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.619+0000 7f0d1c79d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d141552a0 con 0x7f0d1406a270 2023-10-14T11:15:07.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.619+0000 7f0d1c79d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1415c390 con 0x7f0d140c26b0 2023-10-14T11:15:07.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.619+0000 7f0d1c79d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d14154900 con 0x7f0d14069e90 2023-10-14T11:15:07.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.623+0000 7f0d19d38640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d1406a270 0x7f0d1415ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:07.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.623+0000 7f0d19d38640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d1406a270 0x7f0d1415ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34782/0 (socket says 172.21.15.26:34782) 2023-10-14T11:15:07.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.623+0000 7f0d19d38640 1 -- 172.21.15.26:0/3605530833 learned_addr learned my addr 172.21.15.26:0/3605530833 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:07.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.623+0000 7f0d1a539640 1 --2- 172.21.15.26:0/3605530833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d14069e90 0x7f0d14149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:07.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.623+0000 7f0d1ad3a640 1 --2- 172.21.15.26:0/3605530833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d140c26b0 0x7f0d140c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:07.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.623+0000 7f0d19d38640 1 -- 172.21.15.26:0/3605530833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d14069e90 msgr2=0x7f0d14149de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:07.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.623+0000 7f0d19d38640 1 --2- 172.21.15.26:0/3605530833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d14069e90 0x7f0d14149de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.623+0000 7f0d19d38640 1 -- 172.21.15.26:0/3605530833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d140c26b0 msgr2=0x7f0d140c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:07.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.623+0000 7f0d19d38640 1 --2- 172.21.15.26:0/3605530833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d140c26b0 0x7f0d140c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.623+0000 7f0d19d38640 1 -- 172.21.15.26:0/3605530833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c009a70 con 0x7f0d1406a270 2023-10-14T11:15:07.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.623+0000 7f0d1a539640 1 --2- 172.21.15.26:0/3605530833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d14069e90 0x7f0d14149de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:07.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.623+0000 7f0d19d38640 1 --2- 172.21.15.26:0/3605530833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d1406a270 0x7f0d1415ba20 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400c4d0 tx=0x7f0d0400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:07.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.623+0000 7f0d0affd640 1 -- 172.21.15.26:0/3605530833 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d04005cf0 con 0x7f0d1406a270 2023-10-14T11:15:07.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.623+0000 7f0d0affd640 1 -- 172.21.15.26:0/3605530833 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d04005e50 con 0x7f0d1406a270 2023-10-14T11:15:07.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.623+0000 7f0d1c79d640 1 -- 172.21.15.26:0/3605530833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d14154be0 con 0x7f0d1406a270 2023-10-14T11:15:07.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.623+0000 7f0d0affd640 1 -- 172.21.15.26:0/3605530833 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d04007270 con 0x7f0d1406a270 2023-10-14T11:15:07.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.623+0000 7f0d1c79d640 1 -- 172.21.15.26:0/3605530833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1415bf60 con 0x7f0d1406a270 2023-10-14T11:15:07.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.623+0000 7f0d1c79d640 1 -- 172.21.15.26:0/3605530833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d141553e0 con 0x7f0d1406a270 2023-10-14T11:15:07.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.623+0000 7f0d0affd640 1 -- 172.21.15.26:0/3605530833 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0d040073d0 con 0x7f0d1406a270 2023-10-14T11:15:07.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.627+0000 7f0d0affd640 1 --2- 172.21.15.26:0/3605530833 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0cf80664a0 0x7f0cf8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:07.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.627+0000 7f0d0affd640 1 -- 172.21.15.26:0/3605530833 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f0d04083490 con 0x7f0d1406a270 2023-10-14T11:15:07.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.627+0000 7f0d1a539640 1 --2- 172.21.15.26:0/3605530833 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0cf80664a0 0x7f0cf8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:07.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.627+0000 7f0d1a539640 1 --2- 172.21.15.26:0/3605530833 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0cf80664a0 0x7f0cf8068960 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009bb0 tx=0x7f0d10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:07.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.627+0000 7f0d0affd640 1 -- 172.21.15.26:0/3605530833 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0d040508d0 con 0x7f0d1406a270 2023-10-14T11:15:07.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.783+0000 7f0d1c79d640 1 -- 172.21.15.26:0/3605530833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"} v 0) v1 -- 0x7f0d1404e170 con 0x7f0d1406a270 2023-10-14T11:15:07.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.783+0000 7f0d0affd640 1 -- 172.21.15.26:0/3605530833 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"}]=0 v55) v1 ==== 105+0+11 (secure 0 0 0) 0x7f0d04017020 con 0x7f0d1406a270 2023-10-14T11:15:07.792 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:15:07.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.787+0000 7f0d1c79d640 1 -- 172.21.15.26:0/3605530833 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0cf80664a0 msgr2=0x7f0cf8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:07.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.787+0000 7f0d1c79d640 1 --2- 172.21.15.26:0/3605530833 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0cf80664a0 0x7f0cf8068960 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009bb0 tx=0x7f0d10008040 comp rx=0 tx=0).stop 2023-10-14T11:15:07.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.787+0000 7f0d1c79d640 1 -- 172.21.15.26:0/3605530833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d1406a270 msgr2=0x7f0d1415ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:07.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.787+0000 7f0d1c79d640 1 --2- 172.21.15.26:0/3605530833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d1406a270 0x7f0d1415ba20 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400c4d0 tx=0x7f0d0400c990 comp rx=0 tx=0).stop 2023-10-14T11:15:07.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.787+0000 7f0d1c79d640 1 -- 172.21.15.26:0/3605530833 shutdown_connections 2023-10-14T11:15:07.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.787+0000 7f0d1c79d640 1 --2- 172.21.15.26:0/3605530833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d140c26b0 0x7f0d140c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.787+0000 7f0d1c79d640 1 --2- 172.21.15.26:0/3605530833 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0cf80664a0 0x7f0cf8068960 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.787+0000 7f0d1c79d640 1 --2- 172.21.15.26:0/3605530833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d1406a270 0x7f0d1415ba20 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.787+0000 7f0d1c79d640 1 --2- 172.21.15.26:0/3605530833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d14069e90 0x7f0d14149de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.787+0000 7f0d1c79d640 1 -- 172.21.15.26:0/3605530833 >> 172.21.15.26:0/3605530833 conn(0x7f0d140b0da0 msgr2=0x7f0d14159f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.787+0000 7f0d1c79d640 1 -- 172.21.15.26:0/3605530833 shutdown_connections 2023-10-14T11:15:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.787+0000 7f0d1c79d640 1 -- 172.21.15.26:0/3605530833 wait complete. 2023-10-14T11:15:07.812 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:15:07.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8eddaa640 1 Processor -- start 2023-10-14T11:15:07.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8eddaa640 1 -- start start 2023-10-14T11:15:07.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8eddaa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa8e81597c0 0x7fa8e80ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:07.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8eddaa640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e80723d0 con 0x7fa8e80adc10 2023-10-14T11:15:07.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8eddaa640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e80717c0 con 0x7fa8e8159ba0 2023-10-14T11:15:07.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8eddaa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e8071aa0 con 0x7fa8e81597c0 2023-10-14T11:15:07.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e7fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa8e80adc10 0x7fa8e815d4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53130/0 (socket says 172.21.15.26:53130) 2023-10-14T11:15:07.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e7fff640 1 -- 172.21.15.26:0/257238911 learned_addr learned my addr 172.21.15.26:0/257238911 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:07.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e77fe640 1 --2- 172.21.15.26:0/257238911 >> v2:172.21.15.110:3300/0 conn(0x7fa8e81597c0 0x7fa8e80ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:07.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e67fc640 1 -- 172.21.15.26:0/257238911 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2238859849 0 0) 0x7fa8e80723d0 con 0x7fa8e80adc10 2023-10-14T11:15:07.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e67fc640 1 -- 172.21.15.26:0/257238911 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8d0003530 con 0x7fa8e80adc10 2023-10-14T11:15:07.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e67fc640 1 -- 172.21.15.26:0/257238911 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875882064 0 0) 0x7fa8e80717c0 con 0x7fa8e8159ba0 2023-10-14T11:15:07.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e67fc640 1 -- 172.21.15.26:0/257238911 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8e80723d0 con 0x7fa8e8159ba0 2023-10-14T11:15:07.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e67fc640 1 -- 172.21.15.26:0/257238911 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1729997253 0 0) 0x7fa8d0003530 con 0x7fa8e80adc10 2023-10-14T11:15:07.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e67fc640 1 -- 172.21.15.26:0/257238911 >> v2:172.21.15.110:3300/0 conn(0x7fa8e81597c0 msgr2=0x7fa8e80ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:07.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e67fc640 1 --2- 172.21.15.26:0/257238911 >> v2:172.21.15.110:3300/0 conn(0x7fa8e81597c0 0x7fa8e80ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e67fc640 1 -- 172.21.15.26:0/257238911 >> v1:172.21.15.110:6789/0 conn(0x7fa8e8159ba0 legacy=0x7fa8e80cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:07.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e67fc640 1 -- 172.21.15.26:0/257238911 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e8071d80 con 0x7fa8e80adc10 2023-10-14T11:15:07.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e67fc640 1 -- 172.21.15.26:0/257238911 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7fa8e0001a00 con 0x7fa8e80adc10 2023-10-14T11:15:07.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e67fc640 1 -- 172.21.15.26:0/257238911 >> v1:172.21.15.26:6789/0 conn(0x7fa8e80adc10 legacy=0x7fa8e815d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:07.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e67fc640 1 --2- 172.21.15.26:0/257238911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8d0003b10 0x7fa8d0003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:07.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e67fc640 1 --2- 172.21.15.26:0/257238911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8d00047d0 0x7fa8d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:07.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e67fc640 1 --2- 172.21.15.26:0/257238911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d0005190 0x7fa8d000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:07.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e67fc640 1 -- 172.21.15.26:0/257238911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e8071aa0 con 0x7fa8d00047d0 2023-10-14T11:15:07.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e67fc640 1 -- 172.21.15.26:0/257238911 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d000c010 con 0x7fa8d0005190 2023-10-14T11:15:07.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e67fc640 1 -- 172.21.15.26:0/257238911 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d000c1d0 con 0x7fa8d0003b10 2023-10-14T11:15:07.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e6ffd640 1 --2- 172.21.15.26:0/257238911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8d00047d0 0x7fa8d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:07.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e6ffd640 1 -- 172.21.15.26:0/257238911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8d0003b10 msgr2=0x7fa8d0003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:07.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e6ffd640 1 --2- 172.21.15.26:0/257238911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8d0003b10 0x7fa8d0003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e6ffd640 1 -- 172.21.15.26:0/257238911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d0005190 msgr2=0x7fa8d000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:07.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e6ffd640 1 --2- 172.21.15.26:0/257238911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d0005190 0x7fa8d000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e6ffd640 1 -- 172.21.15.26:0/257238911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d0003530 con 0x7fa8d00047d0 2023-10-14T11:15:07.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.951+0000 7fa8e7fff640 1 -- 172.21.15.26:0/257238911 reap_dead start 2023-10-14T11:15:07.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.955+0000 7fa8e6ffd640 1 --2- 172.21.15.26:0/257238911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8d00047d0 0x7fa8d0004c50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fa8e80ce540 tx=0x7fa8dc01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=131b74159256e3f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:07.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.955+0000 7fa8e67fc640 1 -- 172.21.15.26:0/257238911 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc0052d0 con 0x7fa8d00047d0 2023-10-14T11:15:07.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.955+0000 7fa8e67fc640 1 -- 172.21.15.26:0/257238911 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8dc005450 con 0x7fa8d00047d0 2023-10-14T11:15:07.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.955+0000 7fa8e67fc640 1 -- 172.21.15.26:0/257238911 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc0a88d0 con 0x7fa8d00047d0 2023-10-14T11:15:07.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.955+0000 7fa8eddaa640 1 -- 172.21.15.26:0/257238911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8d00047d0 msgr2=0x7fa8d0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:07.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.955+0000 7fa8eddaa640 1 --2- 172.21.15.26:0/257238911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8d00047d0 0x7fa8d0004c50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fa8e80ce540 tx=0x7fa8dc01ec70 comp rx=0 tx=0).stop 2023-10-14T11:15:07.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.955+0000 7fa8eddaa640 1 -- 172.21.15.26:0/257238911 shutdown_connections 2023-10-14T11:15:07.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.955+0000 7fa8eddaa640 1 --2- 172.21.15.26:0/257238911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8d00047d0 0x7fa8d0004c50 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.955+0000 7fa8eddaa640 1 -- 172.21.15.26:0/257238911 >> 172.21.15.26:0/257238911 conn(0x7fa8e806c190 msgr2=0x7fa8e806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:07.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.955+0000 7fa8eddaa640 1 -- 172.21.15.26:0/257238911 shutdown_connections 2023-10-14T11:15:07.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.955+0000 7fa8eddaa640 1 -- 172.21.15.26:0/257238911 wait complete. 2023-10-14T11:15:07.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8eddaa640 1 Processor -- start 2023-10-14T11:15:07.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8eddaa640 1 -- start start 2023-10-14T11:15:07.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8eddaa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8d00047d0 0x7fa8e8158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:07.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8eddaa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8e81f7490 0x7fa8e81528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:07.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8eddaa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8e80b12f0 0x7fa8e80b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:07.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8eddaa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e80b0600 con 0x7fa8e80b12f0 2023-10-14T11:15:07.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8eddaa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e80b0e60 con 0x7fa8e81f7490 2023-10-14T11:15:07.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8eddaa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e81f7910 con 0x7fa8d00047d0 2023-10-14T11:15:07.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8e7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8e80b12f0 0x7fa8e80b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:07.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8e7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8e80b12f0 0x7fa8e80b2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34800/0 (socket says 172.21.15.26:34800) 2023-10-14T11:15:07.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8e7fff640 1 -- 172.21.15.26:0/1441393733 learned_addr learned my addr 172.21.15.26:0/1441393733 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:07.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8e6ffd640 1 --2- 172.21.15.26:0/1441393733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8e81f7490 0x7fa8e81528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:07.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8e77fe640 1 --2- 172.21.15.26:0/1441393733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8d00047d0 0x7fa8e8158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:07.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8e7fff640 1 -- 172.21.15.26:0/1441393733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8d00047d0 msgr2=0x7fa8e8158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:07.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8e7fff640 1 --2- 172.21.15.26:0/1441393733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8d00047d0 0x7fa8e8158340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8e7fff640 1 -- 172.21.15.26:0/1441393733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8e81f7490 msgr2=0x7fa8e81528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:07.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8e7fff640 1 --2- 172.21.15.26:0/1441393733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8e81f7490 0x7fa8e81528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:07.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8e7fff640 1 -- 172.21.15.26:0/1441393733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e81589d0 con 0x7fa8e80b12f0 2023-10-14T11:15:07.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8e77fe640 1 --2- 172.21.15.26:0/1441393733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8d00047d0 0x7fa8e8158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:07.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8e7fff640 1 --2- 172.21.15.26:0/1441393733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8e80b12f0 0x7fa8e80b2130 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0001340 tx=0x7fa8e000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:07.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8cffff640 1 -- 172.21.15.26:0/1441393733 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e000ce50 con 0x7fa8e80b12f0 2023-10-14T11:15:07.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8cffff640 1 -- 172.21.15.26:0/1441393733 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e000a610 con 0x7fa8e80b12f0 2023-10-14T11:15:07.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8cffff640 1 -- 172.21.15.26:0/1441393733 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e000a9c0 con 0x7fa8e80b12f0 2023-10-14T11:15:07.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.959+0000 7fa8eddaa640 1 -- 172.21.15.26:0/1441393733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e80b0810 con 0x7fa8e80b12f0 2023-10-14T11:15:07.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.963+0000 7fa8eddaa640 1 -- 172.21.15.26:0/1441393733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e8152e20 con 0x7fa8e80b12f0 2023-10-14T11:15:07.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.963+0000 7fa8eddaa640 1 -- 172.21.15.26:0/1441393733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e8074010 con 0x7fa8e80b12f0 2023-10-14T11:15:07.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.963+0000 7fa8cffff640 1 -- 172.21.15.26:0/1441393733 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa8e000ab20 con 0x7fa8e80b12f0 2023-10-14T11:15:07.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.963+0000 7fa8cffff640 1 --2- 172.21.15.26:0/1441393733 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa8d4066490 0x7fa8d4068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:07.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.963+0000 7fa8cffff640 1 -- 172.21.15.26:0/1441393733 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fa8e0083700 con 0x7fa8e80b12f0 2023-10-14T11:15:07.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.963+0000 7fa8e77fe640 1 --2- 172.21.15.26:0/1441393733 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa8d4066490 0x7fa8d4068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:07.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.963+0000 7fa8e77fe640 1 --2- 172.21.15.26:0/1441393733 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa8d4066490 0x7fa8d4068950 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8068cd0 tx=0x7fa8d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:07.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:07.967+0000 7fa8cffff640 1 -- 172.21.15.26:0/1441393733 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa8e0054560 con 0x7fa8e80b12f0 2023-10-14T11:15:08.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.135+0000 7fa8eddaa640 1 -- 172.21.15.26:0/1441393733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa8e80b03e0 con 0x7fa8e80b12f0 2023-10-14T11:15:08.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.135+0000 7fa8cffff640 1 -- 172.21.15.26:0/1441393733 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v55) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa8e001a080 con 0x7fa8e80b12f0 2023-10-14T11:15:08.142 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-10-14T11:15:08.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.135+0000 7fa8eddaa640 1 -- 172.21.15.26:0/1441393733 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa8d4066490 msgr2=0x7fa8d4068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:08.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.135+0000 7fa8eddaa640 1 --2- 172.21.15.26:0/1441393733 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa8d4066490 0x7fa8d4068950 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8068cd0 tx=0x7fa8d8008040 comp rx=0 tx=0).stop 2023-10-14T11:15:08.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.135+0000 7fa8eddaa640 1 -- 172.21.15.26:0/1441393733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8e80b12f0 msgr2=0x7fa8e80b2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:08.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.135+0000 7fa8eddaa640 1 --2- 172.21.15.26:0/1441393733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8e80b12f0 0x7fa8e80b2130 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0001340 tx=0x7fa8e000cc00 comp rx=0 tx=0).stop 2023-10-14T11:15:08.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.135+0000 7fa8eddaa640 1 -- 172.21.15.26:0/1441393733 shutdown_connections 2023-10-14T11:15:08.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.135+0000 7fa8eddaa640 1 --2- 172.21.15.26:0/1441393733 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fa8d4066490 0x7fa8d4068950 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:08.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.135+0000 7fa8eddaa640 1 --2- 172.21.15.26:0/1441393733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8e80b12f0 0x7fa8e80b2130 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:08.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.135+0000 7fa8eddaa640 1 --2- 172.21.15.26:0/1441393733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8e81f7490 0x7fa8e81528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:08.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.135+0000 7fa8eddaa640 1 --2- 172.21.15.26:0/1441393733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8d00047d0 0x7fa8e8158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:08.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.135+0000 7fa8eddaa640 1 -- 172.21.15.26:0/1441393733 >> 172.21.15.26:0/1441393733 conn(0x7fa8e806c190 msgr2=0x7fa8e80af110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:08.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.135+0000 7fa8eddaa640 1 -- 172.21.15.26:0/1441393733 shutdown_connections 2023-10-14T11:15:08.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.135+0000 7fa8eddaa640 1 -- 172.21.15.26:0/1441393733 wait complete. 2023-10-14T11:15:08.163 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi026.front.sepia.ceph.com... 2023-10-14T11:15:08.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:08.164 DEBUG:teuthology.orchestra.run.smithi026:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-14T11:15:08.183 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[51342]: fuse finished with error 0 and tester_r 0 2023-10-14T11:15:08.186 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:15:08.210 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T11:15:08.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:08.211 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T11:15:08.260 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T11:15:08.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.439+0000 7f628b091640 1 Processor -- start 2023-10-14T11:15:08.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.439+0000 7f628b091640 1 -- start start 2023-10-14T11:15:08.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.443+0000 7f628b091640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f628415cf90 0x7f628406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:08.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.443+0000 7f628b091640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f628415d4e0 con 0x7f62840b2ad0 2023-10-14T11:15:08.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.443+0000 7f628b091640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f628415d7c0 con 0x7f62840ce310 2023-10-14T11:15:08.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.443+0000 7f628b091640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6284160580 con 0x7f628415cf90 2023-10-14T11:15:08.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.443+0000 7f6283fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f628415cf90 0x7f628406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:08.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.443+0000 7f6283fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f628415cf90 0x7f628406c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34804/0 (socket says 172.21.15.26:34804) 2023-10-14T11:15:08.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.443+0000 7f6283fff640 1 -- 172.21.15.26:0/3991629517 learned_addr learned my addr 172.21.15.26:0/3991629517 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:08.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.443+0000 7f6288e2d640 1 --1- 172.21.15.26:0/3991629517 >> v1:172.21.15.26:6789/0 conn(0x7f62840b2ad0 0x7f628406b4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53144/0 (socket says 172.21.15.26:53144) 2023-10-14T11:15:08.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.443+0000 7f6283fff640 1 -- 172.21.15.26:0/3991629517 >> v1:172.21.15.110:6789/0 conn(0x7f62840ce310 legacy=0x7f62841609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:08.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.443+0000 7f6283fff640 1 -- 172.21.15.26:0/3991629517 >> v1:172.21.15.26:6789/0 conn(0x7f62840b2ad0 legacy=0x7f628406b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:08.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.443+0000 7f6283fff640 1 -- 172.21.15.26:0/3991629517 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628415daa0 con 0x7f628415cf90 2023-10-14T11:15:08.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.443+0000 7f62837fe640 1 -- 172.21.15.26:0/3991629517 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282975472 0 0) 0x7f628415d4e0 con 0x7f62840b2ad0 2023-10-14T11:15:08.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.443+0000 7f6283fff640 1 --2- 172.21.15.26:0/3991629517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f628415cf90 0x7f628406c8f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f62700098a0 tx=0x7f627001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f172264d34c0eed server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:08.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f62837fe640 1 -- 172.21.15.26:0/3991629517 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62700ab600 con 0x7f628415cf90 2023-10-14T11:15:08.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f62837fe640 1 -- 172.21.15.26:0/3991629517 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62700ab760 con 0x7f628415cf90 2023-10-14T11:15:08.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f62837fe640 1 -- 172.21.15.26:0/3991629517 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62700abaf0 con 0x7f628415cf90 2023-10-14T11:15:08.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f628b091640 1 -- 172.21.15.26:0/3991629517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f628415cf90 msgr2=0x7f628406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:08.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f628b091640 1 --2- 172.21.15.26:0/3991629517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f628415cf90 0x7f628406c8f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f62700098a0 tx=0x7f627001c4f0 comp rx=0 tx=0).stop 2023-10-14T11:15:08.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f628b091640 1 -- 172.21.15.26:0/3991629517 shutdown_connections 2023-10-14T11:15:08.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f628b091640 1 --2- 172.21.15.26:0/3991629517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f628415cf90 0x7f628406c8f0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:08.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f628b091640 1 -- 172.21.15.26:0/3991629517 >> 172.21.15.26:0/3991629517 conn(0x7f62840cd1c0 msgr2=0x7f62840cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:08.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f628b091640 1 -- 172.21.15.26:0/3991629517 shutdown_connections 2023-10-14T11:15:08.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f628b091640 1 -- 172.21.15.26:0/3991629517 wait complete. 2023-10-14T11:15:08.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f628b091640 1 Processor -- start 2023-10-14T11:15:08.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f628b091640 1 -- start start 2023-10-14T11:15:08.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f628b091640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62840b2ad0 0x7f628414aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:08.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f628b091640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62840ce310 0x7f6284153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:08.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f628b091640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f628415cf90 0x7f628415bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:08.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f628b091640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6284154590 con 0x7f62840ce310 2023-10-14T11:15:08.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f628b091640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62841542b0 con 0x7f628415cf90 2023-10-14T11:15:08.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f628b091640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62840b3680 con 0x7f62840b2ad0 2023-10-14T11:15:08.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f6283fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62840ce310 0x7f6284153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:08.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f6283fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62840ce310 0x7f6284153940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34812/0 (socket says 172.21.15.26:34812) 2023-10-14T11:15:08.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f6283fff640 1 -- 172.21.15.26:0/3693535821 learned_addr learned my addr 172.21.15.26:0/3693535821 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:08.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f628962e640 1 --2- 172.21.15.26:0/3693535821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f628415cf90 0x7f628415bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:08.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.447+0000 7f6288e2d640 1 --2- 172.21.15.26:0/3693535821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62840b2ad0 0x7f628414aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:08.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.451+0000 7f6283fff640 1 -- 172.21.15.26:0/3693535821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62840b2ad0 msgr2=0x7f628414aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:08.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.451+0000 7f6283fff640 1 --2- 172.21.15.26:0/3693535821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62840b2ad0 0x7f628414aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:08.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.451+0000 7f6283fff640 1 -- 172.21.15.26:0/3693535821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f628415cf90 msgr2=0x7f628415bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:08.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.451+0000 7f6283fff640 1 --2- 172.21.15.26:0/3693535821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f628415cf90 0x7f628415bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:08.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.451+0000 7f6283fff640 1 -- 172.21.15.26:0/3693535821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62700094d0 con 0x7f62840ce310 2023-10-14T11:15:08.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.451+0000 7f6283fff640 1 --2- 172.21.15.26:0/3693535821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62840ce310 0x7f6284153940 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f62700ad040 tx=0x7f6270019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:08.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.451+0000 7f62817fa640 1 -- 172.21.15.26:0/3693535821 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62700b5810 con 0x7f62840ce310 2023-10-14T11:15:08.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.451+0000 7f62817fa640 1 -- 172.21.15.26:0/3693535821 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62700b59b0 con 0x7f62840ce310 2023-10-14T11:15:08.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.451+0000 7f62817fa640 1 -- 172.21.15.26:0/3693535821 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62700b5d60 con 0x7f62840ce310 2023-10-14T11:15:08.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.451+0000 7f628b091640 1 -- 172.21.15.26:0/3693535821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62840b3960 con 0x7f62840ce310 2023-10-14T11:15:08.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.451+0000 7f628b091640 1 -- 172.21.15.26:0/3693535821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62840b3330 con 0x7f62840ce310 2023-10-14T11:15:08.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.451+0000 7f628b091640 1 -- 172.21.15.26:0/3693535821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6284074010 con 0x7f62840ce310 2023-10-14T11:15:08.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.451+0000 7f62817fa640 1 -- 172.21.15.26:0/3693535821 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f62700b4390 con 0x7f62840ce310 2023-10-14T11:15:08.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.451+0000 7f62817fa640 1 --2- 172.21.15.26:0/3693535821 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62680664a0 0x7f6268068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:08.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.451+0000 7f62817fa640 1 -- 172.21.15.26:0/3693535821 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f627011e920 con 0x7f62840ce310 2023-10-14T11:15:08.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.455+0000 7f6288e2d640 1 --2- 172.21.15.26:0/3693535821 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62680664a0 0x7f6268068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:08.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.455+0000 7f6288e2d640 1 --2- 172.21.15.26:0/3693535821 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62680664a0 0x7f6268068960 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6278000f70 tx=0x7f6278007240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:08.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.455+0000 7f62817fa640 1 -- 172.21.15.26:0/3693535821 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f62700ebc50 con 0x7f62840ce310 2023-10-14T11:15:08.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.651+0000 7f628b091640 1 -- 172.21.15.26:0/3693535821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f62840b3e10 con 0x7f62840ce310 2023-10-14T11:15:08.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.651+0000 7f62817fa640 1 -- 172.21.15.26:0/3693535821 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+88 (secure 0 0 0) 0x7f62700ef270 con 0x7f62840ce310 2023-10-14T11:15:08.657 INFO:teuthology.orchestra.run.smithi026.stdout:name: testcephfs1, metadata pool: testcephfs1_metadata, data pools: [testcephfs1_data ] 2023-10-14T11:15:08.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.651+0000 7f628b091640 1 -- 172.21.15.26:0/3693535821 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62680664a0 msgr2=0x7f6268068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:08.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.651+0000 7f628b091640 1 --2- 172.21.15.26:0/3693535821 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62680664a0 0x7f6268068960 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6278000f70 tx=0x7f6278007240 comp rx=0 tx=0).stop 2023-10-14T11:15:08.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.651+0000 7f628b091640 1 -- 172.21.15.26:0/3693535821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62840ce310 msgr2=0x7f6284153940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:08.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.651+0000 7f628b091640 1 --2- 172.21.15.26:0/3693535821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62840ce310 0x7f6284153940 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f62700ad040 tx=0x7f6270019290 comp rx=0 tx=0).stop 2023-10-14T11:15:08.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.651+0000 7f628b091640 1 -- 172.21.15.26:0/3693535821 shutdown_connections 2023-10-14T11:15:08.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.651+0000 7f628b091640 1 --2- 172.21.15.26:0/3693535821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f628415cf90 0x7f628415bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:08.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.651+0000 7f628b091640 1 --2- 172.21.15.26:0/3693535821 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62680664a0 0x7f6268068960 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:08.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.651+0000 7f628b091640 1 --2- 172.21.15.26:0/3693535821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62840ce310 0x7f6284153940 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:08.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.651+0000 7f628b091640 1 --2- 172.21.15.26:0/3693535821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62840b2ad0 0x7f628414aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:08.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.651+0000 7f628b091640 1 -- 172.21.15.26:0/3693535821 >> 172.21.15.26:0/3693535821 conn(0x7f62840cd1c0 msgr2=0x7f628406b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:08.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.651+0000 7f628b091640 1 -- 172.21.15.26:0/3693535821 shutdown_connections 2023-10-14T11:15:08.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:08.651+0000 7f628b091640 1 -- 172.21.15.26:0/3693535821 wait complete. 2023-10-14T11:15:08.678 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T11:15:08.678 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T11:15:08.679 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-14T11:15:08.679 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T11:15:08.679 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T11:15:08.680 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T11:15:08.680 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T11:15:08.680 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T11:15:08.681 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:15:08.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:08.681 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-14T11:15:08.691 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:15:08.691 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:15:08.692 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:15:08.692 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:15:08.692 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-14T11:15:08.692 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:15:08.692 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:15:08.693 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-14T11:15:08.693 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-14T11:15:08.693 INFO:teuthology.orchestra.run.smithi026.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T11:15:08.693 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:15:08.693 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-14T11:15:08.694 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-14T11:15:08.694 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42269sec preferred_lft 42269sec 2023-10-14T11:15:08.694 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-14T11:15:08.694 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:15:08.694 INFO:teuthology.orchestra.run.smithi026.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:15:08.695 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-14T11:15:08.695 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-14T11:15:08.695 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T11:15:08.695 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:15:08.695 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-14T11:15:08.696 INFO:teuthology.orchestra.run.smithi026.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-14T11:15:08.696 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 02:42:e1:29:12:f0 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:15:08.696 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-14T11:15:08.696 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:15:08.696 INFO:teuthology.orchestra.run.smithi026.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T11:15:08.696 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-14T11:15:08.697 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T11:15:08.697 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:15:08.697 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-14T11:15:08.697 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:15:08.697 INFO:teuthology.orchestra.run.smithi026.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T11:15:08.698 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:15:08.698 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-14T11:15:08.698 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:15:08.698 INFO:teuthology.orchestra.run.smithi026.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T11:15:08.698 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:15:08.699 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-14T11:15:08.699 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:15:08.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:08.701 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T11:15:08.763 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-14T11:15:08.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:08.766 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-14T11:15:08.821 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-14T11:15:08.821 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T11:15:08.821 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-14T11:15:08.822 INFO:teuthology.orchestra.run.smithi026.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-14T11:15:08.822 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-14T11:15:08.822 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T11:15:08.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:08.823 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-14T11:15:08.823 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-14T11:15:08.824 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T11:15:08.824 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T11:15:08.825 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T11:15:08.825 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-14T11:15:08.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:08.917 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-14T11:15:08.926 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T11:15:08.927 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T11:15:08.928 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:15:08.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:08.928 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-10-14T11:15:08.996 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-14T11:15:08.997 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:15:08.997 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T11:15:09.050 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:15:09.051 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:15:09.051 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T11:15:09.099 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-10-14T11:15:09.165 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:15:09.217 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2023-10-14T11:15:09.218 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2023-10-14T11:15:09.218 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2023-10-14T11:15:09.218 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2023-10-14T11:15:09.218 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2023-10-14T11:15:09.219 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2023-10-14T11:15:09.219 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2023-10-14T11:15:09.219 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2023-10-14T11:15:09.219 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2023-10-14T11:15:09.219 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2023-10-14T11:15:09.220 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2023-10-14T11:15:09.220 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2023-10-14T11:15:09.220 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:15:09.220 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2023-10-14T11:15:09.220 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2023-10-14T11:15:09.221 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2023-10-14T11:15:09.221 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2023-10-14T11:15:09.221 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2023-10-14T11:15:09.221 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2023-10-14T11:15:09.221 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2023-10-14T11:15:09.222 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:15:09.222 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2023-10-14T11:15:09.222 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2023-10-14T11:15:09.222 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2023-10-14T11:15:09.223 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T11:15:09.223 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T11:15:09.223 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T11:15:09.223 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T11:15:09.223 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2023-10-14T11:15:09.223 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:15:09.224 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:15:09.224 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:15:09.224 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:15:09.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:09.225 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-10-14T11:15:09.280 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-14T11:15:09.280 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-14T11:15:09.326 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-10-14T11:15:09.348 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T11:15:09.403 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2023-10-14T11:15:09.403 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2023-10-14T11:15:09.403 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2023-10-14T11:15:09.403 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2023-10-14T11:15:09.404 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2023-10-14T11:15:09.404 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2023-10-14T11:15:09.404 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2023-10-14T11:15:09.404 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2023-10-14T11:15:09.404 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2023-10-14T11:15:09.405 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2023-10-14T11:15:09.405 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2023-10-14T11:15:09.405 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2023-10-14T11:15:09.405 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T11:15:09.405 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2023-10-14T11:15:09.406 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2023-10-14T11:15:09.406 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2023-10-14T11:15:09.406 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2023-10-14T11:15:09.406 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2023-10-14T11:15:09.406 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2023-10-14T11:15:09.407 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2023-10-14T11:15:09.407 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T11:15:09.407 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2023-10-14T11:15:09.407 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2023-10-14T11:15:09.407 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2023-10-14T11:15:09.408 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T11:15:09.408 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T11:15:09.408 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T11:15:09.408 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T11:15:09.408 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2023-10-14T11:15:09.409 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:15:09.409 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:15:09.409 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:15:09.409 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:15:09.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:09.411 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-10-14T11:15:09.424 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:2023-10-14T11:15:09.419+0000 7f7b9b4ff580 -1 init, newargv = 0x55f8e5e529e0 newargc=15 2023-10-14T11:15:09.424 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[51740]: starting ceph client 2023-10-14T11:15:09.431 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[51740]: starting fuse 2023-10-14T11:15:09.434 INFO:teuthology.orchestra.run.smithi026.stdout:43 2023-10-14T11:15:09.434 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-10-14T11:15:09.435 DEBUG:teuthology.orchestra.run.smithi026:> sudo stdin-killer -- python3 -c ' 2023-10-14T11:15:09.435 DEBUG:teuthology.orchestra.run.smithi026:> import glob 2023-10-14T11:15:09.436 DEBUG:teuthology.orchestra.run.smithi026:> import re 2023-10-14T11:15:09.436 DEBUG:teuthology.orchestra.run.smithi026:> import os 2023-10-14T11:15:09.436 DEBUG:teuthology.orchestra.run.smithi026:> import subprocess 2023-10-14T11:15:09.437 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:15:09.437 DEBUG:teuthology.orchestra.run.smithi026:> def _find_admin_socket(client_name): 2023-10-14T11:15:09.437 DEBUG:teuthology.orchestra.run.smithi026:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-14T11:15:09.438 DEBUG:teuthology.orchestra.run.smithi026:> files = glob.glob(asok_path) 2023-10-14T11:15:09.438 DEBUG:teuthology.orchestra.run.smithi026:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-14T11:15:09.438 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:15:09.439 DEBUG:teuthology.orchestra.run.smithi026:> # Given a non-glob path, it better be there 2023-10-14T11:15:09.439 DEBUG:teuthology.orchestra.run.smithi026:> if "*" not in asok_path: 2023-10-14T11:15:09.440 DEBUG:teuthology.orchestra.run.smithi026:> assert(len(files) == 1) 2023-10-14T11:15:09.440 DEBUG:teuthology.orchestra.run.smithi026:> return files[0] 2023-10-14T11:15:09.440 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:15:09.441 DEBUG:teuthology.orchestra.run.smithi026:> for f in files: 2023-10-14T11:15:09.441 DEBUG:teuthology.orchestra.run.smithi026:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-14T11:15:09.441 DEBUG:teuthology.orchestra.run.smithi026:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-14T11:15:09.442 DEBUG:teuthology.orchestra.run.smithi026:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-14T11:15:09.442 DEBUG:teuthology.orchestra.run.smithi026:> contents = proc_f.read() 2023-10-14T11:15:09.442 DEBUG:teuthology.orchestra.run.smithi026:> if mountpoint in contents: 2023-10-14T11:15:09.443 DEBUG:teuthology.orchestra.run.smithi026:> return f 2023-10-14T11:15:09.443 DEBUG:teuthology.orchestra.run.smithi026:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-14T11:15:09.444 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:15:09.444 DEBUG:teuthology.orchestra.run.smithi026:> print(_find_admin_socket("client.0")) 2023-10-14T11:15:09.444 DEBUG:teuthology.orchestra.run.smithi026:> ' 2023-10-14T11:15:09.563 INFO:teuthology.orchestra.run.smithi026.stdout:/var/run/ceph/ceph-client.0.51740.asok 2023-10-14T11:15:09.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-14T11:15:09.575 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.51740.asok 2023-10-14T11:15:09.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:09.575 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.51740.asok status 2023-10-14T11:15:09.749 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:15:09.749 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": { 2023-10-14T11:15:09.749 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-14T11:15:09.750 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T11:15:09.750 INFO:teuthology.orchestra.run.smithi026.stdout: "entity_id": "0", 2023-10-14T11:15:09.750 INFO:teuthology.orchestra.run.smithi026.stdout: "hostname": "smithi026", 2023-10-14T11:15:09.750 INFO:teuthology.orchestra.run.smithi026.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-14T11:15:09.750 INFO:teuthology.orchestra.run.smithi026.stdout: "pid": "51740", 2023-10-14T11:15:09.751 INFO:teuthology.orchestra.run.smithi026.stdout: "root": "/" 2023-10-14T11:15:09.751 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:15:09.751 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_count": 0, 2023-10-14T11:15:09.751 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_pinned_count": 0, 2023-10-14T11:15:09.751 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 6471, 2023-10-14T11:15:09.752 INFO:teuthology.orchestra.run.smithi026.stdout: "inst": { 2023-10-14T11:15:09.752 INFO:teuthology.orchestra.run.smithi026.stdout: "name": { 2023-10-14T11:15:09.752 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "client", 2023-10-14T11:15:09.752 INFO:teuthology.orchestra.run.smithi026.stdout: "num": 6471 2023-10-14T11:15:09.752 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:15:09.753 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-10-14T11:15:09.753 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-14T11:15:09.753 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2023-10-14T11:15:09.753 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 2314107915 2023-10-14T11:15:09.753 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-14T11:15:09.754 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:15:09.754 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-10-14T11:15:09.754 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-14T11:15:09.754 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2023-10-14T11:15:09.754 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 2314107915 2023-10-14T11:15:09.755 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-14T11:15:09.755 INFO:teuthology.orchestra.run.smithi026.stdout: "inst_str": "client.6471 192.168.0.1:0/2314107915", 2023-10-14T11:15:09.755 INFO:teuthology.orchestra.run.smithi026.stdout: "addr_str": "192.168.0.1:0/2314107915", 2023-10-14T11:15:09.755 INFO:teuthology.orchestra.run.smithi026.stdout: "inode_count": 1, 2023-10-14T11:15:09.755 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_epoch": 26, 2023-10-14T11:15:09.756 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch": 55, 2023-10-14T11:15:09.756 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch_barrier": 0, 2023-10-14T11:15:09.756 INFO:teuthology.orchestra.run.smithi026.stdout: "blocklisted": false, 2023-10-14T11:15:09.756 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "testcephfs1" 2023-10-14T11:15:09.756 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:15:09.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:09.765 DEBUG:teuthology.orchestra.run.smithi026:> stat --file-system '--printf=%T 2023-10-14T11:15:09.765 DEBUG:teuthology.orchestra.run.smithi026:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-14T11:15:09.775 INFO:teuthology.orchestra.run.smithi026.stdout:fuseblk 2023-10-14T11:15:09.775 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-14T11:15:09.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:09.776 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T11:15:09.836 DEBUG:teuthology.orchestra.run.smithi026:> stdin-killer -- python3 -c ' 2023-10-14T11:15:09.836 DEBUG:teuthology.orchestra.run.smithi026:> import os 2023-10-14T11:15:09.837 DEBUG:teuthology.orchestra.run.smithi026:> import errno 2023-10-14T11:15:09.837 DEBUG:teuthology.orchestra.run.smithi026:> 2023-10-14T11:15:09.838 DEBUG:teuthology.orchestra.run.smithi026:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2023-10-14T11:15:09.838 DEBUG:teuthology.orchestra.run.smithi026:> try: 2023-10-14T11:15:09.838 DEBUG:teuthology.orchestra.run.smithi026:> if True: 2023-10-14T11:15:09.839 DEBUG:teuthology.orchestra.run.smithi026:> ret = os.read(fd, 1024) 2023-10-14T11:15:09.839 DEBUG:teuthology.orchestra.run.smithi026:> else: 2023-10-14T11:15:09.839 DEBUG:teuthology.orchestra.run.smithi026:> os.write(fd, b'"'"'content'"'"') 2023-10-14T11:15:09.840 DEBUG:teuthology.orchestra.run.smithi026:> except OSError as e: 2023-10-14T11:15:09.840 DEBUG:teuthology.orchestra.run.smithi026:> if e.errno != errno.EPERM: 2023-10-14T11:15:09.840 DEBUG:teuthology.orchestra.run.smithi026:> raise 2023-10-14T11:15:09.841 DEBUG:teuthology.orchestra.run.smithi026:> else: 2023-10-14T11:15:09.841 DEBUG:teuthology.orchestra.run.smithi026:> raise RuntimeError("client does not check permission of data pool") 2023-10-14T11:15:09.841 DEBUG:teuthology.orchestra.run.smithi026:> ' 2023-10-14T11:15:09.949 INFO:teuthology.orchestra.run.smithi026.stderr:Traceback (most recent call last): 2023-10-14T11:15:09.949 INFO:teuthology.orchestra.run.smithi026.stderr: File "", line 15, in 2023-10-14T11:15:09.949 INFO:teuthology.orchestra.run.smithi026.stderr:RuntimeError: client does not check permission of data pool 2023-10-14T11:15:09.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:09 stdin-killer INFO: command exited with status 1: exiting normally with same code! 2023-10-14T11:15:09.958 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:15:09.959 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=testcephfs1_data' 2023-10-14T11:15:10.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f644de46640 1 Processor -- start 2023-10-14T11:15:10.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f644de46640 1 -- start start 2023-10-14T11:15:10.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f644de46640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64480cd350 0x7f64480c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:10.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f644de46640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f64480c3d80 0x7f64480c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:10.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f644de46640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64480addc0 con 0x7f64480ca3c0 2023-10-14T11:15:10.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f644de46640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6448159dd0 con 0x7f64480c3d80 2023-10-14T11:15:10.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f644de46640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64480c46e0 con 0x7f64480cd350 2023-10-14T11:15:10.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f6446ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f64480ca3c0 0x7f64480cc2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53160/0 (socket says 172.21.15.26:53160) 2023-10-14T11:15:10.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f6446ffd640 1 -- 172.21.15.26:0/3965553505 learned_addr learned my addr 172.21.15.26:0/3965553505 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:10.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f64477fe640 1 --2- 172.21.15.26:0/3965553505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64480cd350 0x7f64480c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:10.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f6447fff640 1 --2- 172.21.15.26:0/3965553505 >> v2:172.21.15.110:3300/0 conn(0x7f64480c3d80 0x7f64480c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:10.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f64467fc640 1 -- 172.21.15.26:0/3965553505 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970209789 0 0) 0x7f64480addc0 con 0x7f64480ca3c0 2023-10-14T11:15:10.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f64467fc640 1 -- 172.21.15.26:0/3965553505 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6430003430 con 0x7f64480ca3c0 2023-10-14T11:15:10.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f64467fc640 1 -- 172.21.15.26:0/3965553505 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 341512755 0 0) 0x7f6430003430 con 0x7f64480ca3c0 2023-10-14T11:15:10.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f64467fc640 1 -- 172.21.15.26:0/3965553505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64480cd350 msgr2=0x7f64480c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:10.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f64467fc640 1 --2- 172.21.15.26:0/3965553505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64480cd350 0x7f64480c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:10.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f64467fc640 1 -- 172.21.15.26:0/3965553505 >> v2:172.21.15.110:3300/0 conn(0x7f64480c3d80 msgr2=0x7f64480c41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:10.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f64467fc640 1 --2- 172.21.15.26:0/3965553505 >> v2:172.21.15.110:3300/0 conn(0x7f64480c3d80 0x7f64480c41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:10.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f64467fc640 1 -- 172.21.15.26:0/3965553505 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64480c35c0 con 0x7f64480ca3c0 2023-10-14T11:15:10.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f64467fc640 1 -- 172.21.15.26:0/3965553505 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f643c001680 con 0x7f64480ca3c0 2023-10-14T11:15:10.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f64467fc640 1 -- 172.21.15.26:0/3965553505 >> v1:172.21.15.26:6789/0 conn(0x7f64480ca3c0 legacy=0x7f64480cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:10.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f64467fc640 1 --2- 172.21.15.26:0/3965553505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6430004a60 0x7f6430004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:10.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f64467fc640 1 --2- 172.21.15.26:0/3965553505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6430003670 0x7f6430003af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:10.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f64467fc640 1 --2- 172.21.15.26:0/3965553505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6430004030 0x7f643000fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:10.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f64467fc640 1 -- 172.21.15.26:0/3965553505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6448159dd0 con 0x7f6430004030 2023-10-14T11:15:10.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f64467fc640 1 -- 172.21.15.26:0/3965553505 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64480c46e0 con 0x7f6430004a60 2023-10-14T11:15:10.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f64467fc640 1 -- 172.21.15.26:0/3965553505 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6430010250 con 0x7f6430003670 2023-10-14T11:15:10.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f64477fe640 1 --2- 172.21.15.26:0/3965553505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64480cd350 0x7f64480c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:15:10.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.143+0000 7f6447fff640 1 --2- 172.21.15.26:0/3965553505 >> v2:172.21.15.110:3300/0 conn(0x7f64480c3d80 0x7f64480c41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:15:10.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.147+0000 7f6447fff640 1 --2- 172.21.15.26:0/3965553505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6430004030 0x7f643000fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:10.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.147+0000 7f6446ffd640 1 --2- 172.21.15.26:0/3965553505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6430003670 0x7f6430003af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:10.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.147+0000 7f64477fe640 1 --2- 172.21.15.26:0/3965553505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6430004a60 0x7f6430004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:10.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.147+0000 7f6447fff640 1 -- 172.21.15.26:0/3965553505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6430003670 msgr2=0x7f6430003af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:10.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.147+0000 7f6447fff640 1 --2- 172.21.15.26:0/3965553505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6430003670 0x7f6430003af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:10.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.147+0000 7f6447fff640 1 -- 172.21.15.26:0/3965553505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6430004a60 msgr2=0x7f6430004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:10.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.147+0000 7f6447fff640 1 --2- 172.21.15.26:0/3965553505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6430004a60 0x7f6430004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:10.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.147+0000 7f6447fff640 1 -- 172.21.15.26:0/3965553505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6430003430 con 0x7f6430004030 2023-10-14T11:15:10.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.147+0000 7f6446ffd640 1 --2- 172.21.15.26:0/3965553505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6430003670 0x7f6430003af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:15:10.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.147+0000 7f6447fff640 1 --2- 172.21.15.26:0/3965553505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6430004030 0x7f643000fb80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f644000e350 tx=0x7f644001ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2f848bac925f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:10.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.147+0000 7f64467fc640 1 -- 172.21.15.26:0/3965553505 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64400a5e50 con 0x7f6430004030 2023-10-14T11:15:10.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.147+0000 7f64467fc640 1 -- 172.21.15.26:0/3965553505 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644000f040 con 0x7f6430004030 2023-10-14T11:15:10.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.147+0000 7f64467fc640 1 -- 172.21.15.26:0/3965553505 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440003ba0 con 0x7f6430004030 2023-10-14T11:15:10.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f644de46640 1 -- 172.21.15.26:0/3965553505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6430004030 msgr2=0x7f643000fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:10.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f644de46640 1 --2- 172.21.15.26:0/3965553505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6430004030 0x7f643000fb80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f644000e350 tx=0x7f644001ce40 comp rx=0 tx=0).stop 2023-10-14T11:15:10.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f6447fff640 1 -- 172.21.15.26:0/3965553505 reap_dead start 2023-10-14T11:15:10.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f644de46640 1 -- 172.21.15.26:0/3965553505 shutdown_connections 2023-10-14T11:15:10.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f644de46640 1 -- 172.21.15.26:0/3965553505 >> 172.21.15.26:0/3965553505 conn(0x7f64480b0d10 msgr2=0x7f64480ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:10.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f644de46640 1 -- 172.21.15.26:0/3965553505 shutdown_connections 2023-10-14T11:15:10.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f644de46640 1 -- 172.21.15.26:0/3965553505 wait complete. 2023-10-14T11:15:10.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f644de46640 1 Processor -- start 2023-10-14T11:15:10.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f644de46640 1 -- start start 2023-10-14T11:15:10.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f644de46640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6430004030 0x7f64481fa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:10.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f644de46640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f644814c870 0x7f644806cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:10.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f644de46640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f644814ccf0 0x7f644806d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:10.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f644de46640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644815c300 con 0x7f644814ccf0 2023-10-14T11:15:10.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f644de46640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64481faac0 con 0x7f644814c870 2023-10-14T11:15:10.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f644de46640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644815bcf0 con 0x7f6430004030 2023-10-14T11:15:10.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f6447fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f644814ccf0 0x7f644806d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:10.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f6447fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f644814ccf0 0x7f644806d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34830/0 (socket says 172.21.15.26:34830) 2023-10-14T11:15:10.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f6447fff640 1 -- 172.21.15.26:0/1583733016 learned_addr learned my addr 172.21.15.26:0/1583733016 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:10.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f6447fff640 1 -- 172.21.15.26:0/1583733016 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6430004030 msgr2=0x7f64481fa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:10.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f64477fe640 1 --2- 172.21.15.26:0/1583733016 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6430004030 0x7f64481fa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:10.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f6447fff640 1 --2- 172.21.15.26:0/1583733016 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6430004030 0x7f64481fa580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:10.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f6446ffd640 1 --2- 172.21.15.26:0/1583733016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f644814c870 0x7f644806cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:10.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f6447fff640 1 -- 172.21.15.26:0/1583733016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f644814c870 msgr2=0x7f644806cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:10.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f6447fff640 1 --2- 172.21.15.26:0/1583733016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f644814c870 0x7f644806cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:10.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f6447fff640 1 -- 172.21.15.26:0/1583733016 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644815a2f0 con 0x7f644814ccf0 2023-10-14T11:15:10.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.151+0000 7f64477fe640 1 --2- 172.21.15.26:0/1583733016 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6430004030 0x7f64481fa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:15:10.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.155+0000 7f6447fff640 1 --2- 172.21.15.26:0/1583733016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f644814ccf0 0x7f644806d420 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f644001c8b0 tx=0x7f6440009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:10.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.155+0000 7f642ffff640 1 -- 172.21.15.26:0/1583733016 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440003ba0 con 0x7f644814ccf0 2023-10-14T11:15:10.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.155+0000 7f642ffff640 1 -- 172.21.15.26:0/1583733016 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6440003d00 con 0x7f644814ccf0 2023-10-14T11:15:10.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.155+0000 7f642ffff640 1 -- 172.21.15.26:0/1583733016 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440004220 con 0x7f644814ccf0 2023-10-14T11:15:10.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.155+0000 7f644de46640 1 -- 172.21.15.26:0/1583733016 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644815bf90 con 0x7f644814ccf0 2023-10-14T11:15:10.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.155+0000 7f644de46640 1 -- 172.21.15.26:0/1583733016 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6448159f50 con 0x7f644814ccf0 2023-10-14T11:15:10.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.155+0000 7f644de46640 1 -- 172.21.15.26:0/1583733016 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f644815bb50 con 0x7f644814ccf0 2023-10-14T11:15:10.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.155+0000 7f642ffff640 1 -- 172.21.15.26:0/1583733016 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6440004380 con 0x7f644814ccf0 2023-10-14T11:15:10.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.155+0000 7f642ffff640 1 --2- 172.21.15.26:0/1583733016 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f64340664a0 0x7f6434068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:10.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.155+0000 7f642ffff640 1 -- 172.21.15.26:0/1583733016 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f644011f0e0 con 0x7f644814ccf0 2023-10-14T11:15:10.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.155+0000 7f64477fe640 1 --2- 172.21.15.26:0/1583733016 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f64340664a0 0x7f6434068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:10.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.155+0000 7f64477fe640 1 --2- 172.21.15.26:0/1583733016 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f64340664a0 0x7f6434068960 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f64480ce680 tx=0x7f6438008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:10.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.159+0000 7f642ffff640 1 -- 172.21.15.26:0/1583733016 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f644815bb50 con 0x7f644814ccf0 2023-10-14T11:15:10.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.371+0000 7f644de46640 1 -- 172.21.15.26:0/1583733016 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=testcephfs1_data"]} v 0) v1 -- 0x7f644815bb50 con 0x7f644814ccf0 2023-10-14T11:15:10.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.375+0000 7f642ffff640 1 -- 172.21.15.26:0/1583733016 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=testcephfs1_data"]}]=0 updated caps for client.0 v18) v1 ==== 189+0+146 (secure 0 0 0) 0x7f644815bb50 con 0x7f644814ccf0 2023-10-14T11:15:10.381 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2023-10-14T11:15:10.381 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBZdyplGXdwHxAA3yn7fC60cZX9BQGuvdlfYw== 2023-10-14T11:15:10.381 INFO:teuthology.orchestra.run.smithi026.stdout: caps mds = "allow" 2023-10-14T11:15:10.382 INFO:teuthology.orchestra.run.smithi026.stdout: caps mon = "allow r" 2023-10-14T11:15:10.382 INFO:teuthology.orchestra.run.smithi026.stdout: caps osd = "allow rw pool=testcephfs1_data" 2023-10-14T11:15:10.382 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-10-14T11:15:10.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.375+0000 7f644de46640 1 -- 172.21.15.26:0/1583733016 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f64340664a0 msgr2=0x7f6434068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:10.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.375+0000 7f644de46640 1 --2- 172.21.15.26:0/1583733016 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f64340664a0 0x7f6434068960 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f64480ce680 tx=0x7f6438008040 comp rx=0 tx=0).stop 2023-10-14T11:15:10.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.375+0000 7f644de46640 1 -- 172.21.15.26:0/1583733016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f644814ccf0 msgr2=0x7f644806d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:10.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.375+0000 7f644de46640 1 --2- 172.21.15.26:0/1583733016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f644814ccf0 0x7f644806d420 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f644001c8b0 tx=0x7f6440009750 comp rx=0 tx=0).stop 2023-10-14T11:15:10.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.375+0000 7f644de46640 1 -- 172.21.15.26:0/1583733016 shutdown_connections 2023-10-14T11:15:10.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.375+0000 7f644de46640 1 --2- 172.21.15.26:0/1583733016 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f64340664a0 0x7f6434068960 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:10.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.375+0000 7f644de46640 1 --2- 172.21.15.26:0/1583733016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f644814ccf0 0x7f644806d420 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:10.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.375+0000 7f644de46640 1 --2- 172.21.15.26:0/1583733016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f644814c870 0x7f644806cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:10.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.375+0000 7f644de46640 1 --2- 172.21.15.26:0/1583733016 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6430004030 0x7f64481fa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:10.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.375+0000 7f644de46640 1 -- 172.21.15.26:0/1583733016 >> 172.21.15.26:0/1583733016 conn(0x7f64480b0d10 msgr2=0x7f6448158490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:10.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.379+0000 7f644de46640 1 -- 172.21.15.26:0/1583733016 shutdown_connections 2023-10-14T11:15:10.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.379+0000 7f644de46640 1 -- 172.21.15.26:0/1583733016 wait complete. 2023-10-14T11:15:10.403 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T11:15:10.404 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T11:15:10.506 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T11:15:10.596 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T11:15:10.596 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:15:10.597 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:15:10.606 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:15:10.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.783+0000 7fe233417640 1 Processor -- start 2023-10-14T11:15:10.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.783+0000 7fe233417640 1 -- start start 2023-10-14T11:15:10.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.783+0000 7fe233417640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe22c15ca70 0x7fe22c0d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:10.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.787+0000 7fe233417640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c0c65f0 con 0x7fe22c0d3550 2023-10-14T11:15:10.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.787+0000 7fe233417640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c0cdf80 con 0x7fe22c0cf7a0 2023-10-14T11:15:10.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.787+0000 7fe233417640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22c0ce820 con 0x7fe22c15ca70 2023-10-14T11:15:10.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.787+0000 7fe2309b2640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe22c0d3550 0x7fe22c0cf090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53166/0 (socket says 172.21.15.26:53166) 2023-10-14T11:15:10.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.787+0000 7fe2311b3640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe22c15ca70 0x7fe22c0d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:10.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.787+0000 7fe2309b2640 1 -- 172.21.15.26:0/2318828136 learned_addr learned my addr 172.21.15.26:0/2318828136 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:10.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.787+0000 7fe223fff640 1 -- 172.21.15.26:0/2318828136 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586065343 0 0) 0x7fe22c0c65f0 con 0x7fe22c0d3550 2023-10-14T11:15:10.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.787+0000 7fe223fff640 1 -- 172.21.15.26:0/2318828136 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe218003530 con 0x7fe22c0d3550 2023-10-14T11:15:10.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.787+0000 7fe2311b3640 1 -- 172.21.15.26:0/2318828136 >> v1:172.21.15.110:6789/0 conn(0x7fe22c0cf7a0 legacy=0x7fe22c0c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:10.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.787+0000 7fe2311b3640 1 -- 172.21.15.26:0/2318828136 >> v1:172.21.15.26:6789/0 conn(0x7fe22c0d3550 legacy=0x7fe22c0cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:10.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.787+0000 7fe2311b3640 1 -- 172.21.15.26:0/2318828136 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c0ce260 con 0x7fe22c15ca70 2023-10-14T11:15:10.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.787+0000 7fe2311b3640 1 --2- 172.21.15.26:0/2318828136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22c15ca70 0x7fe22c0d3010 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe2280097a0 tx=0x7fe22801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef2ebce00e66b32 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:10.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.787+0000 7fe223fff640 1 -- 172.21.15.26:0/2318828136 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2280a8050 con 0x7fe22c15ca70 2023-10-14T11:15:10.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.787+0000 7fe223fff640 1 -- 172.21.15.26:0/2318828136 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2280ac5f0 con 0x7fe22c15ca70 2023-10-14T11:15:10.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.787+0000 7fe223fff640 1 -- 172.21.15.26:0/2318828136 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2280ac980 con 0x7fe22c15ca70 2023-10-14T11:15:10.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.791+0000 7fe233417640 1 -- 172.21.15.26:0/2318828136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22c15ca70 msgr2=0x7fe22c0d3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:10.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.791+0000 7fe233417640 1 --2- 172.21.15.26:0/2318828136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22c15ca70 0x7fe22c0d3010 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe2280097a0 tx=0x7fe22801c430 comp rx=0 tx=0).stop 2023-10-14T11:15:10.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.791+0000 7fe233417640 1 -- 172.21.15.26:0/2318828136 shutdown_connections 2023-10-14T11:15:10.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.791+0000 7fe233417640 1 --2- 172.21.15.26:0/2318828136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22c15ca70 0x7fe22c0d3010 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:10.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.791+0000 7fe233417640 1 -- 172.21.15.26:0/2318828136 >> 172.21.15.26:0/2318828136 conn(0x7fe22c09bc50 msgr2=0x7fe22c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:10.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.791+0000 7fe233417640 1 -- 172.21.15.26:0/2318828136 shutdown_connections 2023-10-14T11:15:10.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.791+0000 7fe233417640 1 -- 172.21.15.26:0/2318828136 wait complete. 2023-10-14T11:15:10.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.791+0000 7fe233417640 1 Processor -- start 2023-10-14T11:15:10.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.791+0000 7fe233417640 1 -- start start 2023-10-14T11:15:10.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.791+0000 7fe233417640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe22c0cf7a0 0x7fe22c1569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:10.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.791+0000 7fe233417640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe22c0d3550 0x7fe22c0c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:10.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.791+0000 7fe233417640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22c15ca70 0x7fe22c0ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:10.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.791+0000 7fe233417640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0cc330 con 0x7fe22c15ca70 2023-10-14T11:15:10.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.791+0000 7fe233417640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0cae90 con 0x7fe22c0d3550 2023-10-14T11:15:10.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.791+0000 7fe233417640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0cb450 con 0x7fe22c0cf7a0 2023-10-14T11:15:10.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.791+0000 7fe2319b4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22c15ca70 0x7fe22c0ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:10.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.791+0000 7fe2319b4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22c15ca70 0x7fe22c0ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34852/0 (socket says 172.21.15.26:34852) 2023-10-14T11:15:10.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.791+0000 7fe2319b4640 1 -- 172.21.15.26:0/608932728 learned_addr learned my addr 172.21.15.26:0/608932728 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:10.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.795+0000 7fe2311b3640 1 --2- 172.21.15.26:0/608932728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe22c0cf7a0 0x7fe22c1569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:10.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.795+0000 7fe2309b2640 1 --2- 172.21.15.26:0/608932728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe22c0d3550 0x7fe22c0c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:10.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.795+0000 7fe2319b4640 1 -- 172.21.15.26:0/608932728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe22c0cf7a0 msgr2=0x7fe22c1569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:10.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.795+0000 7fe2319b4640 1 --2- 172.21.15.26:0/608932728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe22c0cf7a0 0x7fe22c1569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:10.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.795+0000 7fe2319b4640 1 -- 172.21.15.26:0/608932728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe22c0d3550 msgr2=0x7fe22c0c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:10.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.795+0000 7fe2319b4640 1 --2- 172.21.15.26:0/608932728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe22c0d3550 0x7fe22c0c9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:10.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.795+0000 7fe2319b4640 1 -- 172.21.15.26:0/608932728 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2280093b0 con 0x7fe22c15ca70 2023-10-14T11:15:10.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.795+0000 7fe2309b2640 1 --2- 172.21.15.26:0/608932728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe22c0d3550 0x7fe22c0c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:15:10.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.795+0000 7fe2319b4640 1 --2- 172.21.15.26:0/608932728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22c15ca70 0x7fe22c0ce9a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fe22400c7d0 tx=0x7fe22400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:10.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.795+0000 7fe221ffb640 1 -- 172.21.15.26:0/608932728 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224003b80 con 0x7fe22c15ca70 2023-10-14T11:15:10.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.795+0000 7fe221ffb640 1 -- 172.21.15.26:0/608932728 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe224003ce0 con 0x7fe22c15ca70 2023-10-14T11:15:10.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.795+0000 7fe221ffb640 1 -- 172.21.15.26:0/608932728 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22400aa30 con 0x7fe22c15ca70 2023-10-14T11:15:10.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.795+0000 7fe233417640 1 -- 172.21.15.26:0/608932728 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22c0cc580 con 0x7fe22c15ca70 2023-10-14T11:15:10.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.795+0000 7fe233417640 1 -- 172.21.15.26:0/608932728 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22c0cb0e0 con 0x7fe22c15ca70 2023-10-14T11:15:10.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.795+0000 7fe233417640 1 -- 172.21.15.26:0/608932728 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22c0cb5c0 con 0x7fe22c15ca70 2023-10-14T11:15:10.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.795+0000 7fe221ffb640 1 -- 172.21.15.26:0/608932728 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe22400ab90 con 0x7fe22c15ca70 2023-10-14T11:15:10.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.795+0000 7fe221ffb640 1 --2- 172.21.15.26:0/608932728 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe2100664a0 0x7fe210068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:10.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.795+0000 7fe221ffb640 1 -- 172.21.15.26:0/608932728 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fe224083ed0 con 0x7fe22c15ca70 2023-10-14T11:15:10.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.795+0000 7fe2311b3640 1 --2- 172.21.15.26:0/608932728 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe2100664a0 0x7fe210068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:10.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.799+0000 7fe2311b3640 1 --2- 172.21.15.26:0/608932728 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe2100664a0 0x7fe210068960 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe2280ae000 tx=0x7fe228008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:10.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.799+0000 7fe221ffb640 1 -- 172.21.15.26:0/608932728 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe224051150 con 0x7fe22c15ca70 2023-10-14T11:15:10.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.959+0000 7fe233417640 1 -- 172.21.15.26:0/608932728 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe22c0cb2a0 con 0x7fe22c15ca70 2023-10-14T11:15:10.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.963+0000 7fe221ffb640 1 -- 172.21.15.26:0/608932728 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16790 (secure 0 0 0) 0x7fe224054770 con 0x7fe22c15ca70 2023-10-14T11:15:10.969 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:15:10.969 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":55,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:14:51.591742+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:14:47.752880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:14:48.971211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:15:10.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.963+0000 7fe233417640 1 -- 172.21.15.26:0/608932728 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe2100664a0 msgr2=0x7fe210068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:10.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.963+0000 7fe233417640 1 --2- 172.21.15.26:0/608932728 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe2100664a0 0x7fe210068960 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe2280ae000 tx=0x7fe228008040 comp rx=0 tx=0).stop 2023-10-14T11:15:10.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.963+0000 7fe233417640 1 -- 172.21.15.26:0/608932728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22c15ca70 msgr2=0x7fe22c0ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:10.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.963+0000 7fe233417640 1 --2- 172.21.15.26:0/608932728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22c15ca70 0x7fe22c0ce9a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fe22400c7d0 tx=0x7fe22400cc90 comp rx=0 tx=0).stop 2023-10-14T11:15:10.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.963+0000 7fe233417640 1 -- 172.21.15.26:0/608932728 shutdown_connections 2023-10-14T11:15:10.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.963+0000 7fe233417640 1 --2- 172.21.15.26:0/608932728 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe2100664a0 0x7fe210068960 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:10.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.963+0000 7fe233417640 1 --2- 172.21.15.26:0/608932728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22c15ca70 0x7fe22c0ce9a0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:10.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.963+0000 7fe233417640 1 --2- 172.21.15.26:0/608932728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe22c0d3550 0x7fe22c0c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:10.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.963+0000 7fe233417640 1 --2- 172.21.15.26:0/608932728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe22c0cf7a0 0x7fe22c1569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:10.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.963+0000 7fe233417640 1 -- 172.21.15.26:0/608932728 >> 172.21.15.26:0/608932728 conn(0x7fe22c09bc50 msgr2=0x7fe22c0c8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:10.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.963+0000 7fe233417640 1 -- 172.21.15.26:0/608932728 shutdown_connections 2023-10-14T11:15:10.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:10.963+0000 7fe233417640 1 -- 172.21.15.26:0/608932728 wait complete. 2023-10-14T11:15:10.990 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'testcephfs1_metadata', 'create_time': '2023-10-14T11:14:47.752880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'testcephfs1_data', 'create_time': '2023-10-14T11:14:48.971211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:15:10.991 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:15:11.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.131+0000 7f3b2309e640 1 Processor -- start 2023-10-14T11:15:11.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.131+0000 7f3b2309e640 1 -- start start 2023-10-14T11:15:11.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.131+0000 7f3b2309e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3b1c070a00 0x7f3b1c163f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:11.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.131+0000 7f3b2309e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1c0c9600 con 0x7f3b1c1590d0 2023-10-14T11:15:11.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.131+0000 7f3b2309e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1c0c98e0 con 0x7f3b1c06df40 2023-10-14T11:15:11.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.131+0000 7f3b2309e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b1c0c9bc0 con 0x7f3b1c070a00 2023-10-14T11:15:11.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.131+0000 7f3b20e3a640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3b1c1590d0 0x7f3b1c0c8dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53178/0 (socket says 172.21.15.26:53178) 2023-10-14T11:15:11.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.131+0000 7f3b20e3a640 1 -- 172.21.15.26:0/1534026027 learned_addr learned my addr 172.21.15.26:0/1534026027 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:11.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.131+0000 7f3b2163b640 1 --2- 172.21.15.26:0/1534026027 >> v2:172.21.15.110:3300/0 conn(0x7f3b1c070a00 0x7f3b1c163f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:11.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.131+0000 7f3b1b7fe640 1 -- 172.21.15.26:0/1534026027 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363385923 0 0) 0x7f3b1c0c9600 con 0x7f3b1c1590d0 2023-10-14T11:15:11.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.131+0000 7f3b1b7fe640 1 -- 172.21.15.26:0/1534026027 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b0c003450 con 0x7f3b1c1590d0 2023-10-14T11:15:11.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.131+0000 7f3b1b7fe640 1 -- 172.21.15.26:0/1534026027 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583033178 0 0) 0x7f3b1c0c98e0 con 0x7f3b1c06df40 2023-10-14T11:15:11.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.131+0000 7f3b1b7fe640 1 -- 172.21.15.26:0/1534026027 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b1c0c9600 con 0x7f3b1c06df40 2023-10-14T11:15:11.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.131+0000 7f3b1b7fe640 1 -- 172.21.15.26:0/1534026027 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3668381865 0 0) 0x7f3b0c003450 con 0x7f3b1c1590d0 2023-10-14T11:15:11.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.131+0000 7f3b2163b640 1 -- 172.21.15.26:0/1534026027 >> v1:172.21.15.110:6789/0 conn(0x7f3b1c06df40 legacy=0x7f3b1c0702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:11.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.131+0000 7f3b2163b640 1 -- 172.21.15.26:0/1534026027 >> v1:172.21.15.26:6789/0 conn(0x7f3b1c1590d0 legacy=0x7f3b1c0c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:11.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.131+0000 7f3b2163b640 1 -- 172.21.15.26:0/1534026027 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1c0c9ea0 con 0x7f3b1c070a00 2023-10-14T11:15:11.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.135+0000 7f3b2163b640 1 --2- 172.21.15.26:0/1534026027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b1c070a00 0x7f3b1c163f80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009d90 tx=0x7f3b1401c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52329d06a8fd124a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:11.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.135+0000 7f3b1b7fe640 1 -- 172.21.15.26:0/1534026027 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b10001680 con 0x7f3b1c070a00 2023-10-14T11:15:11.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.135+0000 7f3b1b7fe640 1 -- 172.21.15.26:0/1534026027 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b140a6440 con 0x7f3b1c070a00 2023-10-14T11:15:11.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.135+0000 7f3b1b7fe640 1 -- 172.21.15.26:0/1534026027 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b140a67d0 con 0x7f3b1c070a00 2023-10-14T11:15:11.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.135+0000 7f3b2309e640 1 -- 172.21.15.26:0/1534026027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b1c070a00 msgr2=0x7f3b1c163f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:11.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.135+0000 7f3b2309e640 1 --2- 172.21.15.26:0/1534026027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b1c070a00 0x7f3b1c163f80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009d90 tx=0x7f3b1401c870 comp rx=0 tx=0).stop 2023-10-14T11:15:11.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.135+0000 7f3b2309e640 1 -- 172.21.15.26:0/1534026027 shutdown_connections 2023-10-14T11:15:11.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.135+0000 7f3b2309e640 1 --2- 172.21.15.26:0/1534026027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b1c070a00 0x7f3b1c163f80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:11.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.135+0000 7f3b2309e640 1 -- 172.21.15.26:0/1534026027 >> 172.21.15.26:0/1534026027 conn(0x7f3b1c0b0da0 msgr2=0x7f3b1c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:11.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.135+0000 7f3b2309e640 1 -- 172.21.15.26:0/1534026027 shutdown_connections 2023-10-14T11:15:11.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.135+0000 7f3b2309e640 1 -- 172.21.15.26:0/1534026027 wait complete. 2023-10-14T11:15:11.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b2309e640 1 Processor -- start 2023-10-14T11:15:11.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b2309e640 1 -- start start 2023-10-14T11:15:11.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b2309e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b1c06df40 0x7f3b1c0c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:11.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b2309e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b1c070a00 0x7f3b1c0c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:11.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b2309e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b1c1590d0 0x7f3b1c0cd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:11.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b2309e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c14c630 con 0x7f3b1c06df40 2023-10-14T11:15:11.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b2309e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c0c70b0 con 0x7f3b1c1590d0 2023-10-14T11:15:11.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b2309e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c0c7390 con 0x7f3b1c070a00 2023-10-14T11:15:11.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b20e3a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b1c06df40 0x7f3b1c0c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:11.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b20e3a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b1c06df40 0x7f3b1c0c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34866/0 (socket says 172.21.15.26:34866) 2023-10-14T11:15:11.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b20e3a640 1 -- 172.21.15.26:0/3358734343 learned_addr learned my addr 172.21.15.26:0/3358734343 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:11.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b2163b640 1 --2- 172.21.15.26:0/3358734343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b1c1590d0 0x7f3b1c0cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:11.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b1bfff640 1 --2- 172.21.15.26:0/3358734343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b1c070a00 0x7f3b1c0c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:11.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b20e3a640 1 -- 172.21.15.26:0/3358734343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b1c070a00 msgr2=0x7f3b1c0c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:11.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b20e3a640 1 --2- 172.21.15.26:0/3358734343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b1c070a00 0x7f3b1c0c66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:11.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b20e3a640 1 -- 172.21.15.26:0/3358734343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b1c1590d0 msgr2=0x7f3b1c0cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:11.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b20e3a640 1 --2- 172.21.15.26:0/3358734343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b1c1590d0 0x7f3b1c0cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:11.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b20e3a640 1 -- 172.21.15.26:0/3358734343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b14009a70 con 0x7f3b1c06df40 2023-10-14T11:15:11.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b2163b640 1 --2- 172.21.15.26:0/3358734343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b1c1590d0 0x7f3b1c0cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:15:11.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b1bfff640 1 --2- 172.21.15.26:0/3358734343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b1c070a00 0x7f3b1c0c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:15:11.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b20e3a640 1 --2- 172.21.15.26:0/3358734343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b1c06df40 0x7f3b1c0c4760 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000c700 tx=0x7f3b1000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:11.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b197fa640 1 -- 172.21.15.26:0/3358734343 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b10005cf0 con 0x7f3b1c06df40 2023-10-14T11:15:11.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b197fa640 1 -- 172.21.15.26:0/3358734343 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b10005e70 con 0x7f3b1c06df40 2023-10-14T11:15:11.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b197fa640 1 -- 172.21.15.26:0/3358734343 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b10007290 con 0x7f3b1c06df40 2023-10-14T11:15:11.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.139+0000 7f3b2309e640 1 -- 172.21.15.26:0/3358734343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b1c0ca820 con 0x7f3b1c06df40 2023-10-14T11:15:11.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.143+0000 7f3b2309e640 1 -- 172.21.15.26:0/3358734343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b1c0c7950 con 0x7f3b1c06df40 2023-10-14T11:15:11.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.143+0000 7f3b2309e640 1 -- 172.21.15.26:0/3358734343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b1c14c7e0 con 0x7f3b1c06df40 2023-10-14T11:15:11.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.143+0000 7f3b197fa640 1 -- 172.21.15.26:0/3358734343 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3b100073f0 con 0x7f3b1c06df40 2023-10-14T11:15:11.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.143+0000 7f3b197fa640 1 --2- 172.21.15.26:0/3358734343 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3b000664d0 0x7f3b00068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:11.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.143+0000 7f3b197fa640 1 -- 172.21.15.26:0/3358734343 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f3b100837f0 con 0x7f3b1c06df40 2023-10-14T11:15:11.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.143+0000 7f3b1bfff640 1 --2- 172.21.15.26:0/3358734343 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3b000664d0 0x7f3b00068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:11.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.143+0000 7f3b1bfff640 1 --2- 172.21.15.26:0/3358734343 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3b000664d0 0x7f3b00068990 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c0aeea0 tx=0x7f3b08009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:11.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.147+0000 7f3b197fa640 1 -- 172.21.15.26:0/3358734343 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3b1c14c7e0 con 0x7f3b1c06df40 2023-10-14T11:15:11.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.307+0000 7f3b2309e640 1 -- 172.21.15.26:0/3358734343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b1c06d0a0 con 0x7f3b1c06df40 2023-10-14T11:15:11.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.307+0000 7f3b197fa640 1 -- 172.21.15.26:0/3358734343 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b10050a70 con 0x7f3b1c06df40 2023-10-14T11:15:11.313 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:15:11.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.307+0000 7f3b2309e640 1 -- 172.21.15.26:0/3358734343 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3b000664d0 msgr2=0x7f3b00068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:11.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.307+0000 7f3b2309e640 1 --2- 172.21.15.26:0/3358734343 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3b000664d0 0x7f3b00068990 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c0aeea0 tx=0x7f3b08009040 comp rx=0 tx=0).stop 2023-10-14T11:15:11.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.307+0000 7f3b2309e640 1 -- 172.21.15.26:0/3358734343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b1c06df40 msgr2=0x7f3b1c0c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:11.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.307+0000 7f3b2309e640 1 --2- 172.21.15.26:0/3358734343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b1c06df40 0x7f3b1c0c4760 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000c700 tx=0x7f3b1000cbc0 comp rx=0 tx=0).stop 2023-10-14T11:15:11.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.307+0000 7f3b2309e640 1 -- 172.21.15.26:0/3358734343 shutdown_connections 2023-10-14T11:15:11.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.307+0000 7f3b2309e640 1 --2- 172.21.15.26:0/3358734343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b1c1590d0 0x7f3b1c0cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:11.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.307+0000 7f3b2309e640 1 --2- 172.21.15.26:0/3358734343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b1c070a00 0x7f3b1c0c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:11.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.307+0000 7f3b2309e640 1 --2- 172.21.15.26:0/3358734343 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3b000664d0 0x7f3b00068990 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:11.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.307+0000 7f3b2309e640 1 --2- 172.21.15.26:0/3358734343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b1c06df40 0x7f3b1c0c4760 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:11.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.307+0000 7f3b2309e640 1 -- 172.21.15.26:0/3358734343 >> 172.21.15.26:0/3358734343 conn(0x7f3b1c0b0da0 msgr2=0x7f3b1c0ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:11.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.307+0000 7f3b2309e640 1 -- 172.21.15.26:0/3358734343 shutdown_connections 2023-10-14T11:15:11.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.307+0000 7f3b2309e640 1 -- 172.21.15.26:0/3358734343 wait complete. 2023-10-14T11:15:11.334 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_metadata pg_num 2023-10-14T11:15:11.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.475+0000 7f3696268640 1 Processor -- start 2023-10-14T11:15:11.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.475+0000 7f3696268640 1 -- start start 2023-10-14T11:15:11.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.475+0000 7f3696268640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36900ceda0 0x7f3690167be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:11.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.475+0000 7f3696268640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36900cc330 con 0x7f36900cb040 2023-10-14T11:15:11.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.475+0000 7f3696268640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36900cb4d0 con 0x7f369015cc60 2023-10-14T11:15:11.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.475+0000 7f3696268640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36900cb720 con 0x7f36900ceda0 2023-10-14T11:15:11.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.475+0000 7f368f7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f36900cb040 0x7f36900ce690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53186/0 (socket says 172.21.15.26:53186) 2023-10-14T11:15:11.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.475+0000 7f368f7fe640 1 -- 172.21.15.26:0/3299830355 learned_addr learned my addr 172.21.15.26:0/3299830355 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:11.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.475+0000 7f3694805640 1 --2- 172.21.15.26:0/3299830355 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36900ceda0 0x7f3690167be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:11.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.475+0000 7f368effd640 1 -- 172.21.15.26:0/3299830355 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 94935065 0 0) 0x7f36900cc330 con 0x7f36900cb040 2023-10-14T11:15:11.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.475+0000 7f368effd640 1 -- 172.21.15.26:0/3299830355 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3678003530 con 0x7f36900cb040 2023-10-14T11:15:11.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.475+0000 7f368effd640 1 -- 172.21.15.26:0/3299830355 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461265648 0 0) 0x7f36900cb4d0 con 0x7f369015cc60 2023-10-14T11:15:11.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.475+0000 7f368effd640 1 -- 172.21.15.26:0/3299830355 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36900cc330 con 0x7f369015cc60 2023-10-14T11:15:11.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.475+0000 7f3694805640 1 -- 172.21.15.26:0/3299830355 >> v1:172.21.15.110:6789/0 conn(0x7f369015cc60 legacy=0x7f3690161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:11.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.475+0000 7f3694805640 1 -- 172.21.15.26:0/3299830355 >> v1:172.21.15.26:6789/0 conn(0x7f36900cb040 legacy=0x7f36900ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:11.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.475+0000 7f3694805640 1 -- 172.21.15.26:0/3299830355 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36900cba00 con 0x7f36900ceda0 2023-10-14T11:15:11.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.479+0000 7f3694805640 1 --2- 172.21.15.26:0/3299830355 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36900ceda0 0x7f3690167be0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3688009dc0 tx=0x7f368801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96722f36eb2d30c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:11.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.479+0000 7f368effd640 1 -- 172.21.15.26:0/3299830355 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36880a5a00 con 0x7f36900ceda0 2023-10-14T11:15:11.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.479+0000 7f368effd640 1 -- 172.21.15.26:0/3299830355 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36880a5b60 con 0x7f36900ceda0 2023-10-14T11:15:11.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.479+0000 7f368effd640 1 -- 172.21.15.26:0/3299830355 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36880ad440 con 0x7f36900ceda0 2023-10-14T11:15:11.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.479+0000 7f3696268640 1 -- 172.21.15.26:0/3299830355 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36900ceda0 msgr2=0x7f3690167be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:11.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.479+0000 7f3696268640 1 --2- 172.21.15.26:0/3299830355 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36900ceda0 0x7f3690167be0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3688009dc0 tx=0x7f368801c940 comp rx=0 tx=0).stop 2023-10-14T11:15:11.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.479+0000 7f3696268640 1 -- 172.21.15.26:0/3299830355 shutdown_connections 2023-10-14T11:15:11.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.479+0000 7f3696268640 1 --2- 172.21.15.26:0/3299830355 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36900ceda0 0x7f3690167be0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:11.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.479+0000 7f3696268640 1 -- 172.21.15.26:0/3299830355 >> 172.21.15.26:0/3299830355 conn(0x7f369006e570 msgr2=0x7f369006e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:11.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.479+0000 7f3696268640 1 -- 172.21.15.26:0/3299830355 shutdown_connections 2023-10-14T11:15:11.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.479+0000 7f3696268640 1 -- 172.21.15.26:0/3299830355 wait complete. 2023-10-14T11:15:11.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f3696268640 1 Processor -- start 2023-10-14T11:15:11.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f3696268640 1 -- start start 2023-10-14T11:15:11.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f3696268640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36900cb040 0x7f3690151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:11.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f3696268640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36900ceda0 0x7f3690157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:11.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f3696268640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f369015cc60 0x7f3690157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:11.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f3696268640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36901f6200 con 0x7f369015cc60 2023-10-14T11:15:11.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f3696268640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3690151e40 con 0x7f36900cb040 2023-10-14T11:15:11.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f3696268640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36901f6510 con 0x7f36900ceda0 2023-10-14T11:15:11.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f3694805640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f369015cc60 0x7f3690157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:11.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f3694805640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f369015cc60 0x7f3690157ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34878/0 (socket says 172.21.15.26:34878) 2023-10-14T11:15:11.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f3694805640 1 -- 172.21.15.26:0/669821430 learned_addr learned my addr 172.21.15.26:0/669821430 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:11.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f368f7fe640 1 --2- 172.21.15.26:0/669821430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36900ceda0 0x7f3690157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:11.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f368ffff640 1 --2- 172.21.15.26:0/669821430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36900cb040 0x7f3690151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:11.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f3694805640 1 -- 172.21.15.26:0/669821430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36900ceda0 msgr2=0x7f3690157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:11.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f3694805640 1 --2- 172.21.15.26:0/669821430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36900ceda0 0x7f3690157990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:11.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f3694805640 1 -- 172.21.15.26:0/669821430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36900cb040 msgr2=0x7f3690151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:11.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f3694805640 1 --2- 172.21.15.26:0/669821430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36900cb040 0x7f3690151900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:11.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f3694805640 1 -- 172.21.15.26:0/669821430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3688009a70 con 0x7f369015cc60 2023-10-14T11:15:11.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f3694805640 1 --2- 172.21.15.26:0/669821430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f369015cc60 0x7f3690157ed0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f368801a570 tx=0x7f36880196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:11.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f368cff9640 1 -- 172.21.15.26:0/669821430 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36880adc80 con 0x7f369015cc60 2023-10-14T11:15:11.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f368cff9640 1 -- 172.21.15.26:0/669821430 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36880adde0 con 0x7f369015cc60 2023-10-14T11:15:11.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f3696268640 1 -- 172.21.15.26:0/669821430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36901f67f0 con 0x7f369015cc60 2023-10-14T11:15:11.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f368cff9640 1 -- 172.21.15.26:0/669821430 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36880b7650 con 0x7f369015cc60 2023-10-14T11:15:11.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.483+0000 7f3696268640 1 -- 172.21.15.26:0/669821430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36901f6db0 con 0x7f369015cc60 2023-10-14T11:15:11.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.487+0000 7f3696268640 1 -- 172.21.15.26:0/669821430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36901f6fd0 con 0x7f369015cc60 2023-10-14T11:15:11.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.487+0000 7f368cff9640 1 -- 172.21.15.26:0/669821430 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f36880b4050 con 0x7f369015cc60 2023-10-14T11:15:11.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.487+0000 7f368cff9640 1 --2- 172.21.15.26:0/669821430 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f367c0664a0 0x7f367c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:11.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.487+0000 7f368cff9640 1 -- 172.21.15.26:0/669821430 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f368811f190 con 0x7f369015cc60 2023-10-14T11:15:11.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.487+0000 7f368ffff640 1 --2- 172.21.15.26:0/669821430 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f367c0664a0 0x7f367c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:11.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.487+0000 7f368ffff640 1 --2- 172.21.15.26:0/669821430 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f367c0664a0 0x7f367c068960 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f36800011f0 tx=0x7f3680009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:11.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.491+0000 7f368cff9640 1 -- 172.21.15.26:0/669821430 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f36880ec670 con 0x7f369015cc60 2023-10-14T11:15:11.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.647+0000 7f3696268640 1 -- 172.21.15.26:0/669821430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"} v 0) v1 -- 0x7f369004e170 con 0x7f369015cc60 2023-10-14T11:15:11.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.647+0000 7f368cff9640 1 -- 172.21.15.26:0/669821430 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"}]=0 v55) v1 ==== 109+0+11 (secure 0 0 0) 0x7f36880b2020 con 0x7f369015cc60 2023-10-14T11:15:11.654 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:15:11.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.647+0000 7f3696268640 1 -- 172.21.15.26:0/669821430 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f367c0664a0 msgr2=0x7f367c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:11.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.647+0000 7f3696268640 1 --2- 172.21.15.26:0/669821430 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f367c0664a0 0x7f367c068960 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f36800011f0 tx=0x7f3680009040 comp rx=0 tx=0).stop 2023-10-14T11:15:11.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.647+0000 7f3696268640 1 -- 172.21.15.26:0/669821430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f369015cc60 msgr2=0x7f3690157ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:11.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.647+0000 7f3696268640 1 --2- 172.21.15.26:0/669821430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f369015cc60 0x7f3690157ed0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f368801a570 tx=0x7f36880196e0 comp rx=0 tx=0).stop 2023-10-14T11:15:11.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.647+0000 7f3696268640 1 -- 172.21.15.26:0/669821430 shutdown_connections 2023-10-14T11:15:11.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.647+0000 7f3696268640 1 --2- 172.21.15.26:0/669821430 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f367c0664a0 0x7f367c068960 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:11.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.647+0000 7f3696268640 1 --2- 172.21.15.26:0/669821430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f369015cc60 0x7f3690157ed0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:11.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.647+0000 7f3696268640 1 --2- 172.21.15.26:0/669821430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36900ceda0 0x7f3690157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:11.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.647+0000 7f3696268640 1 --2- 172.21.15.26:0/669821430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36900cb040 0x7f3690151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:11.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.647+0000 7f3696268640 1 -- 172.21.15.26:0/669821430 >> 172.21.15.26:0/669821430 conn(0x7f369006e570 msgr2=0x7f3690072820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:11.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.647+0000 7f3696268640 1 -- 172.21.15.26:0/669821430 shutdown_connections 2023-10-14T11:15:11.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.647+0000 7f3696268640 1 -- 172.21.15.26:0/669821430 wait complete. 2023-10-14T11:15:11.676 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_data pg_num 2023-10-14T11:15:11.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.815+0000 7f62ebdaa640 1 Processor -- start 2023-10-14T11:15:11.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.815+0000 7f62ebdaa640 1 -- start start 2023-10-14T11:15:11.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.815+0000 7f62ebdaa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62e406a4d0 0x7f62e40c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:11.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.815+0000 7f62ebdaa640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e406c6d0 con 0x7f62e406a0f0 2023-10-14T11:15:11.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.815+0000 7f62ebdaa640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e406c950 con 0x7f62e40ade00 2023-10-14T11:15:11.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.815+0000 7f62ebdaa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e41654f0 con 0x7f62e406a4d0 2023-10-14T11:15:11.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.815+0000 7f62e9b46640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f62e406a0f0 0x7f62e40ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53194/0 (socket says 172.21.15.26:53194) 2023-10-14T11:15:11.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.815+0000 7f62e9b46640 1 -- 172.21.15.26:0/2451261825 learned_addr learned my addr 172.21.15.26:0/2451261825 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:11.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.815+0000 7f62ea347640 1 --2- 172.21.15.26:0/2451261825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62e406a4d0 0x7f62e40c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:11.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.819+0000 7f62e8b44640 1 -- 172.21.15.26:0/2451261825 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662801248 0 0) 0x7f62e406c6d0 con 0x7f62e406a0f0 2023-10-14T11:15:11.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.819+0000 7f62e8b44640 1 -- 172.21.15.26:0/2451261825 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62d0003530 con 0x7f62e406a0f0 2023-10-14T11:15:11.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.819+0000 7f62e8b44640 1 -- 172.21.15.26:0/2451261825 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794064912 0 0) 0x7f62e406c950 con 0x7f62e40ade00 2023-10-14T11:15:11.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.819+0000 7f62e8b44640 1 -- 172.21.15.26:0/2451261825 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62e406c6d0 con 0x7f62e40ade00 2023-10-14T11:15:11.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.819+0000 7f62ea347640 1 -- 172.21.15.26:0/2451261825 >> v1:172.21.15.110:6789/0 conn(0x7f62e40ade00 legacy=0x7f62e406ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:11.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.819+0000 7f62ea347640 1 -- 172.21.15.26:0/2451261825 >> v1:172.21.15.26:6789/0 conn(0x7f62e406a0f0 legacy=0x7f62e40ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:11.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.819+0000 7f62ea347640 1 -- 172.21.15.26:0/2451261825 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e41657d0 con 0x7f62e406a4d0 2023-10-14T11:15:11.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.819+0000 7f62ea347640 1 --2- 172.21.15.26:0/2451261825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62e406a4d0 0x7f62e40c8dd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009dc0 tx=0x7f62dc01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=832ac868ceedb9cb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:11.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.819+0000 7f62e8b44640 1 -- 172.21.15.26:0/2451261825 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0a5a50 con 0x7f62e406a4d0 2023-10-14T11:15:11.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.819+0000 7f62e8b44640 1 -- 172.21.15.26:0/2451261825 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc0a5bb0 con 0x7f62e406a4d0 2023-10-14T11:15:11.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.819+0000 7f62e8b44640 1 -- 172.21.15.26:0/2451261825 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0ad440 con 0x7f62e406a4d0 2023-10-14T11:15:11.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62ebdaa640 1 -- 172.21.15.26:0/2451261825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62e406a4d0 msgr2=0x7f62e40c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:11.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62ebdaa640 1 --2- 172.21.15.26:0/2451261825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62e406a4d0 0x7f62e40c8dd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009dc0 tx=0x7f62dc01c970 comp rx=0 tx=0).stop 2023-10-14T11:15:11.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62ebdaa640 1 -- 172.21.15.26:0/2451261825 shutdown_connections 2023-10-14T11:15:11.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62ebdaa640 1 --2- 172.21.15.26:0/2451261825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62e406a4d0 0x7f62e40c8dd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:11.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62ebdaa640 1 -- 172.21.15.26:0/2451261825 >> 172.21.15.26:0/2451261825 conn(0x7f62e40b0da0 msgr2=0x7f62e40ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:11.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62ebdaa640 1 -- 172.21.15.26:0/2451261825 shutdown_connections 2023-10-14T11:15:11.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62ebdaa640 1 -- 172.21.15.26:0/2451261825 wait complete. 2023-10-14T11:15:11.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62ebdaa640 1 Processor -- start 2023-10-14T11:15:11.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62ebdaa640 1 -- start start 2023-10-14T11:15:11.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62ebdaa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62e406a0f0 0x7f62e415d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:11.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62ebdaa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62e406a4d0 0x7f62e40c2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:11.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62ebdaa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62e40ade00 0x7f62e40c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:11.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62ebdaa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e415dbc0 con 0x7f62e406a0f0 2023-10-14T11:15:11.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62ebdaa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e40b2f10 con 0x7f62e40ade00 2023-10-14T11:15:11.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62ebdaa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e40c2790 con 0x7f62e406a4d0 2023-10-14T11:15:11.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62e9b46640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62e406a0f0 0x7f62e415d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:11.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62e9b46640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62e406a0f0 0x7f62e415d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34890/0 (socket says 172.21.15.26:34890) 2023-10-14T11:15:11.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62e9b46640 1 -- 172.21.15.26:0/2321130226 learned_addr learned my addr 172.21.15.26:0/2321130226 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:11.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62e9345640 1 --2- 172.21.15.26:0/2321130226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62e406a4d0 0x7f62e40c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:11.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62ea347640 1 --2- 172.21.15.26:0/2321130226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62e40ade00 0x7f62e40c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:11.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62e9b46640 1 -- 172.21.15.26:0/2321130226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62e406a4d0 msgr2=0x7f62e40c2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:11.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62e9b46640 1 --2- 172.21.15.26:0/2321130226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62e406a4d0 0x7f62e40c2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:11.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62e9b46640 1 -- 172.21.15.26:0/2321130226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62e40ade00 msgr2=0x7f62e40c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:11.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62e9b46640 1 --2- 172.21.15.26:0/2321130226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62e40ade00 0x7f62e40c4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:11.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62e9b46640 1 -- 172.21.15.26:0/2321130226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62dc009a70 con 0x7f62e406a0f0 2023-10-14T11:15:11.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.823+0000 7f62e9345640 1 --2- 172.21.15.26:0/2321130226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62e406a4d0 0x7f62e40c2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:11.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.827+0000 7f62e9b46640 1 --2- 172.21.15.26:0/2321130226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62e406a0f0 0x7f62e415d680 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f62e000c560 tx=0x7f62e000ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:11.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.827+0000 7f62da7fc640 1 -- 172.21.15.26:0/2321130226 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e0005cf0 con 0x7f62e406a0f0 2023-10-14T11:15:11.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.827+0000 7f62da7fc640 1 -- 172.21.15.26:0/2321130226 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e0005e50 con 0x7f62e406a0f0 2023-10-14T11:15:11.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.827+0000 7f62da7fc640 1 -- 172.21.15.26:0/2321130226 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e0007290 con 0x7f62e406a0f0 2023-10-14T11:15:11.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.827+0000 7f62ebdaa640 1 -- 172.21.15.26:0/2321130226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e40b25e0 con 0x7f62e406a0f0 2023-10-14T11:15:11.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.827+0000 7f62ebdaa640 1 -- 172.21.15.26:0/2321130226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e40b2ba0 con 0x7f62e406a0f0 2023-10-14T11:15:11.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.827+0000 7f62ebdaa640 1 -- 172.21.15.26:0/2321130226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e404e170 con 0x7f62e406a0f0 2023-10-14T11:15:11.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.827+0000 7f62da7fc640 1 -- 172.21.15.26:0/2321130226 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f62e00073f0 con 0x7f62e406a0f0 2023-10-14T11:15:11.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.827+0000 7f62da7fc640 1 --2- 172.21.15.26:0/2321130226 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62c80664a0 0x7f62c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:11.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.827+0000 7f62da7fc640 1 -- 172.21.15.26:0/2321130226 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f62e0083520 con 0x7f62e406a0f0 2023-10-14T11:15:11.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.827+0000 7f62e9345640 1 --2- 172.21.15.26:0/2321130226 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62c80664a0 0x7f62c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:11.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.831+0000 7f62e9345640 1 --2- 172.21.15.26:0/2321130226 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62c80664a0 0x7f62c8068960 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f62e4163460 tx=0x7f62d4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:11.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.831+0000 7f62da7fc640 1 -- 172.21.15.26:0/2321130226 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f62e00508f0 con 0x7f62e406a0f0 2023-10-14T11:15:11.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.991+0000 7f62ebdaa640 1 -- 172.21.15.26:0/2321130226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"} v 0) v1 -- 0x7f62e40c19d0 con 0x7f62e406a0f0 2023-10-14T11:15:11.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.991+0000 7f62da7fc640 1 -- 172.21.15.26:0/2321130226 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"}]=0 v55) v1 ==== 105+0+11 (secure 0 0 0) 0x7f62e0053f10 con 0x7f62e406a0f0 2023-10-14T11:15:11.997 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:15:11.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.991+0000 7f62ebdaa640 1 -- 172.21.15.26:0/2321130226 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62c80664a0 msgr2=0x7f62c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:11.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.991+0000 7f62ebdaa640 1 --2- 172.21.15.26:0/2321130226 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62c80664a0 0x7f62c8068960 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f62e4163460 tx=0x7f62d4009040 comp rx=0 tx=0).stop 2023-10-14T11:15:11.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.991+0000 7f62ebdaa640 1 -- 172.21.15.26:0/2321130226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62e406a0f0 msgr2=0x7f62e415d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:11.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.991+0000 7f62ebdaa640 1 --2- 172.21.15.26:0/2321130226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62e406a0f0 0x7f62e415d680 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f62e000c560 tx=0x7f62e000ca20 comp rx=0 tx=0).stop 2023-10-14T11:15:11.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.991+0000 7f62ebdaa640 1 -- 172.21.15.26:0/2321130226 shutdown_connections 2023-10-14T11:15:11.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.991+0000 7f62ebdaa640 1 --2- 172.21.15.26:0/2321130226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62e40ade00 0x7f62e40c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:11.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.991+0000 7f62ebdaa640 1 --2- 172.21.15.26:0/2321130226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62e406a4d0 0x7f62e40c2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:12.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.991+0000 7f62ebdaa640 1 --2- 172.21.15.26:0/2321130226 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62c80664a0 0x7f62c8068960 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:12.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.991+0000 7f62ebdaa640 1 --2- 172.21.15.26:0/2321130226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62e406a0f0 0x7f62e415d680 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:12.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.991+0000 7f62ebdaa640 1 -- 172.21.15.26:0/2321130226 >> 172.21.15.26:0/2321130226 conn(0x7f62e40b0da0 msgr2=0x7f62e406dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:12.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.991+0000 7f62ebdaa640 1 -- 172.21.15.26:0/2321130226 shutdown_connections 2023-10-14T11:15:12.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:11.991+0000 7f62ebdaa640 1 -- 172.21.15.26:0/2321130226 wait complete. 2023-10-14T11:15:12.017 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:15:12.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.155+0000 7f5e46fd9640 1 Processor -- start 2023-10-14T11:15:12.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.155+0000 7f5e46fd9640 1 -- start start 2023-10-14T11:15:12.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.155+0000 7f5e46fd9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e400c8cb0 0x7f5e400cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:12.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.155+0000 7f5e46fd9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e400723d0 con 0x7f5e401597c0 2023-10-14T11:15:12.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.155+0000 7f5e46fd9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e400717c0 con 0x7f5e40159ba0 2023-10-14T11:15:12.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.155+0000 7f5e46fd9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e40071aa0 con 0x7f5e400c8cb0 2023-10-14T11:15:12.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.155+0000 7f5e44d75640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5e401597c0 0x7f5e400ad6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53204/0 (socket says 172.21.15.26:53204) 2023-10-14T11:15:12.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.155+0000 7f5e44d75640 1 -- 172.21.15.26:0/2472899709 learned_addr learned my addr 172.21.15.26:0/2472899709 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:12.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e45576640 1 --2- 172.21.15.26:0/2472899709 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e400c8cb0 0x7f5e400cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:12.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e3f7fe640 1 -- 172.21.15.26:0/2472899709 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4159926707 0 0) 0x7f5e400723d0 con 0x7f5e401597c0 2023-10-14T11:15:12.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e3f7fe640 1 -- 172.21.15.26:0/2472899709 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e30003530 con 0x7f5e401597c0 2023-10-14T11:15:12.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e3f7fe640 1 -- 172.21.15.26:0/2472899709 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3783712316 0 0) 0x7f5e400717c0 con 0x7f5e40159ba0 2023-10-14T11:15:12.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e3f7fe640 1 -- 172.21.15.26:0/2472899709 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e400723d0 con 0x7f5e40159ba0 2023-10-14T11:15:12.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e3f7fe640 1 -- 172.21.15.26:0/2472899709 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 944123729 0 0) 0x7f5e30003530 con 0x7f5e401597c0 2023-10-14T11:15:12.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e3f7fe640 1 -- 172.21.15.26:0/2472899709 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e400c8cb0 msgr2=0x7f5e400cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:12.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e3f7fe640 1 --2- 172.21.15.26:0/2472899709 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e400c8cb0 0x7f5e400cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:12.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e3f7fe640 1 -- 172.21.15.26:0/2472899709 >> v1:172.21.15.110:6789/0 conn(0x7f5e40159ba0 legacy=0x7f5e400cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:12.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e3f7fe640 1 -- 172.21.15.26:0/2472899709 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e40071d80 con 0x7f5e401597c0 2023-10-14T11:15:12.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e3f7fe640 1 -- 172.21.15.26:0/2472899709 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f5e34001680 con 0x7f5e401597c0 2023-10-14T11:15:12.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e3f7fe640 1 -- 172.21.15.26:0/2472899709 >> v1:172.21.15.26:6789/0 conn(0x7f5e401597c0 legacy=0x7f5e400ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:12.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e3f7fe640 1 --2- 172.21.15.26:0/2472899709 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e400c8cb0 0x7f5e30003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:12.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e3f7fe640 1 --2- 172.21.15.26:0/2472899709 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e300040a0 0x7f5e300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:12.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e3f7fe640 1 --2- 172.21.15.26:0/2472899709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e30004d10 0x7f5e30005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:12.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e3f7fe640 1 -- 172.21.15.26:0/2472899709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e40071aa0 con 0x7f5e30004d10 2023-10-14T11:15:12.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e3f7fe640 1 -- 172.21.15.26:0/2472899709 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3000ba70 con 0x7f5e300040a0 2023-10-14T11:15:12.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e3f7fe640 1 -- 172.21.15.26:0/2472899709 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3000bc30 con 0x7f5e400c8cb0 2023-10-14T11:15:12.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e45576640 1 --2- 172.21.15.26:0/2472899709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e30004d10 0x7f5e30005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:12.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e44d75640 1 --2- 172.21.15.26:0/2472899709 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e400c8cb0 0x7f5e30003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:12.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e3ffff640 1 --2- 172.21.15.26:0/2472899709 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e300040a0 0x7f5e300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:12.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e45576640 1 -- 172.21.15.26:0/2472899709 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e400c8cb0 msgr2=0x7f5e30003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:12.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e45576640 1 --2- 172.21.15.26:0/2472899709 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e400c8cb0 0x7f5e30003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:12.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e45576640 1 -- 172.21.15.26:0/2472899709 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e300040a0 msgr2=0x7f5e300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:12.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e45576640 1 --2- 172.21.15.26:0/2472899709 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e300040a0 0x7f5e300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:12.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.159+0000 7f5e45576640 1 -- 172.21.15.26:0/2472899709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e30003530 con 0x7f5e30004d10 2023-10-14T11:15:12.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.163+0000 7f5e45576640 1 --2- 172.21.15.26:0/2472899709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e30004d10 0x7f5e30005190 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009fc0 tx=0x7f5e3801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160315d4f110a6cd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:12.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.163+0000 7f5e3f7fe640 1 -- 172.21.15.26:0/2472899709 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e34007ea0 con 0x7f5e30004d10 2023-10-14T11:15:12.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.163+0000 7f5e3f7fe640 1 -- 172.21.15.26:0/2472899709 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3800f040 con 0x7f5e30004d10 2023-10-14T11:15:12.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.163+0000 7f5e3f7fe640 1 -- 172.21.15.26:0/2472899709 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e380a5da0 con 0x7f5e30004d10 2023-10-14T11:15:12.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.163+0000 7f5e46fd9640 1 -- 172.21.15.26:0/2472899709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e30004d10 msgr2=0x7f5e30005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:12.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.163+0000 7f5e46fd9640 1 --2- 172.21.15.26:0/2472899709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e30004d10 0x7f5e30005190 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009fc0 tx=0x7f5e3801cc60 comp rx=0 tx=0).stop 2023-10-14T11:15:12.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.163+0000 7f5e45576640 1 -- 172.21.15.26:0/2472899709 reap_dead start 2023-10-14T11:15:12.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.163+0000 7f5e46fd9640 1 -- 172.21.15.26:0/2472899709 shutdown_connections 2023-10-14T11:15:12.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.163+0000 7f5e46fd9640 1 -- 172.21.15.26:0/2472899709 >> 172.21.15.26:0/2472899709 conn(0x7f5e4006c190 msgr2=0x7f5e4006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:12.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.163+0000 7f5e46fd9640 1 -- 172.21.15.26:0/2472899709 shutdown_connections 2023-10-14T11:15:12.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.163+0000 7f5e46fd9640 1 -- 172.21.15.26:0/2472899709 wait complete. 2023-10-14T11:15:12.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.163+0000 7f5e46fd9640 1 Processor -- start 2023-10-14T11:15:12.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.163+0000 7f5e46fd9640 1 -- start start 2023-10-14T11:15:12.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e46fd9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e30004d10 0x7f5e401f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:12.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e46fd9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e400aeee0 0x7f5e401555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:12.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e46fd9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e400af360 0x7f5e401471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:12.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e46fd9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e40157400 con 0x7f5e400aeee0 2023-10-14T11:15:12.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e46fd9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e401576e0 con 0x7f5e30004d10 2023-10-14T11:15:12.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e46fd9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e401579c0 con 0x7f5e400af360 2023-10-14T11:15:12.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e3ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e400aeee0 0x7f5e401555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:12.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e3ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e400aeee0 0x7f5e401555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34910/0 (socket says 172.21.15.26:34910) 2023-10-14T11:15:12.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e3ffff640 1 -- 172.21.15.26:0/4002347452 learned_addr learned my addr 172.21.15.26:0/4002347452 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:12.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e44d75640 1 --2- 172.21.15.26:0/4002347452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e30004d10 0x7f5e401f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:12.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e3ffff640 1 -- 172.21.15.26:0/4002347452 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e400af360 msgr2=0x7f5e401471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:12.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e3ffff640 1 --2- 172.21.15.26:0/4002347452 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e400af360 0x7f5e401471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:12.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e3ffff640 1 -- 172.21.15.26:0/4002347452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e30004d10 msgr2=0x7f5e401f1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:12.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e3ffff640 1 --2- 172.21.15.26:0/4002347452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e30004d10 0x7f5e401f1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:12.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e3ffff640 1 -- 172.21.15.26:0/4002347452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e40157ca0 con 0x7f5e400aeee0 2023-10-14T11:15:12.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e3ffff640 1 --2- 172.21.15.26:0/4002347452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e400aeee0 0x7f5e401555c0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00f700 tx=0x7f5e2c00fbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:12.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e3d7fa640 1 -- 172.21.15.26:0/4002347452 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c0050d0 con 0x7f5e400aeee0 2023-10-14T11:15:12.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e3d7fa640 1 -- 172.21.15.26:0/4002347452 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c005230 con 0x7f5e400aeee0 2023-10-14T11:15:12.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e3d7fa640 1 -- 172.21.15.26:0/4002347452 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c00d6b0 con 0x7f5e400aeee0 2023-10-14T11:15:12.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e46fd9640 1 -- 172.21.15.26:0/4002347452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e401f2000 con 0x7f5e400aeee0 2023-10-14T11:15:12.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e46fd9640 1 -- 172.21.15.26:0/4002347452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e40155b00 con 0x7f5e400aeee0 2023-10-14T11:15:12.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e46fd9640 1 -- 172.21.15.26:0/4002347452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e40074010 con 0x7f5e400aeee0 2023-10-14T11:15:12.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.167+0000 7f5e3d7fa640 1 -- 172.21.15.26:0/4002347452 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5e2c00d810 con 0x7f5e400aeee0 2023-10-14T11:15:12.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.171+0000 7f5e3d7fa640 1 --2- 172.21.15.26:0/4002347452 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5e240664d0 0x7f5e24068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:12.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.171+0000 7f5e3d7fa640 1 -- 172.21.15.26:0/4002347452 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f5e2c083fa0 con 0x7f5e400aeee0 2023-10-14T11:15:12.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.171+0000 7f5e44d75640 1 --2- 172.21.15.26:0/4002347452 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5e240664d0 0x7f5e24068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:12.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.171+0000 7f5e44d75640 1 --2- 172.21.15.26:0/4002347452 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5e240664d0 0x7f5e24068990 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5e34001c50 tx=0x7f5e34009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:12.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.175+0000 7f5e3d7fa640 1 -- 172.21.15.26:0/4002347452 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5e2c0b5090 con 0x7f5e400aeee0 2023-10-14T11:15:12.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.343+0000 7f5e46fd9640 1 -- 172.21.15.26:0/4002347452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5e40157540 con 0x7f5e400aeee0 2023-10-14T11:15:12.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.343+0000 7f5e3d7fa640 1 -- 172.21.15.26:0/4002347452 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v55) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5e40157540 con 0x7f5e400aeee0 2023-10-14T11:15:12.349 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-10-14T11:15:12.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.343+0000 7f5e46fd9640 1 -- 172.21.15.26:0/4002347452 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5e240664d0 msgr2=0x7f5e24068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:12.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.343+0000 7f5e46fd9640 1 --2- 172.21.15.26:0/4002347452 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5e240664d0 0x7f5e24068990 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5e34001c50 tx=0x7f5e34009040 comp rx=0 tx=0).stop 2023-10-14T11:15:12.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.343+0000 7f5e46fd9640 1 -- 172.21.15.26:0/4002347452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e400aeee0 msgr2=0x7f5e401555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:12.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.343+0000 7f5e46fd9640 1 --2- 172.21.15.26:0/4002347452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e400aeee0 0x7f5e401555c0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00f700 tx=0x7f5e2c00fbc0 comp rx=0 tx=0).stop 2023-10-14T11:15:12.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.343+0000 7f5e46fd9640 1 -- 172.21.15.26:0/4002347452 shutdown_connections 2023-10-14T11:15:12.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.343+0000 7f5e46fd9640 1 --2- 172.21.15.26:0/4002347452 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e400af360 0x7f5e401471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:12.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.343+0000 7f5e46fd9640 1 --2- 172.21.15.26:0/4002347452 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5e240664d0 0x7f5e24068990 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:12.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.343+0000 7f5e46fd9640 1 --2- 172.21.15.26:0/4002347452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e400aeee0 0x7f5e401555c0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:12.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.343+0000 7f5e46fd9640 1 --2- 172.21.15.26:0/4002347452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e30004d10 0x7f5e401f1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:12.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.343+0000 7f5e46fd9640 1 -- 172.21.15.26:0/4002347452 >> 172.21.15.26:0/4002347452 conn(0x7f5e4006c190 msgr2=0x7f5e400cdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:12.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.343+0000 7f5e46fd9640 1 -- 172.21.15.26:0/4002347452 shutdown_connections 2023-10-14T11:15:12.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.343+0000 7f5e46fd9640 1 -- 172.21.15.26:0/4002347452 wait complete. 2023-10-14T11:15:12.371 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi026.front.sepia.ceph.com... 2023-10-14T11:15:12.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:12.372 DEBUG:teuthology.orchestra.run.smithi026:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-14T11:15:12.391 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[51740]: fuse finished with error 0 and tester_r 0 2023-10-14T11:15:12.394 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T11:15:12.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:12.395 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T11:15:12.561 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:15:12.562 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:15:12.573 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7574 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-14T11:15:12.573 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2023-10-14T11:15:12.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:12.574 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T11:15:12.622 INFO:teuthology.orchestra.run.smithi110.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-14T11:15:12.623 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:15:12.624 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:15:12.624 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:15:12.634 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357764k,nr_inodes=4089441,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7700 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-14T11:15:12.634 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T11:15:12.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:12.635 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-14T11:15:12.688 INFO:teuthology.orchestra.run.smithi026.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-14T11:15:12.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:15:12.689 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:15:12.690 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:15:12.699 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7574 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-14T11:15:12.700 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2023-10-14T11:15:12.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:12.700 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-14T11:15:12.750 INFO:teuthology.orchestra.run.smithi110.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-14T11:15:12.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:15:12.752 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:15:12.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.891+0000 7fad5d609640 1 Processor -- start 2023-10-14T11:15:12.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.891+0000 7fad5d609640 1 -- start start 2023-10-14T11:15:12.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.891+0000 7fad5d609640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad5815ca70 0x7fad580d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:12.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.891+0000 7fad5d609640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fad580cf7a0 0x7fad580c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:12.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.891+0000 7fad5d609640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad580c65f0 con 0x7fad580d3550 2023-10-14T11:15:12.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.891+0000 7fad5d609640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad580ce820 con 0x7fad580cf7a0 2023-10-14T11:15:12.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.891+0000 7fad5d609640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad580cdf80 con 0x7fad5815ca70 2023-10-14T11:15:12.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.891+0000 7fad577fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fad580cf7a0 0x7fad580c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:12.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.891+0000 7fad577fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fad580cf7a0 0x7fad580c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34070/0 (socket says 172.21.15.26:34070) 2023-10-14T11:15:12.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.891+0000 7fad577fe640 1 -- 172.21.15.26:0/3117997450 learned_addr learned my addr 172.21.15.26:0/3117997450 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:12.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.891+0000 7fad56ffd640 1 --2- 172.21.15.26:0/3117997450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad5815ca70 0x7fad580d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:12.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.891+0000 7fad577fe640 1 -- 172.21.15.26:0/3117997450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad5815ca70 msgr2=0x7fad580d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:12.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.891+0000 7fad577fe640 1 --2- 172.21.15.26:0/3117997450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad5815ca70 0x7fad580d3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:12.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.891+0000 7fad577fe640 1 -- 172.21.15.26:0/3117997450 >> v1:172.21.15.26:6789/0 conn(0x7fad580d3550 legacy=0x7fad580cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:12.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.891+0000 7fad577fe640 1 -- 172.21.15.26:0/3117997450 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad580ce260 con 0x7fad580cf7a0 2023-10-14T11:15:12.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.895+0000 7fad577fe640 1 --2- 172.21.15.26:0/3117997450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad580cf7a0 0x7fad580c6ad0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fad50009e50 tx=0x7fad5001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec48ebe99e0859e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:12.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.895+0000 7fad567fc640 1 -- 172.21.15.26:0/3117997450 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad500a5810 con 0x7fad580cf7a0 2023-10-14T11:15:12.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.895+0000 7fad567fc640 1 -- 172.21.15.26:0/3117997450 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad500a5970 con 0x7fad580cf7a0 2023-10-14T11:15:12.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.895+0000 7fad567fc640 1 -- 172.21.15.26:0/3117997450 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad500a5d00 con 0x7fad580cf7a0 2023-10-14T11:15:12.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.895+0000 7fad5d609640 1 -- 172.21.15.26:0/3117997450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad580cf7a0 msgr2=0x7fad580c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:12.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.895+0000 7fad5d609640 1 --2- 172.21.15.26:0/3117997450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad580cf7a0 0x7fad580c6ad0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fad50009e50 tx=0x7fad5001c9e0 comp rx=0 tx=0).stop 2023-10-14T11:15:12.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.895+0000 7fad5d609640 1 -- 172.21.15.26:0/3117997450 shutdown_connections 2023-10-14T11:15:12.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.895+0000 7fad5d609640 1 --2- 172.21.15.26:0/3117997450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad580cf7a0 0x7fad580c6ad0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:12.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.895+0000 7fad5d609640 1 --2- 172.21.15.26:0/3117997450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad5815ca70 0x7fad580d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:12.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.895+0000 7fad5d609640 1 -- 172.21.15.26:0/3117997450 >> 172.21.15.26:0/3117997450 conn(0x7fad5809bc50 msgr2=0x7fad580d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:12.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.895+0000 7fad5d609640 1 -- 172.21.15.26:0/3117997450 shutdown_connections 2023-10-14T11:15:12.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.895+0000 7fad5d609640 1 -- 172.21.15.26:0/3117997450 wait complete. 2023-10-14T11:15:12.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad5d609640 1 Processor -- start 2023-10-14T11:15:12.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad5d609640 1 -- start start 2023-10-14T11:15:12.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad5d609640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad580cf7a0 0x7fad5814f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:12.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad5d609640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad580d3550 0x7fad5814ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:12.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad5d609640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad5815ca70 0x7fad580b7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:12.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad5d609640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad580b56b0 con 0x7fad5815ca70 2023-10-14T11:15:12.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad5d609640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5814fd70 con 0x7fad580d3550 2023-10-14T11:15:12.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad5d609640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5814e310 con 0x7fad580cf7a0 2023-10-14T11:15:12.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad577fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad5815ca70 0x7fad580b7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:12.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad577fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad5815ca70 0x7fad580b7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34086/0 (socket says 172.21.15.26:34086) 2023-10-14T11:15:12.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad56ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad580cf7a0 0x7fad5814f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:12.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad577fe640 1 -- 172.21.15.26:0/3170678373 learned_addr learned my addr 172.21.15.26:0/3170678373 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:12.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad4ffff640 1 --2- 172.21.15.26:0/3170678373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad580d3550 0x7fad5814ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:12.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad577fe640 1 -- 172.21.15.26:0/3170678373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad580cf7a0 msgr2=0x7fad5814f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:12.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad577fe640 1 --2- 172.21.15.26:0/3170678373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad580cf7a0 0x7fad5814f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:12.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad577fe640 1 -- 172.21.15.26:0/3170678373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad580d3550 msgr2=0x7fad5814ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:12.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad577fe640 1 --2- 172.21.15.26:0/3170678373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad580d3550 0x7fad5814ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:12.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad577fe640 1 -- 172.21.15.26:0/3170678373 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad50009b30 con 0x7fad5815ca70 2023-10-14T11:15:12.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad577fe640 1 --2- 172.21.15.26:0/3170678373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad5815ca70 0x7fad580b7e70 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fad5001a610 tx=0x7fad50019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:12.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad4f7fe640 1 -- 172.21.15.26:0/3170678373 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad500b8670 con 0x7fad5815ca70 2023-10-14T11:15:12.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad4f7fe640 1 -- 172.21.15.26:0/3170678373 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad500b87d0 con 0x7fad5815ca70 2023-10-14T11:15:12.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad4f7fe640 1 -- 172.21.15.26:0/3170678373 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad500b8b80 con 0x7fad5815ca70 2023-10-14T11:15:12.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad5d609640 1 -- 172.21.15.26:0/3170678373 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5814ef90 con 0x7fad5815ca70 2023-10-14T11:15:12.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad5d609640 1 -- 172.21.15.26:0/3170678373 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5814f550 con 0x7fad5815ca70 2023-10-14T11:15:12.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.899+0000 7fad5d609640 1 -- 172.21.15.26:0/3170678373 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad580b5820 con 0x7fad5815ca70 2023-10-14T11:15:12.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.903+0000 7fad4f7fe640 1 -- 172.21.15.26:0/3170678373 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fad500b8ce0 con 0x7fad5815ca70 2023-10-14T11:15:12.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.903+0000 7fad4f7fe640 1 --2- 172.21.15.26:0/3170678373 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fad380664a0 0x7fad38068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:12.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.903+0000 7fad4f7fe640 1 -- 172.21.15.26:0/3170678373 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fad5011f470 con 0x7fad5815ca70 2023-10-14T11:15:12.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.903+0000 7fad56ffd640 1 --2- 172.21.15.26:0/3170678373 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fad380664a0 0x7fad38068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:12.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.903+0000 7fad56ffd640 1 --2- 172.21.15.26:0/3170678373 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fad380664a0 0x7fad38068960 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fad580b4d90 tx=0x7fad48008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:12.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:12.907+0000 7fad4f7fe640 1 -- 172.21.15.26:0/3170678373 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fad580b5820 con 0x7fad5815ca70 2023-10-14T11:15:13.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.099+0000 7fad5d609640 1 -- 172.21.15.26:0/3170678373 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad580b57f0 con 0x7fad5815ca70 2023-10-14T11:15:13.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.099+0000 7fad4f7fe640 1 -- 172.21.15.26:0/3170678373 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4921 (secure 0 0 0) 0x7fad500eca10 con 0x7fad5815ca70 2023-10-14T11:15:13.106 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:15:13.107 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/633779909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":633779909},{"type":"v1","addr":"172.21.15.110:6834","nonce":633779909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5995,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3833036081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3833036081},{"type":"v1","addr":"172.21.15.110:6835","nonce":3833036081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":6144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2594736858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2594736858},{"type":"v1","addr":"172.21.15.26:6835","nonce":2594736858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:14:49.973814+0000","modified":"2023-10-14T11:14:52.995854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6147},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6147":{"gid":6147,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6837/2641279888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2641279888},{"type":"v1","addr":"172.21.15.26:6837","nonce":2641279888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-14T11:15:13.108 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 26 2023-10-14T11:15:13.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.099+0000 7fad5d609640 1 -- 172.21.15.26:0/3170678373 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fad380664a0 msgr2=0x7fad38068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:13.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.099+0000 7fad5d609640 1 --2- 172.21.15.26:0/3170678373 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fad380664a0 0x7fad38068960 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fad580b4d90 tx=0x7fad48008040 comp rx=0 tx=0).stop 2023-10-14T11:15:13.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.099+0000 7fad5d609640 1 -- 172.21.15.26:0/3170678373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad5815ca70 msgr2=0x7fad580b7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:13.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.099+0000 7fad5d609640 1 --2- 172.21.15.26:0/3170678373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad5815ca70 0x7fad580b7e70 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fad5001a610 tx=0x7fad50019780 comp rx=0 tx=0).stop 2023-10-14T11:15:13.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.099+0000 7fad5d609640 1 -- 172.21.15.26:0/3170678373 shutdown_connections 2023-10-14T11:15:13.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.099+0000 7fad5d609640 1 --2- 172.21.15.26:0/3170678373 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fad380664a0 0x7fad38068960 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.099+0000 7fad5d609640 1 --2- 172.21.15.26:0/3170678373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad5815ca70 0x7fad580b7e70 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.099+0000 7fad5d609640 1 --2- 172.21.15.26:0/3170678373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad580d3550 0x7fad5814ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.099+0000 7fad5d609640 1 --2- 172.21.15.26:0/3170678373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad580cf7a0 0x7fad5814f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.099+0000 7fad5d609640 1 -- 172.21.15.26:0/3170678373 >> 172.21.15.26:0/3170678373 conn(0x7fad5809bc50 msgr2=0x7fad580ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:13.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.099+0000 7fad5d609640 1 -- 172.21.15.26:0/3170678373 shutdown_connections 2023-10-14T11:15:13.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.099+0000 7fad5d609640 1 -- 172.21.15.26:0/3170678373 wait complete. 2023-10-14T11:15:13.128 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:15:13.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.263+0000 7f5b3ebf8640 1 Processor -- start 2023-10-14T11:15:13.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.263+0000 7f5b3ebf8640 1 -- start start 2023-10-14T11:15:13.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b3ebf8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5b3815a800 0x7f5b380cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:13.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b3ebf8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b380c7110 con 0x7f5b380b21c0 2023-10-14T11:15:13.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b3ebf8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b38070bc0 con 0x7f5b380b2630 2023-10-14T11:15:13.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b3ebf8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b380cf820 con 0x7f5b3815a800 2023-10-14T11:15:13.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b37fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5b380b21c0 0x7f5b3806fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45648/0 (socket says 172.21.15.26:45648) 2023-10-14T11:15:13.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b37fff640 1 -- 172.21.15.26:0/1592951069 learned_addr learned my addr 172.21.15.26:0/1592951069 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:13.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b3c994640 1 --2- 172.21.15.26:0/1592951069 >> v2:172.21.15.110:3300/0 conn(0x7f5b3815a800 0x7f5b380cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:13.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b377fe640 1 -- 172.21.15.26:0/1592951069 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280289388 0 0) 0x7f5b380c7110 con 0x7f5b380b21c0 2023-10-14T11:15:13.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b377fe640 1 -- 172.21.15.26:0/1592951069 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b28003530 con 0x7f5b380b21c0 2023-10-14T11:15:13.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b377fe640 1 -- 172.21.15.26:0/1592951069 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1768438439 0 0) 0x7f5b38070bc0 con 0x7f5b380b2630 2023-10-14T11:15:13.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b377fe640 1 -- 172.21.15.26:0/1592951069 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b380c7110 con 0x7f5b380b2630 2023-10-14T11:15:13.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b377fe640 1 -- 172.21.15.26:0/1592951069 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3791319210 0 0) 0x7f5b28003530 con 0x7f5b380b21c0 2023-10-14T11:15:13.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b377fe640 1 -- 172.21.15.26:0/1592951069 >> v2:172.21.15.110:3300/0 conn(0x7f5b3815a800 msgr2=0x7f5b380cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:13.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b377fe640 1 --2- 172.21.15.26:0/1592951069 >> v2:172.21.15.110:3300/0 conn(0x7f5b3815a800 0x7f5b380cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b377fe640 1 -- 172.21.15.26:0/1592951069 >> v1:172.21.15.110:6789/0 conn(0x7f5b380b2630 legacy=0x7f5b380704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:13.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b377fe640 1 -- 172.21.15.26:0/1592951069 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b380b2ac0 con 0x7f5b380b21c0 2023-10-14T11:15:13.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b377fe640 1 -- 172.21.15.26:0/1592951069 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f5b24001680 con 0x7f5b380b21c0 2023-10-14T11:15:13.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b3c994640 1 --2- 172.21.15.26:0/1592951069 >> v2:172.21.15.110:3300/0 conn(0x7f5b3815a800 0x7f5b380cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:15:13.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b377fe640 1 -- 172.21.15.26:0/1592951069 >> v1:172.21.15.26:6789/0 conn(0x7f5b380b21c0 legacy=0x7f5b3806fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:13.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b377fe640 1 --2- 172.21.15.26:0/1592951069 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b28003b10 0x7f5b28003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:13.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b377fe640 1 --2- 172.21.15.26:0/1592951069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b280047d0 0x7f5b28004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:13.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b377fe640 1 --2- 172.21.15.26:0/1592951069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b28005190 0x7f5b2800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:13.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b377fe640 1 -- 172.21.15.26:0/1592951069 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b380cf820 con 0x7f5b28005190 2023-10-14T11:15:13.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b377fe640 1 -- 172.21.15.26:0/1592951069 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2800c010 con 0x7f5b28003b10 2023-10-14T11:15:13.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b377fe640 1 -- 172.21.15.26:0/1592951069 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2800c1d0 con 0x7f5b280047d0 2023-10-14T11:15:13.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b3d195640 1 --2- 172.21.15.26:0/1592951069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b28005190 0x7f5b2800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:13.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b3c994640 1 --2- 172.21.15.26:0/1592951069 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b28003b10 0x7f5b28003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:13.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b37fff640 1 --2- 172.21.15.26:0/1592951069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b280047d0 0x7f5b28004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:13.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b3d195640 1 -- 172.21.15.26:0/1592951069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b280047d0 msgr2=0x7f5b28004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:13.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b3d195640 1 --2- 172.21.15.26:0/1592951069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b280047d0 0x7f5b28004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b3d195640 1 -- 172.21.15.26:0/1592951069 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b28003b10 msgr2=0x7f5b28003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:13.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b3d195640 1 --2- 172.21.15.26:0/1592951069 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b28003b10 0x7f5b28003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.267+0000 7f5b3d195640 1 -- 172.21.15.26:0/1592951069 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b28003530 con 0x7f5b28005190 2023-10-14T11:15:13.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.271+0000 7f5b3d195640 1 -- 172.21.15.26:0/1592951069 reap_dead start 2023-10-14T11:15:13.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.271+0000 7f5b3d195640 1 --2- 172.21.15.26:0/1592951069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b28005190 0x7f5b2800b990 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f5b30001fd0 tx=0x7f5b3001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d71d954e537dcd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:13.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.271+0000 7f5b377fe640 1 -- 172.21.15.26:0/1592951069 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b24007ea0 con 0x7f5b28005190 2023-10-14T11:15:13.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.271+0000 7f5b377fe640 1 -- 172.21.15.26:0/1592951069 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b30003b80 con 0x7f5b28005190 2023-10-14T11:15:13.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.271+0000 7f5b377fe640 1 -- 172.21.15.26:0/1592951069 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b300050d0 con 0x7f5b28005190 2023-10-14T11:15:13.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.271+0000 7f5b3ebf8640 1 -- 172.21.15.26:0/1592951069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b28005190 msgr2=0x7f5b2800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:13.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.271+0000 7f5b3ebf8640 1 --2- 172.21.15.26:0/1592951069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b28005190 0x7f5b2800b990 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f5b30001fd0 tx=0x7f5b3001c8e0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.271+0000 7f5b3ebf8640 1 -- 172.21.15.26:0/1592951069 shutdown_connections 2023-10-14T11:15:13.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.271+0000 7f5b3ebf8640 1 --2- 172.21.15.26:0/1592951069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b28005190 0x7f5b2800b990 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.271+0000 7f5b3ebf8640 1 -- 172.21.15.26:0/1592951069 >> 172.21.15.26:0/1592951069 conn(0x7f5b380cd1c0 msgr2=0x7f5b380cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:13.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.271+0000 7f5b3ebf8640 1 -- 172.21.15.26:0/1592951069 shutdown_connections 2023-10-14T11:15:13.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.271+0000 7f5b3ebf8640 1 -- 172.21.15.26:0/1592951069 wait complete. 2023-10-14T11:15:13.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b3ebf8640 1 Processor -- start 2023-10-14T11:15:13.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b3ebf8640 1 -- start start 2023-10-14T11:15:13.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b3ebf8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b28005190 0x7f5b381536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:13.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b3ebf8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3814ed50 0x7f5b380b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:13.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b3ebf8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b380b5df0 0x7f5b380b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:13.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b3ebf8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b380b6270 con 0x7f5b3814ed50 2023-10-14T11:15:13.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b3ebf8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b381e4210 con 0x7f5b380b5df0 2023-10-14T11:15:13.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b3ebf8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b38156850 con 0x7f5b28005190 2023-10-14T11:15:13.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b37fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3814ed50 0x7f5b380b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:13.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b37fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3814ed50 0x7f5b380b58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34114/0 (socket says 172.21.15.26:34114) 2023-10-14T11:15:13.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b37fff640 1 -- 172.21.15.26:0/1000408780 learned_addr learned my addr 172.21.15.26:0/1000408780 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:13.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b3c994640 1 --2- 172.21.15.26:0/1000408780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b28005190 0x7f5b381536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:13.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b3d195640 1 --2- 172.21.15.26:0/1000408780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b380b5df0 0x7f5b380b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:13.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b37fff640 1 -- 172.21.15.26:0/1000408780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b28005190 msgr2=0x7f5b381536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:13.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b37fff640 1 --2- 172.21.15.26:0/1000408780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b28005190 0x7f5b381536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b37fff640 1 -- 172.21.15.26:0/1000408780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b380b5df0 msgr2=0x7f5b380b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:13.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b37fff640 1 --2- 172.21.15.26:0/1000408780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b380b5df0 0x7f5b380b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b37fff640 1 -- 172.21.15.26:0/1000408780 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b38155fb0 con 0x7f5b3814ed50 2023-10-14T11:15:13.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b3c994640 1 --2- 172.21.15.26:0/1000408780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b28005190 0x7f5b381536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:13.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b37fff640 1 --2- 172.21.15.26:0/1000408780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3814ed50 0x7f5b380b58b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5b24012510 tx=0x7f5b240129d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:13.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b357fa640 1 -- 172.21.15.26:0/1000408780 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b24014750 con 0x7f5b3814ed50 2023-10-14T11:15:13.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b357fa640 1 -- 172.21.15.26:0/1000408780 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b240148b0 con 0x7f5b3814ed50 2023-10-14T11:15:13.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b357fa640 1 -- 172.21.15.26:0/1000408780 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b24014c60 con 0x7f5b3814ed50 2023-10-14T11:15:13.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b3ebf8640 1 -- 172.21.15.26:0/1000408780 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b38156290 con 0x7f5b3814ed50 2023-10-14T11:15:13.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b3ebf8640 1 -- 172.21.15.26:0/1000408780 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3814f1d0 con 0x7f5b3814ed50 2023-10-14T11:15:13.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.275+0000 7f5b3ebf8640 1 -- 172.21.15.26:0/1000408780 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b381e4380 con 0x7f5b3814ed50 2023-10-14T11:15:13.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.279+0000 7f5b357fa640 1 -- 172.21.15.26:0/1000408780 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5b240153e0 con 0x7f5b3814ed50 2023-10-14T11:15:13.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.279+0000 7f5b357fa640 1 --2- 172.21.15.26:0/1000408780 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5b1c0664a0 0x7f5b1c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:13.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.279+0000 7f5b357fa640 1 -- 172.21.15.26:0/1000408780 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f5b24086740 con 0x7f5b3814ed50 2023-10-14T11:15:13.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.279+0000 7f5b3c994640 1 --2- 172.21.15.26:0/1000408780 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5b1c0664a0 0x7f5b1c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:13.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.279+0000 7f5b3c994640 1 --2- 172.21.15.26:0/1000408780 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5b1c0664a0 0x7f5b1c068960 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009cf0 tx=0x7f5b2c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:13.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.283+0000 7f5b357fa640 1 -- 172.21.15.26:0/1000408780 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5b24053a70 con 0x7f5b3814ed50 2023-10-14T11:15:13.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.439+0000 7f5b3ebf8640 1 -- 172.21.15.26:0/1000408780 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b38074010 con 0x7f5b3814ed50 2023-10-14T11:15:13.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.443+0000 7f5b357fa640 1 -- 172.21.15.26:0/1000408780 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16790 (secure 0 0 0) 0x7f5b24057090 con 0x7f5b3814ed50 2023-10-14T11:15:13.449 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:15:13.449 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":55,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:14:51.591742+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:14:47.752880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:14:48.971211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:15:13.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.443+0000 7f5b3ebf8640 1 -- 172.21.15.26:0/1000408780 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5b1c0664a0 msgr2=0x7f5b1c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:13.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.443+0000 7f5b3ebf8640 1 --2- 172.21.15.26:0/1000408780 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5b1c0664a0 0x7f5b1c068960 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009cf0 tx=0x7f5b2c008040 comp rx=0 tx=0).stop 2023-10-14T11:15:13.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.443+0000 7f5b3ebf8640 1 -- 172.21.15.26:0/1000408780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3814ed50 msgr2=0x7f5b380b58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:13.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.443+0000 7f5b3ebf8640 1 --2- 172.21.15.26:0/1000408780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3814ed50 0x7f5b380b58b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5b24012510 tx=0x7f5b240129d0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.443+0000 7f5b3ebf8640 1 -- 172.21.15.26:0/1000408780 shutdown_connections 2023-10-14T11:15:13.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.443+0000 7f5b3ebf8640 1 --2- 172.21.15.26:0/1000408780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b380b5df0 0x7f5b380b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.443+0000 7f5b3ebf8640 1 --2- 172.21.15.26:0/1000408780 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5b1c0664a0 0x7f5b1c068960 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.443+0000 7f5b3ebf8640 1 --2- 172.21.15.26:0/1000408780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3814ed50 0x7f5b380b58b0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.443+0000 7f5b3ebf8640 1 --2- 172.21.15.26:0/1000408780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b28005190 0x7f5b381536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.443+0000 7f5b3ebf8640 1 -- 172.21.15.26:0/1000408780 >> 172.21.15.26:0/1000408780 conn(0x7f5b380cd1c0 msgr2=0x7f5b380cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:13.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.443+0000 7f5b3ebf8640 1 -- 172.21.15.26:0/1000408780 shutdown_connections 2023-10-14T11:15:13.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.443+0000 7f5b3ebf8640 1 -- 172.21.15.26:0/1000408780 wait complete. 2023-10-14T11:15:13.470 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:12:10.220846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'testcephfs1_metadata', 'create_time': '2023-10-14T11:14:47.752880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'testcephfs1_data', 'create_time': '2023-10-14T11:14:48.971211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:15:13.471 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:15:13.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.611+0000 7f0dbd91d640 1 Processor -- start 2023-10-14T11:15:13.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.611+0000 7f0dbd91d640 1 -- start start 2023-10-14T11:15:13.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.615+0000 7f0dbd91d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0db815cba0 0x7f0db80d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.615+0000 7f0dbd91d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0db80b84e0 0x7f0db80cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.615+0000 7f0dbd91d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db80d1670 con 0x7f0db80d0040 2023-10-14T11:15:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.615+0000 7f0dbd91d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db80d1460 con 0x7f0db80b84e0 2023-10-14T11:15:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.615+0000 7f0dbd91d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db80d04b0 con 0x7f0db815cba0 2023-10-14T11:15:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.615+0000 7f0daffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0db80b84e0 0x7f0db80cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.615+0000 7f0db77fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0db80d0040 0x7f0db80d2ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45652/0 (socket says 172.21.15.26:45652) 2023-10-14T11:15:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.615+0000 7f0db77fe640 1 -- 172.21.15.26:0/2800741943 learned_addr learned my addr 172.21.15.26:0/2800741943 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.615+0000 7f0daffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0db80b84e0 0x7f0db80cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34120/0 (socket says 172.21.15.26:34120) 2023-10-14T11:15:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.615+0000 7f0db6ffd640 1 --2- 172.21.15.26:0/2800741943 >> v2:172.21.15.110:3300/0 conn(0x7f0db815cba0 0x7f0db80d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.615+0000 7f0daffff640 1 -- 172.21.15.26:0/2800741943 >> v2:172.21.15.110:3300/0 conn(0x7f0db815cba0 msgr2=0x7f0db80d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:13.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.615+0000 7f0daffff640 1 --2- 172.21.15.26:0/2800741943 >> v2:172.21.15.110:3300/0 conn(0x7f0db815cba0 0x7f0db80d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.615+0000 7f0daffff640 1 -- 172.21.15.26:0/2800741943 >> v1:172.21.15.26:6789/0 conn(0x7f0db80d0040 legacy=0x7f0db80d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:13.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.615+0000 7f0daffff640 1 -- 172.21.15.26:0/2800741943 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db80d1950 con 0x7f0db80b84e0 2023-10-14T11:15:13.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.615+0000 7f0daffff640 1 --2- 172.21.15.26:0/2800741943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db80b84e0 0x7f0db80cfb00 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f0db80b4890 tx=0x7f0da001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f0488f7a96cb6b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.615+0000 7f0db67fc640 1 -- 172.21.15.26:0/2800741943 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da00ab600 con 0x7f0db80b84e0 2023-10-14T11:15:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.615+0000 7f0db67fc640 1 -- 172.21.15.26:0/2800741943 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da00a7050 con 0x7f0db80b84e0 2023-10-14T11:15:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.615+0000 7f0db67fc640 1 -- 172.21.15.26:0/2800741943 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da00ab980 con 0x7f0db80b84e0 2023-10-14T11:15:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.619+0000 7f0dbd91d640 1 -- 172.21.15.26:0/2800741943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db80b84e0 msgr2=0x7f0db80cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.619+0000 7f0dbd91d640 1 --2- 172.21.15.26:0/2800741943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db80b84e0 0x7f0db80cfb00 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f0db80b4890 tx=0x7f0da001c3d0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.619+0000 7f0dbd91d640 1 -- 172.21.15.26:0/2800741943 shutdown_connections 2023-10-14T11:15:13.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.619+0000 7f0dbd91d640 1 --2- 172.21.15.26:0/2800741943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db80b84e0 0x7f0db80cfb00 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.619+0000 7f0dbd91d640 1 --2- 172.21.15.26:0/2800741943 >> v2:172.21.15.110:3300/0 conn(0x7f0db815cba0 0x7f0db80d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.619+0000 7f0dbd91d640 1 -- 172.21.15.26:0/2800741943 >> 172.21.15.26:0/2800741943 conn(0x7f0db80719c0 msgr2=0x7f0db8071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:13.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.619+0000 7f0dbd91d640 1 -- 172.21.15.26:0/2800741943 shutdown_connections 2023-10-14T11:15:13.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.619+0000 7f0dbd91d640 1 -- 172.21.15.26:0/2800741943 wait complete. 2023-10-14T11:15:13.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.619+0000 7f0dbd91d640 1 Processor -- start 2023-10-14T11:15:13.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.619+0000 7f0dbd91d640 1 -- start start 2023-10-14T11:15:13.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.619+0000 7f0dbd91d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0db80b84e0 0x7f0db814d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:13.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.619+0000 7f0dbd91d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0db80d0040 0x7f0db80cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.619+0000 7f0dbd91d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db815cba0 0x7f0db81541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.619+0000 7f0dbd91d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db814eaf0 con 0x7f0db815cba0 2023-10-14T11:15:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.619+0000 7f0dbd91d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db814e7e0 con 0x7f0db80b84e0 2023-10-14T11:15:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.619+0000 7f0dbd91d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db814d940 con 0x7f0db80d0040 2023-10-14T11:15:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.619+0000 7f0db77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db815cba0 0x7f0db81541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:13.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.619+0000 7f0db77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db815cba0 0x7f0db81541b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34128/0 (socket says 172.21.15.26:34128) 2023-10-14T11:15:13.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.619+0000 7f0db77fe640 1 -- 172.21.15.26:0/1389816801 learned_addr learned my addr 172.21.15.26:0/1389816801 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:13.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.619+0000 7f0db6ffd640 1 --2- 172.21.15.26:0/1389816801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0db80b84e0 0x7f0db814d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:13.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.619+0000 7f0daffff640 1 --2- 172.21.15.26:0/1389816801 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0db80d0040 0x7f0db80cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:13.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.623+0000 7f0db77fe640 1 -- 172.21.15.26:0/1389816801 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0db80d0040 msgr2=0x7f0db80cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:13.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.623+0000 7f0db77fe640 1 --2- 172.21.15.26:0/1389816801 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0db80d0040 0x7f0db80cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.623+0000 7f0db77fe640 1 -- 172.21.15.26:0/1389816801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0db80b84e0 msgr2=0x7f0db814d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:13.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.623+0000 7f0db77fe640 1 --2- 172.21.15.26:0/1389816801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0db80b84e0 0x7f0db814d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.623+0000 7f0db77fe640 1 -- 172.21.15.26:0/1389816801 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da0009420 con 0x7f0db815cba0 2023-10-14T11:15:13.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.623+0000 7f0daffff640 1 --2- 172.21.15.26:0/1389816801 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0db80d0040 0x7f0db80cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.623+0000 7f0db77fe640 1 --2- 172.21.15.26:0/1389816801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db815cba0 0x7f0db81541b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f0db000cbc0 tx=0x7f0db000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.623+0000 7f0db4ff9640 1 -- 172.21.15.26:0/1389816801 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db000ad40 con 0x7f0db815cba0 2023-10-14T11:15:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.623+0000 7f0db4ff9640 1 -- 172.21.15.26:0/1389816801 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db0012400 con 0x7f0db815cba0 2023-10-14T11:15:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.623+0000 7f0db4ff9640 1 -- 172.21.15.26:0/1389816801 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db000aea0 con 0x7f0db815cba0 2023-10-14T11:15:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.623+0000 7f0dbd91d640 1 -- 172.21.15.26:0/1389816801 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db80cc0e0 con 0x7f0db815cba0 2023-10-14T11:15:13.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.623+0000 7f0dbd91d640 1 -- 172.21.15.26:0/1389816801 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db80cc6a0 con 0x7f0db815cba0 2023-10-14T11:15:13.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.623+0000 7f0dbd91d640 1 -- 172.21.15.26:0/1389816801 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db814ec30 con 0x7f0db815cba0 2023-10-14T11:15:13.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.623+0000 7f0db4ff9640 1 -- 172.21.15.26:0/1389816801 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0db0007070 con 0x7f0db815cba0 2023-10-14T11:15:13.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.623+0000 7f0db4ff9640 1 --2- 172.21.15.26:0/1389816801 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0d980664a0 0x7f0d98068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:13.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.623+0000 7f0db4ff9640 1 -- 172.21.15.26:0/1389816801 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f0db0083e40 con 0x7f0db815cba0 2023-10-14T11:15:13.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.623+0000 7f0db6ffd640 1 --2- 172.21.15.26:0/1389816801 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0d980664a0 0x7f0d98068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:13.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.627+0000 7f0db6ffd640 1 --2- 172.21.15.26:0/1389816801 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0d980664a0 0x7f0d98068960 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0db80724b0 tx=0x7f0da8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:13.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.627+0000 7f0db4ff9640 1 -- 172.21.15.26:0/1389816801 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0db814ec30 con 0x7f0db815cba0 2023-10-14T11:15:13.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.783+0000 7f0dbd91d640 1 -- 172.21.15.26:0/1389816801 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0db814ec30 con 0x7f0db815cba0 2023-10-14T11:15:13.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.787+0000 7f0db4ff9640 1 -- 172.21.15.26:0/1389816801 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0db814ec30 con 0x7f0db815cba0 2023-10-14T11:15:13.793 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-14T11:15:13.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.787+0000 7f0dbd91d640 1 -- 172.21.15.26:0/1389816801 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0d980664a0 msgr2=0x7f0d98068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:13.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.787+0000 7f0dbd91d640 1 --2- 172.21.15.26:0/1389816801 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0d980664a0 0x7f0d98068960 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0db80724b0 tx=0x7f0da8008040 comp rx=0 tx=0).stop 2023-10-14T11:15:13.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.787+0000 7f0dbd91d640 1 -- 172.21.15.26:0/1389816801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db815cba0 msgr2=0x7f0db81541b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:13.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.787+0000 7f0dbd91d640 1 --2- 172.21.15.26:0/1389816801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db815cba0 0x7f0db81541b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f0db000cbc0 tx=0x7f0db000a430 comp rx=0 tx=0).stop 2023-10-14T11:15:13.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.787+0000 7f0dbd91d640 1 -- 172.21.15.26:0/1389816801 shutdown_connections 2023-10-14T11:15:13.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.787+0000 7f0dbd91d640 1 --2- 172.21.15.26:0/1389816801 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0d980664a0 0x7f0d98068960 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.787+0000 7f0dbd91d640 1 --2- 172.21.15.26:0/1389816801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db815cba0 0x7f0db81541b0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.787+0000 7f0dbd91d640 1 --2- 172.21.15.26:0/1389816801 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0db80d0040 0x7f0db80cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.787+0000 7f0dbd91d640 1 --2- 172.21.15.26:0/1389816801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0db80b84e0 0x7f0db814d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.787+0000 7f0dbd91d640 1 -- 172.21.15.26:0/1389816801 >> 172.21.15.26:0/1389816801 conn(0x7f0db80719c0 msgr2=0x7f0db80b7580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.787+0000 7f0dbd91d640 1 -- 172.21.15.26:0/1389816801 shutdown_connections 2023-10-14T11:15:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.787+0000 7f0dbd91d640 1 -- 172.21.15.26:0/1389816801 wait complete. 2023-10-14T11:15:13.815 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_metadata pg_num 2023-10-14T11:15:13.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.955+0000 7f8de6606640 1 Processor -- start 2023-10-14T11:15:13.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.955+0000 7f8de6606640 1 -- start start 2023-10-14T11:15:13.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.959+0000 7f8de6606640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8de00cf670 0x7f8de006afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:13.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.959+0000 7f8de6606640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de015cd70 con 0x7f8de015c990 2023-10-14T11:15:13.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.959+0000 7f8de6606640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de00d02f0 con 0x7f8de00d1300 2023-10-14T11:15:13.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.959+0000 7f8de6606640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de00d1790 con 0x7f8de00cf670 2023-10-14T11:15:13.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.959+0000 7f8de5e05640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8de00cf670 0x7f8de006afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:13.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.959+0000 7f8de4e03640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8de00d1300 0x7f8de00cef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:33740/0 (socket says 172.21.15.26:33740) 2023-10-14T11:15:13.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.959+0000 7f8de5604640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8de015c990 0x7f8de00cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45666/0 (socket says 172.21.15.26:45666) 2023-10-14T11:15:13.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.959+0000 7f8de4e03640 1 -- 172.21.15.26:0/588040439 learned_addr learned my addr 172.21.15.26:0/588040439 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:13.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.959+0000 7f8de5e05640 1 -- 172.21.15.26:0/588040439 >> v1:172.21.15.110:6789/0 conn(0x7f8de00d1300 legacy=0x7f8de00cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:13.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.959+0000 7f8de5e05640 1 -- 172.21.15.26:0/588040439 >> v1:172.21.15.26:6789/0 conn(0x7f8de015c990 legacy=0x7f8de00cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:13.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.959+0000 7f8dd7fff640 1 -- 172.21.15.26:0/588040439 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981250369 0 0) 0x7f8de00d02f0 con 0x7f8de00d1300 2023-10-14T11:15:13.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.959+0000 7f8de5e05640 1 -- 172.21.15.26:0/588040439 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de00d0540 con 0x7f8de00cf670 2023-10-14T11:15:13.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.963+0000 7f8de5e05640 1 --2- 172.21.15.26:0/588040439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8de00cf670 0x7f8de006afe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009dc0 tx=0x7f8dd801c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4177b5462e5e81fc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:13.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.963+0000 7f8dd7fff640 1 -- 172.21.15.26:0/588040439 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd80a5780 con 0x7f8de00cf670 2023-10-14T11:15:13.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.963+0000 7f8dd7fff640 1 -- 172.21.15.26:0/588040439 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd80a58e0 con 0x7f8de00cf670 2023-10-14T11:15:13.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.963+0000 7f8dd7fff640 1 -- 172.21.15.26:0/588040439 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd80a5c70 con 0x7f8de00cf670 2023-10-14T11:15:13.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.963+0000 7f8de6606640 1 -- 172.21.15.26:0/588040439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8de00cf670 msgr2=0x7f8de006afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:13.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.963+0000 7f8de6606640 1 --2- 172.21.15.26:0/588040439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8de00cf670 0x7f8de006afe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009dc0 tx=0x7f8dd801c740 comp rx=0 tx=0).stop 2023-10-14T11:15:13.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.963+0000 7f8de6606640 1 -- 172.21.15.26:0/588040439 shutdown_connections 2023-10-14T11:15:13.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.963+0000 7f8de6606640 1 --2- 172.21.15.26:0/588040439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8de00cf670 0x7f8de006afe0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.963+0000 7f8de6606640 1 -- 172.21.15.26:0/588040439 >> 172.21.15.26:0/588040439 conn(0x7f8de0089f80 msgr2=0x7f8de00d2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:13.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.963+0000 7f8de6606640 1 -- 172.21.15.26:0/588040439 shutdown_connections 2023-10-14T11:15:13.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.963+0000 7f8de6606640 1 -- 172.21.15.26:0/588040439 wait complete. 2023-10-14T11:15:13.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.963+0000 7f8de6606640 1 Processor -- start 2023-10-14T11:15:13.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.963+0000 7f8de6606640 1 -- start start 2023-10-14T11:15:13.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8de6606640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8de00cf670 0x7f8de00b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:13.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8de6606640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8de00d1300 0x7f8de01f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:13.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8de6606640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8de015c990 0x7f8de00b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:13.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8de6606640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de00b3bc0 con 0x7f8de00d1300 2023-10-14T11:15:13.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8de6606640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de0153b40 con 0x7f8de015c990 2023-10-14T11:15:13.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8de6606640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de01535c0 con 0x7f8de00cf670 2023-10-14T11:15:13.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8de4e03640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8de00d1300 0x7f8de01f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:13.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8de4e03640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8de00d1300 0x7f8de01f7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34130/0 (socket says 172.21.15.26:34130) 2023-10-14T11:15:13.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8de4e03640 1 -- 172.21.15.26:0/4093790027 learned_addr learned my addr 172.21.15.26:0/4093790027 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:13.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8de5e05640 1 --2- 172.21.15.26:0/4093790027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8de015c990 0x7f8de00b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:13.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8de5604640 1 --2- 172.21.15.26:0/4093790027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8de00cf670 0x7f8de00b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:13.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8de4e03640 1 -- 172.21.15.26:0/4093790027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8de00cf670 msgr2=0x7f8de00b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:13.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8de4e03640 1 --2- 172.21.15.26:0/4093790027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8de00cf670 0x7f8de00b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8de4e03640 1 -- 172.21.15.26:0/4093790027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8de015c990 msgr2=0x7f8de00b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:13.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8de4e03640 1 --2- 172.21.15.26:0/4093790027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8de015c990 0x7f8de00b0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:13.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8de4e03640 1 -- 172.21.15.26:0/4093790027 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd8009a70 con 0x7f8de00d1300 2023-10-14T11:15:13.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8de4e03640 1 --2- 172.21.15.26:0/4093790027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8de00d1300 0x7f8de01f7be0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f8dd00011f0 tx=0x7f8dd000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:13.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8dd5ffb640 1 -- 172.21.15.26:0/4093790027 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd00074e0 con 0x7f8de00d1300 2023-10-14T11:15:13.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8dd5ffb640 1 -- 172.21.15.26:0/4093790027 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd0007640 con 0x7f8de00d1300 2023-10-14T11:15:13.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8dd5ffb640 1 -- 172.21.15.26:0/4093790027 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0004a10 con 0x7f8de00d1300 2023-10-14T11:15:13.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8de6606640 1 -- 172.21.15.26:0/4093790027 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de01f7790 con 0x7f8de00d1300 2023-10-14T11:15:13.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8de6606640 1 -- 172.21.15.26:0/4093790027 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de00b37e0 con 0x7f8de00d1300 2023-10-14T11:15:13.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.967+0000 7f8de6606640 1 -- 172.21.15.26:0/4093790027 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de00b3d00 con 0x7f8de00d1300 2023-10-14T11:15:13.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.971+0000 7f8dd5ffb640 1 -- 172.21.15.26:0/4093790027 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8dd0004b70 con 0x7f8de00d1300 2023-10-14T11:15:13.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.971+0000 7f8dd5ffb640 1 --2- 172.21.15.26:0/4093790027 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8dc40664a0 0x7f8dc4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:13.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.971+0000 7f8dd5ffb640 1 -- 172.21.15.26:0/4093790027 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f8dd00832d0 con 0x7f8de00d1300 2023-10-14T11:15:13.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.971+0000 7f8de5604640 1 --2- 172.21.15.26:0/4093790027 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8dc40664a0 0x7f8dc4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:13.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.971+0000 7f8de5604640 1 --2- 172.21.15.26:0/4093790027 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8dc40664a0 0x7f8dc4068960 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc000f70 tx=0x7f8ddc007e10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:13.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:13.975+0000 7f8dd5ffb640 1 -- 172.21.15.26:0/4093790027 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8de00b3d00 con 0x7f8de00d1300 2023-10-14T11:15:14.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.131+0000 7f8de6606640 1 -- 172.21.15.26:0/4093790027 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8de00b3d00 con 0x7f8de00d1300 2023-10-14T11:15:14.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.131+0000 7f8dd5ffb640 1 -- 172.21.15.26:0/4093790027 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"}]=0 v55) v1 ==== 109+0+11 (secure 0 0 0) 0x7f8de00b3d00 con 0x7f8de00d1300 2023-10-14T11:15:14.138 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-14T11:15:14.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.131+0000 7f8de6606640 1 -- 172.21.15.26:0/4093790027 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8dc40664a0 msgr2=0x7f8dc4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:14.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.131+0000 7f8de6606640 1 --2- 172.21.15.26:0/4093790027 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8dc40664a0 0x7f8dc4068960 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc000f70 tx=0x7f8ddc007e10 comp rx=0 tx=0).stop 2023-10-14T11:15:14.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.131+0000 7f8de6606640 1 -- 172.21.15.26:0/4093790027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8de00d1300 msgr2=0x7f8de01f7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:14.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.131+0000 7f8de6606640 1 --2- 172.21.15.26:0/4093790027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8de00d1300 0x7f8de01f7be0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f8dd00011f0 tx=0x7f8dd000c9b0 comp rx=0 tx=0).stop 2023-10-14T11:15:14.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.131+0000 7f8de6606640 1 -- 172.21.15.26:0/4093790027 shutdown_connections 2023-10-14T11:15:14.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.131+0000 7f8de6606640 1 --2- 172.21.15.26:0/4093790027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8de015c990 0x7f8de00b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:14.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.131+0000 7f8de6606640 1 --2- 172.21.15.26:0/4093790027 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8dc40664a0 0x7f8dc4068960 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:14.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.131+0000 7f8de6606640 1 --2- 172.21.15.26:0/4093790027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8de00d1300 0x7f8de01f7be0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:14.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.131+0000 7f8de6606640 1 --2- 172.21.15.26:0/4093790027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8de00cf670 0x7f8de00b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:14.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.131+0000 7f8de6606640 1 -- 172.21.15.26:0/4093790027 >> 172.21.15.26:0/4093790027 conn(0x7f8de0089f80 msgr2=0x7f8de00d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:14.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.131+0000 7f8de6606640 1 -- 172.21.15.26:0/4093790027 shutdown_connections 2023-10-14T11:15:14.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.131+0000 7f8de6606640 1 -- 172.21.15.26:0/4093790027 wait complete. 2023-10-14T11:15:14.159 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_data pg_num 2023-10-14T11:15:14.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.299+0000 7f630e93e640 1 Processor -- start 2023-10-14T11:15:14.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.299+0000 7f630e93e640 1 -- start start 2023-10-14T11:15:14.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.299+0000 7f630e93e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6308159900 0x7f630806e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:14.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.299+0000 7f630e93e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63080b4390 con 0x7f63080b3f00 2023-10-14T11:15:14.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.299+0000 7f630e93e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63080b4600 con 0x7f630806a5a0 2023-10-14T11:15:14.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.299+0000 7f630e93e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63080cd740 con 0x7f6308159900 2023-10-14T11:15:14.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.299+0000 7f63077fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f63080b3f00 0x7f6308069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45674/0 (socket says 172.21.15.26:45674) 2023-10-14T11:15:14.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.299+0000 7f63077fe640 1 -- 172.21.15.26:0/4290539386 learned_addr learned my addr 172.21.15.26:0/4290539386 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:14.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.299+0000 7f6307fff640 1 --2- 172.21.15.26:0/4290539386 >> v2:172.21.15.110:3300/0 conn(0x7f6308159900 0x7f630806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:14.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.303+0000 7f6306ffd640 1 -- 172.21.15.26:0/4290539386 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277589793 0 0) 0x7f63080b4390 con 0x7f63080b3f00 2023-10-14T11:15:14.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.303+0000 7f6306ffd640 1 -- 172.21.15.26:0/4290539386 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62f0003530 con 0x7f63080b3f00 2023-10-14T11:15:14.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.303+0000 7f6306ffd640 1 -- 172.21.15.26:0/4290539386 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2528808323 0 0) 0x7f63080b4600 con 0x7f630806a5a0 2023-10-14T11:15:14.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.303+0000 7f6306ffd640 1 -- 172.21.15.26:0/4290539386 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63080b4390 con 0x7f630806a5a0 2023-10-14T11:15:14.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.303+0000 7f6307fff640 1 -- 172.21.15.26:0/4290539386 >> v1:172.21.15.110:6789/0 conn(0x7f630806a5a0 legacy=0x7f63080c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:14.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.303+0000 7f6307fff640 1 -- 172.21.15.26:0/4290539386 >> v1:172.21.15.26:6789/0 conn(0x7f63080b3f00 legacy=0x7f6308069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:14.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.303+0000 7f6307fff640 1 -- 172.21.15.26:0/4290539386 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63080c8dd0 con 0x7f6308159900 2023-10-14T11:15:14.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.303+0000 7f6307fff640 1 --2- 172.21.15.26:0/4290539386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6308159900 0x7f630806e260 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f62f80097c0 tx=0x7f62f801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c35bb0f5e4122057 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:14.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.303+0000 7f6306ffd640 1 -- 172.21.15.26:0/4290539386 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f80ab650 con 0x7f6308159900 2023-10-14T11:15:14.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.303+0000 7f6306ffd640 1 -- 172.21.15.26:0/4290539386 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f80ab7b0 con 0x7f6308159900 2023-10-14T11:15:14.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.303+0000 7f6306ffd640 1 -- 172.21.15.26:0/4290539386 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f80abb40 con 0x7f6308159900 2023-10-14T11:15:14.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.307+0000 7f630e93e640 1 -- 172.21.15.26:0/4290539386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6308159900 msgr2=0x7f630806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:14.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.307+0000 7f630e93e640 1 --2- 172.21.15.26:0/4290539386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6308159900 0x7f630806e260 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f62f80097c0 tx=0x7f62f801c450 comp rx=0 tx=0).stop 2023-10-14T11:15:14.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.307+0000 7f630e93e640 1 -- 172.21.15.26:0/4290539386 shutdown_connections 2023-10-14T11:15:14.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.307+0000 7f630e93e640 1 --2- 172.21.15.26:0/4290539386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6308159900 0x7f630806e260 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:14.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.307+0000 7f630e93e640 1 -- 172.21.15.26:0/4290539386 >> 172.21.15.26:0/4290539386 conn(0x7f63080b0da0 msgr2=0x7f63080ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:14.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.307+0000 7f630e93e640 1 -- 172.21.15.26:0/4290539386 shutdown_connections 2023-10-14T11:15:14.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.307+0000 7f630e93e640 1 -- 172.21.15.26:0/4290539386 wait complete. 2023-10-14T11:15:14.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.307+0000 7f630e93e640 1 Processor -- start 2023-10-14T11:15:14.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.307+0000 7f630e93e640 1 -- start start 2023-10-14T11:15:14.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.307+0000 7f630e93e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f630806a5a0 0x7f6308150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:14.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.307+0000 7f630e93e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63080b3f00 0x7f6308154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:14.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.307+0000 7f630e93e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6308159900 0x7f63081549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:14.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.307+0000 7f630e93e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63081f5da0 con 0x7f630806a5a0 2023-10-14T11:15:14.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.307+0000 7f630e93e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63081f5190 con 0x7f6308159900 2023-10-14T11:15:14.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.307+0000 7f630e93e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63081f5470 con 0x7f63080b3f00 2023-10-14T11:15:14.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.307+0000 7f6307fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f630806a5a0 0x7f6308150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:14.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.307+0000 7f6307fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f630806a5a0 0x7f6308150f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34138/0 (socket says 172.21.15.26:34138) 2023-10-14T11:15:14.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.307+0000 7f6307fff640 1 -- 172.21.15.26:0/1846347998 learned_addr learned my addr 172.21.15.26:0/1846347998 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:14.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.307+0000 7f63077fe640 1 --2- 172.21.15.26:0/1846347998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63080b3f00 0x7f6308154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:14.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.307+0000 7f630cedb640 1 --2- 172.21.15.26:0/1846347998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6308159900 0x7f63081549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:14.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.311+0000 7f6307fff640 1 -- 172.21.15.26:0/1846347998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63080b3f00 msgr2=0x7f6308154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:14.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.311+0000 7f6307fff640 1 --2- 172.21.15.26:0/1846347998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63080b3f00 0x7f6308154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:14.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.311+0000 7f6307fff640 1 -- 172.21.15.26:0/1846347998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6308159900 msgr2=0x7f63081549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:14.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.311+0000 7f6307fff640 1 --2- 172.21.15.26:0/1846347998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6308159900 0x7f63081549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:14.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.311+0000 7f6307fff640 1 -- 172.21.15.26:0/1846347998 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f8009420 con 0x7f630806a5a0 2023-10-14T11:15:14.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.311+0000 7f6307fff640 1 --2- 172.21.15.26:0/1846347998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f630806a5a0 0x7f6308150f50 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f62f80ad040 tx=0x7f62f801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:14.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.311+0000 7f6304ff9640 1 -- 172.21.15.26:0/1846347998 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f80bf610 con 0x7f630806a5a0 2023-10-14T11:15:14.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.311+0000 7f6304ff9640 1 -- 172.21.15.26:0/1846347998 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f80bf790 con 0x7f630806a5a0 2023-10-14T11:15:14.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.311+0000 7f6304ff9640 1 -- 172.21.15.26:0/1846347998 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f80bfb40 con 0x7f630806a5a0 2023-10-14T11:15:14.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.311+0000 7f630e93e640 1 -- 172.21.15.26:0/1846347998 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63081f5750 con 0x7f630806a5a0 2023-10-14T11:15:14.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.311+0000 7f630e93e640 1 -- 172.21.15.26:0/1846347998 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63080b2030 con 0x7f630806a5a0 2023-10-14T11:15:14.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.311+0000 7f630e93e640 1 -- 172.21.15.26:0/1846347998 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f630804e170 con 0x7f630806a5a0 2023-10-14T11:15:14.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.311+0000 7f6304ff9640 1 -- 172.21.15.26:0/1846347998 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f62f80b5400 con 0x7f630806a5a0 2023-10-14T11:15:14.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.311+0000 7f6304ff9640 1 --2- 172.21.15.26:0/1846347998 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62f40664d0 0x7f62f4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:14.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.311+0000 7f6304ff9640 1 -- 172.21.15.26:0/1846347998 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f62f811ea90 con 0x7f630806a5a0 2023-10-14T11:15:14.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.315+0000 7f63077fe640 1 --2- 172.21.15.26:0/1846347998 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62f40664d0 0x7f62f4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:14.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.315+0000 7f63077fe640 1 --2- 172.21.15.26:0/1846347998 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62f40664d0 0x7f62f4068990 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f63080abd50 tx=0x7f62fc007d60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:14.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.315+0000 7f6304ff9640 1 -- 172.21.15.26:0/1846347998 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f62f80ebdd0 con 0x7f630806a5a0 2023-10-14T11:15:14.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.471+0000 7f630e93e640 1 -- 172.21.15.26:0/1846347998 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"} v 0) v1 -- 0x7f63081f55b0 con 0x7f630806a5a0 2023-10-14T11:15:14.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.471+0000 7f6304ff9640 1 -- 172.21.15.26:0/1846347998 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"}]=0 v55) v1 ==== 105+0+11 (secure 0 0 0) 0x7f63081f55b0 con 0x7f630806a5a0 2023-10-14T11:15:14.480 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-14T11:15:14.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.475+0000 7f630e93e640 1 -- 172.21.15.26:0/1846347998 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62f40664d0 msgr2=0x7f62f4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:14.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.475+0000 7f630e93e640 1 --2- 172.21.15.26:0/1846347998 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62f40664d0 0x7f62f4068990 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f63080abd50 tx=0x7f62fc007d60 comp rx=0 tx=0).stop 2023-10-14T11:15:14.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.475+0000 7f630e93e640 1 -- 172.21.15.26:0/1846347998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f630806a5a0 msgr2=0x7f6308150f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:14.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.475+0000 7f630e93e640 1 --2- 172.21.15.26:0/1846347998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f630806a5a0 0x7f6308150f50 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f62f80ad040 tx=0x7f62f801ac90 comp rx=0 tx=0).stop 2023-10-14T11:15:14.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.475+0000 7f630e93e640 1 -- 172.21.15.26:0/1846347998 shutdown_connections 2023-10-14T11:15:14.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.475+0000 7f630e93e640 1 --2- 172.21.15.26:0/1846347998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6308159900 0x7f63081549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:14.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.475+0000 7f630e93e640 1 --2- 172.21.15.26:0/1846347998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63080b3f00 0x7f6308154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:14.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.475+0000 7f630e93e640 1 --2- 172.21.15.26:0/1846347998 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f62f40664d0 0x7f62f4068990 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:14.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.475+0000 7f630e93e640 1 --2- 172.21.15.26:0/1846347998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f630806a5a0 0x7f6308150f50 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:14.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.475+0000 7f630e93e640 1 -- 172.21.15.26:0/1846347998 >> 172.21.15.26:0/1846347998 conn(0x7f63080b0da0 msgr2=0x7f63080ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:14.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.475+0000 7f630e93e640 1 -- 172.21.15.26:0/1846347998 shutdown_connections 2023-10-14T11:15:14.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.475+0000 7f630e93e640 1 -- 172.21.15.26:0/1846347998 wait complete. 2023-10-14T11:15:14.501 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:15:14.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.639+0000 7f0085e79640 1 Processor -- start 2023-10-14T11:15:14.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.639+0000 7f0085e79640 1 -- start start 2023-10-14T11:15:14.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.639+0000 7f0085e79640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0080159ba0 0x7f00800cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:14.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.639+0000 7f0085e79640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f00800c8cb0 0x7f00800cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:14.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.639+0000 7f0085e79640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00800723d0 con 0x7f00801597c0 2023-10-14T11:15:14.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.639+0000 7f0085e79640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00800717c0 con 0x7f00800c8cb0 2023-10-14T11:15:14.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.639+0000 7f0085e79640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0080071aa0 con 0x7f0080159ba0 2023-10-14T11:15:14.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.639+0000 7f007ffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f00800c8cb0 0x7f00800cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:14.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.639+0000 7f007ffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f00800c8cb0 0x7f00800cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34148/0 (socket says 172.21.15.26:34148) 2023-10-14T11:15:14.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.639+0000 7f007ffff640 1 -- 172.21.15.26:0/1118775781 learned_addr learned my addr 172.21.15.26:0/1118775781 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:14.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.639+0000 7f007effd640 1 --2- 172.21.15.26:0/1118775781 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0080159ba0 0x7f00800cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:14.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.643+0000 7f007ffff640 1 -- 172.21.15.26:0/1118775781 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0080159ba0 msgr2=0x7f00800cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:14.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.643+0000 7f007ffff640 1 --2- 172.21.15.26:0/1118775781 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0080159ba0 0x7f00800cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:14.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.643+0000 7f007ffff640 1 -- 172.21.15.26:0/1118775781 >> v1:172.21.15.110:6789/0 conn(0x7f00801597c0 legacy=0x7f00800ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:14.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.643+0000 7f007ffff640 1 -- 172.21.15.26:0/1118775781 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0080071d80 con 0x7f00800c8cb0 2023-10-14T11:15:14.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.643+0000 7f007ffff640 1 --2- 172.21.15.26:0/1118775781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00800c8cb0 0x7f00800cb350 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0078009e50 tx=0x7f007801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25675e2cb5400bd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:14.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.643+0000 7f007e7fc640 1 -- 172.21.15.26:0/1118775781 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00780a5850 con 0x7f00800c8cb0 2023-10-14T11:15:14.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.643+0000 7f007e7fc640 1 -- 172.21.15.26:0/1118775781 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00780a59b0 con 0x7f00800c8cb0 2023-10-14T11:15:14.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.643+0000 7f007e7fc640 1 -- 172.21.15.26:0/1118775781 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00780a5d40 con 0x7f00800c8cb0 2023-10-14T11:15:14.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.643+0000 7f0085e79640 1 -- 172.21.15.26:0/1118775781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00800c8cb0 msgr2=0x7f00800cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:14.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.643+0000 7f0085e79640 1 --2- 172.21.15.26:0/1118775781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00800c8cb0 0x7f00800cb350 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0078009e50 tx=0x7f007801c9e0 comp rx=0 tx=0).stop 2023-10-14T11:15:14.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.643+0000 7f0085e79640 1 -- 172.21.15.26:0/1118775781 shutdown_connections 2023-10-14T11:15:14.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.643+0000 7f0085e79640 1 --2- 172.21.15.26:0/1118775781 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0080159ba0 0x7f00800cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:14.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.643+0000 7f0085e79640 1 --2- 172.21.15.26:0/1118775781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00800c8cb0 0x7f00800cb350 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:14.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.647+0000 7f0085e79640 1 -- 172.21.15.26:0/1118775781 >> 172.21.15.26:0/1118775781 conn(0x7f008006c190 msgr2=0x7f008006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:14.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.647+0000 7f0085e79640 1 -- 172.21.15.26:0/1118775781 shutdown_connections 2023-10-14T11:15:14.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.647+0000 7f0085e79640 1 -- 172.21.15.26:0/1118775781 wait complete. 2023-10-14T11:15:14.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.647+0000 7f0085e79640 1 Processor -- start 2023-10-14T11:15:14.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.647+0000 7f0085e79640 1 -- start start 2023-10-14T11:15:14.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.647+0000 7f0085e79640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00800c8cb0 0x7f008014c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:14.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.647+0000 7f0085e79640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00801597c0 0x7f00801502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:14.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.647+0000 7f0085e79640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0080159ba0 0x7f0080157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:14.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.647+0000 7f0085e79640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0080150130 con 0x7f0080159ba0 2023-10-14T11:15:14.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.647+0000 7f0085e79640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0080156ef0 con 0x7f00800c8cb0 2023-10-14T11:15:14.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.647+0000 7f0085e79640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008014cd20 con 0x7f00801597c0 2023-10-14T11:15:14.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.647+0000 7f007ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0080159ba0 0x7f0080157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:14.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.647+0000 7f007ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0080159ba0 0x7f0080157380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34158/0 (socket says 172.21.15.26:34158) 2023-10-14T11:15:14.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.647+0000 7f007ffff640 1 -- 172.21.15.26:0/4102663811 learned_addr learned my addr 172.21.15.26:0/4102663811 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:14.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.647+0000 7f007f7fe640 1 --2- 172.21.15.26:0/4102663811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00800c8cb0 0x7f008014c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:14.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.647+0000 7f007effd640 1 --2- 172.21.15.26:0/4102663811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00801597c0 0x7f00801502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:14.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.647+0000 7f007ffff640 1 -- 172.21.15.26:0/4102663811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00801597c0 msgr2=0x7f00801502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:14.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.647+0000 7f007ffff640 1 --2- 172.21.15.26:0/4102663811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00801597c0 0x7f00801502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:14.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.647+0000 7f007ffff640 1 -- 172.21.15.26:0/4102663811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00800c8cb0 msgr2=0x7f008014c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:14.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.647+0000 7f007ffff640 1 --2- 172.21.15.26:0/4102663811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00800c8cb0 0x7f008014c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:14.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.647+0000 7f007ffff640 1 -- 172.21.15.26:0/4102663811 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0078009b30 con 0x7f0080159ba0 2023-10-14T11:15:14.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.647+0000 7f007ffff640 1 --2- 172.21.15.26:0/4102663811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0080159ba0 0x7f0080157380 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f00780af040 tx=0x7f0078019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:14.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.651+0000 7f0067fff640 1 -- 172.21.15.26:0/4102663811 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00780b8670 con 0x7f0080159ba0 2023-10-14T11:15:14.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.651+0000 7f0067fff640 1 -- 172.21.15.26:0/4102663811 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00780b87d0 con 0x7f0080159ba0 2023-10-14T11:15:14.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.651+0000 7f0067fff640 1 -- 172.21.15.26:0/4102663811 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00780b8b60 con 0x7f0080159ba0 2023-10-14T11:15:14.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.651+0000 7f0085e79640 1 -- 172.21.15.26:0/4102663811 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00801584c0 con 0x7f0080159ba0 2023-10-14T11:15:14.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.651+0000 7f0085e79640 1 -- 172.21.15.26:0/4102663811 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0080158a80 con 0x7f0080159ba0 2023-10-14T11:15:14.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.651+0000 7f0085e79640 1 -- 172.21.15.26:0/4102663811 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00801570a0 con 0x7f0080159ba0 2023-10-14T11:15:14.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.651+0000 7f0067fff640 1 -- 172.21.15.26:0/4102663811 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f00780b8cc0 con 0x7f0080159ba0 2023-10-14T11:15:14.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.651+0000 7f0067fff640 1 --2- 172.21.15.26:0/4102663811 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f006c0664a0 0x7f006c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:14.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.651+0000 7f0067fff640 1 -- 172.21.15.26:0/4102663811 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f007811f4e0 con 0x7f0080159ba0 2023-10-14T11:15:14.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.651+0000 7f007f7fe640 1 --2- 172.21.15.26:0/4102663811 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f006c0664a0 0x7f006c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:14.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.651+0000 7f007f7fe640 1 --2- 172.21.15.26:0/4102663811 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f006c0664a0 0x7f006c068960 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0070000f70 tx=0x7f0070009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:14.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.655+0000 7f0067fff640 1 -- 172.21.15.26:0/4102663811 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f00801570a0 con 0x7f0080159ba0 2023-10-14T11:15:14.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.847+0000 7f0085e79640 1 -- 172.21.15.26:0/4102663811 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00801570a0 con 0x7f0080159ba0 2023-10-14T11:15:14.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.847+0000 7f0067fff640 1 -- 172.21.15.26:0/4102663811 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f00801570a0 con 0x7f0080159ba0 2023-10-14T11:15:14.854 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:15:14.854 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/633779909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":633779909},{"type":"v1","addr":"172.21.15.110:6834","nonce":633779909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5995,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3833036081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3833036081},{"type":"v1","addr":"172.21.15.110:6835","nonce":3833036081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":6144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2594736858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2594736858},{"type":"v1","addr":"172.21.15.26:6835","nonce":2594736858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:14:49.973814+0000","modified":"2023-10-14T11:14:52.995854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6147},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6147":{"gid":6147,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6837/2641279888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2641279888},{"type":"v1","addr":"172.21.15.26:6837","nonce":2641279888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-14T11:15:14.854 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 26 2023-10-14T11:15:14.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.847+0000 7f0085e79640 1 -- 172.21.15.26:0/4102663811 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f006c0664a0 msgr2=0x7f006c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:14.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.847+0000 7f0085e79640 1 --2- 172.21.15.26:0/4102663811 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f006c0664a0 0x7f006c068960 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0070000f70 tx=0x7f0070009040 comp rx=0 tx=0).stop 2023-10-14T11:15:14.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.847+0000 7f0085e79640 1 -- 172.21.15.26:0/4102663811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0080159ba0 msgr2=0x7f0080157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:14.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.847+0000 7f0085e79640 1 --2- 172.21.15.26:0/4102663811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0080159ba0 0x7f0080157380 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f00780af040 tx=0x7f0078019780 comp rx=0 tx=0).stop 2023-10-14T11:15:14.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.847+0000 7f0085e79640 1 -- 172.21.15.26:0/4102663811 shutdown_connections 2023-10-14T11:15:14.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.847+0000 7f0085e79640 1 --2- 172.21.15.26:0/4102663811 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f006c0664a0 0x7f006c068960 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:14.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.847+0000 7f0085e79640 1 --2- 172.21.15.26:0/4102663811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0080159ba0 0x7f0080157380 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:14.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.847+0000 7f0085e79640 1 --2- 172.21.15.26:0/4102663811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00801597c0 0x7f00801502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:14.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.847+0000 7f0085e79640 1 --2- 172.21.15.26:0/4102663811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00800c8cb0 0x7f008014c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:14.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.847+0000 7f0085e79640 1 -- 172.21.15.26:0/4102663811 >> 172.21.15.26:0/4102663811 conn(0x7f008006c190 msgr2=0x7f00800ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:14.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.847+0000 7f0085e79640 1 -- 172.21.15.26:0/4102663811 shutdown_connections 2023-10-14T11:15:14.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:14.847+0000 7f0085e79640 1 -- 172.21.15.26:0/4102663811 wait complete. 2023-10-14T11:15:14.876 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:15:15.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.011+0000 7fc7929b8640 1 Processor -- start 2023-10-14T11:15:15.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.011+0000 7fc7929b8640 1 -- start start 2023-10-14T11:15:15.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc7929b8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc78c1597c0 0x7fc78c0ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:15.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc7929b8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc78c159ba0 0x7fc78c0cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:15.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc7929b8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78c0723d0 con 0x7fc78c0adc10 2023-10-14T11:15:15.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc7929b8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78c0717c0 con 0x7fc78c1597c0 2023-10-14T11:15:15.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc7929b8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c071aa0 con 0x7fc78c159ba0 2023-10-14T11:15:15.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc790f55640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc78c0adc10 0x7fc78c0cb350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45682/0 (socket says 172.21.15.26:45682) 2023-10-14T11:15:15.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc790f55640 1 -- 172.21.15.26:0/4077932630 learned_addr learned my addr 172.21.15.26:0/4077932630 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:15.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc78bfff640 1 --2- 172.21.15.26:0/4077932630 >> v2:172.21.15.110:3300/0 conn(0x7fc78c1597c0 0x7fc78c0ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:15.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc78b7fe640 1 --2- 172.21.15.26:0/4077932630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc78c159ba0 0x7fc78c0cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:15.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc78affd640 1 -- 172.21.15.26:0/4077932630 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831311521 0 0) 0x7fc78c0723d0 con 0x7fc78c0adc10 2023-10-14T11:15:15.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc78affd640 1 -- 172.21.15.26:0/4077932630 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc774003530 con 0x7fc78c0adc10 2023-10-14T11:15:15.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc78affd640 1 -- 172.21.15.26:0/4077932630 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1046602365 0 0) 0x7fc774003530 con 0x7fc78c0adc10 2023-10-14T11:15:15.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc78affd640 1 -- 172.21.15.26:0/4077932630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc78c159ba0 msgr2=0x7fc78c0cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:15.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc78affd640 1 --2- 172.21.15.26:0/4077932630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc78c159ba0 0x7fc78c0cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc78affd640 1 -- 172.21.15.26:0/4077932630 >> v2:172.21.15.110:3300/0 conn(0x7fc78c1597c0 msgr2=0x7fc78c0ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:15.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc78affd640 1 --2- 172.21.15.26:0/4077932630 >> v2:172.21.15.110:3300/0 conn(0x7fc78c1597c0 0x7fc78c0ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc78affd640 1 -- 172.21.15.26:0/4077932630 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c071d80 con 0x7fc78c0adc10 2023-10-14T11:15:15.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc78affd640 1 -- 172.21.15.26:0/4077932630 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7fc784001a00 con 0x7fc78c0adc10 2023-10-14T11:15:15.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc78bfff640 1 --2- 172.21.15.26:0/4077932630 >> v2:172.21.15.110:3300/0 conn(0x7fc78c1597c0 0x7fc78c0ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:15:15.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc78affd640 1 -- 172.21.15.26:0/4077932630 >> v1:172.21.15.26:6789/0 conn(0x7fc78c0adc10 legacy=0x7fc78c0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:15.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc78affd640 1 --2- 172.21.15.26:0/4077932630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc78c159ba0 0x7fc774003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:15.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc78affd640 1 --2- 172.21.15.26:0/4077932630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc774003f00 0x7fc7740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:15.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc78affd640 1 --2- 172.21.15.26:0/4077932630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc774004d10 0x7fc774005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:15.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc78affd640 1 -- 172.21.15.26:0/4077932630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0717c0 con 0x7fc774004d10 2023-10-14T11:15:15.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc78affd640 1 -- 172.21.15.26:0/4077932630 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c071aa0 con 0x7fc774003f00 2023-10-14T11:15:15.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc78affd640 1 -- 172.21.15.26:0/4077932630 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77400b990 con 0x7fc78c159ba0 2023-10-14T11:15:15.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc790f55640 1 --2- 172.21.15.26:0/4077932630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc774004d10 0x7fc774005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:15.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc78bfff640 1 --2- 172.21.15.26:0/4077932630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc78c159ba0 0x7fc774003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:15.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc78b7fe640 1 --2- 172.21.15.26:0/4077932630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc774003f00 0x7fc7740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:15.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc790f55640 1 -- 172.21.15.26:0/4077932630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc78c159ba0 msgr2=0x7fc774003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:15.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc790f55640 1 --2- 172.21.15.26:0/4077932630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc78c159ba0 0x7fc774003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc790f55640 1 -- 172.21.15.26:0/4077932630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc774003f00 msgr2=0x7fc7740047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:15.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc790f55640 1 --2- 172.21.15.26:0/4077932630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc774003f00 0x7fc7740047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.015+0000 7fc790f55640 1 -- 172.21.15.26:0/4077932630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc774003530 con 0x7fc774004d10 2023-10-14T11:15:15.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.019+0000 7fc790f55640 1 --2- 172.21.15.26:0/4077932630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc774004d10 0x7fc774005190 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fc78400a860 tx=0x7fc78401d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b391573747ca83d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:15.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.019+0000 7fc78affd640 1 -- 172.21.15.26:0/4077932630 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7840ad630 con 0x7fc774004d10 2023-10-14T11:15:15.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.019+0000 7fc78affd640 1 -- 172.21.15.26:0/4077932630 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7840a8070 con 0x7fc774004d10 2023-10-14T11:15:15.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.019+0000 7fc78affd640 1 -- 172.21.15.26:0/4077932630 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7840ada70 con 0x7fc774004d10 2023-10-14T11:15:15.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.019+0000 7fc7929b8640 1 -- 172.21.15.26:0/4077932630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc774004d10 msgr2=0x7fc774005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:15.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.019+0000 7fc7929b8640 1 --2- 172.21.15.26:0/4077932630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc774004d10 0x7fc774005190 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fc78400a860 tx=0x7fc78401d300 comp rx=0 tx=0).stop 2023-10-14T11:15:15.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.019+0000 7fc790f55640 1 -- 172.21.15.26:0/4077932630 reap_dead start 2023-10-14T11:15:15.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.019+0000 7fc7929b8640 1 -- 172.21.15.26:0/4077932630 shutdown_connections 2023-10-14T11:15:15.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.019+0000 7fc7929b8640 1 -- 172.21.15.26:0/4077932630 >> 172.21.15.26:0/4077932630 conn(0x7fc78c06c190 msgr2=0x7fc78c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:15.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.019+0000 7fc7929b8640 1 -- 172.21.15.26:0/4077932630 shutdown_connections 2023-10-14T11:15:15.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.019+0000 7fc7929b8640 1 -- 172.21.15.26:0/4077932630 wait complete. 2023-10-14T11:15:15.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc7929b8640 1 Processor -- start 2023-10-14T11:15:15.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc7929b8640 1 -- start start 2023-10-14T11:15:15.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc7929b8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc774004d10 0x7fc78c15b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:15.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc7929b8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc78c0c5730 0x7fc78c0c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:15.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc7929b8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc78c14a1b0 0x7fc78c14a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:15.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc7929b8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0c67b0 con 0x7fc774004d10 2023-10-14T11:15:15.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc7929b8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0c61f0 con 0x7fc78c0c5730 2023-10-14T11:15:15.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc7929b8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0c64d0 con 0x7fc78c14a1b0 2023-10-14T11:15:15.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc78bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc774004d10 0x7fc78c15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:15.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc78bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc774004d10 0x7fc78c15b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34182/0 (socket says 172.21.15.26:34182) 2023-10-14T11:15:15.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc78bfff640 1 -- 172.21.15.26:0/1103749170 learned_addr learned my addr 172.21.15.26:0/1103749170 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:15.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc790f55640 1 --2- 172.21.15.26:0/1103749170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc78c14a1b0 0x7fc78c14a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:15.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc78b7fe640 1 --2- 172.21.15.26:0/1103749170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc78c0c5730 0x7fc78c0c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:15.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc78bfff640 1 -- 172.21.15.26:0/1103749170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc78c14a1b0 msgr2=0x7fc78c14a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:15.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc78bfff640 1 --2- 172.21.15.26:0/1103749170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc78c14a1b0 0x7fc78c14a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc78bfff640 1 -- 172.21.15.26:0/1103749170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc78c0c5730 msgr2=0x7fc78c0c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:15.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc78bfff640 1 --2- 172.21.15.26:0/1103749170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc78c0c5730 0x7fc78c0c5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc78bfff640 1 -- 172.21.15.26:0/1103749170 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c0c6ca0 con 0x7fc774004d10 2023-10-14T11:15:15.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc790f55640 1 --2- 172.21.15.26:0/1103749170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc78c14a1b0 0x7fc78c14a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:15.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc78bfff640 1 --2- 172.21.15.26:0/1103749170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc774004d10 0x7fc78c15b320 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fc77c011cd0 tx=0x7fc77c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:15.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc788ff9640 1 -- 172.21.15.26:0/1103749170 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c00fd20 con 0x7fc774004d10 2023-10-14T11:15:15.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc788ff9640 1 -- 172.21.15.26:0/1103749170 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77c00fe80 con 0x7fc774004d10 2023-10-14T11:15:15.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc788ff9640 1 -- 172.21.15.26:0/1103749170 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c004240 con 0x7fc774004d10 2023-10-14T11:15:15.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc7929b8640 1 -- 172.21.15.26:0/1103749170 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78c0c6f80 con 0x7fc774004d10 2023-10-14T11:15:15.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc7929b8640 1 -- 172.21.15.26:0/1103749170 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78c15b860 con 0x7fc774004d10 2023-10-14T11:15:15.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.023+0000 7fc7929b8640 1 -- 172.21.15.26:0/1103749170 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc78c074010 con 0x7fc774004d10 2023-10-14T11:15:15.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.027+0000 7fc788ff9640 1 -- 172.21.15.26:0/1103749170 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc77c0043a0 con 0x7fc774004d10 2023-10-14T11:15:15.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.027+0000 7fc788ff9640 1 --2- 172.21.15.26:0/1103749170 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc7780664a0 0x7fc778068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:15.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.027+0000 7fc788ff9640 1 -- 172.21.15.26:0/1103749170 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fc77c084ae0 con 0x7fc774004d10 2023-10-14T11:15:15.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.027+0000 7fc78b7fe640 1 --2- 172.21.15.26:0/1103749170 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc7780664a0 0x7fc778068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:15.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.027+0000 7fc78b7fe640 1 --2- 172.21.15.26:0/1103749170 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc7780664a0 0x7fc778068960 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc78c14d4b0 tx=0x7fc780008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:15.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.031+0000 7fc788ff9640 1 -- 172.21.15.26:0/1103749170 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc77c051df0 con 0x7fc774004d10 2023-10-14T11:15:15.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.191+0000 7fc7929b8640 1 -- 172.21.15.26:0/1103749170 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc78c0c4fc0 con 0x7fc774004d10 2023-10-14T11:15:15.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.195+0000 7fc788ff9640 1 -- 172.21.15.26:0/1103749170 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16790 (secure 0 0 0) 0x7fc77c022070 con 0x7fc774004d10 2023-10-14T11:15:15.200 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:15:15.201 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":55,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:14:51.591742+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:14:47.752880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:14:48.971211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:15:15.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.195+0000 7fc7929b8640 1 -- 172.21.15.26:0/1103749170 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc7780664a0 msgr2=0x7fc778068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:15.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.195+0000 7fc7929b8640 1 --2- 172.21.15.26:0/1103749170 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc7780664a0 0x7fc778068960 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc78c14d4b0 tx=0x7fc780008040 comp rx=0 tx=0).stop 2023-10-14T11:15:15.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.195+0000 7fc7929b8640 1 -- 172.21.15.26:0/1103749170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc774004d10 msgr2=0x7fc78c15b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:15.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.195+0000 7fc7929b8640 1 --2- 172.21.15.26:0/1103749170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc774004d10 0x7fc78c15b320 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fc77c011cd0 tx=0x7fc77c00f610 comp rx=0 tx=0).stop 2023-10-14T11:15:15.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.195+0000 7fc7929b8640 1 -- 172.21.15.26:0/1103749170 shutdown_connections 2023-10-14T11:15:15.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.195+0000 7fc7929b8640 1 --2- 172.21.15.26:0/1103749170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc78c14a1b0 0x7fc78c14a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.195+0000 7fc7929b8640 1 --2- 172.21.15.26:0/1103749170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc78c0c5730 0x7fc78c0c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.195+0000 7fc7929b8640 1 --2- 172.21.15.26:0/1103749170 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc7780664a0 0x7fc778068960 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.195+0000 7fc7929b8640 1 --2- 172.21.15.26:0/1103749170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc774004d10 0x7fc78c15b320 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.195+0000 7fc7929b8640 1 -- 172.21.15.26:0/1103749170 >> 172.21.15.26:0/1103749170 conn(0x7fc78c06c190 msgr2=0x7fc78c15c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:15.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.195+0000 7fc7929b8640 1 -- 172.21.15.26:0/1103749170 shutdown_connections 2023-10-14T11:15:15.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.195+0000 7fc7929b8640 1 -- 172.21.15.26:0/1103749170 wait complete. 2023-10-14T11:15:15.223 INFO:tasks.cephfs.filesystem:Destroying file system testcephfs1 and related pools 2023-10-14T11:15:15.224 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:15:15.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.363+0000 7fccf27a7640 1 Processor -- start 2023-10-14T11:15:15.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.363+0000 7fccf27a7640 1 -- start start 2023-10-14T11:15:15.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.363+0000 7fccf27a7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fccec15c980 0x7fccec06af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:15.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.363+0000 7fccf27a7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fccec15cd60 0x7fccec0b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:15.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.363+0000 7fccf27a7640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccec0d3510 con 0x7fccec0d0d80 2023-10-14T11:15:15.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.363+0000 7fccf27a7640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccec0cd2b0 con 0x7fccec15cd60 2023-10-14T11:15:15.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.363+0000 7fccf27a7640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccec0d2f50 con 0x7fccec15c980 2023-10-14T11:15:15.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.363+0000 7fccf0fa4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fccec15cd60 0x7fccec0b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:15.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.363+0000 7fccf0fa4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fccec15cd60 0x7fccec0b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34192/0 (socket says 172.21.15.26:34192) 2023-10-14T11:15:15.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.363+0000 7fccf0fa4640 1 -- 172.21.15.26:0/2041939223 learned_addr learned my addr 172.21.15.26:0/2041939223 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:15.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.363+0000 7fccf17a5640 1 --2- 172.21.15.26:0/2041939223 >> v2:172.21.15.110:3300/0 conn(0x7fccec15c980 0x7fccec06af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:15.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.363+0000 7fccf0fa4640 1 -- 172.21.15.26:0/2041939223 >> v2:172.21.15.110:3300/0 conn(0x7fccec15c980 msgr2=0x7fccec06af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:15.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.363+0000 7fccf0fa4640 1 --2- 172.21.15.26:0/2041939223 >> v2:172.21.15.110:3300/0 conn(0x7fccec15c980 0x7fccec06af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.363+0000 7fccf0fa4640 1 -- 172.21.15.26:0/2041939223 >> v1:172.21.15.110:6789/0 conn(0x7fccec0d0d80 legacy=0x7fccec0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:15.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.363+0000 7fccf0fa4640 1 -- 172.21.15.26:0/2041939223 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec0d3230 con 0x7fccec15cd60 2023-10-14T11:15:15.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.367+0000 7fccf0fa4640 1 --2- 172.21.15.26:0/2041939223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccec15cd60 0x7fccec0b1b90 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fccec08b910 tx=0x7fccdc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af67079c6cc031c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:15.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.367+0000 7fcce3fff640 1 -- 172.21.15.26:0/2041939223 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc0ad680 con 0x7fccec15cd60 2023-10-14T11:15:15.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.367+0000 7fcce3fff640 1 -- 172.21.15.26:0/2041939223 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccdc0ad7e0 con 0x7fccec15cd60 2023-10-14T11:15:15.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.367+0000 7fcce3fff640 1 -- 172.21.15.26:0/2041939223 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc0adb70 con 0x7fccec15cd60 2023-10-14T11:15:15.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.367+0000 7fccf27a7640 1 -- 172.21.15.26:0/2041939223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccec15cd60 msgr2=0x7fccec0b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:15.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.367+0000 7fccf27a7640 1 --2- 172.21.15.26:0/2041939223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccec15cd60 0x7fccec0b1b90 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fccec08b910 tx=0x7fccdc01c470 comp rx=0 tx=0).stop 2023-10-14T11:15:15.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.367+0000 7fccf27a7640 1 -- 172.21.15.26:0/2041939223 shutdown_connections 2023-10-14T11:15:15.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.367+0000 7fccf27a7640 1 --2- 172.21.15.26:0/2041939223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccec15cd60 0x7fccec0b1b90 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.367+0000 7fccf27a7640 1 --2- 172.21.15.26:0/2041939223 >> v2:172.21.15.110:3300/0 conn(0x7fccec15c980 0x7fccec06af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.367+0000 7fccf27a7640 1 -- 172.21.15.26:0/2041939223 >> 172.21.15.26:0/2041939223 conn(0x7fccec09ba80 msgr2=0x7fccec0d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:15.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.367+0000 7fccf27a7640 1 -- 172.21.15.26:0/2041939223 shutdown_connections 2023-10-14T11:15:15.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.367+0000 7fccf27a7640 1 -- 172.21.15.26:0/2041939223 wait complete. 2023-10-14T11:15:15.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.367+0000 7fccf27a7640 1 Processor -- start 2023-10-14T11:15:15.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fccf27a7640 1 -- start start 2023-10-14T11:15:15.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fccf27a7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccec0d0d80 0x7fccec158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:15.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fccf27a7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccec15c980 0x7fccec0cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:15.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fccf27a7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fccec15cd60 0x7fccec0af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:15.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fccf27a7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec15d140 con 0x7fccec0d0d80 2023-10-14T11:15:15.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fccf27a7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec158570 con 0x7fccec15c980 2023-10-14T11:15:15.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fccf27a7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0cc630 con 0x7fccec15cd60 2023-10-14T11:15:15.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fccf17a5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccec0d0d80 0x7fccec158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:15.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fccf17a5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccec0d0d80 0x7fccec158030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34206/0 (socket says 172.21.15.26:34206) 2023-10-14T11:15:15.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fccf17a5640 1 -- 172.21.15.26:0/399286498 learned_addr learned my addr 172.21.15.26:0/399286498 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:15.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fccf1fa6640 1 --2- 172.21.15.26:0/399286498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fccec15cd60 0x7fccec0af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:15.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fccf0fa4640 1 --2- 172.21.15.26:0/399286498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccec15c980 0x7fccec0cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:15.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fccf17a5640 1 -- 172.21.15.26:0/399286498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fccec15cd60 msgr2=0x7fccec0af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:15.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fccf17a5640 1 --2- 172.21.15.26:0/399286498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fccec15cd60 0x7fccec0af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fccf17a5640 1 -- 172.21.15.26:0/399286498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccec15c980 msgr2=0x7fccec0cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:15.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fccf17a5640 1 --2- 172.21.15.26:0/399286498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccec15c980 0x7fccec0cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fccf17a5640 1 -- 172.21.15.26:0/399286498 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc0094d0 con 0x7fccec0d0d80 2023-10-14T11:15:15.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fccf1fa6640 1 --2- 172.21.15.26:0/399286498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fccec15cd60 0x7fccec0af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:15.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fccf17a5640 1 --2- 172.21.15.26:0/399286498 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccec0d0d80 0x7fccec158030 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fcce800e9b0 tx=0x7fcce800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:15.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fcce1ffb640 1 -- 172.21.15.26:0/399286498 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8009670 con 0x7fccec0d0d80 2023-10-14T11:15:15.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fcce1ffb640 1 -- 172.21.15.26:0/399286498 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce800c9a0 con 0x7fccec0d0d80 2023-10-14T11:15:15.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fccf27a7640 1 -- 172.21.15.26:0/399286498 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccec0d1720 con 0x7fccec0d0d80 2023-10-14T11:15:15.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fcce1ffb640 1 -- 172.21.15.26:0/399286498 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce800cd10 con 0x7fccec0d0d80 2023-10-14T11:15:15.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fccf27a7640 1 -- 172.21.15.26:0/399286498 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccec15d390 con 0x7fccec0d0d80 2023-10-14T11:15:15.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.371+0000 7fccf27a7640 1 -- 172.21.15.26:0/399286498 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccec04e9c0 con 0x7fccec0d0d80 2023-10-14T11:15:15.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.375+0000 7fcce1ffb640 1 -- 172.21.15.26:0/399286498 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcce8013470 con 0x7fccec0d0d80 2023-10-14T11:15:15.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.375+0000 7fcce1ffb640 1 --2- 172.21.15.26:0/399286498 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fccd00664a0 0x7fccd0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:15.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.375+0000 7fcce1ffb640 1 -- 172.21.15.26:0/399286498 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fcce8084640 con 0x7fccec0d0d80 2023-10-14T11:15:15.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.375+0000 7fccf0fa4640 1 --2- 172.21.15.26:0/399286498 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fccd00664a0 0x7fccd0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:15.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.375+0000 7fccf0fa4640 1 --2- 172.21.15.26:0/399286498 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fccd00664a0 0x7fccd0068960 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0af000 tx=0x7fccdc0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:15.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.379+0000 7fcce1ffb640 1 -- 172.21.15.26:0/399286498 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcce8051970 con 0x7fccec0d0d80 2023-10-14T11:15:15.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.567+0000 7fccf27a7640 1 -- 172.21.15.26:0/399286498 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fccec0d36b0 con 0x7fccec0d0d80 2023-10-14T11:15:15.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.567+0000 7fcce1ffb640 1 -- 172.21.15.26:0/399286498 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4921 (secure 0 0 0) 0x7fcce8054f90 con 0x7fccec0d0d80 2023-10-14T11:15:15.574 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:15:15.574 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/633779909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":633779909},{"type":"v1","addr":"172.21.15.110:6834","nonce":633779909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5995,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3833036081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3833036081},{"type":"v1","addr":"172.21.15.110:6835","nonce":3833036081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":6144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2594736858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2594736858},{"type":"v1","addr":"172.21.15.26:6835","nonce":2594736858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:14:49.973814+0000","modified":"2023-10-14T11:14:52.995854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6147},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6147":{"gid":6147,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6837/2641279888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2641279888},{"type":"v1","addr":"172.21.15.26:6837","nonce":2641279888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-14T11:15:15.574 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 26 2023-10-14T11:15:15.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.567+0000 7fccf27a7640 1 -- 172.21.15.26:0/399286498 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fccd00664a0 msgr2=0x7fccd0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:15.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.567+0000 7fccf27a7640 1 --2- 172.21.15.26:0/399286498 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fccd00664a0 0x7fccd0068960 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0af000 tx=0x7fccdc0a7000 comp rx=0 tx=0).stop 2023-10-14T11:15:15.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.567+0000 7fccf27a7640 1 -- 172.21.15.26:0/399286498 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccec0d0d80 msgr2=0x7fccec158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:15.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.567+0000 7fccf27a7640 1 --2- 172.21.15.26:0/399286498 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccec0d0d80 0x7fccec158030 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fcce800e9b0 tx=0x7fcce800ee70 comp rx=0 tx=0).stop 2023-10-14T11:15:15.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.567+0000 7fccf27a7640 1 -- 172.21.15.26:0/399286498 shutdown_connections 2023-10-14T11:15:15.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.567+0000 7fccf27a7640 1 --2- 172.21.15.26:0/399286498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fccec15cd60 0x7fccec0af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.567+0000 7fccf27a7640 1 --2- 172.21.15.26:0/399286498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccec15c980 0x7fccec0cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.567+0000 7fccf27a7640 1 --2- 172.21.15.26:0/399286498 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fccd00664a0 0x7fccd0068960 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.567+0000 7fccf27a7640 1 --2- 172.21.15.26:0/399286498 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccec0d0d80 0x7fccec158030 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.567+0000 7fccf27a7640 1 -- 172.21.15.26:0/399286498 >> 172.21.15.26:0/399286498 conn(0x7fccec09ba80 msgr2=0x7fccec0b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:15.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.567+0000 7fccf27a7640 1 -- 172.21.15.26:0/399286498 shutdown_connections 2023-10-14T11:15:15.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.567+0000 7fccf27a7640 1 -- 172.21.15.26:0/399286498 wait complete. 2023-10-14T11:15:15.595 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:15:15.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.731+0000 7fe2d2e86640 1 Processor -- start 2023-10-14T11:15:15.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.731+0000 7fe2d2e86640 1 -- start start 2023-10-14T11:15:15.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.735+0000 7fe2d2e86640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe2cc070c40 0x7fe2cc15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:15.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.735+0000 7fe2d2e86640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2cc0b4020 0x7fe2cc0b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:15.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.735+0000 7fe2d2e86640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2cc15be60 con 0x7fe2cc0b0620 2023-10-14T11:15:15.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.735+0000 7fe2d2e86640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2cc15b3b0 con 0x7fe2cc070c40 2023-10-14T11:15:15.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.735+0000 7fe2d2e86640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc0b0a90 con 0x7fe2cc0b4020 2023-10-14T11:15:15.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.735+0000 7fe2d0c22640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe2cc070c40 0x7fe2cc15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:15.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.735+0000 7fe2d1423640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe2cc0b0620 0x7fe2cc15c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45696/0 (socket says 172.21.15.26:45696) 2023-10-14T11:15:15.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.735+0000 7fe2d1423640 1 -- 172.21.15.26:0/1753961830 learned_addr learned my addr 172.21.15.26:0/1753961830 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:15.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.735+0000 7fe2cbfff640 1 --2- 172.21.15.26:0/1753961830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2cc0b4020 0x7fe2cc0b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:15.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.735+0000 7fe2d0c22640 1 -- 172.21.15.26:0/1753961830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2cc0b4020 msgr2=0x7fe2cc0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:15.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.735+0000 7fe2d0c22640 1 --2- 172.21.15.26:0/1753961830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2cc0b4020 0x7fe2cc0b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.735+0000 7fe2d0c22640 1 -- 172.21.15.26:0/1753961830 >> v1:172.21.15.26:6789/0 conn(0x7fe2cc0b0620 legacy=0x7fe2cc15c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:15.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.735+0000 7fe2d0c22640 1 -- 172.21.15.26:0/1753961830 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc15c1f0 con 0x7fe2cc070c40 2023-10-14T11:15:15.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.735+0000 7fe2cb7fe640 1 -- 172.21.15.26:0/1753961830 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722842157 0 0) 0x7fe2cc15be60 con 0x7fe2cc0b0620 2023-10-14T11:15:15.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.735+0000 7fe2cbfff640 1 --2- 172.21.15.26:0/1753961830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2cc0b4020 0x7fe2cc0b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:15:15.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.739+0000 7fe2d0c22640 1 --2- 172.21.15.26:0/1753961830 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2cc070c40 0x7fe2cc15ae70 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00097c0 tx=0x7fe2c001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eac6d8a39e701a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:15.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.739+0000 7fe2cb7fe640 1 -- 172.21.15.26:0/1753961830 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00ab5f0 con 0x7fe2cc070c40 2023-10-14T11:15:15.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.739+0000 7fe2cb7fe640 1 -- 172.21.15.26:0/1753961830 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c00ab750 con 0x7fe2cc070c40 2023-10-14T11:15:15.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.739+0000 7fe2cb7fe640 1 -- 172.21.15.26:0/1753961830 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00abae0 con 0x7fe2cc070c40 2023-10-14T11:15:15.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.739+0000 7fe2d2e86640 1 -- 172.21.15.26:0/1753961830 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2cc070c40 msgr2=0x7fe2cc15ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:15.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.739+0000 7fe2d2e86640 1 --2- 172.21.15.26:0/1753961830 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2cc070c40 0x7fe2cc15ae70 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00097c0 tx=0x7fe2c001c3f0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.739+0000 7fe2d2e86640 1 -- 172.21.15.26:0/1753961830 shutdown_connections 2023-10-14T11:15:15.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.739+0000 7fe2d2e86640 1 --2- 172.21.15.26:0/1753961830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2cc0b4020 0x7fe2cc0b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.739+0000 7fe2d2e86640 1 --2- 172.21.15.26:0/1753961830 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2cc070c40 0x7fe2cc15ae70 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.739+0000 7fe2d2e86640 1 -- 172.21.15.26:0/1753961830 >> 172.21.15.26:0/1753961830 conn(0x7fe2cc06c190 msgr2=0x7fe2cc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:15.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.739+0000 7fe2d2e86640 1 -- 172.21.15.26:0/1753961830 shutdown_connections 2023-10-14T11:15:15.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.739+0000 7fe2d2e86640 1 -- 172.21.15.26:0/1753961830 wait complete. 2023-10-14T11:15:15.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.739+0000 7fe2d2e86640 1 Processor -- start 2023-10-14T11:15:15.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.739+0000 7fe2d2e86640 1 -- start start 2023-10-14T11:15:15.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2d2e86640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2cc070c40 0x7fe2cc1517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:15.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2d2e86640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2cc0b0620 0x7fe2cc0cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:15.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2d2e86640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2cc0b4020 0x7fe2cc0cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:15.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2d2e86640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc0af6a0 con 0x7fe2cc070c40 2023-10-14T11:15:15.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2d2e86640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc0ccfb0 con 0x7fe2cc0b4020 2023-10-14T11:15:15.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2d2e86640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc0cd290 con 0x7fe2cc0b0620 2023-10-14T11:15:15.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2d0c22640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2cc070c40 0x7fe2cc1517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:15.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2d0c22640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2cc070c40 0x7fe2cc1517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34216/0 (socket says 172.21.15.26:34216) 2023-10-14T11:15:15.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2d0c22640 1 -- 172.21.15.26:0/2402791267 learned_addr learned my addr 172.21.15.26:0/2402791267 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:15.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2d1423640 1 --2- 172.21.15.26:0/2402791267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2cc0b4020 0x7fe2cc0cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:15.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2cbfff640 1 --2- 172.21.15.26:0/2402791267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2cc0b0620 0x7fe2cc0cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:15.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2d0c22640 1 -- 172.21.15.26:0/2402791267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2cc0b0620 msgr2=0x7fe2cc0cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:15.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2d0c22640 1 --2- 172.21.15.26:0/2402791267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2cc0b0620 0x7fe2cc0cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2d0c22640 1 -- 172.21.15.26:0/2402791267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2cc0b4020 msgr2=0x7fe2cc0cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:15.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2d0c22640 1 --2- 172.21.15.26:0/2402791267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2cc0b4020 0x7fe2cc0cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2d0c22640 1 -- 172.21.15.26:0/2402791267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c0009420 con 0x7fe2cc070c40 2023-10-14T11:15:15.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2d0c22640 1 --2- 172.21.15.26:0/2402791267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2cc070c40 0x7fe2cc1517d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe2c001a020 tx=0x7fe2c001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:15.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2c97fa640 1 -- 172.21.15.26:0/2402791267 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00b5810 con 0x7fe2cc070c40 2023-10-14T11:15:15.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2c97fa640 1 -- 172.21.15.26:0/2402791267 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c00b5990 con 0x7fe2cc070c40 2023-10-14T11:15:15.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2c97fa640 1 -- 172.21.15.26:0/2402791267 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00b5d40 con 0x7fe2cc070c40 2023-10-14T11:15:15.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2d2e86640 1 -- 172.21.15.26:0/2402791267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2cc0cd570 con 0x7fe2cc070c40 2023-10-14T11:15:15.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2d2e86640 1 -- 172.21.15.26:0/2402791267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2cc0cdb30 con 0x7fe2cc070c40 2023-10-14T11:15:15.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.743+0000 7fe2d2e86640 1 -- 172.21.15.26:0/2402791267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2cc074010 con 0x7fe2cc070c40 2023-10-14T11:15:15.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.747+0000 7fe2c97fa640 1 -- 172.21.15.26:0/2402791267 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe2c00c83a0 con 0x7fe2cc070c40 2023-10-14T11:15:15.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.747+0000 7fe2c97fa640 1 --2- 172.21.15.26:0/2402791267 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe2b00664a0 0x7fe2b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:15.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.747+0000 7fe2c97fa640 1 -- 172.21.15.26:0/2402791267 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fe2c00a8050 con 0x7fe2cc070c40 2023-10-14T11:15:15.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.747+0000 7fe2cbfff640 1 --2- 172.21.15.26:0/2402791267 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe2b00664a0 0x7fe2b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:15.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.747+0000 7fe2cbfff640 1 --2- 172.21.15.26:0/2402791267 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe2b00664a0 0x7fe2b0068960 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc072c10 tx=0x7fe2b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:15.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.751+0000 7fe2c97fa640 1 -- 172.21.15.26:0/2402791267 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe2c00ec010 con 0x7fe2cc070c40 2023-10-14T11:15:15.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.943+0000 7fe2d2e86640 1 -- 172.21.15.26:0/2402791267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2cc15c9c0 con 0x7fe2cc070c40 2023-10-14T11:15:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.943+0000 7fe2c97fa640 1 -- 172.21.15.26:0/2402791267 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4921 (secure 0 0 0) 0x7fe2c00c4020 con 0x7fe2cc070c40 2023-10-14T11:15:15.951 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:15:15.952 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/633779909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":633779909},{"type":"v1","addr":"172.21.15.110:6834","nonce":633779909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5995,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3833036081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3833036081},{"type":"v1","addr":"172.21.15.110:6835","nonce":3833036081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":6144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2594736858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2594736858},{"type":"v1","addr":"172.21.15.26:6835","nonce":2594736858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:14:49.973814+0000","modified":"2023-10-14T11:14:52.995854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6147},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6147":{"gid":6147,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6837/2641279888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2641279888},{"type":"v1","addr":"172.21.15.26:6837","nonce":2641279888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-14T11:15:15.953 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 26 2023-10-14T11:15:15.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.947+0000 7fe2d2e86640 1 -- 172.21.15.26:0/2402791267 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe2b00664a0 msgr2=0x7fe2b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:15.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.947+0000 7fe2d2e86640 1 --2- 172.21.15.26:0/2402791267 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe2b00664a0 0x7fe2b0068960 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc072c10 tx=0x7fe2b8008040 comp rx=0 tx=0).stop 2023-10-14T11:15:15.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.947+0000 7fe2d2e86640 1 -- 172.21.15.26:0/2402791267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2cc070c40 msgr2=0x7fe2cc1517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:15.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.947+0000 7fe2d2e86640 1 --2- 172.21.15.26:0/2402791267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2cc070c40 0x7fe2cc1517d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe2c001a020 tx=0x7fe2c001ac30 comp rx=0 tx=0).stop 2023-10-14T11:15:15.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.947+0000 7fe2d2e86640 1 -- 172.21.15.26:0/2402791267 shutdown_connections 2023-10-14T11:15:15.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.947+0000 7fe2d2e86640 1 --2- 172.21.15.26:0/2402791267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2cc0b4020 0x7fe2cc0cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.947+0000 7fe2d2e86640 1 --2- 172.21.15.26:0/2402791267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2cc0b0620 0x7fe2cc0cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.947+0000 7fe2d2e86640 1 --2- 172.21.15.26:0/2402791267 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fe2b00664a0 0x7fe2b0068960 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.947+0000 7fe2d2e86640 1 --2- 172.21.15.26:0/2402791267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2cc070c40 0x7fe2cc1517d0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:15.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.947+0000 7fe2d2e86640 1 -- 172.21.15.26:0/2402791267 >> 172.21.15.26:0/2402791267 conn(0x7fe2cc06c190 msgr2=0x7fe2cc0b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:15.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.947+0000 7fe2d2e86640 1 -- 172.21.15.26:0/2402791267 shutdown_connections 2023-10-14T11:15:15.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:15.947+0000 7fe2d2e86640 1 -- 172.21.15.26:0/2402791267 wait complete. 2023-10-14T11:15:15.975 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:15:16.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f59cbb640 1 Processor -- start 2023-10-14T11:15:16.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f59cbb640 1 -- start start 2023-10-14T11:15:16.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f59cbb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f540d1490 0x7f8f5406af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f59cbb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8f5415cd60 0x7f8f540b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f59cbb640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f540d3510 con 0x7f8f5415c980 2023-10-14T11:15:16.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f59cbb640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f540cd2b0 con 0x7f8f5415cd60 2023-10-14T11:15:16.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f59cbb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f540d2f50 con 0x7f8f540d1490 2023-10-14T11:15:16.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f58cb9640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8f5415c980 0x7f8f540d0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45698/0 (socket says 172.21.15.26:45698) 2023-10-14T11:15:16.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f58cb9640 1 -- 172.21.15.26:0/2923990480 learned_addr learned my addr 172.21.15.26:0/2923990480 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:16.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f537fe640 1 -- 172.21.15.26:0/2923990480 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472018512 0 0) 0x7f8f480012a0 con 0x7f8f5415c980 2023-10-14T11:15:16.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f594ba640 1 --2- 172.21.15.26:0/2923990480 >> v2:172.21.15.110:3300/0 conn(0x7f8f5415cd60 0x7f8f540b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f537fe640 1 -- 172.21.15.26:0/2923990480 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f44003530 con 0x7f8f5415c980 2023-10-14T11:15:16.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f53fff640 1 --2- 172.21.15.26:0/2923990480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f540d1490 0x7f8f5406af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f537fe640 1 -- 172.21.15.26:0/2923990480 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1660230475 0 0) 0x7f8f44003530 con 0x7f8f5415c980 2023-10-14T11:15:16.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f537fe640 1 -- 172.21.15.26:0/2923990480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f540d1490 msgr2=0x7f8f5406af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:16.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f537fe640 1 --2- 172.21.15.26:0/2923990480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f540d1490 0x7f8f5406af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f537fe640 1 -- 172.21.15.26:0/2923990480 >> v2:172.21.15.110:3300/0 conn(0x7f8f5415cd60 msgr2=0x7f8f540b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:16.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f537fe640 1 --2- 172.21.15.26:0/2923990480 >> v2:172.21.15.110:3300/0 conn(0x7f8f5415cd60 0x7f8f540b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f537fe640 1 -- 172.21.15.26:0/2923990480 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f540d3230 con 0x7f8f5415c980 2023-10-14T11:15:16.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f537fe640 1 -- 172.21.15.26:0/2923990480 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f8f48001990 con 0x7f8f5415c980 2023-10-14T11:15:16.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f537fe640 1 -- 172.21.15.26:0/2923990480 >> v1:172.21.15.26:6789/0 conn(0x7f8f5415c980 legacy=0x7f8f540d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:16.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f537fe640 1 --2- 172.21.15.26:0/2923990480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f44003a60 0x7f8f44003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f537fe640 1 --2- 172.21.15.26:0/2923990480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f540d1490 0x7f8f440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f537fe640 1 --2- 172.21.15.26:0/2923990480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f44004d10 0x7f8f44005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f537fe640 1 -- 172.21.15.26:0/2923990480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f540cd2b0 con 0x7f8f44003a60 2023-10-14T11:15:16.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f537fe640 1 -- 172.21.15.26:0/2923990480 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f540d2f50 con 0x7f8f44004d10 2023-10-14T11:15:16.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f537fe640 1 -- 172.21.15.26:0/2923990480 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4400ba10 con 0x7f8f540d1490 2023-10-14T11:15:16.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f58cb9640 1 --2- 172.21.15.26:0/2923990480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f44003a60 0x7f8f44003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f53fff640 1 --2- 172.21.15.26:0/2923990480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f540d1490 0x7f8f440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f594ba640 1 --2- 172.21.15.26:0/2923990480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f44004d10 0x7f8f44005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f58cb9640 1 -- 172.21.15.26:0/2923990480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f540d1490 msgr2=0x7f8f440047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:16.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f58cb9640 1 --2- 172.21.15.26:0/2923990480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f540d1490 0x7f8f440047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f58cb9640 1 -- 172.21.15.26:0/2923990480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f44004d10 msgr2=0x7f8f44005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:16.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f58cb9640 1 --2- 172.21.15.26:0/2923990480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f44004d10 0x7f8f44005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.115+0000 7f8f58cb9640 1 -- 172.21.15.26:0/2923990480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f44003530 con 0x7f8f44003a60 2023-10-14T11:15:16.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.119+0000 7f8f58cb9640 1 --2- 172.21.15.26:0/2923990480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f44003a60 0x7f8f44003e80 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f8f480011e0 tx=0x7f8f4801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2cc8ffc5d08b4f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:16.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.119+0000 7f8f537fe640 1 -- 172.21.15.26:0/2923990480 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f480070d0 con 0x7f8f44003a60 2023-10-14T11:15:16.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.119+0000 7f8f537fe640 1 -- 172.21.15.26:0/2923990480 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f48007230 con 0x7f8f44003a60 2023-10-14T11:15:16.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.119+0000 7f8f537fe640 1 -- 172.21.15.26:0/2923990480 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f480075e0 con 0x7f8f44003a60 2023-10-14T11:15:16.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.119+0000 7f8f59cbb640 1 -- 172.21.15.26:0/2923990480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f44003a60 msgr2=0x7f8f44003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:16.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.119+0000 7f8f59cbb640 1 --2- 172.21.15.26:0/2923990480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f44003a60 0x7f8f44003e80 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f8f480011e0 tx=0x7f8f4801cc20 comp rx=0 tx=0).stop 2023-10-14T11:15:16.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.119+0000 7f8f594ba640 1 -- 172.21.15.26:0/2923990480 reap_dead start 2023-10-14T11:15:16.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.119+0000 7f8f59cbb640 1 -- 172.21.15.26:0/2923990480 shutdown_connections 2023-10-14T11:15:16.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.119+0000 7f8f59cbb640 1 -- 172.21.15.26:0/2923990480 >> 172.21.15.26:0/2923990480 conn(0x7f8f5409ba80 msgr2=0x7f8f540d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:16.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.119+0000 7f8f59cbb640 1 -- 172.21.15.26:0/2923990480 shutdown_connections 2023-10-14T11:15:16.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.119+0000 7f8f59cbb640 1 -- 172.21.15.26:0/2923990480 wait complete. 2023-10-14T11:15:16.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f59cbb640 1 Processor -- start 2023-10-14T11:15:16.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f59cbb640 1 -- start start 2023-10-14T11:15:16.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f59cbb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f44003a60 0x7f8f540b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f59cbb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f5414e7a0 0x7f8f540b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f59cbb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f5414ec40 0x7f8f5414f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f59cbb640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f540cbc60 con 0x7f8f5414e7a0 2023-10-14T11:15:16.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f59cbb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5414f930 con 0x7f8f44003a60 2023-10-14T11:15:16.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f59cbb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5414fc10 con 0x7f8f5414ec40 2023-10-14T11:15:16.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f53fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f5414e7a0 0x7f8f540b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f53fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f5414e7a0 0x7f8f540b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34238/0 (socket says 172.21.15.26:34238) 2023-10-14T11:15:16.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f53fff640 1 -- 172.21.15.26:0/2700619774 learned_addr learned my addr 172.21.15.26:0/2700619774 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:16.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f58cb9640 1 --2- 172.21.15.26:0/2700619774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f44003a60 0x7f8f540b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f594ba640 1 --2- 172.21.15.26:0/2700619774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f5414ec40 0x7f8f5414f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f53fff640 1 -- 172.21.15.26:0/2700619774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f5414ec40 msgr2=0x7f8f5414f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:16.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f53fff640 1 --2- 172.21.15.26:0/2700619774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f5414ec40 0x7f8f5414f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f53fff640 1 -- 172.21.15.26:0/2700619774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f44003a60 msgr2=0x7f8f540b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:16.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f53fff640 1 --2- 172.21.15.26:0/2700619774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f44003a60 0x7f8f540b03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f53fff640 1 -- 172.21.15.26:0/2700619774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f54150790 con 0x7f8f5414e7a0 2023-10-14T11:15:16.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f53fff640 1 --2- 172.21.15.26:0/2700619774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f5414e7a0 0x7f8f540b0900 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f8f40011960 tx=0x7f8f40011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:16.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f517fa640 1 -- 172.21.15.26:0/2700619774 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4000faf0 con 0x7f8f5414e7a0 2023-10-14T11:15:16.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f517fa640 1 -- 172.21.15.26:0/2700619774 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4000fc50 con 0x7f8f5414e7a0 2023-10-14T11:15:16.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f517fa640 1 -- 172.21.15.26:0/2700619774 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40014440 con 0x7f8f5414e7a0 2023-10-14T11:15:16.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f59cbb640 1 -- 172.21.15.26:0/2700619774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f54150a70 con 0x7f8f5414e7a0 2023-10-14T11:15:16.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.123+0000 7f8f59cbb640 1 -- 172.21.15.26:0/2700619774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f5414fef0 con 0x7f8f5414e7a0 2023-10-14T11:15:16.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.127+0000 7f8f59cbb640 1 -- 172.21.15.26:0/2700619774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f5404e9c0 con 0x7f8f5414e7a0 2023-10-14T11:15:16.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.127+0000 7f8f517fa640 1 -- 172.21.15.26:0/2700619774 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8f400145a0 con 0x7f8f5414e7a0 2023-10-14T11:15:16.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.127+0000 7f8f517fa640 1 --2- 172.21.15.26:0/2700619774 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8f380664d0 0x7f8f38068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.127+0000 7f8f517fa640 1 -- 172.21.15.26:0/2700619774 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f8f40084790 con 0x7f8f5414e7a0 2023-10-14T11:15:16.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.127+0000 7f8f58cb9640 1 --2- 172.21.15.26:0/2700619774 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8f380664d0 0x7f8f38068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.127+0000 7f8f58cb9640 1 --2- 172.21.15.26:0/2700619774 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8f380664d0 0x7f8f38068990 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8f480aa000 tx=0x7f8f480b0040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:16.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.131+0000 7f8f517fa640 1 -- 172.21.15.26:0/2700619774 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8f40051ac0 con 0x7f8f5414e7a0 2023-10-14T11:15:16.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.295+0000 7f8f59cbb640 1 -- 172.21.15.26:0/2700619774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f540d36b0 con 0x7f8f5414e7a0 2023-10-14T11:15:16.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.295+0000 7f8f517fa640 1 -- 172.21.15.26:0/2700619774 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16790 (secure 0 0 0) 0x7f8f400550e0 con 0x7f8f5414e7a0 2023-10-14T11:15:16.302 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:15:16.303 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":55,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:14:51.591742+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:14:47.752880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:14:48.971211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:15:16.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.299+0000 7f8f59cbb640 1 -- 172.21.15.26:0/2700619774 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8f380664d0 msgr2=0x7f8f38068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:16.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.299+0000 7f8f59cbb640 1 --2- 172.21.15.26:0/2700619774 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8f380664d0 0x7f8f38068990 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8f480aa000 tx=0x7f8f480b0040 comp rx=0 tx=0).stop 2023-10-14T11:15:16.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.299+0000 7f8f59cbb640 1 -- 172.21.15.26:0/2700619774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f5414e7a0 msgr2=0x7f8f540b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:16.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.299+0000 7f8f59cbb640 1 --2- 172.21.15.26:0/2700619774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f5414e7a0 0x7f8f540b0900 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f8f40011960 tx=0x7f8f40011e20 comp rx=0 tx=0).stop 2023-10-14T11:15:16.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.299+0000 7f8f59cbb640 1 -- 172.21.15.26:0/2700619774 shutdown_connections 2023-10-14T11:15:16.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.299+0000 7f8f59cbb640 1 --2- 172.21.15.26:0/2700619774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f5414ec40 0x7f8f5414f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.299+0000 7f8f59cbb640 1 --2- 172.21.15.26:0/2700619774 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f8f380664d0 0x7f8f38068990 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.299+0000 7f8f59cbb640 1 --2- 172.21.15.26:0/2700619774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f5414e7a0 0x7f8f540b0900 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.299+0000 7f8f59cbb640 1 --2- 172.21.15.26:0/2700619774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f44003a60 0x7f8f540b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.299+0000 7f8f59cbb640 1 -- 172.21.15.26:0/2700619774 >> 172.21.15.26:0/2700619774 conn(0x7f8f5409ba80 msgr2=0x7f8f5406be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:16.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.299+0000 7f8f59cbb640 1 -- 172.21.15.26:0/2700619774 shutdown_connections 2023-10-14T11:15:16.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.299+0000 7f8f59cbb640 1 -- 172.21.15.26:0/2700619774 wait complete. 2023-10-14T11:15:16.324 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail testcephfs1 2023-10-14T11:15:16.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc814b3e640 1 Processor -- start 2023-10-14T11:15:16.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc814b3e640 1 -- start start 2023-10-14T11:15:16.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc814b3e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc810070c40 0x7fc81015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc814b3e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81015be60 con 0x7fc8100b07f0 2023-10-14T11:15:16.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc814b3e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81015c1f0 con 0x7fc8100b4020 2023-10-14T11:15:16.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc814b3e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81015b3b0 con 0x7fc810070c40 2023-10-14T11:15:16.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc80ed9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc8100b07f0 0x7fc810164490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45712/0 (socket says 172.21.15.26:45712) 2023-10-14T11:15:16.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc80ed9d640 1 -- 172.21.15.26:0/33113958 learned_addr learned my addr 172.21.15.26:0/33113958 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:16.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc80e59c640 1 --2- 172.21.15.26:0/33113958 >> v2:172.21.15.110:3300/0 conn(0x7fc810070c40 0x7fc81015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc80dd9b640 1 -- 172.21.15.26:0/33113958 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304849754 0 0) 0x7fc81015be60 con 0x7fc8100b07f0 2023-10-14T11:15:16.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc80dd9b640 1 -- 172.21.15.26:0/33113958 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7fc003530 con 0x7fc8100b07f0 2023-10-14T11:15:16.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc80dd9b640 1 -- 172.21.15.26:0/33113958 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2035480281 0 0) 0x7fc7fc003530 con 0x7fc8100b07f0 2023-10-14T11:15:16.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc80dd9b640 1 -- 172.21.15.26:0/33113958 >> v2:172.21.15.110:3300/0 conn(0x7fc810070c40 msgr2=0x7fc81015ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:16.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc80dd9b640 1 --2- 172.21.15.26:0/33113958 >> v2:172.21.15.110:3300/0 conn(0x7fc810070c40 0x7fc81015ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc80dd9b640 1 -- 172.21.15.26:0/33113958 >> v1:172.21.15.110:6789/0 conn(0x7fc8100b4020 legacy=0x7fc8100b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:16.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc80dd9b640 1 -- 172.21.15.26:0/33113958 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc810071020 con 0x7fc8100b07f0 2023-10-14T11:15:16.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc80dd9b640 1 -- 172.21.15.26:0/33113958 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7fc808001a00 con 0x7fc8100b07f0 2023-10-14T11:15:16.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc80dd9b640 1 -- 172.21.15.26:0/33113958 >> v1:172.21.15.26:6789/0 conn(0x7fc8100b07f0 legacy=0x7fc810164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:16.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc80dd9b640 1 --2- 172.21.15.26:0/33113958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7fc003980 0x7fc7fc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc80dd9b640 1 --2- 172.21.15.26:0/33113958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7fc0047d0 0x7fc7fc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc80dd9b640 1 --2- 172.21.15.26:0/33113958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7fc005190 0x7fc7fc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc80dd9b640 1 -- 172.21.15.26:0/33113958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81015b3b0 con 0x7fc7fc0047d0 2023-10-14T11:15:16.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc80dd9b640 1 -- 172.21.15.26:0/33113958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc00c130 con 0x7fc7fc003980 2023-10-14T11:15:16.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc80dd9b640 1 -- 172.21.15.26:0/33113958 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc00c2f0 con 0x7fc7fc005190 2023-10-14T11:15:16.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc807fff640 1 --2- 172.21.15.26:0/33113958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7fc0047d0 0x7fc7fc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc80ed9d640 1 --2- 172.21.15.26:0/33113958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7fc005190 0x7fc7fc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc80e59c640 1 --2- 172.21.15.26:0/33113958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7fc003980 0x7fc7fc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc807fff640 1 -- 172.21.15.26:0/33113958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7fc005190 msgr2=0x7fc7fc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:16.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc807fff640 1 --2- 172.21.15.26:0/33113958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7fc005190 0x7fc7fc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc807fff640 1 -- 172.21.15.26:0/33113958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7fc003980 msgr2=0x7fc7fc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:16.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc807fff640 1 --2- 172.21.15.26:0/33113958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7fc003980 0x7fc7fc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.463+0000 7fc807fff640 1 -- 172.21.15.26:0/33113958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7fc003530 con 0x7fc7fc0047d0 2023-10-14T11:15:16.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.467+0000 7fc80e59c640 1 --2- 172.21.15.26:0/33113958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7fc003980 0x7fc7fc003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:16.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.467+0000 7fc80ed9d640 1 -- 172.21.15.26:0/33113958 reap_dead start 2023-10-14T11:15:16.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.467+0000 7fc807fff640 1 --2- 172.21.15.26:0/33113958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7fc0047d0 0x7fc7fc004c50 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8001780 tx=0x7fc7f801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519b24bb7aa5eb01 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:16.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.467+0000 7fc80dd9b640 1 -- 172.21.15.26:0/33113958 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f80052d0 con 0x7fc7fc0047d0 2023-10-14T11:15:16.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.467+0000 7fc80dd9b640 1 -- 172.21.15.26:0/33113958 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f80a7050 con 0x7fc7fc0047d0 2023-10-14T11:15:16.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.467+0000 7fc80dd9b640 1 -- 172.21.15.26:0/33113958 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8003600 con 0x7fc7fc0047d0 2023-10-14T11:15:16.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.467+0000 7fc814b3e640 1 -- 172.21.15.26:0/33113958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7fc0047d0 msgr2=0x7fc7fc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:16.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.467+0000 7fc814b3e640 1 --2- 172.21.15.26:0/33113958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7fc0047d0 0x7fc7fc004c50 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8001780 tx=0x7fc7f801c400 comp rx=0 tx=0).stop 2023-10-14T11:15:16.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.467+0000 7fc814b3e640 1 -- 172.21.15.26:0/33113958 shutdown_connections 2023-10-14T11:15:16.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.467+0000 7fc814b3e640 1 --2- 172.21.15.26:0/33113958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7fc0047d0 0x7fc7fc004c50 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.467+0000 7fc814b3e640 1 -- 172.21.15.26:0/33113958 >> 172.21.15.26:0/33113958 conn(0x7fc81006c190 msgr2=0x7fc81006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:16.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.467+0000 7fc814b3e640 1 -- 172.21.15.26:0/33113958 shutdown_connections 2023-10-14T11:15:16.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.467+0000 7fc814b3e640 1 -- 172.21.15.26:0/33113958 wait complete. 2023-10-14T11:15:16.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc814b3e640 1 Processor -- start 2023-10-14T11:15:16.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc814b3e640 1 -- start start 2023-10-14T11:15:16.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc814b3e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7fc0047d0 0x7fc810152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc814b3e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8100ca810 0x7fc8100c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc814b3e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8100c8230 0x7fc810157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc814b3e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc810157770 con 0x7fc8100ca810 2023-10-14T11:15:16.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc814b3e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8100c86b0 con 0x7fc8100c8230 2023-10-14T11:15:16.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc814b3e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8100cb5b0 con 0x7fc7fc0047d0 2023-10-14T11:15:16.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc807fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8100ca810 0x7fc8100c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc807fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8100ca810 0x7fc8100c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34262/0 (socket says 172.21.15.26:34262) 2023-10-14T11:15:16.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc807fff640 1 -- 172.21.15.26:0/1560875246 learned_addr learned my addr 172.21.15.26:0/1560875246 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:16.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc80e59c640 1 --2- 172.21.15.26:0/1560875246 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7fc0047d0 0x7fc810152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc80ed9d640 1 --2- 172.21.15.26:0/1560875246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8100c8230 0x7fc810157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc807fff640 1 -- 172.21.15.26:0/1560875246 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7fc0047d0 msgr2=0x7fc810152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:16.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc807fff640 1 --2- 172.21.15.26:0/1560875246 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7fc0047d0 0x7fc810152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc807fff640 1 -- 172.21.15.26:0/1560875246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8100c8230 msgr2=0x7fc810157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:16.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc807fff640 1 --2- 172.21.15.26:0/1560875246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8100c8230 0x7fc810157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc807fff640 1 -- 172.21.15.26:0/1560875246 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc810152c90 con 0x7fc8100ca810 2023-10-14T11:15:16.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc807fff640 1 --2- 172.21.15.26:0/1560875246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8100ca810 0x7fc8100c7cf0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc7f801c230 tx=0x7fc7fc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:16.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc806ffd640 1 -- 172.21.15.26:0/1560875246 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f80072f0 con 0x7fc8100ca810 2023-10-14T11:15:16.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc806ffd640 1 -- 172.21.15.26:0/1560875246 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f80a4e90 con 0x7fc8100ca810 2023-10-14T11:15:16.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc806ffd640 1 -- 172.21.15.26:0/1560875246 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8007690 con 0x7fc8100ca810 2023-10-14T11:15:16.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.471+0000 7fc814b3e640 1 -- 172.21.15.26:0/1560875246 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8100cad10 con 0x7fc8100ca810 2023-10-14T11:15:16.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.475+0000 7fc814b3e640 1 -- 172.21.15.26:0/1560875246 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8100cb2d0 con 0x7fc8100ca810 2023-10-14T11:15:16.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.475+0000 7fc814b3e640 1 -- 172.21.15.26:0/1560875246 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8101578b0 con 0x7fc8100ca810 2023-10-14T11:15:16.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.475+0000 7fc806ffd640 1 -- 172.21.15.26:0/1560875246 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc7f80067e0 con 0x7fc8100ca810 2023-10-14T11:15:16.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.475+0000 7fc806ffd640 1 --2- 172.21.15.26:0/1560875246 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc7f00664d0 0x7fc7f0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.475+0000 7fc806ffd640 1 -- 172.21.15.26:0/1560875246 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fc7f811dd70 con 0x7fc8100ca810 2023-10-14T11:15:16.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.475+0000 7fc80e59c640 1 --2- 172.21.15.26:0/1560875246 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc7f00664d0 0x7fc7f0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.479+0000 7fc80e59c640 1 --2- 172.21.15.26:0/1560875246 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc7f00664d0 0x7fc7f0068990 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc810068cd0 tx=0x7fc800008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:16.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.479+0000 7fc806ffd640 1 -- 172.21.15.26:0/1560875246 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc8101578b0 con 0x7fc8100ca810 2023-10-14T11:15:16.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.671+0000 7fc814b3e640 1 -- 172.21.15.26:0/1560875246 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "testcephfs1"} v 0) v1 -- 0x7fc8101578b0 con 0x7fc8100ca810 2023-10-14T11:15:16.678 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-14T11:15:16.671+0000 7f7c7d495640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T11:15:16.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.675+0000 7fc806ffd640 1 -- 172.21.15.26:0/1560875246 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "testcephfs1"}]=0 testcephfs1 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 171+0+0 (secure 0 0 0) 0x7fc8101578b0 con 0x7fc8100ca810 2023-10-14T11:15:16.680 INFO:teuthology.orchestra.run.smithi026.stderr:testcephfs1 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T11:15:16.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.675+0000 7fc814b3e640 1 -- 172.21.15.26:0/1560875246 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc7f00664d0 msgr2=0x7fc7f0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:16.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.675+0000 7fc814b3e640 1 --2- 172.21.15.26:0/1560875246 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc7f00664d0 0x7fc7f0068990 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc810068cd0 tx=0x7fc800008040 comp rx=0 tx=0).stop 2023-10-14T11:15:16.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.675+0000 7fc814b3e640 1 -- 172.21.15.26:0/1560875246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8100ca810 msgr2=0x7fc8100c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:16.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.675+0000 7fc814b3e640 1 --2- 172.21.15.26:0/1560875246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8100ca810 0x7fc8100c7cf0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc7f801c230 tx=0x7fc7fc005800 comp rx=0 tx=0).stop 2023-10-14T11:15:16.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.675+0000 7fc814b3e640 1 -- 172.21.15.26:0/1560875246 shutdown_connections 2023-10-14T11:15:16.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.675+0000 7fc814b3e640 1 --2- 172.21.15.26:0/1560875246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8100c8230 0x7fc810157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.675+0000 7fc814b3e640 1 --2- 172.21.15.26:0/1560875246 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fc7f00664d0 0x7fc7f0068990 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.675+0000 7fc814b3e640 1 --2- 172.21.15.26:0/1560875246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8100ca810 0x7fc8100c7cf0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.675+0000 7fc814b3e640 1 --2- 172.21.15.26:0/1560875246 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7fc0047d0 0x7fc810152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.675+0000 7fc814b3e640 1 -- 172.21.15.26:0/1560875246 >> 172.21.15.26:0/1560875246 conn(0x7fc81006c190 msgr2=0x7fc8100c3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:16.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.675+0000 7fc814b3e640 1 -- 172.21.15.26:0/1560875246 shutdown_connections 2023-10-14T11:15:16.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.675+0000 7fc814b3e640 1 -- 172.21.15.26:0/1560875246 wait complete. 2023-10-14T11:15:16.689 INFO:tasks.ceph.mds.c.smithi026.stderr: -2471> 2023-10-14T11:14:55.551+0000 7f49f8c57640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T11:15:16.704 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm testcephfs1 --yes-i-really-mean-it 2023-10-14T11:15:16.738 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-10-14T11:15:16.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.847+0000 7f2d1ac59640 1 Processor -- start 2023-10-14T11:15:16.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.847+0000 7f2d1ac59640 1 -- start start 2023-10-14T11:15:16.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.847+0000 7f2d1ac59640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d140cf210 0x7f2d140cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.847+0000 7f2d1ac59640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2d1415cdc0 0x7f2d140b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.847+0000 7f2d1ac59640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d140cfb30 con 0x7f2d140d3320 2023-10-14T11:15:16.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.847+0000 7f2d1ac59640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d140d0880 con 0x7f2d1415cdc0 2023-10-14T11:15:16.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.847+0000 7f2d1ac59640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d140b1c00 con 0x7f2d140cf210 2023-10-14T11:15:16.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.847+0000 7f2d19c57640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d140cf210 0x7f2d140cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.851+0000 7f2d19456640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2d1415cdc0 0x7f2d140b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.851+0000 7f2d19c57640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d140cf210 0x7f2d140cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:59424/0 (socket says 172.21.15.26:59424) 2023-10-14T11:15:16.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.851+0000 7f2d19c57640 1 -- 172.21.15.26:0/1547989094 learned_addr learned my addr 172.21.15.26:0/1547989094 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:16.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.851+0000 7f2d19456640 1 -- 172.21.15.26:0/1547989094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d140cf210 msgr2=0x7f2d140cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:16.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.851+0000 7f2d19456640 1 --2- 172.21.15.26:0/1547989094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d140cf210 0x7f2d140cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.851+0000 7f2d18c55640 1 -- 172.21.15.26:0/1547989094 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 170372682 0 0) 0x7f2d140cfb30 con 0x7f2d140d3320 2023-10-14T11:15:16.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.851+0000 7f2d19456640 1 -- 172.21.15.26:0/1547989094 >> v1:172.21.15.110:6789/0 conn(0x7f2d140d3320 legacy=0x7f2d140b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:16.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.851+0000 7f2d19456640 1 -- 172.21.15.26:0/1547989094 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d140b1ee0 con 0x7f2d1415cdc0 2023-10-14T11:15:16.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.855+0000 7f2d19456640 1 --2- 172.21.15.26:0/1547989094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d1415cdc0 0x7f2d140b2ca0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2d040097c0 tx=0x7f2d140b4100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89c2862f5ce77115 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:16.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.855+0000 7f2d18c55640 1 -- 172.21.15.26:0/1547989094 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d040ab650 con 0x7f2d1415cdc0 2023-10-14T11:15:16.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.855+0000 7f2d18c55640 1 -- 172.21.15.26:0/1547989094 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d040ab7b0 con 0x7f2d1415cdc0 2023-10-14T11:15:16.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.855+0000 7f2d18c55640 1 -- 172.21.15.26:0/1547989094 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d040abb40 con 0x7f2d1415cdc0 2023-10-14T11:15:16.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.855+0000 7f2d1ac59640 1 -- 172.21.15.26:0/1547989094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d1415cdc0 msgr2=0x7f2d140b2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:16.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.855+0000 7f2d1ac59640 1 --2- 172.21.15.26:0/1547989094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d1415cdc0 0x7f2d140b2ca0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2d040097c0 tx=0x7f2d140b4100 comp rx=0 tx=0).stop 2023-10-14T11:15:16.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.855+0000 7f2d1ac59640 1 -- 172.21.15.26:0/1547989094 shutdown_connections 2023-10-14T11:15:16.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.855+0000 7f2d1ac59640 1 --2- 172.21.15.26:0/1547989094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d1415cdc0 0x7f2d140b2ca0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.855+0000 7f2d1ac59640 1 --2- 172.21.15.26:0/1547989094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d140cf210 0x7f2d140cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.855+0000 7f2d1ac59640 1 -- 172.21.15.26:0/1547989094 >> 172.21.15.26:0/1547989094 conn(0x7f2d140d2800 msgr2=0x7f2d140d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:16.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.855+0000 7f2d1ac59640 1 -- 172.21.15.26:0/1547989094 shutdown_connections 2023-10-14T11:15:16.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.855+0000 7f2d1ac59640 1 -- 172.21.15.26:0/1547989094 wait complete. 2023-10-14T11:15:16.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.855+0000 7f2d1ac59640 1 Processor -- start 2023-10-14T11:15:16.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.855+0000 7f2d1ac59640 1 -- start start 2023-10-14T11:15:16.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d1ac59640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d140cf210 0x7f2d1415ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d1ac59640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d140d3320 0x7f2d14154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d1ac59640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d1415cdc0 0x7f2d141567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d1ac59640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d140c93c0 con 0x7f2d140d3320 2023-10-14T11:15:16.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d1ac59640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d141586c0 con 0x7f2d140cf210 2023-10-14T11:15:16.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d1ac59640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d140c8e00 con 0x7f2d1415cdc0 2023-10-14T11:15:16.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d19456640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d140d3320 0x7f2d14154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d19456640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d140d3320 0x7f2d14154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34300/0 (socket says 172.21.15.26:34300) 2023-10-14T11:15:16.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d19456640 1 -- 172.21.15.26:0/3848693876 learned_addr learned my addr 172.21.15.26:0/3848693876 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:16.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d19c57640 1 --2- 172.21.15.26:0/3848693876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d140cf210 0x7f2d1415ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d1a458640 1 --2- 172.21.15.26:0/3848693876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d1415cdc0 0x7f2d141567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d19456640 1 -- 172.21.15.26:0/3848693876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d1415cdc0 msgr2=0x7f2d141567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:16.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d19456640 1 --2- 172.21.15.26:0/3848693876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d1415cdc0 0x7f2d141567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d19456640 1 -- 172.21.15.26:0/3848693876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d140cf210 msgr2=0x7f2d1415ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:16.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d19456640 1 --2- 172.21.15.26:0/3848693876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d140cf210 0x7f2d1415ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:16.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d19456640 1 -- 172.21.15.26:0/3848693876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d04009420 con 0x7f2d140d3320 2023-10-14T11:15:16.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d1a458640 1 --2- 172.21.15.26:0/3848693876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d1415cdc0 0x7f2d141567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:15:16.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d19456640 1 --2- 172.21.15.26:0/3848693876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d140d3320 0x7f2d14154d20 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2d040ad040 tx=0x7f2d0401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:16.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d0a7fc640 1 -- 172.21.15.26:0/3848693876 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d040bf610 con 0x7f2d140d3320 2023-10-14T11:15:16.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d0a7fc640 1 -- 172.21.15.26:0/3848693876 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d040bf770 con 0x7f2d140d3320 2023-10-14T11:15:16.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d0a7fc640 1 -- 172.21.15.26:0/3848693876 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d040bfb20 con 0x7f2d140d3320 2023-10-14T11:15:16.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d1ac59640 1 -- 172.21.15.26:0/3848693876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d140c90e0 con 0x7f2d140d3320 2023-10-14T11:15:16.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d1ac59640 1 -- 172.21.15.26:0/3848693876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1415f340 con 0x7f2d140d3320 2023-10-14T11:15:16.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d1ac59640 1 -- 172.21.15.26:0/3848693876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d141581b0 con 0x7f2d140d3320 2023-10-14T11:15:16.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.859+0000 7f2d0a7fc640 1 -- 172.21.15.26:0/3848693876 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2d040b5400 con 0x7f2d140d3320 2023-10-14T11:15:16.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.863+0000 7f2d0a7fc640 1 --2- 172.21.15.26:0/3848693876 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2cf80664a0 0x7f2cf8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:16.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.863+0000 7f2d0a7fc640 1 -- 172.21.15.26:0/3848693876 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6135+0+0 (secure 0 0 0) 0x7f2d0411edb0 con 0x7f2d140d3320 2023-10-14T11:15:16.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.863+0000 7f2d19c57640 1 --2- 172.21.15.26:0/3848693876 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2cf80664a0 0x7f2cf8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:16.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.863+0000 7f2d19c57640 1 --2- 172.21.15.26:0/3848693876 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2cf80664a0 0x7f2cf8068960 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2d10006fd0 tx=0x7f2d10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:16.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:16.867+0000 7f2d0a7fc640 1 -- 172.21.15.26:0/3848693876 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2d141581b0 con 0x7f2d140d3320 2023-10-14T11:15:17.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.063+0000 7f2d1ac59640 1 -- 172.21.15.26:0/3848693876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "testcephfs1", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2d141581b0 con 0x7f2d140d3320 2023-10-14T11:15:17.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.675+0000 7f2d0a7fc640 1 -- 172.21.15.26:0/3848693876 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "testcephfs1", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 109+0+0 (secure 0 0 0) 0x7f2d141581b0 con 0x7f2d140d3320 2023-10-14T11:15:17.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.679+0000 7f2d1ac59640 1 -- 172.21.15.26:0/3848693876 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2cf80664a0 msgr2=0x7f2cf8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:17.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.679+0000 7f2d1ac59640 1 --2- 172.21.15.26:0/3848693876 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2cf80664a0 0x7f2cf8068960 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2d10006fd0 tx=0x7f2d10008040 comp rx=0 tx=0).stop 2023-10-14T11:15:17.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.679+0000 7f2d1ac59640 1 -- 172.21.15.26:0/3848693876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d140d3320 msgr2=0x7f2d14154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:17.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.679+0000 7f2d1ac59640 1 --2- 172.21.15.26:0/3848693876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d140d3320 0x7f2d14154d20 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2d040ad040 tx=0x7f2d0401ac90 comp rx=0 tx=0).stop 2023-10-14T11:15:17.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.679+0000 7f2d1ac59640 1 -- 172.21.15.26:0/3848693876 shutdown_connections 2023-10-14T11:15:17.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.679+0000 7f2d1ac59640 1 --2- 172.21.15.26:0/3848693876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d1415cdc0 0x7f2d141567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:17.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.679+0000 7f2d1ac59640 1 --2- 172.21.15.26:0/3848693876 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2cf80664a0 0x7f2cf8068960 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:17.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.679+0000 7f2d1ac59640 1 --2- 172.21.15.26:0/3848693876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d140d3320 0x7f2d14154d20 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:17.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.679+0000 7f2d1ac59640 1 --2- 172.21.15.26:0/3848693876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d140cf210 0x7f2d1415ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:17.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.679+0000 7f2d1ac59640 1 -- 172.21.15.26:0/3848693876 >> 172.21.15.26:0/3848693876 conn(0x7f2d140d2800 msgr2=0x7f2d1406c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:17.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.679+0000 7f2d1ac59640 1 -- 172.21.15.26:0/3848693876 shutdown_connections 2023-10-14T11:15:17.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.679+0000 7f2d1ac59640 1 -- 172.21.15.26:0/3848693876 wait complete. 2023-10-14T11:15:17.711 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm testcephfs1_metadata testcephfs1_metadata --yes-i-really-really-mean-it 2023-10-14T11:15:17.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.899+0000 7f6d58f8d640 1 Processor -- start 2023-10-14T11:15:17.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.899+0000 7f6d58f8d640 1 -- start start 2023-10-14T11:15:17.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.903+0000 7f6d58f8d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6d5415a560 0x7f6d5415db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:17.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.903+0000 7f6d58f8d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d540c78d0 0x7f6d540c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:17.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.903+0000 7f6d58f8d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d540cde20 con 0x7f6d540cc190 2023-10-14T11:15:17.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.903+0000 7f6d58f8d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d540c82c0 con 0x7f6d5415a560 2023-10-14T11:15:17.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.903+0000 7f6d58f8d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5415e050 con 0x7f6d540c78d0 2023-10-14T11:15:17.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.903+0000 7f6d5259c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6d5415a560 0x7f6d5415db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:17.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.903+0000 7f6d4bfff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f6d540cc190 0x7f6d540cd710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:33806/0 (socket says 172.21.15.26:33806) 2023-10-14T11:15:17.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.903+0000 7f6d4bfff640 1 -- 172.21.15.26:0/2293396885 learned_addr learned my addr 172.21.15.26:0/2293396885 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:17.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.903+0000 7f6d52d9d640 1 --2- 172.21.15.26:0/2293396885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d540c78d0 0x7f6d540c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:17.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.903+0000 7f6d51d9b640 1 -- 172.21.15.26:0/2293396885 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827972248 0 0) 0x7f6d540cde20 con 0x7f6d540cc190 2023-10-14T11:15:17.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.903+0000 7f6d51d9b640 1 -- 172.21.15.26:0/2293396885 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d40003530 con 0x7f6d540cc190 2023-10-14T11:15:17.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.903+0000 7f6d52d9d640 1 -- 172.21.15.26:0/2293396885 >> v2:172.21.15.110:3300/0 conn(0x7f6d5415a560 msgr2=0x7f6d5415db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:17.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.903+0000 7f6d52d9d640 1 --2- 172.21.15.26:0/2293396885 >> v2:172.21.15.110:3300/0 conn(0x7f6d5415a560 0x7f6d5415db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:17.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.903+0000 7f6d52d9d640 1 -- 172.21.15.26:0/2293396885 >> v1:172.21.15.110:6789/0 conn(0x7f6d540cc190 legacy=0x7f6d540cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:17.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.903+0000 7f6d52d9d640 1 -- 172.21.15.26:0/2293396885 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d540cc670 con 0x7f6d540c78d0 2023-10-14T11:15:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.907+0000 7f6d52d9d640 1 --2- 172.21.15.26:0/2293396885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d540c78d0 0x7f6d540c7d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009d90 tx=0x7f6d4c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7368e61e0a41773 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.907+0000 7f6d51d9b640 1 -- 172.21.15.26:0/2293396885 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c0a6620 con 0x7f6d540c78d0 2023-10-14T11:15:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.907+0000 7f6d51d9b640 1 -- 172.21.15.26:0/2293396885 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4c0a6780 con 0x7f6d540c78d0 2023-10-14T11:15:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.907+0000 7f6d51d9b640 1 -- 172.21.15.26:0/2293396885 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c0a6b10 con 0x7f6d540c78d0 2023-10-14T11:15:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.907+0000 7f6d58f8d640 1 -- 172.21.15.26:0/2293396885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d540c78d0 msgr2=0x7f6d540c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:17.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.907+0000 7f6d58f8d640 1 --2- 172.21.15.26:0/2293396885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d540c78d0 0x7f6d540c7d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009d90 tx=0x7f6d4c01c920 comp rx=0 tx=0).stop 2023-10-14T11:15:17.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.907+0000 7f6d58f8d640 1 -- 172.21.15.26:0/2293396885 shutdown_connections 2023-10-14T11:15:17.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.907+0000 7f6d58f8d640 1 --2- 172.21.15.26:0/2293396885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d540c78d0 0x7f6d540c7d80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:17.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.907+0000 7f6d58f8d640 1 --2- 172.21.15.26:0/2293396885 >> v2:172.21.15.110:3300/0 conn(0x7f6d5415a560 0x7f6d5415db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:17.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.907+0000 7f6d58f8d640 1 -- 172.21.15.26:0/2293396885 >> 172.21.15.26:0/2293396885 conn(0x7f6d5406a820 msgr2=0x7f6d540b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:17.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.907+0000 7f6d58f8d640 1 -- 172.21.15.26:0/2293396885 shutdown_connections 2023-10-14T11:15:17.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.907+0000 7f6d58f8d640 1 -- 172.21.15.26:0/2293396885 wait complete. 2023-10-14T11:15:17.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d58f8d640 1 Processor -- start 2023-10-14T11:15:17.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d58f8d640 1 -- start start 2023-10-14T11:15:17.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d58f8d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d540c78d0 0x7f6d54159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:17.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d58f8d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d540cc190 0x7f6d541f84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:17.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d58f8d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d5415a560 0x7f6d541f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:17.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d58f8d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d540b1c20 con 0x7f6d540c78d0 2023-10-14T11:15:17.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d58f8d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d541427f0 con 0x7f6d540cc190 2023-10-14T11:15:17.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d58f8d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d540b12f0 con 0x7f6d5415a560 2023-10-14T11:15:17.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d5259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d540c78d0 0x7f6d54159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:17.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d5259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d540c78d0 0x7f6d54159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34304/0 (socket says 172.21.15.26:34304) 2023-10-14T11:15:17.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d5259c640 1 -- 172.21.15.26:0/4128050506 learned_addr learned my addr 172.21.15.26:0/4128050506 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:17.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d4bfff640 1 --2- 172.21.15.26:0/4128050506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d540cc190 0x7f6d541f84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:17.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d52d9d640 1 --2- 172.21.15.26:0/4128050506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d5415a560 0x7f6d541f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:17.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d5259c640 1 -- 172.21.15.26:0/4128050506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d5415a560 msgr2=0x7f6d541f8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:17.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d5259c640 1 --2- 172.21.15.26:0/4128050506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d5415a560 0x7f6d541f8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:17.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d5259c640 1 -- 172.21.15.26:0/4128050506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d540cc190 msgr2=0x7f6d541f84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:17.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d5259c640 1 --2- 172.21.15.26:0/4128050506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d540cc190 0x7f6d541f84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:17.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d5259c640 1 -- 172.21.15.26:0/4128050506 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c009a70 con 0x7f6d540c78d0 2023-10-14T11:15:17.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d5259c640 1 --2- 172.21.15.26:0/4128050506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d540c78d0 0x7f6d54159280 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400e930 tx=0x7f6d4400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:17.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d4affd640 1 -- 172.21.15.26:0/4128050506 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d44009690 con 0x7f6d540c78d0 2023-10-14T11:15:17.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d4affd640 1 -- 172.21.15.26:0/4128050506 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4400ca00 con 0x7f6d540c78d0 2023-10-14T11:15:17.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d4affd640 1 -- 172.21.15.26:0/4128050506 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4400cd70 con 0x7f6d540c78d0 2023-10-14T11:15:17.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d58f8d640 1 -- 172.21.15.26:0/4128050506 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d540b15d0 con 0x7f6d540c78d0 2023-10-14T11:15:17.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d58f8d640 1 -- 172.21.15.26:0/4128050506 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d541597c0 con 0x7f6d540c78d0 2023-10-14T11:15:17.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.911+0000 7f6d58f8d640 1 -- 172.21.15.26:0/4128050506 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5415fc40 con 0x7f6d540c78d0 2023-10-14T11:15:17.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.915+0000 7f6d4affd640 1 -- 172.21.15.26:0/4128050506 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6d44013470 con 0x7f6d540c78d0 2023-10-14T11:15:17.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.915+0000 7f6d4affd640 1 --2- 172.21.15.26:0/4128050506 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6d340664a0 0x7f6d34068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:17.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.915+0000 7f6d4affd640 1 -- 172.21.15.26:0/4128050506 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6135+0+0 (secure 0 0 0) 0x7f6d440842a0 con 0x7f6d540c78d0 2023-10-14T11:15:17.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.915+0000 7f6d4bfff640 1 --2- 172.21.15.26:0/4128050506 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6d340664a0 0x7f6d34068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:17.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.915+0000 7f6d4bfff640 1 --2- 172.21.15.26:0/4128050506 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6d340664a0 0x7f6d34068960 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6d541f8440 tx=0x7f6d3c007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:17.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:17.919+0000 7f6d4affd640 1 -- 172.21.15.26:0/4128050506 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6d44051640 con 0x7f6d540c78d0 2023-10-14T11:15:18.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:18.079+0000 7f6d58f8d640 1 -- 172.21.15.26:0/4128050506 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "testcephfs1_metadata", "pool2": "testcephfs1_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6d5404e170 con 0x7f6d540c78d0 2023-10-14T11:15:18.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:18.951+0000 7f6d4affd640 1 -- 172.21.15.26:0/4128050506 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "testcephfs1_metadata", "pool2": "testcephfs1_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'testcephfs1_metadata' removed v57) v1 ==== 196+0+0 (secure 0 0 0) 0x7f6d44054c60 con 0x7f6d540c78d0 2023-10-14T11:15:18.958 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'testcephfs1_metadata' removed 2023-10-14T11:15:18.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:18.955+0000 7f6d58f8d640 1 -- 172.21.15.26:0/4128050506 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6d340664a0 msgr2=0x7f6d34068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:18.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:18.955+0000 7f6d58f8d640 1 --2- 172.21.15.26:0/4128050506 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6d340664a0 0x7f6d34068960 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6d541f8440 tx=0x7f6d3c007d40 comp rx=0 tx=0).stop 2023-10-14T11:15:18.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:18.955+0000 7f6d58f8d640 1 -- 172.21.15.26:0/4128050506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d540c78d0 msgr2=0x7f6d54159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:18.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:18.955+0000 7f6d58f8d640 1 --2- 172.21.15.26:0/4128050506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d540c78d0 0x7f6d54159280 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400e930 tx=0x7f6d4400edf0 comp rx=0 tx=0).stop 2023-10-14T11:15:18.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:18.955+0000 7f6d58f8d640 1 -- 172.21.15.26:0/4128050506 shutdown_connections 2023-10-14T11:15:18.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:18.955+0000 7f6d58f8d640 1 --2- 172.21.15.26:0/4128050506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d5415a560 0x7f6d541f8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:18.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:18.955+0000 7f6d58f8d640 1 --2- 172.21.15.26:0/4128050506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d540cc190 0x7f6d541f84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:18.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:18.955+0000 7f6d58f8d640 1 --2- 172.21.15.26:0/4128050506 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f6d340664a0 0x7f6d34068960 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:18.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:18.955+0000 7f6d58f8d640 1 --2- 172.21.15.26:0/4128050506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d540c78d0 0x7f6d54159280 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:18.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:18.955+0000 7f6d58f8d640 1 -- 172.21.15.26:0/4128050506 >> 172.21.15.26:0/4128050506 conn(0x7f6d5406a820 msgr2=0x7f6d540ca700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:18.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:18.955+0000 7f6d58f8d640 1 -- 172.21.15.26:0/4128050506 shutdown_connections 2023-10-14T11:15:18.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:18.955+0000 7f6d58f8d640 1 -- 172.21.15.26:0/4128050506 wait complete. 2023-10-14T11:15:18.987 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm testcephfs1_data testcephfs1_data --yes-i-really-really-mean-it 2023-10-14T11:15:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.131+0000 7f8734291640 1 Processor -- start 2023-10-14T11:15:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.131+0000 7f8734291640 1 -- start start 2023-10-14T11:15:19.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.135+0000 7f8734291640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f872c0cfd20 0x7f872c0d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:19.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.135+0000 7f8734291640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872c0ce460 con 0x7f872c0cdc80 2023-10-14T11:15:19.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.135+0000 7f8734291640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872c15da30 con 0x7f872c0d2570 2023-10-14T11:15:19.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.135+0000 7f8734291640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872c0cd830 con 0x7f872c0cfd20 2023-10-14T11:15:19.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.135+0000 7f873182c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f872c0cdc80 0x7f872c0cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45728/0 (socket says 172.21.15.26:45728) 2023-10-14T11:15:19.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.135+0000 7f873182c640 1 -- 172.21.15.26:0/2156543515 learned_addr learned my addr 172.21.15.26:0/2156543515 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:19.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.135+0000 7f873282e640 1 --2- 172.21.15.26:0/2156543515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f872c0cfd20 0x7f872c0d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:19.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.135+0000 7f873102b640 1 -- 172.21.15.26:0/2156543515 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233544073 0 0) 0x7f872c0ce460 con 0x7f872c0cdc80 2023-10-14T11:15:19.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.135+0000 7f873102b640 1 -- 172.21.15.26:0/2156543515 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8718003530 con 0x7f872c0cdc80 2023-10-14T11:15:19.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.135+0000 7f873102b640 1 -- 172.21.15.26:0/2156543515 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987930357 0 0) 0x7f872c15da30 con 0x7f872c0d2570 2023-10-14T11:15:19.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.135+0000 7f873102b640 1 -- 172.21.15.26:0/2156543515 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f872c0ce460 con 0x7f872c0d2570 2023-10-14T11:15:19.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.135+0000 7f873282e640 1 -- 172.21.15.26:0/2156543515 >> v1:172.21.15.110:6789/0 conn(0x7f872c0d2570 legacy=0x7f872c161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:19.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.135+0000 7f873102b640 1 -- 172.21.15.26:0/2156543515 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3602189772 0 0) 0x7f8718003530 con 0x7f872c0cdc80 2023-10-14T11:15:19.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.135+0000 7f873282e640 1 -- 172.21.15.26:0/2156543515 >> v1:172.21.15.26:6789/0 conn(0x7f872c0cdc80 legacy=0x7f872c0cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:19.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.135+0000 7f873282e640 1 -- 172.21.15.26:0/2156543515 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c0ce180 con 0x7f872c0cfd20 2023-10-14T11:15:19.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.139+0000 7f873282e640 1 --2- 172.21.15.26:0/2156543515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f872c0cfd20 0x7f872c0d0e60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8724009dc0 tx=0x7f872401c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1a61d5a9b0d3332 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:19.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.139+0000 7f873102b640 1 -- 172.21.15.26:0/2156543515 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c001680 con 0x7f872c0cfd20 2023-10-14T11:15:19.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.139+0000 7f873102b640 1 -- 172.21.15.26:0/2156543515 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87240a55b0 con 0x7f872c0cfd20 2023-10-14T11:15:19.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.139+0000 7f873102b640 1 -- 172.21.15.26:0/2156543515 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87240a5940 con 0x7f872c0cfd20 2023-10-14T11:15:19.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.139+0000 7f8734291640 1 -- 172.21.15.26:0/2156543515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f872c0cfd20 msgr2=0x7f872c0d0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:19.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.139+0000 7f8734291640 1 --2- 172.21.15.26:0/2156543515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f872c0cfd20 0x7f872c0d0e60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8724009dc0 tx=0x7f872401c860 comp rx=0 tx=0).stop 2023-10-14T11:15:19.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.139+0000 7f8734291640 1 -- 172.21.15.26:0/2156543515 shutdown_connections 2023-10-14T11:15:19.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.139+0000 7f8734291640 1 --2- 172.21.15.26:0/2156543515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f872c0cfd20 0x7f872c0d0e60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:19.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.139+0000 7f8734291640 1 -- 172.21.15.26:0/2156543515 >> 172.21.15.26:0/2156543515 conn(0x7f872c0715c0 msgr2=0x7f872c0719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:19.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.139+0000 7f8734291640 1 -- 172.21.15.26:0/2156543515 shutdown_connections 2023-10-14T11:15:19.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.139+0000 7f8734291640 1 -- 172.21.15.26:0/2156543515 wait complete. 2023-10-14T11:15:19.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.139+0000 7f8734291640 1 Processor -- start 2023-10-14T11:15:19.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.139+0000 7f8734291640 1 -- start start 2023-10-14T11:15:19.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f8734291640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f872c0cdc80 0x7f872c151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:19.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f8734291640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f872c0cfd20 0x7f872c1470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:19.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f8734291640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f872c0d2570 0x7f872c149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:19.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f8734291640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c0c7140 con 0x7f872c0cdc80 2023-10-14T11:15:19.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f8734291640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c0c7390 con 0x7f872c0cfd20 2023-10-14T11:15:19.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f8734291640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872c152060 con 0x7f872c0d2570 2023-10-14T11:15:19.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f873202d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f872c0cdc80 0x7f872c151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:19.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f873182c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f872c0cfd20 0x7f872c1470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f873202d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f872c0cdc80 0x7f872c151500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34320/0 (socket says 172.21.15.26:34320) 2023-10-14T11:15:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f873202d640 1 -- 172.21.15.26:0/4178042271 learned_addr learned my addr 172.21.15.26:0/4178042271 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f873282e640 1 --2- 172.21.15.26:0/4178042271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f872c0d2570 0x7f872c149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f873202d640 1 -- 172.21.15.26:0/4178042271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f872c0d2570 msgr2=0x7f872c149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f873202d640 1 --2- 172.21.15.26:0/4178042271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f872c0d2570 0x7f872c149050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f873202d640 1 -- 172.21.15.26:0/4178042271 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f872c0cfd20 msgr2=0x7f872c1470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f873202d640 1 --2- 172.21.15.26:0/4178042271 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f872c0cfd20 0x7f872c1470f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f873202d640 1 -- 172.21.15.26:0/4178042271 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8724009a70 con 0x7f872c0cdc80 2023-10-14T11:15:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f873182c640 1 --2- 172.21.15.26:0/4178042271 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f872c0cfd20 0x7f872c1470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:15:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f873202d640 1 --2- 172.21.15.26:0/4178042271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f872c0cdc80 0x7f872c151500 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f872800c490 tx=0x7f872800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:19.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f8722ffd640 1 -- 172.21.15.26:0/4178042271 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87280052d0 con 0x7f872c0cdc80 2023-10-14T11:15:19.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f8722ffd640 1 -- 172.21.15.26:0/4178042271 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8728005430 con 0x7f872c0cdc80 2023-10-14T11:15:19.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f8734291640 1 -- 172.21.15.26:0/4178042271 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872c151d10 con 0x7f872c0cdc80 2023-10-14T11:15:19.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f8722ffd640 1 -- 172.21.15.26:0/4178042271 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728012870 con 0x7f872c0cdc80 2023-10-14T11:15:19.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f8734291640 1 -- 172.21.15.26:0/4178042271 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872c149590 con 0x7f872c0cdc80 2023-10-14T11:15:19.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f8734291640 1 -- 172.21.15.26:0/4178042271 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f872c152220 con 0x7f872c0cdc80 2023-10-14T11:15:19.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.143+0000 7f8722ffd640 1 -- 172.21.15.26:0/4178042271 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f87280129d0 con 0x7f872c0cdc80 2023-10-14T11:15:19.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.147+0000 7f8722ffd640 1 --2- 172.21.15.26:0/4178042271 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f87100664d0 0x7f8710068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:19.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.147+0000 7f8722ffd640 1 -- 172.21.15.26:0/4178042271 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5687+0+0 (secure 0 0 0) 0x7f87280838c0 con 0x7f872c0cdc80 2023-10-14T11:15:19.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.147+0000 7f873182c640 1 --2- 172.21.15.26:0/4178042271 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f87100664d0 0x7f8710068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:19.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.147+0000 7f873182c640 1 --2- 172.21.15.26:0/4178042271 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f87100664d0 0x7f8710068990 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f872c150150 tx=0x7f871c006ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:19.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.151+0000 7f8722ffd640 1 -- 172.21.15.26:0/4178042271 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8728050df0 con 0x7f872c0cdc80 2023-10-14T11:15:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.307+0000 7f8734291640 1 -- 172.21.15.26:0/4178042271 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "testcephfs1_data", "pool2": "testcephfs1_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f872c04e170 con 0x7f872c0cdc80 2023-10-14T11:15:19.828 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:15:19.832 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:15:19.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.951+0000 7f8722ffd640 1 -- 172.21.15.26:0/4178042271 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "testcephfs1_data", "pool2": "testcephfs1_data", "yes_i_really_really_mean_it": true}]=0 pool 'testcephfs1_data' removed v58) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8728054410 con 0x7f872c0cdc80 2023-10-14T11:15:19.960 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'testcephfs1_data' removed 2023-10-14T11:15:19.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.955+0000 7f8734291640 1 -- 172.21.15.26:0/4178042271 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f87100664d0 msgr2=0x7f8710068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:19.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.955+0000 7f8734291640 1 --2- 172.21.15.26:0/4178042271 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f87100664d0 0x7f8710068990 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f872c150150 tx=0x7f871c006ad0 comp rx=0 tx=0).stop 2023-10-14T11:15:19.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.955+0000 7f8734291640 1 -- 172.21.15.26:0/4178042271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f872c0cdc80 msgr2=0x7f872c151500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:19.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.955+0000 7f8734291640 1 --2- 172.21.15.26:0/4178042271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f872c0cdc80 0x7f872c151500 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f872800c490 tx=0x7f872800c950 comp rx=0 tx=0).stop 2023-10-14T11:15:19.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.955+0000 7f8734291640 1 -- 172.21.15.26:0/4178042271 shutdown_connections 2023-10-14T11:15:19.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.955+0000 7f8734291640 1 --2- 172.21.15.26:0/4178042271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f872c0d2570 0x7f872c149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:19.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.955+0000 7f8734291640 1 --2- 172.21.15.26:0/4178042271 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f872c0cfd20 0x7f872c1470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:19.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.955+0000 7f8734291640 1 --2- 172.21.15.26:0/4178042271 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f87100664d0 0x7f8710068990 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:19.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.955+0000 7f8734291640 1 --2- 172.21.15.26:0/4178042271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f872c0cdc80 0x7f872c151500 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:19.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.955+0000 7f8734291640 1 -- 172.21.15.26:0/4178042271 >> 172.21.15.26:0/4178042271 conn(0x7f872c0715c0 msgr2=0x7f872c0b60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:19.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.955+0000 7f8734291640 1 -- 172.21.15.26:0/4178042271 shutdown_connections 2023-10-14T11:15:19.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:19.955+0000 7f8734291640 1 -- 172.21.15.26:0/4178042271 wait complete. 2023-10-14T11:15:19.991 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T11:15:20.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.131+0000 7f59e3aea640 1 Processor -- start 2023-10-14T11:15:20.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.131+0000 7f59e3aea640 1 -- start start 2023-10-14T11:15:20.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e3aea640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f59dc069e90 0x7f59dc06d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:20.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e3aea640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59dc06a270 0x7f59dc0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:20.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e3aea640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc15ae30 con 0x7f59dc0702f0 2023-10-14T11:15:20.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e3aea640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59dc0cb090 con 0x7f59dc069e90 2023-10-14T11:15:20.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e3aea640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0ca510 con 0x7f59dc06a270 2023-10-14T11:15:20.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e2087640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f59dc0702f0 0x7f59dc070780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45744/0 (socket says 172.21.15.26:45744) 2023-10-14T11:15:20.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e2087640 1 -- 172.21.15.26:0/3657379721 learned_addr learned my addr 172.21.15.26:0/3657379721 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:20.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e1886640 1 --2- 172.21.15.26:0/3657379721 >> v2:172.21.15.110:3300/0 conn(0x7f59dc069e90 0x7f59dc06d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:20.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e1085640 1 --2- 172.21.15.26:0/3657379721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59dc06a270 0x7f59dc0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:20.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e0884640 1 -- 172.21.15.26:0/3657379721 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676945044 0 0) 0x7f59dc15ae30 con 0x7f59dc0702f0 2023-10-14T11:15:20.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e0884640 1 -- 172.21.15.26:0/3657379721 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59c8003530 con 0x7f59dc0702f0 2023-10-14T11:15:20.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e0884640 1 -- 172.21.15.26:0/3657379721 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 763054949 0 0) 0x7f59c8003530 con 0x7f59dc0702f0 2023-10-14T11:15:20.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e0884640 1 -- 172.21.15.26:0/3657379721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59dc06a270 msgr2=0x7f59dc0c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:20.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e0884640 1 --2- 172.21.15.26:0/3657379721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59dc06a270 0x7f59dc0c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:20.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e0884640 1 -- 172.21.15.26:0/3657379721 >> v2:172.21.15.110:3300/0 conn(0x7f59dc069e90 msgr2=0x7f59dc06d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:20.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e0884640 1 --2- 172.21.15.26:0/3657379721 >> v2:172.21.15.110:3300/0 conn(0x7f59dc069e90 0x7f59dc06d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:20.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e0884640 1 -- 172.21.15.26:0/3657379721 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc0ca7f0 con 0x7f59dc0702f0 2023-10-14T11:15:20.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e0884640 1 -- 172.21.15.26:0/3657379721 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f59d4001a00 con 0x7f59dc0702f0 2023-10-14T11:15:20.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e0884640 1 -- 172.21.15.26:0/3657379721 >> v1:172.21.15.26:6789/0 conn(0x7f59dc0702f0 legacy=0x7f59dc070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:20.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e0884640 1 --2- 172.21.15.26:0/3657379721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c8003980 0x7f59c8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:20.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e0884640 1 --2- 172.21.15.26:0/3657379721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59dc06a270 0x7f59c80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:20.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e0884640 1 --2- 172.21.15.26:0/3657379721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59c8004d10 0x7f59c8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:20.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e0884640 1 -- 172.21.15.26:0/3657379721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0cb090 con 0x7f59c8004d10 2023-10-14T11:15:20.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e0884640 1 -- 172.21.15.26:0/3657379721 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0ca510 con 0x7f59c8003980 2023-10-14T11:15:20.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e0884640 1 -- 172.21.15.26:0/3657379721 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c800b990 con 0x7f59dc06a270 2023-10-14T11:15:20.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e2087640 1 --2- 172.21.15.26:0/3657379721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59c8004d10 0x7f59c8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:20.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e1886640 1 --2- 172.21.15.26:0/3657379721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c8003980 0x7f59c8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:20.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e1085640 1 --2- 172.21.15.26:0/3657379721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59dc06a270 0x7f59c80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:20.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e2087640 1 -- 172.21.15.26:0/3657379721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59dc06a270 msgr2=0x7f59c80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:20.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e2087640 1 --2- 172.21.15.26:0/3657379721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59dc06a270 0x7f59c80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:20.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e2087640 1 -- 172.21.15.26:0/3657379721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c8003980 msgr2=0x7f59c8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:20.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e2087640 1 --2- 172.21.15.26:0/3657379721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c8003980 0x7f59c8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:20.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.135+0000 7f59e2087640 1 -- 172.21.15.26:0/3657379721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c8003530 con 0x7f59c8004d10 2023-10-14T11:15:20.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.139+0000 7f59e2087640 1 --2- 172.21.15.26:0/3657379721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59c8004d10 0x7f59c8005190 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f59d400a830 tx=0x7f59d401d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d80ae96608ae183 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:20.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.139+0000 7f59e0884640 1 -- 172.21.15.26:0/3657379721 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d40ad630 con 0x7f59c8004d10 2023-10-14T11:15:20.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.139+0000 7f59e0884640 1 -- 172.21.15.26:0/3657379721 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d40a8070 con 0x7f59c8004d10 2023-10-14T11:15:20.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.139+0000 7f59e0884640 1 -- 172.21.15.26:0/3657379721 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d40ad9f0 con 0x7f59c8004d10 2023-10-14T11:15:20.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.139+0000 7f59e3aea640 1 -- 172.21.15.26:0/3657379721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59c8004d10 msgr2=0x7f59c8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:20.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.139+0000 7f59e3aea640 1 --2- 172.21.15.26:0/3657379721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59c8004d10 0x7f59c8005190 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f59d400a830 tx=0x7f59d401d360 comp rx=0 tx=0).stop 2023-10-14T11:15:20.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.139+0000 7f59e2087640 1 -- 172.21.15.26:0/3657379721 reap_dead start 2023-10-14T11:15:20.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.139+0000 7f59e3aea640 1 -- 172.21.15.26:0/3657379721 shutdown_connections 2023-10-14T11:15:20.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.139+0000 7f59e3aea640 1 -- 172.21.15.26:0/3657379721 >> 172.21.15.26:0/3657379721 conn(0x7f59dc0b0da0 msgr2=0x7f59dc0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:20.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.139+0000 7f59e3aea640 1 -- 172.21.15.26:0/3657379721 shutdown_connections 2023-10-14T11:15:20.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.139+0000 7f59e3aea640 1 -- 172.21.15.26:0/3657379721 wait complete. 2023-10-14T11:15:20.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.139+0000 7f59e3aea640 1 Processor -- start 2023-10-14T11:15:20.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59e3aea640 1 -- start start 2023-10-14T11:15:20.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59e3aea640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59dc14b300 0x7f59dc0ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:20.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59e3aea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59dc14ddb0 0x7f59dc0c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:20.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59e3aea640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59dc14b6e0 0x7f59dc0c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:20.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59e3aea640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0b1910 con 0x7f59dc14ddb0 2023-10-14T11:15:20.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59e3aea640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0ac7a0 con 0x7f59dc14b6e0 2023-10-14T11:15:20.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59e3aea640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0ac1e0 con 0x7f59dc14b300 2023-10-14T11:15:20.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59e1085640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59dc14ddb0 0x7f59dc0c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:20.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59e1886640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59dc14b300 0x7f59dc0ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:20.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59e1085640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59dc14ddb0 0x7f59dc0c2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34342/0 (socket says 172.21.15.26:34342) 2023-10-14T11:15:20.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59e1085640 1 -- 172.21.15.26:0/3072927031 learned_addr learned my addr 172.21.15.26:0/3072927031 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:20.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59e2087640 1 --2- 172.21.15.26:0/3072927031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59dc14b6e0 0x7f59dc0c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:20.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59e1085640 1 -- 172.21.15.26:0/3072927031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59dc14b300 msgr2=0x7f59dc0ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:20.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59e1085640 1 --2- 172.21.15.26:0/3072927031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59dc14b300 0x7f59dc0ab870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:20.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59e1085640 1 -- 172.21.15.26:0/3072927031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59dc14b6e0 msgr2=0x7f59dc0c2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:20.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59e1085640 1 --2- 172.21.15.26:0/3072927031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59dc14b6e0 0x7f59dc0c2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:20.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59e1085640 1 -- 172.21.15.26:0/3072927031 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc0ac4c0 con 0x7f59dc14ddb0 2023-10-14T11:15:20.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59e1085640 1 --2- 172.21.15.26:0/3072927031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59dc14ddb0 0x7f59dc0c2a50 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f59cc0119d0 tx=0x7f59cc011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:20.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59d27fc640 1 -- 172.21.15.26:0/3072927031 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc00faf0 con 0x7f59dc14ddb0 2023-10-14T11:15:20.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59d27fc640 1 -- 172.21.15.26:0/3072927031 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59cc00fc50 con 0x7f59dc14ddb0 2023-10-14T11:15:20.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59e3aea640 1 -- 172.21.15.26:0/3072927031 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59dc14bcd0 con 0x7f59dc14ddb0 2023-10-14T11:15:20.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59d27fc640 1 -- 172.21.15.26:0/3072927031 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc014440 con 0x7f59dc14ddb0 2023-10-14T11:15:20.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59e3aea640 1 -- 172.21.15.26:0/3072927031 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59dc0abdb0 con 0x7f59dc14ddb0 2023-10-14T11:15:20.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.143+0000 7f59e3aea640 1 -- 172.21.15.26:0/3072927031 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59dc04e170 con 0x7f59dc14ddb0 2023-10-14T11:15:20.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.147+0000 7f59d27fc640 1 -- 172.21.15.26:0/3072927031 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f59cc0145a0 con 0x7f59dc14ddb0 2023-10-14T11:15:20.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.147+0000 7f59d27fc640 1 --2- 172.21.15.26:0/3072927031 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f59c00664d0 0x7f59c0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:20.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.147+0000 7f59d27fc640 1 -- 172.21.15.26:0/3072927031 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f59cc084530 con 0x7f59dc14ddb0 2023-10-14T11:15:20.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.147+0000 7f59e1886640 1 --2- 172.21.15.26:0/3072927031 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f59c00664d0 0x7f59c0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:20.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.147+0000 7f59e1886640 1 --2- 172.21.15.26:0/3072927031 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f59c00664d0 0x7f59c0068990 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f59d8009b40 tx=0x7f59d8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:20.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.151+0000 7f59d27fc640 1 -- 172.21.15.26:0/3072927031 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f59cc051b00 con 0x7f59dc14ddb0 2023-10-14T11:15:20.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.307+0000 7f59e3aea640 1 -- 172.21.15.26:0/3072927031 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f59dc0c2090 con 0x7f59dc14ddb0 2023-10-14T11:15:20.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.311+0000 7f59d27fc640 1 -- 172.21.15.26:0/3072927031 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f59cc055120 con 0x7f59dc14ddb0 2023-10-14T11:15:20.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.315+0000 7f59e3aea640 1 -- 172.21.15.26:0/3072927031 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f59c00664d0 msgr2=0x7f59c0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:20.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.315+0000 7f59e3aea640 1 --2- 172.21.15.26:0/3072927031 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f59c00664d0 0x7f59c0068990 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f59d8009b40 tx=0x7f59d8009190 comp rx=0 tx=0).stop 2023-10-14T11:15:20.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.315+0000 7f59e3aea640 1 -- 172.21.15.26:0/3072927031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59dc14ddb0 msgr2=0x7f59dc0c2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:20.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.315+0000 7f59e3aea640 1 --2- 172.21.15.26:0/3072927031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59dc14ddb0 0x7f59dc0c2a50 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f59cc0119d0 tx=0x7f59cc011dd0 comp rx=0 tx=0).stop 2023-10-14T11:15:20.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.315+0000 7f59e3aea640 1 -- 172.21.15.26:0/3072927031 shutdown_connections 2023-10-14T11:15:20.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.315+0000 7f59e3aea640 1 --2- 172.21.15.26:0/3072927031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59dc14b6e0 0x7f59dc0c2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:20.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.315+0000 7f59e3aea640 1 --2- 172.21.15.26:0/3072927031 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f59c00664d0 0x7f59c0068990 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:20.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.315+0000 7f59e3aea640 1 --2- 172.21.15.26:0/3072927031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59dc14ddb0 0x7f59dc0c2a50 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:20.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.315+0000 7f59e3aea640 1 --2- 172.21.15.26:0/3072927031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59dc14b300 0x7f59dc0ab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:20.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.315+0000 7f59e3aea640 1 -- 172.21.15.26:0/3072927031 >> 172.21.15.26:0/3072927031 conn(0x7f59dc0b0da0 msgr2=0x7f59dc0ad760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:20.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.315+0000 7f59e3aea640 1 -- 172.21.15.26:0/3072927031 shutdown_connections 2023-10-14T11:15:20.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.315+0000 7f59e3aea640 1 -- 172.21.15.26:0/3072927031 wait complete. 2023-10-14T11:15:20.354 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2023-10-14T11:15:20.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.495+0000 7f25badf8640 1 Processor -- start 2023-10-14T11:15:20.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.495+0000 7f25badf8640 1 -- start start 2023-10-14T11:15:20.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.495+0000 7f25badf8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f25b40d15d0 0x7f25b40cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:20.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.495+0000 7f25badf8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25b40d3010 0x7f25b40c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:20.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.495+0000 7f25badf8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b40ce770 con 0x7f25b415cb90 2023-10-14T11:15:20.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.495+0000 7f25badf8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b40d0600 con 0x7f25b40d15d0 2023-10-14T11:15:20.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.495+0000 7f25badf8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b40c6450 con 0x7f25b40d3010 2023-10-14T11:15:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.495+0000 7f25b9395640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25b40d3010 0x7f25b40c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.495+0000 7f25b8b94640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f25b415cb90 0x7f25b40d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:33824/0 (socket says 172.21.15.26:33824) 2023-10-14T11:15:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.495+0000 7f25b8b94640 1 -- 172.21.15.26:0/3761803966 learned_addr learned my addr 172.21.15.26:0/3761803966 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.495+0000 7f25b3fff640 1 --2- 172.21.15.26:0/3761803966 >> v2:172.21.15.110:3300/0 conn(0x7f25b40d15d0 0x7f25b40cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.495+0000 7f25b9395640 1 -- 172.21.15.26:0/3761803966 >> v2:172.21.15.110:3300/0 conn(0x7f25b40d15d0 msgr2=0x7f25b40cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:20.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.495+0000 7f25b9395640 1 --2- 172.21.15.26:0/3761803966 >> v2:172.21.15.110:3300/0 conn(0x7f25b40d15d0 0x7f25b40cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:20.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.495+0000 7f25b9395640 1 -- 172.21.15.26:0/3761803966 >> v1:172.21.15.110:6789/0 conn(0x7f25b415cb90 legacy=0x7f25b40d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:20.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.495+0000 7f25b9395640 1 -- 172.21.15.26:0/3761803966 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b40d08a0 con 0x7f25b40d3010 2023-10-14T11:15:20.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.495+0000 7f25b37fe640 1 -- 172.21.15.26:0/3761803966 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687456830 0 0) 0x7f25b40ce770 con 0x7f25b415cb90 2023-10-14T11:15:20.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.499+0000 7f25b9395640 1 --2- 172.21.15.26:0/3761803966 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25b40d3010 0x7f25b40c6c10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009d90 tx=0x7f25ac01c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d8422f4661742e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:20.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.499+0000 7f25b37fe640 1 -- 172.21.15.26:0/3761803966 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0a5950 con 0x7f25b40d3010 2023-10-14T11:15:20.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.499+0000 7f25b37fe640 1 -- 172.21.15.26:0/3761803966 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac0a5ab0 con 0x7f25b40d3010 2023-10-14T11:15:20.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.499+0000 7f25b37fe640 1 -- 172.21.15.26:0/3761803966 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0a5e40 con 0x7f25b40d3010 2023-10-14T11:15:20.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.499+0000 7f25badf8640 1 -- 172.21.15.26:0/3761803966 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25b40d3010 msgr2=0x7f25b40c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:20.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.499+0000 7f25badf8640 1 --2- 172.21.15.26:0/3761803966 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25b40d3010 0x7f25b40c6c10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009d90 tx=0x7f25ac01c890 comp rx=0 tx=0).stop 2023-10-14T11:15:20.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.499+0000 7f25badf8640 1 -- 172.21.15.26:0/3761803966 shutdown_connections 2023-10-14T11:15:20.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.499+0000 7f25badf8640 1 --2- 172.21.15.26:0/3761803966 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25b40d3010 0x7f25b40c6c10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:20.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.499+0000 7f25badf8640 1 --2- 172.21.15.26:0/3761803966 >> v2:172.21.15.110:3300/0 conn(0x7f25b40d15d0 0x7f25b40cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:20.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.499+0000 7f25badf8640 1 -- 172.21.15.26:0/3761803966 >> 172.21.15.26:0/3761803966 conn(0x7f25b409bc50 msgr2=0x7f25b40d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:20.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.499+0000 7f25badf8640 1 -- 172.21.15.26:0/3761803966 shutdown_connections 2023-10-14T11:15:20.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.499+0000 7f25badf8640 1 -- 172.21.15.26:0/3761803966 wait complete. 2023-10-14T11:15:20.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25badf8640 1 Processor -- start 2023-10-14T11:15:20.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25badf8640 1 -- start start 2023-10-14T11:15:20.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25badf8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25b40d15d0 0x7f25b4147c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:20.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25badf8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25b40d3010 0x7f25b40cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:20.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25badf8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25b415cb90 0x7f25b406b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:20.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25badf8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b40cbe20 con 0x7f25b40d3010 2023-10-14T11:15:20.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25badf8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b41481b0 con 0x7f25b40d15d0 2023-10-14T11:15:20.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25badf8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b40cad80 con 0x7f25b415cb90 2023-10-14T11:15:20.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25b3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25b40d3010 0x7f25b40cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:20.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25b3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25b40d3010 0x7f25b40cc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34348/0 (socket says 172.21.15.26:34348) 2023-10-14T11:15:20.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25b3fff640 1 -- 172.21.15.26:0/3166994133 learned_addr learned my addr 172.21.15.26:0/3166994133 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:20.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25b9395640 1 --2- 172.21.15.26:0/3166994133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25b415cb90 0x7f25b406b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:20.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25b8b94640 1 --2- 172.21.15.26:0/3166994133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25b40d15d0 0x7f25b4147c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:20.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25b3fff640 1 -- 172.21.15.26:0/3166994133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25b415cb90 msgr2=0x7f25b406b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:20.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25b3fff640 1 --2- 172.21.15.26:0/3166994133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25b415cb90 0x7f25b406b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:20.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25b3fff640 1 -- 172.21.15.26:0/3166994133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25b40d15d0 msgr2=0x7f25b4147c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:20.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25b3fff640 1 --2- 172.21.15.26:0/3166994133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25b40d15d0 0x7f25b4147c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:20.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25b3fff640 1 -- 172.21.15.26:0/3166994133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ac009a70 con 0x7f25b40d3010 2023-10-14T11:15:20.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25b8b94640 1 --2- 172.21.15.26:0/3166994133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25b40d15d0 0x7f25b4147c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:15:20.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25b3fff640 1 --2- 172.21.15.26:0/3166994133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25b40d3010 0x7f25b40cc620 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f25a000e960 tx=0x7f25a000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:20.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25b17fa640 1 -- 172.21.15.26:0/3166994133 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0009690 con 0x7f25b40d3010 2023-10-14T11:15:20.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25b17fa640 1 -- 172.21.15.26:0/3166994133 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a000ca00 con 0x7f25b40d3010 2023-10-14T11:15:20.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25b17fa640 1 -- 172.21.15.26:0/3166994133 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a000cd70 con 0x7f25b40d3010 2023-10-14T11:15:20.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25badf8640 1 -- 172.21.15.26:0/3166994133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b40cb060 con 0x7f25b40d3010 2023-10-14T11:15:20.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25badf8640 1 -- 172.21.15.26:0/3166994133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b40cb620 con 0x7f25b40d3010 2023-10-14T11:15:20.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.503+0000 7f25badf8640 1 -- 172.21.15.26:0/3166994133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b4074010 con 0x7f25b40d3010 2023-10-14T11:15:20.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.507+0000 7f25b17fa640 1 -- 172.21.15.26:0/3166994133 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f25a0013470 con 0x7f25b40d3010 2023-10-14T11:15:20.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.507+0000 7f25b17fa640 1 --2- 172.21.15.26:0/3166994133 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f25980664a0 0x7f2598068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:20.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.507+0000 7f25b17fa640 1 -- 172.21.15.26:0/3166994133 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f25a0083f50 con 0x7f25b40d3010 2023-10-14T11:15:20.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.507+0000 7f25b8b94640 1 --2- 172.21.15.26:0/3166994133 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f25980664a0 0x7f2598068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:20.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.507+0000 7f25b8b94640 1 --2- 172.21.15.26:0/3166994133 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f25980664a0 0x7f2598068960 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f25a8000fc0 tx=0x7f25a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:20.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.511+0000 7f25b17fa640 1 -- 172.21.15.26:0/3166994133 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f25a0051500 con 0x7f25b40d3010 2023-10-14T11:15:20.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.727+0000 7f25badf8640 1 -- 172.21.15.26:0/3166994133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7f25b40b8430 con 0x7f25b40d3010 2023-10-14T11:15:20.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.967+0000 7f25b17fa640 1 -- 172.21.15.26:0/3166994133 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v192) v1 ==== 134+0+0 (secure 0 0 0) 0x7f25a00210c0 con 0x7f25b40d3010 2023-10-14T11:15:20.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.967+0000 7f25badf8640 1 -- 172.21.15.26:0/3166994133 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f25980664a0 msgr2=0x7f2598068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:20.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.967+0000 7f25badf8640 1 --2- 172.21.15.26:0/3166994133 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f25980664a0 0x7f2598068960 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f25a8000fc0 tx=0x7f25a8009040 comp rx=0 tx=0).stop 2023-10-14T11:15:20.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.967+0000 7f25badf8640 1 -- 172.21.15.26:0/3166994133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25b40d3010 msgr2=0x7f25b40cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:20.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.967+0000 7f25badf8640 1 --2- 172.21.15.26:0/3166994133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25b40d3010 0x7f25b40cc620 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f25a000e960 tx=0x7f25a000ee20 comp rx=0 tx=0).stop 2023-10-14T11:15:20.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.967+0000 7f25badf8640 1 -- 172.21.15.26:0/3166994133 shutdown_connections 2023-10-14T11:15:20.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.967+0000 7f25badf8640 1 --2- 172.21.15.26:0/3166994133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25b415cb90 0x7f25b406b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:20.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.967+0000 7f25badf8640 1 --2- 172.21.15.26:0/3166994133 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f25980664a0 0x7f2598068960 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:20.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.967+0000 7f25badf8640 1 --2- 172.21.15.26:0/3166994133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25b40d3010 0x7f25b40cc620 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:20.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.967+0000 7f25badf8640 1 --2- 172.21.15.26:0/3166994133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25b40d15d0 0x7f25b4147c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:20.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.967+0000 7f25badf8640 1 -- 172.21.15.26:0/3166994133 >> 172.21.15.26:0/3166994133 conn(0x7f25b409bc50 msgr2=0x7f25b4159100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:20.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.971+0000 7f25badf8640 1 -- 172.21.15.26:0/3166994133 shutdown_connections 2023-10-14T11:15:20.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:20.971+0000 7f25badf8640 1 -- 172.21.15.26:0/3166994133 wait complete. 2023-10-14T11:15:20.996 INFO:tasks.cephfs_test_runner:test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) ... ERROR 2023-10-14T11:15:20.997 INFO:tasks.cephfs_test_runner: 2023-10-14T11:15:20.997 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-14T11:15:20.997 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-10-14T11:15:20.998 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T11:15:20.998 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-14T11:15:20.998 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2023-10-14T11:15:20.999 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2023-10-14T11:15:20.999 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/mount.py", line 775, in run_python 2023-10-14T11:15:20.999 INFO:tasks.cephfs_test_runner: p.wait() 2023-10-14T11:15:20.999 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait 2023-10-14T11:15:21.000 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-14T11:15:21.000 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-14T11:15:21.000 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-14T11:15:21.000 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 1: 'stdin-killer -- python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2023-10-14T11:15:21.001 INFO:tasks.cephfs_test_runner: 2023-10-14T11:15:21.001 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T11:15:21.001 INFO:tasks.cephfs_test_runner:Ran 2 tests in 126.516s 2023-10-14T11:15:21.001 INFO:tasks.cephfs_test_runner: 2023-10-14T11:15:21.002 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-10-14T11:15:21.002 INFO:tasks.cephfs_test_runner: 2023-10-14T11:15:21.002 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-14T11:15:21.002 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-10-14T11:15:21.003 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T11:15:21.003 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-14T11:15:21.003 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2023-10-14T11:15:21.003 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2023-10-14T11:15:21.004 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/mount.py", line 775, in run_python 2023-10-14T11:15:21.004 INFO:tasks.cephfs_test_runner: p.wait() 2023-10-14T11:15:21.004 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait 2023-10-14T11:15:21.004 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-14T11:15:21.005 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-14T11:15:21.005 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-14T11:15:21.005 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 1: 'stdin-killer -- python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2023-10-14T11:15:21.005 INFO:tasks.cephfs_test_runner: 2023-10-14T11:15:21.006 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-10-14T11:15:21.080 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=3fc2d7b4618f44f4a1a5f673abfe7e43 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-10-14T11:15:21.082 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-14T11:15:21.095 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-14T11:15:21.866 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-14T11:15:21.867 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:15:21.868 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:15:21.884 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357764k,nr_inodes=4089441,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7700 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-14T11:15:21.885 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-14T11:15:21.885 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:15:21.934 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357764k,nr_inodes=4089441,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7700 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-14T11:15:21.934 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:15:21.934 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:15:21.946 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7574 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-14T11:15:21.947 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-14T11:15:21.947 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:15:22.005 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7574 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-14T11:15:22.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:22.006 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-14T11:15:22.017 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T11:15:22.018 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T11:15:22.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:22.020 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:15:22.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:22.084 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:15:22.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:22.190 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2023-10-14T11:15:22.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:22.335 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2023-10-14T11:15:22.345 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T11:15:22.345 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T11:15:22.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:22.346 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T11:15:22.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:22.413 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T11:15:22.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:15:22.489 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2023-10-14T11:15:22.680 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-14T11:15:22.690 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T11:15:22.690 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:15:22.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.839+0000 7fd469654640 1 Processor -- start 2023-10-14T11:15:22.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.839+0000 7fd469654640 1 -- start start 2023-10-14T11:15:22.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.839+0000 7fd469654640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd46415cb90 0x7fd4640cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:22.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.839+0000 7fd469654640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd4640d15d0 0x7fd4640c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:22.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.839+0000 7fd469654640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4640ce770 con 0x7fd4640d3010 2023-10-14T11:15:22.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.839+0000 7fd469654640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4640d0600 con 0x7fd4640d15d0 2023-10-14T11:15:22.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.839+0000 7fd469654640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4640c6450 con 0x7fd46415cb90 2023-10-14T11:15:22.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.839+0000 7fd45bfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd4640d3010 0x7fd4640d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52800/0 (socket says 172.21.15.26:52800) 2023-10-14T11:15:22.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.839+0000 7fd45bfff640 1 -- 172.21.15.26:0/3743560083 learned_addr learned my addr 172.21.15.26:0/3743560083 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:22.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.839+0000 7fd4637fe640 1 --2- 172.21.15.26:0/3743560083 >> v2:172.21.15.26:3300/0 conn(0x7fd4640d15d0 0x7fd4640c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:22.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.839+0000 7fd462ffd640 1 --2- 172.21.15.26:0/3743560083 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd46415cb90 0x7fd4640cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:22.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.839+0000 7fd4627fc640 1 -- 172.21.15.26:0/3743560083 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4194537176 0 0) 0x7fd4640ce770 con 0x7fd4640d3010 2023-10-14T11:15:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.839+0000 7fd4627fc640 1 -- 172.21.15.26:0/3743560083 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd450003530 con 0x7fd4640d3010 2023-10-14T11:15:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.839+0000 7fd4637fe640 1 -- 172.21.15.26:0/3743560083 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd46415cb90 msgr2=0x7fd4640cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.839+0000 7fd4637fe640 1 --2- 172.21.15.26:0/3743560083 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd46415cb90 0x7fd4640cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.839+0000 7fd4637fe640 1 -- 172.21.15.26:0/3743560083 >> v1:172.21.15.26:6789/0 conn(0x7fd4640d3010 legacy=0x7fd4640d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:22.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.839+0000 7fd4637fe640 1 -- 172.21.15.26:0/3743560083 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4640d08a0 con 0x7fd4640d15d0 2023-10-14T11:15:22.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.843+0000 7fd4637fe640 1 --2- 172.21.15.26:0/3743560083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4640d15d0 0x7fd4640c6c10 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd45c009d90 tx=0x7fd45c01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a13db69f3056983 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:22.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.843+0000 7fd4627fc640 1 -- 172.21.15.26:0/3743560083 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c0a5950 con 0x7fd4640d15d0 2023-10-14T11:15:22.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.843+0000 7fd4627fc640 1 -- 172.21.15.26:0/3743560083 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45c0a5ab0 con 0x7fd4640d15d0 2023-10-14T11:15:22.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.843+0000 7fd4627fc640 1 -- 172.21.15.26:0/3743560083 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c0a5e40 con 0x7fd4640d15d0 2023-10-14T11:15:22.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.843+0000 7fd469654640 1 -- 172.21.15.26:0/3743560083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4640d15d0 msgr2=0x7fd4640c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:22.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.843+0000 7fd469654640 1 --2- 172.21.15.26:0/3743560083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4640d15d0 0x7fd4640c6c10 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd45c009d90 tx=0x7fd45c01c890 comp rx=0 tx=0).stop 2023-10-14T11:15:22.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.843+0000 7fd469654640 1 -- 172.21.15.26:0/3743560083 shutdown_connections 2023-10-14T11:15:22.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.843+0000 7fd469654640 1 --2- 172.21.15.26:0/3743560083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4640d15d0 0x7fd4640c6c10 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:22.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.843+0000 7fd469654640 1 --2- 172.21.15.26:0/3743560083 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd46415cb90 0x7fd4640cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:22.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.843+0000 7fd469654640 1 -- 172.21.15.26:0/3743560083 >> 172.21.15.26:0/3743560083 conn(0x7fd46409bc50 msgr2=0x7fd4640d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:22.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.843+0000 7fd469654640 1 -- 172.21.15.26:0/3743560083 shutdown_connections 2023-10-14T11:15:22.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.843+0000 7fd469654640 1 -- 172.21.15.26:0/3743560083 wait complete. 2023-10-14T11:15:22.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd469654640 1 Processor -- start 2023-10-14T11:15:22.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd469654640 1 -- start start 2023-10-14T11:15:22.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd469654640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4640d15d0 0x7fd46406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:22.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd469654640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4640d3010 0x7fd4641501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:22.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd469654640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd46415cb90 0x7fd4640cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:22.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd469654640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46406c1d0 con 0x7fd4640d3010 2023-10-14T11:15:22.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd469654640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd464150700 con 0x7fd4640d15d0 2023-10-14T11:15:22.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd469654640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46413ecc0 con 0x7fd46415cb90 2023-10-14T11:15:22.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd45bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4640d3010 0x7fd4641501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:22.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd45bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4640d3010 0x7fd4641501c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34806/0 (socket says 172.21.15.26:34806) 2023-10-14T11:15:22.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd45bfff640 1 -- 172.21.15.26:0/724991548 learned_addr learned my addr 172.21.15.26:0/724991548 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:22.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd462ffd640 1 --2- 172.21.15.26:0/724991548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4640d15d0 0x7fd46406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:22.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd4637fe640 1 --2- 172.21.15.26:0/724991548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd46415cb90 0x7fd4640cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:22.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd45bfff640 1 -- 172.21.15.26:0/724991548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd46415cb90 msgr2=0x7fd4640cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:22.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd45bfff640 1 --2- 172.21.15.26:0/724991548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd46415cb90 0x7fd4640cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:22.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd45bfff640 1 -- 172.21.15.26:0/724991548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4640d15d0 msgr2=0x7fd46406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:22.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd45bfff640 1 --2- 172.21.15.26:0/724991548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4640d15d0 0x7fd46406bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:22.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd45bfff640 1 -- 172.21.15.26:0/724991548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c009a70 con 0x7fd4640d3010 2023-10-14T11:15:22.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd45bfff640 1 --2- 172.21.15.26:0/724991548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4640d3010 0x7fd4641501c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fd44c00c4d0 tx=0x7fd44c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:22.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd45b7fe640 1 -- 172.21.15.26:0/724991548 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c005cf0 con 0x7fd4640d3010 2023-10-14T11:15:22.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd45b7fe640 1 -- 172.21.15.26:0/724991548 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44c005e50 con 0x7fd4640d3010 2023-10-14T11:15:22.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd45b7fe640 1 -- 172.21.15.26:0/724991548 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c007270 con 0x7fd4640d3010 2023-10-14T11:15:22.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.847+0000 7fd469654640 1 -- 172.21.15.26:0/724991548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46413efa0 con 0x7fd4640d3010 2023-10-14T11:15:22.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.851+0000 7fd469654640 1 -- 172.21.15.26:0/724991548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46413f560 con 0x7fd4640d3010 2023-10-14T11:15:22.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.851+0000 7fd469654640 1 -- 172.21.15.26:0/724991548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46413f750 con 0x7fd4640d3010 2023-10-14T11:15:22.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.851+0000 7fd45b7fe640 1 -- 172.21.15.26:0/724991548 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd44c0073d0 con 0x7fd4640d3010 2023-10-14T11:15:22.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.851+0000 7fd45b7fe640 1 --2- 172.21.15.26:0/724991548 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd4440664a0 0x7fd444068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:22.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.851+0000 7fd45b7fe640 1 -- 172.21.15.26:0/724991548 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd44c083210 con 0x7fd4640d3010 2023-10-14T11:15:22.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.851+0000 7fd462ffd640 1 --2- 172.21.15.26:0/724991548 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd4440664a0 0x7fd444068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:22.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.855+0000 7fd462ffd640 1 --2- 172.21.15.26:0/724991548 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd4440664a0 0x7fd444068960 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd4540079a0 tx=0x7fd454008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:22.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:22.855+0000 7fd45b7fe640 1 -- 172.21.15.26:0/724991548 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd44c050860 con 0x7fd4640d3010 2023-10-14T11:15:23.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.011+0000 7fd469654640 1 -- 172.21.15.26:0/724991548 --> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd46415cf70 con 0x7fd4440664a0 2023-10-14T11:15:23.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.015+0000 7fd45b7fe640 1 -- 172.21.15.26:0/724991548 <== mgr.4101 v2:172.21.15.26:6832/4136446821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50782 (secure 0 0 0) 0x7fd4540108d0 con 0x7fd4440664a0 2023-10-14T11:15:23.021 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:15:23.023 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-14T11:15:23.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.015+0000 7fd469654640 1 -- 172.21.15.26:0/724991548 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd4440664a0 msgr2=0x7fd444068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:23.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.015+0000 7fd469654640 1 --2- 172.21.15.26:0/724991548 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd4440664a0 0x7fd444068960 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd4540079a0 tx=0x7fd454008040 comp rx=0 tx=0).stop 2023-10-14T11:15:23.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.015+0000 7fd469654640 1 -- 172.21.15.26:0/724991548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4640d3010 msgr2=0x7fd4641501c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:23.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.015+0000 7fd469654640 1 --2- 172.21.15.26:0/724991548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4640d3010 0x7fd4641501c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fd44c00c4d0 tx=0x7fd44c00c990 comp rx=0 tx=0).stop 2023-10-14T11:15:23.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.015+0000 7fd469654640 1 -- 172.21.15.26:0/724991548 shutdown_connections 2023-10-14T11:15:23.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.015+0000 7fd469654640 1 --2- 172.21.15.26:0/724991548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd46415cb90 0x7fd4640cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.015+0000 7fd469654640 1 --2- 172.21.15.26:0/724991548 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fd4440664a0 0x7fd444068960 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.015+0000 7fd469654640 1 --2- 172.21.15.26:0/724991548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4640d3010 0x7fd4641501c0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.015+0000 7fd469654640 1 --2- 172.21.15.26:0/724991548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4640d15d0 0x7fd46406bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.015+0000 7fd469654640 1 -- 172.21.15.26:0/724991548 >> 172.21.15.26:0/724991548 conn(0x7fd46409bc50 msgr2=0x7fd4640d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:23.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.015+0000 7fd469654640 1 -- 172.21.15.26:0/724991548 shutdown_connections 2023-10-14T11:15:23.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.015+0000 7fd469654640 1 -- 172.21.15.26:0/724991548 wait complete. 2023-10-14T11:15:23.041 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2023-10-14T11:15:22.198249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255936,"kb_used_data":6496,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718784,"statfs":{"total":773094113280,"available":772832034816,"internally_reserved":0,"allocated":6651904,"data_stored":3622962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":255315512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14930,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-62,"num_write_kb":-36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001052"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":194,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.603365+0000","last_change":"2023-10-14T11:12:12.162289+0000","last_active":"2023-10-14T11:14:51.603365+0000","last_peered":"2023-10-14T11:14:51.603365+0000","last_clean":"2023-10-14T11:14:51.603365+0000","last_became_active":"2023-10-14T11:12:12.161055+0000","last_became_peered":"2023-10-14T11:12:12.161055+0000","last_unstale":"2023-10-14T11:14:51.603365+0000","last_undegraded":"2023-10-14T11:14:51.603365+0000","last_fullsized":"2023-10-14T11:14:51.603365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_clean_scrub_stamp":"2023-10-14T11:12:10.853576+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:52.154107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1273856,"data_stored":891533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.77300000000000002,"15min":0.82699999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.96999999999999997,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":0.871},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.65800000000000003},"min":{"1min":0.42199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78700000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71599999999999997}]},{"osd":1,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88400000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90500000000000003,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.75900000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.81799999999999995,"15min":0.85599999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93799999999999994,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78300000000000003,"15min":0.81100000000000005},"min":{"1min":0.52600000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.91000000000000003,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.88900000000000001}]},{"osd":3,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.77100000000000002,"15min":0.81699999999999995},"min":{"1min":0.499,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84999999999999998,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.82999999999999996,"15min":0.873},"min":{"1min":0.502,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0129999999999999,"5min":3.5489999999999999,"15min":3.5489999999999999},"last":0.67600000000000005}]},{"osd":4,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65900000000000003,"15min":0.66100000000000003},"min":{"1min":0.45300000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89200000000000002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.52100000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92200000000000004,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.90300000000000002}]},{"osd":5,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69599999999999995,"15min":0.70199999999999996},"min":{"1min":0.437,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.876,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.749,"15min":0.76200000000000001},"min":{"1min":0.60899999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92100000000000004,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.64700000000000002}]},{"osd":6,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.81399999999999995},"min":{"1min":0.53800000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96999999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.76200000000000001,"15min":0.78800000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.94499999999999995,"5min":1.395,"15min":1.395},"last":0.95199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":671744,"data_stored":301005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.69299999999999995,"15min":0.71599999999999997},"min":{"1min":0.441,"5min":0.315,"15min":0.315},"max":{"1min":0.93300000000000005,"5min":1.244,"15min":1.244},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74399999999999999,"15min":0.76100000000000001},"min":{"1min":0.56399999999999995,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95599999999999996,"5min":1.331,"15min":1.331},"last":0.66800000000000004}]},{"osd":1,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.52000000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.94599999999999995,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68600000000000005,"15min":0.70199999999999996},"min":{"1min":0.46400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.024,"5min":1.304,"15min":1.304},"last":0.63600000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.69799999999999995,"15min":0.72599999999999998},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96999999999999997,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73599999999999999,"15min":0.75700000000000001},"min":{"1min":0.49399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.91600000000000004,"5min":1.845,"15min":1.845},"last":0.60099999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.76500000000000001,"15min":0.80000000000000004},"min":{"1min":0.53000000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98199999999999998,"5min":1.627,"15min":1.627},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.48399999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.016,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.69499999999999995,"15min":0.71099999999999997},"min":{"1min":0.41399999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.98999999999999999,"5min":1.206,"15min":1.206},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0600000000000001,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.86199999999999999}]},{"osd":5,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.45700000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88100000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72199999999999998,"15min":0.73299999999999998},"min":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0089999999999999,"5min":1.425,"15min":1.425},"last":0.80000000000000004}]},{"osd":7,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.747,"15min":0.77600000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98999999999999999,"5min":1.502,"15min":1.502},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.75800000000000001,"15min":0.78100000000000003},"min":{"1min":0.57099999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.93899999999999995,"5min":1.609,"15min":1.609},"last":0.68799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":679936,"data_stored":301657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.42799999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.3210000000000002,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":0.79300000000000004}]},{"osd":1,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.72499999999999998,"15min":0.70699999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.6600000000000001,"5min":2.6600000000000001,"15min":2.6600000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.45100000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.83399999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.81200000000000006}]},{"osd":2,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.56200000000000006,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68500000000000005,"15min":0.68899999999999995},"min":{"1min":0.52700000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.872,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.74199999999999999}]},{"osd":3,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.50800000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0169999999999999,"5min":1.22,"15min":1.22},"last":0.70099999999999996}]},{"osd":4,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89000000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68400000000000005,"15min":0.67200000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":0.61199999999999999}]},{"osd":6,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69399999999999995,"15min":0.69099999999999995},"min":{"1min":0.504,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91700000000000004,"5min":0.995,"15min":0.995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.51500000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94099999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.58599999999999997}]},{"osd":7,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.45000000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.55100000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97299999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.64300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":696320,"data_stored":317300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70399999999999996,"15min":0.72299999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96199999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68999999999999995,"15min":0.69699999999999995},"min":{"1min":0.498,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96599999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.61799999999999999}]},{"osd":1,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76100000000000001,"15min":0.78300000000000003},"min":{"1min":0.56299999999999994,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90700000000000003,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.85699999999999998}]},{"osd":2,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.77400000000000002,"15min":0.80700000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98599999999999999,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.54000000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.91600000000000004,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.749}]},{"osd":3,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73899999999999999,"15min":0.746},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0669999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.497},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77500000000000002,"15min":0.78500000000000003},"min":{"1min":0.61699999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.052,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.63400000000000001}]},{"osd":5,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70199999999999996,"15min":0.72199999999999998},"min":{"1min":0.41499999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.875,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67500000000000004,"15min":0.68200000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.024,"5min":1.349,"15min":1.349},"last":0.80300000000000005}]},{"osd":6,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88400000000000001,"5min":1.306,"15min":1.306},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.75900000000000001,"15min":0.78700000000000003},"min":{"1min":0.52000000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88900000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.94199999999999995}]},{"osd":7,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.53600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":1.071,"5min":1.163,"15min":1.163},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.83899999999999997,"15min":0.86199999999999999},"min":{"1min":0.67400000000000004,"5min":0.504,"15min":0.504},"max":{"1min":0.94299999999999995,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.68300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":679936,"data_stored":301061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44600000000000001,"15min":0.46300000000000002},"min":{"1min":0.26600000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.69199999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.28299999999999997,"5min":0.255,"15min":0.255},"max":{"1min":0.61099999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.34000000000000002}]},{"osd":1,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45800000000000002,"15min":0.47799999999999998},"min":{"1min":0.30199999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54200000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52700000000000002,"15min":0.54300000000000004},"min":{"1min":0.41899999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66500000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.378}]},{"osd":2,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.50900000000000001,"15min":0.52100000000000002},"min":{"1min":0.38100000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.61299999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58299999999999996,"15min":0.60299999999999998},"min":{"1min":0.36499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83199999999999996,"5min":1.018,"15min":1.018},"last":0.52200000000000002}]},{"osd":4,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.747,"15min":0.78100000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.95899999999999996,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.628},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.751,"15min":0.77300000000000002},"min":{"1min":0.56499999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.76000000000000001,"15min":0.78100000000000003},"min":{"1min":0.53600000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":1.375,"15min":1.375},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77100000000000002,"15min":0.79900000000000004},"min":{"1min":0.503,"5min":0.442,"15min":0.442},"max":{"1min":0.92300000000000004,"5min":1.286,"15min":1.286},"last":0.64800000000000002}]},{"osd":6,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76700000000000002,"15min":0.79000000000000004},"min":{"1min":0.55500000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0069999999999999,"5min":1.46,"15min":1.46},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77500000000000002,"15min":0.80300000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.878,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.77300000000000002}]},{"osd":7,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.53400000000000003,"5min":0.503,"15min":0.503},"max":{"1min":0.94799999999999995,"5min":1.222,"15min":1.222},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.90700000000000003,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.75900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":679936,"data_stored":301061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.45300000000000001,"15min":0.47899999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56000000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48399999999999999,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71599999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.53100000000000003}]},{"osd":1,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.53800000000000003,"15min":0.55700000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75800000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77700000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.57399999999999995}]},{"osd":3,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47499999999999998,"15min":0.48599999999999999},"min":{"1min":0.32700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69399999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55300000000000005,"15min":0.57499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.75,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.56100000000000005}]},{"osd":4,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.80400000000000005},"min":{"1min":0.59199999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.98699999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.754,"15min":0.77100000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.76300000000000001,"15min":0.78500000000000003},"min":{"1min":0.495,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.625},{"interface":"front","average":{"1min":0.749,"5min":0.80200000000000005,"15min":0.83599999999999997},"min":{"1min":0.54000000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.73499999999999999}]},{"osd":6,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.629,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0920000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.82899999999999996,"15min":0.87},"min":{"1min":0.5,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.286,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.82999999999999996,"15min":0.85699999999999998},"min":{"1min":0.56799999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.262,"5min":1.3,"15min":1.3},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.83199999999999996,"15min":0.86099999999999999},"min":{"1min":0.57899999999999996,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.80600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31840,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340000,"statfs":{"total":96636764160,"available":96604160000,"internally_reserved":0,"allocated":675840,"data_stored":301095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40100000000000002,"15min":0.40899999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.66000000000000003,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54900000000000004,"15min":0.56299999999999994},"min":{"1min":0.442,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.78700000000000003,"5min":1.244,"15min":1.244},"last":0.504}]},{"osd":2,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.44,"15min":0.433},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.53900000000000003,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.46500000000000002,"15min":0.46800000000000003},"min":{"1min":0.34599999999999997,"5min":0.31,"15min":0.31},"max":{"1min":0.69999999999999996,"5min":0.753,"15min":0.753},"last":0.41199999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.377,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73199999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55300000000000005,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85399999999999998,"5min":1.081,"15min":1.081},"last":0.47399999999999998}]},{"osd":4,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77100000000000002,"15min":0.78900000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.075,"5min":1.629,"15min":1.629},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77800000000000002,"15min":0.79500000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.98799999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.76400000000000001}]},{"osd":5,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.54600000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.099,"5min":1.296,"15min":1.296},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.78000000000000003,"15min":0.81100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93300000000000005,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":0.747}]},{"osd":6,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73799999999999999,"15min":0.752},"min":{"1min":0.56000000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.006,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.78400000000000003,"15min":0.80800000000000005},"min":{"1min":0.60699999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0109999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.82799999999999996}]},{"osd":7,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.81299999999999994,"15min":0.83899999999999997},"min":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1519999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.75900000000000001,"15min":0.78600000000000003},"min":{"1min":0.55000000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.042,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.80100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":908250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44800000000000001,"15min":0.46200000000000002},"min":{"1min":0.29899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.40400000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.376}]},{"osd":2,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52500000000000002,"15min":0.54000000000000004},"min":{"1min":0.36499999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.441},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45400000000000001,"15min":0.46400000000000002},"min":{"1min":0.32900000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68100000000000005,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.34899999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.502,"15min":0.51800000000000002},"min":{"1min":0.35899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.61799999999999999,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89000000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.48799999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.63100000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.628},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.64000000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.048,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.71299999999999997}]},{"osd":5,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.65700000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.77300000000000002,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.59799999999999998}]},{"osd":6,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.81499999999999995,"15min":0.82899999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78300000000000003,"15min":0.80800000000000005},"min":{"1min":0.59599999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.127,"5min":1.536,"15min":1.536},"last":0.69399999999999995}]},{"osd":7,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":0.89900000000000002,"15min":0.877},"min":{"1min":0.54700000000000004,"5min":0.501,"15min":0.501},"max":{"1min":7.0880000000000001,"5min":7.0880000000000001,"15min":7.0880000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.79100000000000004,"15min":0.80200000000000005},"min":{"1min":0.63500000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.72699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:15:23.045 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:15:23.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.179+0000 7f0cff59e640 1 Processor -- start 2023-10-14T11:15:23.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.183+0000 7f0cff59e640 1 -- start start 2023-10-14T11:15:23.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.183+0000 7f0cff59e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d0015c980 0x7f0d0006af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:23.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.183+0000 7f0cff59e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0d0015cd60 0x7f0d000b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:23.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.183+0000 7f0cff59e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d000d3510 con 0x7f0d000d0d80 2023-10-14T11:15:23.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.183+0000 7f0cff59e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d000cd2b0 con 0x7f0d0015cd60 2023-10-14T11:15:23.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.183+0000 7f0cff59e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d000d2f50 con 0x7f0d0015c980 2023-10-14T11:15:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.183+0000 7f0cfed9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0d000d0d80 0x7f0d000cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52802/0 (socket says 172.21.15.26:52802) 2023-10-14T11:15:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.183+0000 7f0cfed9d640 1 -- 172.21.15.26:0/3767680414 learned_addr learned my addr 172.21.15.26:0/3767680414 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.183+0000 7f0cfdd9b640 1 --2- 172.21.15.26:0/3767680414 >> v2:172.21.15.110:3300/0 conn(0x7f0d0015cd60 0x7f0d000b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.183+0000 7f0cfe59c640 1 --2- 172.21.15.26:0/3767680414 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d0015c980 0x7f0d0006af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:23.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.183+0000 7f0cfd59a640 1 -- 172.21.15.26:0/3767680414 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094097036 0 0) 0x7f0cf80014a0 con 0x7f0d000d0d80 2023-10-14T11:15:23.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.183+0000 7f0cfd59a640 1 -- 172.21.15.26:0/3767680414 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ce8003530 con 0x7f0d000d0d80 2023-10-14T11:15:23.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.183+0000 7f0cfe59c640 1 -- 172.21.15.26:0/3767680414 >> v2:172.21.15.110:3300/0 conn(0x7f0d0015cd60 msgr2=0x7f0d000b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:23.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.183+0000 7f0cfe59c640 1 --2- 172.21.15.26:0/3767680414 >> v2:172.21.15.110:3300/0 conn(0x7f0d0015cd60 0x7f0d000b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.183+0000 7f0cfe59c640 1 -- 172.21.15.26:0/3767680414 >> v1:172.21.15.26:6789/0 conn(0x7f0d000d0d80 legacy=0x7f0d000cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:23.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.183+0000 7f0cfe59c640 1 -- 172.21.15.26:0/3767680414 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d000d3230 con 0x7f0d0015c980 2023-10-14T11:15:23.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.183+0000 7f0cfdd9b640 1 --2- 172.21.15.26:0/3767680414 >> v2:172.21.15.110:3300/0 conn(0x7f0d0015cd60 0x7f0d000b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:15:23.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.187+0000 7f0cfe59c640 1 --2- 172.21.15.26:0/3767680414 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d0015c980 0x7f0d0006af90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0cf00097a0 tx=0x7f0cf001c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b5ece528cfc8b22 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:23.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.187+0000 7f0cfd59a640 1 -- 172.21.15.26:0/3767680414 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf00ab600 con 0x7f0d0015c980 2023-10-14T11:15:23.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.187+0000 7f0cfd59a640 1 -- 172.21.15.26:0/3767680414 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf00a7050 con 0x7f0d0015c980 2023-10-14T11:15:23.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.187+0000 7f0cfd59a640 1 -- 172.21.15.26:0/3767680414 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf00ab980 con 0x7f0d0015c980 2023-10-14T11:15:23.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.187+0000 7f0cff59e640 1 -- 172.21.15.26:0/3767680414 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d0015c980 msgr2=0x7f0d0006af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:23.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.187+0000 7f0cff59e640 1 --2- 172.21.15.26:0/3767680414 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d0015c980 0x7f0d0006af90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0cf00097a0 tx=0x7f0cf001c460 comp rx=0 tx=0).stop 2023-10-14T11:15:23.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.187+0000 7f0cff59e640 1 -- 172.21.15.26:0/3767680414 shutdown_connections 2023-10-14T11:15:23.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.187+0000 7f0cff59e640 1 --2- 172.21.15.26:0/3767680414 >> v2:172.21.15.110:3300/0 conn(0x7f0d0015cd60 0x7f0d000b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.187+0000 7f0cff59e640 1 --2- 172.21.15.26:0/3767680414 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d0015c980 0x7f0d0006af90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.187+0000 7f0cff59e640 1 -- 172.21.15.26:0/3767680414 >> 172.21.15.26:0/3767680414 conn(0x7f0d0009ba80 msgr2=0x7f0d000d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:23.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.187+0000 7f0cff59e640 1 -- 172.21.15.26:0/3767680414 shutdown_connections 2023-10-14T11:15:23.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.187+0000 7f0cff59e640 1 -- 172.21.15.26:0/3767680414 wait complete. 2023-10-14T11:15:23.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0cff59e640 1 Processor -- start 2023-10-14T11:15:23.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0cff59e640 1 -- start start 2023-10-14T11:15:23.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0cff59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d000d0d80 0x7f0d00144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:23.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0cff59e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d0015c980 0x7f0d00144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:23.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0cff59e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d0015cd60 0x7f0d00156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:23.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0cff59e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d001578f0 con 0x7f0d000d0d80 2023-10-14T11:15:23.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0cff59e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d000cb530 con 0x7f0d0015c980 2023-10-14T11:15:23.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0cff59e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d000cb810 con 0x7f0d0015cd60 2023-10-14T11:15:23.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0cfe59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d000d0d80 0x7f0d00144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:23.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0cfe59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d000d0d80 0x7f0d00144770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34816/0 (socket says 172.21.15.26:34816) 2023-10-14T11:15:23.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0cfe59c640 1 -- 172.21.15.26:0/1845008264 learned_addr learned my addr 172.21.15.26:0/1845008264 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:23.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0cfe59c640 1 -- 172.21.15.26:0/1845008264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d0015cd60 msgr2=0x7f0d00156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:23.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0cfe59c640 1 --2- 172.21.15.26:0/1845008264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d0015cd60 0x7f0d00156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0cfe59c640 1 -- 172.21.15.26:0/1845008264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d0015c980 msgr2=0x7f0d00144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:23.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0cfe59c640 1 --2- 172.21.15.26:0/1845008264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d0015c980 0x7f0d00144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0cfe59c640 1 -- 172.21.15.26:0/1845008264 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf4009420 con 0x7f0d000d0d80 2023-10-14T11:15:23.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0cfe59c640 1 --2- 172.21.15.26:0/1845008264 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d000d0d80 0x7f0d00144770 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f0cf001a090 tx=0x7f0cf0019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:23.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0ceeffd640 1 -- 172.21.15.26:0/1845008264 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf00b4410 con 0x7f0d000d0d80 2023-10-14T11:15:23.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0ceeffd640 1 -- 172.21.15.26:0/1845008264 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf00b4570 con 0x7f0d000d0d80 2023-10-14T11:15:23.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0ceeffd640 1 -- 172.21.15.26:0/1845008264 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf00b4920 con 0x7f0d000d0d80 2023-10-14T11:15:23.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0cff59e640 1 -- 172.21.15.26:0/1845008264 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf00093b0 con 0x7f0d000d0d80 2023-10-14T11:15:23.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0cff59e640 1 -- 172.21.15.26:0/1845008264 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d000d1720 con 0x7f0d000d0d80 2023-10-14T11:15:23.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.191+0000 7f0cff59e640 1 -- 172.21.15.26:0/1845008264 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d0004e9c0 con 0x7f0d000d0d80 2023-10-14T11:15:23.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.195+0000 7f0ceeffd640 1 -- 172.21.15.26:0/1845008264 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0cf00b2040 con 0x7f0d000d0d80 2023-10-14T11:15:23.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.195+0000 7f0ceeffd640 1 --2- 172.21.15.26:0/1845008264 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0ce00664a0 0x7f0ce0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:23.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.195+0000 7f0ceeffd640 1 -- 172.21.15.26:0/1845008264 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f0cf011dbe0 con 0x7f0d000d0d80 2023-10-14T11:15:23.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.195+0000 7f0cfdd9b640 1 --2- 172.21.15.26:0/1845008264 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0ce00664a0 0x7f0ce0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:23.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.195+0000 7f0cfdd9b640 1 --2- 172.21.15.26:0/1845008264 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0ce00664a0 0x7f0ce0068960 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4006e90 tx=0x7f0cf4006de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:23.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.199+0000 7f0ceeffd640 1 -- 172.21.15.26:0/1845008264 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0cf00eb210 con 0x7f0d000d0d80 2023-10-14T11:15:23.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.355+0000 7f0cff59e640 1 -- 172.21.15.26:0/1845008264 --> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d0009dbb0 con 0x7f0ce00664a0 2023-10-14T11:15:23.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.355+0000 7f0ceeffd640 1 -- 172.21.15.26:0/1845008264 <== mgr.4101 v2:172.21.15.26:6832/4136446821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50782 (secure 0 0 0) 0x7f0d0009dbb0 con 0x7f0ce00664a0 2023-10-14T11:15:23.363 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:15:23.363 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-14T11:15:23.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.359+0000 7f0cff59e640 1 -- 172.21.15.26:0/1845008264 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0ce00664a0 msgr2=0x7f0ce0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:23.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.359+0000 7f0cff59e640 1 --2- 172.21.15.26:0/1845008264 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0ce00664a0 0x7f0ce0068960 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4006e90 tx=0x7f0cf4006de0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.359+0000 7f0cff59e640 1 -- 172.21.15.26:0/1845008264 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d000d0d80 msgr2=0x7f0d00144770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:23.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.359+0000 7f0cff59e640 1 --2- 172.21.15.26:0/1845008264 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d000d0d80 0x7f0d00144770 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f0cf001a090 tx=0x7f0cf0019200 comp rx=0 tx=0).stop 2023-10-14T11:15:23.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.359+0000 7f0cff59e640 1 -- 172.21.15.26:0/1845008264 shutdown_connections 2023-10-14T11:15:23.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.359+0000 7f0cff59e640 1 --2- 172.21.15.26:0/1845008264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d0015cd60 0x7f0d00156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.359+0000 7f0cff59e640 1 --2- 172.21.15.26:0/1845008264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d0015c980 0x7f0d00144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.359+0000 7f0cff59e640 1 --2- 172.21.15.26:0/1845008264 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f0ce00664a0 0x7f0ce0068960 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.359+0000 7f0cff59e640 1 --2- 172.21.15.26:0/1845008264 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d000d0d80 0x7f0d00144770 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.359+0000 7f0cff59e640 1 -- 172.21.15.26:0/1845008264 >> 172.21.15.26:0/1845008264 conn(0x7f0d0009ba80 msgr2=0x7f0d00158fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:23.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.359+0000 7f0cff59e640 1 -- 172.21.15.26:0/1845008264 shutdown_connections 2023-10-14T11:15:23.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.359+0000 7f0cff59e640 1 -- 172.21.15.26:0/1845008264 wait complete. 2023-10-14T11:15:23.383 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2023-10-14T11:15:22.198249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255936,"kb_used_data":6496,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718784,"statfs":{"total":773094113280,"available":772832034816,"internally_reserved":0,"allocated":6651904,"data_stored":3622962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":255315512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14930,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-62,"num_write_kb":-36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001052"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":194,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.603365+0000","last_change":"2023-10-14T11:12:12.162289+0000","last_active":"2023-10-14T11:14:51.603365+0000","last_peered":"2023-10-14T11:14:51.603365+0000","last_clean":"2023-10-14T11:14:51.603365+0000","last_became_active":"2023-10-14T11:12:12.161055+0000","last_became_peered":"2023-10-14T11:12:12.161055+0000","last_unstale":"2023-10-14T11:14:51.603365+0000","last_undegraded":"2023-10-14T11:14:51.603365+0000","last_fullsized":"2023-10-14T11:14:51.603365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_clean_scrub_stamp":"2023-10-14T11:12:10.853576+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:52.154107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1273856,"data_stored":891533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.77300000000000002,"15min":0.82699999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.96999999999999997,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":0.871},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.65800000000000003},"min":{"1min":0.42199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78700000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71599999999999997}]},{"osd":1,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88400000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90500000000000003,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.75900000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.81799999999999995,"15min":0.85599999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93799999999999994,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78300000000000003,"15min":0.81100000000000005},"min":{"1min":0.52600000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.91000000000000003,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.88900000000000001}]},{"osd":3,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.77100000000000002,"15min":0.81699999999999995},"min":{"1min":0.499,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84999999999999998,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.82999999999999996,"15min":0.873},"min":{"1min":0.502,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0129999999999999,"5min":3.5489999999999999,"15min":3.5489999999999999},"last":0.67600000000000005}]},{"osd":4,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65900000000000003,"15min":0.66100000000000003},"min":{"1min":0.45300000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89200000000000002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.52100000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92200000000000004,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.90300000000000002}]},{"osd":5,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69599999999999995,"15min":0.70199999999999996},"min":{"1min":0.437,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.876,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.749,"15min":0.76200000000000001},"min":{"1min":0.60899999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92100000000000004,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.64700000000000002}]},{"osd":6,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.81399999999999995},"min":{"1min":0.53800000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96999999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.76200000000000001,"15min":0.78800000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.94499999999999995,"5min":1.395,"15min":1.395},"last":0.95199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":671744,"data_stored":301005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.69299999999999995,"15min":0.71599999999999997},"min":{"1min":0.441,"5min":0.315,"15min":0.315},"max":{"1min":0.93300000000000005,"5min":1.244,"15min":1.244},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74399999999999999,"15min":0.76100000000000001},"min":{"1min":0.56399999999999995,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95599999999999996,"5min":1.331,"15min":1.331},"last":0.66800000000000004}]},{"osd":1,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.52000000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.94599999999999995,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68600000000000005,"15min":0.70199999999999996},"min":{"1min":0.46400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.024,"5min":1.304,"15min":1.304},"last":0.63600000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.69799999999999995,"15min":0.72599999999999998},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96999999999999997,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73599999999999999,"15min":0.75700000000000001},"min":{"1min":0.49399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.91600000000000004,"5min":1.845,"15min":1.845},"last":0.60099999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.76500000000000001,"15min":0.80000000000000004},"min":{"1min":0.53000000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98199999999999998,"5min":1.627,"15min":1.627},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.48399999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.016,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.69499999999999995,"15min":0.71099999999999997},"min":{"1min":0.41399999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.98999999999999999,"5min":1.206,"15min":1.206},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0600000000000001,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.86199999999999999}]},{"osd":5,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.45700000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88100000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72199999999999998,"15min":0.73299999999999998},"min":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0089999999999999,"5min":1.425,"15min":1.425},"last":0.80000000000000004}]},{"osd":7,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.747,"15min":0.77600000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98999999999999999,"5min":1.502,"15min":1.502},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.75800000000000001,"15min":0.78100000000000003},"min":{"1min":0.57099999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.93899999999999995,"5min":1.609,"15min":1.609},"last":0.68799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":679936,"data_stored":301657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.42799999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.3210000000000002,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":0.79300000000000004}]},{"osd":1,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.72499999999999998,"15min":0.70699999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.6600000000000001,"5min":2.6600000000000001,"15min":2.6600000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.45100000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.83399999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.81200000000000006}]},{"osd":2,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.56200000000000006,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68500000000000005,"15min":0.68899999999999995},"min":{"1min":0.52700000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.872,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.74199999999999999}]},{"osd":3,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.50800000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0169999999999999,"5min":1.22,"15min":1.22},"last":0.70099999999999996}]},{"osd":4,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89000000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68400000000000005,"15min":0.67200000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":0.61199999999999999}]},{"osd":6,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69399999999999995,"15min":0.69099999999999995},"min":{"1min":0.504,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91700000000000004,"5min":0.995,"15min":0.995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.51500000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94099999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.58599999999999997}]},{"osd":7,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.45000000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.55100000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97299999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.64300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":696320,"data_stored":317300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70399999999999996,"15min":0.72299999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96199999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68999999999999995,"15min":0.69699999999999995},"min":{"1min":0.498,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96599999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.61799999999999999}]},{"osd":1,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76100000000000001,"15min":0.78300000000000003},"min":{"1min":0.56299999999999994,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90700000000000003,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.85699999999999998}]},{"osd":2,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.77400000000000002,"15min":0.80700000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98599999999999999,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.54000000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.91600000000000004,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.749}]},{"osd":3,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73899999999999999,"15min":0.746},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0669999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.497},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77500000000000002,"15min":0.78500000000000003},"min":{"1min":0.61699999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.052,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.63400000000000001}]},{"osd":5,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70199999999999996,"15min":0.72199999999999998},"min":{"1min":0.41499999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.875,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67500000000000004,"15min":0.68200000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.024,"5min":1.349,"15min":1.349},"last":0.80300000000000005}]},{"osd":6,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88400000000000001,"5min":1.306,"15min":1.306},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.75900000000000001,"15min":0.78700000000000003},"min":{"1min":0.52000000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88900000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.94199999999999995}]},{"osd":7,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.53600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":1.071,"5min":1.163,"15min":1.163},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.83899999999999997,"15min":0.86199999999999999},"min":{"1min":0.67400000000000004,"5min":0.504,"15min":0.504},"max":{"1min":0.94299999999999995,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.68300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":679936,"data_stored":301061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44600000000000001,"15min":0.46300000000000002},"min":{"1min":0.26600000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.69199999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.28299999999999997,"5min":0.255,"15min":0.255},"max":{"1min":0.61099999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.34000000000000002}]},{"osd":1,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45800000000000002,"15min":0.47799999999999998},"min":{"1min":0.30199999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54200000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52700000000000002,"15min":0.54300000000000004},"min":{"1min":0.41899999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66500000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.378}]},{"osd":2,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.50900000000000001,"15min":0.52100000000000002},"min":{"1min":0.38100000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.61299999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58299999999999996,"15min":0.60299999999999998},"min":{"1min":0.36499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83199999999999996,"5min":1.018,"15min":1.018},"last":0.52200000000000002}]},{"osd":4,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.747,"15min":0.78100000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.95899999999999996,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.628},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.751,"15min":0.77300000000000002},"min":{"1min":0.56499999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.76000000000000001,"15min":0.78100000000000003},"min":{"1min":0.53600000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":1.375,"15min":1.375},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77100000000000002,"15min":0.79900000000000004},"min":{"1min":0.503,"5min":0.442,"15min":0.442},"max":{"1min":0.92300000000000004,"5min":1.286,"15min":1.286},"last":0.64800000000000002}]},{"osd":6,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76700000000000002,"15min":0.79000000000000004},"min":{"1min":0.55500000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0069999999999999,"5min":1.46,"15min":1.46},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77500000000000002,"15min":0.80300000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.878,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.77300000000000002}]},{"osd":7,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.53400000000000003,"5min":0.503,"15min":0.503},"max":{"1min":0.94799999999999995,"5min":1.222,"15min":1.222},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.90700000000000003,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.75900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":679936,"data_stored":301061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.45300000000000001,"15min":0.47899999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56000000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48399999999999999,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71599999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.53100000000000003}]},{"osd":1,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.53800000000000003,"15min":0.55700000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75800000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77700000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.57399999999999995}]},{"osd":3,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47499999999999998,"15min":0.48599999999999999},"min":{"1min":0.32700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69399999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55300000000000005,"15min":0.57499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.75,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.56100000000000005}]},{"osd":4,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.80400000000000005},"min":{"1min":0.59199999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.98699999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.754,"15min":0.77100000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.76300000000000001,"15min":0.78500000000000003},"min":{"1min":0.495,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.625},{"interface":"front","average":{"1min":0.749,"5min":0.80200000000000005,"15min":0.83599999999999997},"min":{"1min":0.54000000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.73499999999999999}]},{"osd":6,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.629,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0920000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.82899999999999996,"15min":0.87},"min":{"1min":0.5,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.286,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.82999999999999996,"15min":0.85699999999999998},"min":{"1min":0.56799999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.262,"5min":1.3,"15min":1.3},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.83199999999999996,"15min":0.86099999999999999},"min":{"1min":0.57899999999999996,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.80600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31840,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340000,"statfs":{"total":96636764160,"available":96604160000,"internally_reserved":0,"allocated":675840,"data_stored":301095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40100000000000002,"15min":0.40899999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.66000000000000003,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54900000000000004,"15min":0.56299999999999994},"min":{"1min":0.442,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.78700000000000003,"5min":1.244,"15min":1.244},"last":0.504}]},{"osd":2,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.44,"15min":0.433},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.53900000000000003,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.46500000000000002,"15min":0.46800000000000003},"min":{"1min":0.34599999999999997,"5min":0.31,"15min":0.31},"max":{"1min":0.69999999999999996,"5min":0.753,"15min":0.753},"last":0.41199999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.377,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73199999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55300000000000005,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85399999999999998,"5min":1.081,"15min":1.081},"last":0.47399999999999998}]},{"osd":4,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77100000000000002,"15min":0.78900000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.075,"5min":1.629,"15min":1.629},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77800000000000002,"15min":0.79500000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.98799999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.76400000000000001}]},{"osd":5,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.54600000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.099,"5min":1.296,"15min":1.296},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.78000000000000003,"15min":0.81100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93300000000000005,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":0.747}]},{"osd":6,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73799999999999999,"15min":0.752},"min":{"1min":0.56000000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.006,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.78400000000000003,"15min":0.80800000000000005},"min":{"1min":0.60699999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0109999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.82799999999999996}]},{"osd":7,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.81299999999999994,"15min":0.83899999999999997},"min":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1519999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.75900000000000001,"15min":0.78600000000000003},"min":{"1min":0.55000000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.042,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.80100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":908250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44800000000000001,"15min":0.46200000000000002},"min":{"1min":0.29899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.40400000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.376}]},{"osd":2,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52500000000000002,"15min":0.54000000000000004},"min":{"1min":0.36499999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.441},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45400000000000001,"15min":0.46400000000000002},"min":{"1min":0.32900000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68100000000000005,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.34899999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.502,"15min":0.51800000000000002},"min":{"1min":0.35899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.61799999999999999,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89000000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.48799999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.63100000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.628},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.64000000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.048,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.71299999999999997}]},{"osd":5,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.65700000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.77300000000000002,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.59799999999999998}]},{"osd":6,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.81499999999999995,"15min":0.82899999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78300000000000003,"15min":0.80800000000000005},"min":{"1min":0.59599999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.127,"5min":1.536,"15min":1.536},"last":0.69399999999999995}]},{"osd":7,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":0.89900000000000002,"15min":0.877},"min":{"1min":0.54700000000000004,"5min":0.501,"15min":0.501},"max":{"1min":7.0880000000000001,"5min":7.0880000000000001,"15min":7.0880000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.79100000000000004,"15min":0.80200000000000005},"min":{"1min":0.63500000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.72699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:15:23.385 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T11:15:23.386 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:15:23.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.523+0000 7f2d5ccdc640 1 Processor -- start 2023-10-14T11:15:23.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.523+0000 7f2d5ccdc640 1 -- start start 2023-10-14T11:15:23.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.523+0000 7f2d5ccdc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2d580d1490 0x7f2d5806af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:23.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.523+0000 7f2d5ccdc640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d580d3510 con 0x7f2d5815cd60 2023-10-14T11:15:23.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.523+0000 7f2d5ccdc640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d580d2f50 con 0x7f2d5815c980 2023-10-14T11:15:23.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.523+0000 7f2d5ccdc640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d580cd2b0 con 0x7f2d580d1490 2023-10-14T11:15:23.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.523+0000 7f2d57fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2d5815cd60 0x7f2d580cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52808/0 (socket says 172.21.15.26:52808) 2023-10-14T11:15:23.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.523+0000 7f2d57fff640 1 -- 172.21.15.26:0/117124180 learned_addr learned my addr 172.21.15.26:0/117124180 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:23.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.523+0000 7f2d56ffd640 1 --2- 172.21.15.26:0/117124180 >> v2:172.21.15.110:3300/0 conn(0x7f2d580d1490 0x7f2d5806af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:23.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.523+0000 7f2d567fc640 1 -- 172.21.15.26:0/117124180 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4047227206 0 0) 0x7f2d500014a0 con 0x7f2d5815cd60 2023-10-14T11:15:23.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.523+0000 7f2d567fc640 1 -- 172.21.15.26:0/117124180 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d40003530 con 0x7f2d5815cd60 2023-10-14T11:15:23.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.523+0000 7f2d567fc640 1 -- 172.21.15.26:0/117124180 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2695515552 0 0) 0x7f2d580d2f50 con 0x7f2d5815c980 2023-10-14T11:15:23.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.523+0000 7f2d567fc640 1 -- 172.21.15.26:0/117124180 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d500014a0 con 0x7f2d5815c980 2023-10-14T11:15:23.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.523+0000 7f2d56ffd640 1 -- 172.21.15.26:0/117124180 >> v1:172.21.15.110:6789/0 conn(0x7f2d5815c980 legacy=0x7f2d580d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:23.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.523+0000 7f2d567fc640 1 -- 172.21.15.26:0/117124180 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1261122850 0 0) 0x7f2d40003530 con 0x7f2d5815cd60 2023-10-14T11:15:23.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.523+0000 7f2d56ffd640 1 -- 172.21.15.26:0/117124180 >> v1:172.21.15.26:6789/0 conn(0x7f2d5815cd60 legacy=0x7f2d580cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:23.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.523+0000 7f2d56ffd640 1 -- 172.21.15.26:0/117124180 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d580d3230 con 0x7f2d580d1490 2023-10-14T11:15:23.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.527+0000 7f2d56ffd640 1 --2- 172.21.15.26:0/117124180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d580d1490 0x7f2d5806af90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0097c0 tx=0x7f2d4c01c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dd9a4aa802e3fa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:23.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.527+0000 7f2d567fc640 1 -- 172.21.15.26:0/117124180 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d50001b90 con 0x7f2d580d1490 2023-10-14T11:15:23.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.527+0000 7f2d567fc640 1 -- 172.21.15.26:0/117124180 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4c0a7050 con 0x7f2d580d1490 2023-10-14T11:15:23.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.527+0000 7f2d567fc640 1 -- 172.21.15.26:0/117124180 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0ab620 con 0x7f2d580d1490 2023-10-14T11:15:23.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.527+0000 7f2d5ccdc640 1 -- 172.21.15.26:0/117124180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d580d1490 msgr2=0x7f2d5806af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:23.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.527+0000 7f2d5ccdc640 1 --2- 172.21.15.26:0/117124180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d580d1490 0x7f2d5806af90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0097c0 tx=0x7f2d4c01c3a0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.527+0000 7f2d5ccdc640 1 -- 172.21.15.26:0/117124180 shutdown_connections 2023-10-14T11:15:23.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.527+0000 7f2d5ccdc640 1 --2- 172.21.15.26:0/117124180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d580d1490 0x7f2d5806af90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.527+0000 7f2d5ccdc640 1 -- 172.21.15.26:0/117124180 >> 172.21.15.26:0/117124180 conn(0x7f2d5809ba80 msgr2=0x7f2d580d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:23.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.527+0000 7f2d5ccdc640 1 -- 172.21.15.26:0/117124180 shutdown_connections 2023-10-14T11:15:23.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.527+0000 7f2d5ccdc640 1 -- 172.21.15.26:0/117124180 wait complete. 2023-10-14T11:15:23.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d5ccdc640 1 Processor -- start 2023-10-14T11:15:23.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d5ccdc640 1 -- start start 2023-10-14T11:15:23.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d5ccdc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d580d1490 0x7f2d58151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:23.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d5ccdc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d5815c980 0x7f2d58152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:23.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d5ccdc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d5815cd60 0x7f2d581f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:23.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d5ccdc640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d581534f0 con 0x7f2d5815c980 2023-10-14T11:15:23.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d5ccdc640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d581525a0 con 0x7f2d580d1490 2023-10-14T11:15:23.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d5ccdc640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d58152870 con 0x7f2d5815cd60 2023-10-14T11:15:23.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d56ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d5815c980 0x7f2d58152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:23.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d56ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d5815c980 0x7f2d58152060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34828/0 (socket says 172.21.15.26:34828) 2023-10-14T11:15:23.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d56ffd640 1 -- 172.21.15.26:0/2024776171 learned_addr learned my addr 172.21.15.26:0/2024776171 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:23.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d56ffd640 1 -- 172.21.15.26:0/2024776171 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d5815cd60 msgr2=0x7f2d581f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:23.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d56ffd640 1 --2- 172.21.15.26:0/2024776171 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d5815cd60 0x7f2d581f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d56ffd640 1 -- 172.21.15.26:0/2024776171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d580d1490 msgr2=0x7f2d58151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:23.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d577fe640 1 --2- 172.21.15.26:0/2024776171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d580d1490 0x7f2d58151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:23.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d56ffd640 1 --2- 172.21.15.26:0/2024776171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d580d1490 0x7f2d58151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d56ffd640 1 -- 172.21.15.26:0/2024776171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c009420 con 0x7f2d5815c980 2023-10-14T11:15:23.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d577fe640 1 --2- 172.21.15.26:0/2024776171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d580d1490 0x7f2d58151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:15:23.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d56ffd640 1 --2- 172.21.15.26:0/2024776171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d5815c980 0x7f2d58152060 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c018fb0 tx=0x7f2d4c01abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:23.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d3ffff640 1 -- 172.21.15.26:0/2024776171 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0b4440 con 0x7f2d5815c980 2023-10-14T11:15:23.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d3ffff640 1 -- 172.21.15.26:0/2024776171 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4c0b45a0 con 0x7f2d5815c980 2023-10-14T11:15:23.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d3ffff640 1 -- 172.21.15.26:0/2024776171 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0b4910 con 0x7f2d5815c980 2023-10-14T11:15:23.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d5ccdc640 1 -- 172.21.15.26:0/2024776171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d58152b50 con 0x7f2d5815c980 2023-10-14T11:15:23.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d5ccdc640 1 -- 172.21.15.26:0/2024776171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d58153110 con 0x7f2d5815c980 2023-10-14T11:15:23.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.531+0000 7f2d5ccdc640 1 -- 172.21.15.26:0/2024776171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d5804e9c0 con 0x7f2d5815c980 2023-10-14T11:15:23.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.535+0000 7f2d3ffff640 1 -- 172.21.15.26:0/2024776171 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2d4c0b2070 con 0x7f2d5815c980 2023-10-14T11:15:23.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.535+0000 7f2d3ffff640 1 --2- 172.21.15.26:0/2024776171 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2d440664a0 0x7f2d44068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:23.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.535+0000 7f2d3ffff640 1 -- 172.21.15.26:0/2024776171 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f2d4c11db10 con 0x7f2d5815c980 2023-10-14T11:15:23.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.535+0000 7f2d577fe640 1 --2- 172.21.15.26:0/2024776171 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2d440664a0 0x7f2d44068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:23.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.535+0000 7f2d577fe640 1 --2- 172.21.15.26:0/2024776171 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2d440664a0 0x7f2d44068960 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2d48001240 tx=0x7f2d48009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:23.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.539+0000 7f2d3ffff640 1 -- 172.21.15.26:0/2024776171 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2d4c0eb1e0 con 0x7f2d5815c980 2023-10-14T11:15:23.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.691+0000 7f2d5ccdc640 1 -- 172.21.15.26:0/2024776171 --> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d580cfc30 con 0x7f2d440664a0 2023-10-14T11:15:23.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.695+0000 7f2d3ffff640 1 -- 172.21.15.26:0/2024776171 <== mgr.4101 v2:172.21.15.26:6832/4136446821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50782 (secure 0 0 0) 0x7f2d48001d40 con 0x7f2d440664a0 2023-10-14T11:15:23.700 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:15:23.701 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-14T11:15:23.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.695+0000 7f2d5ccdc640 1 -- 172.21.15.26:0/2024776171 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2d440664a0 msgr2=0x7f2d44068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:23.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.695+0000 7f2d5ccdc640 1 --2- 172.21.15.26:0/2024776171 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2d440664a0 0x7f2d44068960 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2d48001240 tx=0x7f2d48009040 comp rx=0 tx=0).stop 2023-10-14T11:15:23.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.695+0000 7f2d5ccdc640 1 -- 172.21.15.26:0/2024776171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d5815c980 msgr2=0x7f2d58152060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:23.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.695+0000 7f2d5ccdc640 1 --2- 172.21.15.26:0/2024776171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d5815c980 0x7f2d58152060 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c018fb0 tx=0x7f2d4c01abe0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.695+0000 7f2d5ccdc640 1 -- 172.21.15.26:0/2024776171 shutdown_connections 2023-10-14T11:15:23.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.695+0000 7f2d5ccdc640 1 --2- 172.21.15.26:0/2024776171 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d5815cd60 0x7f2d581f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.695+0000 7f2d5ccdc640 1 --2- 172.21.15.26:0/2024776171 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f2d440664a0 0x7f2d44068960 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.695+0000 7f2d5ccdc640 1 --2- 172.21.15.26:0/2024776171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d5815c980 0x7f2d58152060 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.695+0000 7f2d5ccdc640 1 --2- 172.21.15.26:0/2024776171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d580d1490 0x7f2d58151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.695+0000 7f2d5ccdc640 1 -- 172.21.15.26:0/2024776171 >> 172.21.15.26:0/2024776171 conn(0x7f2d5809ba80 msgr2=0x7f2d580b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:23.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.695+0000 7f2d5ccdc640 1 -- 172.21.15.26:0/2024776171 shutdown_connections 2023-10-14T11:15:23.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.695+0000 7f2d5ccdc640 1 -- 172.21.15.26:0/2024776171 wait complete. 2023-10-14T11:15:23.721 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2023-10-14T11:15:22.198249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255936,"kb_used_data":6496,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718784,"statfs":{"total":773094113280,"available":772832034816,"internally_reserved":0,"allocated":6651904,"data_stored":3622962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":255315512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14930,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-62,"num_write_kb":-36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001052"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":194,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-14T11:14:51.603365+0000","last_change":"2023-10-14T11:12:12.162289+0000","last_active":"2023-10-14T11:14:51.603365+0000","last_peered":"2023-10-14T11:14:51.603365+0000","last_clean":"2023-10-14T11:14:51.603365+0000","last_became_active":"2023-10-14T11:12:12.161055+0000","last_became_peered":"2023-10-14T11:12:12.161055+0000","last_unstale":"2023-10-14T11:14:51.603365+0000","last_undegraded":"2023-10-14T11:14:51.603365+0000","last_fullsized":"2023-10-14T11:14:51.603365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_clean_scrub_stamp":"2023-10-14T11:12:10.853576+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:52.154107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1273856,"data_stored":891533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.77300000000000002,"15min":0.82699999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.96999999999999997,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":0.871},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.65800000000000003},"min":{"1min":0.42199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78700000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71599999999999997}]},{"osd":1,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88400000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90500000000000003,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.75900000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.81799999999999995,"15min":0.85599999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93799999999999994,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78300000000000003,"15min":0.81100000000000005},"min":{"1min":0.52600000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.91000000000000003,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.88900000000000001}]},{"osd":3,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.77100000000000002,"15min":0.81699999999999995},"min":{"1min":0.499,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84999999999999998,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.82999999999999996,"15min":0.873},"min":{"1min":0.502,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0129999999999999,"5min":3.5489999999999999,"15min":3.5489999999999999},"last":0.67600000000000005}]},{"osd":4,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65900000000000003,"15min":0.66100000000000003},"min":{"1min":0.45300000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89200000000000002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.52100000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92200000000000004,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.90300000000000002}]},{"osd":5,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69599999999999995,"15min":0.70199999999999996},"min":{"1min":0.437,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.876,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.749,"15min":0.76200000000000001},"min":{"1min":0.60899999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92100000000000004,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.64700000000000002}]},{"osd":6,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.81399999999999995},"min":{"1min":0.53800000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96999999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.76200000000000001,"15min":0.78800000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.94499999999999995,"5min":1.395,"15min":1.395},"last":0.95199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":671744,"data_stored":301005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.69299999999999995,"15min":0.71599999999999997},"min":{"1min":0.441,"5min":0.315,"15min":0.315},"max":{"1min":0.93300000000000005,"5min":1.244,"15min":1.244},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74399999999999999,"15min":0.76100000000000001},"min":{"1min":0.56399999999999995,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95599999999999996,"5min":1.331,"15min":1.331},"last":0.66800000000000004}]},{"osd":1,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.52000000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.94599999999999995,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68600000000000005,"15min":0.70199999999999996},"min":{"1min":0.46400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.024,"5min":1.304,"15min":1.304},"last":0.63600000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.69799999999999995,"15min":0.72599999999999998},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96999999999999997,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73599999999999999,"15min":0.75700000000000001},"min":{"1min":0.49399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.91600000000000004,"5min":1.845,"15min":1.845},"last":0.60099999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.76500000000000001,"15min":0.80000000000000004},"min":{"1min":0.53000000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98199999999999998,"5min":1.627,"15min":1.627},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.48399999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.016,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.69499999999999995,"15min":0.71099999999999997},"min":{"1min":0.41399999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.98999999999999999,"5min":1.206,"15min":1.206},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0600000000000001,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.86199999999999999}]},{"osd":5,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.45700000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88100000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72199999999999998,"15min":0.73299999999999998},"min":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0089999999999999,"5min":1.425,"15min":1.425},"last":0.80000000000000004}]},{"osd":7,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.747,"15min":0.77600000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98999999999999999,"5min":1.502,"15min":1.502},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.75800000000000001,"15min":0.78100000000000003},"min":{"1min":0.57099999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.93899999999999995,"5min":1.609,"15min":1.609},"last":0.68799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":679936,"data_stored":301657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.42799999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.3210000000000002,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":0.79300000000000004}]},{"osd":1,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.72499999999999998,"15min":0.70699999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.6600000000000001,"5min":2.6600000000000001,"15min":2.6600000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.45100000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.83399999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.81200000000000006}]},{"osd":2,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.56200000000000006,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68500000000000005,"15min":0.68899999999999995},"min":{"1min":0.52700000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.872,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.74199999999999999}]},{"osd":3,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.50800000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0169999999999999,"5min":1.22,"15min":1.22},"last":0.70099999999999996}]},{"osd":4,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89000000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68400000000000005,"15min":0.67200000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":0.61199999999999999}]},{"osd":6,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69399999999999995,"15min":0.69099999999999995},"min":{"1min":0.504,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91700000000000004,"5min":0.995,"15min":0.995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.51500000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94099999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.58599999999999997}]},{"osd":7,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.45000000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.55100000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97299999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.64300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":696320,"data_stored":317300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70399999999999996,"15min":0.72299999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96199999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68999999999999995,"15min":0.69699999999999995},"min":{"1min":0.498,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96599999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.61799999999999999}]},{"osd":1,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76100000000000001,"15min":0.78300000000000003},"min":{"1min":0.56299999999999994,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90700000000000003,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.85699999999999998}]},{"osd":2,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.77400000000000002,"15min":0.80700000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98599999999999999,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.54000000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.91600000000000004,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.749}]},{"osd":3,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73899999999999999,"15min":0.746},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0669999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.497},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77500000000000002,"15min":0.78500000000000003},"min":{"1min":0.61699999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.052,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.63400000000000001}]},{"osd":5,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70199999999999996,"15min":0.72199999999999998},"min":{"1min":0.41499999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.875,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67500000000000004,"15min":0.68200000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.024,"5min":1.349,"15min":1.349},"last":0.80300000000000005}]},{"osd":6,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88400000000000001,"5min":1.306,"15min":1.306},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.75900000000000001,"15min":0.78700000000000003},"min":{"1min":0.52000000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88900000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.94199999999999995}]},{"osd":7,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.53600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":1.071,"5min":1.163,"15min":1.163},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.83899999999999997,"15min":0.86199999999999999},"min":{"1min":0.67400000000000004,"5min":0.504,"15min":0.504},"max":{"1min":0.94299999999999995,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.68300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":679936,"data_stored":301061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44600000000000001,"15min":0.46300000000000002},"min":{"1min":0.26600000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.69199999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.28299999999999997,"5min":0.255,"15min":0.255},"max":{"1min":0.61099999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.34000000000000002}]},{"osd":1,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45800000000000002,"15min":0.47799999999999998},"min":{"1min":0.30199999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54200000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52700000000000002,"15min":0.54300000000000004},"min":{"1min":0.41899999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66500000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.378}]},{"osd":2,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.50900000000000001,"15min":0.52100000000000002},"min":{"1min":0.38100000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.61299999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58299999999999996,"15min":0.60299999999999998},"min":{"1min":0.36499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83199999999999996,"5min":1.018,"15min":1.018},"last":0.52200000000000002}]},{"osd":4,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.747,"15min":0.78100000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.95899999999999996,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.628},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.751,"15min":0.77300000000000002},"min":{"1min":0.56499999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.76000000000000001,"15min":0.78100000000000003},"min":{"1min":0.53600000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":1.375,"15min":1.375},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77100000000000002,"15min":0.79900000000000004},"min":{"1min":0.503,"5min":0.442,"15min":0.442},"max":{"1min":0.92300000000000004,"5min":1.286,"15min":1.286},"last":0.64800000000000002}]},{"osd":6,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76700000000000002,"15min":0.79000000000000004},"min":{"1min":0.55500000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0069999999999999,"5min":1.46,"15min":1.46},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77500000000000002,"15min":0.80300000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.878,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.77300000000000002}]},{"osd":7,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.53400000000000003,"5min":0.503,"15min":0.503},"max":{"1min":0.94799999999999995,"5min":1.222,"15min":1.222},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.90700000000000003,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.75900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":679936,"data_stored":301061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.45300000000000001,"15min":0.47899999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56000000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48399999999999999,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71599999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.53100000000000003}]},{"osd":1,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.53800000000000003,"15min":0.55700000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75800000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77700000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.57399999999999995}]},{"osd":3,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47499999999999998,"15min":0.48599999999999999},"min":{"1min":0.32700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69399999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55300000000000005,"15min":0.57499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.75,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.56100000000000005}]},{"osd":4,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.80400000000000005},"min":{"1min":0.59199999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.98699999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.754,"15min":0.77100000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.76300000000000001,"15min":0.78500000000000003},"min":{"1min":0.495,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.625},{"interface":"front","average":{"1min":0.749,"5min":0.80200000000000005,"15min":0.83599999999999997},"min":{"1min":0.54000000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.73499999999999999}]},{"osd":6,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.629,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0920000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.82899999999999996,"15min":0.87},"min":{"1min":0.5,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.286,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.82999999999999996,"15min":0.85699999999999998},"min":{"1min":0.56799999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.262,"5min":1.3,"15min":1.3},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.83199999999999996,"15min":0.86099999999999999},"min":{"1min":0.57899999999999996,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.80600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31840,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340000,"statfs":{"total":96636764160,"available":96604160000,"internally_reserved":0,"allocated":675840,"data_stored":301095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40100000000000002,"15min":0.40899999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.66000000000000003,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54900000000000004,"15min":0.56299999999999994},"min":{"1min":0.442,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.78700000000000003,"5min":1.244,"15min":1.244},"last":0.504}]},{"osd":2,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.44,"15min":0.433},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.53900000000000003,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.46500000000000002,"15min":0.46800000000000003},"min":{"1min":0.34599999999999997,"5min":0.31,"15min":0.31},"max":{"1min":0.69999999999999996,"5min":0.753,"15min":0.753},"last":0.41199999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.377,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73199999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55300000000000005,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85399999999999998,"5min":1.081,"15min":1.081},"last":0.47399999999999998}]},{"osd":4,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77100000000000002,"15min":0.78900000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.075,"5min":1.629,"15min":1.629},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77800000000000002,"15min":0.79500000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.98799999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.76400000000000001}]},{"osd":5,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.54600000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.099,"5min":1.296,"15min":1.296},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.78000000000000003,"15min":0.81100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93300000000000005,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":0.747}]},{"osd":6,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73799999999999999,"15min":0.752},"min":{"1min":0.56000000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.006,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.78400000000000003,"15min":0.80800000000000005},"min":{"1min":0.60699999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0109999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.82799999999999996}]},{"osd":7,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.81299999999999994,"15min":0.83899999999999997},"min":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1519999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.75900000000000001,"15min":0.78600000000000003},"min":{"1min":0.55000000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.042,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.80100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":908250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44800000000000001,"15min":0.46200000000000002},"min":{"1min":0.29899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.40400000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.376}]},{"osd":2,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52500000000000002,"15min":0.54000000000000004},"min":{"1min":0.36499999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.441},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45400000000000001,"15min":0.46400000000000002},"min":{"1min":0.32900000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68100000000000005,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.34899999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.502,"15min":0.51800000000000002},"min":{"1min":0.35899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.61799999999999999,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89000000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.48799999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.63100000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.628},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.64000000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.048,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.71299999999999997}]},{"osd":5,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.65700000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.77300000000000002,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.59799999999999998}]},{"osd":6,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.81499999999999995,"15min":0.82899999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78300000000000003,"15min":0.80800000000000005},"min":{"1min":0.59599999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.127,"5min":1.536,"15min":1.536},"last":0.69399999999999995}]},{"osd":7,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":0.89900000000000002,"15min":0.877},"min":{"1min":0.54700000000000004,"5min":0.501,"15min":0.501},"max":{"1min":7.0880000000000001,"5min":7.0880000000000001,"15min":7.0880000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.79100000000000004,"15min":0.80200000000000005},"min":{"1min":0.63500000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.72699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:15:23.723 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:15:23.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.859+0000 7f18ace9e640 1 Processor -- start 2023-10-14T11:15:23.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.859+0000 7f18ace9e640 1 -- start start 2023-10-14T11:15:23.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.859+0000 7f18ace9e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f18a80b07f0 0x7f18a815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:23.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.859+0000 7f18ace9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18a815d690 0x7f18a8164490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:23.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.859+0000 7f18ace9e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a815be60 con 0x7f18a8070c40 2023-10-14T11:15:23.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.859+0000 7f18ace9e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a815b3b0 con 0x7f18a80b07f0 2023-10-14T11:15:23.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.859+0000 7f18ace9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a815c1f0 con 0x7f18a815d690 2023-10-14T11:15:23.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.859+0000 7f18a659c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f18a8070c40 0x7f18a80b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52814/0 (socket says 172.21.15.26:52814) 2023-10-14T11:15:23.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.859+0000 7f18a659c640 1 -- 172.21.15.26:0/1858813211 learned_addr learned my addr 172.21.15.26:0/1858813211 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:23.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.859+0000 7f189ffff640 1 --2- 172.21.15.26:0/1858813211 >> v2:172.21.15.26:3300/0 conn(0x7f18a80b07f0 0x7f18a815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:23.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.863+0000 7f18a6d9d640 1 --2- 172.21.15.26:0/1858813211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18a815d690 0x7f18a8164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:23.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.863+0000 7f18a5d9b640 1 -- 172.21.15.26:0/1858813211 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 9670426 0 0) 0x7f18a815be60 con 0x7f18a8070c40 2023-10-14T11:15:23.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.863+0000 7f189ffff640 1 -- 172.21.15.26:0/1858813211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18a815d690 msgr2=0x7f18a8164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:23.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.863+0000 7f189ffff640 1 --2- 172.21.15.26:0/1858813211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18a815d690 0x7f18a8164490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.863+0000 7f189ffff640 1 -- 172.21.15.26:0/1858813211 >> v1:172.21.15.26:6789/0 conn(0x7f18a8070c40 legacy=0x7f18a80b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:23.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.863+0000 7f189ffff640 1 -- 172.21.15.26:0/1858813211 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a8071020 con 0x7f18a80b07f0 2023-10-14T11:15:23.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.863+0000 7f189ffff640 1 --2- 172.21.15.26:0/1858813211 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18a80b07f0 0x7f18a815ae70 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f18900097c0 tx=0x7f189001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16606ccd4f8cf482 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:23.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.863+0000 7f18a5d9b640 1 -- 172.21.15.26:0/1858813211 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18900ad660 con 0x7f18a80b07f0 2023-10-14T11:15:23.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.863+0000 7f18a5d9b640 1 -- 172.21.15.26:0/1858813211 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18900ad7c0 con 0x7f18a80b07f0 2023-10-14T11:15:23.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.863+0000 7f18a5d9b640 1 -- 172.21.15.26:0/1858813211 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18900adb50 con 0x7f18a80b07f0 2023-10-14T11:15:23.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.863+0000 7f18ace9e640 1 -- 172.21.15.26:0/1858813211 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18a80b07f0 msgr2=0x7f18a815ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:23.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.863+0000 7f18ace9e640 1 --2- 172.21.15.26:0/1858813211 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18a80b07f0 0x7f18a815ae70 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f18900097c0 tx=0x7f189001c360 comp rx=0 tx=0).stop 2023-10-14T11:15:23.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18ace9e640 1 -- 172.21.15.26:0/1858813211 shutdown_connections 2023-10-14T11:15:23.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18ace9e640 1 --2- 172.21.15.26:0/1858813211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18a815d690 0x7f18a8164490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18ace9e640 1 --2- 172.21.15.26:0/1858813211 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18a80b07f0 0x7f18a815ae70 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18ace9e640 1 -- 172.21.15.26:0/1858813211 >> 172.21.15.26:0/1858813211 conn(0x7f18a806c190 msgr2=0x7f18a806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:23.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18ace9e640 1 -- 172.21.15.26:0/1858813211 shutdown_connections 2023-10-14T11:15:23.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18ace9e640 1 -- 172.21.15.26:0/1858813211 wait complete. 2023-10-14T11:15:23.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18ace9e640 1 Processor -- start 2023-10-14T11:15:23.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18ace9e640 1 -- start start 2023-10-14T11:15:23.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18ace9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18a8070c40 0x7f18a80a8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:23.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18ace9e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18a80b07f0 0x7f18a80a8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:23.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18ace9e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18a815d690 0x7f18a81f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:23.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18ace9e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a81f6dc0 con 0x7f18a815d690 2023-10-14T11:15:23.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18ace9e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a80c4d70 con 0x7f18a80b07f0 2023-10-14T11:15:23.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18ace9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a80a92b0 con 0x7f18a8070c40 2023-10-14T11:15:23.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18a6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18a815d690 0x7f18a81f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:23.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18a6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18a815d690 0x7f18a81f4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34838/0 (socket says 172.21.15.26:34838) 2023-10-14T11:15:23.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18a6d9d640 1 -- 172.21.15.26:0/1426803926 learned_addr learned my addr 172.21.15.26:0/1426803926 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:23.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18a659c640 1 --2- 172.21.15.26:0/1426803926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18a8070c40 0x7f18a80a8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:23.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f189ffff640 1 --2- 172.21.15.26:0/1426803926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18a80b07f0 0x7f18a80a8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:23.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18a6d9d640 1 -- 172.21.15.26:0/1426803926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18a8070c40 msgr2=0x7f18a80a8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:23.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18a6d9d640 1 --2- 172.21.15.26:0/1426803926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18a8070c40 0x7f18a80a8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18a6d9d640 1 -- 172.21.15.26:0/1426803926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18a80b07f0 msgr2=0x7f18a80a8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:23.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18a6d9d640 1 --2- 172.21.15.26:0/1426803926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18a80b07f0 0x7f18a80a8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18a6d9d640 1 -- 172.21.15.26:0/1426803926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1890009420 con 0x7f18a815d690 2023-10-14T11:15:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f189ffff640 1 --2- 172.21.15.26:0/1426803926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18a80b07f0 0x7f18a80a8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:15:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18a659c640 1 --2- 172.21.15.26:0/1426803926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18a8070c40 0x7f18a80a8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:15:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.867+0000 7f18a6d9d640 1 --2- 172.21.15.26:0/1426803926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18a815d690 0x7f18a81f4e50 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f18a0007dc0 tx=0x7f18a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:23.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.871+0000 7f189effd640 1 -- 172.21.15.26:0/1426803926 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0014420 con 0x7f18a815d690 2023-10-14T11:15:23.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.871+0000 7f189effd640 1 -- 172.21.15.26:0/1426803926 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a00145a0 con 0x7f18a815d690 2023-10-14T11:15:23.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.871+0000 7f189effd640 1 -- 172.21.15.26:0/1426803926 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0014950 con 0x7f18a815d690 2023-10-14T11:15:23.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.871+0000 7f18ace9e640 1 -- 172.21.15.26:0/1426803926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a81f61b0 con 0x7f18a815d690 2023-10-14T11:15:23.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.871+0000 7f18ace9e640 1 -- 172.21.15.26:0/1426803926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a81f6770 con 0x7f18a815d690 2023-10-14T11:15:23.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.871+0000 7f18ace9e640 1 -- 172.21.15.26:0/1426803926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a81f6f70 con 0x7f18a815d690 2023-10-14T11:15:23.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.871+0000 7f189effd640 1 -- 172.21.15.26:0/1426803926 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f18a0014ab0 con 0x7f18a815d690 2023-10-14T11:15:23.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.871+0000 7f189effd640 1 --2- 172.21.15.26:0/1426803926 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f18880664a0 0x7f1888068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:23.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.871+0000 7f189effd640 1 -- 172.21.15.26:0/1426803926 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f18a0084690 con 0x7f18a815d690 2023-10-14T11:15:23.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.871+0000 7f18a659c640 1 --2- 172.21.15.26:0/1426803926 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f18880664a0 0x7f1888068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:23.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.875+0000 7f18a659c640 1 --2- 172.21.15.26:0/1426803926 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f18880664a0 0x7f1888068960 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1898007fd0 tx=0x7f1898009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:23.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:23.875+0000 7f189effd640 1 -- 172.21.15.26:0/1426803926 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f18a81f6f70 con 0x7f18a815d690 2023-10-14T11:15:24.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:24.035+0000 7f18ace9e640 1 -- 172.21.15.26:0/1426803926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18a81f6f70 con 0x7f18a815d690 2023-10-14T11:15:24.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:24.035+0000 7f189effd640 1 -- 172.21.15.26:0/1426803926 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+13191 (secure 0 0 0) 0x7f18a81f6f70 con 0x7f18a815d690 2023-10-14T11:15:24.043 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:15:24.043 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":58,"fsid":"9730719c-9713-4147-aaa1-ca8aabbbe5ad","created":"2023-10-14T11:11:57.033063+0000","modified":"2023-10-14T11:15:19.955470+0000","last_up_change":"2023-10-14T11:12:08.640402+0000","last_in_change":"2023-10-14T11:11:59.590779+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:12:10.220846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25998260-202e-4090-9e28-3098039db5b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6825","nonce":1796231477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6827","nonce":1796231477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6831","nonce":1796231477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1796231477},{"type":"v1","addr":"172.21.15.26:6829","nonce":1796231477}]},"public_addr":"172.21.15.26:6825/1796231477","cluster_addr":"172.21.15.26:6827/1796231477","heartbeat_back_addr":"172.21.15.26:6831/1796231477","heartbeat_front_addr":"172.21.15.26:6829/1796231477","state":["exists","up"]},{"osd":1,"uuid":"561dc692-04c6-4a51-85aa-a1490fbb8da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6817","nonce":3885030983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6819","nonce":3885030983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6823","nonce":3885030983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3885030983},{"type":"v1","addr":"172.21.15.26:6821","nonce":3885030983}]},"public_addr":"172.21.15.26:6817/3885030983","cluster_addr":"172.21.15.26:6819/3885030983","heartbeat_back_addr":"172.21.15.26:6823/3885030983","heartbeat_front_addr":"172.21.15.26:6821/3885030983","state":["exists","up"]},{"osd":2,"uuid":"0e76b99e-ec38-4aec-a55d-c4c13944e199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6807","nonce":1022580976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6811","nonce":1022580976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6815","nonce":1022580976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1022580976},{"type":"v1","addr":"172.21.15.26:6813","nonce":1022580976}]},"public_addr":"172.21.15.26:6807/1022580976","cluster_addr":"172.21.15.26:6811/1022580976","heartbeat_back_addr":"172.21.15.26:6815/1022580976","heartbeat_front_addr":"172.21.15.26:6813/1022580976","state":["exists","up"]},{"osd":3,"uuid":"4aaf2a3a-551b-4f2b-9fe6-b9c74db0cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6801","nonce":603797368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6803","nonce":603797368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6809","nonce":603797368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":603797368},{"type":"v1","addr":"172.21.15.26:6806","nonce":603797368}]},"public_addr":"172.21.15.26:6801/603797368","cluster_addr":"172.21.15.26:6803/603797368","heartbeat_back_addr":"172.21.15.26:6809/603797368","heartbeat_front_addr":"172.21.15.26:6806/603797368","state":["exists","up"]},{"osd":4,"uuid":"155ec5fc-cdfd-468c-9b87-48b7d568181b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6801","nonce":3436135045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6803","nonce":3436135045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6807","nonce":3436135045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3436135045},{"type":"v1","addr":"172.21.15.110:6805","nonce":3436135045}]},"public_addr":"172.21.15.110:6801/3436135045","cluster_addr":"172.21.15.110:6803/3436135045","heartbeat_back_addr":"172.21.15.110:6807/3436135045","heartbeat_front_addr":"172.21.15.110:6805/3436135045","state":["exists","up"]},{"osd":5,"uuid":"040ef3ea-4707-4229-b251-0d951b8112a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6809","nonce":3405567465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6811","nonce":3405567465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6815","nonce":3405567465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3405567465},{"type":"v1","addr":"172.21.15.110:6813","nonce":3405567465}]},"public_addr":"172.21.15.110:6809/3405567465","cluster_addr":"172.21.15.110:6811/3405567465","heartbeat_back_addr":"172.21.15.110:6815/3405567465","heartbeat_front_addr":"172.21.15.110:6813/3405567465","state":["exists","up"]},{"osd":6,"uuid":"9a55b2d2-8cdf-41a4-94cb-969d4a7dc297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6825","nonce":3095626813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3095626813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6831","nonce":3095626813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3095626813},{"type":"v1","addr":"172.21.15.110:6829","nonce":3095626813}]},"public_addr":"172.21.15.110:6825/3095626813","cluster_addr":"172.21.15.110:6827/3095626813","heartbeat_back_addr":"172.21.15.110:6831/3095626813","heartbeat_front_addr":"172.21.15.110:6829/3095626813","state":["exists","up"]},{"osd":7,"uuid":"9d237756-386f-48dd-bd9b-0796937e557f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6817","nonce":3205286209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6819","nonce":3205286209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6823","nonce":3205286209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3205286209},{"type":"v1","addr":"172.21.15.110:6821","nonce":3205286209}]},"public_addr":"172.21.15.110:6817/3205286209","cluster_addr":"172.21.15.110:6819/3205286209","heartbeat_back_addr":"172.21.15.110:6823/3205286209","heartbeat_front_addr":"172.21.15.110:6821/3205286209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.359663+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.376972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.234953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.393509+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.107145+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.366682+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.304965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:12:05.300598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:6837/2641279888":"2023-10-15T11:15:16.676239+0000","172.21.15.26:6836/2641279888":"2023-10-15T11:15:16.676239+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:15:24.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:24.039+0000 7f18ace9e640 1 -- 172.21.15.26:0/1426803926 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f18880664a0 msgr2=0x7f1888068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:24.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:24.039+0000 7f18ace9e640 1 --2- 172.21.15.26:0/1426803926 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f18880664a0 0x7f1888068960 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1898007fd0 tx=0x7f1898009040 comp rx=0 tx=0).stop 2023-10-14T11:15:24.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:24.039+0000 7f18ace9e640 1 -- 172.21.15.26:0/1426803926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18a815d690 msgr2=0x7f18a81f4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:24.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:24.039+0000 7f18ace9e640 1 --2- 172.21.15.26:0/1426803926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18a815d690 0x7f18a81f4e50 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f18a0007dc0 tx=0x7f18a000e4b0 comp rx=0 tx=0).stop 2023-10-14T11:15:24.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:24.039+0000 7f18ace9e640 1 -- 172.21.15.26:0/1426803926 shutdown_connections 2023-10-14T11:15:24.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:24.039+0000 7f18ace9e640 1 --2- 172.21.15.26:0/1426803926 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f18880664a0 0x7f1888068960 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:24.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:24.039+0000 7f18ace9e640 1 --2- 172.21.15.26:0/1426803926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18a815d690 0x7f18a81f4e50 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:24.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:24.039+0000 7f18ace9e640 1 --2- 172.21.15.26:0/1426803926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18a80b07f0 0x7f18a80a8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:24.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:24.039+0000 7f18ace9e640 1 --2- 172.21.15.26:0/1426803926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18a8070c40 0x7f18a80a8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:24.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:24.039+0000 7f18ace9e640 1 -- 172.21.15.26:0/1426803926 >> 172.21.15.26:0/1426803926 conn(0x7f18a806c190 msgr2=0x7f18a80cee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:24.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:24.039+0000 7f18ace9e640 1 -- 172.21.15.26:0/1426803926 shutdown_connections 2023-10-14T11:15:24.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:24.039+0000 7f18ace9e640 1 -- 172.21.15.26:0/1426803926 wait complete. 2023-10-14T11:15:25.064 INFO:tasks.ceph:Scrubbing osd.0 2023-10-14T11:15:25.065 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-14T11:15:25.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.215+0000 7f4fbc30f640 1 Processor -- start 2023-10-14T11:15:25.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.215+0000 7f4fbc30f640 1 -- start start 2023-10-14T11:15:25.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.215+0000 7f4fbc30f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4fb40cdc80 0x7f4fb40cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.215+0000 7f4fbc30f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb415dec0 0x7f4fb40cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.215+0000 7f4fbc30f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb40ce460 con 0x7f4fb40d2570 2023-10-14T11:15:25.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.215+0000 7f4fbc30f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb40cd830 con 0x7f4fb40cdc80 2023-10-14T11:15:25.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.215+0000 7f4fbc30f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb415da30 con 0x7f4fb415dec0 2023-10-14T11:15:25.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.215+0000 7f4fba8ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb415dec0 0x7f4fb40cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.215+0000 7f4fba0ab640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f4fb40d2570 0x7f4fb4161210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:45724/0 (socket says 172.21.15.26:45724) 2023-10-14T11:15:25.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.215+0000 7f4fba0ab640 1 -- 172.21.15.26:0/3123057792 learned_addr learned my addr 172.21.15.26:0/3123057792 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:25.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.215+0000 7f4fb98aa640 1 --2- 172.21.15.26:0/3123057792 >> v2:172.21.15.110:3300/0 conn(0x7f4fb40cdc80 0x7f4fb40cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.215+0000 7f4fb90a9640 1 -- 172.21.15.26:0/3123057792 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008473354 0 0) 0x7f4fb40ce460 con 0x7f4fb40d2570 2023-10-14T11:15:25.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.215+0000 7f4fb90a9640 1 -- 172.21.15.26:0/3123057792 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fa0003530 con 0x7f4fb40d2570 2023-10-14T11:15:25.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.219+0000 7f4fb98aa640 1 -- 172.21.15.26:0/3123057792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb415dec0 msgr2=0x7f4fb40cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:25.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.219+0000 7f4fb98aa640 1 --2- 172.21.15.26:0/3123057792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb415dec0 0x7f4fb40cfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.219+0000 7f4fb98aa640 1 -- 172.21.15.26:0/3123057792 >> v1:172.21.15.110:6789/0 conn(0x7f4fb40d2570 legacy=0x7f4fb4161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.219+0000 7f4fb98aa640 1 -- 172.21.15.26:0/3123057792 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb40ce180 con 0x7f4fb40cdc80 2023-10-14T11:15:25.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.219+0000 7f4fba8ac640 1 --2- 172.21.15.26:0/3123057792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb415dec0 0x7f4fb40cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:15:25.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.219+0000 7f4fb98aa640 1 --2- 172.21.15.26:0/3123057792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fb40cdc80 0x7f4fb40cf610 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40097c0 tx=0x7f4fa401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b7b1bfdf0ea75db server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:25.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.219+0000 7f4fb90a9640 1 -- 172.21.15.26:0/3123057792 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa40ad660 con 0x7f4fb40cdc80 2023-10-14T11:15:25.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.219+0000 7f4fb90a9640 1 -- 172.21.15.26:0/3123057792 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa40ad7c0 con 0x7f4fb40cdc80 2023-10-14T11:15:25.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.219+0000 7f4fb90a9640 1 -- 172.21.15.26:0/3123057792 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa40adb50 con 0x7f4fb40cdc80 2023-10-14T11:15:25.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.219+0000 7f4fbc30f640 1 -- 172.21.15.26:0/3123057792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fb40cdc80 msgr2=0x7f4fb40cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.219+0000 7f4fbc30f640 1 --2- 172.21.15.26:0/3123057792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fb40cdc80 0x7f4fb40cf610 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40097c0 tx=0x7f4fa401c450 comp rx=0 tx=0).stop 2023-10-14T11:15:25.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fbc30f640 1 -- 172.21.15.26:0/3123057792 shutdown_connections 2023-10-14T11:15:25.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fbc30f640 1 --2- 172.21.15.26:0/3123057792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb415dec0 0x7f4fb40cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fbc30f640 1 --2- 172.21.15.26:0/3123057792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fb40cdc80 0x7f4fb40cf610 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fbc30f640 1 -- 172.21.15.26:0/3123057792 >> 172.21.15.26:0/3123057792 conn(0x7f4fb40715c0 msgr2=0x7f4fb40719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:25.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fbc30f640 1 -- 172.21.15.26:0/3123057792 shutdown_connections 2023-10-14T11:15:25.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fbc30f640 1 -- 172.21.15.26:0/3123057792 wait complete. 2023-10-14T11:15:25.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fbc30f640 1 Processor -- start 2023-10-14T11:15:25.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fbc30f640 1 -- start start 2023-10-14T11:15:25.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fbc30f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fb40cdc80 0x7f4fb4152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fbc30f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fb40d2570 0x7f4fb414cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fbc30f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb415dec0 0x7f4fb4159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fbc30f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb4152a50 con 0x7f4fb40cdc80 2023-10-14T11:15:25.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fbc30f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb4158a50 con 0x7f4fb40d2570 2023-10-14T11:15:25.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fbc30f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb4158d30 con 0x7f4fb415dec0 2023-10-14T11:15:25.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fba0ab640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fb40cdc80 0x7f4fb4152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fba0ab640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fb40cdc80 0x7f4fb4152510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34850/0 (socket says 172.21.15.26:34850) 2023-10-14T11:15:25.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fba0ab640 1 -- 172.21.15.26:0/4012856262 learned_addr learned my addr 172.21.15.26:0/4012856262 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:25.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fb98aa640 1 --2- 172.21.15.26:0/4012856262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fb40d2570 0x7f4fb414cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fba8ac640 1 --2- 172.21.15.26:0/4012856262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb415dec0 0x7f4fb4159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fba0ab640 1 -- 172.21.15.26:0/4012856262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb415dec0 msgr2=0x7f4fb4159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fba0ab640 1 --2- 172.21.15.26:0/4012856262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb415dec0 0x7f4fb4159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fba0ab640 1 -- 172.21.15.26:0/4012856262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fb40d2570 msgr2=0x7f4fb414cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fba0ab640 1 --2- 172.21.15.26:0/4012856262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fb40d2570 0x7f4fb414cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fba0ab640 1 -- 172.21.15.26:0/4012856262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac009a70 con 0x7f4fb40cdc80 2023-10-14T11:15:25.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fba0ab640 1 --2- 172.21.15.26:0/4012856262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fb40cdc80 0x7f4fb4152510 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f4fb000c4d0 tx=0x7f4fb000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:25.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4faaffd640 1 -- 172.21.15.26:0/4012856262 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0005cf0 con 0x7f4fb40cdc80 2023-10-14T11:15:25.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4faaffd640 1 -- 172.21.15.26:0/4012856262 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb0005e50 con 0x7f4fb40cdc80 2023-10-14T11:15:25.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4faaffd640 1 -- 172.21.15.26:0/4012856262 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb00072d0 con 0x7f4fb40cdc80 2023-10-14T11:15:25.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.223+0000 7f4fbc30f640 1 -- 172.21.15.26:0/4012856262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa4009420 con 0x7f4fb40cdc80 2023-10-14T11:15:25.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.227+0000 7f4fbc30f640 1 -- 172.21.15.26:0/4012856262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb4151d10 con 0x7f4fb40cdc80 2023-10-14T11:15:25.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.227+0000 7f4fbc30f640 1 -- 172.21.15.26:0/4012856262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4fb404e170 con 0x7f4fb40cdc80 2023-10-14T11:15:25.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.227+0000 7f4faaffd640 1 -- 172.21.15.26:0/4012856262 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4fb0007430 con 0x7f4fb40cdc80 2023-10-14T11:15:25.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.227+0000 7f4faaffd640 1 --2- 172.21.15.26:0/4012856262 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4f980664a0 0x7f4f98068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.227+0000 7f4faaffd640 1 -- 172.21.15.26:0/4012856262 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4fb0083210 con 0x7f4fb40cdc80 2023-10-14T11:15:25.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.227+0000 7f4fb98aa640 1 --2- 172.21.15.26:0/4012856262 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4f980664a0 0x7f4f98068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.227+0000 7f4faaffd640 1 --2- 172.21.15.26:0/4012856262 >> [v2:172.21.15.26:6824/1796231477,v1:172.21.15.26:6825/1796231477] conn(0x7f4f9806c7a0 0x7f4f9806ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.227+0000 7f4faaffd640 1 -- 172.21.15.26:0/4012856262 --> [v2:172.21.15.26:6824/1796231477,v1:172.21.15.26:6825/1796231477] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4f9806f2b0 con 0x7f4f9806c7a0 2023-10-14T11:15:25.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.227+0000 7f4faaffd640 1 -- 172.21.15.26:0/4012856262 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fb00857f0 con 0x7f4fb40cdc80 2023-10-14T11:15:25.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.227+0000 7f4fba8ac640 1 --2- 172.21.15.26:0/4012856262 >> [v2:172.21.15.26:6824/1796231477,v1:172.21.15.26:6825/1796231477] conn(0x7f4f9806c7a0 0x7f4f9806ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.227+0000 7f4fb98aa640 1 --2- 172.21.15.26:0/4012856262 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4f980664a0 0x7f4f98068960 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40af000 tx=0x7f4fa4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:25.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.227+0000 7f4fba8ac640 1 --2- 172.21.15.26:0/4012856262 >> [v2:172.21.15.26:6824/1796231477,v1:172.21.15.26:6825/1796231477] conn(0x7f4f9806c7a0 0x7f4f9806ebe0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:25.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.231+0000 7f4faaffd640 1 -- 172.21.15.26:0/4012856262 <== osd.0 v2:172.21.15.26:6824/1796231477 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f4f9806f2b0 con 0x7f4f9806c7a0 2023-10-14T11:15:25.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.243+0000 7f4fbc30f640 1 -- 172.21.15.26:0/4012856262 --> [v2:172.21.15.26:6824/1796231477,v1:172.21.15.26:6825/1796231477] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4fb40cda60 con 0x7f4f9806c7a0 2023-10-14T11:15:25.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.243+0000 7f4faaffd640 1 -- 172.21.15.26:0/4012856262 <== osd.0 v2:172.21.15.26:6824/1796231477 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4fb40cda60 con 0x7f4f9806c7a0 2023-10-14T11:15:25.250 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:15:25.250 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T11:15:25.250 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:15:25.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.243+0000 7f4fbc30f640 1 -- 172.21.15.26:0/4012856262 >> [v2:172.21.15.26:6824/1796231477,v1:172.21.15.26:6825/1796231477] conn(0x7f4f9806c7a0 msgr2=0x7f4f9806ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.243+0000 7f4fbc30f640 1 --2- 172.21.15.26:0/4012856262 >> [v2:172.21.15.26:6824/1796231477,v1:172.21.15.26:6825/1796231477] conn(0x7f4f9806c7a0 0x7f4f9806ebe0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.243+0000 7f4fbc30f640 1 -- 172.21.15.26:0/4012856262 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4f980664a0 msgr2=0x7f4f98068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.243+0000 7f4fbc30f640 1 --2- 172.21.15.26:0/4012856262 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f4f980664a0 0x7f4f98068960 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40af000 tx=0x7f4fa4008040 comp rx=0 tx=0).stop 2023-10-14T11:15:25.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.243+0000 7f4fbc30f640 1 -- 172.21.15.26:0/4012856262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fb40cdc80 msgr2=0x7f4fb4152510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.243+0000 7f4fbc30f640 1 --2- 172.21.15.26:0/4012856262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fb40cdc80 0x7f4fb4152510 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f4fb000c4d0 tx=0x7f4fb000c8d0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.243+0000 7f4fba8ac640 1 -- 172.21.15.26:0/4012856262 reap_dead start 2023-10-14T11:15:25.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.243+0000 7f4fbc30f640 1 -- 172.21.15.26:0/4012856262 shutdown_connections 2023-10-14T11:15:25.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.243+0000 7f4fbc30f640 1 -- 172.21.15.26:0/4012856262 >> 172.21.15.26:0/4012856262 conn(0x7f4fb40715c0 msgr2=0x7f4fb415a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:25.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.243+0000 7f4fbc30f640 1 -- 172.21.15.26:0/4012856262 shutdown_connections 2023-10-14T11:15:25.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.243+0000 7f4fbc30f640 1 -- 172.21.15.26:0/4012856262 wait complete. 2023-10-14T11:15:25.268 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-14T11:15:25.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa3196640 1 Processor -- start 2023-10-14T11:15:25.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa3196640 1 -- start start 2023-10-14T11:15:25.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa3196640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcf9c15c910 0x7fcf9c0d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa3196640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf9c0d3170 0x7fcf9c0cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa3196640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9c0ce730 con 0x7fcf9c0cefe0 2023-10-14T11:15:25.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa3196640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9c0d17a0 con 0x7fcf9c15c910 2023-10-14T11:15:25.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa3196640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c0d0dd0 con 0x7fcf9c0d3170 2023-10-14T11:15:25.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa2995640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcf9c0cefe0 0x7fcf9c06b050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52828/0 (socket says 172.21.15.26:52828) 2023-10-14T11:15:25.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa2995640 1 -- 172.21.15.26:0/1559978109 learned_addr learned my addr 172.21.15.26:0/1559978109 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:25.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa2194640 1 --2- 172.21.15.26:0/1559978109 >> v2:172.21.15.110:3300/0 conn(0x7fcf9c15c910 0x7fcf9c0d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa1993640 1 --2- 172.21.15.26:0/1559978109 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf9c0d3170 0x7fcf9c0cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa1192640 1 -- 172.21.15.26:0/1559978109 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403140809 0 0) 0x7fcf9c0ce730 con 0x7fcf9c0cefe0 2023-10-14T11:15:25.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa1192640 1 -- 172.21.15.26:0/1559978109 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf88003530 con 0x7fcf9c0cefe0 2023-10-14T11:15:25.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa1192640 1 -- 172.21.15.26:0/1559978109 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4261033723 0 0) 0x7fcf88003530 con 0x7fcf9c0cefe0 2023-10-14T11:15:25.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa1192640 1 -- 172.21.15.26:0/1559978109 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf9c0d3170 msgr2=0x7fcf9c0cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:25.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa1192640 1 --2- 172.21.15.26:0/1559978109 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf9c0d3170 0x7fcf9c0cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa1192640 1 -- 172.21.15.26:0/1559978109 >> v2:172.21.15.110:3300/0 conn(0x7fcf9c15c910 msgr2=0x7fcf9c0d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:25.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa1192640 1 --2- 172.21.15.26:0/1559978109 >> v2:172.21.15.110:3300/0 conn(0x7fcf9c15c910 0x7fcf9c0d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa1192640 1 -- 172.21.15.26:0/1559978109 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c0d04a0 con 0x7fcf9c0cefe0 2023-10-14T11:15:25.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa1192640 1 -- 172.21.15.26:0/1559978109 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7fcf94001a00 con 0x7fcf9c0cefe0 2023-10-14T11:15:25.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa2194640 1 --2- 172.21.15.26:0/1559978109 >> v2:172.21.15.110:3300/0 conn(0x7fcf9c15c910 0x7fcf9c0d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:15:25.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa1192640 1 -- 172.21.15.26:0/1559978109 >> v1:172.21.15.26:6789/0 conn(0x7fcf9c0cefe0 legacy=0x7fcf9c06b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa1192640 1 --2- 172.21.15.26:0/1559978109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf88003a60 0x7fcf88003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa1192640 1 --2- 172.21.15.26:0/1559978109 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf9c0d3170 0x7fcf880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa1192640 1 --2- 172.21.15.26:0/1559978109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf88004d10 0x7fcf88005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa1192640 1 -- 172.21.15.26:0/1559978109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c0d17a0 con 0x7fcf88003a60 2023-10-14T11:15:25.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa1192640 1 -- 172.21.15.26:0/1559978109 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c0d0dd0 con 0x7fcf88004d10 2023-10-14T11:15:25.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa1192640 1 -- 172.21.15.26:0/1559978109 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8800ba60 con 0x7fcf9c0d3170 2023-10-14T11:15:25.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.407+0000 7fcfa2194640 1 --2- 172.21.15.26:0/1559978109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf88003a60 0x7fcf88003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.411+0000 7fcfa2995640 1 --2- 172.21.15.26:0/1559978109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf88004d10 0x7fcf88005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.411+0000 7fcfa1993640 1 --2- 172.21.15.26:0/1559978109 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf9c0d3170 0x7fcf880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.411+0000 7fcfa2194640 1 -- 172.21.15.26:0/1559978109 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf9c0d3170 msgr2=0x7fcf880047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:25.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.411+0000 7fcfa2194640 1 --2- 172.21.15.26:0/1559978109 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf9c0d3170 0x7fcf880047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.411+0000 7fcfa2194640 1 -- 172.21.15.26:0/1559978109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf88004d10 msgr2=0x7fcf88005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:25.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.411+0000 7fcfa2194640 1 --2- 172.21.15.26:0/1559978109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf88004d10 0x7fcf88005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.411+0000 7fcfa2194640 1 -- 172.21.15.26:0/1559978109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf88003530 con 0x7fcf88003a60 2023-10-14T11:15:25.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.411+0000 7fcfa2194640 1 --2- 172.21.15.26:0/1559978109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf88003a60 0x7fcf88003e80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fcf98009c90 tx=0x7fcf9801cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34ba29b081516e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:25.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.411+0000 7fcfa1192640 1 -- 172.21.15.26:0/1559978109 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf980a5800 con 0x7fcf88003a60 2023-10-14T11:15:25.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.411+0000 7fcfa1192640 1 -- 172.21.15.26:0/1559978109 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf980a5960 con 0x7fcf88003a60 2023-10-14T11:15:25.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.411+0000 7fcfa1192640 1 -- 172.21.15.26:0/1559978109 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf980a5d10 con 0x7fcf88003a60 2023-10-14T11:15:25.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.411+0000 7fcfa3196640 1 -- 172.21.15.26:0/1559978109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf88003a60 msgr2=0x7fcf88003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.411+0000 7fcfa3196640 1 --2- 172.21.15.26:0/1559978109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf88003a60 0x7fcf88003e80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fcf98009c90 tx=0x7fcf9801cb60 comp rx=0 tx=0).stop 2023-10-14T11:15:25.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.411+0000 7fcfa2995640 1 -- 172.21.15.26:0/1559978109 reap_dead start 2023-10-14T11:15:25.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa3196640 1 -- 172.21.15.26:0/1559978109 shutdown_connections 2023-10-14T11:15:25.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa3196640 1 -- 172.21.15.26:0/1559978109 >> 172.21.15.26:0/1559978109 conn(0x7fcf9c09bb50 msgr2=0x7fcf9c0d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:25.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa3196640 1 -- 172.21.15.26:0/1559978109 shutdown_connections 2023-10-14T11:15:25.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa3196640 1 -- 172.21.15.26:0/1559978109 wait complete. 2023-10-14T11:15:25.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa3196640 1 Processor -- start 2023-10-14T11:15:25.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa3196640 1 -- start start 2023-10-14T11:15:25.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa3196640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf88003a60 0x7fcf9c158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa3196640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf9c0b5cb0 0x7fcf9c0c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa3196640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf9c0c9db0 0x7fcf9c0b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa3196640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c159200 con 0x7fcf88003a60 2023-10-14T11:15:25.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa3196640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c15e260 con 0x7fcf9c0b5cb0 2023-10-14T11:15:25.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa3196640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c15e540 con 0x7fcf9c0c9db0 2023-10-14T11:15:25.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa2194640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf88003a60 0x7fcf9c158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa2194640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf88003a60 0x7fcf9c158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34860/0 (socket says 172.21.15.26:34860) 2023-10-14T11:15:25.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa2194640 1 -- 172.21.15.26:0/2388196042 learned_addr learned my addr 172.21.15.26:0/2388196042 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:25.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa2995640 1 --2- 172.21.15.26:0/2388196042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf9c0c9db0 0x7fcf9c0b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa1993640 1 --2- 172.21.15.26:0/2388196042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf9c0b5cb0 0x7fcf9c0c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa2194640 1 -- 172.21.15.26:0/2388196042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf9c0c9db0 msgr2=0x7fcf9c0b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa2194640 1 --2- 172.21.15.26:0/2388196042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf9c0c9db0 0x7fcf9c0b1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa2194640 1 -- 172.21.15.26:0/2388196042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf9c0b5cb0 msgr2=0x7fcf9c0c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa2194640 1 --2- 172.21.15.26:0/2388196042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf9c0b5cb0 0x7fcf9c0c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa2194640 1 -- 172.21.15.26:0/2388196042 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c15e820 con 0x7fcf88003a60 2023-10-14T11:15:25.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa2995640 1 --2- 172.21.15.26:0/2388196042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf9c0c9db0 0x7fcf9c0b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:25.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.415+0000 7fcfa2194640 1 --2- 172.21.15.26:0/2388196042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf88003a60 0x7fcf9c158690 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fcf98009bb0 tx=0x7fcf88005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:25.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.419+0000 7fcf92ffd640 1 -- 172.21.15.26:0/2388196042 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98004020 con 0x7fcf88003a60 2023-10-14T11:15:25.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.419+0000 7fcf92ffd640 1 -- 172.21.15.26:0/2388196042 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf98004180 con 0x7fcf88003a60 2023-10-14T11:15:25.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.419+0000 7fcf92ffd640 1 -- 172.21.15.26:0/2388196042 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98003620 con 0x7fcf88003a60 2023-10-14T11:15:25.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.419+0000 7fcfa3196640 1 -- 172.21.15.26:0/2388196042 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf9c15eb00 con 0x7fcf88003a60 2023-10-14T11:15:25.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.419+0000 7fcfa3196640 1 -- 172.21.15.26:0/2388196042 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9c158bd0 con 0x7fcf88003a60 2023-10-14T11:15:25.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.419+0000 7fcfa3196640 1 -- 172.21.15.26:0/2388196042 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf9c159190 con 0x7fcf88003a60 2023-10-14T11:15:25.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.419+0000 7fcf92ffd640 1 -- 172.21.15.26:0/2388196042 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcf980b4040 con 0x7fcf88003a60 2023-10-14T11:15:25.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.419+0000 7fcf92ffd640 1 --2- 172.21.15.26:0/2388196042 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcf800664a0 0x7fcf80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.419+0000 7fcf92ffd640 1 -- 172.21.15.26:0/2388196042 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fcf9811def0 con 0x7fcf88003a60 2023-10-14T11:15:25.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.419+0000 7fcfa1993640 1 --2- 172.21.15.26:0/2388196042 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcf800664a0 0x7fcf80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.419+0000 7fcfa1993640 1 --2- 172.21.15.26:0/2388196042 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcf800664a0 0x7fcf80068960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0b3150 tx=0x7fcf8c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:25.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.423+0000 7fcf92ffd640 1 -- 172.21.15.26:0/2388196042 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcf980eb520 con 0x7fcf88003a60 2023-10-14T11:15:25.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.579+0000 7fcfa3196640 1 -- 172.21.15.26:0/2388196042 --> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf9c06bb70 con 0x7fcf800664a0 2023-10-14T11:15:25.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.579+0000 7fcf92ffd640 1 -- 172.21.15.26:0/2388196042 <== mgr.4101 v2:172.21.15.26:6832/4136446821 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcf8c009790 con 0x7fcf800664a0 2023-10-14T11:15:25.588 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 0 to deep-scrub 2023-10-14T11:15:25.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.583+0000 7fcfa3196640 1 -- 172.21.15.26:0/2388196042 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcf800664a0 msgr2=0x7fcf80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.583+0000 7fcfa3196640 1 --2- 172.21.15.26:0/2388196042 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcf800664a0 0x7fcf80068960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0b3150 tx=0x7fcf8c008040 comp rx=0 tx=0).stop 2023-10-14T11:15:25.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.583+0000 7fcfa3196640 1 -- 172.21.15.26:0/2388196042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf88003a60 msgr2=0x7fcf9c158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.583+0000 7fcfa3196640 1 --2- 172.21.15.26:0/2388196042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf88003a60 0x7fcf9c158690 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fcf98009bb0 tx=0x7fcf88005800 comp rx=0 tx=0).stop 2023-10-14T11:15:25.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.583+0000 7fcfa3196640 1 -- 172.21.15.26:0/2388196042 shutdown_connections 2023-10-14T11:15:25.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.583+0000 7fcfa3196640 1 --2- 172.21.15.26:0/2388196042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf9c0c9db0 0x7fcf9c0b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.583+0000 7fcfa3196640 1 --2- 172.21.15.26:0/2388196042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf9c0b5cb0 0x7fcf9c0c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.583+0000 7fcfa3196640 1 --2- 172.21.15.26:0/2388196042 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcf800664a0 0x7fcf80068960 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.583+0000 7fcfa3196640 1 --2- 172.21.15.26:0/2388196042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf88003a60 0x7fcf9c158690 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.583+0000 7fcfa3196640 1 -- 172.21.15.26:0/2388196042 >> 172.21.15.26:0/2388196042 conn(0x7fcf9c09bb50 msgr2=0x7fcf9c160430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:25.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.583+0000 7fcfa3196640 1 -- 172.21.15.26:0/2388196042 shutdown_connections 2023-10-14T11:15:25.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.583+0000 7fcfa3196640 1 -- 172.21.15.26:0/2388196042 wait complete. 2023-10-14T11:15:25.609 INFO:tasks.ceph:Scrubbing osd.1 2023-10-14T11:15:25.609 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-14T11:15:25.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.751+0000 7f24ae432640 1 Processor -- start 2023-10-14T11:15:25.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.751+0000 7f24ae432640 1 -- start start 2023-10-14T11:15:25.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.751+0000 7f24ae432640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24a80cef30 0x7f24a80b1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.751+0000 7f24ae432640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f24a80b1680 0x7f24a80cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.751+0000 7f24ae432640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a80b2510 con 0x7f24a8159830 2023-10-14T11:15:25.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.751+0000 7f24ae432640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a80cf390 con 0x7f24a80b1680 2023-10-14T11:15:25.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.751+0000 7f24ae432640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80b1b10 con 0x7f24a80cef30 2023-10-14T11:15:25.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.751+0000 7f24ac9cf640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f24a80b1680 0x7f24a80cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.751+0000 7f24a7fff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f24a8159830 0x7f24a8071ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:45730/0 (socket says 172.21.15.26:45730) 2023-10-14T11:15:25.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.751+0000 7f24a7fff640 1 -- 172.21.15.26:0/3240853840 learned_addr learned my addr 172.21.15.26:0/3240853840 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:25.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.751+0000 7f24a77fe640 1 --2- 172.21.15.26:0/3240853840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24a80cef30 0x7f24a80b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.751+0000 7f24a6ffd640 1 -- 172.21.15.26:0/3240853840 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 263500558 0 0) 0x7f24a80b2510 con 0x7f24a8159830 2023-10-14T11:15:25.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.751+0000 7f24a77fe640 1 -- 172.21.15.26:0/3240853840 >> v2:172.21.15.26:3300/0 conn(0x7f24a80b1680 msgr2=0x7f24a80cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:25.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.751+0000 7f24a77fe640 1 --2- 172.21.15.26:0/3240853840 >> v2:172.21.15.26:3300/0 conn(0x7f24a80b1680 0x7f24a80cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.751+0000 7f24a77fe640 1 -- 172.21.15.26:0/3240853840 >> v1:172.21.15.110:6789/0 conn(0x7f24a8159830 legacy=0x7f24a8071ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.751+0000 7f24a77fe640 1 -- 172.21.15.26:0/3240853840 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a806e020 con 0x7f24a80cef30 2023-10-14T11:15:25.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.751+0000 7f24ac9cf640 1 --2- 172.21.15.26:0/3240853840 >> v2:172.21.15.26:3300/0 conn(0x7f24a80b1680 0x7f24a80cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:15:25.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.755+0000 7f24a77fe640 1 --2- 172.21.15.26:0/3240853840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24a80cef30 0x7f24a80b1140 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f249c0097c0 tx=0x7f249c01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba5ae9f6e403d2be server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:25.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.755+0000 7f24a6ffd640 1 -- 172.21.15.26:0/3240853840 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c0ab600 con 0x7f24a80cef30 2023-10-14T11:15:25.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.755+0000 7f24a6ffd640 1 -- 172.21.15.26:0/3240853840 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c0a7050 con 0x7f24a80cef30 2023-10-14T11:15:25.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.755+0000 7f24a6ffd640 1 -- 172.21.15.26:0/3240853840 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c0ab980 con 0x7f24a80cef30 2023-10-14T11:15:25.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.755+0000 7f24ae432640 1 -- 172.21.15.26:0/3240853840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24a80cef30 msgr2=0x7f24a80b1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.755+0000 7f24ae432640 1 --2- 172.21.15.26:0/3240853840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24a80cef30 0x7f24a80b1140 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f249c0097c0 tx=0x7f249c01c3f0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.755+0000 7f24ae432640 1 -- 172.21.15.26:0/3240853840 shutdown_connections 2023-10-14T11:15:25.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.755+0000 7f24ae432640 1 --2- 172.21.15.26:0/3240853840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24a80cef30 0x7f24a80b1140 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.755+0000 7f24ae432640 1 --2- 172.21.15.26:0/3240853840 >> v2:172.21.15.26:3300/0 conn(0x7f24a80b1680 0x7f24a80cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.755+0000 7f24ae432640 1 -- 172.21.15.26:0/3240853840 >> 172.21.15.26:0/3240853840 conn(0x7f24a806b5a0 msgr2=0x7f24a80cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:25.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.755+0000 7f24ae432640 1 -- 172.21.15.26:0/3240853840 shutdown_connections 2023-10-14T11:15:25.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.755+0000 7f24ae432640 1 -- 172.21.15.26:0/3240853840 wait complete. 2023-10-14T11:15:25.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24ae432640 1 Processor -- start 2023-10-14T11:15:25.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24ae432640 1 -- start start 2023-10-14T11:15:25.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24ae432640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a80b1680 0x7f24a8162720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24ae432640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24a80cef30 0x7f24a80afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24ae432640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24a8159830 0x7f24a81fc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24ae432640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a8162f70 con 0x7f24a8159830 2023-10-14T11:15:25.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24ae432640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a8163250 con 0x7f24a80b1680 2023-10-14T11:15:25.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24ae432640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a8163530 con 0x7f24a80cef30 2023-10-14T11:15:25.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24ac9cf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24a8159830 0x7f24a81fc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24ac9cf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24a8159830 0x7f24a81fc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34874/0 (socket says 172.21.15.26:34874) 2023-10-14T11:15:25.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24ac9cf640 1 -- 172.21.15.26:0/1440904424 learned_addr learned my addr 172.21.15.26:0/1440904424 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:25.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24a77fe640 1 --2- 172.21.15.26:0/1440904424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24a80cef30 0x7f24a80afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24a7fff640 1 --2- 172.21.15.26:0/1440904424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a80b1680 0x7f24a8162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24ac9cf640 1 -- 172.21.15.26:0/1440904424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24a80cef30 msgr2=0x7f24a80afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24ac9cf640 1 --2- 172.21.15.26:0/1440904424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24a80cef30 0x7f24a80afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24ac9cf640 1 -- 172.21.15.26:0/1440904424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a80b1680 msgr2=0x7f24a8162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24ac9cf640 1 --2- 172.21.15.26:0/1440904424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a80b1680 0x7f24a8162720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24ac9cf640 1 -- 172.21.15.26:0/1440904424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a000bc80 con 0x7f24a8159830 2023-10-14T11:15:25.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24ac9cf640 1 --2- 172.21.15.26:0/1440904424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24a8159830 0x7f24a81fc420 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f24a0007fc0 tx=0x7f24a000e550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:25.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24a4ff9640 1 -- 172.21.15.26:0/1440904424 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a0010040 con 0x7f24a8159830 2023-10-14T11:15:25.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24a4ff9640 1 -- 172.21.15.26:0/1440904424 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a000b2d0 con 0x7f24a8159830 2023-10-14T11:15:25.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24ae432640 1 -- 172.21.15.26:0/1440904424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249c009420 con 0x7f24a8159830 2023-10-14T11:15:25.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24a4ff9640 1 -- 172.21.15.26:0/1440904424 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a0003bf0 con 0x7f24a8159830 2023-10-14T11:15:25.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24ae432640 1 -- 172.21.15.26:0/1440904424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a8163af0 con 0x7f24a8159830 2023-10-14T11:15:25.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.759+0000 7f24ae432640 1 -- 172.21.15.26:0/1440904424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f24a81633c0 con 0x7f24a8159830 2023-10-14T11:15:25.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.763+0000 7f24a4ff9640 1 -- 172.21.15.26:0/1440904424 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f24a0003d50 con 0x7f24a8159830 2023-10-14T11:15:25.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.763+0000 7f24a4ff9640 1 --2- 172.21.15.26:0/1440904424 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f24940664a0 0x7f2494068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.763+0000 7f24a4ff9640 1 -- 172.21.15.26:0/1440904424 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f24a00841e0 con 0x7f24a8159830 2023-10-14T11:15:25.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.763+0000 7f24a7fff640 1 --2- 172.21.15.26:0/1440904424 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f24940664a0 0x7f2494068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.763+0000 7f24a4ff9640 1 --2- 172.21.15.26:0/1440904424 >> [v2:172.21.15.26:6816/3885030983,v1:172.21.15.26:6817/3885030983] conn(0x7f249406c7a0 0x7f249406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.763+0000 7f24a4ff9640 1 -- 172.21.15.26:0/1440904424 --> [v2:172.21.15.26:6816/3885030983,v1:172.21.15.26:6817/3885030983] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f249406f2b0 con 0x7f249406c7a0 2023-10-14T11:15:25.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.763+0000 7f24a4ff9640 1 -- 172.21.15.26:0/1440904424 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24a00867c0 con 0x7f24a8159830 2023-10-14T11:15:25.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.763+0000 7f24a77fe640 1 --2- 172.21.15.26:0/1440904424 >> [v2:172.21.15.26:6816/3885030983,v1:172.21.15.26:6817/3885030983] conn(0x7f249406c7a0 0x7f249406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.763+0000 7f24a7fff640 1 --2- 172.21.15.26:0/1440904424 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f24940664a0 0x7f2494068960 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2498000f70 tx=0x7f2498007df0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:25.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.763+0000 7f24a77fe640 1 --2- 172.21.15.26:0/1440904424 >> [v2:172.21.15.26:6816/3885030983,v1:172.21.15.26:6817/3885030983] conn(0x7f249406c7a0 0x7f249406ebe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:25.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.763+0000 7f24a4ff9640 1 -- 172.21.15.26:0/1440904424 <== osd.1 v2:172.21.15.26:6816/3885030983 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f249406f2b0 con 0x7f249406c7a0 2023-10-14T11:15:25.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.775+0000 7f24ae432640 1 -- 172.21.15.26:0/1440904424 --> [v2:172.21.15.26:6816/3885030983,v1:172.21.15.26:6817/3885030983] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f24a806dcb0 con 0x7f249406c7a0 2023-10-14T11:15:25.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.779+0000 7f24a4ff9640 1 -- 172.21.15.26:0/1440904424 <== osd.1 v2:172.21.15.26:6816/3885030983 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f249c0ab680 con 0x7f249406c7a0 2023-10-14T11:15:25.784 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:15:25.785 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T11:15:25.785 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:15:25.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.779+0000 7f24ae432640 1 -- 172.21.15.26:0/1440904424 >> [v2:172.21.15.26:6816/3885030983,v1:172.21.15.26:6817/3885030983] conn(0x7f249406c7a0 msgr2=0x7f249406ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.779+0000 7f24ae432640 1 --2- 172.21.15.26:0/1440904424 >> [v2:172.21.15.26:6816/3885030983,v1:172.21.15.26:6817/3885030983] conn(0x7f249406c7a0 0x7f249406ebe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.779+0000 7f24ae432640 1 -- 172.21.15.26:0/1440904424 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f24940664a0 msgr2=0x7f2494068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.779+0000 7f24ae432640 1 --2- 172.21.15.26:0/1440904424 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f24940664a0 0x7f2494068960 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2498000f70 tx=0x7f2498007df0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.779+0000 7f24ae432640 1 -- 172.21.15.26:0/1440904424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24a8159830 msgr2=0x7f24a81fc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.779+0000 7f24ae432640 1 --2- 172.21.15.26:0/1440904424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24a8159830 0x7f24a81fc420 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f24a0007fc0 tx=0x7f24a000e550 comp rx=0 tx=0).stop 2023-10-14T11:15:25.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.779+0000 7f24ac9cf640 1 -- 172.21.15.26:0/1440904424 reap_dead start 2023-10-14T11:15:25.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.779+0000 7f24ae432640 1 -- 172.21.15.26:0/1440904424 shutdown_connections 2023-10-14T11:15:25.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.779+0000 7f24ae432640 1 -- 172.21.15.26:0/1440904424 >> 172.21.15.26:0/1440904424 conn(0x7f24a806b5a0 msgr2=0x7f24a8158a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:25.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.779+0000 7f24ae432640 1 -- 172.21.15.26:0/1440904424 shutdown_connections 2023-10-14T11:15:25.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.779+0000 7f24ae432640 1 -- 172.21.15.26:0/1440904424 wait complete. 2023-10-14T11:15:25.803 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-14T11:15:25.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.939+0000 7fca66867640 1 Processor -- start 2023-10-14T11:15:25.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.939+0000 7fca66867640 1 -- start start 2023-10-14T11:15:25.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.943+0000 7fca66867640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fca6015c980 0x7fca6006af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.943+0000 7fca66867640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fca600d1490 0x7fca600b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.943+0000 7fca66867640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca600d3510 con 0x7fca6015cd60 2023-10-14T11:15:25.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.943+0000 7fca66867640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca600cd2b0 con 0x7fca600d1490 2023-10-14T11:15:25.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.943+0000 7fca66867640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca600d2f50 con 0x7fca6015c980 2023-10-14T11:15:25.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.943+0000 7fca66066640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fca600d1490 0x7fca600b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.943+0000 7fca66066640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fca600d1490 0x7fca600b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34886/0 (socket says 172.21.15.26:34886) 2023-10-14T11:15:25.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.943+0000 7fca66066640 1 -- 172.21.15.26:0/1635326681 learned_addr learned my addr 172.21.15.26:0/1635326681 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:25.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.943+0000 7fca65865640 1 --2- 172.21.15.26:0/1635326681 >> v2:172.21.15.110:3300/0 conn(0x7fca6015c980 0x7fca6006af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.943+0000 7fca66066640 1 -- 172.21.15.26:0/1635326681 >> v2:172.21.15.110:3300/0 conn(0x7fca6015c980 msgr2=0x7fca6006af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:25.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.943+0000 7fca66066640 1 --2- 172.21.15.26:0/1635326681 >> v2:172.21.15.110:3300/0 conn(0x7fca6015c980 0x7fca6006af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.943+0000 7fca66066640 1 -- 172.21.15.26:0/1635326681 >> v1:172.21.15.110:6789/0 conn(0x7fca6015cd60 legacy=0x7fca600d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.943+0000 7fca66066640 1 -- 172.21.15.26:0/1635326681 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca600d3230 con 0x7fca600d1490 2023-10-14T11:15:25.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.943+0000 7fca66066640 1 --2- 172.21.15.26:0/1635326681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca600d1490 0x7fca600b1b90 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fca6008b910 tx=0x7fca5801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6b366ec9daf40d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:25.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.947+0000 7fca64863640 1 -- 172.21.15.26:0/1635326681 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca580a57a0 con 0x7fca600d1490 2023-10-14T11:15:25.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.947+0000 7fca64863640 1 -- 172.21.15.26:0/1635326681 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca580a5900 con 0x7fca600d1490 2023-10-14T11:15:25.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.947+0000 7fca64863640 1 -- 172.21.15.26:0/1635326681 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca580a5c90 con 0x7fca600d1490 2023-10-14T11:15:25.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.947+0000 7fca66867640 1 -- 172.21.15.26:0/1635326681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca600d1490 msgr2=0x7fca600b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.947+0000 7fca66867640 1 --2- 172.21.15.26:0/1635326681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca600d1490 0x7fca600b1b90 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fca6008b910 tx=0x7fca5801c9d0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.947+0000 7fca66867640 1 -- 172.21.15.26:0/1635326681 shutdown_connections 2023-10-14T11:15:25.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.947+0000 7fca66867640 1 --2- 172.21.15.26:0/1635326681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca600d1490 0x7fca600b1b90 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.947+0000 7fca66867640 1 --2- 172.21.15.26:0/1635326681 >> v2:172.21.15.110:3300/0 conn(0x7fca6015c980 0x7fca6006af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.947+0000 7fca66867640 1 -- 172.21.15.26:0/1635326681 >> 172.21.15.26:0/1635326681 conn(0x7fca6009ba80 msgr2=0x7fca600d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:25.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.947+0000 7fca66867640 1 -- 172.21.15.26:0/1635326681 shutdown_connections 2023-10-14T11:15:25.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.947+0000 7fca66867640 1 -- 172.21.15.26:0/1635326681 wait complete. 2023-10-14T11:15:25.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.947+0000 7fca66867640 1 Processor -- start 2023-10-14T11:15:25.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.947+0000 7fca66867640 1 -- start start 2023-10-14T11:15:25.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.947+0000 7fca66867640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca600d1490 0x7fca600cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.947+0000 7fca66867640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca6015c980 0x7fca600c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.947+0000 7fca66867640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca6015cd60 0x7fca60155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.947+0000 7fca66867640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6015a3b0 con 0x7fca6015cd60 2023-10-14T11:15:25.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.947+0000 7fca66867640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca600cca40 con 0x7fca6015c980 2023-10-14T11:15:25.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.947+0000 7fca66867640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca60159da0 con 0x7fca600d1490 2023-10-14T11:15:25.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.947+0000 7fca66066640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca6015cd60 0x7fca60155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.951+0000 7fca66066640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca6015cd60 0x7fca60155bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34888/0 (socket says 172.21.15.26:34888) 2023-10-14T11:15:25.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.951+0000 7fca65865640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca600d1490 0x7fca600cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.951+0000 7fca66066640 1 -- 172.21.15.26:0/3398543058 learned_addr learned my addr 172.21.15.26:0/3398543058 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:25.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.951+0000 7fca65064640 1 --2- 172.21.15.26:0/3398543058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca6015c980 0x7fca600c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.951+0000 7fca66066640 1 -- 172.21.15.26:0/3398543058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca600d1490 msgr2=0x7fca600cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.951+0000 7fca66066640 1 --2- 172.21.15.26:0/3398543058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca600d1490 0x7fca600cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.951+0000 7fca66066640 1 -- 172.21.15.26:0/3398543058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca6015c980 msgr2=0x7fca600c9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:25.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.951+0000 7fca66066640 1 --2- 172.21.15.26:0/3398543058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca6015c980 0x7fca600c9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:25.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.951+0000 7fca66066640 1 -- 172.21.15.26:0/3398543058 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca58009b30 con 0x7fca6015cd60 2023-10-14T11:15:25.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.951+0000 7fca66066640 1 --2- 172.21.15.26:0/3398543058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca6015cd60 0x7fca60155bf0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fca580af040 tx=0x7fca58019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:25.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.951+0000 7fca567fc640 1 -- 172.21.15.26:0/3398543058 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca580b8670 con 0x7fca6015cd60 2023-10-14T11:15:25.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.951+0000 7fca567fc640 1 -- 172.21.15.26:0/3398543058 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca580b87d0 con 0x7fca6015cd60 2023-10-14T11:15:25.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.951+0000 7fca567fc640 1 -- 172.21.15.26:0/3398543058 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca580b8b80 con 0x7fca6015cd60 2023-10-14T11:15:25.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.951+0000 7fca66867640 1 -- 172.21.15.26:0/3398543058 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca600cc760 con 0x7fca6015cd60 2023-10-14T11:15:25.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.951+0000 7fca66867640 1 -- 172.21.15.26:0/3398543058 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca600c9f70 con 0x7fca6015cd60 2023-10-14T11:15:25.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.951+0000 7fca66867640 1 -- 172.21.15.26:0/3398543058 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca6015a520 con 0x7fca6015cd60 2023-10-14T11:15:25.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.951+0000 7fca567fc640 1 -- 172.21.15.26:0/3398543058 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fca580b8ce0 con 0x7fca6015cd60 2023-10-14T11:15:25.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.955+0000 7fca567fc640 1 --2- 172.21.15.26:0/3398543058 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fca440664d0 0x7fca44068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:25.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.955+0000 7fca567fc640 1 -- 172.21.15.26:0/3398543058 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fca5811ef30 con 0x7fca6015cd60 2023-10-14T11:15:25.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.955+0000 7fca65865640 1 --2- 172.21.15.26:0/3398543058 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fca440664d0 0x7fca44068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:25.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.955+0000 7fca65865640 1 --2- 172.21.15.26:0/3398543058 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fca440664d0 0x7fca44068990 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fca60160570 tx=0x7fca5c006f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:25.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:25.959+0000 7fca567fc640 1 -- 172.21.15.26:0/3398543058 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fca580ec750 con 0x7fca6015cd60 2023-10-14T11:15:26.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.115+0000 7fca66867640 1 -- 172.21.15.26:0/3398543058 --> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fca600cfc30 con 0x7fca440664d0 2023-10-14T11:15:26.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.115+0000 7fca567fc640 1 -- 172.21.15.26:0/3398543058 <== mgr.4101 v2:172.21.15.26:6832/4136446821 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fca5c011a30 con 0x7fca440664d0 2023-10-14T11:15:26.121 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 1 to deep-scrub 2023-10-14T11:15:26.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.115+0000 7fca66867640 1 -- 172.21.15.26:0/3398543058 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fca440664d0 msgr2=0x7fca44068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:26.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.115+0000 7fca66867640 1 --2- 172.21.15.26:0/3398543058 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fca440664d0 0x7fca44068990 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fca60160570 tx=0x7fca5c006f90 comp rx=0 tx=0).stop 2023-10-14T11:15:26.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.115+0000 7fca66867640 1 -- 172.21.15.26:0/3398543058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca6015cd60 msgr2=0x7fca60155bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:26.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.115+0000 7fca66867640 1 --2- 172.21.15.26:0/3398543058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca6015cd60 0x7fca60155bf0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fca580af040 tx=0x7fca58019770 comp rx=0 tx=0).stop 2023-10-14T11:15:26.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.115+0000 7fca66867640 1 -- 172.21.15.26:0/3398543058 shutdown_connections 2023-10-14T11:15:26.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.115+0000 7fca66867640 1 --2- 172.21.15.26:0/3398543058 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fca440664d0 0x7fca44068990 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.115+0000 7fca66867640 1 --2- 172.21.15.26:0/3398543058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca6015cd60 0x7fca60155bf0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.115+0000 7fca66867640 1 --2- 172.21.15.26:0/3398543058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca6015c980 0x7fca600c9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.115+0000 7fca66867640 1 --2- 172.21.15.26:0/3398543058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca600d1490 0x7fca600cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.115+0000 7fca66867640 1 -- 172.21.15.26:0/3398543058 >> 172.21.15.26:0/3398543058 conn(0x7fca6009ba80 msgr2=0x7fca6006be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:26.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.115+0000 7fca66867640 1 -- 172.21.15.26:0/3398543058 shutdown_connections 2023-10-14T11:15:26.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.115+0000 7fca66867640 1 -- 172.21.15.26:0/3398543058 wait complete. 2023-10-14T11:15:26.142 INFO:tasks.ceph:Scrubbing osd.2 2023-10-14T11:15:26.143 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-14T11:15:26.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.283+0000 7f5865b3e640 1 Processor -- start 2023-10-14T11:15:26.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.283+0000 7f5865b3e640 1 -- start start 2023-10-14T11:15:26.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.283+0000 7f5865b3e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f58600d2570 0x7f5860161210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:26.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.283+0000 7f5865b3e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58600cdc80 0x7f58600cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:26.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.283+0000 7f5865b3e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58600ce460 con 0x7f586015dec0 2023-10-14T11:15:26.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.283+0000 7f5865b3e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58600cd830 con 0x7f58600d2570 2023-10-14T11:15:26.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.283+0000 7f5865b3e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586015da30 con 0x7f58600cdc80 2023-10-14T11:15:26.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.287+0000 7f585f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f58600d2570 0x7f5860161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:26.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.287+0000 7f585f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f58600d2570 0x7f5860161210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34892/0 (socket says 172.21.15.26:34892) 2023-10-14T11:15:26.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.287+0000 7f585f7fe640 1 -- 172.21.15.26:0/1068520453 learned_addr learned my addr 172.21.15.26:0/1068520453 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:26.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.287+0000 7f585effd640 1 --2- 172.21.15.26:0/1068520453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58600cdc80 0x7f58600cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:26.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.287+0000 7f585f7fe640 1 -- 172.21.15.26:0/1068520453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58600cdc80 msgr2=0x7f58600cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:26.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.287+0000 7f585f7fe640 1 --2- 172.21.15.26:0/1068520453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58600cdc80 0x7f58600cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.287+0000 7f585f7fe640 1 -- 172.21.15.26:0/1068520453 >> v1:172.21.15.110:6789/0 conn(0x7f586015dec0 legacy=0x7f58600d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:26.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.287+0000 7f585f7fe640 1 -- 172.21.15.26:0/1068520453 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5860161750 con 0x7f58600d2570 2023-10-14T11:15:26.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.287+0000 7f585f7fe640 1 --2- 172.21.15.26:0/1068520453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58600d2570 0x7f5860161210 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f5850009870 tx=0x7f585001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aaadd18e4897a4c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:26.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.287+0000 7f585e7fc640 1 -- 172.21.15.26:0/1068520453 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58500ab620 con 0x7f58600d2570 2023-10-14T11:15:26.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.287+0000 7f585e7fc640 1 -- 172.21.15.26:0/1068520453 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58500ab780 con 0x7f58600d2570 2023-10-14T11:15:26.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.287+0000 7f585e7fc640 1 -- 172.21.15.26:0/1068520453 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58500abb10 con 0x7f58600d2570 2023-10-14T11:15:26.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.291+0000 7f5865b3e640 1 -- 172.21.15.26:0/1068520453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58600d2570 msgr2=0x7f5860161210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:26.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.291+0000 7f5865b3e640 1 --2- 172.21.15.26:0/1068520453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58600d2570 0x7f5860161210 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f5850009870 tx=0x7f585001c510 comp rx=0 tx=0).stop 2023-10-14T11:15:26.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.291+0000 7f5865b3e640 1 -- 172.21.15.26:0/1068520453 shutdown_connections 2023-10-14T11:15:26.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.291+0000 7f5865b3e640 1 --2- 172.21.15.26:0/1068520453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58600cdc80 0x7f58600cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.291+0000 7f5865b3e640 1 --2- 172.21.15.26:0/1068520453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58600d2570 0x7f5860161210 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.291+0000 7f5865b3e640 1 -- 172.21.15.26:0/1068520453 >> 172.21.15.26:0/1068520453 conn(0x7f58600715c0 msgr2=0x7f58600719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:26.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.291+0000 7f5865b3e640 1 -- 172.21.15.26:0/1068520453 shutdown_connections 2023-10-14T11:15:26.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.291+0000 7f5865b3e640 1 -- 172.21.15.26:0/1068520453 wait complete. 2023-10-14T11:15:26.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.291+0000 7f5865b3e640 1 Processor -- start 2023-10-14T11:15:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.291+0000 7f5865b3e640 1 -- start start 2023-10-14T11:15:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.291+0000 7f5865b3e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58600cdc80 0x7f5860159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.291+0000 7f5865b3e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58600d2570 0x7f586015c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.291+0000 7f5865b3e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f586015dec0 0x7f5860155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.291+0000 7f5865b3e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586015a200 con 0x7f586015dec0 2023-10-14T11:15:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.291+0000 7f5865b3e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5860158c60 con 0x7f58600d2570 2023-10-14T11:15:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.291+0000 7f5865b3e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5860158f40 con 0x7f58600cdc80 2023-10-14T11:15:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.291+0000 7f585ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f586015dec0 0x7f5860155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.291+0000 7f585ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f586015dec0 0x7f5860155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34898/0 (socket says 172.21.15.26:34898) 2023-10-14T11:15:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.291+0000 7f585ffff640 1 -- 172.21.15.26:0/146682740 learned_addr learned my addr 172.21.15.26:0/146682740 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.291+0000 7f585effd640 1 --2- 172.21.15.26:0/146682740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58600d2570 0x7f586015c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:26.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.291+0000 7f585f7fe640 1 --2- 172.21.15.26:0/146682740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58600cdc80 0x7f5860159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:26.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.295+0000 7f585ffff640 1 -- 172.21.15.26:0/146682740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58600cdc80 msgr2=0x7f5860159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:26.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.295+0000 7f585ffff640 1 --2- 172.21.15.26:0/146682740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58600cdc80 0x7f5860159990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.295+0000 7f585ffff640 1 -- 172.21.15.26:0/146682740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58600d2570 msgr2=0x7f586015c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:26.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.295+0000 7f585ffff640 1 --2- 172.21.15.26:0/146682740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58600d2570 0x7f586015c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.295+0000 7f585ffff640 1 -- 172.21.15.26:0/146682740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58500094d0 con 0x7f586015dec0 2023-10-14T11:15:26.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.295+0000 7f585ffff640 1 --2- 172.21.15.26:0/146682740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f586015dec0 0x7f5860155fe0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f585800c730 tx=0x7f585800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:26.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.295+0000 7f5847fff640 1 -- 172.21.15.26:0/146682740 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5858003b80 con 0x7f586015dec0 2023-10-14T11:15:26.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.295+0000 7f5847fff640 1 -- 172.21.15.26:0/146682740 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5858003ce0 con 0x7f586015dec0 2023-10-14T11:15:26.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.295+0000 7f5865b3e640 1 -- 172.21.15.26:0/146682740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5860159220 con 0x7f586015dec0 2023-10-14T11:15:26.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.295+0000 7f5847fff640 1 -- 172.21.15.26:0/146682740 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585800aa30 con 0x7f586015dec0 2023-10-14T11:15:26.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.295+0000 7f5865b3e640 1 -- 172.21.15.26:0/146682740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5860158950 con 0x7f586015dec0 2023-10-14T11:15:26.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.295+0000 7f5865b3e640 1 -- 172.21.15.26:0/146682740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f58600d2950 con 0x7f586015dec0 2023-10-14T11:15:26.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.295+0000 7f5847fff640 1 -- 172.21.15.26:0/146682740 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f585800ab90 con 0x7f586015dec0 2023-10-14T11:15:26.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.295+0000 7f5847fff640 1 --2- 172.21.15.26:0/146682740 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f584c0664a0 0x7f584c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:26.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.295+0000 7f5847fff640 1 -- 172.21.15.26:0/146682740 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f58580839d0 con 0x7f586015dec0 2023-10-14T11:15:26.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.295+0000 7f585f7fe640 1 --2- 172.21.15.26:0/146682740 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f584c0664a0 0x7f584c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:26.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.295+0000 7f5847fff640 1 --2- 172.21.15.26:0/146682740 >> [v2:172.21.15.26:6804/1022580976,v1:172.21.15.26:6807/1022580976] conn(0x7f584c06c7a0 0x7f584c06ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:26.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.295+0000 7f5847fff640 1 -- 172.21.15.26:0/146682740 --> [v2:172.21.15.26:6804/1022580976,v1:172.21.15.26:6807/1022580976] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f584c06f2b0 con 0x7f584c06c7a0 2023-10-14T11:15:26.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.295+0000 7f5847fff640 1 -- 172.21.15.26:0/146682740 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58580882a0 con 0x7f586015dec0 2023-10-14T11:15:26.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.299+0000 7f585effd640 1 --2- 172.21.15.26:0/146682740 >> [v2:172.21.15.26:6804/1022580976,v1:172.21.15.26:6807/1022580976] conn(0x7f584c06c7a0 0x7f584c06ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:26.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.299+0000 7f585f7fe640 1 --2- 172.21.15.26:0/146682740 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f584c0664a0 0x7f584c068960 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f58500af000 tx=0x7f58500b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:26.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.299+0000 7f585effd640 1 --2- 172.21.15.26:0/146682740 >> [v2:172.21.15.26:6804/1022580976,v1:172.21.15.26:6807/1022580976] conn(0x7f584c06c7a0 0x7f584c06ebe0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:26.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.299+0000 7f5847fff640 1 -- 172.21.15.26:0/146682740 <== osd.2 v2:172.21.15.26:6804/1022580976 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f584c06f2b0 con 0x7f584c06c7a0 2023-10-14T11:15:26.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.311+0000 7f5865b3e640 1 -- 172.21.15.26:0/146682740 --> [v2:172.21.15.26:6804/1022580976,v1:172.21.15.26:6807/1022580976] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f58601590b0 con 0x7f584c06c7a0 2023-10-14T11:15:26.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.311+0000 7f5847fff640 1 -- 172.21.15.26:0/146682740 <== osd.2 v2:172.21.15.26:6804/1022580976 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f58601590b0 con 0x7f584c06c7a0 2023-10-14T11:15:26.319 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:15:26.319 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T11:15:26.319 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:15:26.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.311+0000 7f5865b3e640 1 -- 172.21.15.26:0/146682740 >> [v2:172.21.15.26:6804/1022580976,v1:172.21.15.26:6807/1022580976] conn(0x7f584c06c7a0 msgr2=0x7f584c06ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:26.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.311+0000 7f5865b3e640 1 --2- 172.21.15.26:0/146682740 >> [v2:172.21.15.26:6804/1022580976,v1:172.21.15.26:6807/1022580976] conn(0x7f584c06c7a0 0x7f584c06ebe0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.311+0000 7f5865b3e640 1 -- 172.21.15.26:0/146682740 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f584c0664a0 msgr2=0x7f584c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:26.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.311+0000 7f5865b3e640 1 --2- 172.21.15.26:0/146682740 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f584c0664a0 0x7f584c068960 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f58500af000 tx=0x7f58500b6040 comp rx=0 tx=0).stop 2023-10-14T11:15:26.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.311+0000 7f5865b3e640 1 -- 172.21.15.26:0/146682740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f586015dec0 msgr2=0x7f5860155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:26.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.311+0000 7f5865b3e640 1 --2- 172.21.15.26:0/146682740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f586015dec0 0x7f5860155fe0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f585800c730 tx=0x7f585800cbf0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.311+0000 7f585ffff640 1 -- 172.21.15.26:0/146682740 reap_dead start 2023-10-14T11:15:26.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.311+0000 7f5865b3e640 1 -- 172.21.15.26:0/146682740 shutdown_connections 2023-10-14T11:15:26.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.311+0000 7f5865b3e640 1 -- 172.21.15.26:0/146682740 >> 172.21.15.26:0/146682740 conn(0x7f58600715c0 msgr2=0x7f58600d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:26.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.311+0000 7f5865b3e640 1 -- 172.21.15.26:0/146682740 shutdown_connections 2023-10-14T11:15:26.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.311+0000 7f5865b3e640 1 -- 172.21.15.26:0/146682740 wait complete. 2023-10-14T11:15:26.337 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-14T11:15:26.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.475+0000 7f5b8e5f8640 1 Processor -- start 2023-10-14T11:15:26.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.475+0000 7f5b8e5f8640 1 -- start start 2023-10-14T11:15:26.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.475+0000 7f5b8e5f8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5b880b07f0 0x7f5b8815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:26.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.475+0000 7f5b8e5f8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b8815d690 0x7f5b88164490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:26.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.475+0000 7f5b8e5f8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8815be60 con 0x7f5b88070c40 2023-10-14T11:15:26.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.475+0000 7f5b8e5f8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b8815b3b0 con 0x7f5b880b07f0 2023-10-14T11:15:26.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.475+0000 7f5b8e5f8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8815c1f0 con 0x7f5b8815d690 2023-10-14T11:15:26.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.479+0000 7f5b8cb95640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b8815d690 0x7f5b88164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:26.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.479+0000 7f5b877fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5b880b07f0 0x7f5b8815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:26.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.479+0000 7f5b8cb95640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b8815d690 0x7f5b88164490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.26:51720/0 (socket says 172.21.15.26:51720) 2023-10-14T11:15:26.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.479+0000 7f5b8cb95640 1 -- 172.21.15.26:0/3299680146 learned_addr learned my addr 172.21.15.26:0/3299680146 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:26.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.479+0000 7f5b87fff640 1 --1- 172.21.15.26:0/3299680146 >> v1:172.21.15.110:6789/0 conn(0x7f5b88070c40 0x7f5b880b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:45742/0 (socket says 172.21.15.26:45742) 2023-10-14T11:15:26.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.479+0000 7f5b8cb95640 1 -- 172.21.15.26:0/3299680146 >> v2:172.21.15.110:3300/0 conn(0x7f5b880b07f0 msgr2=0x7f5b8815ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:26.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.479+0000 7f5b8cb95640 1 --2- 172.21.15.26:0/3299680146 >> v2:172.21.15.110:3300/0 conn(0x7f5b880b07f0 0x7f5b8815ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.479+0000 7f5b8cb95640 1 -- 172.21.15.26:0/3299680146 >> v1:172.21.15.110:6789/0 conn(0x7f5b88070c40 legacy=0x7f5b880b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:26.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.479+0000 7f5b8cb95640 1 -- 172.21.15.26:0/3299680146 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b88071020 con 0x7f5b8815d690 2023-10-14T11:15:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.479+0000 7f5b8cb95640 1 --2- 172.21.15.26:0/3299680146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b8815d690 0x7f5b88164490 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5b80009e50 tx=0x7f5b8001c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b13035df6383b40c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:26.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.479+0000 7f5b86ffd640 1 -- 172.21.15.26:0/3299680146 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b800a57b0 con 0x7f5b8815d690 2023-10-14T11:15:26.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.479+0000 7f5b86ffd640 1 -- 172.21.15.26:0/3299680146 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b800a5910 con 0x7f5b8815d690 2023-10-14T11:15:26.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.479+0000 7f5b86ffd640 1 -- 172.21.15.26:0/3299680146 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b800a5ca0 con 0x7f5b8815d690 2023-10-14T11:15:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.483+0000 7f5b8e5f8640 1 -- 172.21.15.26:0/3299680146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b8815d690 msgr2=0x7f5b88164490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.483+0000 7f5b8e5f8640 1 --2- 172.21.15.26:0/3299680146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b8815d690 0x7f5b88164490 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5b80009e50 tx=0x7f5b8001c8f0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.483+0000 7f5b8e5f8640 1 -- 172.21.15.26:0/3299680146 shutdown_connections 2023-10-14T11:15:26.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.483+0000 7f5b8e5f8640 1 --2- 172.21.15.26:0/3299680146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b8815d690 0x7f5b88164490 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.483+0000 7f5b8e5f8640 1 --2- 172.21.15.26:0/3299680146 >> v2:172.21.15.110:3300/0 conn(0x7f5b880b07f0 0x7f5b8815ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.483+0000 7f5b8e5f8640 1 -- 172.21.15.26:0/3299680146 >> 172.21.15.26:0/3299680146 conn(0x7f5b8806c190 msgr2=0x7f5b8806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:26.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.483+0000 7f5b8e5f8640 1 -- 172.21.15.26:0/3299680146 shutdown_connections 2023-10-14T11:15:26.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.483+0000 7f5b8e5f8640 1 -- 172.21.15.26:0/3299680146 wait complete. 2023-10-14T11:15:26.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.483+0000 7f5b8e5f8640 1 Processor -- start 2023-10-14T11:15:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.483+0000 7f5b8e5f8640 1 -- start start 2023-10-14T11:15:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.483+0000 7f5b8e5f8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b88070c40 0x7f5b880c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.483+0000 7f5b8e5f8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880b07f0 0x7f5b8814d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:26.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.483+0000 7f5b8e5f8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b8815d690 0x7f5b880b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:26.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.483+0000 7f5b8e5f8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880b2080 con 0x7f5b880b07f0 2023-10-14T11:15:26.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.483+0000 7f5b8e5f8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880b1470 con 0x7f5b8815d690 2023-10-14T11:15:26.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.483+0000 7f5b8e5f8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880b1750 con 0x7f5b88070c40 2023-10-14T11:15:26.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.483+0000 7f5b877fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880b07f0 0x7f5b8814d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:26.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.483+0000 7f5b877fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880b07f0 0x7f5b8814d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34912/0 (socket says 172.21.15.26:34912) 2023-10-14T11:15:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.483+0000 7f5b877fe640 1 -- 172.21.15.26:0/1699991907 learned_addr learned my addr 172.21.15.26:0/1699991907 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.483+0000 7f5b87fff640 1 --2- 172.21.15.26:0/1699991907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b88070c40 0x7f5b880c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.483+0000 7f5b8cb95640 1 --2- 172.21.15.26:0/1699991907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b8815d690 0x7f5b880b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.487+0000 7f5b877fe640 1 -- 172.21.15.26:0/1699991907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b88070c40 msgr2=0x7f5b880c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.487+0000 7f5b877fe640 1 --2- 172.21.15.26:0/1699991907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b88070c40 0x7f5b880c4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.487+0000 7f5b877fe640 1 -- 172.21.15.26:0/1699991907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b8815d690 msgr2=0x7f5b880b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.487+0000 7f5b877fe640 1 --2- 172.21.15.26:0/1699991907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b8815d690 0x7f5b880b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.487+0000 7f5b877fe640 1 -- 172.21.15.26:0/1699991907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b80009b30 con 0x7f5b880b07f0 2023-10-14T11:15:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.487+0000 7f5b8cb95640 1 --2- 172.21.15.26:0/1699991907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b8815d690 0x7f5b880b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.487+0000 7f5b877fe640 1 --2- 172.21.15.26:0/1699991907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880b07f0 0x7f5b8814d8d0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c00e870 tx=0x7f5b7c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.487+0000 7f5b84ff9640 1 -- 172.21.15.26:0/1699991907 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c009510 con 0x7f5b880b07f0 2023-10-14T11:15:26.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.487+0000 7f5b8e5f8640 1 -- 172.21.15.26:0/1699991907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b880b1a30 con 0x7f5b880b07f0 2023-10-14T11:15:26.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.487+0000 7f5b84ff9640 1 -- 172.21.15.26:0/1699991907 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c00eec0 con 0x7f5b880b07f0 2023-10-14T11:15:26.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.487+0000 7f5b84ff9640 1 -- 172.21.15.26:0/1699991907 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c00cb40 con 0x7f5b880b07f0 2023-10-14T11:15:26.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.487+0000 7f5b8e5f8640 1 -- 172.21.15.26:0/1699991907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b8814de10 con 0x7f5b880b07f0 2023-10-14T11:15:26.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.487+0000 7f5b8e5f8640 1 -- 172.21.15.26:0/1699991907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b88074010 con 0x7f5b880b07f0 2023-10-14T11:15:26.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.487+0000 7f5b84ff9640 1 -- 172.21.15.26:0/1699991907 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5b7c00ccc0 con 0x7f5b880b07f0 2023-10-14T11:15:26.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.487+0000 7f5b84ff9640 1 --2- 172.21.15.26:0/1699991907 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5b740664a0 0x7f5b74068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.487+0000 7f5b84ff9640 1 -- 172.21.15.26:0/1699991907 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f5b7c083d80 con 0x7f5b880b07f0 2023-10-14T11:15:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.487+0000 7f5b87fff640 1 --2- 172.21.15.26:0/1699991907 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5b740664a0 0x7f5b74068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.491+0000 7f5b87fff640 1 --2- 172.21.15.26:0/1699991907 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5b740664a0 0x7f5b74068960 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5b78000f70 tx=0x7f5b78007e50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.491+0000 7f5b84ff9640 1 -- 172.21.15.26:0/1699991907 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5b7c0513e0 con 0x7f5b880b07f0 2023-10-14T11:15:26.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.647+0000 7f5b8e5f8640 1 -- 172.21.15.26:0/1699991907 --> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b8815bb80 con 0x7f5b740664a0 2023-10-14T11:15:26.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.651+0000 7f5b84ff9640 1 -- 172.21.15.26:0/1699991907 <== mgr.4101 v2:172.21.15.26:6832/4136446821 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5b78004a70 con 0x7f5b740664a0 2023-10-14T11:15:26.657 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 2 to deep-scrub 2023-10-14T11:15:26.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.651+0000 7f5b8e5f8640 1 -- 172.21.15.26:0/1699991907 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5b740664a0 msgr2=0x7f5b74068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:26.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.651+0000 7f5b8e5f8640 1 --2- 172.21.15.26:0/1699991907 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5b740664a0 0x7f5b74068960 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5b78000f70 tx=0x7f5b78007e50 comp rx=0 tx=0).stop 2023-10-14T11:15:26.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.651+0000 7f5b8e5f8640 1 -- 172.21.15.26:0/1699991907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880b07f0 msgr2=0x7f5b8814d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:26.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.651+0000 7f5b8e5f8640 1 --2- 172.21.15.26:0/1699991907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880b07f0 0x7f5b8814d8d0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c00e870 tx=0x7f5b7c00ec70 comp rx=0 tx=0).stop 2023-10-14T11:15:26.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.651+0000 7f5b8e5f8640 1 -- 172.21.15.26:0/1699991907 shutdown_connections 2023-10-14T11:15:26.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.651+0000 7f5b8e5f8640 1 --2- 172.21.15.26:0/1699991907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b8815d690 0x7f5b880b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.651+0000 7f5b8e5f8640 1 --2- 172.21.15.26:0/1699991907 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f5b740664a0 0x7f5b74068960 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.651+0000 7f5b8e5f8640 1 --2- 172.21.15.26:0/1699991907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880b07f0 0x7f5b8814d8d0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.651+0000 7f5b8e5f8640 1 --2- 172.21.15.26:0/1699991907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b88070c40 0x7f5b880c4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.651+0000 7f5b8e5f8640 1 -- 172.21.15.26:0/1699991907 >> 172.21.15.26:0/1699991907 conn(0x7f5b8806c190 msgr2=0x7f5b880aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:26.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.651+0000 7f5b8e5f8640 1 -- 172.21.15.26:0/1699991907 shutdown_connections 2023-10-14T11:15:26.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.651+0000 7f5b8e5f8640 1 -- 172.21.15.26:0/1699991907 wait complete. 2023-10-14T11:15:26.677 INFO:tasks.ceph:Scrubbing osd.3 2023-10-14T11:15:26.678 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-14T11:15:26.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.819+0000 7f1c6f1ab640 1 Processor -- start 2023-10-14T11:15:26.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.819+0000 7f1c6f1ab640 1 -- start start 2023-10-14T11:15:26.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.819+0000 7f1c6f1ab640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c68153540 0x7f1c680ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:26.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.819+0000 7f1c6f1ab640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c680cb6e0 0x7f1c6815ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:26.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.819+0000 7f1c6f1ab640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c68159510 con 0x7f1c680afaa0 2023-10-14T11:15:26.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.819+0000 7f1c6f1ab640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c68159790 con 0x7f1c68153540 2023-10-14T11:15:26.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.819+0000 7f1c6f1ab640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68159a70 con 0x7f1c680cb6e0 2023-10-14T11:15:26.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.819+0000 7f1c6cf47640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c68153540 0x7f1c680ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:26.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.819+0000 7f1c67fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1c680afaa0 0x7f1c680cafd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52830/0 (socket says 172.21.15.26:52830) 2023-10-14T11:15:26.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.819+0000 7f1c6cf47640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c68153540 0x7f1c680ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34918/0 (socket says 172.21.15.26:34918) 2023-10-14T11:15:26.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.819+0000 7f1c67fff640 1 -- 172.21.15.26:0/1884962130 learned_addr learned my addr 172.21.15.26:0/1884962130 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:26.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.819+0000 7f1c6d748640 1 --2- 172.21.15.26:0/1884962130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c680cb6e0 0x7f1c6815ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:26.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.819+0000 7f1c6cf47640 1 -- 172.21.15.26:0/1884962130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c680cb6e0 msgr2=0x7f1c6815ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:26.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.819+0000 7f1c6cf47640 1 --2- 172.21.15.26:0/1884962130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c680cb6e0 0x7f1c6815ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.819+0000 7f1c6cf47640 1 -- 172.21.15.26:0/1884962130 >> v1:172.21.15.26:6789/0 conn(0x7f1c680afaa0 legacy=0x7f1c680cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:26.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.819+0000 7f1c6cf47640 1 -- 172.21.15.26:0/1884962130 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c68159d50 con 0x7f1c68153540 2023-10-14T11:15:26.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.819+0000 7f1c677fe640 1 -- 172.21.15.26:0/1884962130 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948499551 0 0) 0x7f1c68159510 con 0x7f1c680afaa0 2023-10-14T11:15:26.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.819+0000 7f1c6d748640 1 --2- 172.21.15.26:0/1884962130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c680cb6e0 0x7f1c6815ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:15:26.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.823+0000 7f1c6cf47640 1 --2- 172.21.15.26:0/1884962130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c68153540 0x7f1c680ccdb0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0097c0 tx=0x7f1c5c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0bb862b0c00e24 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:26.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.823+0000 7f1c677fe640 1 -- 172.21.15.26:0/1884962130 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c0ab600 con 0x7f1c68153540 2023-10-14T11:15:26.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.823+0000 7f1c677fe640 1 -- 172.21.15.26:0/1884962130 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c0a7050 con 0x7f1c68153540 2023-10-14T11:15:26.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.823+0000 7f1c677fe640 1 -- 172.21.15.26:0/1884962130 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c0ab980 con 0x7f1c68153540 2023-10-14T11:15:26.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.823+0000 7f1c6f1ab640 1 -- 172.21.15.26:0/1884962130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c68153540 msgr2=0x7f1c680ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:26.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.823+0000 7f1c6f1ab640 1 --2- 172.21.15.26:0/1884962130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c68153540 0x7f1c680ccdb0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0097c0 tx=0x7f1c5c01c3c0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.823+0000 7f1c6f1ab640 1 -- 172.21.15.26:0/1884962130 shutdown_connections 2023-10-14T11:15:26.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.823+0000 7f1c6f1ab640 1 --2- 172.21.15.26:0/1884962130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c680cb6e0 0x7f1c6815ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.823+0000 7f1c6f1ab640 1 --2- 172.21.15.26:0/1884962130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c68153540 0x7f1c680ccdb0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.823+0000 7f1c6f1ab640 1 -- 172.21.15.26:0/1884962130 >> 172.21.15.26:0/1884962130 conn(0x7f1c6806a820 msgr2=0x7f1c680b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:26.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.823+0000 7f1c6f1ab640 1 -- 172.21.15.26:0/1884962130 shutdown_connections 2023-10-14T11:15:26.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.823+0000 7f1c6f1ab640 1 -- 172.21.15.26:0/1884962130 wait complete. 2023-10-14T11:15:26.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c6f1ab640 1 Processor -- start 2023-10-14T11:15:26.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c6f1ab640 1 -- start start 2023-10-14T11:15:26.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c6f1ab640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c680afaa0 0x7f1c6815c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c6f1ab640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c680cb6e0 0x7f1c68145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c6f1ab640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c68153540 0x7f1c68158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c6f1ab640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6815c5c0 con 0x7f1c680cb6e0 2023-10-14T11:15:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c6f1ab640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c680cd4a0 con 0x7f1c68153540 2023-10-14T11:15:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c6f1ab640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68153e40 con 0x7f1c680afaa0 2023-10-14T11:15:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c67fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c680cb6e0 0x7f1c68145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c67fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c680cb6e0 0x7f1c68145ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34930/0 (socket says 172.21.15.26:34930) 2023-10-14T11:15:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c67fff640 1 -- 172.21.15.26:0/360598721 learned_addr learned my addr 172.21.15.26:0/360598721 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c6cf47640 1 --2- 172.21.15.26:0/360598721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c680afaa0 0x7f1c6815c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c6d748640 1 --2- 172.21.15.26:0/360598721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c68153540 0x7f1c68158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c67fff640 1 -- 172.21.15.26:0/360598721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c680afaa0 msgr2=0x7f1c6815c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c67fff640 1 --2- 172.21.15.26:0/360598721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c680afaa0 0x7f1c6815c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c67fff640 1 -- 172.21.15.26:0/360598721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c68153540 msgr2=0x7f1c68158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:26.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c67fff640 1 --2- 172.21.15.26:0/360598721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c68153540 0x7f1c68158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c67fff640 1 -- 172.21.15.26:0/360598721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c009420 con 0x7f1c680cb6e0 2023-10-14T11:15:26.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c6cf47640 1 --2- 172.21.15.26:0/360598721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c680afaa0 0x7f1c6815c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:26.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c67fff640 1 --2- 172.21.15.26:0/360598721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c680cb6e0 0x7f1c68145ac0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1c540011f0 tx=0x7f1c5400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:26.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c657fa640 1 -- 172.21.15.26:0/360598721 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c540074e0 con 0x7f1c680cb6e0 2023-10-14T11:15:26.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c657fa640 1 -- 172.21.15.26:0/360598721 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c54007640 con 0x7f1c680cb6e0 2023-10-14T11:15:26.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c6f1ab640 1 -- 172.21.15.26:0/360598721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c680cce50 con 0x7f1c680cb6e0 2023-10-14T11:15:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c657fa640 1 -- 172.21.15.26:0/360598721 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54004a10 con 0x7f1c680cb6e0 2023-10-14T11:15:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c6f1ab640 1 -- 172.21.15.26:0/360598721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c68146000 con 0x7f1c680cb6e0 2023-10-14T11:15:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.827+0000 7f1c6f1ab640 1 -- 172.21.15.26:0/360598721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c6804e170 con 0x7f1c680cb6e0 2023-10-14T11:15:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.831+0000 7f1c657fa640 1 -- 172.21.15.26:0/360598721 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1c54004b70 con 0x7f1c680cb6e0 2023-10-14T11:15:26.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.831+0000 7f1c657fa640 1 --2- 172.21.15.26:0/360598721 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1c4c0664a0 0x7f1c4c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:26.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.831+0000 7f1c657fa640 1 -- 172.21.15.26:0/360598721 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1c54082e50 con 0x7f1c680cb6e0 2023-10-14T11:15:26.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.831+0000 7f1c6cf47640 1 --2- 172.21.15.26:0/360598721 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1c4c0664a0 0x7f1c4c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:26.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.831+0000 7f1c657fa640 1 --2- 172.21.15.26:0/360598721 >> [v2:172.21.15.26:6800/603797368,v1:172.21.15.26:6801/603797368] conn(0x7f1c4c06c7a0 0x7f1c4c06ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:26.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.831+0000 7f1c657fa640 1 -- 172.21.15.26:0/360598721 --> [v2:172.21.15.26:6800/603797368,v1:172.21.15.26:6801/603797368] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c4c06f2b0 con 0x7f1c4c06c7a0 2023-10-14T11:15:26.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.831+0000 7f1c657fa640 1 -- 172.21.15.26:0/360598721 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c54085430 con 0x7f1c680cb6e0 2023-10-14T11:15:26.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.831+0000 7f1c6d748640 1 --2- 172.21.15.26:0/360598721 >> [v2:172.21.15.26:6800/603797368,v1:172.21.15.26:6801/603797368] conn(0x7f1c4c06c7a0 0x7f1c4c06ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:26.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.831+0000 7f1c6cf47640 1 --2- 172.21.15.26:0/360598721 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1c4c0664a0 0x7f1c4c068960 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1c6806e400 tx=0x7f1c5c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:26.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.831+0000 7f1c6d748640 1 --2- 172.21.15.26:0/360598721 >> [v2:172.21.15.26:6800/603797368,v1:172.21.15.26:6801/603797368] conn(0x7f1c4c06c7a0 0x7f1c4c06ebe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:26.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.831+0000 7f1c657fa640 1 -- 172.21.15.26:0/360598721 <== osd.3 v2:172.21.15.26:6800/603797368 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f1c4c06f2b0 con 0x7f1c4c06c7a0 2023-10-14T11:15:26.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.847+0000 7f1c6f1ab640 1 -- 172.21.15.26:0/360598721 --> [v2:172.21.15.26:6800/603797368,v1:172.21.15.26:6801/603797368] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1c680cc730 con 0x7f1c4c06c7a0 2023-10-14T11:15:26.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.847+0000 7f1c657fa640 1 -- 172.21.15.26:0/360598721 <== osd.3 v2:172.21.15.26:6800/603797368 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1c680cc730 con 0x7f1c4c06c7a0 2023-10-14T11:15:26.853 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:15:26.853 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T11:15:26.853 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:15:26.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.847+0000 7f1c6f1ab640 1 -- 172.21.15.26:0/360598721 >> [v2:172.21.15.26:6800/603797368,v1:172.21.15.26:6801/603797368] conn(0x7f1c4c06c7a0 msgr2=0x7f1c4c06ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:26.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.847+0000 7f1c6f1ab640 1 --2- 172.21.15.26:0/360598721 >> [v2:172.21.15.26:6800/603797368,v1:172.21.15.26:6801/603797368] conn(0x7f1c4c06c7a0 0x7f1c4c06ebe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.847+0000 7f1c6f1ab640 1 -- 172.21.15.26:0/360598721 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1c4c0664a0 msgr2=0x7f1c4c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:26.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.847+0000 7f1c6f1ab640 1 --2- 172.21.15.26:0/360598721 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1c4c0664a0 0x7f1c4c068960 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1c6806e400 tx=0x7f1c5c0a6000 comp rx=0 tx=0).stop 2023-10-14T11:15:26.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.847+0000 7f1c6f1ab640 1 -- 172.21.15.26:0/360598721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c680cb6e0 msgr2=0x7f1c68145ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:26.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.847+0000 7f1c6f1ab640 1 --2- 172.21.15.26:0/360598721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c680cb6e0 0x7f1c68145ac0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1c540011f0 tx=0x7f1c5400c9b0 comp rx=0 tx=0).stop 2023-10-14T11:15:26.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.847+0000 7f1c6d748640 1 -- 172.21.15.26:0/360598721 reap_dead start 2023-10-14T11:15:26.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.847+0000 7f1c6f1ab640 1 -- 172.21.15.26:0/360598721 shutdown_connections 2023-10-14T11:15:26.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.847+0000 7f1c6f1ab640 1 -- 172.21.15.26:0/360598721 >> 172.21.15.26:0/360598721 conn(0x7f1c6806a820 msgr2=0x7f1c68071650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:26.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.847+0000 7f1c6f1ab640 1 -- 172.21.15.26:0/360598721 shutdown_connections 2023-10-14T11:15:26.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:26.847+0000 7f1c6f1ab640 1 -- 172.21.15.26:0/360598721 wait complete. 2023-10-14T11:15:26.872 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-14T11:15:27.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.011+0000 7f4694f65640 1 Processor -- start 2023-10-14T11:15:27.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.011+0000 7f4694f65640 1 -- start start 2023-10-14T11:15:27.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.015+0000 7f4694f65640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4690070c40 0x7f469015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.015+0000 7f4694f65640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46900b07f0 0x7f4690164490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.015+0000 7f4694f65640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469015be60 con 0x7f46900b4020 2023-10-14T11:15:27.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.015+0000 7f4694f65640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469015b3b0 con 0x7f4690070c40 2023-10-14T11:15:27.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.015+0000 7f4694f65640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469015c1f0 con 0x7f46900b07f0 2023-10-14T11:15:27.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.015+0000 7f468ed9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46900b07f0 0x7f4690164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.015+0000 7f4687fff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f46900b4020 0x7f46900b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.26:45754/0 (socket says 172.21.15.26:45754) 2023-10-14T11:15:27.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.015+0000 7f468e59c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4690070c40 0x7f469015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.015+0000 7f4687fff640 1 -- 172.21.15.26:0/2527998280 learned_addr learned my addr 172.21.15.26:0/2527998280 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:27.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.015+0000 7f468dd9b640 1 -- 172.21.15.26:0/2527998280 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3842513961 0 0) 0x7f469015be60 con 0x7f46900b4020 2023-10-14T11:15:27.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.015+0000 7f468dd9b640 1 -- 172.21.15.26:0/2527998280 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f467c003530 con 0x7f46900b4020 2023-10-14T11:15:27.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.015+0000 7f468ed9d640 1 -- 172.21.15.26:0/2527998280 >> v2:172.21.15.110:3300/0 conn(0x7f4690070c40 msgr2=0x7f469015ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:27.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.015+0000 7f468ed9d640 1 --2- 172.21.15.26:0/2527998280 >> v2:172.21.15.110:3300/0 conn(0x7f4690070c40 0x7f469015ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.015+0000 7f468ed9d640 1 -- 172.21.15.26:0/2527998280 >> v1:172.21.15.110:6789/0 conn(0x7f46900b4020 legacy=0x7f46900b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.015+0000 7f468ed9d640 1 -- 172.21.15.26:0/2527998280 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4690071020 con 0x7f46900b07f0 2023-10-14T11:15:27.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.015+0000 7f468e59c640 1 --2- 172.21.15.26:0/2527998280 >> v2:172.21.15.110:3300/0 conn(0x7f4690070c40 0x7f469015ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:15:27.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.019+0000 7f468ed9d640 1 --2- 172.21.15.26:0/2527998280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46900b07f0 0x7f4690164490 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4688009d90 tx=0x7f468801c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb67120d8a0b8188 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:27.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.019+0000 7f468dd9b640 1 -- 172.21.15.26:0/2527998280 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46880a5980 con 0x7f46900b07f0 2023-10-14T11:15:27.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.019+0000 7f468dd9b640 1 -- 172.21.15.26:0/2527998280 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46880a5ae0 con 0x7f46900b07f0 2023-10-14T11:15:27.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.019+0000 7f468dd9b640 1 -- 172.21.15.26:0/2527998280 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46880a5e70 con 0x7f46900b07f0 2023-10-14T11:15:27.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.019+0000 7f4694f65640 1 -- 172.21.15.26:0/2527998280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46900b07f0 msgr2=0x7f4690164490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.019+0000 7f4694f65640 1 --2- 172.21.15.26:0/2527998280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46900b07f0 0x7f4690164490 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4688009d90 tx=0x7f468801c8c0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.019+0000 7f4694f65640 1 -- 172.21.15.26:0/2527998280 shutdown_connections 2023-10-14T11:15:27.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.019+0000 7f4694f65640 1 --2- 172.21.15.26:0/2527998280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46900b07f0 0x7f4690164490 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.019+0000 7f4694f65640 1 --2- 172.21.15.26:0/2527998280 >> v2:172.21.15.110:3300/0 conn(0x7f4690070c40 0x7f469015ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.019+0000 7f4694f65640 1 -- 172.21.15.26:0/2527998280 >> 172.21.15.26:0/2527998280 conn(0x7f469006c190 msgr2=0x7f469006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:27.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.019+0000 7f4694f65640 1 -- 172.21.15.26:0/2527998280 shutdown_connections 2023-10-14T11:15:27.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.019+0000 7f4694f65640 1 -- 172.21.15.26:0/2527998280 wait complete. 2023-10-14T11:15:27.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.019+0000 7f4694f65640 1 Processor -- start 2023-10-14T11:15:27.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.019+0000 7f4694f65640 1 -- start start 2023-10-14T11:15:27.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f4694f65640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4690070c40 0x7f46900c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f4694f65640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46900b07f0 0x7f46901f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f4694f65640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46900b4020 0x7f46900cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f4694f65640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46900adff0 con 0x7f4690070c40 2023-10-14T11:15:27.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f4694f65640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46900ae890 con 0x7f46900b07f0 2023-10-14T11:15:27.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f4694f65640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46900ade10 con 0x7f46900b4020 2023-10-14T11:15:27.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f468e59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4690070c40 0x7f46900c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f468e59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4690070c40 0x7f46900c41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34942/0 (socket says 172.21.15.26:34942) 2023-10-14T11:15:27.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f468e59c640 1 -- 172.21.15.26:0/1146348231 learned_addr learned my addr 172.21.15.26:0/1146348231 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:27.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f4687fff640 1 --2- 172.21.15.26:0/1146348231 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46900b07f0 0x7f46901f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f468ed9d640 1 --2- 172.21.15.26:0/1146348231 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46900b4020 0x7f46900cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f468e59c640 1 -- 172.21.15.26:0/1146348231 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46900b4020 msgr2=0x7f46900cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f468e59c640 1 --2- 172.21.15.26:0/1146348231 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46900b4020 0x7f46900cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f468e59c640 1 -- 172.21.15.26:0/1146348231 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46900b07f0 msgr2=0x7f46901f47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f468e59c640 1 --2- 172.21.15.26:0/1146348231 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46900b07f0 0x7f46901f47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f468e59c640 1 -- 172.21.15.26:0/1146348231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4680009420 con 0x7f4690070c40 2023-10-14T11:15:27.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f468e59c640 1 --2- 172.21.15.26:0/1146348231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4690070c40 0x7f46900c41e0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f468000ec10 tx=0x7f468000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:27.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f4686ffd640 1 -- 172.21.15.26:0/1146348231 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468000cc30 con 0x7f4690070c40 2023-10-14T11:15:27.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f4686ffd640 1 -- 172.21.15.26:0/1146348231 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468000cd90 con 0x7f4690070c40 2023-10-14T11:15:27.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f4694f65640 1 -- 172.21.15.26:0/1146348231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4688009a70 con 0x7f4690070c40 2023-10-14T11:15:27.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f4686ffd640 1 -- 172.21.15.26:0/1146348231 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4680013690 con 0x7f4690070c40 2023-10-14T11:15:27.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f4694f65640 1 -- 172.21.15.26:0/1146348231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46901f4ce0 con 0x7f4690070c40 2023-10-14T11:15:27.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f4694f65640 1 -- 172.21.15.26:0/1146348231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4690074010 con 0x7f4690070c40 2023-10-14T11:15:27.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.023+0000 7f4686ffd640 1 -- 172.21.15.26:0/1146348231 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f46800137f0 con 0x7f4690070c40 2023-10-14T11:15:27.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.027+0000 7f4686ffd640 1 --2- 172.21.15.26:0/1146348231 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f46700664a0 0x7f4670068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.027+0000 7f4686ffd640 1 -- 172.21.15.26:0/1146348231 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4680083fc0 con 0x7f4690070c40 2023-10-14T11:15:27.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.027+0000 7f4687fff640 1 --2- 172.21.15.26:0/1146348231 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f46700664a0 0x7f4670068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.027+0000 7f4687fff640 1 --2- 172.21.15.26:0/1146348231 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f46700664a0 0x7f4670068960 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f46900cdc00 tx=0x7f4678009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:27.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.031+0000 7f4686ffd640 1 -- 172.21.15.26:0/1146348231 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f46800b5090 con 0x7f4690070c40 2023-10-14T11:15:27.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.187+0000 7f4694f65640 1 -- 172.21.15.26:0/1146348231 --> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f469015bb80 con 0x7f46700664a0 2023-10-14T11:15:27.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.187+0000 7f4686ffd640 1 -- 172.21.15.26:0/1146348231 <== mgr.4101 v2:172.21.15.26:6832/4136446821 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f46780013f0 con 0x7f46700664a0 2023-10-14T11:15:27.195 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 3 to deep-scrub 2023-10-14T11:15:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.191+0000 7f4694f65640 1 -- 172.21.15.26:0/1146348231 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f46700664a0 msgr2=0x7f4670068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.191+0000 7f4694f65640 1 --2- 172.21.15.26:0/1146348231 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f46700664a0 0x7f4670068960 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f46900cdc00 tx=0x7f4678009040 comp rx=0 tx=0).stop 2023-10-14T11:15:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.191+0000 7f4694f65640 1 -- 172.21.15.26:0/1146348231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4690070c40 msgr2=0x7f46900c41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.191+0000 7f4694f65640 1 --2- 172.21.15.26:0/1146348231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4690070c40 0x7f46900c41e0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f468000ec10 tx=0x7f468000c520 comp rx=0 tx=0).stop 2023-10-14T11:15:27.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.191+0000 7f4694f65640 1 -- 172.21.15.26:0/1146348231 shutdown_connections 2023-10-14T11:15:27.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.191+0000 7f4694f65640 1 --2- 172.21.15.26:0/1146348231 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46900b4020 0x7f46900cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.191+0000 7f4694f65640 1 --2- 172.21.15.26:0/1146348231 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46900b07f0 0x7f46901f47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.191+0000 7f4694f65640 1 --2- 172.21.15.26:0/1146348231 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f46700664a0 0x7f4670068960 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.191+0000 7f4694f65640 1 --2- 172.21.15.26:0/1146348231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4690070c40 0x7f46900c41e0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.191+0000 7f4694f65640 1 -- 172.21.15.26:0/1146348231 >> 172.21.15.26:0/1146348231 conn(0x7f469006c190 msgr2=0x7f4690150850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:27.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.191+0000 7f4694f65640 1 -- 172.21.15.26:0/1146348231 shutdown_connections 2023-10-14T11:15:27.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.191+0000 7f4694f65640 1 -- 172.21.15.26:0/1146348231 wait complete. 2023-10-14T11:15:27.215 INFO:tasks.ceph:Scrubbing osd.4 2023-10-14T11:15:27.216 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-14T11:15:27.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.355+0000 7f3dfca54640 1 Processor -- start 2023-10-14T11:15:27.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.355+0000 7f3dfca54640 1 -- start start 2023-10-14T11:15:27.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3dfca54640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3df80cdc80 0x7f3df80cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3dfca54640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3df815dec0 0x7f3df80cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3dfca54640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df80ce460 con 0x7f3df80d2570 2023-10-14T11:15:27.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3dfca54640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df80cd830 con 0x7f3df80cdc80 2023-10-14T11:15:27.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3dfca54640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df815da30 con 0x7f3df815dec0 2023-10-14T11:15:27.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3df659c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3df80d2570 0x7f3df8161210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52846/0 (socket says 172.21.15.26:52846) 2023-10-14T11:15:27.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3df659c640 1 -- 172.21.15.26:0/2020660988 learned_addr learned my addr 172.21.15.26:0/2020660988 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:27.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3df6d9d640 1 --2- 172.21.15.26:0/2020660988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3df815dec0 0x7f3df80cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3deffff640 1 --2- 172.21.15.26:0/2020660988 >> v2:172.21.15.110:3300/0 conn(0x7f3df80cdc80 0x7f3df80cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3df5d9b640 1 -- 172.21.15.26:0/2020660988 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615811754 0 0) 0x7f3df80ce460 con 0x7f3df80d2570 2023-10-14T11:15:27.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3df5d9b640 1 -- 172.21.15.26:0/2020660988 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3de4003530 con 0x7f3df80d2570 2023-10-14T11:15:27.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3df5d9b640 1 -- 172.21.15.26:0/2020660988 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3998524353 0 0) 0x7f3de4003530 con 0x7f3df80d2570 2023-10-14T11:15:27.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3df5d9b640 1 -- 172.21.15.26:0/2020660988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3df815dec0 msgr2=0x7f3df80cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:27.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3df5d9b640 1 --2- 172.21.15.26:0/2020660988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3df815dec0 0x7f3df80cfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3df5d9b640 1 -- 172.21.15.26:0/2020660988 >> v2:172.21.15.110:3300/0 conn(0x7f3df80cdc80 msgr2=0x7f3df80cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:27.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3df5d9b640 1 --2- 172.21.15.26:0/2020660988 >> v2:172.21.15.110:3300/0 conn(0x7f3df80cdc80 0x7f3df80cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3df5d9b640 1 -- 172.21.15.26:0/2020660988 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df80ce180 con 0x7f3df80d2570 2023-10-14T11:15:27.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3df5d9b640 1 -- 172.21.15.26:0/2020660988 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2997802559 0 0) 0x7f3de8001680 con 0x7f3df80d2570 2023-10-14T11:15:27.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3df5d9b640 1 -- 172.21.15.26:0/2020660988 >> v1:172.21.15.26:6789/0 conn(0x7f3df80d2570 legacy=0x7f3df8161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3df5d9b640 1 --2- 172.21.15.26:0/2020660988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3de4003980 0x7f3de4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3df5d9b640 1 --2- 172.21.15.26:0/2020660988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3de4004370 0x7f3de4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3df5d9b640 1 --2- 172.21.15.26:0/2020660988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de4004ec0 0x7f3de400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3df5d9b640 1 -- 172.21.15.26:0/2020660988 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80cd830 con 0x7f3de4004370 2023-10-14T11:15:27.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3df5d9b640 1 -- 172.21.15.26:0/2020660988 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df815da30 con 0x7f3de4004ec0 2023-10-14T11:15:27.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3df5d9b640 1 -- 172.21.15.26:0/2020660988 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de400bed0 con 0x7f3de4003980 2023-10-14T11:15:27.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3deffff640 1 --2- 172.21.15.26:0/2020660988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3de4004370 0x7f3de4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3df659c640 1 --2- 172.21.15.26:0/2020660988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3de4003980 0x7f3de4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3df6d9d640 1 --2- 172.21.15.26:0/2020660988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de4004ec0 0x7f3de400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3deffff640 1 -- 172.21.15.26:0/2020660988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3de4003980 msgr2=0x7f3de4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:27.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3deffff640 1 --2- 172.21.15.26:0/2020660988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3de4003980 0x7f3de4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3deffff640 1 -- 172.21.15.26:0/2020660988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de4004ec0 msgr2=0x7f3de400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:27.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3deffff640 1 --2- 172.21.15.26:0/2020660988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de4004ec0 0x7f3de400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3deffff640 1 -- 172.21.15.26:0/2020660988 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de4003530 con 0x7f3de4004370 2023-10-14T11:15:27.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.359+0000 7f3df6d9d640 1 --2- 172.21.15.26:0/2020660988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de4004ec0 0x7f3de400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:27.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.363+0000 7f3deffff640 1 --2- 172.21.15.26:0/2020660988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3de4004370 0x7f3de4004850 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f3de0009ae0 tx=0x7f3de001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4968797dae9126e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:27.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.363+0000 7f3df5d9b640 1 -- 172.21.15.26:0/2020660988 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de00a5680 con 0x7f3de4004370 2023-10-14T11:15:27.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.363+0000 7f3df5d9b640 1 -- 172.21.15.26:0/2020660988 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de00a57e0 con 0x7f3de4004370 2023-10-14T11:15:27.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.363+0000 7f3df5d9b640 1 -- 172.21.15.26:0/2020660988 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de00a5b90 con 0x7f3de4004370 2023-10-14T11:15:27.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.363+0000 7f3dfca54640 1 -- 172.21.15.26:0/2020660988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3de4004370 msgr2=0x7f3de4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.363+0000 7f3dfca54640 1 --2- 172.21.15.26:0/2020660988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3de4004370 0x7f3de4004850 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f3de0009ae0 tx=0x7f3de001ca90 comp rx=0 tx=0).stop 2023-10-14T11:15:27.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.363+0000 7f3df6d9d640 1 -- 172.21.15.26:0/2020660988 reap_dead start 2023-10-14T11:15:27.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.363+0000 7f3dfca54640 1 -- 172.21.15.26:0/2020660988 shutdown_connections 2023-10-14T11:15:27.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.363+0000 7f3dfca54640 1 -- 172.21.15.26:0/2020660988 >> 172.21.15.26:0/2020660988 conn(0x7f3df80715c0 msgr2=0x7f3df80719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:27.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.363+0000 7f3dfca54640 1 -- 172.21.15.26:0/2020660988 shutdown_connections 2023-10-14T11:15:27.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.363+0000 7f3dfca54640 1 -- 172.21.15.26:0/2020660988 wait complete. 2023-10-14T11:15:27.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.363+0000 7f3dfca54640 1 Processor -- start 2023-10-14T11:15:27.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.363+0000 7f3dfca54640 1 -- start start 2023-10-14T11:15:27.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3dfca54640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3de4004370 0x7f3df8152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3dfca54640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3df80ca600 0x7f3df81f2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3dfca54640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3df81f6380 0x7f3df81f6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3dfca54640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df81f6d70 con 0x7f3df81f6380 2023-10-14T11:15:27.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3dfca54640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80c7290 con 0x7f3df80ca600 2023-10-14T11:15:27.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3dfca54640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80caa60 con 0x7f3de4004370 2023-10-14T11:15:27.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3df6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3df81f6380 0x7f3df81f6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3df6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3df81f6380 0x7f3df81f6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34960/0 (socket says 172.21.15.26:34960) 2023-10-14T11:15:27.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3df6d9d640 1 -- 172.21.15.26:0/3141478261 learned_addr learned my addr 172.21.15.26:0/3141478261 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:27.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3df659c640 1 --2- 172.21.15.26:0/3141478261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3de4004370 0x7f3df8152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3deffff640 1 --2- 172.21.15.26:0/3141478261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3df80ca600 0x7f3df81f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3df6d9d640 1 -- 172.21.15.26:0/3141478261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3de4004370 msgr2=0x7f3df8152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3df6d9d640 1 --2- 172.21.15.26:0/3141478261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3de4004370 0x7f3df8152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3df6d9d640 1 -- 172.21.15.26:0/3141478261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3df80ca600 msgr2=0x7f3df81f2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3df6d9d640 1 --2- 172.21.15.26:0/3141478261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3df80ca600 0x7f3df81f2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3df6d9d640 1 -- 172.21.15.26:0/3141478261 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df80cad30 con 0x7f3df81f6380 2023-10-14T11:15:27.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3df6d9d640 1 --2- 172.21.15.26:0/3141478261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3df81f6380 0x7f3df81f6830 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f3df815e2a0 tx=0x7f3df0010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:27.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3deeffd640 1 -- 172.21.15.26:0/3141478261 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df001b070 con 0x7f3df81f6380 2023-10-14T11:15:27.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3deeffd640 1 -- 172.21.15.26:0/3141478261 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df000f040 con 0x7f3df81f6380 2023-10-14T11:15:27.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3deeffd640 1 -- 172.21.15.26:0/3141478261 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df000e050 con 0x7f3df81f6380 2023-10-14T11:15:27.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3dfca54640 1 -- 172.21.15.26:0/3141478261 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df80b80c0 con 0x7f3df81f6380 2023-10-14T11:15:27.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3dfca54640 1 -- 172.21.15.26:0/3141478261 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df80b8680 con 0x7f3df81f6380 2023-10-14T11:15:27.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3dfca54640 1 -- 172.21.15.26:0/3141478261 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3df815d6c0 con 0x7f3df81f6380 2023-10-14T11:15:27.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.367+0000 7f3deeffd640 1 -- 172.21.15.26:0/3141478261 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3df0015440 con 0x7f3df81f6380 2023-10-14T11:15:27.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.371+0000 7f3deeffd640 1 --2- 172.21.15.26:0/3141478261 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3dd80664d0 0x7f3dd8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.371+0000 7f3deeffd640 1 -- 172.21.15.26:0/3141478261 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f3df0084bf0 con 0x7f3df81f6380 2023-10-14T11:15:27.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.371+0000 7f3df659c640 1 --2- 172.21.15.26:0/3141478261 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3dd80664d0 0x7f3dd8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.371+0000 7f3deeffd640 1 --2- 172.21.15.26:0/3141478261 >> [v2:172.21.15.110:6800/3436135045,v1:172.21.15.110:6801/3436135045] conn(0x7f3dd806c7d0 0x7f3dd806ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.371+0000 7f3deeffd640 1 -- 172.21.15.26:0/3141478261 --> [v2:172.21.15.110:6800/3436135045,v1:172.21.15.110:6801/3436135045] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3dd806f2e0 con 0x7f3dd806c7d0 2023-10-14T11:15:27.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.371+0000 7f3deeffd640 1 -- 172.21.15.26:0/3141478261 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3df0084f60 con 0x7f3df81f6380 2023-10-14T11:15:27.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.371+0000 7f3deffff640 1 --2- 172.21.15.26:0/3141478261 >> [v2:172.21.15.110:6800/3436135045,v1:172.21.15.110:6801/3436135045] conn(0x7f3dd806c7d0 0x7f3dd806ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.371+0000 7f3df659c640 1 --2- 172.21.15.26:0/3141478261 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3dd80664d0 0x7f3dd8068990 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3de8000c10 tx=0x7f3de8007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:27.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.371+0000 7f3deffff640 1 --2- 172.21.15.26:0/3141478261 >> [v2:172.21.15.110:6800/3436135045,v1:172.21.15.110:6801/3436135045] conn(0x7f3dd806c7d0 0x7f3dd806ec10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:27.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.371+0000 7f3deeffd640 1 -- 172.21.15.26:0/3141478261 <== osd.4 v2:172.21.15.110:6800/3436135045 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f3dd806f2e0 con 0x7f3dd806c7d0 2023-10-14T11:15:27.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.383+0000 7f3dfca54640 1 -- 172.21.15.26:0/3141478261 --> [v2:172.21.15.110:6800/3436135045,v1:172.21.15.110:6801/3436135045] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3df815d3e0 con 0x7f3dd806c7d0 2023-10-14T11:15:27.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.387+0000 7f3deeffd640 1 -- 172.21.15.26:0/3141478261 <== osd.4 v2:172.21.15.110:6800/3436135045 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3de000f080 con 0x7f3dd806c7d0 2023-10-14T11:15:27.393 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:15:27.394 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T11:15:27.394 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:15:27.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.387+0000 7f3dfca54640 1 -- 172.21.15.26:0/3141478261 >> [v2:172.21.15.110:6800/3436135045,v1:172.21.15.110:6801/3436135045] conn(0x7f3dd806c7d0 msgr2=0x7f3dd806ec10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.387+0000 7f3dfca54640 1 --2- 172.21.15.26:0/3141478261 >> [v2:172.21.15.110:6800/3436135045,v1:172.21.15.110:6801/3436135045] conn(0x7f3dd806c7d0 0x7f3dd806ec10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.387+0000 7f3dfca54640 1 -- 172.21.15.26:0/3141478261 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3dd80664d0 msgr2=0x7f3dd8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.387+0000 7f3dfca54640 1 --2- 172.21.15.26:0/3141478261 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f3dd80664d0 0x7f3dd8068990 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3de8000c10 tx=0x7f3de8007900 comp rx=0 tx=0).stop 2023-10-14T11:15:27.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.387+0000 7f3dfca54640 1 -- 172.21.15.26:0/3141478261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3df81f6380 msgr2=0x7f3df81f6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.387+0000 7f3dfca54640 1 --2- 172.21.15.26:0/3141478261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3df81f6380 0x7f3df81f6830 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f3df815e2a0 tx=0x7f3df0010590 comp rx=0 tx=0).stop 2023-10-14T11:15:27.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.387+0000 7f3df6d9d640 1 -- 172.21.15.26:0/3141478261 reap_dead start 2023-10-14T11:15:27.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.387+0000 7f3dfca54640 1 -- 172.21.15.26:0/3141478261 shutdown_connections 2023-10-14T11:15:27.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.387+0000 7f3dfca54640 1 -- 172.21.15.26:0/3141478261 >> 172.21.15.26:0/3141478261 conn(0x7f3df80715c0 msgr2=0x7f3df80719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:27.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.387+0000 7f3dfca54640 1 -- 172.21.15.26:0/3141478261 shutdown_connections 2023-10-14T11:15:27.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.387+0000 7f3dfca54640 1 -- 172.21.15.26:0/3141478261 wait complete. 2023-10-14T11:15:27.411 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-14T11:15:27.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.547+0000 7f1d9899c640 1 Processor -- start 2023-10-14T11:15:27.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.547+0000 7f1d9899c640 1 -- start start 2023-10-14T11:15:27.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.551+0000 7f1d9899c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1d940d1490 0x7f1d9406af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.551+0000 7f1d9899c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d9415cd60 0x7f1d940b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.551+0000 7f1d9899c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d940d3510 con 0x7f1d9415c980 2023-10-14T11:15:27.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.551+0000 7f1d9899c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d940cd2b0 con 0x7f1d940d1490 2023-10-14T11:15:27.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.551+0000 7f1d9899c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d940d2f50 con 0x7f1d9415cd60 2023-10-14T11:15:27.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.551+0000 7f1d9259c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1d940d1490 0x7f1d9406af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.551+0000 7f1d92d9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1d9415c980 0x7f1d940d0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52862/0 (socket says 172.21.15.26:52862) 2023-10-14T11:15:27.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.551+0000 7f1d92d9d640 1 -- 172.21.15.26:0/2794942269 learned_addr learned my addr 172.21.15.26:0/2794942269 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:27.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.551+0000 7f1d9359e640 1 --2- 172.21.15.26:0/2794942269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d9415cd60 0x7f1d940b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.551+0000 7f1d9259c640 1 -- 172.21.15.26:0/2794942269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d9415cd60 msgr2=0x7f1d940b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:27.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.551+0000 7f1d9259c640 1 --2- 172.21.15.26:0/2794942269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d9415cd60 0x7f1d940b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.551+0000 7f1d9259c640 1 -- 172.21.15.26:0/2794942269 >> v1:172.21.15.26:6789/0 conn(0x7f1d9415c980 legacy=0x7f1d940d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.551+0000 7f1d9259c640 1 -- 172.21.15.26:0/2794942269 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d940d3230 con 0x7f1d940d1490 2023-10-14T11:15:27.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.551+0000 7f1d9259c640 1 --2- 172.21.15.26:0/2794942269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d940d1490 0x7f1d9406af90 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f1d880097c0 tx=0x7f1d8801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85da68e474d19465 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:27.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.551+0000 7f1d91d9b640 1 -- 172.21.15.26:0/2794942269 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d880ab600 con 0x7f1d940d1490 2023-10-14T11:15:27.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.555+0000 7f1d91d9b640 1 -- 172.21.15.26:0/2794942269 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d880a7050 con 0x7f1d940d1490 2023-10-14T11:15:27.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.555+0000 7f1d91d9b640 1 -- 172.21.15.26:0/2794942269 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d880ab980 con 0x7f1d940d1490 2023-10-14T11:15:27.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.555+0000 7f1d9899c640 1 -- 172.21.15.26:0/2794942269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d940d1490 msgr2=0x7f1d9406af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.555+0000 7f1d9899c640 1 --2- 172.21.15.26:0/2794942269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d940d1490 0x7f1d9406af90 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f1d880097c0 tx=0x7f1d8801c3f0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.555+0000 7f1d9899c640 1 -- 172.21.15.26:0/2794942269 shutdown_connections 2023-10-14T11:15:27.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.555+0000 7f1d9899c640 1 --2- 172.21.15.26:0/2794942269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d9415cd60 0x7f1d940b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.555+0000 7f1d9899c640 1 --2- 172.21.15.26:0/2794942269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d940d1490 0x7f1d9406af90 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.555+0000 7f1d9899c640 1 -- 172.21.15.26:0/2794942269 >> 172.21.15.26:0/2794942269 conn(0x7f1d9409ba80 msgr2=0x7f1d940d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:27.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.555+0000 7f1d9899c640 1 -- 172.21.15.26:0/2794942269 shutdown_connections 2023-10-14T11:15:27.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.555+0000 7f1d9899c640 1 -- 172.21.15.26:0/2794942269 wait complete. 2023-10-14T11:15:27.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.555+0000 7f1d9899c640 1 Processor -- start 2023-10-14T11:15:27.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.555+0000 7f1d9899c640 1 -- start start 2023-10-14T11:15:27.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.555+0000 7f1d9899c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d940d1490 0x7f1d940c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.555+0000 7f1d9899c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d9415c980 0x7f1d940c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.555+0000 7f1d9899c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d9415cd60 0x7f1d941412b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.555+0000 7f1d9899c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d940c5f50 con 0x7f1d940d1490 2023-10-14T11:15:27.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.555+0000 7f1d9899c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d940c8d60 con 0x7f1d9415c980 2023-10-14T11:15:27.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.555+0000 7f1d9899c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d940c9040 con 0x7f1d9415cd60 2023-10-14T11:15:27.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.555+0000 7f1d92d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d940d1490 0x7f1d940c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.555+0000 7f1d92d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d940d1490 0x7f1d940c9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34978/0 (socket says 172.21.15.26:34978) 2023-10-14T11:15:27.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.555+0000 7f1d92d9d640 1 -- 172.21.15.26:0/2422810395 learned_addr learned my addr 172.21.15.26:0/2422810395 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:27.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.559+0000 7f1d9259c640 1 --2- 172.21.15.26:0/2422810395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d9415c980 0x7f1d940c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.559+0000 7f1d9359e640 1 --2- 172.21.15.26:0/2422810395 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d9415cd60 0x7f1d941412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.559+0000 7f1d92d9d640 1 -- 172.21.15.26:0/2422810395 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d9415cd60 msgr2=0x7f1d941412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.559+0000 7f1d92d9d640 1 --2- 172.21.15.26:0/2422810395 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d9415cd60 0x7f1d941412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.559+0000 7f1d92d9d640 1 -- 172.21.15.26:0/2422810395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d9415c980 msgr2=0x7f1d940c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.559+0000 7f1d92d9d640 1 --2- 172.21.15.26:0/2422810395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d9415c980 0x7f1d940c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.559+0000 7f1d92d9d640 1 -- 172.21.15.26:0/2422810395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d88009420 con 0x7f1d940d1490 2023-10-14T11:15:27.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.559+0000 7f1d92d9d640 1 --2- 172.21.15.26:0/2422810395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d940d1490 0x7f1d940c9870 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400c4d0 tx=0x7f1d8400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:27.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.559+0000 7f1d7b7fe640 1 -- 172.21.15.26:0/2422810395 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d84007480 con 0x7f1d940d1490 2023-10-14T11:15:27.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.559+0000 7f1d7b7fe640 1 -- 172.21.15.26:0/2422810395 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d840075e0 con 0x7f1d940d1490 2023-10-14T11:15:27.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.559+0000 7f1d7b7fe640 1 -- 172.21.15.26:0/2422810395 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d840059b0 con 0x7f1d940d1490 2023-10-14T11:15:27.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.559+0000 7f1d9899c640 1 -- 172.21.15.26:0/2422810395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d940cbc70 con 0x7f1d940d1490 2023-10-14T11:15:27.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.559+0000 7f1d9899c640 1 -- 172.21.15.26:0/2422810395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d94154560 con 0x7f1d940d1490 2023-10-14T11:15:27.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.559+0000 7f1d9899c640 1 -- 172.21.15.26:0/2422810395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9404e9c0 con 0x7f1d940d1490 2023-10-14T11:15:27.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.559+0000 7f1d7b7fe640 1 -- 172.21.15.26:0/2422810395 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1d84005b10 con 0x7f1d940d1490 2023-10-14T11:15:27.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.559+0000 7f1d7b7fe640 1 --2- 172.21.15.26:0/2422810395 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d800664f0 0x7f1d800689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.559+0000 7f1d7b7fe640 1 -- 172.21.15.26:0/2422810395 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1d84082fb0 con 0x7f1d940d1490 2023-10-14T11:15:27.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.563+0000 7f1d9259c640 1 --2- 172.21.15.26:0/2422810395 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d800664f0 0x7f1d800689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.563+0000 7f1d9259c640 1 --2- 172.21.15.26:0/2422810395 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d800664f0 0x7f1d800689b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1d880ad000 tx=0x7f1d88008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:27.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.563+0000 7f1d7b7fe640 1 -- 172.21.15.26:0/2422810395 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1d84050680 con 0x7f1d940d1490 2023-10-14T11:15:27.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.723+0000 7f1d9899c640 1 -- 172.21.15.26:0/2422810395 --> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d940c8ed0 con 0x7f1d800664f0 2023-10-14T11:15:27.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.723+0000 7f1d7b7fe640 1 -- 172.21.15.26:0/2422810395 <== mgr.4101 v2:172.21.15.26:6832/4136446821 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1d940c8ed0 con 0x7f1d800664f0 2023-10-14T11:15:27.729 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 4 to deep-scrub 2023-10-14T11:15:27.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.723+0000 7f1d9899c640 1 -- 172.21.15.26:0/2422810395 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d800664f0 msgr2=0x7f1d800689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.723+0000 7f1d9899c640 1 --2- 172.21.15.26:0/2422810395 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d800664f0 0x7f1d800689b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1d880ad000 tx=0x7f1d88008040 comp rx=0 tx=0).stop 2023-10-14T11:15:27.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.723+0000 7f1d9899c640 1 -- 172.21.15.26:0/2422810395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d940d1490 msgr2=0x7f1d940c9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.723+0000 7f1d9899c640 1 --2- 172.21.15.26:0/2422810395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d940d1490 0x7f1d940c9870 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400c4d0 tx=0x7f1d8400c990 comp rx=0 tx=0).stop 2023-10-14T11:15:27.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.723+0000 7f1d9899c640 1 -- 172.21.15.26:0/2422810395 shutdown_connections 2023-10-14T11:15:27.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.723+0000 7f1d9899c640 1 --2- 172.21.15.26:0/2422810395 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d9415cd60 0x7f1d941412b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.723+0000 7f1d9899c640 1 --2- 172.21.15.26:0/2422810395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d9415c980 0x7f1d940c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.723+0000 7f1d9899c640 1 --2- 172.21.15.26:0/2422810395 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f1d800664f0 0x7f1d800689b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.723+0000 7f1d9899c640 1 --2- 172.21.15.26:0/2422810395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d940d1490 0x7f1d940c9870 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.723+0000 7f1d9899c640 1 -- 172.21.15.26:0/2422810395 >> 172.21.15.26:0/2422810395 conn(0x7f1d9409ba80 msgr2=0x7f1d940b3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:27.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.723+0000 7f1d9899c640 1 -- 172.21.15.26:0/2422810395 shutdown_connections 2023-10-14T11:15:27.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.723+0000 7f1d9899c640 1 -- 172.21.15.26:0/2422810395 wait complete. 2023-10-14T11:15:27.749 INFO:tasks.ceph:Scrubbing osd.5 2023-10-14T11:15:27.750 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-14T11:15:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.891+0000 7fcb3b53e640 1 Processor -- start 2023-10-14T11:15:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.891+0000 7fcb3b53e640 1 -- start start 2023-10-14T11:15:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.891+0000 7fcb3b53e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb34147180 0x7fcb341655f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.891+0000 7fcb3b53e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcb340cb6e0 0x7fcb34161ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.891+0000 7fcb3b53e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb34162410 con 0x7fcb340c8c10 2023-10-14T11:15:27.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.891+0000 7fcb3b53e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb34165160 con 0x7fcb340cb6e0 2023-10-14T11:15:27.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.891+0000 7fcb3b53e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb340c9380 con 0x7fcb34147180 2023-10-14T11:15:27.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.891+0000 7fcb38ad9640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcb340c8c10 0x7fcb340cafd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52870/0 (socket says 172.21.15.26:52870) 2023-10-14T11:15:27.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.891+0000 7fcb38ad9640 1 -- 172.21.15.26:0/3406201417 learned_addr learned my addr 172.21.15.26:0/3406201417 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:27.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.891+0000 7fcb392da640 1 --2- 172.21.15.26:0/3406201417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb34147180 0x7fcb341655f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.891+0000 7fcb39adb640 1 --2- 172.21.15.26:0/3406201417 >> v2:172.21.15.110:3300/0 conn(0x7fcb340cb6e0 0x7fcb34161ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.891+0000 7fcb2bfff640 1 -- 172.21.15.26:0/3406201417 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520671144 0 0) 0x7fcb24001120 con 0x7fcb340c8c10 2023-10-14T11:15:27.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.891+0000 7fcb2bfff640 1 -- 172.21.15.26:0/3406201417 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb20003530 con 0x7fcb340c8c10 2023-10-14T11:15:27.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.891+0000 7fcb392da640 1 -- 172.21.15.26:0/3406201417 >> v2:172.21.15.110:3300/0 conn(0x7fcb340cb6e0 msgr2=0x7fcb34161ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:27.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.891+0000 7fcb392da640 1 --2- 172.21.15.26:0/3406201417 >> v2:172.21.15.110:3300/0 conn(0x7fcb340cb6e0 0x7fcb34161ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.891+0000 7fcb392da640 1 -- 172.21.15.26:0/3406201417 >> v1:172.21.15.26:6789/0 conn(0x7fcb340c8c10 legacy=0x7fcb340cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.891+0000 7fcb392da640 1 -- 172.21.15.26:0/3406201417 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb340c90a0 con 0x7fcb34147180 2023-10-14T11:15:27.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.895+0000 7fcb392da640 1 --2- 172.21.15.26:0/3406201417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb34147180 0x7fcb341655f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcb300097c0 tx=0x7fcb3001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d12de6ce7463ca3f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:27.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.895+0000 7fcb2bfff640 1 -- 172.21.15.26:0/3406201417 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb300ab650 con 0x7fcb34147180 2023-10-14T11:15:27.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.895+0000 7fcb2bfff640 1 -- 172.21.15.26:0/3406201417 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb300ab7b0 con 0x7fcb34147180 2023-10-14T11:15:27.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.895+0000 7fcb2bfff640 1 -- 172.21.15.26:0/3406201417 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb300abb40 con 0x7fcb34147180 2023-10-14T11:15:27.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.895+0000 7fcb3b53e640 1 -- 172.21.15.26:0/3406201417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb34147180 msgr2=0x7fcb341655f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.895+0000 7fcb3b53e640 1 --2- 172.21.15.26:0/3406201417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb34147180 0x7fcb341655f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcb300097c0 tx=0x7fcb3001c450 comp rx=0 tx=0).stop 2023-10-14T11:15:27.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.895+0000 7fcb3b53e640 1 -- 172.21.15.26:0/3406201417 shutdown_connections 2023-10-14T11:15:27.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.895+0000 7fcb3b53e640 1 --2- 172.21.15.26:0/3406201417 >> v2:172.21.15.110:3300/0 conn(0x7fcb340cb6e0 0x7fcb34161ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.895+0000 7fcb3b53e640 1 --2- 172.21.15.26:0/3406201417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb34147180 0x7fcb341655f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.895+0000 7fcb3b53e640 1 -- 172.21.15.26:0/3406201417 >> 172.21.15.26:0/3406201417 conn(0x7fcb3406a820 msgr2=0x7fcb340b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:27.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.895+0000 7fcb3b53e640 1 -- 172.21.15.26:0/3406201417 shutdown_connections 2023-10-14T11:15:27.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.895+0000 7fcb3b53e640 1 -- 172.21.15.26:0/3406201417 wait complete. 2023-10-14T11:15:27.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb3b53e640 1 Processor -- start 2023-10-14T11:15:27.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb3b53e640 1 -- start start 2023-10-14T11:15:27.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb3b53e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb340cb6e0 0x7fcb3413cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb3b53e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb34147180 0x7fcb340b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb3b53e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb34160840 0x7fcb340b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb3b53e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb34070c50 con 0x7fcb34160840 2023-10-14T11:15:27.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb3b53e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb34070f30 con 0x7fcb34147180 2023-10-14T11:15:27.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb3b53e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb34071210 con 0x7fcb340cb6e0 2023-10-14T11:15:27.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb39adb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb34160840 0x7fcb340b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb39adb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb34160840 0x7fcb340b1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34984/0 (socket says 172.21.15.26:34984) 2023-10-14T11:15:27.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb39adb640 1 -- 172.21.15.26:0/3955246522 learned_addr learned my addr 172.21.15.26:0/3955246522 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:27.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb392da640 1 --2- 172.21.15.26:0/3955246522 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb340cb6e0 0x7fcb3413cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb38ad9640 1 --2- 172.21.15.26:0/3955246522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb34147180 0x7fcb340b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb39adb640 1 -- 172.21.15.26:0/3955246522 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb340cb6e0 msgr2=0x7fcb3413cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb39adb640 1 --2- 172.21.15.26:0/3955246522 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb340cb6e0 0x7fcb3413cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb39adb640 1 -- 172.21.15.26:0/3955246522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb34147180 msgr2=0x7fcb340b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb39adb640 1 --2- 172.21.15.26:0/3955246522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb34147180 0x7fcb340b1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb39adb640 1 -- 172.21.15.26:0/3955246522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb30009420 con 0x7fcb34160840 2023-10-14T11:15:27.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb38ad9640 1 --2- 172.21.15.26:0/3955246522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb34147180 0x7fcb340b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:15:27.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb39adb640 1 --2- 172.21.15.26:0/3955246522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb34160840 0x7fcb340b1e40 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00ef90 tx=0x7fcb2c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:27.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb29ffb640 1 -- 172.21.15.26:0/3955246522 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c009ca0 con 0x7fcb34160840 2023-10-14T11:15:27.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb29ffb640 1 -- 172.21.15.26:0/3955246522 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2c00f040 con 0x7fcb34160840 2023-10-14T11:15:27.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb3b53e640 1 -- 172.21.15.26:0/3955246522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb341476e0 con 0x7fcb34160840 2023-10-14T11:15:27.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb29ffb640 1 -- 172.21.15.26:0/3955246522 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c0146c0 con 0x7fcb34160840 2023-10-14T11:15:27.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.899+0000 7fcb3b53e640 1 -- 172.21.15.26:0/3955246522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb340717d0 con 0x7fcb34160840 2023-10-14T11:15:27.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.903+0000 7fcb3b53e640 1 -- 172.21.15.26:0/3955246522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb34147560 con 0x7fcb34160840 2023-10-14T11:15:27.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.903+0000 7fcb29ffb640 1 -- 172.21.15.26:0/3955246522 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcb2c014820 con 0x7fcb34160840 2023-10-14T11:15:27.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.903+0000 7fcb29ffb640 1 --2- 172.21.15.26:0/3955246522 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcb180664d0 0x7fcb18068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.903+0000 7fcb29ffb640 1 -- 172.21.15.26:0/3955246522 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fcb2c084c40 con 0x7fcb34160840 2023-10-14T11:15:27.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.903+0000 7fcb392da640 1 --2- 172.21.15.26:0/3955246522 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcb180664d0 0x7fcb18068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.903+0000 7fcb29ffb640 1 --2- 172.21.15.26:0/3955246522 >> [v2:172.21.15.110:6808/3405567465,v1:172.21.15.110:6809/3405567465] conn(0x7fcb1806c7d0 0x7fcb1806ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:27.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.903+0000 7fcb29ffb640 1 -- 172.21.15.26:0/3955246522 --> [v2:172.21.15.110:6808/3405567465,v1:172.21.15.110:6809/3405567465] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb1806f2e0 con 0x7fcb1806c7d0 2023-10-14T11:15:27.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.903+0000 7fcb29ffb640 1 -- 172.21.15.26:0/3955246522 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb2c089240 con 0x7fcb34160840 2023-10-14T11:15:27.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.903+0000 7fcb38ad9640 1 --2- 172.21.15.26:0/3955246522 >> [v2:172.21.15.110:6808/3405567465,v1:172.21.15.110:6809/3405567465] conn(0x7fcb1806c7d0 0x7fcb1806ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:27.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.903+0000 7fcb392da640 1 --2- 172.21.15.26:0/3955246522 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcb180664d0 0x7fcb18068990 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fcb300af000 tx=0x7fcb300a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:27.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.903+0000 7fcb38ad9640 1 --2- 172.21.15.26:0/3955246522 >> [v2:172.21.15.110:6808/3405567465,v1:172.21.15.110:6809/3405567465] conn(0x7fcb1806c7d0 0x7fcb1806ec10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:27.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.907+0000 7fcb29ffb640 1 -- 172.21.15.26:0/3955246522 <== osd.5 v2:172.21.15.110:6808/3405567465 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fcb1806f2e0 con 0x7fcb1806c7d0 2023-10-14T11:15:27.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.919+0000 7fcb3b53e640 1 -- 172.21.15.26:0/3955246522 --> [v2:172.21.15.110:6808/3405567465,v1:172.21.15.110:6809/3405567465] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcb340b0b90 con 0x7fcb1806c7d0 2023-10-14T11:15:27.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.919+0000 7fcb29ffb640 1 -- 172.21.15.26:0/3955246522 <== osd.5 v2:172.21.15.110:6808/3405567465 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fcb24001880 con 0x7fcb1806c7d0 2023-10-14T11:15:27.926 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:15:27.927 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T11:15:27.927 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:15:27.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.919+0000 7fcb3b53e640 1 -- 172.21.15.26:0/3955246522 >> [v2:172.21.15.110:6808/3405567465,v1:172.21.15.110:6809/3405567465] conn(0x7fcb1806c7d0 msgr2=0x7fcb1806ec10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.919+0000 7fcb3b53e640 1 --2- 172.21.15.26:0/3955246522 >> [v2:172.21.15.110:6808/3405567465,v1:172.21.15.110:6809/3405567465] conn(0x7fcb1806c7d0 0x7fcb1806ec10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:27.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.919+0000 7fcb3b53e640 1 -- 172.21.15.26:0/3955246522 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcb180664d0 msgr2=0x7fcb18068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.919+0000 7fcb3b53e640 1 --2- 172.21.15.26:0/3955246522 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fcb180664d0 0x7fcb18068990 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fcb300af000 tx=0x7fcb300a7000 comp rx=0 tx=0).stop 2023-10-14T11:15:27.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.919+0000 7fcb3b53e640 1 -- 172.21.15.26:0/3955246522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb34160840 msgr2=0x7fcb340b1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:27.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.919+0000 7fcb3b53e640 1 --2- 172.21.15.26:0/3955246522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb34160840 0x7fcb340b1e40 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00ef90 tx=0x7fcb2c00c490 comp rx=0 tx=0).stop 2023-10-14T11:15:27.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.919+0000 7fcb39adb640 1 -- 172.21.15.26:0/3955246522 reap_dead start 2023-10-14T11:15:27.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.919+0000 7fcb3b53e640 1 -- 172.21.15.26:0/3955246522 shutdown_connections 2023-10-14T11:15:27.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.919+0000 7fcb3b53e640 1 -- 172.21.15.26:0/3955246522 >> 172.21.15.26:0/3955246522 conn(0x7fcb3406a820 msgr2=0x7fcb34144a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:27.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.919+0000 7fcb3b53e640 1 -- 172.21.15.26:0/3955246522 shutdown_connections 2023-10-14T11:15:27.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:27.919+0000 7fcb3b53e640 1 -- 172.21.15.26:0/3955246522 wait complete. 2023-10-14T11:15:27.945 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-14T11:15:28.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.083+0000 7f330aa91640 1 Processor -- start 2023-10-14T11:15:28.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.083+0000 7f330aa91640 1 -- start start 2023-10-14T11:15:28.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.083+0000 7f330aa91640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f330415cb90 0x7f33040cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.083+0000 7f330aa91640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33040d15d0 0x7f33040c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.083+0000 7f330aa91640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33040ce770 con 0x7f33040d3010 2023-10-14T11:15:28.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.083+0000 7f330aa91640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33040d0600 con 0x7f33040d15d0 2023-10-14T11:15:28.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.083+0000 7f330aa91640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33040c6450 con 0x7f330415cb90 2023-10-14T11:15:28.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.083+0000 7f330902e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33040d15d0 0x7f33040c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.083+0000 7f330902e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33040d15d0 0x7f33040c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34994/0 (socket says 172.21.15.26:34994) 2023-10-14T11:15:28.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.083+0000 7f330902e640 1 -- 172.21.15.26:0/3176612873 learned_addr learned my addr 172.21.15.26:0/3176612873 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:28.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.083+0000 7f330902e640 1 -- 172.21.15.26:0/3176612873 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f330415cb90 msgr2=0x7f33040cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:28.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.083+0000 7f330902e640 1 --2- 172.21.15.26:0/3176612873 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f330415cb90 0x7f33040cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.083+0000 7f330902e640 1 -- 172.21.15.26:0/3176612873 >> v1:172.21.15.26:6789/0 conn(0x7f33040d3010 legacy=0x7f33040d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.083+0000 7f330902e640 1 -- 172.21.15.26:0/3176612873 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33040d08a0 con 0x7f33040d15d0 2023-10-14T11:15:28.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.087+0000 7f330902e640 1 --2- 172.21.15.26:0/3176612873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33040d15d0 0x7f33040c6c10 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009e50 tx=0x7f32fc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d68f4dcbda3f4d8b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:28.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.087+0000 7f33037fe640 1 -- 172.21.15.26:0/3176612873 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc0a5810 con 0x7f33040d15d0 2023-10-14T11:15:28.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.087+0000 7f33037fe640 1 -- 172.21.15.26:0/3176612873 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32fc0a5970 con 0x7f33040d15d0 2023-10-14T11:15:28.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.087+0000 7f33037fe640 1 -- 172.21.15.26:0/3176612873 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc0a5d00 con 0x7f33040d15d0 2023-10-14T11:15:28.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.087+0000 7f330aa91640 1 -- 172.21.15.26:0/3176612873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33040d15d0 msgr2=0x7f33040c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.087+0000 7f330aa91640 1 --2- 172.21.15.26:0/3176612873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33040d15d0 0x7f33040c6c10 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009e50 tx=0x7f32fc01c950 comp rx=0 tx=0).stop 2023-10-14T11:15:28.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.087+0000 7f330aa91640 1 -- 172.21.15.26:0/3176612873 shutdown_connections 2023-10-14T11:15:28.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.087+0000 7f330aa91640 1 --2- 172.21.15.26:0/3176612873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33040d15d0 0x7f33040c6c10 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.087+0000 7f330aa91640 1 --2- 172.21.15.26:0/3176612873 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f330415cb90 0x7f33040cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.087+0000 7f330aa91640 1 -- 172.21.15.26:0/3176612873 >> 172.21.15.26:0/3176612873 conn(0x7f330409bc50 msgr2=0x7f33040d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:28.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.087+0000 7f330aa91640 1 -- 172.21.15.26:0/3176612873 shutdown_connections 2023-10-14T11:15:28.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.087+0000 7f330aa91640 1 -- 172.21.15.26:0/3176612873 wait complete. 2023-10-14T11:15:28.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f330aa91640 1 Processor -- start 2023-10-14T11:15:28.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f330aa91640 1 -- start start 2023-10-14T11:15:28.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f330aa91640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33040d15d0 0x7f3304141f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f330aa91640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33040d3010 0x7f330409c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f330aa91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f330415cb90 0x7f3304143770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f330aa91640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3304143350 con 0x7f33040d3010 2023-10-14T11:15:28.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f330aa91640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33041424a0 con 0x7f330415cb90 2023-10-14T11:15:28.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f330aa91640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330409cea0 con 0x7f33040d15d0 2023-10-14T11:15:28.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f3303fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33040d3010 0x7f330409c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f3303fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33040d3010 0x7f330409c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35008/0 (socket says 172.21.15.26:35008) 2023-10-14T11:15:28.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f3303fff640 1 -- 172.21.15.26:0/2320134084 learned_addr learned my addr 172.21.15.26:0/2320134084 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:28.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f330882d640 1 --2- 172.21.15.26:0/2320134084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33040d15d0 0x7f3304141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f330902e640 1 --2- 172.21.15.26:0/2320134084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f330415cb90 0x7f3304143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f3303fff640 1 -- 172.21.15.26:0/2320134084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33040d15d0 msgr2=0x7f3304141f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f3303fff640 1 --2- 172.21.15.26:0/2320134084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33040d15d0 0x7f3304141f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f3303fff640 1 -- 172.21.15.26:0/2320134084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f330415cb90 msgr2=0x7f3304143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f3303fff640 1 --2- 172.21.15.26:0/2320134084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f330415cb90 0x7f3304143770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f3303fff640 1 -- 172.21.15.26:0/2320134084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc009b30 con 0x7f33040d3010 2023-10-14T11:15:28.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f3303fff640 1 --2- 172.21.15.26:0/2320134084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33040d3010 0x7f330409c960 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f32f000c530 tx=0x7f32f000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:28.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f33017fa640 1 -- 172.21.15.26:0/2320134084 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f0005220 con 0x7f33040d3010 2023-10-14T11:15:28.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f33017fa640 1 -- 172.21.15.26:0/2320134084 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f0005380 con 0x7f33040d3010 2023-10-14T11:15:28.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f330aa91640 1 -- 172.21.15.26:0/2320134084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33041426d0 con 0x7f33040d3010 2023-10-14T11:15:28.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f33017fa640 1 -- 172.21.15.26:0/2320134084 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f0007270 con 0x7f33040d3010 2023-10-14T11:15:28.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.091+0000 7f330aa91640 1 -- 172.21.15.26:0/2320134084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3304142c90 con 0x7f33040d3010 2023-10-14T11:15:28.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.095+0000 7f330aa91640 1 -- 172.21.15.26:0/2320134084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3304143490 con 0x7f33040d3010 2023-10-14T11:15:28.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.095+0000 7f33017fa640 1 -- 172.21.15.26:0/2320134084 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f32f00073d0 con 0x7f33040d3010 2023-10-14T11:15:28.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.095+0000 7f33017fa640 1 --2- 172.21.15.26:0/2320134084 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f32e80664a0 0x7f32e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.095+0000 7f33017fa640 1 -- 172.21.15.26:0/2320134084 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f32f0083450 con 0x7f33040d3010 2023-10-14T11:15:28.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.095+0000 7f330882d640 1 --2- 172.21.15.26:0/2320134084 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f32e80664a0 0x7f32e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.095+0000 7f330882d640 1 --2- 172.21.15.26:0/2320134084 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f32e80664a0 0x7f32e8068960 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f32f80098e0 tx=0x7f32f8009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:28.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.099+0000 7f33017fa640 1 -- 172.21.15.26:0/2320134084 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3304143490 con 0x7f33040d3010 2023-10-14T11:15:28.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.259+0000 7f330aa91640 1 -- 172.21.15.26:0/2320134084 --> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f330415cf70 con 0x7f32e80664a0 2023-10-14T11:15:28.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.259+0000 7f33017fa640 1 -- 172.21.15.26:0/2320134084 <== mgr.4101 v2:172.21.15.26:6832/4136446821 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f32f8009530 con 0x7f32e80664a0 2023-10-14T11:15:28.266 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 5 to deep-scrub 2023-10-14T11:15:28.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.263+0000 7f330aa91640 1 -- 172.21.15.26:0/2320134084 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f32e80664a0 msgr2=0x7f32e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.263+0000 7f330aa91640 1 --2- 172.21.15.26:0/2320134084 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f32e80664a0 0x7f32e8068960 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f32f80098e0 tx=0x7f32f8009060 comp rx=0 tx=0).stop 2023-10-14T11:15:28.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.263+0000 7f330aa91640 1 -- 172.21.15.26:0/2320134084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33040d3010 msgr2=0x7f330409c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.263+0000 7f330aa91640 1 --2- 172.21.15.26:0/2320134084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33040d3010 0x7f330409c960 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f32f000c530 tx=0x7f32f000c9f0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.263+0000 7f330aa91640 1 -- 172.21.15.26:0/2320134084 shutdown_connections 2023-10-14T11:15:28.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.263+0000 7f330aa91640 1 --2- 172.21.15.26:0/2320134084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f330415cb90 0x7f3304143770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.263+0000 7f330aa91640 1 --2- 172.21.15.26:0/2320134084 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f32e80664a0 0x7f32e8068960 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.263+0000 7f330aa91640 1 --2- 172.21.15.26:0/2320134084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33040d3010 0x7f330409c960 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.263+0000 7f330aa91640 1 --2- 172.21.15.26:0/2320134084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33040d15d0 0x7f3304141f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.263+0000 7f330aa91640 1 -- 172.21.15.26:0/2320134084 >> 172.21.15.26:0/2320134084 conn(0x7f330409bc50 msgr2=0x7f33040ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:28.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.263+0000 7f330aa91640 1 -- 172.21.15.26:0/2320134084 shutdown_connections 2023-10-14T11:15:28.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.263+0000 7f330aa91640 1 -- 172.21.15.26:0/2320134084 wait complete. 2023-10-14T11:15:28.288 INFO:tasks.ceph:Scrubbing osd.6 2023-10-14T11:15:28.288 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-14T11:15:28.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.427+0000 7f5795f3e640 1 Processor -- start 2023-10-14T11:15:28.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.427+0000 7f5795f3e640 1 -- start start 2023-10-14T11:15:28.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.431+0000 7f5795f3e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f57901441a0 0x7f57900b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.431+0000 7f5795f3e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f57900b1a90 0x7f57900cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.431+0000 7f5795f3e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57900cb360 0x7f579006c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.431+0000 7f5795f3e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57900b1f20 con 0x7f57901441a0 2023-10-14T11:15:28.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.431+0000 7f5795f3e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579015e5f0 con 0x7f57900b1a90 2023-10-14T11:15:28.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.431+0000 7f5795f3e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579015e8d0 con 0x7f57900cb360 2023-10-14T11:15:28.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.431+0000 7f578f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f57901441a0 0x7f57900b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.431+0000 7f578f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f57901441a0 0x7f57900b1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35022/0 (socket says 172.21.15.26:35022) 2023-10-14T11:15:28.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.431+0000 7f578f7fe640 1 -- 172.21.15.26:0/2551064922 learned_addr learned my addr 172.21.15.26:0/2551064922 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:28.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.431+0000 7f578ffff640 1 --2- 172.21.15.26:0/2551064922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57900cb360 0x7f579006c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.431+0000 7f578effd640 1 --2- 172.21.15.26:0/2551064922 >> v2:172.21.15.110:3300/0 conn(0x7f57900b1a90 0x7f57900cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.431+0000 7f578f7fe640 1 -- 172.21.15.26:0/2551064922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57900cb360 msgr2=0x7f579006c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:28.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.431+0000 7f578f7fe640 1 --2- 172.21.15.26:0/2551064922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57900cb360 0x7f579006c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.431+0000 7f578f7fe640 1 -- 172.21.15.26:0/2551064922 >> v2:172.21.15.110:3300/0 conn(0x7f57900b1a90 msgr2=0x7f57900cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:28.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.431+0000 7f578f7fe640 1 --2- 172.21.15.26:0/2551064922 >> v2:172.21.15.110:3300/0 conn(0x7f57900b1a90 0x7f57900cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.431+0000 7f578f7fe640 1 -- 172.21.15.26:0/2551064922 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579015ebb0 con 0x7f57901441a0 2023-10-14T11:15:28.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.431+0000 7f578f7fe640 1 --2- 172.21.15.26:0/2551064922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57901441a0 0x7f57900b1550 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f579006d580 tx=0x7f578001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7db1773a2a0b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:28.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.431+0000 7f578e7fc640 1 -- 172.21.15.26:0/2551064922 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57800ab600 con 0x7f57901441a0 2023-10-14T11:15:28.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.435+0000 7f578e7fc640 1 -- 172.21.15.26:0/2551064922 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57800a7050 con 0x7f57901441a0 2023-10-14T11:15:28.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.435+0000 7f578e7fc640 1 -- 172.21.15.26:0/2551064922 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57800ab980 con 0x7f57901441a0 2023-10-14T11:15:28.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.435+0000 7f5795f3e640 1 -- 172.21.15.26:0/2551064922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57901441a0 msgr2=0x7f57900b1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.435+0000 7f5795f3e640 1 --2- 172.21.15.26:0/2551064922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57901441a0 0x7f57900b1550 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f579006d580 tx=0x7f578001c240 comp rx=0 tx=0).stop 2023-10-14T11:15:28.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.435+0000 7f5795f3e640 1 -- 172.21.15.26:0/2551064922 shutdown_connections 2023-10-14T11:15:28.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.435+0000 7f5795f3e640 1 --2- 172.21.15.26:0/2551064922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57900cb360 0x7f579006c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.435+0000 7f5795f3e640 1 --2- 172.21.15.26:0/2551064922 >> v2:172.21.15.110:3300/0 conn(0x7f57900b1a90 0x7f57900cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.435+0000 7f5795f3e640 1 --2- 172.21.15.26:0/2551064922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57901441a0 0x7f57900b1550 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.435+0000 7f5795f3e640 1 -- 172.21.15.26:0/2551064922 >> 172.21.15.26:0/2551064922 conn(0x7f579006a820 msgr2=0x7f57900b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:28.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.435+0000 7f5795f3e640 1 -- 172.21.15.26:0/2551064922 shutdown_connections 2023-10-14T11:15:28.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.435+0000 7f5795f3e640 1 -- 172.21.15.26:0/2551064922 wait complete. 2023-10-14T11:15:28.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.435+0000 7f5795f3e640 1 Processor -- start 2023-10-14T11:15:28.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.435+0000 7f5795f3e640 1 -- start start 2023-10-14T11:15:28.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.435+0000 7f5795f3e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57900b1a90 0x7f579013f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.435+0000 7f5795f3e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57900cb360 0x7f579013f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.435+0000 7f5795f3e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57901441a0 0x7f57901397d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.435+0000 7f5795f3e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57900ccf60 con 0x7f57901441a0 2023-10-14T11:15:28.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.435+0000 7f5795f3e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57900cd240 con 0x7f57900cb360 2023-10-14T11:15:28.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.435+0000 7f5795f3e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57900cd520 con 0x7f57900b1a90 2023-10-14T11:15:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.435+0000 7f578ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57901441a0 0x7f57901397d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.435+0000 7f578ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57901441a0 0x7f57901397d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35026/0 (socket says 172.21.15.26:35026) 2023-10-14T11:15:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.439+0000 7f578ffff640 1 -- 172.21.15.26:0/3757629947 learned_addr learned my addr 172.21.15.26:0/3757629947 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.439+0000 7f578f7fe640 1 --2- 172.21.15.26:0/3757629947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57900b1a90 0x7f579013f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.439+0000 7f578effd640 1 --2- 172.21.15.26:0/3757629947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57900cb360 0x7f579013f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.439+0000 7f578ffff640 1 -- 172.21.15.26:0/3757629947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57900b1a90 msgr2=0x7f579013f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.439+0000 7f578ffff640 1 --2- 172.21.15.26:0/3757629947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57900b1a90 0x7f579013f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.439+0000 7f578ffff640 1 -- 172.21.15.26:0/3757629947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57900cb360 msgr2=0x7f579013f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.439+0000 7f578ffff640 1 --2- 172.21.15.26:0/3757629947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57900cb360 0x7f579013f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.439+0000 7f578ffff640 1 -- 172.21.15.26:0/3757629947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57800094d0 con 0x7f57901441a0 2023-10-14T11:15:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.439+0000 7f578ffff640 1 --2- 172.21.15.26:0/3757629947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57901441a0 0x7f57901397d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f578800efc0 tx=0x7f578800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:28.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.439+0000 7f5777fff640 1 -- 172.21.15.26:0/3757629947 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788014480 con 0x7f57901441a0 2023-10-14T11:15:28.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.439+0000 7f5777fff640 1 -- 172.21.15.26:0/3757629947 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578800f040 con 0x7f57901441a0 2023-10-14T11:15:28.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.439+0000 7f5777fff640 1 -- 172.21.15.26:0/3757629947 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788014820 con 0x7f57901441a0 2023-10-14T11:15:28.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.439+0000 7f5795f3e640 1 -- 172.21.15.26:0/3757629947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57900cd800 con 0x7f57901441a0 2023-10-14T11:15:28.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.439+0000 7f5795f3e640 1 -- 172.21.15.26:0/3757629947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57900ccbc0 con 0x7f57901441a0 2023-10-14T11:15:28.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.439+0000 7f5795f3e640 1 -- 172.21.15.26:0/3757629947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f57900c8fc0 con 0x7f57901441a0 2023-10-14T11:15:28.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.439+0000 7f5777fff640 1 -- 172.21.15.26:0/3757629947 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5788014980 con 0x7f57901441a0 2023-10-14T11:15:28.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.439+0000 7f5777fff640 1 --2- 172.21.15.26:0/3757629947 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f577c0664a0 0x7f577c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.439+0000 7f5777fff640 1 -- 172.21.15.26:0/3757629947 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f5788084660 con 0x7f57901441a0 2023-10-14T11:15:28.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.443+0000 7f578f7fe640 1 --2- 172.21.15.26:0/3757629947 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f577c0664a0 0x7f577c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.443+0000 7f5777fff640 1 --2- 172.21.15.26:0/3757629947 >> [v2:172.21.15.110:6824/3095626813,v1:172.21.15.110:6825/3095626813] conn(0x7f577c06c7a0 0x7f577c06ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.443+0000 7f5777fff640 1 -- 172.21.15.26:0/3757629947 --> [v2:172.21.15.110:6824/3095626813,v1:172.21.15.110:6825/3095626813] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f577c06f2b0 con 0x7f577c06c7a0 2023-10-14T11:15:28.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.443+0000 7f5777fff640 1 -- 172.21.15.26:0/3757629947 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5788086d20 con 0x7f57901441a0 2023-10-14T11:15:28.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.443+0000 7f578effd640 1 --2- 172.21.15.26:0/3757629947 >> [v2:172.21.15.110:6824/3095626813,v1:172.21.15.110:6825/3095626813] conn(0x7f577c06c7a0 0x7f577c06ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.443+0000 7f578f7fe640 1 --2- 172.21.15.26:0/3757629947 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f577c0664a0 0x7f577c068960 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f57800ad000 tx=0x7f5780008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:28.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.443+0000 7f578effd640 1 --2- 172.21.15.26:0/3757629947 >> [v2:172.21.15.110:6824/3095626813,v1:172.21.15.110:6825/3095626813] conn(0x7f577c06c7a0 0x7f577c06ebe0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:28.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.443+0000 7f5777fff640 1 -- 172.21.15.26:0/3757629947 <== osd.6 v2:172.21.15.110:6824/3095626813 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f577c06f2b0 con 0x7f577c06c7a0 2023-10-14T11:15:28.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.455+0000 7f5795f3e640 1 -- 172.21.15.26:0/3757629947 --> [v2:172.21.15.110:6824/3095626813,v1:172.21.15.110:6825/3095626813] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f579004e170 con 0x7f577c06c7a0 2023-10-14T11:15:28.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.455+0000 7f5777fff640 1 -- 172.21.15.26:0/3757629947 <== osd.6 v2:172.21.15.110:6824/3095626813 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f579004e170 con 0x7f577c06c7a0 2023-10-14T11:15:28.464 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:15:28.464 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T11:15:28.464 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:15:28.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.459+0000 7f5795f3e640 1 -- 172.21.15.26:0/3757629947 >> [v2:172.21.15.110:6824/3095626813,v1:172.21.15.110:6825/3095626813] conn(0x7f577c06c7a0 msgr2=0x7f577c06ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.459+0000 7f5795f3e640 1 --2- 172.21.15.26:0/3757629947 >> [v2:172.21.15.110:6824/3095626813,v1:172.21.15.110:6825/3095626813] conn(0x7f577c06c7a0 0x7f577c06ebe0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.459+0000 7f5795f3e640 1 -- 172.21.15.26:0/3757629947 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f577c0664a0 msgr2=0x7f577c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.459+0000 7f5795f3e640 1 --2- 172.21.15.26:0/3757629947 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f577c0664a0 0x7f577c068960 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f57800ad000 tx=0x7f5780008040 comp rx=0 tx=0).stop 2023-10-14T11:15:28.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.459+0000 7f5795f3e640 1 -- 172.21.15.26:0/3757629947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57901441a0 msgr2=0x7f57901397d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.459+0000 7f5795f3e640 1 --2- 172.21.15.26:0/3757629947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57901441a0 0x7f57901397d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f578800efc0 tx=0x7f578800c490 comp rx=0 tx=0).stop 2023-10-14T11:15:28.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.459+0000 7f578ffff640 1 -- 172.21.15.26:0/3757629947 reap_dead start 2023-10-14T11:15:28.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.459+0000 7f5795f3e640 1 -- 172.21.15.26:0/3757629947 shutdown_connections 2023-10-14T11:15:28.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.459+0000 7f5795f3e640 1 -- 172.21.15.26:0/3757629947 >> 172.21.15.26:0/3757629947 conn(0x7f579006a820 msgr2=0x7f5790071350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:28.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.459+0000 7f5795f3e640 1 -- 172.21.15.26:0/3757629947 shutdown_connections 2023-10-14T11:15:28.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.459+0000 7f5795f3e640 1 -- 172.21.15.26:0/3757629947 wait complete. 2023-10-14T11:15:28.483 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-14T11:15:28.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.619+0000 7efef7c17640 1 Processor -- start 2023-10-14T11:15:28.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.619+0000 7efef7c17640 1 -- start start 2023-10-14T11:15:28.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.623+0000 7efef7c17640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efef00b07f0 0x7efef00ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.623+0000 7efef7c17640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efef00c96f0 con 0x7efef0164520 2023-10-14T11:15:28.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.623+0000 7efef7c17640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efef00cb950 con 0x7efef00ad960 2023-10-14T11:15:28.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.623+0000 7efef7c17640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef0164900 con 0x7efef00b07f0 2023-10-14T11:15:28.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.623+0000 7efef59b3640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efef0164520 0x7efef00b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52884/0 (socket says 172.21.15.26:52884) 2023-10-14T11:15:28.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.623+0000 7efef59b3640 1 -- 172.21.15.26:0/170042581 learned_addr learned my addr 172.21.15.26:0/170042581 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:28.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.623+0000 7efef61b4640 1 --2- 172.21.15.26:0/170042581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efef00b07f0 0x7efef00ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.623+0000 7efef49b1640 1 -- 172.21.15.26:0/170042581 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59937552 0 0) 0x7efef00c96f0 con 0x7efef0164520 2023-10-14T11:15:28.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.623+0000 7efef49b1640 1 -- 172.21.15.26:0/170042581 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efedc003530 con 0x7efef0164520 2023-10-14T11:15:28.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.623+0000 7efef49b1640 1 -- 172.21.15.26:0/170042581 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319295185 0 0) 0x7efef00cb950 con 0x7efef00ad960 2023-10-14T11:15:28.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.623+0000 7efef49b1640 1 -- 172.21.15.26:0/170042581 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efef00c96f0 con 0x7efef00ad960 2023-10-14T11:15:28.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.623+0000 7efef61b4640 1 -- 172.21.15.26:0/170042581 >> v1:172.21.15.110:6789/0 conn(0x7efef00ad960 legacy=0x7efef00cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.623+0000 7efef61b4640 1 -- 172.21.15.26:0/170042581 >> v1:172.21.15.26:6789/0 conn(0x7efef0164520 legacy=0x7efef00b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.623+0000 7efef61b4640 1 -- 172.21.15.26:0/170042581 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef00cbed0 con 0x7efef00b07f0 2023-10-14T11:15:28.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.627+0000 7efef61b4640 1 --2- 172.21.15.26:0/170042581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efef00b07f0 0x7efef00ce010 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efee8009dc0 tx=0x7efee801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3edc2d3756c93c52 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:28.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.627+0000 7efef49b1640 1 -- 172.21.15.26:0/170042581 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee80a5a20 con 0x7efef00b07f0 2023-10-14T11:15:28.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.627+0000 7efef49b1640 1 -- 172.21.15.26:0/170042581 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee80a5b80 con 0x7efef00b07f0 2023-10-14T11:15:28.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.627+0000 7efef49b1640 1 -- 172.21.15.26:0/170042581 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee80ad440 con 0x7efef00b07f0 2023-10-14T11:15:28.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.627+0000 7efef7c17640 1 -- 172.21.15.26:0/170042581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efef00b07f0 msgr2=0x7efef00ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.627+0000 7efef7c17640 1 --2- 172.21.15.26:0/170042581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efef00b07f0 0x7efef00ce010 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efee8009dc0 tx=0x7efee801c940 comp rx=0 tx=0).stop 2023-10-14T11:15:28.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.627+0000 7efef7c17640 1 -- 172.21.15.26:0/170042581 shutdown_connections 2023-10-14T11:15:28.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.627+0000 7efef7c17640 1 --2- 172.21.15.26:0/170042581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efef00b07f0 0x7efef00ce010 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.627+0000 7efef7c17640 1 -- 172.21.15.26:0/170042581 >> 172.21.15.26:0/170042581 conn(0x7efef006c190 msgr2=0x7efef006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:28.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.627+0000 7efef7c17640 1 -- 172.21.15.26:0/170042581 shutdown_connections 2023-10-14T11:15:28.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.627+0000 7efef7c17640 1 -- 172.21.15.26:0/170042581 wait complete. 2023-10-14T11:15:28.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.627+0000 7efef7c17640 1 Processor -- start 2023-10-14T11:15:28.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.627+0000 7efef7c17640 1 -- start start 2023-10-14T11:15:28.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efef7c17640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efef00ad960 0x7efef01512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efef7c17640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efef00b07f0 0x7efef0152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efef7c17640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efef0164520 0x7efef0153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efef7c17640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef01536c0 con 0x7efef00b07f0 2023-10-14T11:15:28.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efef7c17640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef0163e20 con 0x7efef00ad960 2023-10-14T11:15:28.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efef7c17640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef01580e0 con 0x7efef0164520 2023-10-14T11:15:28.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efef51b2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efef00b07f0 0x7efef0152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efef51b2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efef00b07f0 0x7efef0152c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35040/0 (socket says 172.21.15.26:35040) 2023-10-14T11:15:28.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efef51b2640 1 -- 172.21.15.26:0/3537607400 learned_addr learned my addr 172.21.15.26:0/3537607400 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:28.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efef59b3640 1 --2- 172.21.15.26:0/3537607400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efef00ad960 0x7efef01512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efef61b4640 1 --2- 172.21.15.26:0/3537607400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efef0164520 0x7efef0153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efef51b2640 1 -- 172.21.15.26:0/3537607400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efef0164520 msgr2=0x7efef0153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efef51b2640 1 --2- 172.21.15.26:0/3537607400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efef0164520 0x7efef0153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efef51b2640 1 -- 172.21.15.26:0/3537607400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efef00ad960 msgr2=0x7efef01512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efef51b2640 1 --2- 172.21.15.26:0/3537607400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efef00ad960 0x7efef01512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efef51b2640 1 -- 172.21.15.26:0/3537607400 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee8009a70 con 0x7efef00b07f0 2023-10-14T11:15:28.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efef59b3640 1 --2- 172.21.15.26:0/3537607400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efef00ad960 0x7efef01512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:28.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efef61b4640 1 --2- 172.21.15.26:0/3537607400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efef0164520 0x7efef0153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:28.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efef51b2640 1 --2- 172.21.15.26:0/3537607400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efef00b07f0 0x7efef0152c40 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7efee000c3f0 tx=0x7efee000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:28.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efee67fc640 1 -- 172.21.15.26:0/3537607400 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee00052d0 con 0x7efef00b07f0 2023-10-14T11:15:28.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efee67fc640 1 -- 172.21.15.26:0/3537607400 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee0005430 con 0x7efef00b07f0 2023-10-14T11:15:28.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efef7c17640 1 -- 172.21.15.26:0/3537607400 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efef01517e0 con 0x7efef00b07f0 2023-10-14T11:15:28.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efee67fc640 1 -- 172.21.15.26:0/3537607400 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee0003840 con 0x7efef00b07f0 2023-10-14T11:15:28.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efef7c17640 1 -- 172.21.15.26:0/3537607400 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efef0158660 con 0x7efef00b07f0 2023-10-14T11:15:28.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efef7c17640 1 -- 172.21.15.26:0/3537607400 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efef0074010 con 0x7efef00b07f0 2023-10-14T11:15:28.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.631+0000 7efee67fc640 1 -- 172.21.15.26:0/3537607400 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efee00039a0 con 0x7efef00b07f0 2023-10-14T11:15:28.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.635+0000 7efee67fc640 1 --2- 172.21.15.26:0/3537607400 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efed40664a0 0x7efed4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.635+0000 7efee67fc640 1 -- 172.21.15.26:0/3537607400 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7efee0083250 con 0x7efef00b07f0 2023-10-14T11:15:28.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.635+0000 7efef59b3640 1 --2- 172.21.15.26:0/3537607400 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efed40664a0 0x7efed4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.635+0000 7efef59b3640 1 --2- 172.21.15.26:0/3537607400 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efed40664a0 0x7efed4068960 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7efeec0011f0 tx=0x7efeec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:28.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.639+0000 7efee67fc640 1 -- 172.21.15.26:0/3537607400 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efee0050880 con 0x7efef00b07f0 2023-10-14T11:15:28.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.795+0000 7efef7c17640 1 -- 172.21.15.26:0/3537607400 --> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7efef016ee30 con 0x7efed40664a0 2023-10-14T11:15:28.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.795+0000 7efee67fc640 1 -- 172.21.15.26:0/3537607400 <== mgr.4101 v2:172.21.15.26:6832/4136446821 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efeec0013e0 con 0x7efed40664a0 2023-10-14T11:15:28.802 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 6 to deep-scrub 2023-10-14T11:15:28.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.795+0000 7efef7c17640 1 -- 172.21.15.26:0/3537607400 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efed40664a0 msgr2=0x7efed4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.795+0000 7efef7c17640 1 --2- 172.21.15.26:0/3537607400 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efed40664a0 0x7efed4068960 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7efeec0011f0 tx=0x7efeec009040 comp rx=0 tx=0).stop 2023-10-14T11:15:28.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.795+0000 7efef7c17640 1 -- 172.21.15.26:0/3537607400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efef00b07f0 msgr2=0x7efef0152c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.795+0000 7efef7c17640 1 --2- 172.21.15.26:0/3537607400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efef00b07f0 0x7efef0152c40 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7efee000c3f0 tx=0x7efee000c8b0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.795+0000 7efef7c17640 1 -- 172.21.15.26:0/3537607400 shutdown_connections 2023-10-14T11:15:28.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.795+0000 7efef7c17640 1 --2- 172.21.15.26:0/3537607400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efef0164520 0x7efef0153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.795+0000 7efef7c17640 1 --2- 172.21.15.26:0/3537607400 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7efed40664a0 0x7efed4068960 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.795+0000 7efef7c17640 1 --2- 172.21.15.26:0/3537607400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efef00b07f0 0x7efef0152c40 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.795+0000 7efef7c17640 1 --2- 172.21.15.26:0/3537607400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efef00ad960 0x7efef01512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.795+0000 7efef7c17640 1 -- 172.21.15.26:0/3537607400 >> 172.21.15.26:0/3537607400 conn(0x7efef006c190 msgr2=0x7efef01610b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:28.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.795+0000 7efef7c17640 1 -- 172.21.15.26:0/3537607400 shutdown_connections 2023-10-14T11:15:28.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.795+0000 7efef7c17640 1 -- 172.21.15.26:0/3537607400 wait complete. 2023-10-14T11:15:28.823 INFO:tasks.ceph:Scrubbing osd.7 2023-10-14T11:15:28.823 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-14T11:15:28.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.963+0000 7fef1e009640 1 Processor -- start 2023-10-14T11:15:28.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.967+0000 7fef1e009640 1 -- start start 2023-10-14T11:15:28.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.967+0000 7fef1e009640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fef1806cbc0 0x7fef18164680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.967+0000 7fef1e009640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef180c8a20 con 0x7fef181595a0 2023-10-14T11:15:28.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.967+0000 7fef1e009640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef180c8c10 con 0x7fef18159980 2023-10-14T11:15:28.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.967+0000 7fef1e009640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef1815e300 con 0x7fef1806cbc0 2023-10-14T11:15:28.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.967+0000 7fef17fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fef1806cbc0 0x7fef18164680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.967+0000 7fef177fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fef181595a0 0x7fef1806c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52896/0 (socket says 172.21.15.26:52896) 2023-10-14T11:15:28.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.967+0000 7fef17fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fef1806cbc0 0x7fef18164680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35048/0 (socket says 172.21.15.26:35048) 2023-10-14T11:15:28.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.967+0000 7fef177fe640 1 -- 172.21.15.26:0/1212430472 learned_addr learned my addr 172.21.15.26:0/1212430472 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:28.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.967+0000 7fef17fff640 1 -- 172.21.15.26:0/1212430472 >> v1:172.21.15.110:6789/0 conn(0x7fef18159980 legacy=0x7fef180b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.967+0000 7fef17fff640 1 -- 172.21.15.26:0/1212430472 >> v1:172.21.15.26:6789/0 conn(0x7fef181595a0 legacy=0x7fef1806c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.967+0000 7fef17fff640 1 -- 172.21.15.26:0/1212430472 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef180c8ef0 con 0x7fef1806cbc0 2023-10-14T11:15:28.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.967+0000 7fef167fc640 1 -- 172.21.15.26:0/1212430472 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618106710 0 0) 0x7fef180c8a20 con 0x7fef181595a0 2023-10-14T11:15:28.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.971+0000 7fef17fff640 1 --2- 172.21.15.26:0/1212430472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef1806cbc0 0x7fef18164680 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fef10009d90 tx=0x7fef1001c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d16e24f9e71dba server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:28.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.971+0000 7fef167fc640 1 -- 172.21.15.26:0/1212430472 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef100a58c0 con 0x7fef1806cbc0 2023-10-14T11:15:28.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.971+0000 7fef167fc640 1 -- 172.21.15.26:0/1212430472 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef100a5a20 con 0x7fef1806cbc0 2023-10-14T11:15:28.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.971+0000 7fef167fc640 1 -- 172.21.15.26:0/1212430472 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef100a5db0 con 0x7fef1806cbc0 2023-10-14T11:15:28.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.971+0000 7fef1e009640 1 -- 172.21.15.26:0/1212430472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef1806cbc0 msgr2=0x7fef18164680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.971+0000 7fef1e009640 1 --2- 172.21.15.26:0/1212430472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef1806cbc0 0x7fef18164680 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fef10009d90 tx=0x7fef1001c800 comp rx=0 tx=0).stop 2023-10-14T11:15:28.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.971+0000 7fef1e009640 1 -- 172.21.15.26:0/1212430472 shutdown_connections 2023-10-14T11:15:28.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.971+0000 7fef1e009640 1 --2- 172.21.15.26:0/1212430472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef1806cbc0 0x7fef18164680 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.971+0000 7fef1e009640 1 -- 172.21.15.26:0/1212430472 >> 172.21.15.26:0/1212430472 conn(0x7fef1806a820 msgr2=0x7fef180b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:28.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.971+0000 7fef1e009640 1 -- 172.21.15.26:0/1212430472 shutdown_connections 2023-10-14T11:15:28.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.971+0000 7fef1e009640 1 -- 172.21.15.26:0/1212430472 wait complete. 2023-10-14T11:15:28.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.971+0000 7fef1e009640 1 Processor -- start 2023-10-14T11:15:28.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.971+0000 7fef1e009640 1 -- start start 2023-10-14T11:15:28.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7fef1e009640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef1806cbc0 0x7fef1814c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7fef1e009640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef181595a0 0x7fef18071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7fef1e009640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef180718d0 0x7fef18167cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7fef1e009640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef18071d80 con 0x7fef180718d0 2023-10-14T11:15:28.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7fef1e009640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef18168a30 con 0x7fef1806cbc0 2023-10-14T11:15:28.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7fef1e009640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef18168d10 con 0x7fef181595a0 2023-10-14T11:15:28.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7fef17fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef180718d0 0x7fef18167cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7fef17fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef180718d0 0x7fef18167cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35050/0 (socket says 172.21.15.26:35050) 2023-10-14T11:15:28.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7fef17fff640 1 -- 172.21.15.26:0/1934891957 learned_addr learned my addr 172.21.15.26:0/1934891957 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:28.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7fef16ffd640 1 --2- 172.21.15.26:0/1934891957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef181595a0 0x7fef18071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7fef177fe640 1 --2- 172.21.15.26:0/1934891957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef1806cbc0 0x7fef1814c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7fef17fff640 1 -- 172.21.15.26:0/1934891957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef181595a0 msgr2=0x7fef18071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7fef17fff640 1 --2- 172.21.15.26:0/1934891957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef181595a0 0x7fef18071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7fef17fff640 1 -- 172.21.15.26:0/1934891957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef1806cbc0 msgr2=0x7fef1814c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:28.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7fef17fff640 1 --2- 172.21.15.26:0/1934891957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef1806cbc0 0x7fef1814c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:28.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7fef17fff640 1 -- 172.21.15.26:0/1934891957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef10009a70 con 0x7fef180718d0 2023-10-14T11:15:28.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7fef177fe640 1 --2- 172.21.15.26:0/1934891957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef1806cbc0 0x7fef1814c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:28.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7fef17fff640 1 --2- 172.21.15.26:0/1934891957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef180718d0 0x7fef18167cc0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fef1001a430 tx=0x7fef100195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:28.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7feefffff640 1 -- 172.21.15.26:0/1934891957 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef100b9860 con 0x7fef180718d0 2023-10-14T11:15:28.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7feefffff640 1 -- 172.21.15.26:0/1934891957 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef100b99c0 con 0x7fef180718d0 2023-10-14T11:15:28.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7feefffff640 1 -- 172.21.15.26:0/1934891957 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef100b9d30 con 0x7fef180718d0 2023-10-14T11:15:28.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7fef1e009640 1 -- 172.21.15.26:0/1934891957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef18168ff0 con 0x7fef180718d0 2023-10-14T11:15:28.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7fef1e009640 1 -- 172.21.15.26:0/1934891957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef181695b0 con 0x7fef180718d0 2023-10-14T11:15:28.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.975+0000 7fef1e009640 1 -- 172.21.15.26:0/1934891957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef180c9790 con 0x7fef180718d0 2023-10-14T11:15:28.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.979+0000 7feefffff640 1 -- 172.21.15.26:0/1934891957 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fef100ad440 con 0x7fef180718d0 2023-10-14T11:15:28.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.979+0000 7feefffff640 1 --2- 172.21.15.26:0/1934891957 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fef040664a0 0x7fef04068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.979+0000 7feefffff640 1 -- 172.21.15.26:0/1934891957 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fef1011f1e0 con 0x7fef180718d0 2023-10-14T11:15:28.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.979+0000 7fef177fe640 1 --2- 172.21.15.26:0/1934891957 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fef040664a0 0x7fef04068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.979+0000 7feefffff640 1 --2- 172.21.15.26:0/1934891957 >> [v2:172.21.15.110:6816/3205286209,v1:172.21.15.110:6817/3205286209] conn(0x7fef0406c7a0 0x7fef0406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:28.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.979+0000 7feefffff640 1 -- 172.21.15.26:0/1934891957 --> [v2:172.21.15.110:6816/3205286209,v1:172.21.15.110:6817/3205286209] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef0406f2b0 con 0x7fef0406c7a0 2023-10-14T11:15:28.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.979+0000 7feefffff640 1 -- 172.21.15.26:0/1934891957 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef101217c0 con 0x7fef180718d0 2023-10-14T11:15:28.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.979+0000 7fef16ffd640 1 --2- 172.21.15.26:0/1934891957 >> [v2:172.21.15.110:6816/3205286209,v1:172.21.15.110:6817/3205286209] conn(0x7fef0406c7a0 0x7fef0406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:28.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.979+0000 7fef177fe640 1 --2- 172.21.15.26:0/1934891957 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fef040664a0 0x7fef04068960 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fef08000f70 tx=0x7fef08009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:28.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.979+0000 7fef16ffd640 1 --2- 172.21.15.26:0/1934891957 >> [v2:172.21.15.110:6816/3205286209,v1:172.21.15.110:6817/3205286209] conn(0x7fef0406c7a0 0x7fef0406ebe0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:28.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.979+0000 7feefffff640 1 -- 172.21.15.26:0/1934891957 <== osd.7 v2:172.21.15.110:6816/3205286209 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fef0406f2b0 con 0x7fef0406c7a0 2023-10-14T11:15:29.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.995+0000 7fef1e009640 1 -- 172.21.15.26:0/1934891957 --> [v2:172.21.15.110:6816/3205286209,v1:172.21.15.110:6817/3205286209] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fef1815a5a0 con 0x7fef0406c7a0 2023-10-14T11:15:29.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.995+0000 7feefffff640 1 -- 172.21.15.26:0/1934891957 <== osd.7 v2:172.21.15.110:6816/3205286209 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fef1815a5a0 con 0x7fef0406c7a0 2023-10-14T11:15:29.001 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-14T11:15:29.001 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T11:15:29.002 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-14T11:15:29.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.995+0000 7fef1e009640 1 -- 172.21.15.26:0/1934891957 >> [v2:172.21.15.110:6816/3205286209,v1:172.21.15.110:6817/3205286209] conn(0x7fef0406c7a0 msgr2=0x7fef0406ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:29.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.995+0000 7fef1e009640 1 --2- 172.21.15.26:0/1934891957 >> [v2:172.21.15.110:6816/3205286209,v1:172.21.15.110:6817/3205286209] conn(0x7fef0406c7a0 0x7fef0406ebe0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:29.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.995+0000 7fef1e009640 1 -- 172.21.15.26:0/1934891957 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fef040664a0 msgr2=0x7fef04068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:29.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.995+0000 7fef1e009640 1 --2- 172.21.15.26:0/1934891957 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fef040664a0 0x7fef04068960 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fef08000f70 tx=0x7fef08009040 comp rx=0 tx=0).stop 2023-10-14T11:15:29.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.995+0000 7fef1e009640 1 -- 172.21.15.26:0/1934891957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef180718d0 msgr2=0x7fef18167cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:29.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.995+0000 7fef1e009640 1 --2- 172.21.15.26:0/1934891957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef180718d0 0x7fef18167cc0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fef1001a430 tx=0x7fef100195a0 comp rx=0 tx=0).stop 2023-10-14T11:15:29.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.995+0000 7fef17fff640 1 -- 172.21.15.26:0/1934891957 reap_dead start 2023-10-14T11:15:29.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.995+0000 7fef1e009640 1 -- 172.21.15.26:0/1934891957 shutdown_connections 2023-10-14T11:15:29.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.995+0000 7fef1e009640 1 -- 172.21.15.26:0/1934891957 >> 172.21.15.26:0/1934891957 conn(0x7fef1806a820 msgr2=0x7fef18150420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:29.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.995+0000 7fef1e009640 1 -- 172.21.15.26:0/1934891957 shutdown_connections 2023-10-14T11:15:29.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:28.995+0000 7fef1e009640 1 -- 172.21.15.26:0/1934891957 wait complete. 2023-10-14T11:15:29.021 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-14T11:15:29.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.159+0000 7f483351d640 1 Processor -- start 2023-10-14T11:15:29.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.159+0000 7f483351d640 1 -- start start 2023-10-14T11:15:29.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.159+0000 7f483351d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f482c164520 0x7f482c0ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:29.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.159+0000 7f483351d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482c0c96f0 con 0x7f482c0b07f0 2023-10-14T11:15:29.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.159+0000 7f483351d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482c0cb950 con 0x7f482c0ad960 2023-10-14T11:15:29.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.159+0000 7f483351d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f482c164900 con 0x7f482c164520 2023-10-14T11:15:29.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.159+0000 7f48312b9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f482c164520 0x7f482c0ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:29.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.159+0000 7f4831aba640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f482c0b07f0 0x7f482c0cc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52906/0 (socket says 172.21.15.26:52906) 2023-10-14T11:15:29.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.159+0000 7f4831aba640 1 -- 172.21.15.26:0/3825167497 learned_addr learned my addr 172.21.15.26:0/3825167497 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:29.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.159+0000 7f48312b9640 1 -- 172.21.15.26:0/3825167497 >> v1:172.21.15.110:6789/0 conn(0x7f482c0ad960 legacy=0x7f482c0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:29.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.159+0000 7f48312b9640 1 -- 172.21.15.26:0/3825167497 >> v1:172.21.15.26:6789/0 conn(0x7f482c0b07f0 legacy=0x7f482c0cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:29.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.163+0000 7f48312b9640 1 -- 172.21.15.26:0/3825167497 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c0cbed0 con 0x7f482c164520 2023-10-14T11:15:29.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.159+0000 7f4823fff640 1 -- 172.21.15.26:0/3825167497 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239456796 0 0) 0x7f482c0c96f0 con 0x7f482c0b07f0 2023-10-14T11:15:29.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.163+0000 7f48312b9640 1 --2- 172.21.15.26:0/3825167497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f482c164520 0x7f482c0ce010 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f48280097c0 tx=0x7f482801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb5a0fcf3e571fd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:29.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.163+0000 7f4823fff640 1 -- 172.21.15.26:0/3825167497 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48280ab670 con 0x7f482c164520 2023-10-14T11:15:29.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.163+0000 7f4823fff640 1 -- 172.21.15.26:0/3825167497 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48280ab7d0 con 0x7f482c164520 2023-10-14T11:15:29.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.163+0000 7f4823fff640 1 -- 172.21.15.26:0/3825167497 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48280abb60 con 0x7f482c164520 2023-10-14T11:15:29.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.163+0000 7f483351d640 1 -- 172.21.15.26:0/3825167497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f482c164520 msgr2=0x7f482c0ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:29.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.163+0000 7f483351d640 1 --2- 172.21.15.26:0/3825167497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f482c164520 0x7f482c0ce010 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f48280097c0 tx=0x7f482801c450 comp rx=0 tx=0).stop 2023-10-14T11:15:29.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.163+0000 7f483351d640 1 -- 172.21.15.26:0/3825167497 shutdown_connections 2023-10-14T11:15:29.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.163+0000 7f483351d640 1 --2- 172.21.15.26:0/3825167497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f482c164520 0x7f482c0ce010 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:29.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.163+0000 7f483351d640 1 -- 172.21.15.26:0/3825167497 >> 172.21.15.26:0/3825167497 conn(0x7f482c06c190 msgr2=0x7f482c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:29.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.163+0000 7f483351d640 1 -- 172.21.15.26:0/3825167497 shutdown_connections 2023-10-14T11:15:29.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.163+0000 7f483351d640 1 -- 172.21.15.26:0/3825167497 wait complete. 2023-10-14T11:15:29.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f483351d640 1 Processor -- start 2023-10-14T11:15:29.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f483351d640 1 -- start start 2023-10-14T11:15:29.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f483351d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f482c0ad960 0x7f482c0c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:29.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f483351d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f482c0b07f0 0x7f482c0c2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:29.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f483351d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f482c164520 0x7f482c0c2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:29.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f483351d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c15d1c0 con 0x7f482c164520 2023-10-14T11:15:29.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f483351d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c0c2d10 con 0x7f482c0ad960 2023-10-14T11:15:29.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f483351d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482c0c2ff0 con 0x7f482c0b07f0 2023-10-14T11:15:29.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f4831aba640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f482c164520 0x7f482c0c2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:29.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f4831aba640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f482c164520 0x7f482c0c2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35072/0 (socket says 172.21.15.26:35072) 2023-10-14T11:15:29.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f4831aba640 1 -- 172.21.15.26:0/2143687999 learned_addr learned my addr 172.21.15.26:0/2143687999 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:29.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f48312b9640 1 --2- 172.21.15.26:0/2143687999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f482c0ad960 0x7f482c0c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:29.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f4830ab8640 1 --2- 172.21.15.26:0/2143687999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f482c0b07f0 0x7f482c0c2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:29.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f4831aba640 1 -- 172.21.15.26:0/2143687999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f482c0b07f0 msgr2=0x7f482c0c2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:29.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f4831aba640 1 --2- 172.21.15.26:0/2143687999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f482c0b07f0 0x7f482c0c2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:29.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f4831aba640 1 -- 172.21.15.26:0/2143687999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f482c0ad960 msgr2=0x7f482c0c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:29.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f4831aba640 1 --2- 172.21.15.26:0/2143687999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f482c0ad960 0x7f482c0c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:29.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f4831aba640 1 -- 172.21.15.26:0/2143687999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4828009420 con 0x7f482c164520 2023-10-14T11:15:29.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f4830ab8640 1 --2- 172.21.15.26:0/2143687999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f482c0b07f0 0x7f482c0c2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:29.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f4831aba640 1 --2- 172.21.15.26:0/2143687999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f482c164520 0x7f482c0c2690 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f482400c780 tx=0x7f482400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:29.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f4821ffb640 1 -- 172.21.15.26:0/2143687999 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482400ce30 con 0x7f482c164520 2023-10-14T11:15:29.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f4821ffb640 1 -- 172.21.15.26:0/2143687999 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482400a640 con 0x7f482c164520 2023-10-14T11:15:29.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f4821ffb640 1 -- 172.21.15.26:0/2143687999 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482400a9f0 con 0x7f482c164520 2023-10-14T11:15:29.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.167+0000 7f483351d640 1 -- 172.21.15.26:0/2143687999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f482c0c32d0 con 0x7f482c164520 2023-10-14T11:15:29.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.171+0000 7f483351d640 1 -- 172.21.15.26:0/2143687999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f482c0c3890 con 0x7f482c164520 2023-10-14T11:15:29.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.171+0000 7f483351d640 1 -- 172.21.15.26:0/2143687999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f482c074010 con 0x7f482c164520 2023-10-14T11:15:29.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.171+0000 7f4821ffb640 1 -- 172.21.15.26:0/2143687999 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f482400ab50 con 0x7f482c164520 2023-10-14T11:15:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.171+0000 7f4821ffb640 1 --2- 172.21.15.26:0/2143687999 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f48100664f0 0x7f48100689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.171+0000 7f4821ffb640 1 -- 172.21.15.26:0/2143687999 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4824083500 con 0x7f482c164520 2023-10-14T11:15:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.171+0000 7f48312b9640 1 --2- 172.21.15.26:0/2143687999 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f48100664f0 0x7f48100689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.171+0000 7f48312b9640 1 --2- 172.21.15.26:0/2143687999 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f48100664f0 0x7f48100689b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f48280af000 tx=0x7f48280a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:29.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.175+0000 7f4821ffb640 1 -- 172.21.15.26:0/2143687999 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4824050bd0 con 0x7f482c164520 2023-10-14T11:15:29.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.335+0000 7f483351d640 1 -- 172.21.15.26:0/2143687999 --> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f482c16ee30 con 0x7f48100664f0 2023-10-14T11:15:29.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.335+0000 7f4821ffb640 1 -- 172.21.15.26:0/2143687999 <== mgr.4101 v2:172.21.15.26:6832/4136446821 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f48280ab9c0 con 0x7f48100664f0 2023-10-14T11:15:29.342 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 7 to deep-scrub 2023-10-14T11:15:29.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.339+0000 7f483351d640 1 -- 172.21.15.26:0/2143687999 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f48100664f0 msgr2=0x7f48100689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:29.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.339+0000 7f483351d640 1 --2- 172.21.15.26:0/2143687999 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f48100664f0 0x7f48100689b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f48280af000 tx=0x7f48280a7000 comp rx=0 tx=0).stop 2023-10-14T11:15:29.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.339+0000 7f483351d640 1 -- 172.21.15.26:0/2143687999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f482c164520 msgr2=0x7f482c0c2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:29.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.339+0000 7f483351d640 1 --2- 172.21.15.26:0/2143687999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f482c164520 0x7f482c0c2690 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f482400c780 tx=0x7f482400cc40 comp rx=0 tx=0).stop 2023-10-14T11:15:29.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.339+0000 7f483351d640 1 -- 172.21.15.26:0/2143687999 shutdown_connections 2023-10-14T11:15:29.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.339+0000 7f483351d640 1 --2- 172.21.15.26:0/2143687999 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f48100664f0 0x7f48100689b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:29.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.339+0000 7f483351d640 1 --2- 172.21.15.26:0/2143687999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f482c164520 0x7f482c0c2690 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:29.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.339+0000 7f483351d640 1 --2- 172.21.15.26:0/2143687999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f482c0b07f0 0x7f482c0c2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:29.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.339+0000 7f483351d640 1 --2- 172.21.15.26:0/2143687999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f482c0ad960 0x7f482c0c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:29.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.339+0000 7f483351d640 1 -- 172.21.15.26:0/2143687999 >> 172.21.15.26:0/2143687999 conn(0x7f482c06c190 msgr2=0x7f482c0cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:29.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.339+0000 7f483351d640 1 -- 172.21.15.26:0/2143687999 shutdown_connections 2023-10-14T11:15:29.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.339+0000 7f483351d640 1 -- 172.21.15.26:0/2143687999 wait complete. 2023-10-14T11:15:29.363 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:15:29.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.499+0000 7f681b479640 1 Processor -- start 2023-10-14T11:15:29.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.499+0000 7f681b479640 1 -- start start 2023-10-14T11:15:29.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.499+0000 7f681b479640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f68140b07f0 0x7f68140ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:29.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.499+0000 7f681b479640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68140c96f0 con 0x7f68140ad960 2023-10-14T11:15:29.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.499+0000 7f681b479640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68140cb950 con 0x7f6814164520 2023-10-14T11:15:29.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.499+0000 7f681b479640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6814164900 con 0x7f68140b07f0 2023-10-14T11:15:29.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.499+0000 7f6818a14640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f68140ad960 0x7f68140cc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52922/0 (socket says 172.21.15.26:52922) 2023-10-14T11:15:29.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.499+0000 7f6818a14640 1 -- 172.21.15.26:0/2382502169 learned_addr learned my addr 172.21.15.26:0/2382502169 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:29.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.503+0000 7f6819a16640 1 --2- 172.21.15.26:0/2382502169 >> v2:172.21.15.110:3300/0 conn(0x7f68140b07f0 0x7f68140ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:29.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.503+0000 7f680bfff640 1 -- 172.21.15.26:0/2382502169 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563426927 0 0) 0x7f68140c96f0 con 0x7f68140ad960 2023-10-14T11:15:29.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.503+0000 7f680bfff640 1 -- 172.21.15.26:0/2382502169 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6800003530 con 0x7f68140ad960 2023-10-14T11:15:29.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.503+0000 7f680bfff640 1 -- 172.21.15.26:0/2382502169 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177150365 0 0) 0x7f68140cb950 con 0x7f6814164520 2023-10-14T11:15:29.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.503+0000 7f680bfff640 1 -- 172.21.15.26:0/2382502169 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68140c96f0 con 0x7f6814164520 2023-10-14T11:15:29.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.503+0000 7f6819a16640 1 -- 172.21.15.26:0/2382502169 >> v1:172.21.15.110:6789/0 conn(0x7f6814164520 legacy=0x7f68140b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:29.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.503+0000 7f6819a16640 1 -- 172.21.15.26:0/2382502169 >> v1:172.21.15.26:6789/0 conn(0x7f68140ad960 legacy=0x7f68140cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:29.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.503+0000 7f6819a16640 1 -- 172.21.15.26:0/2382502169 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68140cbed0 con 0x7f68140b07f0 2023-10-14T11:15:29.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.503+0000 7f6819a16640 1 --2- 172.21.15.26:0/2382502169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68140b07f0 0x7f68140ce010 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f680c009d90 tx=0x7f680c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3461179cd359269 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:29.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.503+0000 7f680bfff640 1 -- 172.21.15.26:0/2382502169 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c0a5a00 con 0x7f68140b07f0 2023-10-14T11:15:29.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.503+0000 7f680bfff640 1 -- 172.21.15.26:0/2382502169 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680c0a5b60 con 0x7f68140b07f0 2023-10-14T11:15:29.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.503+0000 7f680bfff640 1 -- 172.21.15.26:0/2382502169 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c0ad440 con 0x7f68140b07f0 2023-10-14T11:15:29.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f681b479640 1 -- 172.21.15.26:0/2382502169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68140b07f0 msgr2=0x7f68140ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:29.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f681b479640 1 --2- 172.21.15.26:0/2382502169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68140b07f0 0x7f68140ce010 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f680c009d90 tx=0x7f680c01c920 comp rx=0 tx=0).stop 2023-10-14T11:15:29.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f681b479640 1 -- 172.21.15.26:0/2382502169 shutdown_connections 2023-10-14T11:15:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f681b479640 1 --2- 172.21.15.26:0/2382502169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68140b07f0 0x7f68140ce010 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f681b479640 1 -- 172.21.15.26:0/2382502169 >> 172.21.15.26:0/2382502169 conn(0x7f681406c190 msgr2=0x7f681406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f681b479640 1 -- 172.21.15.26:0/2382502169 shutdown_connections 2023-10-14T11:15:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f681b479640 1 -- 172.21.15.26:0/2382502169 wait complete. 2023-10-14T11:15:29.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f681b479640 1 Processor -- start 2023-10-14T11:15:29.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f681b479640 1 -- start start 2023-10-14T11:15:29.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f681b479640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68140ad960 0x7f6814151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:29.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f681b479640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68140b07f0 0x7f68140b1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:29.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f681b479640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6814164520 0x7f6814162a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:29.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f681b479640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68141516a0 con 0x7f68140ad960 2023-10-14T11:15:29.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f681b479640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68140b2bf0 con 0x7f68140b07f0 2023-10-14T11:15:29.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f681b479640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68140b1fe0 con 0x7f6814164520 2023-10-14T11:15:29.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f6819215640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68140ad960 0x7f6814151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:29.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f6819215640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68140ad960 0x7f6814151160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35074/0 (socket says 172.21.15.26:35074) 2023-10-14T11:15:29.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f6819215640 1 -- 172.21.15.26:0/1558969973 learned_addr learned my addr 172.21.15.26:0/1558969973 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:29.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f6818a14640 1 --2- 172.21.15.26:0/1558969973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68140b07f0 0x7f68140b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:29.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f6819215640 1 -- 172.21.15.26:0/1558969973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6814164520 msgr2=0x7f6814162a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:29.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f6819215640 1 --2- 172.21.15.26:0/1558969973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6814164520 0x7f6814162a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:29.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f6819215640 1 -- 172.21.15.26:0/1558969973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68140b07f0 msgr2=0x7f68140b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:29.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f6819215640 1 --2- 172.21.15.26:0/1558969973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68140b07f0 0x7f68140b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:29.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f6819215640 1 -- 172.21.15.26:0/1558969973 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c009a70 con 0x7f68140ad960 2023-10-14T11:15:29.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.507+0000 7f6818a14640 1 --2- 172.21.15.26:0/1558969973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68140b07f0 0x7f68140b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:15:29.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.511+0000 7f6819215640 1 --2- 172.21.15.26:0/1558969973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68140ad960 0x7f6814151160 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f681000c3d0 tx=0x7f681000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:29.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.511+0000 7f6809ffb640 1 -- 172.21.15.26:0/1558969973 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68100052d0 con 0x7f68140ad960 2023-10-14T11:15:29.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.511+0000 7f6809ffb640 1 -- 172.21.15.26:0/1558969973 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6810005450 con 0x7f68140ad960 2023-10-14T11:15:29.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.511+0000 7f681b479640 1 -- 172.21.15.26:0/1558969973 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68140b22c0 con 0x7f68140ad960 2023-10-14T11:15:29.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.511+0000 7f6809ffb640 1 -- 172.21.15.26:0/1558969973 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6810003840 con 0x7f68140ad960 2023-10-14T11:15:29.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.511+0000 7f681b479640 1 -- 172.21.15.26:0/1558969973 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68140b2880 con 0x7f68140ad960 2023-10-14T11:15:29.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.511+0000 7f681b479640 1 -- 172.21.15.26:0/1558969973 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68140b3060 con 0x7f68140ad960 2023-10-14T11:15:29.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.511+0000 7f6809ffb640 1 -- 172.21.15.26:0/1558969973 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f68100039a0 con 0x7f68140ad960 2023-10-14T11:15:29.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.511+0000 7f6809ffb640 1 --2- 172.21.15.26:0/1558969973 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f67f80664a0 0x7f67f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:29.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.511+0000 7f6809ffb640 1 -- 172.21.15.26:0/1558969973 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f6810083220 con 0x7f68140ad960 2023-10-14T11:15:29.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.511+0000 7f6818a14640 1 --2- 172.21.15.26:0/1558969973 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f67f80664a0 0x7f67f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:29.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.515+0000 7f6818a14640 1 --2- 172.21.15.26:0/1558969973 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f67f80664a0 0x7f67f8068960 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6814072300 tx=0x7f6804009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:29.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.515+0000 7f6809ffb640 1 -- 172.21.15.26:0/1558969973 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f68100508f0 con 0x7f68140ad960 2023-10-14T11:15:29.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.671+0000 7f681b479640 1 -- 172.21.15.26:0/1558969973 --> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f681416ee30 con 0x7f67f80664a0 2023-10-14T11:15:29.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.671+0000 7f6809ffb640 1 -- 172.21.15.26:0/1558969973 <== mgr.4101 v2:172.21.15.26:6832/4136446821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50776 (secure 0 0 0) 0x7f6804001c90 con 0x7f67f80664a0 2023-10-14T11:15:29.680 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:15:29.680 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-14T11:15:29.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.675+0000 7f681b479640 1 -- 172.21.15.26:0/1558969973 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f67f80664a0 msgr2=0x7f67f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:29.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.675+0000 7f681b479640 1 --2- 172.21.15.26:0/1558969973 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f67f80664a0 0x7f67f8068960 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6814072300 tx=0x7f6804009040 comp rx=0 tx=0).stop 2023-10-14T11:15:29.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.675+0000 7f681b479640 1 -- 172.21.15.26:0/1558969973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68140ad960 msgr2=0x7f6814151160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:29.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.675+0000 7f681b479640 1 --2- 172.21.15.26:0/1558969973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68140ad960 0x7f6814151160 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f681000c3d0 tx=0x7f681000c890 comp rx=0 tx=0).stop 2023-10-14T11:15:29.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.675+0000 7f681b479640 1 -- 172.21.15.26:0/1558969973 shutdown_connections 2023-10-14T11:15:29.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.675+0000 7f681b479640 1 --2- 172.21.15.26:0/1558969973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6814164520 0x7f6814162a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:29.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.675+0000 7f681b479640 1 --2- 172.21.15.26:0/1558969973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68140b07f0 0x7f68140b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:29.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.675+0000 7f681b479640 1 --2- 172.21.15.26:0/1558969973 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f67f80664a0 0x7f67f8068960 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:29.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.675+0000 7f681b479640 1 --2- 172.21.15.26:0/1558969973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68140ad960 0x7f6814151160 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:29.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.675+0000 7f681b479640 1 -- 172.21.15.26:0/1558969973 >> 172.21.15.26:0/1558969973 conn(0x7f681406c190 msgr2=0x7f68140cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:29.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.675+0000 7f681b479640 1 -- 172.21.15.26:0/1558969973 shutdown_connections 2023-10-14T11:15:29.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:29.675+0000 7f681b479640 1 -- 172.21.15.26:0/1558969973 wait complete. 2023-10-14T11:15:29.700 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2023-10-14T11:15:28.199097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":59,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":256124,"kb_used_data":6664,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718596,"statfs":{"total":773094113280,"available":772831842304,"internally_reserved":0,"allocated":6823936,"data_stored":3686680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":255315512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.242801"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-14T11:15:19.528070+0000","last_change":"2023-10-14T11:12:12.162289+0000","last_active":"2023-10-14T11:15:19.528070+0000","last_peered":"2023-10-14T11:15:19.528070+0000","last_clean":"2023-10-14T11:15:19.528070+0000","last_became_active":"2023-10-14T11:12:12.161055+0000","last_became_peered":"2023-10-14T11:12:12.161055+0000","last_unstale":"2023-10-14T11:15:19.528070+0000","last_undegraded":"2023-10-14T11:15:19.528070+0000","last_fullsized":"2023-10-14T11:15:19.528070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:12:10.853576+0000","last_clean_scrub_stamp":"2023-10-14T11:12:10.853576+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:52.154107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1298432,"data_stored":903611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.77300000000000002,"15min":0.82699999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.96999999999999997,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.65800000000000003},"min":{"1min":0.42199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78700000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.94899999999999995}]},{"osd":1,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88400000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90500000000000003,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.86399999999999999}]},{"osd":2,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.81799999999999995,"15min":0.85599999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93799999999999994,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78300000000000003,"15min":0.81100000000000005},"min":{"1min":0.52600000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.91000000000000003,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.83899999999999997}]},{"osd":3,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.77100000000000002,"15min":0.81699999999999995},"min":{"1min":0.499,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84999999999999998,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.82999999999999996,"15min":0.873},"min":{"1min":0.502,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0129999999999999,"5min":3.5489999999999999,"15min":3.5489999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65900000000000003,"15min":0.66100000000000003},"min":{"1min":0.45300000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89200000000000002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.52100000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92200000000000004,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.67300000000000004}]},{"osd":5,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69599999999999995,"15min":0.70199999999999996},"min":{"1min":0.437,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.876,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.749,"15min":0.76200000000000001},"min":{"1min":0.60899999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92100000000000004,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.0189999999999999}]},{"osd":6,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.81399999999999995},"min":{"1min":0.53800000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96999999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.76200000000000001,"15min":0.78800000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.94499999999999995,"5min":1.395,"15min":1.395},"last":0.90000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31868,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":704512,"data_stored":313243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.69299999999999995,"15min":0.71599999999999997},"min":{"1min":0.441,"5min":0.315,"15min":0.315},"max":{"1min":0.93300000000000005,"5min":1.244,"15min":1.244},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74399999999999999,"15min":0.76100000000000001},"min":{"1min":0.56399999999999995,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95599999999999996,"5min":1.331,"15min":1.331},"last":0.79200000000000004}]},{"osd":1,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.52000000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.94599999999999995,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68600000000000005,"15min":0.70199999999999996},"min":{"1min":0.46400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.024,"5min":1.304,"15min":1.304},"last":0.69999999999999996}]},{"osd":2,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.69799999999999995,"15min":0.72599999999999998},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96999999999999997,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73599999999999999,"15min":0.75700000000000001},"min":{"1min":0.49399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.91600000000000004,"5min":1.845,"15min":1.845},"last":0.89800000000000002}]},{"osd":3,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.76500000000000001,"15min":0.80000000000000004},"min":{"1min":0.53000000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98199999999999998,"5min":1.627,"15min":1.627},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.48399999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.016,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.755}]},{"osd":4,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.69499999999999995,"15min":0.71099999999999997},"min":{"1min":0.41399999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.98999999999999999,"5min":1.206,"15min":1.206},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0600000000000001,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.57899999999999996}]},{"osd":5,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.45700000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88100000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72199999999999998,"15min":0.73299999999999998},"min":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0089999999999999,"5min":1.425,"15min":1.425},"last":0.77400000000000002}]},{"osd":7,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.747,"15min":0.77600000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98999999999999999,"5min":1.502,"15min":1.502},"last":0.63},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.75800000000000001,"15min":0.78100000000000003},"min":{"1min":0.57099999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.93899999999999995,"5min":1.609,"15min":1.609},"last":0.82799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31872,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":704512,"data_stored":313243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.42799999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.3210000000000002,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.028}]},{"osd":1,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.72499999999999998,"15min":0.70699999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.6600000000000001,"5min":2.6600000000000001,"15min":2.6600000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.45100000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.83399999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.89700000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.56200000000000006,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68500000000000005,"15min":0.68899999999999995},"min":{"1min":0.52700000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.872,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.95599999999999996}]},{"osd":3,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.50800000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0169999999999999,"5min":1.22,"15min":1.22},"last":0.93799999999999994}]},{"osd":4,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89000000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68400000000000005,"15min":0.67200000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":0.96799999999999997}]},{"osd":6,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69399999999999995,"15min":0.69099999999999995},"min":{"1min":0.504,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91700000000000004,"5min":0.995,"15min":0.995},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.51500000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94099999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":1.2}]},{"osd":7,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.45000000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.55100000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97299999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":1.131}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31872,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":704512,"data_stored":313243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70399999999999996,"15min":0.72299999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96199999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68999999999999995,"15min":0.69699999999999995},"min":{"1min":0.498,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96599999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.65800000000000003}]},{"osd":1,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76100000000000001,"15min":0.78300000000000003},"min":{"1min":0.56299999999999994,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90700000000000003,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.76700000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.77400000000000002,"15min":0.80700000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98599999999999999,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.54000000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.91600000000000004,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.83299999999999996}]},{"osd":3,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73899999999999999,"15min":0.746},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0669999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77500000000000002,"15min":0.78500000000000003},"min":{"1min":0.61699999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.052,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.61199999999999999}]},{"osd":5,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70199999999999996,"15min":0.72199999999999998},"min":{"1min":0.41499999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.875,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67500000000000004,"15min":0.68200000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.024,"5min":1.349,"15min":1.349},"last":0.53700000000000003}]},{"osd":6,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88400000000000001,"5min":1.306,"15min":1.306},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.75900000000000001,"15min":0.78700000000000003},"min":{"1min":0.52000000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88900000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.53600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":1.071,"5min":1.163,"15min":1.163},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.83899999999999997,"15min":0.86199999999999999},"min":{"1min":0.67400000000000004,"5min":0.504,"15min":0.504},"max":{"1min":0.94299999999999995,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.78700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31868,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":704512,"data_stored":313243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44600000000000001,"15min":0.46300000000000002},"min":{"1min":0.26600000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.69199999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.439},{"interface":"front","average":{"1min":0.441,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.28299999999999997,"5min":0.255,"15min":0.255},"max":{"1min":0.61099999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.54500000000000004}]},{"osd":1,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45800000000000002,"15min":0.47799999999999998},"min":{"1min":0.30199999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54200000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52700000000000002,"15min":0.54300000000000004},"min":{"1min":0.41899999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66500000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.52300000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.50900000000000001,"15min":0.52100000000000002},"min":{"1min":0.38100000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.61299999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58299999999999996,"15min":0.60299999999999998},"min":{"1min":0.36499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83199999999999996,"5min":1.018,"15min":1.018},"last":0.57399999999999995}]},{"osd":4,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.747,"15min":0.78100000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.95899999999999996,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.751,"15min":0.77300000000000002},"min":{"1min":0.56499999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.67400000000000004}]},{"osd":5,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.76000000000000001,"15min":0.78100000000000003},"min":{"1min":0.53600000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":1.375,"15min":1.375},"last":0.748},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77100000000000002,"15min":0.79900000000000004},"min":{"1min":0.503,"5min":0.442,"15min":0.442},"max":{"1min":0.92300000000000004,"5min":1.286,"15min":1.286},"last":0.72599999999999998}]},{"osd":6,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76700000000000002,"15min":0.79000000000000004},"min":{"1min":0.55500000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0069999999999999,"5min":1.46,"15min":1.46},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77500000000000002,"15min":0.80300000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.878,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.78600000000000003}]},{"osd":7,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.53400000000000003,"5min":0.503,"15min":0.503},"max":{"1min":0.94799999999999995,"5min":1.222,"15min":1.222},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.90700000000000003,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.76900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31868,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":704512,"data_stored":313243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.45300000000000001,"15min":0.47899999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56000000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48399999999999999,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71599999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.40100000000000002}]},{"osd":1,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.53800000000000003,"15min":0.55700000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75800000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77700000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.46100000000000002}]},{"osd":3,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47499999999999998,"15min":0.48599999999999999},"min":{"1min":0.32700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69399999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55300000000000005,"15min":0.57499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.75,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.48399999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.80400000000000005},"min":{"1min":0.59199999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.98699999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.754,"15min":0.77100000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.67500000000000004}]},{"osd":5,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.76300000000000001,"15min":0.78500000000000003},"min":{"1min":0.495,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.80200000000000005,"15min":0.83599999999999997},"min":{"1min":0.54000000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.70799999999999996}]},{"osd":6,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.629,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0920000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.82899999999999996,"15min":0.87},"min":{"1min":0.5,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.286,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.78100000000000003}]},{"osd":7,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.82999999999999996,"15min":0.85699999999999998},"min":{"1min":0.56799999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.262,"5min":1.3,"15min":1.3},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.83199999999999996,"15min":0.86099999999999999},"min":{"1min":0.57899999999999996,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.83199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31872,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":704512,"data_stored":313243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40100000000000002,"15min":0.40899999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.66000000000000003,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54900000000000004,"15min":0.56299999999999994},"min":{"1min":0.442,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.78700000000000003,"5min":1.244,"15min":1.244},"last":0.53300000000000003}]},{"osd":2,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.44,"15min":0.433},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.53900000000000003,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.46500000000000002,"15min":0.46800000000000003},"min":{"1min":0.34599999999999997,"5min":0.31,"15min":0.31},"max":{"1min":0.69999999999999996,"5min":0.753,"15min":0.753},"last":0.43099999999999999}]},{"osd":3,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.377,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73199999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55300000000000005,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85399999999999998,"5min":1.081,"15min":1.081},"last":0.55900000000000005}]},{"osd":4,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77100000000000002,"15min":0.78900000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.075,"5min":1.629,"15min":1.629},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77800000000000002,"15min":0.79500000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.98799999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.628}]},{"osd":5,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.54600000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.099,"5min":1.296,"15min":1.296},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.78000000000000003,"15min":0.81100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93300000000000005,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":0.51900000000000002}]},{"osd":6,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73799999999999999,"15min":0.752},"min":{"1min":0.56000000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.006,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.78400000000000003,"15min":0.80800000000000005},"min":{"1min":0.60699999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0109999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.71399999999999997}]},{"osd":7,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.81299999999999994,"15min":0.83899999999999997},"min":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1519999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.75900000000000001,"15min":0.78600000000000003},"min":{"1min":0.55000000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.042,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.58999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1298432,"data_stored":903611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44800000000000001,"15min":0.46200000000000002},"min":{"1min":0.29899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.40400000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.67600000000000005}]},{"osd":2,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52500000000000002,"15min":0.54000000000000004},"min":{"1min":0.36499999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45400000000000001,"15min":0.46400000000000002},"min":{"1min":0.32900000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68100000000000005,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.61299999999999999}]},{"osd":3,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.502,"15min":0.51800000000000002},"min":{"1min":0.35899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.61799999999999999,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89000000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.76800000000000002}]},{"osd":4,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.63100000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.64000000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.048,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.1240000000000001}]},{"osd":5,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.65700000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.77300000000000002,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.0169999999999999}]},{"osd":6,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.81499999999999995,"15min":0.82899999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78300000000000003,"15min":0.80800000000000005},"min":{"1min":0.59599999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.127,"5min":1.536,"15min":1.536},"last":1.0649999999999999}]},{"osd":7,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":0.89900000000000002,"15min":0.877},"min":{"1min":0.54700000000000004,"5min":0.501,"15min":0.501},"max":{"1min":7.0880000000000001,"5min":7.0880000000000001,"15min":7.0880000000000001},"last":1.002},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.79100000000000004,"15min":0.80200000000000005},"min":{"1min":0.63500000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.0780000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:15:29.703 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T11:12:10.853576+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=10, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:15:29.704 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T11:15:49.705 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:15:49.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.850+0000 7fdbb3a6b640 1 Processor -- start 2023-10-14T11:15:49.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.854+0000 7fdbb3a6b640 1 -- start start 2023-10-14T11:15:49.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.854+0000 7fdbb3a6b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdbac15cb30 0x7fdbac1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:49.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.854+0000 7fdbb3a6b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdbac065a80 0x7fdbac160e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:49.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.854+0000 7fdbb3a6b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbac15cf10 0x7fdbac161370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:49.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.854+0000 7fdbb3a6b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbac0ccbd0 con 0x7fdbac065a80 2023-10-14T11:15:49.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.854+0000 7fdbb3a6b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbac06b180 con 0x7fdbac15cb30 2023-10-14T11:15:49.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.854+0000 7fdbb3a6b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac06b460 con 0x7fdbac15cf10 2023-10-14T11:15:49.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.854+0000 7fdbb1006640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdbac065a80 0x7fdbac160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:49.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.854+0000 7fdbb1006640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdbac065a80 0x7fdbac160e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55800/0 (socket says 172.21.15.26:55800) 2023-10-14T11:15:49.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.854+0000 7fdbb1006640 1 -- 172.21.15.26:0/870010997 learned_addr learned my addr 172.21.15.26:0/870010997 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:49.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.854+0000 7fdbb1807640 1 --2- 172.21.15.26:0/870010997 >> v2:172.21.15.110:3300/0 conn(0x7fdbac15cb30 0x7fdbac1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:49.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.854+0000 7fdbb2008640 1 --2- 172.21.15.26:0/870010997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbac15cf10 0x7fdbac161370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:49.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.854+0000 7fdbb1006640 1 -- 172.21.15.26:0/870010997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbac15cf10 msgr2=0x7fdbac161370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:49.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.854+0000 7fdbb1006640 1 --2- 172.21.15.26:0/870010997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbac15cf10 0x7fdbac161370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:49.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.854+0000 7fdbb1006640 1 -- 172.21.15.26:0/870010997 >> v2:172.21.15.110:3300/0 conn(0x7fdbac15cb30 msgr2=0x7fdbac1608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:49.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.854+0000 7fdbb1006640 1 --2- 172.21.15.26:0/870010997 >> v2:172.21.15.110:3300/0 conn(0x7fdbac15cb30 0x7fdbac1608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:49.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.854+0000 7fdbb1006640 1 -- 172.21.15.26:0/870010997 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac06c6e0 con 0x7fdbac065a80 2023-10-14T11:15:49.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.858+0000 7fdbb1006640 1 --2- 172.21.15.26:0/870010997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbac065a80 0x7fdbac160e30 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fdbac072640 tx=0x7fdb9c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c6107a99b0c321 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:49.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.858+0000 7fdbb0805640 1 -- 172.21.15.26:0/870010997 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c0ac600 con 0x7fdbac065a80 2023-10-14T11:15:49.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.858+0000 7fdbb0805640 1 -- 172.21.15.26:0/870010997 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c0a8050 con 0x7fdbac065a80 2023-10-14T11:15:49.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.858+0000 7fdbb0805640 1 -- 172.21.15.26:0/870010997 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c0ac980 con 0x7fdbac065a80 2023-10-14T11:15:49.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.858+0000 7fdbb3a6b640 1 -- 172.21.15.26:0/870010997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbac065a80 msgr2=0x7fdbac160e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:49.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.858+0000 7fdbb3a6b640 1 --2- 172.21.15.26:0/870010997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbac065a80 0x7fdbac160e30 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fdbac072640 tx=0x7fdb9c01c440 comp rx=0 tx=0).stop 2023-10-14T11:15:49.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.858+0000 7fdbb3a6b640 1 -- 172.21.15.26:0/870010997 shutdown_connections 2023-10-14T11:15:49.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.858+0000 7fdbb3a6b640 1 --2- 172.21.15.26:0/870010997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbac15cf10 0x7fdbac161370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:49.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.858+0000 7fdbb3a6b640 1 --2- 172.21.15.26:0/870010997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbac065a80 0x7fdbac160e30 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:49.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.858+0000 7fdbb3a6b640 1 --2- 172.21.15.26:0/870010997 >> v2:172.21.15.110:3300/0 conn(0x7fdbac15cb30 0x7fdbac1608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:49.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.858+0000 7fdbb3a6b640 1 -- 172.21.15.26:0/870010997 >> 172.21.15.26:0/870010997 conn(0x7fdbac0b0880 msgr2=0x7fdbac0b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:49.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.858+0000 7fdbb3a6b640 1 -- 172.21.15.26:0/870010997 shutdown_connections 2023-10-14T11:15:49.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.858+0000 7fdbb3a6b640 1 -- 172.21.15.26:0/870010997 wait complete. 2023-10-14T11:15:49.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.858+0000 7fdbb3a6b640 1 Processor -- start 2023-10-14T11:15:49.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.858+0000 7fdbb3a6b640 1 -- start start 2023-10-14T11:15:49.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdbb3a6b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbac065a80 0x7fdbac0cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:49.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdbb3a6b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbac15cb30 0x7fdbac09f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:49.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdbb3a6b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbac15cf10 0x7fdbac153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:49.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdbb3a6b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac0a00a0 con 0x7fdbac065a80 2023-10-14T11:15:49.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdbb3a6b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac09fe00 con 0x7fdbac15cb30 2023-10-14T11:15:49.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdbb3a6b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac0b1990 con 0x7fdbac15cf10 2023-10-14T11:15:49.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdbb1807640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbac065a80 0x7fdbac0cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:49.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdbb1807640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbac065a80 0x7fdbac0cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55806/0 (socket says 172.21.15.26:55806) 2023-10-14T11:15:49.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdbb1807640 1 -- 172.21.15.26:0/415094899 learned_addr learned my addr 172.21.15.26:0/415094899 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:49.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdbb1006640 1 --2- 172.21.15.26:0/415094899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbac15cb30 0x7fdbac09f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:49.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdbb2008640 1 --2- 172.21.15.26:0/415094899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbac15cf10 0x7fdbac153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:49.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdbb1807640 1 -- 172.21.15.26:0/415094899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbac15cf10 msgr2=0x7fdbac153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:49.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdbb1807640 1 --2- 172.21.15.26:0/415094899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbac15cf10 0x7fdbac153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:49.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdbb1807640 1 -- 172.21.15.26:0/415094899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbac15cb30 msgr2=0x7fdbac09f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:49.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdbb1807640 1 --2- 172.21.15.26:0/415094899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbac15cb30 0x7fdbac09f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:49.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdbb1807640 1 -- 172.21.15.26:0/415094899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c0094d0 con 0x7fdbac065a80 2023-10-14T11:15:49.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdbb1006640 1 --2- 172.21.15.26:0/415094899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbac15cb30 0x7fdbac09f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:49.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdbb2008640 1 --2- 172.21.15.26:0/415094899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbac15cf10 0x7fdbac153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:15:49.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdbb1807640 1 --2- 172.21.15.26:0/415094899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbac065a80 0x7fdbac0cb270 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fdba800e8b0 tx=0x7fdba800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:49.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdba27fc640 1 -- 172.21.15.26:0/415094899 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba800c940 con 0x7fdbac065a80 2023-10-14T11:15:49.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdba27fc640 1 -- 172.21.15.26:0/415094899 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba800caa0 con 0x7fdbac065a80 2023-10-14T11:15:49.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdba27fc640 1 -- 172.21.15.26:0/415094899 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba800ce30 con 0x7fdbac065a80 2023-10-14T11:15:49.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdbb3a6b640 1 -- 172.21.15.26:0/415094899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbac0b1c70 con 0x7fdbac065a80 2023-10-14T11:15:49.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdbb3a6b640 1 -- 172.21.15.26:0/415094899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbac0b2230 con 0x7fdbac065a80 2023-10-14T11:15:49.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdbb3a6b640 1 -- 172.21.15.26:0/415094899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbac074010 con 0x7fdbac065a80 2023-10-14T11:15:49.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.862+0000 7fdba27fc640 1 -- 172.21.15.26:0/415094899 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdba8013470 con 0x7fdbac065a80 2023-10-14T11:15:49.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.866+0000 7fdba27fc640 1 --2- 172.21.15.26:0/415094899 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdb900664a0 0x7fdb90068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:49.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.866+0000 7fdba27fc640 1 -- 172.21.15.26:0/415094899 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fdba8083f00 con 0x7fdbac065a80 2023-10-14T11:15:49.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.866+0000 7fdbb1006640 1 --2- 172.21.15.26:0/415094899 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdb900664a0 0x7fdb90068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:49.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.866+0000 7fdbb1006640 1 --2- 172.21.15.26:0/415094899 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdb900664a0 0x7fdb90068960 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0ae000 tx=0x7fdb9c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:49.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:49.870+0000 7fdba27fc640 1 -- 172.21.15.26:0/415094899 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdba80514a0 con 0x7fdbac065a80 2023-10-14T11:15:49.919 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:15:49.923 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:15:50.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.022+0000 7fdbb3a6b640 1 -- 172.21.15.26:0/415094899 --> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdbac0b4d10 con 0x7fdb900664a0 2023-10-14T11:15:50.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.026+0000 7fdba27fc640 1 -- 172.21.15.26:0/415094899 <== mgr.4101 v2:172.21.15.26:6832/4136446821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50727 (secure 0 0 0) 0x7fdbac0b4d10 con 0x7fdb900664a0 2023-10-14T11:15:50.034 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:15:50.035 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-14T11:15:50.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.030+0000 7fdbb3a6b640 1 -- 172.21.15.26:0/415094899 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdb900664a0 msgr2=0x7fdb90068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:50.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.030+0000 7fdbb3a6b640 1 --2- 172.21.15.26:0/415094899 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdb900664a0 0x7fdb90068960 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0ae000 tx=0x7fdb9c008040 comp rx=0 tx=0).stop 2023-10-14T11:15:50.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.030+0000 7fdbb3a6b640 1 -- 172.21.15.26:0/415094899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbac065a80 msgr2=0x7fdbac0cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:50.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.030+0000 7fdbb3a6b640 1 --2- 172.21.15.26:0/415094899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbac065a80 0x7fdbac0cb270 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fdba800e8b0 tx=0x7fdba800ed70 comp rx=0 tx=0).stop 2023-10-14T11:15:50.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.030+0000 7fdbb3a6b640 1 -- 172.21.15.26:0/415094899 shutdown_connections 2023-10-14T11:15:50.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.030+0000 7fdbb3a6b640 1 --2- 172.21.15.26:0/415094899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbac15cf10 0x7fdbac153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:50.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.030+0000 7fdbb3a6b640 1 --2- 172.21.15.26:0/415094899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbac15cb30 0x7fdbac09f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:50.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.030+0000 7fdbb3a6b640 1 --2- 172.21.15.26:0/415094899 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7fdb900664a0 0x7fdb90068960 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:50.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.030+0000 7fdbb3a6b640 1 --2- 172.21.15.26:0/415094899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbac065a80 0x7fdbac0cb270 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:50.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.030+0000 7fdbb3a6b640 1 -- 172.21.15.26:0/415094899 >> 172.21.15.26:0/415094899 conn(0x7fdbac0b0880 msgr2=0x7fdbac0c5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:50.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.030+0000 7fdbb3a6b640 1 -- 172.21.15.26:0/415094899 shutdown_connections 2023-10-14T11:15:50.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.030+0000 7fdbb3a6b640 1 -- 172.21.15.26:0/415094899 wait complete. 2023-10-14T11:15:50.055 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2023-10-14T11:15:48.203293+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":256108,"kb_used_data":6664,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718612,"statfs":{"total":773094113280,"available":772831858688,"internally_reserved":0,"allocated":6823936,"data_stored":3686680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":255315512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002544"},"pg_stats":[{"pgid":"1.0","version":"58'119","reported_seq":207,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-14T11:15:31.612215+0000","last_change":"2023-10-14T11:15:31.612303+0000","last_active":"2023-10-14T11:15:31.612215+0000","last_peered":"2023-10-14T11:15:31.612215+0000","last_clean":"2023-10-14T11:15:31.612215+0000","last_became_active":"2023-10-14T11:12:12.161055+0000","last_became_peered":"2023-10-14T11:12:12.161055+0000","last_unstale":"2023-10-14T11:15:31.612215+0000","last_undegraded":"2023-10-14T11:15:31.612215+0000","last_fullsized":"2023-10-14T11:15:31.612215+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'119","last_scrub_stamp":"2023-10-14T11:15:31.612112+0000","last_deep_scrub":"58'119","last_deep_scrub_stamp":"2023-10-14T11:15:31.612112+0000","last_clean_scrub_stamp":"2023-10-14T11:15:31.612112+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:57.674208+0000","scrub_duration":0.0076104359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1298432,"data_stored":903611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.77300000000000002,"15min":0.82699999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.96999999999999997,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.65800000000000003},"min":{"1min":0.42199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78700000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.81200000000000006}]},{"osd":1,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88400000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90500000000000003,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.67700000000000005}]},{"osd":2,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.81799999999999995,"15min":0.85599999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93799999999999994,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78300000000000003,"15min":0.81100000000000005},"min":{"1min":0.52600000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.91000000000000003,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.73099999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.77100000000000002,"15min":0.81699999999999995},"min":{"1min":0.499,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84999999999999998,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.82999999999999996,"15min":0.873},"min":{"1min":0.502,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0129999999999999,"5min":3.5489999999999999,"15min":3.5489999999999999},"last":0.83499999999999996}]},{"osd":4,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65900000000000003,"15min":0.66100000000000003},"min":{"1min":0.45300000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89200000000000002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.52100000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92200000000000004,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.65300000000000002}]},{"osd":5,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69599999999999995,"15min":0.70199999999999996},"min":{"1min":0.437,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.876,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.749,"15min":0.76200000000000001},"min":{"1min":0.60899999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92100000000000004,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.63}]},{"osd":6,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.81399999999999995},"min":{"1min":0.53800000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96999999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.76200000000000001,"15min":0.78800000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.94499999999999995,"5min":1.395,"15min":1.395},"last":0.54300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31868,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":704512,"data_stored":313243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.69299999999999995,"15min":0.71599999999999997},"min":{"1min":0.441,"5min":0.315,"15min":0.315},"max":{"1min":0.93300000000000005,"5min":1.244,"15min":1.244},"last":0.753},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74399999999999999,"15min":0.76100000000000001},"min":{"1min":0.56399999999999995,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95599999999999996,"5min":1.331,"15min":1.331},"last":0.69499999999999995}]},{"osd":1,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.52000000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.94599999999999995,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68600000000000005,"15min":0.70199999999999996},"min":{"1min":0.46400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.024,"5min":1.304,"15min":1.304},"last":0.71799999999999997}]},{"osd":2,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.69799999999999995,"15min":0.72599999999999998},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96999999999999997,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73599999999999999,"15min":0.75700000000000001},"min":{"1min":0.49399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.91600000000000004,"5min":1.845,"15min":1.845},"last":0.77900000000000003}]},{"osd":3,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.76500000000000001,"15min":0.80000000000000004},"min":{"1min":0.53000000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98199999999999998,"5min":1.627,"15min":1.627},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.48399999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.016,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.69499999999999995,"15min":0.71099999999999997},"min":{"1min":0.41399999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.98999999999999999,"5min":1.206,"15min":1.206},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0600000000000001,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.82399999999999995}]},{"osd":5,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.45700000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88100000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72199999999999998,"15min":0.73299999999999998},"min":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0089999999999999,"5min":1.425,"15min":1.425},"last":0.85699999999999998}]},{"osd":7,"last update":"Sat Oct 14 11:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.747,"15min":0.77600000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98999999999999999,"5min":1.502,"15min":1.502},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.75800000000000001,"15min":0.78100000000000003},"min":{"1min":0.57099999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.93899999999999995,"5min":1.609,"15min":1.609},"last":0.83499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31872,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":704512,"data_stored":313243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.42799999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.3210000000000002,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":0.69499999999999995}]},{"osd":1,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.72499999999999998,"15min":0.70699999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.6600000000000001,"5min":2.6600000000000001,"15min":2.6600000000000001},"last":0.745},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.45100000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.83399999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.85999999999999999}]},{"osd":2,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.56200000000000006,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68500000000000005,"15min":0.68899999999999995},"min":{"1min":0.52700000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.872,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.88700000000000001}]},{"osd":3,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.50800000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0169999999999999,"5min":1.22,"15min":1.22},"last":0.91900000000000004}]},{"osd":4,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89000000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68400000000000005,"15min":0.67200000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":0.81299999999999994}]},{"osd":6,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69399999999999995,"15min":0.69099999999999995},"min":{"1min":0.504,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91700000000000004,"5min":0.995,"15min":0.995},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.51500000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94099999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.83499999999999996}]},{"osd":7,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.45000000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.55100000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97299999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.95799999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31872,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":704512,"data_stored":313243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70399999999999996,"15min":0.72299999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96199999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68999999999999995,"15min":0.69699999999999995},"min":{"1min":0.498,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96599999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.69399999999999995}]},{"osd":1,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76100000000000001,"15min":0.78300000000000003},"min":{"1min":0.56299999999999994,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90700000000000003,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.77400000000000002,"15min":0.80700000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98599999999999999,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.54000000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.91600000000000004,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.74199999999999999}]},{"osd":3,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73899999999999999,"15min":0.746},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0669999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77500000000000002,"15min":0.78500000000000003},"min":{"1min":0.61699999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.052,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.82999999999999996}]},{"osd":5,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70199999999999996,"15min":0.72199999999999998},"min":{"1min":0.41499999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.875,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.437},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67500000000000004,"15min":0.68200000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.024,"5min":1.349,"15min":1.349},"last":0.65400000000000003}]},{"osd":6,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88400000000000001,"5min":1.306,"15min":1.306},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.75900000000000001,"15min":0.78700000000000003},"min":{"1min":0.52000000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88900000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.49299999999999999}]},{"osd":7,"last update":"Sat Oct 14 11:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.53600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":1.071,"5min":1.163,"15min":1.163},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.83899999999999997,"15min":0.86199999999999999},"min":{"1min":0.67400000000000004,"5min":0.504,"15min":0.504},"max":{"1min":0.94299999999999995,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.625}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31868,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":704512,"data_stored":313243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44600000000000001,"15min":0.46300000000000002},"min":{"1min":0.26600000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.69199999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.441,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.28299999999999997,"5min":0.255,"15min":0.255},"max":{"1min":0.61099999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.65400000000000003}]},{"osd":1,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45800000000000002,"15min":0.47799999999999998},"min":{"1min":0.30199999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54200000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52700000000000002,"15min":0.54300000000000004},"min":{"1min":0.41899999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66500000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.76900000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.50900000000000001,"15min":0.52100000000000002},"min":{"1min":0.38100000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.61299999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58299999999999996,"15min":0.60299999999999998},"min":{"1min":0.36499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83199999999999996,"5min":1.018,"15min":1.018},"last":0.70999999999999996}]},{"osd":4,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.747,"15min":0.78100000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.95899999999999996,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.751,"15min":0.77300000000000002},"min":{"1min":0.56499999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.81200000000000006}]},{"osd":5,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.76000000000000001,"15min":0.78100000000000003},"min":{"1min":0.53600000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":1.375,"15min":1.375},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77100000000000002,"15min":0.79900000000000004},"min":{"1min":0.503,"5min":0.442,"15min":0.442},"max":{"1min":0.92300000000000004,"5min":1.286,"15min":1.286},"last":0.95999999999999996}]},{"osd":6,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76700000000000002,"15min":0.79000000000000004},"min":{"1min":0.55500000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0069999999999999,"5min":1.46,"15min":1.46},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77500000000000002,"15min":0.80300000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.878,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.89600000000000002}]},{"osd":7,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.53400000000000003,"5min":0.503,"15min":0.503},"max":{"1min":0.94799999999999995,"5min":1.222,"15min":1.222},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.90700000000000003,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.84499999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31868,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":704512,"data_stored":313243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.45300000000000001,"15min":0.47899999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56000000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48399999999999999,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71599999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.41199999999999998}]},{"osd":1,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.53800000000000003,"15min":0.55700000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75800000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77700000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.59799999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47499999999999998,"15min":0.48599999999999999},"min":{"1min":0.32700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69399999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55300000000000005,"15min":0.57499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.75,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.47599999999999998}]},{"osd":4,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.80400000000000005},"min":{"1min":0.59199999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.98699999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.754,"15min":0.77100000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.55500000000000005}]},{"osd":5,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.76300000000000001,"15min":0.78500000000000003},"min":{"1min":0.495,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.80200000000000005,"15min":0.83599999999999997},"min":{"1min":0.54000000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.68000000000000005}]},{"osd":6,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.629,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0920000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.82899999999999996,"15min":0.87},"min":{"1min":0.5,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.286,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.56999999999999995}]},{"osd":7,"last update":"Sat Oct 14 11:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.82999999999999996,"15min":0.85699999999999998},"min":{"1min":0.56799999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.262,"5min":1.3,"15min":1.3},"last":0.63},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.83199999999999996,"15min":0.86099999999999999},"min":{"1min":0.57899999999999996,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.64500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31872,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":704512,"data_stored":313243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40100000000000002,"15min":0.40899999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.66000000000000003,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54900000000000004,"15min":0.56299999999999994},"min":{"1min":0.442,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.78700000000000003,"5min":1.244,"15min":1.244},"last":0.70099999999999996}]},{"osd":2,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.44,"15min":0.433},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.53900000000000003,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.496},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.46500000000000002,"15min":0.46800000000000003},"min":{"1min":0.34599999999999997,"5min":0.31,"15min":0.31},"max":{"1min":0.69999999999999996,"5min":0.753,"15min":0.753},"last":0.67000000000000004}]},{"osd":3,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.377,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73199999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55300000000000005,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85399999999999998,"5min":1.081,"15min":1.081},"last":0.63900000000000001}]},{"osd":4,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77100000000000002,"15min":0.78900000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.075,"5min":1.629,"15min":1.629},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77800000000000002,"15min":0.79500000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.98799999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.86099999999999999}]},{"osd":5,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.54600000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.099,"5min":1.296,"15min":1.296},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.78000000000000003,"15min":0.81100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93300000000000005,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":0.89500000000000002}]},{"osd":6,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73799999999999999,"15min":0.752},"min":{"1min":0.56000000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.006,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.78400000000000003,"15min":0.80800000000000005},"min":{"1min":0.60699999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0109999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.88300000000000001}]},{"osd":7,"last update":"Sat Oct 14 11:15:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.81299999999999994,"15min":0.83899999999999997},"min":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1519999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.75900000000000001,"15min":0.78600000000000003},"min":{"1min":0.55000000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.042,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.81499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1298432,"data_stored":903611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44800000000000001,"15min":0.46200000000000002},"min":{"1min":0.29899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.40400000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.54300000000000004}]},{"osd":2,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52500000000000002,"15min":0.54000000000000004},"min":{"1min":0.36499999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45400000000000001,"15min":0.46400000000000002},"min":{"1min":0.32900000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68100000000000005,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.45200000000000001}]},{"osd":3,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.502,"15min":0.51800000000000002},"min":{"1min":0.35899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.61799999999999999,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89000000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.61499999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.63100000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.64000000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.048,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.88500000000000001}]},{"osd":5,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.65700000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.77300000000000002,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.93400000000000005}]},{"osd":6,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.81499999999999995,"15min":0.82899999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78300000000000003,"15min":0.80800000000000005},"min":{"1min":0.59599999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.127,"5min":1.536,"15min":1.536},"last":0.91500000000000004}]},{"osd":7,"last update":"Sat Oct 14 11:15:14 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":0.89900000000000002,"15min":0.877},"min":{"1min":0.54700000000000004,"5min":0.501,"15min":0.501},"max":{"1min":7.0880000000000001,"5min":7.0880000000000001,"15min":7.0880000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.79100000000000004,"15min":0.80200000000000005},"min":{"1min":0.63500000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.85699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:15:50.058 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-14T11:15:50.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.194+0000 7f73a273e640 1 Processor -- start 2023-10-14T11:15:50.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.194+0000 7f73a273e640 1 -- start start 2023-10-14T11:15:50.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.194+0000 7f73a273e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f739c0d1fa0 0x7f739c0b8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:50.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.194+0000 7f73a273e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f739c15d010 con 0x7f739c0cdf50 2023-10-14T11:15:50.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.194+0000 7f73a273e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f739c0b74d0 con 0x7f739c15cc30 2023-10-14T11:15:50.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.194+0000 7f73a273e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739c0b77b0 con 0x7f739c0d1fa0 2023-10-14T11:15:50.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.194+0000 7f739b7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f739c0d1fa0 0x7f739c0b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:50.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.194+0000 7f73a0cdb640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f739c0cdf50 0x7f739c0b5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42974/0 (socket says 172.21.15.26:42974) 2023-10-14T11:15:50.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.194+0000 7f73a0cdb640 1 -- 172.21.15.26:0/3294196265 learned_addr learned my addr 172.21.15.26:0/3294196265 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:50.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.194+0000 7f739b7fe640 1 -- 172.21.15.26:0/3294196265 >> v1:172.21.15.110:6789/0 conn(0x7f739c15cc30 legacy=0x7f739c0cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:50.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.194+0000 7f739b7fe640 1 -- 172.21.15.26:0/3294196265 >> v1:172.21.15.26:6789/0 conn(0x7f739c0cdf50 legacy=0x7f739c0b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.194+0000 7f739b7fe640 1 -- 172.21.15.26:0/3294196265 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739c0b7a90 con 0x7f739c0d1fa0 2023-10-14T11:15:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.198+0000 7f739b7fe640 1 --2- 172.21.15.26:0/3294196265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f739c0d1fa0 0x7f739c0b8780 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f73900097c0 tx=0x7f739001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84514e885ab29e94 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:50.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.198+0000 7f739affd640 1 -- 172.21.15.26:0/3294196265 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73900a8970 con 0x7f739c0d1fa0 2023-10-14T11:15:50.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.198+0000 7f739affd640 1 -- 172.21.15.26:0/3294196265 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73900a8ad0 con 0x7f739c0d1fa0 2023-10-14T11:15:50.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.198+0000 7f739affd640 1 -- 172.21.15.26:0/3294196265 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73900a8e60 con 0x7f739c0d1fa0 2023-10-14T11:15:50.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.198+0000 7f73a273e640 1 -- 172.21.15.26:0/3294196265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f739c0d1fa0 msgr2=0x7f739c0b8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:50.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.198+0000 7f73a273e640 1 --2- 172.21.15.26:0/3294196265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f739c0d1fa0 0x7f739c0b8780 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f73900097c0 tx=0x7f739001ec70 comp rx=0 tx=0).stop 2023-10-14T11:15:50.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.198+0000 7f73a273e640 1 -- 172.21.15.26:0/3294196265 shutdown_connections 2023-10-14T11:15:50.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.198+0000 7f73a273e640 1 --2- 172.21.15.26:0/3294196265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f739c0d1fa0 0x7f739c0b8780 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:50.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.198+0000 7f73a273e640 1 -- 172.21.15.26:0/3294196265 >> 172.21.15.26:0/3294196265 conn(0x7f739c06b750 msgr2=0x7f739c06bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:50.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.198+0000 7f73a273e640 1 -- 172.21.15.26:0/3294196265 shutdown_connections 2023-10-14T11:15:50.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.198+0000 7f73a273e640 1 -- 172.21.15.26:0/3294196265 wait complete. 2023-10-14T11:15:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f73a273e640 1 Processor -- start 2023-10-14T11:15:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f73a273e640 1 -- start start 2023-10-14T11:15:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f73a273e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f739c0cdf50 0x7f739c0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:50.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f73a273e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f739c0d1fa0 0x7f739c0c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:50.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f73a273e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f739c15cc30 0x7f739c14b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:50.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f73a273e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c14fab0 con 0x7f739c0d1fa0 2023-10-14T11:15:50.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f73a273e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c0c5db0 con 0x7f739c15cc30 2023-10-14T11:15:50.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f73a273e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739c0cc2f0 con 0x7f739c0cdf50 2023-10-14T11:15:50.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f739b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f739c0d1fa0 0x7f739c0c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:50.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f739b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f739c0d1fa0 0x7f739c0c52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55836/0 (socket says 172.21.15.26:55836) 2023-10-14T11:15:50.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f739b7fe640 1 -- 172.21.15.26:0/2727011621 learned_addr learned my addr 172.21.15.26:0/2727011621 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:50.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f739bfff640 1 --2- 172.21.15.26:0/2727011621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f739c0cdf50 0x7f739c0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:50.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f73a0cdb640 1 --2- 172.21.15.26:0/2727011621 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f739c15cc30 0x7f739c14b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:50.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f739b7fe640 1 -- 172.21.15.26:0/2727011621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f739c0cdf50 msgr2=0x7f739c0cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:50.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f739b7fe640 1 --2- 172.21.15.26:0/2727011621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f739c0cdf50 0x7f739c0cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:50.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f739b7fe640 1 -- 172.21.15.26:0/2727011621 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f739c15cc30 msgr2=0x7f739c14b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:50.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f739b7fe640 1 --2- 172.21.15.26:0/2727011621 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f739c15cc30 0x7f739c14b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:50.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f739b7fe640 1 -- 172.21.15.26:0/2727011621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7390009420 con 0x7f739c0d1fa0 2023-10-14T11:15:50.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f739b7fe640 1 --2- 172.21.15.26:0/2727011621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f739c0d1fa0 0x7f739c0c52d0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f73900b3040 tx=0x7f739001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:50.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f7398ff9640 1 -- 172.21.15.26:0/2727011621 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73900b9630 con 0x7f739c0d1fa0 2023-10-14T11:15:50.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f7398ff9640 1 -- 172.21.15.26:0/2727011621 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73900b97b0 con 0x7f739c0d1fa0 2023-10-14T11:15:50.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f7398ff9640 1 -- 172.21.15.26:0/2727011621 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73900b9b60 con 0x7f739c0d1fa0 2023-10-14T11:15:50.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f73a273e640 1 -- 172.21.15.26:0/2727011621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f739c0cc5d0 con 0x7f739c0d1fa0 2023-10-14T11:15:50.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.202+0000 7f73a273e640 1 -- 172.21.15.26:0/2727011621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f739c14fd00 con 0x7f739c0d1fa0 2023-10-14T11:15:50.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.206+0000 7f73a273e640 1 -- 172.21.15.26:0/2727011621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f739c067230 con 0x7f739c0d1fa0 2023-10-14T11:15:50.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.206+0000 7f7398ff9640 1 -- 172.21.15.26:0/2727011621 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f73900b7040 con 0x7f739c0d1fa0 2023-10-14T11:15:50.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.206+0000 7f7398ff9640 1 --2- 172.21.15.26:0/2727011621 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73880664a0 0x7f7388068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:50.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.206+0000 7f7398ff9640 1 -- 172.21.15.26:0/2727011621 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f7390121af0 con 0x7f739c0d1fa0 2023-10-14T11:15:50.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.206+0000 7f739bfff640 1 --2- 172.21.15.26:0/2727011621 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73880664a0 0x7f7388068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:50.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.210+0000 7f739bfff640 1 --2- 172.21.15.26:0/2727011621 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73880664a0 0x7f7388068960 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f738c007fd0 tx=0x7f738c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:50.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.210+0000 7f7398ff9640 1 -- 172.21.15.26:0/2727011621 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f73900ef270 con 0x7f739c0d1fa0 2023-10-14T11:15:50.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.370+0000 7f73a273e640 1 -- 172.21.15.26:0/2727011621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f739c0d30c0 con 0x7f739c0d1fa0 2023-10-14T11:15:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.374+0000 7f7398ff9640 1 -- 172.21.15.26:0/2727011621 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7f73900b5020 con 0x7f739c0d1fa0 2023-10-14T11:15:50.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.374+0000 7f7398ff9640 1 -- 172.21.15.26:0/2727011621 <== mon.0 v2:172.21.15.26:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7390121e90 con 0x7f739c0d1fa0 2023-10-14T11:15:50.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.378+0000 7f73a273e640 1 -- 172.21.15.26:0/2727011621 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73880664a0 msgr2=0x7f7388068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:50.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.378+0000 7f73a273e640 1 --2- 172.21.15.26:0/2727011621 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73880664a0 0x7f7388068960 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f738c007fd0 tx=0x7f738c009040 comp rx=0 tx=0).stop 2023-10-14T11:15:50.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.378+0000 7f73a273e640 1 -- 172.21.15.26:0/2727011621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f739c0d1fa0 msgr2=0x7f739c0c52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:50.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.378+0000 7f73a273e640 1 --2- 172.21.15.26:0/2727011621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f739c0d1fa0 0x7f739c0c52d0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f73900b3040 tx=0x7f739001ba10 comp rx=0 tx=0).stop 2023-10-14T11:15:50.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.378+0000 7f73a273e640 1 -- 172.21.15.26:0/2727011621 shutdown_connections 2023-10-14T11:15:50.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.378+0000 7f73a273e640 1 --2- 172.21.15.26:0/2727011621 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f739c15cc30 0x7f739c14b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:50.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.378+0000 7f73a273e640 1 --2- 172.21.15.26:0/2727011621 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f73880664a0 0x7f7388068960 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:50.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.378+0000 7f73a273e640 1 --2- 172.21.15.26:0/2727011621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f739c0d1fa0 0x7f739c0c52d0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:50.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.378+0000 7f73a273e640 1 --2- 172.21.15.26:0/2727011621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f739c0cdf50 0x7f739c0cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:50.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.378+0000 7f73a273e640 1 -- 172.21.15.26:0/2727011621 >> 172.21.15.26:0/2727011621 conn(0x7f739c06b750 msgr2=0x7f739c0b6420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:50.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.378+0000 7f73a273e640 1 -- 172.21.15.26:0/2727011621 shutdown_connections 2023-10-14T11:15:50.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.378+0000 7f73a273e640 1 -- 172.21.15.26:0/2727011621 wait complete. 2023-10-14T11:15:50.406 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T11:15:50.406 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:15:50.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.542+0000 7f59367d9640 1 Processor -- start 2023-10-14T11:15:50.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.542+0000 7f59367d9640 1 -- start start 2023-10-14T11:15:50.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.542+0000 7f59367d9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f59301597c0 0x7f59300ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:50.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.542+0000 7f59367d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59300adc10 0x7f59300cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:50.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.542+0000 7f59367d9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59300723d0 con 0x7f5930159ba0 2023-10-14T11:15:50.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.542+0000 7f59367d9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59300717c0 con 0x7f59301597c0 2023-10-14T11:15:50.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.542+0000 7f59367d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5930071aa0 con 0x7f59300adc10 2023-10-14T11:15:50.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.542+0000 7f592f7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5930159ba0 0x7f59300cae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42982/0 (socket says 172.21.15.26:42982) 2023-10-14T11:15:50.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.542+0000 7f592f7fe640 1 -- 172.21.15.26:0/1646068478 learned_addr learned my addr 172.21.15.26:0/1646068478 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-14T11:15:50.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.542+0000 7f592ffff640 1 --2- 172.21.15.26:0/1646068478 >> v2:172.21.15.110:3300/0 conn(0x7f59301597c0 0x7f59300ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:50.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.542+0000 7f5934d76640 1 --2- 172.21.15.26:0/1646068478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59300adc10 0x7f59300cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:50.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.542+0000 7f592effd640 1 -- 172.21.15.26:0/1646068478 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010172016 0 0) 0x7f59300723d0 con 0x7f5930159ba0 2023-10-14T11:15:50.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.542+0000 7f592effd640 1 -- 172.21.15.26:0/1646068478 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5918003530 con 0x7f5930159ba0 2023-10-14T11:15:50.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.542+0000 7f592ffff640 1 -- 172.21.15.26:0/1646068478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59300adc10 msgr2=0x7f59300cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:15:50.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.542+0000 7f592ffff640 1 --2- 172.21.15.26:0/1646068478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59300adc10 0x7f59300cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:50.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.542+0000 7f592ffff640 1 -- 172.21.15.26:0/1646068478 >> v1:172.21.15.26:6789/0 conn(0x7f5930159ba0 legacy=0x7f59300cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:50.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.542+0000 7f592ffff640 1 -- 172.21.15.26:0/1646068478 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5930071d80 con 0x7f59301597c0 2023-10-14T11:15:50.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.546+0000 7f592ffff640 1 --2- 172.21.15.26:0/1646068478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59301597c0 0x7f59300ad6d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f59200097c0 tx=0x7f592001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea30e67538143f2d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:50.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.546+0000 7f592effd640 1 -- 172.21.15.26:0/1646068478 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59200ab620 con 0x7f59301597c0 2023-10-14T11:15:50.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.546+0000 7f592effd640 1 -- 172.21.15.26:0/1646068478 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f59200ab780 con 0x7f59301597c0 2023-10-14T11:15:50.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.546+0000 7f592effd640 1 -- 172.21.15.26:0/1646068478 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59200abb30 con 0x7f59301597c0 2023-10-14T11:15:50.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f59367d9640 1 -- 172.21.15.26:0/1646068478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59301597c0 msgr2=0x7f59300ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:50.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f59367d9640 1 --2- 172.21.15.26:0/1646068478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59301597c0 0x7f59300ad6d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f59200097c0 tx=0x7f592001c480 comp rx=0 tx=0).stop 2023-10-14T11:15:50.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f59367d9640 1 -- 172.21.15.26:0/1646068478 shutdown_connections 2023-10-14T11:15:50.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f59367d9640 1 --2- 172.21.15.26:0/1646068478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59300adc10 0x7f59300cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:50.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f59367d9640 1 --2- 172.21.15.26:0/1646068478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59301597c0 0x7f59300ad6d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:50.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f59367d9640 1 -- 172.21.15.26:0/1646068478 >> 172.21.15.26:0/1646068478 conn(0x7f593006c190 msgr2=0x7f593006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:50.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f59367d9640 1 -- 172.21.15.26:0/1646068478 shutdown_connections 2023-10-14T11:15:50.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f59367d9640 1 -- 172.21.15.26:0/1646068478 wait complete. 2023-10-14T11:15:50.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f59367d9640 1 Processor -- start 2023-10-14T11:15:50.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f59367d9640 1 -- start start 2023-10-14T11:15:50.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f59367d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59300adc10 0x7f59301f7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:50.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f59367d9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59301597c0 0x7f5930157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:50.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f59367d9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5930159ba0 0x7f5930158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:50.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f59367d9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59301f5110 con 0x7f5930159ba0 2023-10-14T11:15:50.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f59367d9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59301f8490 con 0x7f59300adc10 2023-10-14T11:15:50.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f59367d9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593015b1f0 con 0x7f59301597c0 2023-10-14T11:15:50.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f5934d76640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5930159ba0 0x7f5930158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:50.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f5934d76640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5930159ba0 0x7f5930158170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55850/0 (socket says 172.21.15.26:55850) 2023-10-14T11:15:50.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f592ffff640 1 --2- 172.21.15.26:0/2497668063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59300adc10 0x7f59301f7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:50.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f5934d76640 1 -- 172.21.15.26:0/2497668063 learned_addr learned my addr 172.21.15.26:0/2497668063 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-14T11:15:50.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f592f7fe640 1 --2- 172.21.15.26:0/2497668063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59301597c0 0x7f5930157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:50.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f5934d76640 1 -- 172.21.15.26:0/2497668063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59301597c0 msgr2=0x7f5930157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:50.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f5934d76640 1 --2- 172.21.15.26:0/2497668063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59301597c0 0x7f5930157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:50.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f5934d76640 1 -- 172.21.15.26:0/2497668063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59300adc10 msgr2=0x7f59301f7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:50.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f5934d76640 1 --2- 172.21.15.26:0/2497668063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59300adc10 0x7f59301f7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:50.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.550+0000 7f5934d76640 1 -- 172.21.15.26:0/2497668063 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5920009420 con 0x7f5930159ba0 2023-10-14T11:15:50.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.554+0000 7f5934d76640 1 --2- 172.21.15.26:0/2497668063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5930159ba0 0x7f5930158170 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f592800efc0 tx=0x7f592800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:50.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.554+0000 7f592cff9640 1 -- 172.21.15.26:0/2497668063 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592800cd20 con 0x7f5930159ba0 2023-10-14T11:15:50.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.554+0000 7f592cff9640 1 -- 172.21.15.26:0/2497668063 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f592800f040 con 0x7f5930159ba0 2023-10-14T11:15:50.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.554+0000 7f592cff9640 1 -- 172.21.15.26:0/2497668063 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592800cea0 con 0x7f5930159ba0 2023-10-14T11:15:50.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.554+0000 7f59367d9640 1 -- 172.21.15.26:0/2497668063 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593015b4d0 con 0x7f5930159ba0 2023-10-14T11:15:50.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.554+0000 7f59367d9640 1 -- 172.21.15.26:0/2497668063 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593015ba90 con 0x7f5930159ba0 2023-10-14T11:15:50.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.554+0000 7f59367d9640 1 -- 172.21.15.26:0/2497668063 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59301f52e0 con 0x7f5930159ba0 2023-10-14T11:15:50.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.554+0000 7f592cff9640 1 -- 172.21.15.26:0/2497668063 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f59280148f0 con 0x7f5930159ba0 2023-10-14T11:15:50.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.554+0000 7f592cff9640 1 --2- 172.21.15.26:0/2497668063 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f591c0664d0 0x7f591c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:15:50.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.554+0000 7f592cff9640 1 -- 172.21.15.26:0/2497668063 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f5928084d90 con 0x7f5930159ba0 2023-10-14T11:15:50.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.554+0000 7f592ffff640 1 --2- 172.21.15.26:0/2497668063 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f591c0664d0 0x7f591c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:15:50.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.558+0000 7f592ffff640 1 --2- 172.21.15.26:0/2497668063 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f591c0664d0 0x7f591c068990 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f59200af000 tx=0x7f59200a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:15:50.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.558+0000 7f592cff9640 1 -- 172.21.15.26:0/2497668063 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5928052350 con 0x7f5930159ba0 2023-10-14T11:15:50.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.750+0000 7f59367d9640 1 -- 172.21.15.26:0/2497668063 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5930074010 con 0x7f5930159ba0 2023-10-14T11:15:50.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.750+0000 7f592cff9640 1 -- 172.21.15.26:0/2497668063 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f5928018070 con 0x7f5930159ba0 2023-10-14T11:15:50.758 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-14T11:15:50.759 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/633779909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":633779909},{"type":"v1","addr":"172.21.15.110:6834","nonce":633779909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5995,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3833036081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3833036081},{"type":"v1","addr":"172.21.15.110:6835","nonce":3833036081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":6144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2594736858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2594736858},{"type":"v1","addr":"172.21.15.26:6835","nonce":2594736858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":6591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/2917710717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2917710717},{"type":"v1","addr":"172.21.15.26:6837","nonce":2917710717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[]} 2023-10-14T11:15:50.760 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 28 2023-10-14T11:15:50.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.754+0000 7f59367d9640 1 -- 172.21.15.26:0/2497668063 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f591c0664d0 msgr2=0x7f591c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:50.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.754+0000 7f59367d9640 1 --2- 172.21.15.26:0/2497668063 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f591c0664d0 0x7f591c068990 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f59200af000 tx=0x7f59200a7000 comp rx=0 tx=0).stop 2023-10-14T11:15:50.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.754+0000 7f59367d9640 1 -- 172.21.15.26:0/2497668063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5930159ba0 msgr2=0x7f5930158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:15:50.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.754+0000 7f59367d9640 1 --2- 172.21.15.26:0/2497668063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5930159ba0 0x7f5930158170 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f592800efc0 tx=0x7f592800c490 comp rx=0 tx=0).stop 2023-10-14T11:15:50.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.754+0000 7f59367d9640 1 -- 172.21.15.26:0/2497668063 shutdown_connections 2023-10-14T11:15:50.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.754+0000 7f59367d9640 1 --2- 172.21.15.26:0/2497668063 >> [v2:172.21.15.26:6832/4136446821,v1:172.21.15.26:6833/4136446821] conn(0x7f591c0664d0 0x7f591c068990 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:50.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.754+0000 7f59367d9640 1 --2- 172.21.15.26:0/2497668063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5930159ba0 0x7f5930158170 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:50.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.754+0000 7f59367d9640 1 --2- 172.21.15.26:0/2497668063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59301597c0 0x7f5930157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:50.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.754+0000 7f59367d9640 1 --2- 172.21.15.26:0/2497668063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59300adc10 0x7f59301f7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:15:50.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.754+0000 7f59367d9640 1 -- 172.21.15.26:0/2497668063 >> 172.21.15.26:0/2497668063 conn(0x7f593006c190 msgr2=0x7f59300cb060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:15:50.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.754+0000 7f59367d9640 1 -- 172.21.15.26:0/2497668063 shutdown_connections 2023-10-14T11:15:50.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-14T11:15:50.754+0000 7f59367d9640 1 -- 172.21.15.26:0/2497668063 wait complete. 2023-10-14T11:15:50.780 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-14T11:15:50.781 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-14T11:15:50.781 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T11:15:50.782 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:15:50.794 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T11:15:50.794 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T11:15:50.795 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:15:50.848 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T11:15:50.849 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T11:15:50.850 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:15:50.864 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T11:15:50.864 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T11:15:50.865 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:15:50.919 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T11:15:50.920 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-14T11:15:50.920 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-14T11:15:50.920 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:15:50.973 INFO:tasks.ceph.osd.0:Stopped 2023-10-14T11:15:50.974 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-14T11:15:50.974 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:15:51.073 INFO:tasks.ceph.osd.1:Stopped 2023-10-14T11:15:51.073 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-14T11:15:51.074 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:15:51.175 INFO:tasks.ceph.osd.2:Stopped 2023-10-14T11:15:51.177 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-14T11:15:51.177 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:15:51.262 INFO:tasks.ceph.osd.3:Stopped 2023-10-14T11:15:51.263 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-14T11:15:51.263 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:15:51.340 INFO:tasks.ceph.osd.4:Stopped 2023-10-14T11:15:51.341 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-14T11:15:51.341 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:15:51.412 INFO:tasks.ceph.osd.5:Stopped 2023-10-14T11:15:51.413 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-14T11:15:51.413 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:15:56.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-10-14T11:15:57.515 INFO:tasks.ceph.osd.6:Stopped 2023-10-14T11:15:57.516 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-14T11:15:57.517 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:15:57.573 INFO:tasks.ceph.osd.7:Stopped 2023-10-14T11:15:57.574 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-14T11:15:57.574 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-14T11:15:57.574 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:15:57.633 INFO:tasks.ceph.mgr.y:Stopped 2023-10-14T11:15:57.635 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-14T11:15:57.635 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:15:57.687 INFO:tasks.ceph.mgr.x:Stopped 2023-10-14T11:15:57.688 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-14T11:15:57.688 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-14T11:15:57.689 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:15:57.708 INFO:tasks.ceph.mon.a:Stopped 2023-10-14T11:15:57.709 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-14T11:15:57.709 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:15:57.726 INFO:tasks.ceph.mon.b:Stopped 2023-10-14T11:15:57.727 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-14T11:15:57.727 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:15:57.785 INFO:tasks.ceph.mon.c:Stopped 2023-10-14T11:15:57.786 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-14T11:15:57.786 DEBUG:teuthology.orchestra.run.smithi026:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-14T11:15:57.819 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T11:15:57.820 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-14T11:15:58.018 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T11:15:58.019 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-14T11:15:58.178 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T11:15:58.178 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-14T11:15:58.320 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T11:15:58.320 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-14T11:15:58.462 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi110.front.sepia.ceph.com 2023-10-14T11:15:58.463 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-14T11:15:58.620 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi110.front.sepia.ceph.com 2023-10-14T11:15:58.621 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-14T11:15:58.827 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi110.front.sepia.ceph.com 2023-10-14T11:15:58.828 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-14T11:15:58.992 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi110.front.sepia.ceph.com 2023-10-14T11:15:58.992 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-14T11:15:59.194 INFO:tasks.ceph:Archiving mon data... 2023-10-14T11:15:59.195 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425250/data/mon.a.tgz 2023-10-14T11:15:59.196 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2023-10-14T11:15:59.205 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.R18gQj5bc2 2023-10-14T11:15:59.206 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.R18gQj5bc2 2023-10-14T11:15:59.346 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.R18gQj5bc2 2023-10-14T11:15:59.428 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.R18gQj5bc2 is 362KB 2023-10-14T11:15:59.494 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.R18gQj5bc2 2023-10-14T11:15:59.502 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425250/data/mon.b.tgz 2023-10-14T11:15:59.503 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2023-10-14T11:15:59.512 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.Vf0JIFvQoS 2023-10-14T11:15:59.513 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Vf0JIFvQoS 2023-10-14T11:15:59.668 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.Vf0JIFvQoS 2023-10-14T11:15:59.745 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.Vf0JIFvQoS is 476KB 2023-10-14T11:15:59.811 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.Vf0JIFvQoS 2023-10-14T11:15:59.820 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425250/data/mon.c.tgz 2023-10-14T11:15:59.820 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2023-10-14T11:15:59.869 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.caNMR7K0AF 2023-10-14T11:15:59.869 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.caNMR7K0AF 2023-10-14T11:16:00.025 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.caNMR7K0AF 2023-10-14T11:16:00.105 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.caNMR7K0AF is 476KB 2023-10-14T11:16:00.167 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.caNMR7K0AF 2023-10-14T11:16:00.175 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-14T11:16:00.176 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T11:16:00.180 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T11:16:00.236 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-14T11:16:00.237 DEBUG:teuthology.orchestra.run.smithi026:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T11:16:00.246 DEBUG:teuthology.orchestra.run.smithi110:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T11:16:00.276 INFO:teuthology.orchestra.run.smithi026.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T11:16:00.328 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T11:16:00.335 INFO:tasks.ceph:Archiving crash dumps... 2023-10-14T11:16:00.337 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425250/remote/smithi026/crash 2023-10-14T11:16:00.338 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T11:16:00.361 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425250/remote/smithi110/crash 2023-10-14T11:16:00.362 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T11:16:00.382 INFO:tasks.ceph:Shutting down logrotate 2023-10-14T11:16:00.382 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:16:00.410 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:16:00.466 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T11:16:00.489 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T11:16:00.532 INFO:tasks.ceph:Compressing logs... 2023-10-14T11:16:00.533 DEBUG:teuthology.orchestra.run.smithi026:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T11:16:00.538 DEBUG:teuthology.orchestra.run.smithi110:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T11:16:00.561 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49916.log 2023-10-14T11:16:00.562 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43357.log 2023-10-14T11:16:00.563 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49351.log 2023-10-14T11:16:00.563 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49916.log.gz 2023-10-14T11:16:00.564 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49105.log 2023-10-14T11:16:00.564 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43357.log.gz 2023-10-14T11:16:00.565 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46159.log 2023-10-14T11:16:00.566 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49351.log.gz 2023-10-14T11:16:00.567 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49105.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49105.log.gz 2023-10-14T11:16:00.567 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47891.log 2023-10-14T11:16:00.568 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43435.log 2023-10-14T11:16:00.568 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46159.log.gz 2023-10-14T11:16:00.569 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47891.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47891.log.gz 2023-10-14T11:16:00.569 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50312.log 2023-10-14T11:16:00.570 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43435.log: gzip -5 --verbose 87.5% -- -- replaced with /var/log/ceph/ceph-client.admin.43435.log.gz /var/log/ceph/ceph-client.admin.42705.log 2023-10-14T11:16:00.570 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-14T11:16:00.571 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50312.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50312.log.gz 2023-10-14T11:16:00.571 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52088.log 2023-10-14T11:16:00.572 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46947.log 2023-10-14T11:16:00.573 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42705.log.gz 2023-10-14T11:16:00.573 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52088.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52088.log.gz 2023-10-14T11:16:00.573 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50991.log 2023-10-14T11:16:00.575 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47721.log 2023-10-14T11:16:00.575 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46947.log.gz 2023-10-14T11:16:00.575 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50991.log: 89.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.50991.log.gz 2023-10-14T11:16:00.575 INFO:teuthology.orchestra.run.smithi026.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48307.log 2023-10-14T11:16:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45865.log 2023-10-14T11:16:00.579 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47721.log.gz 2023-10-14T11:16:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48307.log: gzip -5 --verbose -- 89.1% /var/log/ceph/ceph-mgr.y.log -- replaced with /var/log/ceph/ceph-client.admin.48307.log.gz 2023-10-14T11:16:00.579 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-14T11:16:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43305.log 2023-10-14T11:16:00.580 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45865.log.gz 2023-10-14T11:16:00.582 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51789.log 2023-10-14T11:16:00.582 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46393.log 2023-10-14T11:16:00.583 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43305.log.gz 2023-10-14T11:16:00.583 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45442.log 2023-10-14T11:16:00.583 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51789.log.gz 2023-10-14T11:16:00.584 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46050.log 88.0% 2023-10-14T11:16:00.584 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46393.log.gz 2023-10-14T11:16:00.585 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45442.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.45442.log.gz 2023-10-14T11:16:00.585 INFO:teuthology.orchestra.run.smithi026.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46473.log 2023-10-14T11:16:00.586 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46050.log: gzip -5 --verbose 87.9% -- -- replaced with /var/log/ceph/ceph-client.admin.46050.log.gz /var/log/ceph/ceph-client.admin.46630.log 2023-10-14T11:16:00.586 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-14T11:16:00.586 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46473.log: gzip 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46473.log.gz -5 2023-10-14T11:16:00.587 INFO:teuthology.orchestra.run.smithi026.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52959.log 2023-10-14T11:16:00.588 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47025.log 2023-10-14T11:16:00.588 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46630.log.gz 2023-10-14T11:16:00.589 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47537.log 2023-10-14T11:16:00.589 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52959.log.gz 2023-10-14T11:16:00.589 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51684.log 2023-10-14T11:16:00.590 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47025.log.gz 2023-10-14T11:16:00.591 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47537.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47537.log.gz 2023-10-14T11:16:00.591 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52595.log 2023-10-14T11:16:00.591 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50117.log 2023-10-14T11:16:00.592 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51684.log.gz 2023-10-14T11:16:00.593 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52595.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52595.log.gz 2023-10-14T11:16:00.593 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49429.log 2023-10-14T11:16:00.593 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50117.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50117.log.gz 2023-10-14T11:16:00.593 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43383.log 2023-10-14T11:16:00.594 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49429.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49429.log.gz 2023-10-14T11:16:00.595 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48948.log 2023-10-14T11:16:00.595 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43383.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.43383.log.gz 2023-10-14T11:16:00.595 INFO:teuthology.orchestra.run.smithi026.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48417.log 2023-10-14T11:16:00.596 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52855.log 2023-10-14T11:16:00.597 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48948.log.gz 2023-10-14T11:16:00.598 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49612.log 2023-10-14T11:16:00.598 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48417.log.gz 2023-10-14T11:16:00.598 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52855.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52855.log.gz 2023-10-14T11:16:00.598 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46525.log 2023-10-14T11:16:00.599 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49612.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49612.log.gz 2023-10-14T11:16:00.600 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-14T11:16:00.600 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46525.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46525.log.gz 2023-10-14T11:16:00.601 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48470.log 2023-10-14T11:16:00.602 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45103.log 2023-10-14T11:16:00.602 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46315.log 2023-10-14T11:16:00.602 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48470.log.gz 2023-10-14T11:16:00.603 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45260.log 2023-10-14T11:16:00.604 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45103.log.gz 2023-10-14T11:16:00.604 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46315.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46315.log.gz 2023-10-14T11:16:00.605 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44024.log 2023-10-14T11:16:00.606 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47389.log 2023-10-14T11:16:00.606 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45260.log.gz 2023-10-14T11:16:00.607 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44024.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44024.log.gz 2023-10-14T11:16:00.607 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51925.log 2023-10-14T11:16:00.608 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44031.log 2023-10-14T11:16:00.608 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47389.log.gz 2023-10-14T11:16:00.609 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51925.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51925.log.gz 2023-10-14T11:16:00.610 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48522.log 2023-10-14T11:16:00.611 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46024.log 2023-10-14T11:16:00.611 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44031.log.gz 2023-10-14T11:16:00.612 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48522.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48522.log.gz 2023-10-14T11:16:00.612 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50065.log 2023-10-14T11:16:00.613 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48335.log 2023-10-14T11:16:00.614 INFO:teuthology.orchestra.run.smithi026.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46024.log.gz 2023-10-14T11:16:00.615 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50065.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50065.log.gz 2023-10-14T11:16:00.615 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50510.log 2023-10-14T11:16:00.616 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38343.log 2023-10-14T11:16:00.617 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44840.log 2023-10-14T11:16:00.617 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48335.log.gz 2023-10-14T11:16:00.618 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50510.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50510.log.gz 2023-10-14T11:16:00.618 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47773.log 2023-10-14T11:16:00.620 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38391.log 2023-10-14T11:16:00.620 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.38343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38247.log 2023-10-14T11:16:00.620 INFO:teuthology.orchestra.run.smithi110.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.38343.log.gz 2023-10-14T11:16:00.621 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.38391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38207.log 2023-10-14T11:16:00.621 INFO:teuthology.orchestra.run.smithi110.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38391.log.gz 2023-10-14T11:16:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.44840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47181.log 2023-10-14T11:16:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47773.log: 90.1% -- replaced with /var/log/ceph/ceph-client.0.44840.log.gz 2023-10-14T11:16:00.622 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47773.log.gz 2023-10-14T11:16:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46973.log 2023-10-14T11:16:00.625 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.38247.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-14T11:16:00.625 INFO:teuthology.orchestra.run.smithi110.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38247.log.gz 2023-10-14T11:16:00.625 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.38207.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-14T11:16:00.626 INFO:teuthology.orchestra.run.smithi110.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38207.log.gz 2023-10-14T11:16:00.626 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-14T11:16:00.626 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42681.log 2023-10-14T11:16:00.627 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42787.log 2023-10-14T11:16:00.628 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46289.log 2023-10-14T11:16:00.629 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47181.log.gz 2023-10-14T11:16:00.629 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46973.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46973.log.gz 2023-10-14T11:16:00.629 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47415.log 2023-10-14T11:16:00.630 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51821.log 2023-10-14T11:16:00.630 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46289.log.gz 2023-10-14T11:16:00.630 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47415.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47415.log.gz 2023-10-14T11:16:00.630 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48204.log 2023-10-14T11:16:00.631 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42114.log 2023-10-14T11:16:00.631 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51821.log.gz 2023-10-14T11:16:00.631 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48204.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48204.log.gz 2023-10-14T11:16:00.632 INFO:teuthology.orchestra.run.smithi026.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-14T11:16:00.632 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42575.log 2023-10-14T11:16:00.632 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48361.log 2023-10-14T11:16:00.632 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42114.log.gz 2023-10-14T11:16:00.638 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.1.42681.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-14T11:16:00.638 INFO:teuthology.orchestra.run.smithi110.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.1.42681.log.gz 2023-10-14T11:16:00.638 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.3.42787.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T11:16:00.639 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mgr.x.log: 91.4% -- replaced with /var/log/ceph/ceph-client.3.42787.log.gz 2023-10-14T11:16:00.639 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38319.log 2023-10-14T11:16:00.639 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38271.log 2023-10-14T11:16:00.640 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.38319.log: 92.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T11:16:00.640 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-14T11:16:00.640 INFO:teuthology.orchestra.run.smithi110.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.38319.log.gz 2023-10-14T11:16:00.640 INFO:teuthology.orchestra.run.smithi110.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-14T11:16:00.641 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.38271.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T11:16:00.641 INFO:teuthology.orchestra.run.smithi110.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38271.log.gz 2023-10-14T11:16:00.641 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-14T11:16:00.641 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-14T11:16:00.642 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-14T11:16:00.645 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mds.b.log: 92.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-14T11:16:00.646 INFO:teuthology.orchestra.run.smithi110.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T11:16:00.646 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-14T11:16:00.646 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38367.log 2023-10-14T11:16:00.648 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42575.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42575.log.gz 2023-10-14T11:16:00.648 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49784.log 2023-10-14T11:16:00.648 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46185.log 2023-10-14T11:16:00.649 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48361.log.gz 2023-10-14T11:16:00.649 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52569.log 2023-10-14T11:16:00.649 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49784.log.gz 2023-10-14T11:16:00.649 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50538.log 2023-10-14T11:16:00.650 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46185.log.gz 2023-10-14T11:16:00.650 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52569.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52569.log.gz 2023-10-14T11:16:00.650 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48102.log 2023-10-14T11:16:00.651 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52140.log 2023-10-14T11:16:00.651 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50538.log.gz 2023-10-14T11:16:00.651 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48102.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48102.log.gz 2023-10-14T11:16:00.651 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43248.log 2023-10-14T11:16:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49189.log 2023-10-14T11:16:00.652 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52140.log.gz 2023-10-14T11:16:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44555.log 2023-10-14T11:16:00.653 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43248.log.gz 2023-10-14T11:16:00.653 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43621.log 2023-10-14T11:16:00.653 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49189.log.gz 2023-10-14T11:16:00.653 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44555.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44555.log.gz 2023-10-14T11:16:00.654 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42333.log 2023-10-14T11:16:00.654 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44373.log 2023-10-14T11:16:00.654 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43621.log.gz 2023-10-14T11:16:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42333.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42333.log.gz 2023-10-14T11:16:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42601.log 2023-10-14T11:16:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42931.log 2023-10-14T11:16:00.655 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44373.log.gz 2023-10-14T11:16:00.656 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44032.log 2023-10-14T11:16:00.656 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42601.log.gz 2023-10-14T11:16:00.656 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51256.log 2023-10-14T11:16:00.656 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44032.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.42931.log.gz 2023-10-14T11:16:00.657 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52777.log 2023-10-14T11:16:00.657 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44032.log.gz 2023-10-14T11:16:00.657 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51256.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51256.log.gz 2023-10-14T11:16:00.658 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47259.log 2023-10-14T11:16:00.659 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.38367.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38367.log.gz 2023-10-14T11:16:00.659 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38295.log 2023-10-14T11:16:00.659 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.38295.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38295.log.gz 2023-10-14T11:16:00.664 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46421.log 2023-10-14T11:16:00.665 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52777.log.gz 2023-10-14T11:16:00.665 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42361.log 2023-10-14T11:16:00.665 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47259.log.gz 2023-10-14T11:16:00.666 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45546.log 2023-10-14T11:16:00.666 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46421.log.gz 2023-10-14T11:16:00.666 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42361.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42361.log.gz 2023-10-14T11:16:00.667 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46447.log 2023-10-14T11:16:00.667 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50574.log 2023-10-14T11:16:00.667 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45546.log.gz 2023-10-14T11:16:00.667 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52465.log 2023-10-14T11:16:00.668 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46447.log.gz 2023-10-14T11:16:00.668 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44295.log 2023-10-14T11:16:00.668 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50574.log.gz 2023-10-14T11:16:00.669 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52465.log: gzip -5 87.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.52465.log.gz -- 2023-10-14T11:16:00.669 INFO:teuthology.orchestra.run.smithi026.stderr: /var/log/ceph/ceph-client.admin.42987.log 2023-10-14T11:16:00.669 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44295.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44295.log.gz 2023-10-14T11:16:00.669 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52439.log 2023-10-14T11:16:00.670 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42987.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42987.log.gz 2023-10-14T11:16:00.670 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43541.log 2023-10-14T11:16:00.670 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52439.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-14T11:16:00.671 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52439.log.gz 2023-10-14T11:16:00.671 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43541.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43541.log.gz 2023-10-14T11:16:00.671 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50482.log 2023-10-14T11:16:00.672 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48076.log 2023-10-14T11:16:00.672 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48921.log 2023-10-14T11:16:00.672 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50482.log.gz 2023-10-14T11:16:00.672 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44217.log 2023-10-14T11:16:00.673 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48076.log.gz 2023-10-14T11:16:00.673 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48921.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48921.log.gz 2023-10-14T11:16:00.673 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52699.log 2023-10-14T11:16:00.674 INFO:teuthology.orchestra.run.smithi110.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-14T11:16:00.678 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44347.log 2023-10-14T11:16:00.679 INFO:teuthology.orchestra.run.smithi026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44217.log.gz 2023-10-14T11:16:00.679 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52699.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52699.log.gz 2023-10-14T11:16:00.679 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42627.log 2023-10-14T11:16:00.679 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44347.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44347.log.gz 2023-10-14T11:16:00.680 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47945.log 2023-10-14T11:16:00.680 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42627.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42627.log.gz 2023-10-14T11:16:00.680 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45390.log 2023-10-14T11:16:00.680 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47589.log 2023-10-14T11:16:00.681 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47945.log.gz 2023-10-14T11:16:00.681 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45390.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45390.log.gz 2023-10-14T11:16:00.681 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46708.log 2023-10-14T11:16:00.682 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42547.log 2023-10-14T11:16:00.682 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47589.log.gz 2023-10-14T11:16:00.682 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46708.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46708.log.gz 2023-10-14T11:16:00.682 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50039.log 2023-10-14T11:16:00.683 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42547.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42547.log.gz 2023-10-14T11:16:00.683 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49482.log 2023-10-14T11:16:00.683 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44659.log 2023-10-14T11:16:00.684 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50039.log.gz 2023-10-14T11:16:00.684 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49482.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49482.log.gz 2023-10-14T11:16:00.684 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-14T11:16:00.684 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47155.log 2023-10-14T11:16:00.685 INFO:teuthology.orchestra.run.smithi026.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.44659.log.gz 2023-10-14T11:16:00.687 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50404.log 2023-10-14T11:16:00.688 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47155.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47155.log.gz 2023-10-14T11:16:00.688 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45650.log 2023-10-14T11:16:00.688 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50456.log 2023-10-14T11:16:00.688 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50404.log.gz 2023-10-14T11:16:00.689 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45650.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45650.log.gz 2023-10-14T11:16:00.689 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51522.log 2023-10-14T11:16:00.689 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42679.log 2023-10-14T11:16:00.689 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50456.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50456.log.gz 2023-10-14T11:16:00.690 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51522.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51522.log.gz 2023-10-14T11:16:00.690 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51201.log 2023-10-14T11:16:00.690 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46578.log 2023-10-14T11:16:00.692 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42679.log.gz 2023-10-14T11:16:00.693 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51201.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51201.log.gz 2023-10-14T11:16:00.693 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48128.log 2023-10-14T11:16:00.693 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48974.log 2023-10-14T11:16:00.693 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46578.log.gz 2023-10-14T11:16:00.694 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48128.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48128.log.gz 2023-10-14T11:16:00.694 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43829.log 2023-10-14T11:16:00.694 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52803.log 2023-10-14T11:16:00.695 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48974.log.gz 2023-10-14T11:16:00.696 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43829.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43829.log.gz 2023-10-14T11:16:00.696 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47829.log 2023-10-14T11:16:00.696 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52803.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52803.log.gz 2023-10-14T11:16:00.697 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49534.log 2023-10-14T11:16:00.698 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47829.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47829.log.gz 2023-10-14T11:16:00.698 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52244.log 2023-10-14T11:16:00.699 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49534.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49534.log.gz 2023-10-14T11:16:00.699 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52673.log 2023-10-14T11:16:00.700 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44321.log 2023-10-14T11:16:00.700 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52244.log.gz 2023-10-14T11:16:00.701 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52673.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52673.log.gz 2023-10-14T11:16:00.701 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51549.log 2023-10-14T11:16:00.703 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44321.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44321.log.gz 2023-10-14T11:16:00.703 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49810.log 2023-10-14T11:16:00.704 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51549.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51549.log.gz 2023-10-14T11:16:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45728.log 2023-10-14T11:16:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47363.log 2023-10-14T11:16:00.706 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49810.log.gz 2023-10-14T11:16:00.707 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45728.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45728.log.gz 2023-10-14T11:16:00.707 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50706.log 2023-10-14T11:16:00.709 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43274.log 2023-10-14T11:16:00.709 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47363.log.gz 2023-10-14T11:16:00.710 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50706.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50706.log.gz 2023-10-14T11:16:00.710 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50680.log 2023-10-14T11:16:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43487.log 2023-10-14T11:16:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50680.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43274.log.gz 2023-10-14T11:16:00.713 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50680.log.gz 2023-10-14T11:16:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43821.log 2023-10-14T11:16:00.714 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43487.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43487.log.gz 2023-10-14T11:16:00.715 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51958.log 2023-10-14T11:16:00.716 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43821.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.43821.log.gz -5 2023-10-14T11:16:00.716 INFO:teuthology.orchestra.run.smithi026.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47799.log 2023-10-14T11:16:00.717 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51958.log: gzip -5 --verbose -- 88.9% /var/log/ceph/ceph.tmp-client.admin.33149.log -- replaced with /var/log/ceph/ceph-client.admin.51958.log.gz 2023-10-14T11:16:00.718 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-14T11:16:00.719 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49758.log 2023-10-14T11:16:00.719 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47799.log.gz 2023-10-14T11:16:00.720 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.tmp-client.admin.33149.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33149.log.gz 2023-10-14T11:16:00.721 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47077.log 2023-10-14T11:16:00.722 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49758.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49758.log.gz 2023-10-14T11:16:00.722 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46604.log 2023-10-14T11:16:00.724 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50626.log 2023-10-14T11:16:00.724 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47077.log.gz 2023-10-14T11:16:00.725 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49157.log 2023-10-14T11:16:00.726 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46604.log.gz 2023-10-14T11:16:00.726 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50626.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50626.log.gz 2023-10-14T11:16:00.727 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51601.log 2023-10-14T11:16:00.728 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52881.log 2023-10-14T11:16:00.728 INFO:teuthology.orchestra.run.smithi026.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.49157.log.gz 2023-10-14T11:16:00.729 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51601.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51601.log.gz 2023-10-14T11:16:00.730 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47051.log 2023-10-14T11:16:00.731 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52881.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52881.log.gz 2023-10-14T11:16:00.732 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52751.log 2023-10-14T11:16:00.733 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47051.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47051.log.gz 2023-10-14T11:16:00.733 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49377.log 2023-10-14T11:16:00.734 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49079.log 2023-10-14T11:16:00.734 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52751.log.gz 2023-10-14T11:16:00.735 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49377.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49377.log.gz 2023-10-14T11:16:00.736 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42757.log 2023-10-14T11:16:00.737 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49079.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49079.log.gz 2023-10-14T11:16:00.737 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48762.log 2023-10-14T11:16:00.738 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42653.log 2023-10-14T11:16:00.739 INFO:teuthology.orchestra.run.smithi026.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.42757.log.gz 2023-10-14T11:16:00.740 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48762.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48762.log.gz 2023-10-14T11:16:00.740 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37958.log 2023-10-14T11:16:00.741 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52192.log 2023-10-14T11:16:00.742 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42653.log.gz 2023-10-14T11:16:00.742 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47971.log 2023-10-14T11:16:00.743 INFO:teuthology.orchestra.run.smithi026.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.37958.log.gz 2023-10-14T11:16:00.744 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52192.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52192.log.gz 2023-10-14T11:16:00.744 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52413.log 2023-10-14T11:16:00.745 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51653.log 2023-10-14T11:16:00.745 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47971.log.gz 2023-10-14T11:16:00.746 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52413.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52413.log.gz 2023-10-14T11:16:00.747 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52289.log 2023-10-14T11:16:00.748 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51653.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.51653.log.gz 2023-10-14T11:16:00.748 INFO:teuthology.orchestra.run.smithi026.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43065.log 2023-10-14T11:16:00.750 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48627.log 2023-10-14T11:16:00.750 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52289.log.gz 2023-10-14T11:16:00.751 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44399.log 2023-10-14T11:16:00.752 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43065.log.gz 2023-10-14T11:16:00.753 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45019.log 2023-10-14T11:16:00.753 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48627.log.gz 2023-10-14T11:16:00.754 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50836.log 2023-10-14T11:16:00.755 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44399.log.gz 2023-10-14T11:16:00.756 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46656.log 2023-10-14T11:16:00.756 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45019.log.gz 2023-10-14T11:16:00.757 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43196.log 2023-10-14T11:16:00.758 INFO:teuthology.orchestra.run.smithi026.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50836.log.gz 2023-10-14T11:16:00.758 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46656.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-14T11:16:00.759 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46656.log.gz 2023-10-14T11:16:00.760 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43196.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43196.log.gz 2023-10-14T11:16:00.760 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51899.log 2023-10-14T11:16:00.761 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49890.log 2023-10-14T11:16:00.763 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47563.log 2023-10-14T11:16:00.763 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51899.log.gz 2023-10-14T11:16:00.764 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49890.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49890.log.gz 2023-10-14T11:16:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42306.log 2023-10-14T11:16:00.766 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43091.log 2023-10-14T11:16:00.766 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47563.log.gz 2023-10-14T11:16:00.767 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42306.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42306.log.gz 2023-10-14T11:16:00.768 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45787.log 2023-10-14T11:16:00.769 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52647.log 2023-10-14T11:16:00.769 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43091.log.gz 2023-10-14T11:16:00.770 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52369.log 2023-10-14T11:16:00.771 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45787.log.gz 2023-10-14T11:16:00.772 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49864.log 2023-10-14T11:16:00.772 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52647.log.gz 2023-10-14T11:16:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45208.log 2023-10-14T11:16:00.774 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52369.log.gz 2023-10-14T11:16:00.775 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46211.log 2023-10-14T11:16:00.775 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49864.log.gz 2023-10-14T11:16:00.776 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51044.log 2023-10-14T11:16:00.777 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45208.log.gz 2023-10-14T11:16:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48869.log 2023-10-14T11:16:00.778 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46211.log.gz 2023-10-14T11:16:00.782 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52218.log 2023-10-14T11:16:00.782 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51044.log.gz 2023-10-14T11:16:00.782 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48869.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48869.log.gz 2023-10-14T11:16:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45702.log 2023-10-14T11:16:00.784 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49131.log 2023-10-14T11:16:00.784 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52218.log.gz 2023-10-14T11:16:00.784 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45494.log 2023-10-14T11:16:00.785 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45702.log.gz 2023-10-14T11:16:00.785 INFO:teuthology.orchestra.run.smithi110.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-14T11:16:00.786 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45893.log 2023-10-14T11:16:00.787 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49131.log.gz 2023-10-14T11:16:00.787 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46341.log 2023-10-14T11:16:00.787 INFO:teuthology.orchestra.run.smithi026.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45494.log.gz 2023-10-14T11:16:00.788 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43170.log 2023-10-14T11:16:00.788 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45893.log.gz 2023-10-14T11:16:00.790 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42280.log 2023-10-14T11:16:00.790 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46341.log.gz 2023-10-14T11:16:00.791 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49836.log 2023-10-14T11:16:00.792 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43170.log.gz 2023-10-14T11:16:00.792 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42280.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42280.log.gzgzip 2023-10-14T11:16:00.793 INFO:teuthology.orchestra.run.smithi026.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47643.log 2023-10-14T11:16:00.794 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52036.log 2023-10-14T11:16:00.794 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49836.log.gz 2023-10-14T11:16:00.795 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52543.log 2023-10-14T11:16:00.796 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47643.log.gz 2023-10-14T11:16:00.797 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43117.log 2023-10-14T11:16:00.797 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52036.log.gz 2023-10-14T11:16:00.798 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52985.log 2023-10-14T11:16:00.799 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52543.log.gz 2023-10-14T11:16:00.800 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48731.log 2023-10-14T11:16:00.800 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43117.log.gz 2023-10-14T11:16:00.801 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45754.log 2023-10-14T11:16:00.801 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52985.log.gz 2023-10-14T11:16:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48731.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-14T11:16:00.803 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48731.log.gz 2023-10-14T11:16:00.804 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51740.log 2023-10-14T11:16:00.804 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45754.log.gz 2023-10-14T11:16:00.805 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45077.log 2023-10-14T11:16:00.807 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.51740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46263.log 2023-10-14T11:16:00.809 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45077.log: 90.1% -- replaced with /var/log/ceph/ceph-client.0.51740.log.gz 2023-10-14T11:16:00.809 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45077.log.gz 2023-10-14T11:16:00.809 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44033.log 2023-10-14T11:16:00.810 INFO:teuthology.orchestra.run.smithi110.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-14T11:16:00.811 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46263.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46263.log.gz 2023-10-14T11:16:00.811 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43819.log 2023-10-14T11:16:00.812 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44033.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44033.log.gz 2023-10-14T11:16:00.812 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45156.log 2023-10-14T11:16:00.814 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50195.log 2023-10-14T11:16:00.814 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43819.log.gz 2023-10-14T11:16:00.815 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45156.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45156.log.gz 2023-10-14T11:16:00.815 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45234.log 2023-10-14T11:16:00.817 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46921.log 2023-10-14T11:16:00.817 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50195.log.gz 2023-10-14T11:16:00.818 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52829.log 2023-10-14T11:16:00.818 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45234.log.gz 2023-10-14T11:16:00.820 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46921.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46921.log.gz -5 2023-10-14T11:16:00.820 INFO:teuthology.orchestra.run.smithi026.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50378.log 2023-10-14T11:16:00.821 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47337.log 2023-10-14T11:16:00.821 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52829.log.gz 2023-10-14T11:16:00.823 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50378.log: gzip -5 --verbose 89.6% -- -- replaced with /var/log/ceph/ceph-client.admin.50378.log.gz /var/log/ceph/ceph-client.admin.44028.log 2023-10-14T11:16:00.823 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-14T11:16:00.824 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45129.log 2023-10-14T11:16:00.824 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47337.log.gz 2023-10-14T11:16:00.825 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44028.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44028.log.gz -5 2023-10-14T11:16:00.826 INFO:teuthology.orchestra.run.smithi026.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48601.log 2023-10-14T11:16:00.827 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47917.log 2023-10-14T11:16:00.828 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45129.log.gz 2023-10-14T11:16:00.829 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48444.log 2023-10-14T11:16:00.829 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48601.log.gz 2023-10-14T11:16:00.830 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47917.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47917.log.gz 2023-10-14T11:16:00.830 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42387.log 2023-10-14T11:16:00.832 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49455.log 2023-10-14T11:16:00.832 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48444.log.gz 2023-10-14T11:16:00.833 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42387.log: gzip 87.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.42387.log.gz -- 2023-10-14T11:16:00.834 INFO:teuthology.orchestra.run.smithi026.stderr: /var/log/ceph/ceph-client.admin.44243.log 2023-10-14T11:16:00.835 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49643.log 2023-10-14T11:16:00.835 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49455.log.gz 2023-10-14T11:16:00.836 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44243.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44243.log.gz 2023-10-14T11:16:00.836 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51984.log 2023-10-14T11:16:00.838 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43567.log 2023-10-14T11:16:00.838 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49643.log.gz 2023-10-14T11:16:00.839 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51984.log: gzip -5 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51984.log.gz 2023-10-14T11:16:00.839 INFO:teuthology.orchestra.run.smithi026.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44018.log 2023-10-14T11:16:00.840 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43567.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43567.log.gz 2023-10-14T11:16:00.841 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44009.log 2023-10-14T11:16:00.842 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44018.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.51873.log -- replaced with /var/log/ceph/ceph-client.admin.44018.log.gz 2023-10-14T11:16:00.843 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-14T11:16:00.844 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50169.log 2023-10-14T11:16:00.844 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44009.log.gz 2023-10-14T11:16:00.845 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51873.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51873.log.gz 2023-10-14T11:16:00.846 INFO:teuthology.orchestra.run.smithi026.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46076.log 2023-10-14T11:16:00.847 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50169.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50169.log.gz 2023-10-14T11:16:00.847 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50784.log 2023-10-14T11:16:00.848 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44425.log 2023-10-14T11:16:00.849 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46076.log.gz 2023-10-14T11:16:00.850 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48574.log 2023-10-14T11:16:00.850 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50784.log.gz 2023-10-14T11:16:00.851 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44425.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44425.log.gz 2023-10-14T11:16:00.852 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51627.log 2023-10-14T11:16:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45676.log 2023-10-14T11:16:00.853 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48574.log.gz 2023-10-14T11:16:00.854 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51627.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.51627.log.gz 2023-10-14T11:16:00.855 INFO:teuthology.orchestra.run.smithi026.stderr: -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T11:16:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47695.log 2023-10-14T11:16:00.856 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45676.log.gz 2023-10-14T11:16:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47473.log 2023-10-14T11:16:00.858 INFO:teuthology.orchestra.run.smithi026.stderr: 85.8%/var/log/ceph/ceph-client.admin.47695.log: -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T11:16:00.859 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47695.log.gz 2023-10-14T11:16:00.860 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47473.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47473.log.gz 2023-10-14T11:16:00.861 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52062.log 2023-10-14T11:16:00.862 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47747.log 2023-10-14T11:16:00.864 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43513.log 2023-10-14T11:16:00.864 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52062.log.gz 2023-10-14T11:16:00.865 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52343.log 2023-10-14T11:16:00.866 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47747.log.gz 2023-10-14T11:16:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43513.log: gzip -5 88.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.43513.log.gz /var/log/ceph/ceph-client.0.50941.log 2023-10-14T11:16:00.867 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-14T11:16:00.868 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47669.log 2023-10-14T11:16:00.868 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52343.log.gz 2023-10-14T11:16:00.870 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.50941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46817.log 2023-10-14T11:16:00.871 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47669.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47669.log.gz 91.7% -- replaced with /var/log/ceph/ceph-client.0.50941.log.gz 2023-10-14T11:16:00.872 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-14T11:16:00.872 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46817.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46817.log.gz 2023-10-14T11:16:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45919.log 2023-10-14T11:16:00.874 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52517.log 2023-10-14T11:16:00.876 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45946.log 2023-10-14T11:16:00.876 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45919.log.gz 2023-10-14T11:16:00.877 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43828.log 2023-10-14T11:16:00.878 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52517.log.gz 2023-10-14T11:16:00.879 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51391.log 2023-10-14T11:16:00.879 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45946.log.gz 2023-10-14T11:16:00.880 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43828.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43828.log.gz 2023-10-14T11:16:00.881 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50758.log 2023-10-14T11:16:00.882 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51391.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51391.log.gz 2023-10-14T11:16:00.882 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52907.log 2023-10-14T11:16:00.884 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46499.log 2023-10-14T11:16:00.884 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50758.log.gz 2023-10-14T11:16:00.885 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52907.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52907.log.gz 2023-10-14T11:16:00.886 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47103.log 2023-10-14T11:16:00.886 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46499.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46499.log.gz 2023-10-14T11:16:00.887 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47233.log 2023-10-14T11:16:00.888 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47857.log 2023-10-14T11:16:00.889 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47103.log.gz 2023-10-14T11:16:00.890 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47233.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47233.log.gz 2023-10-14T11:16:00.890 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51470.log 2023-10-14T11:16:00.891 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47857.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47857.log.gz 2023-10-14T11:16:00.892 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47311.log 2023-10-14T11:16:00.893 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51470.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51470.log.gz 2023-10-14T11:16:00.893 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51287.log 2023-10-14T11:16:00.895 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47617.log 2023-10-14T11:16:00.895 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47311.log.gz 2023-10-14T11:16:00.896 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51287.log: gzip 87.9% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.51287.log.gz -- 2023-10-14T11:16:00.896 INFO:teuthology.orchestra.run.smithi026.stderr: /var/log/ceph/ceph-client.admin.44451.log 2023-10-14T11:16:00.898 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47207.log 2023-10-14T11:16:00.898 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47617.log.gz 2023-10-14T11:16:00.899 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44451.log: gzip -5 88.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.44451.log.gz /var/log/ceph/ceph-client.admin.50430.log 2023-10-14T11:16:00.900 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-14T11:16:00.900 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47207.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47207.log.gz 2023-10-14T11:16:00.901 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48705.log 2023-10-14T11:16:00.902 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45045.log 2023-10-14T11:16:00.903 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50430.log.gz 2023-10-14T11:16:00.904 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42413.log 2023-10-14T11:16:00.904 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48705.log.gz 2023-10-14T11:16:00.905 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45045.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45972.log 2023-10-14T11:16:00.906 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45045.log.gz 2023-10-14T11:16:00.907 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48496.log 2023-10-14T11:16:00.907 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42413.log.gz 2023-10-14T11:16:00.908 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46895.log 2023-10-14T11:16:00.909 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45972.log.gz 2023-10-14T11:16:00.910 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44269.log 2023-10-14T11:16:00.910 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48496.log.gz 2023-10-14T11:16:00.911 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46895.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46895.log.gz 2023-10-14T11:16:00.911 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47129.log 2023-10-14T11:16:00.913 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44269.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44269.log.gz 2023-10-14T11:16:00.913 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50280.log 2023-10-14T11:16:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47129.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47129.log.gz 2023-10-14T11:16:00.915 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49403.log 2023-10-14T11:16:00.916 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50280.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50280.log.gz 2023-10-14T11:16:00.917 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49403.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49403.log.gz 2023-10-14T11:16:00.918 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43013.log 2023-10-14T11:16:00.920 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42467.log 2023-10-14T11:16:00.921 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42807.log 2023-10-14T11:16:00.921 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43013.log.gz 2023-10-14T11:16:00.923 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48895.log 2023-10-14T11:16:00.923 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42467.log.gz 2023-10-14T11:16:00.924 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42807.log: gzip 89.9% -- replaced with /var/log/ceph/ceph-client.admin.42807.log.gz -5 2023-10-14T11:16:00.924 INFO:teuthology.orchestra.run.smithi026.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45182.log 2023-10-14T11:16:00.926 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51496.log 2023-10-14T11:16:00.926 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48895.log.gz 2023-10-14T11:16:00.927 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48387.log 2023-10-14T11:16:00.927 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45182.log.gz 2023-10-14T11:16:00.929 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51444.log 2023-10-14T11:16:00.929 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51496.log.gz 2023-10-14T11:16:00.930 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51018.log 2023-10-14T11:16:00.930 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48387.log.gz 2023-10-14T11:16:00.932 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43039.log 2023-10-14T11:16:00.932 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51444.log.gz 2023-10-14T11:16:00.933 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51018.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.51018.log.gz 2023-10-14T11:16:00.933 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46551.log 2023-10-14T11:16:00.935 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43331.log 2023-10-14T11:16:00.935 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43039.log.gz 2023-10-14T11:16:00.936 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46551.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46551.log.gz 2023-10-14T11:16:00.936 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45364.log 2023-10-14T11:16:00.938 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52315.log 2023-10-14T11:16:00.938 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43331.log.gz 2023-10-14T11:16:00.939 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50600.log 2023-10-14T11:16:00.939 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45364.log.gz 2023-10-14T11:16:00.941 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46237.log 2023-10-14T11:16:00.941 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52315.log.gz 2023-10-14T11:16:00.942 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43602.log 2023-10-14T11:16:00.942 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50600.log.gz 2023-10-14T11:16:00.943 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38078.log 2023-10-14T11:16:00.944 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46237.log.gz 2023-10-14T11:16:00.945 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50091.log 2023-10-14T11:16:00.945 INFO:teuthology.orchestra.run.smithi026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43602.log.gz 2023-10-14T11:16:00.946 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38078.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38078.log.gz 2023-10-14T11:16:00.948 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50091.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50091.log.gz 2023-10-14T11:16:00.948 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43222.log 2023-10-14T11:16:00.950 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51230.log 2023-10-14T11:16:00.951 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45998.log 2023-10-14T11:16:00.951 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43222.log.gz 2023-10-14T11:16:00.953 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51230.log: gzip -5 88.7% --verbose -- /var/log/ceph/ceph-client.admin.44503.log 2023-10-14T11:16:00.954 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51230.log.gz 2023-10-14T11:16:00.954 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45998.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45998.log.gz 2023-10-14T11:16:00.955 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52621.log 2023-10-14T11:16:00.956 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44503.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44503.log.gz 2023-10-14T11:16:00.956 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49053.log 2023-10-14T11:16:00.958 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49560.log 2023-10-14T11:16:00.958 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52621.log.gz 2023-10-14T11:16:00.959 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49053.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49053.log.gz 2023-10-14T11:16:00.960 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49560.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49560.log.gz 2023-10-14T11:16:00.961 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48653.log 2023-10-14T11:16:00.962 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45520.log 2023-10-14T11:16:00.964 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51575.log 2023-10-14T11:16:00.964 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48653.log.gz 2023-10-14T11:16:00.965 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49325.log 2023-10-14T11:16:00.966 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45520.log.gz 2023-10-14T11:16:00.967 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51575.log: gzip -5 89.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.51575.log.gz 2023-10-14T11:16:00.968 INFO:teuthology.orchestra.run.smithi026.stderr: /var/log/ceph/ceph-client.admin.45813.log 2023-10-14T11:16:00.968 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51418.log 2023-10-14T11:16:00.969 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49325.log.gz 2023-10-14T11:16:00.970 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51175.log 2023-10-14T11:16:00.970 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45813.log.gz 2023-10-14T11:16:00.971 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48259.log 2023-10-14T11:16:00.972 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51418.log.gz 2023-10-14T11:16:00.973 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52725.log 2023-10-14T11:16:00.973 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51175.log.gz 2023-10-14T11:16:00.976 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.48259.log: /var/log/ceph/ceph-client.admin.52725.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52725.log.gz 2023-10-14T11:16:00.976 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50247.log 2023-10-14T11:16:00.977 INFO:teuthology.orchestra.run.smithi026.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.48259.log.gz 2023-10-14T11:16:00.977 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44037.log 2023-10-14T11:16:00.979 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43612.log 2023-10-14T11:16:00.979 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50247.log.gz 2023-10-14T11:16:00.981 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42439.log 2023-10-14T11:16:00.981 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44037.log.gz 2023-10-14T11:16:00.982 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43612.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T11:16:00.983 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43612.log.gz 2023-10-14T11:16:00.983 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42439.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42439.log.gz 2023-10-14T11:16:00.990 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.audit.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T11:16:00.990 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-14T11:16:00.991 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45468.log 2023-10-14T11:16:00.991 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47997.log 2023-10-14T11:16:00.992 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45468.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45468.log.gz 2023-10-14T11:16:00.993 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47997.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47997.log.gz 2023-10-14T11:16:00.994 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-14T11:16:00.995 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44884.log 2023-10-14T11:16:00.999 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.44884.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44884.log.gz 2023-10-14T11:16:00.999 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45572.log 2023-10-14T11:16:01.002 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45572.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45572.log.gz 2023-10-14T11:16:01.002 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45598.log 2023-10-14T11:16:01.005 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45598.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45598.log.gz 2023-10-14T11:16:01.006 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49706.log 2023-10-14T11:16:01.010 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44477.log 2023-10-14T11:16:01.011 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44477.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44477.log.gz 2023-10-14T11:16:01.012 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49706.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49706.log.gz 2023-10-14T11:16:01.013 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49994.log 2023-10-14T11:16:01.016 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49994.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49994.log.gz 2023-10-14T11:16:01.016 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46133.log 2023-10-14T11:16:01.018 INFO:teuthology.orchestra.run.smithi026.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-14T11:16:01.018 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5/var/log/ceph/ceph-client.admin.46133.log: --verbose -- /var/log/ceph/ceph-client.admin.43144.log 2023-10-14T11:16:01.019 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46133.log.gz 2023-10-14T11:16:01.020 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46843.log 2023-10-14T11:16:01.021 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43144.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43144.log.gz 2023-10-14T11:16:01.022 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46843.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46843.log.gz 2023-10-14T11:16:01.023 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44975.log 2023-10-14T11:16:01.025 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48154.log 2023-10-14T11:16:01.027 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.2.44975.log: 91.5% -- replaced with /var/log/ceph/ceph-client.2.44975.log.gz 2023-10-14T11:16:01.028 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48154.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.48154.log.gz 2023-10-14T11:16:01.028 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50143.log 2023-10-14T11:16:01.030 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42731.log 2023-10-14T11:16:01.031 INFO:teuthology.orchestra.run.smithi026.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-14T11:16:01.031 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50143.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50143.log.gz 2023-10-14T11:16:01.033 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42731.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42731.log.gz 2023-10-14T11:16:01.033 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51342.log 2023-10-14T11:16:01.035 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49508.log 2023-10-14T11:16:01.038 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.51342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46765.log 2023-10-14T11:16:01.038 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49508.log: 90.1% -- replaced with /var/log/ceph/ceph-client.0.51342.log.gz 2023-10-14T11:16:01.038 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49508.log.gz 2023-10-14T11:16:01.039 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46765.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46765.log.gz 2023-10-14T11:16:01.040 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45286.log 2023-10-14T11:16:01.041 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49586.log 2023-10-14T11:16:01.043 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45286.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45286.log.gz 2023-10-14T11:16:01.043 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46791.log 2023-10-14T11:16:01.044 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42521.log 2023-10-14T11:16:01.045 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49586.log.gz 2023-10-14T11:16:01.046 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43461.log 2023-10-14T11:16:01.046 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46791.log.gz 2023-10-14T11:16:01.047 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42521.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42521.log.gz 2023-10-14T11:16:01.048 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46869.log 2023-10-14T11:16:01.049 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46999.log 2023-10-14T11:16:01.049 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43461.log.gz 2023-10-14T11:16:01.050 INFO:teuthology.orchestra.run.smithi026.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-14T11:16:01.050 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49732.log 2023-10-14T11:16:01.051 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46869.log.gz 2023-10-14T11:16:01.052 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46999.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46999.log.gz 2023-10-14T11:16:01.052 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51847.log 2023-10-14T11:16:01.053 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45338.log 2023-10-14T11:16:01.054 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49732.log.gz 2023-10-14T11:16:01.055 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51847.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.51847.log.gz -5 2023-10-14T11:16:01.055 INFO:teuthology.orchestra.run.smithi026.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46107.log 2023-10-14T11:16:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45338.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45338.log.gz 2023-10-14T11:16:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38177.log 2023-10-14T11:16:01.058 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46107.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46107.log.gz 2023-10-14T11:16:01.058 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49680.log 2023-10-14T11:16:01.060 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38177.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38177.log.gz 2023-10-14T11:16:01.060 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52010.log 2023-10-14T11:16:01.061 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49680.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49680.log.gz 2023-10-14T11:16:01.062 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49215.log 2023-10-14T11:16:01.063 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52010.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52010.log.gz 2023-10-14T11:16:01.064 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47441.log 2023-10-14T11:16:01.064 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49215.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49215.log.gz -5 2023-10-14T11:16:01.065 INFO:teuthology.orchestra.run.smithi026.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48023.log 2023-10-14T11:16:01.066 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43822.log 2023-10-14T11:16:01.066 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47441.log.gz 2023-10-14T11:16:01.068 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52933.log 2023-10-14T11:16:01.068 INFO:teuthology.orchestra.run.smithi026.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.48023.log.gz 2023-10-14T11:16:01.069 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43822.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43822.log.gz 2023-10-14T11:16:01.069 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50654.log 2023-10-14T11:16:01.070 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44633.log 2023-10-14T11:16:01.071 INFO:teuthology.orchestra.run.smithi026.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52933.log.gz 2023-10-14T11:16:01.071 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50654.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50654.log.gz 2023-10-14T11:16:01.072 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49968.log 2023-10-14T11:16:01.073 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44633.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44633.log.gz 2023-10-14T11:16:01.073 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45839.log 2023-10-14T11:16:01.075 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49968.log: gzip 88.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.49968.log.gz --verbose 2023-10-14T11:16:01.075 INFO:teuthology.orchestra.run.smithi026.stderr: -- /var/log/ceph/ceph-client.admin.48679.log 2023-10-14T11:16:01.076 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45839.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.45839.log.gz -5 2023-10-14T11:16:01.077 INFO:teuthology.orchestra.run.smithi026.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49027.log 2023-10-14T11:16:01.078 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43614.log 2023-10-14T11:16:01.078 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48679.log.gz 2023-10-14T11:16:01.079 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49027.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49027.log.gz 2023-10-14T11:16:01.080 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46682.log 2023-10-14T11:16:01.081 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43614.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43614.log.gz 2023-10-14T11:16:01.081 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43409.log 2023-10-14T11:16:01.083 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46682.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46682.log.gz 2023-10-14T11:16:01.083 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47285.log 2023-10-14T11:16:01.084 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43409.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43409.log.gz 2023-10-14T11:16:01.085 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44581.log 2023-10-14T11:16:01.086 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47285.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47285.log.gz 2023-10-14T11:16:01.086 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44529.log 2023-10-14T11:16:01.088 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44581.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44581.log.gz 2023-10-14T11:16:01.088 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50810.log 2023-10-14T11:16:01.089 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44529.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.44529.log.gz 2023-10-14T11:16:01.090 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51070.log 2023-10-14T11:16:01.091 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50810.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50810.log.gz 2023-10-14T11:16:01.091 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45624.log 2023-10-14T11:16:01.092 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46367.log 2023-10-14T11:16:01.093 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51070.log.gz 2023-10-14T11:16:01.094 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50886.log 2023-10-14T11:16:01.094 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45624.log.gz 2023-10-14T11:16:01.095 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52166.log 2023-10-14T11:16:01.096 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46367.log.gz 2023-10-14T11:16:01.096 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50886.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50886.log.gz 2023-10-14T11:16:01.097 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44720.log 2023-10-14T11:16:01.098 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42182.log 2023-10-14T11:16:01.099 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52166.log.gz 2023-10-14T11:16:01.099 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49272.log 2023-10-14T11:16:01.100 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44720.log.gz 2023-10-14T11:16:01.100 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42182.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42182.log.gz 2023-10-14T11:16:01.101 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50221.log 2023-10-14T11:16:01.102 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.49272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43808.log 2023-10-14T11:16:01.103 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50221.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50221.log.gz 2023-10-14T11:16:01.104 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45312.log 2023-10-14T11:16:01.104 INFO:teuthology.orchestra.run.smithi026.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.49272.log.gz 2023-10-14T11:16:01.105 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43808.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43808.log.gz 2023-10-14T11:16:01.105 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52114.log 2023-10-14T11:16:01.107 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45312.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45312.log.gz 2023-10-14T11:16:01.107 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43813.log 2023-10-14T11:16:01.108 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51096.log 2023-10-14T11:16:01.109 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52114.log.gz 2023-10-14T11:16:01.110 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43813.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.43813.log.gz --verbose 2023-10-14T11:16:01.110 INFO:teuthology.orchestra.run.smithi026.stderr: -- /var/log/ceph/ceph-client.admin.43619.log 2023-10-14T11:16:01.111 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51096.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51096.log.gz 2023-10-14T11:16:01.112 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48548.log 2023-10-14T11:16:01.113 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43619.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43619.log.gz 2023-10-14T11:16:01.113 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46739.log 2023-10-14T11:16:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48548.log: gzip -5 89.1% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.48548.log.gz /var/log/ceph/ceph-client.admin.44607.log 2023-10-14T11:16:01.115 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-14T11:16:01.116 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43823.log 2023-10-14T11:16:01.117 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46739.log.gz 2023-10-14T11:16:01.117 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44607.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44607.log.gz 2023-10-14T11:16:01.118 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43620.log 2023-10-14T11:16:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49942.log 2023-10-14T11:16:01.119 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43823.log.gz 2023-10-14T11:16:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43620.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43620.log.gz 2023-10-14T11:16:01.121 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52491.log 2023-10-14T11:16:01.122 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49942.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49942.log.gz 2023-10-14T11:16:01.122 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42495.log 2023-10-14T11:16:01.123 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52491.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52491.log.gz 2023-10-14T11:16:01.124 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45416.log 2023-10-14T11:16:01.125 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42495.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42495.log.gz 2023-10-14T11:16:01.126 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43610.log 2023-10-14T11:16:01.127 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45416.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45416.log.gz 2023-10-14T11:16:01.127 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43604.log 2023-10-14T11:16:01.129 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48049.log 2023-10-14T11:16:01.129 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43610.log.gz 2023-10-14T11:16:01.130 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43604.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43604.log.gz 2023-10-14T11:16:01.130 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53011.log 2023-10-14T11:16:01.131 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48817.log 2023-10-14T11:16:01.132 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48049.log.gz 2023-10-14T11:16:01.133 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53011.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53011.log.gz 2023-10-14T11:16:01.133 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51122.log 2023-10-14T11:16:01.134 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.48817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42215.log 2023-10-14T11:16:01.135 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51122.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.48817.log.gz 2023-10-14T11:16:01.136 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- 87.8% /var/log/ceph/ceph-client.admin.50732.log 2023-10-14T11:16:01.136 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51122.log.gz 2023-10-14T11:16:01.137 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49000.log 2023-10-14T11:16:01.138 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42215.log.gz 2023-10-14T11:16:01.139 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50732.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50732.log.gz 2023-10-14T11:16:01.139 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51149.log 2023-10-14T11:16:01.140 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49000.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49000.log.gz 2023-10-14T11:16:01.141 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51149.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51149.log.gz 2023-10-14T11:16:01.357 INFO:teuthology.orchestra.run.smithi110.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-14T11:16:01.429 INFO:teuthology.orchestra.run.smithi110.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-14T11:16:01.434 INFO:teuthology.orchestra.run.smithi110.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-14T11:16:01.441 INFO:teuthology.orchestra.run.smithi110.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-14T11:16:01.444 INFO:teuthology.orchestra.run.smithi110.stderr: 2023-10-14T11:16:01.445 INFO:teuthology.orchestra.run.smithi110.stderr:real 0m0.864s 2023-10-14T11:16:01.445 INFO:teuthology.orchestra.run.smithi110.stderr:user 0m3.251s 2023-10-14T11:16:01.446 INFO:teuthology.orchestra.run.smithi110.stderr:sys 0m0.347s 2023-10-14T11:16:01.461 INFO:teuthology.orchestra.run.smithi026.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-14T11:16:01.546 INFO:teuthology.orchestra.run.smithi026.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-14T11:16:01.652 INFO:teuthology.orchestra.run.smithi026.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-14T11:16:01.704 INFO:teuthology.orchestra.run.smithi026.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-14T11:16:01.706 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-14T11:16:01.706 INFO:teuthology.orchestra.run.smithi026.stderr:real 0m1.164s 2023-10-14T11:16:01.707 INFO:teuthology.orchestra.run.smithi026.stderr:user 0m4.188s 2023-10-14T11:16:01.707 INFO:teuthology.orchestra.run.smithi026.stderr:sys 0m1.075s 2023-10-14T11:16:01.708 INFO:tasks.ceph:Archiving logs... 2023-10-14T11:16:01.709 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425250/remote/smithi026/log 2023-10-14T11:16:01.710 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T11:16:01.760 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-10-14T11:16:02.486 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425250/remote/smithi110/log 2023-10-14T11:16:02.487 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T11:16:02.899 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-14T11:16:02.908 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-14T11:16:02.909 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T11:16:02.913 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T11:16:03.003 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-14T11:16:03.012 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-14T11:16:03.013 DEBUG:teuthology.orchestra.run.smithi026:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T11:16:03.017 DEBUG:teuthology.orchestra.run.smithi110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T11:16:03.030 INFO:teuthology.orchestra.run.smithi026.stdout: remote refid st t when poll reach delay offset jitter 2023-10-14T11:16:03.031 INFO:teuthology.orchestra.run.smithi026.stdout:============================================================================== 2023-10-14T11:16:03.031 INFO:teuthology.orchestra.run.smithi026.stdout:+hv01.front.sepi 44.4.53.2 2 u 44 64 177 0.070 -6.388 1.353 2023-10-14T11:16:03.031 INFO:teuthology.orchestra.run.smithi026.stdout:*hv02.front.sepi 63.231.80.2 3 u 49 64 177 0.120 +2.185 2.384 2023-10-14T11:16:03.032 INFO:teuthology.orchestra.run.smithi026.stdout:+hv03.front.sepi 74.6.168.72 3 u 43 64 177 0.084 +2.105 2.558 2023-10-14T11:16:03.032 INFO:teuthology.orchestra.run.smithi026.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-14T11:16:03.033 INFO:teuthology.orchestra.run.smithi110.stdout: remote refid st t when poll reach delay offset jitter 2023-10-14T11:16:03.033 INFO:teuthology.orchestra.run.smithi110.stdout:============================================================================== 2023-10-14T11:16:03.033 INFO:teuthology.orchestra.run.smithi110.stdout:+hv01.front.sepi 44.4.53.2 2 u 52 64 177 0.090 -7.100 2.537 2023-10-14T11:16:03.033 INFO:teuthology.orchestra.run.smithi110.stdout:+hv02.front.sepi 63.231.80.2 3 u 48 64 177 0.090 -1.470 2.909 2023-10-14T11:16:03.034 INFO:teuthology.orchestra.run.smithi110.stdout:*hv03.front.sepi 74.6.168.72 3 u 48 64 177 0.063 +1.684 2.137 2023-10-14T11:16:03.034 INFO:teuthology.orchestra.run.smithi110.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-14T11:16:03.036 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-14T11:16:03.046 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-14T11:16:03.047 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-14T11:16:03.056 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-14T11:16:03.066 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-14T11:16:03.075 INFO:teuthology.task.internal:Duration was 971.558992 seconds 2023-10-14T11:16:03.076 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-14T11:16:03.085 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-14T11:16:03.085 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T11:16:03.089 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T11:16:03.198 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-14T11:16:03.199 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi026.front.sepia.ceph.com 2023-10-14T11:16:03.200 DEBUG:teuthology.orchestra.run.smithi026:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T11:16:03.223 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi110.front.sepia.ceph.com 2023-10-14T11:16:03.224 DEBUG:teuthology.orchestra.run.smithi110:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T11:16:03.250 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-14T11:16:03.250 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T11:16:03.272 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T11:16:03.327 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-14T11:16:03.328 DEBUG:teuthology.orchestra.run.smithi026:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T11:16:03.350 DEBUG:teuthology.orchestra.run.smithi110:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T11:16:03.439 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-14T11:16:03.450 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-14T11:16:03.450 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T11:16:03.473 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T11:16:03.495 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-14T11:16:03.506 DEBUG:teuthology.orchestra.run.smithi026:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T11:16:03.522 DEBUG:teuthology.orchestra.run.smithi110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T11:16:03.538 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = core 2023-10-14T11:16:03.554 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = core 2023-10-14T11:16:03.573 DEBUG:teuthology.orchestra.run.smithi026:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T11:16:03.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:16:03.607 DEBUG:teuthology.orchestra.run.smithi110:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T11:16:03.627 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:16:03.628 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-14T11:16:03.638 INFO:teuthology.task.internal:Transferring archived files... 2023-10-14T11:16:03.639 DEBUG:teuthology.misc:Transferring archived files from smithi026:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425250/remote/smithi026 2023-10-14T11:16:03.639 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T11:16:03.676 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425250/remote/smithi110 2023-10-14T11:16:03.677 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T11:16:03.701 INFO:teuthology.task.internal:Removing archive directory... 2023-10-14T11:16:03.702 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T11:16:03.718 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T11:16:03.752 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-14T11:16:03.764 INFO:teuthology.task.internal:Not uploading archives. 2023-10-14T11:16:03.765 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-14T11:16:03.776 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-14T11:16:03.777 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T11:16:03.781 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T11:16:03.786 INFO:teuthology.orchestra.run.smithi026.stdout: 657968 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 14 11:16 /home/ubuntu/cephtest 2023-10-14T11:16:03.805 INFO:teuthology.orchestra.run.smithi110.stdout: 657966 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 14 11:16 /home/ubuntu/cephtest 2023-10-14T11:16:03.807 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-14T11:16:03.818 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-14T11:16:03.841 INFO:teuthology.nuke:Checking targets against current locks 2023-10-14T11:16:03.869 DEBUG:teuthology.nuke:shortname: smithi026 2023-10-14T11:16:03.870 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T11:16:03.892 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425250', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 10:51:07.056865', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDPZroadSD0byLS/OQDU3rLFQxFrNb4uy/8dC1Q84XD54SKs2u9fZvALTgT2TlZqTou2kAJC3FXc4kmbpY/4Vrc='} 2023-10-14T11:16:03.896 DEBUG:teuthology.nuke:shortname: smithi110 2023-10-14T11:16:03.896 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T11:16:03.916 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425250', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 10:51:07.058604', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDaOgbq01oTcfIYZm6TGeOaOza33787dpNubwTK4SNRqD6Wz4P/rF8IfrmDKuzbcpBAWSWfoOcgzkXI7cr8x1EQ='} 2023-10-14T11:16:03.947 INFO:teuthology.orchestra.console.smithi026:Power off 2023-10-14T11:16:03.948 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T11:16:03.972 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2023-10-14T11:16:03.973 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:16:03.989 INFO:teuthology.orchestra.console.smithi110:Power off 2023-10-14T11:16:03.989 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T11:16:03.998 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-10-14T11:16:04.011 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2023-10-14T11:16:04.012 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:16:04.034 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2023-10-14T11:16:08.000 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:16:08.036 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:16:08.112 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-10-14T11:16:08.147 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2023-10-14T11:16:12.114 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:16:12.148 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:16:12.224 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-10-14T11:16:12.260 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-10-14T11:16:12.325 INFO:teuthology.orchestra.console.smithi026:Power off completed 2023-10-14T11:16:12.360 INFO:teuthology.orchestra.console.smithi110:Power off completed 2023-10-14T11:16:12.466 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} duration: 971.5589919090271 failure_reason: 'Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm)' flavor: default mon.a-kernel-sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 mon.b-kernel-sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=3fc2d7b4618f44f4a1a5f673abfe7e43 status: fail success: false 2023-10-14T11:16:12.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T11:16:12.544 INFO:teuthology.run:FAIL